2024-05-08T20:12:41.840 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T20:12:41.841 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003 --verbose --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/orig.config.yaml 2024-05-08T20:12:41.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:12:41.993 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698003' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: client.0: cephfs_name: a client.1: cephfs_name: b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCX4ZeGH/UALomv+8P+omEkUJY0002zBL7lyTx8dG0vCQuqQtHcDurF5lyS1XyR82c3CAf5QcOaiQT1YuyIh0NE= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFyO6jbophzi76lXpKVvK9jSf8Hj7Rtxhn4jaZIPDTmRQEYHNKPU4nXTYwsCg4rSSd7VB8rWvo//4hTgUKYCEk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T20:12:41.994 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T20:12:41.994 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T20:12:41.995 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T20:12:41.996 INFO:teuthology.task.internal:Checking packages... 2024-05-08T20:12:42.020 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T20:12:42.020 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T20:12:42.021 INFO:teuthology.packaging:ref: None 2024-05-08T20:12:42.021 INFO:teuthology.packaging:tag: None 2024-05-08T20:12:42.021 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:12:42.021 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:12:42.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:12:42.172 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:12:42.174 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T20:12:42.181 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T20:12:42.181 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T20:12:42.200 INFO:teuthology.task.internal:Saving configuration 2024-05-08T20:12:42.218 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T20:12:42.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T20:12:42.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:07:11.942211', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJBpzJ1EJNrEOMTule2LmtvUAwE6LWyGNJyrlDCp+1Os'} 2024-05-08T20:12:42.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:07:11.940755', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGPguaNxIorC51ZMvMo3t2iRzoltJDgdSA0GK8tS5w+r'} 2024-05-08T20:12:42.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T20:12:42.282 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T20:12:42.282 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-05-08T20:12:42.282 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T20:12:42.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff8592b430>, signals=[15]) 2024-05-08T20:12:42.357 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T20:12:42.366 INFO:teuthology.task.internal:Opening connections... 2024-05-08T20:12:42.366 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:12:42.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:12:42.452 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:12:42.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:12:42.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T20:12:42.546 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-05-08T20:12:42.552 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-05-08T20:12:42.552 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-05-08T20:12:42.603 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-05-08T20:12:42.604 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T20:12:42.604 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T20:12:42.604 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T20:12:42.604 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T20:12:42.604 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-05-08T20:12:42.604 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-05-08T20:12:42.622 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-05-08T20:12:42.627 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-05-08T20:12:42.627 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-05-08T20:12:42.678 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T20:12:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2024-05-08T20:12:42.679 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-05-08T20:12:42.705 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T20:12:42.717 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T20:12:42.775 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T20:12:42.775 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:12:42.778 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:12:42.783 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T20:12:42.802 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T20:12:42.802 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:12:42.826 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:12:42.833 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T20:12:42.894 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T20:12:42.918 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T20:12:42.918 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T20:12:42.918 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:12:42.919 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:12:42.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:12:42.923 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-05-08T20:12:42.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:12:42.925 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-08T20:12:42.971 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-56-generic 2024-05-08T20:12:42.971 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.15.0-56-generic 2024-05-08T20:12:42.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-05-08T20:12:42.973 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-05-08T20:12:42.974 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-05-08T20:12:42.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-05-08T20:12:43.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T20:12:43.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-05-08T20:12:43.225 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:12:43.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T20:12:43.242 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:12:43.271 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T20:12:43.319 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T20:12:43.345 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T20:12:43.352 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T20:12:43.352 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T20:12:43.467 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T20:12:43.510 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T20:12:43.549 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T20:12:43.594 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T20:12:43.601 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T20:12:43.602 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T20:12:43.630 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T20:12:43.630 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T20:12:43.635 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T20:12:43.635 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T20:12:43.638 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T20:12:43.642 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T20:12:43.649 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T20:12:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T20:12:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T20:12:43.655 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T20:12:43.679 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T20:12:43.681 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T20:12:43.681 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T20:12:43.682 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T20:12:43.684 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T20:12:43.700 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T20:12:43.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T20:12:43.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T20:12:43.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T20:12:43.702 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T20:12:43.718 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T20:12:43.718 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T20:12:43.720 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T20:12:43.725 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T20:12:43.726 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T20:12:43.726 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T20:12:43.726 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T20:12:43.726 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T20:12:43.727 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T20:12:43.727 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T20:12:43.727 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T20:12:43.727 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T20:12:43.728 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T20:12:43.739 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T20:12:43.748 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T20:12:43.749 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T20:12:43.751 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T20:12:43.751 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T20:12:43.751 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T20:12:43.760 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T20:12:43.761 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T20:12:43.761 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T20:12:43.789 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T20:12:43.800 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T20:12:44.075 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T20:12:44.085 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T20:12:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T20:12:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T20:12:44.256 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T20:12:44.256 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T20:12:44.258 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T20:12:44.266 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T20:12:44.267 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T20:12:44.340 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T20:12:44.348 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T20:12:44.349 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T20:12:44.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T20:12:44.350 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T20:12:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T20:12:44.359 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T20:12:44.369 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T20:12:44.374 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T20:12:44.546 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T20:12:44.556 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T20:12:44.944 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T20:12:44.950 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T20:12:44.954 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T20:12:44.960 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T20:12:44.964 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T20:12:44.965 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T20:12:44.967 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T20:12:44.974 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T20:12:44.974 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T20:12:44.977 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T20:12:49.256 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 13.4 MB in 2s (7,223 kB/s) 2024-05-08T20:12:49.417 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 13.4 MB in 2s (7,034 kB/s) 2024-05-08T20:12:50.529 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:12:50.546 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:12:50.608 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:12:50.741 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:12:50.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:12:50.810 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T20:12:50.810 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T20:12:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:12:50.987 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:12:50.987 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:12:50.987 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:12:50.987 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:12:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T20:12:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: python2.7-minimal 2024-05-08T20:12:50.988 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:12:50.989 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-05-08T20:12:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T20:12:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T20:12:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T20:12:50.990 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-05-08T20:12:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T20:12:50.991 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-05-08T20:12:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2024-05-08T20:12:51.013 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-05-08T20:12:51.014 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-05-08T20:12:51.041 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-05-08T20:12:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T20:12:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T20:12:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T20:12:51.043 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-05-08T20:12:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T20:12:51.101 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T20:12:51.101 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 113 MB of archives. 2024-05-08T20:12:51.101 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T20:12:51.101 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T20:12:51.191 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:12:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:12:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:12:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:12:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T20:12:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-05-08T20:12:51.192 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:12:51.193 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-05-08T20:12:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T20:12:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T20:12:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T20:12:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-05-08T20:12:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T20:12:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-05-08T20:12:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-05-08T20:12:51.242 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-05-08T20:12:51.242 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T20:12:51.242 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T20:12:51.242 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T20:12:51.243 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-05-08T20:12:51.244 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T20:12:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T20:12:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-05-08T20:12:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T20:12:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T20:12:51.713 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T20:12:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T20:12:52.267 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T20:12:52.541 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T20:12:53.733 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T20:12:53.733 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T20:12:53.734 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T20:12:54.014 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T20:12:54.081 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T20:12:54.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T20:12:54.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T20:12:54.391 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T20:12:54.478 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 113 MB in 3s (37.4 MB/s) 2024-05-08T20:12:54.559 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T20:12:54.597 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T20:12:54.654 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T20:12:54.978 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 3s (33.9 MB/s) 2024-05-08T20:12:55.161 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T20:12:56.626 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T20:12:56.631 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:12:56.709 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:12:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T20:12:57.230 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:12:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:12:58.860 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T20:12:58.882 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:12:58.961 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:12:59.564 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T20:12:59.584 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:12:59.726 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T20:12:59.748 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:12:59.838 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:12:59.844 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:00.305 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T20:13:00.326 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:13:00.363 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:06.356 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:06.489 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:06.864 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:06.907 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:06.992 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:07.017 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:07.270 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T20:13:07.293 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T20:13:07.308 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:07.337 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T20:13:07.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T20:13:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T20:13:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T20:13:12.735 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T20:13:12.772 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:13:12.810 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:13.507 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T20:13:13.544 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T20:13:13.582 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:16.005 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:16.128 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:16.470 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T20:13:16.591 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:16.611 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T20:13:16.717 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T20:13:16.736 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T20:13:16.862 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:17.078 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T20:13:17.200 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:17.326 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T20:13:17.454 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:18.194 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:18.194 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:18.195 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:18.195 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:18.347 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:18.910 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:19.573 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:19.849 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:20.975 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:21.241 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T20:13:21.367 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T20:13:21.493 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:21.555 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T20:13:21.555 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:22.384 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T20:13:22.485 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T20:13:22.587 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T20:13:22.646 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T20:13:22.646 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:35.980 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T20:13:35.980 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2024-05-08T20:13:35.987 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:13:36.005 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2024-05-08T20:13:36.265 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:36.289 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:36.310 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T20:13:36.310 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-05-08T20:13:36.317 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:13:36.337 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-05-08T20:13:36.587 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:36.592 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:36.660 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T20:13:36.665 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T20:13:36.697 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:36.718 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:36.823 INFO:teuthology.orchestra.run.smithi117.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T20:13:36.823 INFO:teuthology.orchestra.run.smithi117.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T20:13:36.823 INFO:teuthology.orchestra.run.smithi117.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T20:13:36.870 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-05-08T20:13:37.114 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:37.119 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:37.187 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T20:13:37.191 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T20:13:37.335 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-05-08T20:13:37.361 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T20:13:37.361 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T20:13:37.362 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T20:13:37.362 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.106.106 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-05-08T20:13:37.363 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-05-08T20:13:37.364 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:13:37.364 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-05-08T20:13:37.364 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T20:13:37.364 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T20:13:37.364 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T20:13:37.364 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-08T20:13:37.364 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T20:13:37.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2024-05-08T20:13:37.401 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-05-08T20:13:37.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T20:13:37.668 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T20:13:37.668 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:13:37.686 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T20:13:37.707 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T20:13:37.876 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-05-08T20:13:37.894 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-05-08T20:13:37.894 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.106.106 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-05-08T20:13:37.895 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-05-08T20:13:37.896 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:13:37.896 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-05-08T20:13:37.896 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T20:13:37.896 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T20:13:37.896 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T20:13:37.896 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T20:13:37.896 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T20:13:37.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-05-08T20:13:38.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-05-08T20:13:38.223 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:13:38.223 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T20:13:38.233 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T20:13:38.253 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T20:13:39.014 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:13:39.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:13:39.089 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:13:39.297 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T20:13:39.298 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T20:13:39.463 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:13:39.464 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:13:39.501 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T20:13:39.503 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 21 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.106.106 2024-05-08T20:13:39.519 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T20:13:39.520 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:13:39.520 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2024-05-08T20:13:39.520 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2024-05-08T20:13:39.520 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:13:39.520 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2024-05-08T20:13:39.520 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-08T20:13:39.566 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.zvtW9gyanQ 2024-05-08T20:13:39.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zvtW9gyanQ 2024-05-08T20:13:39.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.zvtW9gyanQ 2024-05-08T20:13:39.620 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:13:39.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:13:39.691 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:13:39.727 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.zvtW9gyanQ is 10KB 2024-05-08T20:13:39.784 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.zvtW9gyanQ 2024-05-08T20:13:39.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T20:13:39.846 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:13:39.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T20:13:39.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T20:13:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-05-08T20:13:39.867 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-05-08T20:13:39.909 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T20:13:39.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2024-05-08T20:13:40.023 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T20:13:40.023 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:13:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:13:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:13:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:13:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:13:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:13:40.024 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:13:40.063 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T20:13:40.065 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.106.106 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T20:13:40.123 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:13:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-05-08T20:13:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-05-08T20:13:40.124 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:13:40.124 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-05-08T20:13:40.124 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-05-08T20:13:40.170 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.whmdC1iRQQ 2024-05-08T20:13:40.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.whmdC1iRQQ 2024-05-08T20:13:40.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.whmdC1iRQQ 2024-05-08T20:13:40.342 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.whmdC1iRQQ is 10KB 2024-05-08T20:13:40.355 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.whmdC1iRQQ 2024-05-08T20:13:40.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T20:13:40.415 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:13:40.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T20:13:40.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T20:13:40.491 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T20:13:40.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-05-08T20:13:41.110 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2024-05-08T20:13:41.111 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:13:41.121 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-05-08T20:13:41.272 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:41.278 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:41.510 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:41.516 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:41.557 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T20:13:41.562 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T20:13:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T20:13:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T20:13:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T20:13:41.693 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-05-08T20:13:41.694 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:13:41.696 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-05-08T20:13:41.703 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-05-08T20:13:41.711 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-05-08T20:13:41.866 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T20:13:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T20:13:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T20:13:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T20:13:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T20:13:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T20:13:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T20:13:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T20:13:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T20:13:42.410 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-05-08T20:13:42.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-05-08T20:14:11.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T20:14:11.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:14:11.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:14:12.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T20:14:12.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:14:12.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:14:46.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-08T20:14:47.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-05-08T20:14:55.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:14:55.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:14:56.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:14:56.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:15:13.699 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-08T20:15:14.466 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-05-08T20:15:25.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:15:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:15:26.377 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-08T20:15:26.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:15:26.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:15:26.674 ERROR:teuthology.orchestra.connection:Error authenticating with smithi081.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-05-08T20:15:27.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:15:27.293 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-08T20:15:27.293 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-08T20:15:27.343 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-106-generic 2024-05-08T20:15:27.343 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T20:15:27.343 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T20:15:27.344 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T20:15:28.345 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T20:15:28.345 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:15:28.694 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-05-08T20:15:28.722 DEBUG:teuthology.parallel:result is None 2024-05-08T20:15:30.763 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-05-08T20:15:31.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:15:31.697 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-08T20:15:31.697 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-05-08T20:15:31.745 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-106-generic 2024-05-08T20:15:31.745 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T20:15:31.745 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T20:15:31.745 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T20:15:32.746 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T20:15:32.748 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:15:32.831 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-05-08T20:15:32.859 DEBUG:teuthology.parallel:result is None 2024-05-08T20:15:32.859 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T20:15:32.866 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T20:15:32.866 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:15:32.868 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:15:32.874 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T20:15:32.881 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T20:15:32.889 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T20:15:32.889 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:15:32.918 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:15:32.941 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T20:15:32.950 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T20:15:32.950 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:15:32.982 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:15:33.007 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:15:33.009 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:15:33.014 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:15:33.017 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:15:33.018 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T20:15:33.025 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T20:15:33.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:15:33.058 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:15:33.071 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T20:15:33.080 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T20:15:33.080 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:15:33.110 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:15:33.120 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:15:33.161 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:15:33.211 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:15:33.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:15:33.349 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:15:33.355 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:15:33.400 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:15:33.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:15:33.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-05-08T20:15:33.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-05-08T20:15:33.547 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T20:15:33.554 INFO:teuthology.task.internal:Starting timer... 2024-05-08T20:15:33.554 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T20:15:33.696 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T20:15:33.722 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-05-08T20:15:33.723 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2024-05-08T20:15:33.723 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T20:15:33.723 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T20:15:33.723 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T20:15:33.723 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T20:15:33.731 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T20:15:33.749 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T20:15:33.750 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T20:22:41.413 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-05-08T20:22:41.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:22:41.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:22:41.496 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-05-08T20:22:41.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T20:22:41.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:22:41.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:22:41.658 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-08T20:22:41.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-08T20:22:41.735 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T20:22:41.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T20:22:41.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:22:41.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:22:41.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:22:41.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Command line: ntpd -gq 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: ---------------------------------------------------- 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: corporation. Support and training for ntp-4 are 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: available at https://www.nwtime.org/support 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: ---------------------------------------------------- 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: proto: precision = 0.061 usec (-24) 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: basedate set to 2022-02-04 2024-05-08T20:22:41.777 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: gps base set to 2022-02-06 (week 2196) 2024-05-08T20:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:22:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:22:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:22:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T20:22:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T20:22:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T20:22:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-05-08T20:22:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen normally on 4 lo [::1]:123 2024-05-08T20:22:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-05-08T20:22:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:41 ntpd[17274]: Listening on routing socket on fd #22 for interface updates 2024-05-08T20:22:41.802 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T20:22:41.802 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Command line: ntpd -gq 2024-05-08T20:22:41.802 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: ---------------------------------------------------- 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: corporation. Support and training for ntp-4 are 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: available at https://www.nwtime.org/support 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: ---------------------------------------------------- 2024-05-08T20:22:41.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: proto: precision = 0.060 usec (-24) 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: basedate set to 2022-02-04 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: gps base set to 2022-02-06 (week 2196) 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:22:41.804 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:22:41.805 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T20:22:41.805 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T20:22:41.805 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T20:22:41.806 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2024-05-08T20:22:41.806 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen normally on 4 lo [::1]:123 2024-05-08T20:22:41.806 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2024-05-08T20:22:41.806 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:41 ntpd[17244]: Listening on routing socket on fd #22 for interface updates 2024-05-08T20:22:42.777 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:42.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:42 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:42.802 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:42 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:42.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:42 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:43.777 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:43 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:43.777 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:43 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:43.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:43 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:44.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:44.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:44.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:44.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:44 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:44.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:44.805 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:44.806 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:44.806 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:44 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:45.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:45 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:46 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:46.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:46.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:46.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:46.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:46 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:47.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:47 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:48.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.778 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.779 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:48.780 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:48.781 INFO:teuthology.orchestra.run.smithi081.stdout: 8 May 20:22:48 ntpd[17274]: ntpd: time slew +0.000232 s 2024-05-08T20:22:48.781 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.000232s 2024-05-08T20:22:48.782 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T20:22:48.782 INFO:teuthology.orchestra.run.smithi081.stderr: 8 May 20:22:48 ntpd[17274]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:48.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:48.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:48.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:48.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:48.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:48 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:49.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:49.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:49.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:22:49.803 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:22:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: 8 May 20:22:49 ntpd[17244]: ntpd: time slew -0.000903 s 2024-05-08T20:22:49.804 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew -0.000903s 2024-05-08T20:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T20:22:49.804 INFO:teuthology.orchestra.run.smithi117.stderr: 8 May 20:22:49 ntpd[17244]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T20:22:49.848 INFO:teuthology.run_tasks:Running task install... 2024-05-08T20:22:49.857 DEBUG:teuthology.task.install:project ceph 2024-05-08T20:22:49.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T20:22:49.857 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T20:22:49.857 INFO:teuthology.task.install:Using flavor: default 2024-05-08T20:22:49.863 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T20:22:49.863 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T20:22:49.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-05-08T20:22:49.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2024-05-08T20:22:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T20:22:49.949 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T20:22:49.955 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T20:22:49.955 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T20:22:49.956 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-08T20:22:49.956 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-08T20:22:49.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:22:49.977 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T20:22:49.977 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T20:22:49.978 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-08T20:22:49.978 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-08T20:22:49.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:22:50.188 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default/ 2024-05-08T20:22:50.188 INFO:teuthology.task.install.deb:Package version is 18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:22:50.194 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default/ 2024-05-08T20:22:50.194 INFO:teuthology.task.install.deb:Package version is 18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:22:50.303 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:22:50.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T20:22:50.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-05-08T20:22:50.365 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:22:50.366 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T20:22:50.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2024-05-08T20:22:50.493 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T20:22:50.548 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T20:22:50.552 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:22:50.564 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T20:22:50.569 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T20:22:50.584 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T20:22:50.591 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T20:22:50.600 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T20:22:50.606 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T20:22:50.612 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-05-08T20:22:50.621 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T20:22:50.639 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,426 B] 2024-05-08T20:22:50.643 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T20:22:50.664 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,426 B] 2024-05-08T20:22:50.670 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T20:22:50.688 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T20:22:50.691 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-05-08T20:22:50.770 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T20:22:50.902 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.8 kB in 0s (84.2 kB/s) 2024-05-08T20:22:50.904 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.8 kB in 0s (70.1 kB/s) 2024-05-08T20:22:51.838 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:22:51.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1322-gd21e4f96-1jammy cephadm=18.2.2-1322-gd21e4f96-1jammy ceph-mds=18.2.2-1322-gd21e4f96-1jammy ceph-mgr=18.2.2-1322-gd21e4f96-1jammy ceph-common=18.2.2-1322-gd21e4f96-1jammy ceph-fuse=18.2.2-1322-gd21e4f96-1jammy ceph-test=18.2.2-1322-gd21e4f96-1jammy ceph-volume=18.2.2-1322-gd21e4f96-1jammy radosgw=18.2.2-1322-gd21e4f96-1jammy python3-rados=18.2.2-1322-gd21e4f96-1jammy python3-rgw=18.2.2-1322-gd21e4f96-1jammy python3-cephfs=18.2.2-1322-gd21e4f96-1jammy python3-rbd=18.2.2-1322-gd21e4f96-1jammy libcephfs2=18.2.2-1322-gd21e4f96-1jammy libcephfs-dev=18.2.2-1322-gd21e4f96-1jammy librados2=18.2.2-1322-gd21e4f96-1jammy librbd1=18.2.2-1322-gd21e4f96-1jammy rbd-fuse=18.2.2-1322-gd21e4f96-1jammy python3-cephfs=18.2.2-1322-gd21e4f96-1jammy cephfs-shell=18.2.2-1322-gd21e4f96-1jammy cephfs-top=18.2.2-1322-gd21e4f96-1jammy cephfs-mirror=18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:22:51.903 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:22:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:22:51.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1322-gd21e4f96-1jammy cephadm=18.2.2-1322-gd21e4f96-1jammy ceph-mds=18.2.2-1322-gd21e4f96-1jammy ceph-mgr=18.2.2-1322-gd21e4f96-1jammy ceph-common=18.2.2-1322-gd21e4f96-1jammy ceph-fuse=18.2.2-1322-gd21e4f96-1jammy ceph-test=18.2.2-1322-gd21e4f96-1jammy ceph-volume=18.2.2-1322-gd21e4f96-1jammy radosgw=18.2.2-1322-gd21e4f96-1jammy python3-rados=18.2.2-1322-gd21e4f96-1jammy python3-rgw=18.2.2-1322-gd21e4f96-1jammy python3-cephfs=18.2.2-1322-gd21e4f96-1jammy python3-rbd=18.2.2-1322-gd21e4f96-1jammy libcephfs2=18.2.2-1322-gd21e4f96-1jammy libcephfs-dev=18.2.2-1322-gd21e4f96-1jammy librados2=18.2.2-1322-gd21e4f96-1jammy librbd1=18.2.2-1322-gd21e4f96-1jammy rbd-fuse=18.2.2-1322-gd21e4f96-1jammy python3-cephfs=18.2.2-1322-gd21e4f96-1jammy cephfs-shell=18.2.2-1322-gd21e4f96-1jammy cephfs-top=18.2.2-1322-gd21e4f96-1jammy cephfs-mirror=18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:22:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:22:52.104 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-05-08T20:22:52.105 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-05-08T20:22:52.193 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T20:22:52.194 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T20:22:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:22:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:22:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:22:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:22:52.276 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:22:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:22:52.277 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:22:52.277 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-05-08T20:22:52.277 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T20:22:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T20:22:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-05-08T20:22:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T20:22:52.278 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-08T20:22:52.279 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n socat xmlstarlet 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-05-08T20:22:52.280 INFO:teuthology.orchestra.run.smithi081.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-05-08T20:22:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-05-08T20:22:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-05-08T20:22:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: python3-watchdog 2024-05-08T20:22:52.281 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-05-08T20:22:52.281 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-05-08T20:22:52.383 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-05-08T20:22:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T20:22:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-05-08T20:22:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-08T20:22:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-08T20:22:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: socat xmlstarlet 2024-05-08T20:22:52.392 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:22:52.392 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:22:52.392 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:22:52.392 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:22:52.393 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:22:52.393 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:22:52.393 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:22:52.394 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-05-08T20:22:52.394 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T20:22:52.394 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T20:22:52.394 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-05-08T20:22:52.394 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-08T20:22:52.395 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-08T20:22:52.396 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n socat xmlstarlet 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: python3-watchdog 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2024-05-08T20:22:52.397 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2024-05-08T20:22:52.451 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 115 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T20:22:52.451 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 163 MB of archives. 2024-05-08T20:22:52.451 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 745 MB of additional disk space will be used. 2024-05-08T20:22:52.451 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-08T20:22:52.472 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T20:22:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-08T20:22:52.501 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-08T20:22:52.502 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T20:22:52.503 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T20:22:52.504 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-08T20:22:52.505 INFO:teuthology.orchestra.run.smithi117.stdout: socat xmlstarlet 2024-05-08T20:22:52.536 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-05-08T20:22:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T20:22:52.595 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T20:22:52.597 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T20:22:52.615 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T20:22:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1322-gd21e4f96-1jammy [3,446 kB] 2024-05-08T20:22:52.645 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 115 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T20:22:52.645 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 163 MB of archives. 2024-05-08T20:22:52.645 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 745 MB of additional disk space will be used. 2024-05-08T20:22:52.645 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1322-gd21e4f96-1jammy [3,446 kB] 2024-05-08T20:22:52.691 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-08T20:22:52.709 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T20:22:52.716 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T20:22:52.732 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T20:22:52.737 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T20:22:52.738 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T20:22:52.749 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T20:22:52.750 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T20:22:52.750 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T20:22:52.751 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T20:22:52.752 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T20:22:52.773 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T20:22:52.776 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T20:22:52.777 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T20:22:52.777 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T20:22:52.778 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T20:22:52.797 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T20:22:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T20:22:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T20:22:52.803 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T20:22:52.804 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T20:22:52.806 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T20:22:52.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T20:22:52.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T20:22:52.819 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-08T20:22:52.820 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T20:22:52.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T20:22:52.838 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T20:22:52.848 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T20:22:52.848 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T20:22:52.849 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T20:22:52.850 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T20:22:52.852 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T20:22:52.859 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T20:22:52.861 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T20:22:52.863 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T20:22:52.864 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T20:22:52.880 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T20:22:52.881 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T20:22:52.882 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T20:22:52.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T20:22:52.955 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T20:22:52.956 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T20:22:52.957 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T20:22:52.957 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T20:22:52.958 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T20:22:52.967 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T20:22:52.968 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T20:22:52.970 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T20:22:52.971 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T20:22:52.978 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T20:22:53.001 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T20:22:53.003 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T20:22:53.003 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T20:22:53.022 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-05-08T20:22:53.024 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T20:22:53.024 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T20:22:53.024 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T20:22:53.027 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T20:22:53.027 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T20:22:53.028 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T20:22:53.034 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T20:22:53.035 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T20:22:53.038 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T20:22:53.055 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T20:22:53.056 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T20:22:53.057 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T20:22:53.060 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T20:22:53.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T20:22:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-08T20:22:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T20:22:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T20:22:53.075 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T20:22:53.076 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T20:22:53.078 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T20:22:53.088 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1322-gd21e4f96-1jammy [3,106 kB] 2024-05-08T20:22:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T20:22:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T20:22:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T20:22:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T20:22:53.149 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T20:22:53.195 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T20:22:53.262 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1322-gd21e4f96-1jammy [680 kB] 2024-05-08T20:22:53.300 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1322-gd21e4f96-1jammy [357 kB] 2024-05-08T20:22:53.319 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1322-gd21e4f96-1jammy [32.8 kB] 2024-05-08T20:22:53.320 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1322-gd21e4f96-1jammy [180 kB] 2024-05-08T20:22:53.324 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1322-gd21e4f96-1jammy [63.7 kB] 2024-05-08T20:22:53.325 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1322-gd21e4f96-1jammy [330 kB] 2024-05-08T20:22:53.342 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1322-gd21e4f96-1jammy [5,891 kB] 2024-05-08T20:22:53.361 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T20:22:53.370 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T20:22:53.396 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T20:22:53.536 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1322-gd21e4f96-1jammy [3,106 kB] 2024-05-08T20:22:53.568 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T20:22:53.579 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1322-gd21e4f96-1jammy [112 kB] 2024-05-08T20:22:53.582 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1322-gd21e4f96-1jammy [441 kB] 2024-05-08T20:22:53.597 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1322-gd21e4f96-1jammy [21.9 MB] 2024-05-08T20:22:53.763 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T20:22:54.048 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1322-gd21e4f96-1jammy [680 kB] 2024-05-08T20:22:54.132 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T20:22:54.139 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T20:22:54.141 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T20:22:54.153 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T20:22:54.154 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T20:22:54.155 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T20:22:54.157 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T20:22:54.159 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T20:22:54.161 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T20:22:54.161 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1322-gd21e4f96-1jammy [357 kB] 2024-05-08T20:22:54.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1322-gd21e4f96-1jammy [32.8 kB] 2024-05-08T20:22:54.229 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1322-gd21e4f96-1jammy [180 kB] 2024-05-08T20:22:54.255 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1322-gd21e4f96-1jammy [63.7 kB] 2024-05-08T20:22:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1322-gd21e4f96-1jammy [330 kB] 2024-05-08T20:22:54.326 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1322-gd21e4f96-1jammy [5,891 kB] 2024-05-08T20:22:54.328 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T20:22:54.550 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1322-gd21e4f96-1jammy [5,002 kB] 2024-05-08T20:22:54.752 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1322-gd21e4f96-1jammy [241 kB] 2024-05-08T20:22:54.761 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1322-gd21e4f96-1jammy [130 kB] 2024-05-08T20:22:54.765 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1322-gd21e4f96-1jammy [1,491 kB] 2024-05-08T20:22:54.782 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T20:22:54.793 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1322-gd21e4f96-1jammy [6,080 kB] 2024-05-08T20:22:54.794 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T20:22:54.803 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T20:22:54.805 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T20:22:54.826 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T20:22:54.831 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T20:22:54.833 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T20:22:54.869 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T20:22:54.886 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T20:22:54.892 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T20:22:55.038 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1322-gd21e4f96-1jammy [22.3 MB] 2024-05-08T20:22:55.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1322-gd21e4f96-1jammy [112 kB] 2024-05-08T20:22:55.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1322-gd21e4f96-1jammy [441 kB] 2024-05-08T20:22:55.300 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1322-gd21e4f96-1jammy [21.9 MB] 2024-05-08T20:22:55.560 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T20:22:55.644 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T20:22:55.736 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T20:22:55.794 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T20:22:55.928 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T20:22:56.053 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1322-gd21e4f96-1jammy [14.1 kB] 2024-05-08T20:22:56.054 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1322-gd21e4f96-1jammy [831 kB] 2024-05-08T20:22:56.070 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1322-gd21e4f96-1jammy [2,155 kB] 2024-05-08T20:22:56.108 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1322-gd21e4f96-1jammy [238 kB] 2024-05-08T20:22:56.111 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1322-gd21e4f96-1jammy [145 kB] 2024-05-08T20:22:56.113 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1322-gd21e4f96-1jammy [2,237 kB] 2024-05-08T20:22:56.212 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1322-gd21e4f96-1jammy [8,625 kB] 2024-05-08T20:22:56.311 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T20:22:56.439 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T20:22:56.582 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1322-gd21e4f96-1jammy [14.3 kB] 2024-05-08T20:22:56.582 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1322-gd21e4f96-1jammy [42.6 MB] 2024-05-08T20:22:56.814 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T20:22:56.956 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T20:22:57.466 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T20:22:57.575 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T20:22:57.885 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T20:22:58.305 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T20:22:58.593 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1322-gd21e4f96-1jammy [121 kB] 2024-05-08T20:22:58.596 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1322-gd21e4f96-1jammy [230 kB] 2024-05-08T20:22:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1322-gd21e4f96-1jammy [5,002 kB] 2024-05-08T20:22:58.601 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1322-gd21e4f96-1jammy [34.1 kB] 2024-05-08T20:22:58.602 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1322-gd21e4f96-1jammy [23.5 kB] 2024-05-08T20:22:58.603 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1322-gd21e4f96-1jammy [38.3 kB] 2024-05-08T20:22:58.604 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1322-gd21e4f96-1jammy [11.6 MB] 2024-05-08T20:22:58.732 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T20:22:58.734 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T20:22:58.737 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T20:22:58.738 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T20:22:58.740 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T20:22:58.740 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T20:22:58.741 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T20:22:58.746 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T20:22:58.746 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T20:22:58.915 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T20:22:58.959 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1322-gd21e4f96-1jammy [93.1 kB] 2024-05-08T20:22:59.059 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1322-gd21e4f96-1jammy [241 kB] 2024-05-08T20:22:59.068 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1322-gd21e4f96-1jammy [130 kB] 2024-05-08T20:22:59.075 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1322-gd21e4f96-1jammy [1,491 kB] 2024-05-08T20:22:59.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1322-gd21e4f96-1jammy [6,080 kB] 2024-05-08T20:22:59.600 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1322-gd21e4f96-1jammy [22.3 MB] 2024-05-08T20:22:59.627 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T20:22:59.632 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T20:22:59.633 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T20:22:59.685 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T20:22:59.708 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T20:22:59.710 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T20:22:59.711 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T20:22:59.712 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T20:22:59.714 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T20:22:59.715 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T20:22:59.883 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T20:23:00.750 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T20:23:00.995 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T20:23:01.233 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1322-gd21e4f96-1jammy [14.1 kB] 2024-05-08T20:23:01.234 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1322-gd21e4f96-1jammy [831 kB] 2024-05-08T20:23:01.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1322-gd21e4f96-1jammy [2,155 kB] 2024-05-08T20:23:01.274 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T20:23:01.379 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T20:23:01.382 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1322-gd21e4f96-1jammy [238 kB] 2024-05-08T20:23:01.388 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1322-gd21e4f96-1jammy [145 kB] 2024-05-08T20:23:01.392 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1322-gd21e4f96-1jammy [2,237 kB] 2024-05-08T20:23:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1322-gd21e4f96-1jammy [8,625 kB] 2024-05-08T20:23:01.799 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T20:23:02.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1322-gd21e4f96-1jammy [14.3 kB] 2024-05-08T20:23:02.174 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1322-gd21e4f96-1jammy [42.6 MB] 2024-05-08T20:23:02.298 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-08T20:23:02.347 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T20:23:03.313 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T20:23:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T20:23:04.141 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T20:23:04.765 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T20:23:05.146 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1322-gd21e4f96-1jammy [121 kB] 2024-05-08T20:23:05.148 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1322-gd21e4f96-1jammy [230 kB] 2024-05-08T20:23:05.153 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1322-gd21e4f96-1jammy [34.1 kB] 2024-05-08T20:23:05.154 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1322-gd21e4f96-1jammy [23.5 kB] 2024-05-08T20:23:05.155 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1322-gd21e4f96-1jammy [38.3 kB] 2024-05-08T20:23:05.156 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1322-gd21e4f96-1jammy [11.6 MB] 2024-05-08T20:23:05.351 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T20:23:05.353 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T20:23:05.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T20:23:05.791 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1322-gd21e4f96-1jammy [93.1 kB] 2024-05-08T20:23:06.083 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 163 MB in 13s (12.5 MB/s) 2024-05-08T20:23:06.217 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-08T20:23:06.304 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 163 MB in 13s (12.1 MB/s) 2024-05-08T20:23:06.310 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T20:23:06.316 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-08T20:23:06.357 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-08T20:23:06.424 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-08T20:23:06.516 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T20:23:06.521 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-08T20:23:06.556 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-08T20:23:06.659 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T20:23:06.686 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T20:23:06.726 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T20:23:06.834 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T20:23:06.861 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T20:23:06.901 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T20:23:07.021 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cmd2. 2024-05-08T20:23:07.047 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-08T20:23:07.087 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-08T20:23:07.212 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2024-05-08T20:23:07.238 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-08T20:23:07.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-08T20:23:07.398 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfmt8:amd64. 2024-05-08T20:23:07.425 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-05-08T20:23:07.509 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-05-08T20:23:07.565 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfmt8:amd64. 2024-05-08T20:23:07.590 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-05-08T20:23:07.656 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-05-08T20:23:07.870 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T20:23:07.896 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T20:23:07.936 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T20:23:08.169 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T20:23:08.194 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T20:23:08.290 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T20:23:08.310 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T20:23:08.316 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T20:23:08.356 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T20:23:08.647 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T20:23:08.673 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T20:23:08.675 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T20:23:08.702 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T20:23:08.713 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T20:23:08.734 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T20:23:09.179 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T20:23:09.182 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T20:23:09.206 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:09.208 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T20:23:09.241 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T20:23:09.254 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:09.657 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T20:23:09.684 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:09.686 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T20:23:09.712 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:09.723 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:09.761 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:10.052 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T20:23:10.078 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:10.161 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:10.164 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T20:23:10.190 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:10.231 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:10.576 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T20:23:10.602 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T20:23:10.642 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:23:10.705 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T20:23:10.731 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T20:23:10.771 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T20:23:10.920 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T20:23:10.935 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T20:23:10.987 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T20:23:11.099 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librados2. 2024-05-08T20:23:11.126 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-librados2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:11.166 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:11.290 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-05-08T20:23:11.316 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librados2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:11.356 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:11.560 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librbd1. 2024-05-08T20:23:11.587 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-librbd1_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:11.618 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:11.810 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-05-08T20:23:11.836 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-librbd1_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:11.876 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.071 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T20:23:12.098 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:12.138 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.287 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T20:23:12.314 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:12.354 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.415 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2024-05-08T20:23:12.431 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:12.473 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.581 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-05-08T20:23:12.604 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:12.642 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.776 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T20:23:12.803 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:12.834 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:12.942 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T20:23:12.968 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:13.017 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:13.087 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T20:23:13.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:13.145 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:13.270 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T20:23:13.296 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:13.336 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:13.439 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T20:23:13.455 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:13.489 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:13.606 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T20:23:13.632 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:13.672 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:13.775 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T20:23:13.791 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T20:23:13.825 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T20:23:13.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T20:23:14.032 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T20:23:14.032 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T20:23:14.087 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T20:23:14.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:14.145 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:14.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T20:23:14.243 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:14.436 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:14.498 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T20:23:14.524 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T20:23:14.564 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T20:23:14.806 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T20:23:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T20:23:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T20:23:14.892 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2024-05-08T20:23:14.918 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-librgw2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:14.958 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:15.200 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-05-08T20:23:15.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-librgw2_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:15.267 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:15.436 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T20:23:15.463 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:15.503 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:15.772 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T20:23:15.787 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:15.830 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:15.864 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T20:23:15.891 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T20:23:15.930 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T20:23:16.158 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T20:23:16.184 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T20:23:16.224 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T20:23:16.258 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T20:23:16.284 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:16.325 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T20:23:16.500 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:16.535 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:16.695 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2024-05-08T20:23:16.721 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:16.753 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:16.931 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-05-08T20:23:16.957 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:16.997 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:17.992 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2024-05-08T20:23:18.019 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:18.068 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:18.261 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-05-08T20:23:18.287 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:18.337 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:18.663 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T20:23:18.689 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T20:23:18.729 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T20:23:18.899 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T20:23:18.925 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T20:23:18.966 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T20:23:19.032 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T20:23:19.059 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T20:23:19.098 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T20:23:19.227 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T20:23:19.242 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T20:23:19.277 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T20:23:19.393 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T20:23:19.420 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T20:23:19.451 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T20:23:19.722 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T20:23:19.737 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T20:23:19.748 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T20:23:19.764 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T20:23:19.788 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T20:23:19.804 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T20:23:20.092 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T20:23:20.118 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T20:23:20.132 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T20:23:20.158 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T20:23:20.158 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T20:23:20.198 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T20:23:20.444 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T20:23:20.470 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T20:23:20.501 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T20:23:20.511 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T20:23:20.527 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T20:23:20.568 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T20:23:20.789 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T20:23:20.816 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T20:23:20.820 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-portend. 2024-05-08T20:23:20.836 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-05-08T20:23:20.855 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T20:23:20.879 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T20:23:21.167 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-05-08T20:23:21.181 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T20:23:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-05-08T20:23:21.208 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T20:23:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T20:23:21.248 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T20:23:21.536 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T20:23:21.551 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T20:23:21.562 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T20:23:21.578 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T20:23:21.603 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T20:23:21.617 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T20:23:21.889 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T20:23:21.916 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T20:23:21.947 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T20:23:21.971 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T20:23:21.998 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T20:23:22.038 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T20:23:22.301 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T20:23:22.327 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T20:23:22.349 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T20:23:22.367 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T20:23:22.376 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T20:23:22.415 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T20:23:22.637 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T20:23:22.653 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T20:23:22.687 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T20:23:22.718 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T20:23:22.745 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T20:23:22.785 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T20:23:22.982 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T20:23:23.008 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T20:23:23.046 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2024-05-08T20:23:23.048 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T20:23:23.073 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T20:23:23.113 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T20:23:23.335 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-05-08T20:23:23.361 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T20:23:23.401 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T20:23:23.416 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T20:23:23.442 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T20:23:23.482 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:23:23.730 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T20:23:23.756 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T20:23:23.785 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T20:23:23.796 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:23:23.812 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T20:23:23.851 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T20:23:24.057 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T20:23:24.074 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T20:23:24.116 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T20:23:24.171 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2024-05-08T20:23:24.198 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T20:23:24.238 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T20:23:24.402 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-05-08T20:23:24.429 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T20:23:24.468 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T20:23:24.557 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T20:23:24.584 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T20:23:24.618 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T20:23:24.885 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T20:23:24.912 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T20:23:24.943 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T20:23:25.197 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T20:23:25.224 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T20:23:25.246 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2024-05-08T20:23:25.273 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T20:23:25.313 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T20:23:25.615 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T20:23:25.631 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T20:23:25.641 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T20:23:25.665 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T20:23:25.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T20:23:25.977 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T20:23:26.017 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T20:23:26.303 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-05-08T20:23:26.329 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T20:23:26.386 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T20:23:26.698 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T20:23:26.713 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T20:23:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T20:23:26.786 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T20:23:26.813 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T20:23:26.844 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T20:23:27.043 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T20:23:27.060 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T20:23:27.101 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T20:23:27.139 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T20:23:27.166 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T20:23:27.205 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T20:23:27.354 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T20:23:27.381 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T20:23:27.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T20:23:27.516 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T20:23:27.543 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T20:23:27.583 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T20:23:27.740 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T20:23:27.767 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T20:23:27.807 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T20:23:27.954 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T20:23:27.981 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T20:23:28.046 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T20:23:28.153 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T20:23:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T20:23:28.220 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T20:23:28.374 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-idna. 2024-05-08T20:23:28.400 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-05-08T20:23:28.440 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T20:23:28.540 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-05-08T20:23:28.566 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-05-08T20:23:28.606 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T20:23:28.709 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T20:23:28.725 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T20:23:28.759 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T20:23:28.942 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T20:23:28.969 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T20:23:29.017 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T20:23:29.079 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests. 2024-05-08T20:23:29.106 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T20:23:29.146 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T20:23:29.329 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-05-08T20:23:29.355 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T20:23:29.395 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T20:23:29.440 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T20:23:29.467 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T20:23:29.507 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T20:23:29.690 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T20:23:29.717 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T20:23:29.757 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T20:23:29.801 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T20:23:29.817 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:29.860 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:30.210 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T20:23:30.236 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:30.257 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T20:23:30.276 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:30.283 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:30.323 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:30.623 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T20:23:30.650 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:30.690 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:30.892 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T20:23:30.919 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T20:23:30.958 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T20:23:30.976 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T20:23:31.002 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T20:23:31.042 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T20:23:31.261 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T20:23:31.288 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T20:23:31.328 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T20:23:31.345 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T20:23:31.372 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T20:23:31.412 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T20:23:31.606 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T20:23:31.633 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-ceph-mgr_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:31.672 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:31.749 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T20:23:31.775 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mgr_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:31.815 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:32.076 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T20:23:32.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-ceph-mon_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:32.159 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:32.235 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T20:23:32.261 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-mon_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:32.293 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:32.779 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T20:23:32.805 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-ceph-osd_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:32.846 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:32.930 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T20:23:32.957 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-ceph-osd_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:32.997 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:33.832 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2024-05-08T20:23:33.847 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-ceph_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:34.050 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-05-08T20:23:34.066 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-ceph_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:34.108 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:34.210 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T20:23:34.236 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-ceph-fuse_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:34.276 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:34.403 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T20:23:34.429 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-fuse_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:34.469 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:34.638 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T20:23:34.665 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-ceph-mds_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:34.704 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:34.848 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T20:23:34.875 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-ceph-mds_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:34.914 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:35.049 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2024-05-08T20:23:35.064 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-cephadm_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:35.099 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:35.402 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T20:23:35.428 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T20:23:35.476 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-05-08T20:23:35.477 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T20:23:35.503 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-cephadm_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:35.542 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:35.771 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T20:23:35.787 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T20:23:35.829 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T20:23:35.830 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T20:23:35.856 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T20:23:35.895 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T20:23:36.207 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T20:23:36.222 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T20:23:36.265 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T20:23:36.810 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-babel. 2024-05-08T20:23:36.837 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T20:23:36.868 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T20:23:37.195 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-05-08T20:23:37.196 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T20:23:37.223 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T20:23:37.223 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T20:23:37.261 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T20:23:37.263 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T20:23:37.557 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T20:23:37.572 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T20:23:37.590 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T20:23:37.615 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T20:23:37.618 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:37.657 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:37.935 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T20:23:37.961 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:38.001 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:38.010 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T20:23:38.037 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T20:23:38.077 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T20:23:38.338 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T20:23:38.355 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2024-05-08T20:23:38.365 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T20:23:38.382 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-05-08T20:23:38.413 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T20:23:38.414 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T20:23:38.691 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-05-08T20:23:38.707 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-05-08T20:23:38.733 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T20:23:38.741 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T20:23:38.760 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T20:23:38.800 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T20:23:38.995 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T20:23:39.010 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T20:23:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T20:23:39.153 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-toml. 2024-05-08T20:23:39.180 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-05-08T20:23:39.211 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T20:23:39.339 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-05-08T20:23:39.366 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-05-08T20:23:39.406 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T20:23:39.481 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T20:23:39.507 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T20:23:39.547 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T20:23:39.727 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T20:23:39.753 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T20:23:39.792 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T20:23:39.867 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T20:23:39.884 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T20:23:39.917 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T20:23:40.146 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T20:23:40.173 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T20:23:40.187 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2024-05-08T20:23:40.212 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T20:23:40.214 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T20:23:40.253 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T20:23:40.516 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-05-08T20:23:40.542 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T20:23:40.557 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T20:23:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T20:23:40.583 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:40.615 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:40.936 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T20:23:40.963 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:40.994 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:41.879 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T20:23:41.906 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T20:23:41.945 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T20:23:42.199 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T20:23:42.215 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T20:23:42.257 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T20:23:42.457 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T20:23:42.484 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T20:23:42.523 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T20:23:42.744 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T20:23:42.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T20:23:42.811 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T20:23:42.868 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T20:23:42.895 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T20:23:42.935 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T20:23:43.173 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T20:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T20:23:43.248 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T20:23:43.254 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T20:23:43.281 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T20:23:43.321 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T20:23:43.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T20:23:43.561 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T20:23:43.600 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T20:23:44.056 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T20:23:44.084 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:44.122 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:44.394 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T20:23:44.422 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:44.461 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:45.101 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T20:23:45.128 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T20:23:45.186 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T20:23:45.440 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T20:23:45.467 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T20:23:45.487 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T20:23:45.515 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T20:23:45.553 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T20:23:45.614 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T20:23:45.857 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T20:23:45.873 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T20:23:45.906 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T20:23:45.993 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T20:23:46.019 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T20:23:46.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T20:23:46.168 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T20:23:46.183 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-05-08T20:23:46.359 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T20:23:46.362 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T20:23:46.389 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T20:23:46.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T20:23:46.680 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T20:23:46.707 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T20:23:46.746 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T20:23:46.749 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T20:23:46.776 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-05-08T20:23:46.840 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T20:23:47.075 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T20:23:47.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T20:23:47.141 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T20:23:47.144 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T20:23:47.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T20:23:47.210 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T20:23:47.454 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T20:23:47.482 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T20:23:47.512 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T20:23:47.539 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T20:23:47.566 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T20:23:47.605 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T20:23:47.832 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T20:23:47.860 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T20:23:47.875 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T20:23:47.898 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T20:23:47.903 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T20:23:47.933 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T20:23:48.220 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T20:23:48.248 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T20:23:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T20:23:48.545 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T20:23:48.561 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:48.604 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:48.909 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T20:23:48.926 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:48.967 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:49.006 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T20:23:49.034 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T20:23:49.081 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T20:23:49.295 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T20:23:49.322 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T20:23:49.361 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T20:23:49.442 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T20:23:49.470 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T20:23:49.509 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T20:23:49.673 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T20:23:49.701 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T20:23:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T20:23:49.770 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2024-05-08T20:23:49.786 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T20:23:49.828 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T20:23:50.001 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-05-08T20:23:50.031 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T20:23:50.076 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T20:23:50.098 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2024-05-08T20:23:50.125 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T20:23:50.172 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T20:23:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-05-08T20:23:50.356 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T20:23:50.420 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T20:23:50.484 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T20:23:50.511 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T20:23:50.542 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T20:23:50.707 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T20:23:50.723 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T20:23:50.765 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T20:23:50.913 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2024-05-08T20:23:50.929 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:50.971 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:51.136 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-05-08T20:23:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:51.194 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:52.866 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T20:23:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:52.924 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:52.999 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T20:23:53.026 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:53.057 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:53.245 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-08T20:23:53.269 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:53.312 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-mirror (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:53.378 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-08T20:23:53.406 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:53.436 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:53.615 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-colorama. 2024-05-08T20:23:53.642 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-05-08T20:23:53.681 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-08T20:23:53.730 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2024-05-08T20:23:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-05-08T20:23:53.788 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-08T20:23:53.942 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-shell. 2024-05-08T20:23:53.958 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:54.000 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-shell (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.069 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2024-05-08T20:23:54.085 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:54.118 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.261 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-top. 2024-05-08T20:23:54.277 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:54.311 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-top (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.338 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2024-05-08T20:23:54.354 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1322-gd21e4f96-1jammy_all.deb ... 2024-05-08T20:23:54.388 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.514 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T20:23:54.530 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:54.572 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.624 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T20:23:54.640 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:54.682 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:54.950 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T20:23:54.978 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T20:23:55.016 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T20:23:55.061 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T20:23:55.088 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T20:23:55.127 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T20:23:55.363 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T20:23:55.379 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T20:23:55.421 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T20:23:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T20:23:55.490 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T20:23:55.531 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T20:23:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T20:23:55.935 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T20:23:55.952 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T20:23:55.973 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T20:23:55.979 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T20:23:56.156 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T20:23:56.302 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T20:23:56.330 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T20:23:56.368 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T20:23:56.530 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T20:23:56.557 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T20:23:56.596 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T20:23:56.916 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T20:23:56.944 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T20:23:56.982 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T20:23:57.080 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T20:23:57.108 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T20:23:57.146 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T20:23:57.462 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T20:23:57.489 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T20:23:57.547 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T20:23:57.567 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T20:23:57.583 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T20:23:57.616 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T20:23:57.815 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T20:23:57.842 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T20:23:57.872 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T20:23:57.928 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T20:23:57.955 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T20:23:57.994 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T20:23:58.117 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T20:23:58.144 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T20:23:58.184 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T20:23:58.264 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T20:23:58.291 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T20:23:58.330 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T20:23:58.896 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-05-08T20:23:58.926 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-radosgw_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:58.962 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:59.059 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2024-05-08T20:23:59.086 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-radosgw_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:59.125 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:59.682 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T20:23:59.698 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:59.740 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:23:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T20:23:59.835 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1322-gd21e4f96-1jammy_amd64.deb ... 2024-05-08T20:23:59.869 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:00.005 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T20:24:00.182 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T20:24:00.254 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T20:24:00.380 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T20:24:00.432 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T20:24:00.558 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T20:24:00.641 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T20:24:00.820 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T20:24:00.962 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T20:24:01.128 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T20:24:01.397 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T20:24:01.565 INFO:teuthology.orchestra.run.smithi117.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T20:24:01.582 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:01.635 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:02.048 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-05-08T20:24:02.180 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T20:24:02.376 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2024-05-08T20:24:02.448 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T20:24:02.516 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T20:24:02.682 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T20:24:02.792 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T20:24:02.792 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T20:24:03.043 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T20:24:03.051 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T20:24:03.144 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T20:24:03.311 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T20:24:03.395 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T20:24:03.437 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T20:24:03.655 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T20:24:03.739 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T20:24:03.781 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T20:24:04.082 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T20:24:04.083 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T20:24:04.342 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-08T20:24:04.443 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T20:24:04.593 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T20:24:04.677 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-08T20:24:04.861 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T20:24:04.928 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T20:24:05.113 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T20:24:05.196 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T20:24:05.363 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T20:24:05.455 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T20:24:05.598 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:05.715 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T20:24:05.841 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T20:24:05.967 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-08T20:24:06.049 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:06.227 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T20:24:06.317 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T20:24:06.426 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-08T20:24:06.486 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T20:24:06.612 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T20:24:06.660 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T20:24:06.928 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T20:24:06.980 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T20:24:07.054 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T20:24:07.106 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T20:24:07.374 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T20:24:07.422 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T20:24:07.548 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T20:24:07.633 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T20:24:07.824 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T20:24:07.951 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T20:24:08.083 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T20:24:08.384 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T20:24:08.645 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T20:24:08.904 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T20:24:09.014 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T20:24:09.028 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T20:24:09.114 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T20:24:09.287 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T20:24:09.399 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T20:24:09.413 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T20:24:09.531 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T20:24:09.784 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T20:24:09.815 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T20:24:10.035 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T20:24:10.199 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T20:24:10.442 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T20:24:10.445 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T20:24:10.738 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-08T20:24:10.794 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T20:24:11.039 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T20:24:11.087 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-08T20:24:11.365 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T20:24:11.388 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T20:24:11.616 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T20:24:11.731 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T20:24:11.751 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:11.965 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T20:24:12.074 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:12.077 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T20:24:12.375 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T20:24:12.395 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T20:24:12.702 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T20:24:13.559 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:13.694 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T20:24:13.932 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:13.961 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T20:24:14.058 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T20:24:14.087 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T20:24:14.213 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T20:24:14.300 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T20:24:14.401 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T20:24:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T20:24:14.528 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T20:24:14.749 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T20:24:14.829 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T20:24:14.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:15.096 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T20:24:15.102 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-05-08T20:24:15.228 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T20:24:15.339 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:15.440 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-05-08T20:24:15.529 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T20:24:15.558 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T20:24:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T20:24:15.859 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T20:24:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T20:24:16.119 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T20:24:16.258 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:24:16.378 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T20:24:16.525 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T20:24:16.637 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:24:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T20:24:16.888 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T20:24:16.936 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T20:24:17.139 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T20:24:17.220 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T20:24:17.265 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T20:24:17.346 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T20:24:17.631 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T20:24:17.633 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T20:24:17.767 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T20:24:17.907 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T20:24:18.060 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T20:24:18.141 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T20:24:18.361 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T20:24:18.552 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T20:24:18.620 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T20:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T20:24:18.912 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T20:24:18.998 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T20:24:19.240 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T20:24:19.297 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T20:24:19.366 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T20:24:19.548 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T20:24:19.742 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T20:24:19.791 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:19.917 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T20:24:20.010 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T20:24:20.235 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T20:24:20.269 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T20:24:20.395 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T20:24:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T20:24:20.713 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T20:24:20.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T20:24:20.947 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T20:24:21.005 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T20:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T20:24:21.273 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T20:24:21.391 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T20:24:21.482 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T20:24:21.658 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T20:24:21.725 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T20:24:21.926 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T20:24:22.102 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T20:24:22.194 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T20:24:22.395 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T20:24:22.596 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T20:24:22.739 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T20:24:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:22.888 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T20:24:22.974 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.177 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.232 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T20:24:23.304 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.333 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.430 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.434 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.556 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T20:24:23.637 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.763 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.832 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.889 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:23.958 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.015 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T20:24:24.093 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.304 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:24:24.304 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:24:24.308 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.434 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.569 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.781 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:24:24.782 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:24:24.786 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:24.912 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:25.030 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:25.131 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T20:24:25.270 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:25.388 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:25.505 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-top (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:25.657 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T20:24:26.294 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.420 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.546 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.672 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.798 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.860 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.908 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:26.986 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:27.104 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:27.205 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:27.306 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-shell (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:27.424 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:27.451 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-05-08T20:24:27.778 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-05-08T20:24:27.921 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-05-08T20:24:27.935 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T20:24:28.000 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2024-05-08T20:24:28.083 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T20:24:28.368 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2024-05-08T20:24:28.421 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T20:24:28.511 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2024-05-08T20:24:28.530 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T20:24:28.668 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T20:24:28.885 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:29.014 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T20:24:29.091 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:24:29.091 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:24:29.474 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-mirror (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:29.605 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:24:29.682 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:24:29.854 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:30.150 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:30.277 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:30.309 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:24:30.309 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:24:30.730 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:30.738 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:24:30.739 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:24:31.061 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T20:24:31.195 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:31.508 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T20:24:31.532 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:31.731 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:24:31.731 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:24:31.963 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:24:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:24:32.402 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:32.620 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:24:32.620 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:24:32.656 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:32.865 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:24:32.866 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:24:33.078 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:33.341 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:33.343 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:24:33.343 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:24:33.631 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:24:33.631 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:24:33.796 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:33.922 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.065 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.101 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.227 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.273 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:24:34.273 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:24:34.378 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.588 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:24:34.588 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:24:34.708 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.851 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:34.985 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.079 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.136 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.230 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.364 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (18.2.2-1322-gd21e4f96-1jammy) ... 2024-05-08T20:24:35.664 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T20:24:35.835 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T20:24:36.732 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T20:24:36.911 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T20:24:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:24:37.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-08T20:24:37.234 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-05-08T20:24:37.372 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:24:37.375 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-08T20:24:37.417 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-05-08T20:24:37.417 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-05-08T20:24:37.428 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:24:37.587 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:24:37.588 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:24:37.588 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:24:37.588 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-05-08T20:24:37.588 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-08T20:24:37.588 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-08T20:24:37.589 INFO:teuthology.orchestra.run.smithi081.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-08T20:24:37.589 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-08T20:24:37.589 INFO:teuthology.orchestra.run.smithi081.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:24:37.590 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-05-08T20:24:37.590 INFO:teuthology.orchestra.run.smithi081.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-08T20:24:37.590 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-08T20:24:37.590 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-08T20:24:37.629 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2024-05-08T20:24:37.630 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2024-05-08T20:24:37.630 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-05-08T20:24:37.631 INFO:teuthology.orchestra.run.smithi081.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-08T20:24:37.631 INFO:teuthology.orchestra.run.smithi081.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-08T20:24:37.632 INFO:teuthology.orchestra.run.smithi081.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-08T20:24:37.632 INFO:teuthology.orchestra.run.smithi081.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-08T20:24:37.632 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-08T20:24:37.632 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-08T20:24:37.632 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:24:37.633 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-05-08T20:24:37.633 INFO:teuthology.orchestra.run.smithi081.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T20:24:37.813 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T20:24:37.814 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T20:24:37.814 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:24:37.814 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2024-05-08T20:24:37.814 INFO:teuthology.orchestra.run.smithi117.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-08T20:24:37.814 INFO:teuthology.orchestra.run.smithi117.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-08T20:24:37.815 INFO:teuthology.orchestra.run.smithi117.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-08T20:24:37.815 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-08T20:24:37.815 INFO:teuthology.orchestra.run.smithi117.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:24:37.816 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2024-05-08T20:24:37.816 INFO:teuthology.orchestra.run.smithi117.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-08T20:24:37.816 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-08T20:24:37.816 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-08T20:24:37.835 INFO:teuthology.orchestra.run.smithi081.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:24:37.835 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 55.7 MB of archives. 2024-05-08T20:24:37.836 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-08T20:24:37.836 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-08T20:24:37.856 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2024-05-08T20:24:37.856 INFO:teuthology.orchestra.run.smithi117.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-08T20:24:37.856 INFO:teuthology.orchestra.run.smithi117.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-08T20:24:37.857 INFO:teuthology.orchestra.run.smithi117.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-08T20:24:37.857 INFO:teuthology.orchestra.run.smithi117.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-08T20:24:37.857 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-08T20:24:37.857 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-08T20:24:37.857 INFO:teuthology.orchestra.run.smithi117.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:24:37.858 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2024-05-08T20:24:37.859 INFO:teuthology.orchestra.run.smithi117.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-08T20:24:38.039 INFO:teuthology.orchestra.run.smithi117.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:24:38.039 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 55.7 MB of archives. 2024-05-08T20:24:38.039 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-08T20:24:38.039 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-08T20:24:38.486 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-08T20:24:38.503 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-08T20:24:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-08T20:24:38.632 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-08T20:24:38.633 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-08T20:24:38.662 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-08T20:24:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-08T20:24:38.667 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-08T20:24:38.669 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-08T20:24:38.670 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-08T20:24:38.673 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-08T20:24:38.690 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-08T20:24:38.815 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-08T20:24:38.816 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-08T20:24:38.817 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-08T20:24:38.839 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-08T20:24:38.846 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-08T20:24:38.848 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-08T20:24:38.851 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-08T20:24:38.854 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-08T20:24:38.855 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-08T20:24:39.021 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-08T20:24:39.130 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-08T20:24:39.147 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-08T20:24:39.152 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-08T20:24:39.284 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-08T20:24:39.303 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-08T20:24:39.313 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-08T20:24:39.318 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-08T20:24:39.403 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-08T20:24:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-08T20:24:40.478 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-08T20:24:40.478 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-08T20:24:40.484 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-08T20:24:40.485 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-08T20:24:40.496 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-08T20:24:40.665 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-08T20:24:41.262 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-08T20:24:41.263 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-08T20:24:41.442 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-08T20:24:41.443 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-08T20:24:41.481 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-08T20:24:41.543 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-08T20:24:41.550 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-08T20:24:41.551 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-08T20:24:41.552 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-08T20:24:41.553 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-08T20:24:41.760 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-08T20:24:42.172 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-08T20:24:42.968 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-08T20:24:42.968 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-08T20:24:43.008 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-08T20:24:43.008 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-08T20:24:43.009 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-08T20:24:43.009 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-08T20:24:43.041 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-08T20:24:43.042 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-08T20:24:43.437 INFO:teuthology.orchestra.run.smithi117.stdout:Preconfiguring packages ... 2024-05-08T20:24:43.587 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-05-08T20:24:43.898 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-05-08T20:24:43.904 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:24:44.067 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:24:44.697 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-08T20:24:45.693 INFO:teuthology.orchestra.run.smithi117.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-08T20:24:45.924 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package flex. 2024-05-08T20:24:46.019 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-05-08T20:24:46.025 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-08T20:24:46.064 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-08T20:24:46.613 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-08T20:24:46.786 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-08T20:24:47.204 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:24:47.757 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-05-08T20:24:47.762 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:24:47.877 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:24:48.838 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:24:48.976 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:24:49.269 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-08T20:24:49.652 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package bison. 2024-05-08T20:24:49.756 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-05-08T20:24:49.762 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-08T20:24:49.821 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-08T20:24:50.305 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-08T20:24:50.332 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-08T20:24:50.380 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-08T20:24:50.750 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package dump. 2024-05-08T20:24:50.777 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-08T20:24:50.816 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking dump (0.4b47-3) ... 2024-05-08T20:24:51.112 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package indent. 2024-05-08T20:24:51.140 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:24:51.178 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-08T20:24:51.472 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-08T20:24:51.500 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-08T20:24:51.569 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-08T20:24:51.910 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-08T20:24:51.938 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-08T20:24:51.976 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-08T20:24:52.237 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-08T20:24:52.254 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-08T20:24:52.296 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-08T20:24:52.691 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-08T20:24:52.718 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-08T20:24:52.766 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-08T20:24:53.019 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-08T20:24:53.046 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-08T20:24:53.076 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-08T20:24:53.304 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjson-perl. 2024-05-08T20:24:53.321 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-08T20:24:53.362 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-08T20:24:53.682 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-08T20:24:53.710 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-08T20:24:53.750 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-08T20:24:55.428 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-08T20:24:55.456 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:24:55.486 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:24:55.746 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-08T20:24:55.775 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:24:55.813 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:24:56.141 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-08T20:24:56.169 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-08T20:24:56.207 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:24:56.527 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-08T20:24:56.555 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-08T20:24:56.594 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-08T20:24:56.880 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-08T20:24:56.908 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-08T20:24:56.946 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-08T20:24:57.299 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-08T20:24:57.327 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:24:57.366 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:24:57.711 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-08T20:24:57.739 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:24:57.777 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:24:58.080 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-08T20:24:58.108 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:24:58.146 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:24:58.416 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-08T20:24:58.443 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-08T20:24:58.482 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:24:59.054 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-08T20:24:59.083 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-08T20:24:59.121 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-08T20:24:59.474 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package modemmanager. 2024-05-08T20:24:59.502 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-08T20:24:59.540 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:25:00.164 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager. 2024-05-08T20:25:00.192 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-08T20:25:00.239 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-08T20:25:00.871 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ppp. 2024-05-08T20:25:00.899 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-08T20:25:01.190 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-08T20:25:01.542 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pptp-linux. 2024-05-08T20:25:01.570 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-08T20:25:01.617 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-08T20:25:01.929 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-08T20:25:01.953 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-08T20:25:01.995 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-08T20:25:02.282 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-08T20:25:02.310 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-08T20:25:02.356 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-common (238) ... 2024-05-08T20:25:02.727 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-08T20:25:02.758 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:02.802 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:03.482 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-common. 2024-05-08T20:25:03.510 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-08T20:25:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-08T20:25:03.596 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-common (238) ... 2024-05-08T20:25:04.072 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-14. 2024-05-08T20:25:04.101 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:04.142 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:05.408 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql. 2024-05-08T20:25:05.425 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-08T20:25:05.467 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql (14+238) ... 2024-05-08T20:25:05.719 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client. 2024-05-08T20:25:05.748 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-08T20:25:05.785 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client (14+238) ... 2024-05-08T20:25:05.996 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-08T20:25:06.025 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-08T20:25:06.054 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-08T20:25:06.365 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl8.6. 2024-05-08T20:25:06.393 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-08T20:25:06.448 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-08T20:25:06.759 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl. 2024-05-08T20:25:06.788 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-08T20:25:06.830 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-08T20:25:07.154 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package wpasupplicant. 2024-05-08T20:25:07.182 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-08T20:25:07.220 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-08T20:25:07.566 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-08T20:25:07.594 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-08T20:25:07.632 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-08T20:25:08.019 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-08T20:25:08.047 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-08T20:25:08.094 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-08T20:25:08.380 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-common (238) ... 2024-05-08T20:25:08.591 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-08T20:25:08.726 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-08T20:25:08.852 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:08.961 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-08T20:25:09.071 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-08T20:25:09.564 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-08T20:25:10.145 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-08T20:25:10.470 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:25:10.470 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:25:10.947 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-08T20:25:11.073 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-08T20:25:11.257 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:25:11.383 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-08T20:25:11.509 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-08T20:25:11.644 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-08T20:25:11.753 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-08T20:25:11.854 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-08T20:25:12.492 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-08T20:25:12.619 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up dump (0.4b47-3) ... 2024-05-08T20:25:12.714 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-08T20:25:12.770 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:25:12.888 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-08T20:25:13.014 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-08T20:25:13.140 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-08T20:25:13.265 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-08T20:25:13.355 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-08T20:25:13.425 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-08T20:25:13.560 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-08T20:25:13.703 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-08T20:25:13.804 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:25:13.921 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-08T20:25:14.089 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client (14+238) ... 2024-05-08T20:25:14.215 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-08T20:25:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:which means they are currently configured by ifupdown: 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:- enp3s0f1 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout:remove their configuration from /etc/network/interfaces. 2024-05-08T20:25:14.680 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:14.803 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-08T20:25:15.113 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-08T20:25:15.432 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-08T20:25:15.926 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:25:16.061 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-08T20:25:16.161 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-08T20:25:16.263 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-common (238) ... 2024-05-08T20:25:17.211 INFO:teuthology.orchestra.run.smithi117.stdout:Adding user postgres to group ssl-cert 2024-05-08T20:25:17.436 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:17.436 INFO:teuthology.orchestra.run.smithi117.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-08T20:25:17.615 INFO:teuthology.orchestra.run.smithi117.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-08T20:25:17.615 INFO:teuthology.orchestra.run.smithi117.stdout:Removing obsolete dictionary files: 2024-05-08T20:25:18.173 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-08T20:25:18.547 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:18.868 INFO:teuthology.orchestra.run.smithi117.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-08T20:25:18.900 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:This user must also own the server process. 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:The database cluster will be initialized with locale "en_US". 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:The default text search configuration will be set to "english". 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:Data page checksums are disabled. 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:creating subdirectories ... ok 2024-05-08T20:25:18.951 INFO:teuthology.orchestra.run.smithi117.stdout:selecting dynamic shared memory implementation ... posix 2024-05-08T20:25:18.967 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default max_connections ... 100 2024-05-08T20:25:18.986 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default shared_buffers ... 128MB 2024-05-08T20:25:18.996 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default time zone ... Etc/UTC 2024-05-08T20:25:18.997 INFO:teuthology.orchestra.run.smithi117.stdout:creating configuration files ... ok 2024-05-08T20:25:19.109 INFO:teuthology.orchestra.run.smithi117.stdout:running bootstrap script ... ok 2024-05-08T20:25:19.727 INFO:teuthology.orchestra.run.smithi117.stdout:performing post-bootstrap initialization ... ok 2024-05-08T20:25:20.319 INFO:teuthology.orchestra.run.smithi117.stdout:syncing data to disk ... ok 2024-05-08T20:25:20.715 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-08T20:25:23.464 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:25:23.590 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-08T20:25:23.716 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql (14+238) ... 2024-05-08T20:25:23.844 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:25:23.968 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:25:24.229 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:25:24.229 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:25:24.729 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T20:25:24.922 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-08T20:25:25.207 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T20:25:25.351 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T20:25:26.837 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-08T20:25:26.937 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T20:25:27.560 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:25:27.566 DEBUG:teuthology.parallel:result is None 2024-05-08T20:25:29.082 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-08T20:25:29.337 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-08T20:25:29.360 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-08T20:25:29.801 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-08T20:25:29.814 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-08T20:25:31.305 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-08T20:25:31.638 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-08T20:25:32.228 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-08T20:25:32.228 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-08T20:25:32.409 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-08T20:25:32.409 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-08T20:25:32.448 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-08T20:25:32.505 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-08T20:25:32.512 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-08T20:25:32.513 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-08T20:25:32.514 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-08T20:25:32.514 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-08T20:25:32.722 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-08T20:25:33.134 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-08T20:25:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-08T20:25:33.941 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-08T20:25:33.983 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-08T20:25:33.983 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-08T20:25:33.984 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-08T20:25:33.984 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-08T20:25:34.017 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-08T20:25:34.018 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-08T20:25:34.426 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2024-05-08T20:25:34.588 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 55.7 MB in 56s (988 kB/s) 2024-05-08T20:25:34.913 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-05-08T20:25:34.919 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:25:35.074 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:25:35.720 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-08T20:25:36.669 INFO:teuthology.orchestra.run.smithi081.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-08T20:25:36.938 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package flex. 2024-05-08T20:25:37.037 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-05-08T20:25:37.043 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-08T20:25:37.095 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-08T20:25:37.611 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-08T20:25:37.767 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-08T20:25:38.169 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:25:38.664 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-05-08T20:25:38.670 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:25:38.792 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:25:39.354 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-08T20:25:39.609 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-08T20:25:39.935 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-08T20:25:40.318 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package bison. 2024-05-08T20:25:40.422 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-05-08T20:25:40.427 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-08T20:25:40.470 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-08T20:25:40.813 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-08T20:25:40.841 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-08T20:25:40.879 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-08T20:25:41.216 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2024-05-08T20:25:41.243 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-08T20:25:41.282 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b47-3) ... 2024-05-08T20:25:41.695 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2024-05-08T20:25:41.711 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:41.753 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-08T20:25:41.997 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-08T20:25:42.013 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-08T20:25:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-08T20:25:42.385 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-08T20:25:42.412 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-08T20:25:42.451 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-08T20:25:42.679 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-08T20:25:42.695 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-08T20:25:42.729 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-08T20:25:43.049 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-08T20:25:43.077 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-08T20:25:43.115 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-08T20:25:43.368 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-08T20:25:43.396 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-08T20:25:43.435 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-08T20:25:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjson-perl. 2024-05-08T20:25:43.670 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-08T20:25:43.704 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-08T20:25:43.991 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-08T20:25:44.019 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-08T20:25:44.057 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-08T20:25:45.752 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-08T20:25:45.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:25:45.818 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:25:46.055 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-08T20:25:46.071 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:25:46.104 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:25:46.374 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-08T20:25:46.402 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-08T20:25:46.441 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:25:46.786 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-08T20:25:46.813 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-08T20:25:46.852 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-08T20:25:47.180 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-08T20:25:47.208 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-08T20:25:47.247 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-08T20:25:47.517 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-08T20:25:47.544 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:47.583 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:47.928 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-08T20:25:47.955 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:47.994 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:25:48.288 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-08T20:25:48.304 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:48.347 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:25:48.566 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-08T20:25:48.582 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-08T20:25:48.616 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:25:49.087 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-08T20:25:49.114 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-08T20:25:49.153 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-08T20:25:49.506 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2024-05-08T20:25:49.533 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-08T20:25:49.572 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:25:50.188 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2024-05-08T20:25:50.216 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-08T20:25:50.261 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-08T20:25:50.879 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2024-05-08T20:25:50.906 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-08T20:25:51.164 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-08T20:25:51.467 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2024-05-08T20:25:51.494 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-08T20:25:51.533 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-08T20:25:51.786 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-08T20:25:51.803 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-08T20:25:51.844 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-08T20:25:52.148 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-08T20:25:52.175 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-08T20:25:52.233 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (238) ... 2024-05-08T20:25:52.510 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-08T20:25:52.538 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:52.568 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:53.148 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2024-05-08T20:25:53.176 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-08T20:25:53.232 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-08T20:25:53.263 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (238) ... 2024-05-08T20:25:53.722 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-14. 2024-05-08T20:25:53.750 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-08T20:25:53.792 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:55.209 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2024-05-08T20:25:55.237 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-08T20:25:55.266 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (14+238) ... 2024-05-08T20:25:55.502 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2024-05-08T20:25:55.518 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-08T20:25:55.560 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (14+238) ... 2024-05-08T20:25:55.821 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-08T20:25:55.849 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-08T20:25:55.888 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-08T20:25:56.190 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl8.6. 2024-05-08T20:25:56.218 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-08T20:25:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-08T20:25:56.510 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl. 2024-05-08T20:25:56.538 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-08T20:25:56.572 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-08T20:25:56.904 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2024-05-08T20:25:56.932 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-08T20:25:56.970 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-08T20:25:57.342 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-08T20:25:57.370 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-08T20:25:57.408 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-08T20:25:57.786 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-08T20:25:57.814 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-08T20:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-08T20:25:58.131 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (238) ... 2024-05-08T20:25:58.342 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-08T20:25:58.468 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-08T20:25:58.594 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:58.704 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-08T20:25:58.805 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-08T20:25:58.922 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:25:59.412 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-08T20:25:59.478 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-08T20:25:59.863 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:25:59.863 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:26:00.331 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-08T20:26:00.457 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-08T20:26:00.583 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-08T20:26:00.709 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-08T20:26:00.835 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-08T20:26:00.961 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-08T20:26:01.071 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-08T20:26:01.180 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-08T20:26:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-08T20:26:01.911 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b47-3) ... 2024-05-08T20:26:01.996 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-08T20:26:02.063 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:26:02.164 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-08T20:26:02.398 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-08T20:26:02.524 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-08T20:26:02.659 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-08T20:26:02.749 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-08T20:26:02.810 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-08T20:26:02.936 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-08T20:26:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-08T20:26:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:26:03.339 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-08T20:26:03.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (14+238) ... 2024-05-08T20:26:03.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-08T20:26:04.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:04.099 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-08T20:26:04.099 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2024-05-08T20:26:04.100 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2024-05-08T20:26:04.100 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-08T20:26:04.100 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2024-05-08T20:26:04.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:04.211 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-08T20:26:04.501 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-08T20:26:04.832 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-08T20:26:05.312 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-08T20:26:05.471 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-08T20:26:05.597 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-08T20:26:05.723 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (238) ... 2024-05-08T20:26:06.618 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2024-05-08T20:26:06.853 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:06.854 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-08T20:26:07.062 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-08T20:26:07.062 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2024-05-08T20:26:07.641 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-08T20:26:08.025 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-08T20:26:08.357 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-08T20:26:08.375 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-08T20:26:08.410 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-08T20:26:08.410 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2024-05-08T20:26:08.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2024-05-08T20:26:08.411 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2024-05-08T20:26:08.423 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2024-05-08T20:26:08.444 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2024-05-08T20:26:08.454 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2024-05-08T20:26:08.455 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2024-05-08T20:26:08.565 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2024-05-08T20:26:09.255 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2024-05-08T20:26:09.996 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2024-05-08T20:26:10.370 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-08T20:26:13.132 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:26:13.266 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-08T20:26:13.392 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (14+238) ... 2024-05-08T20:26:13.510 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-08T20:26:13.611 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-08T20:26:13.901 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:26:13.902 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:26:14.456 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T20:26:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-08T20:26:14.959 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T20:26:15.102 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T20:26:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-08T20:26:16.497 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T20:26:17.120 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:26:17.126 DEBUG:teuthology.parallel:result is None 2024-05-08T20:26:17.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:26:17.349 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-05-08T20:26:17.369 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:26:17.369 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:26:17.370 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322-gd21e4f96-1jammy is installed. 2024-05-08T20:26:17.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:26:17.587 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2024-05-08T20:26:17.606 INFO:teuthology.orchestra.run.smithi117.stdout:18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:26:17.606 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322-gd21e4f96-1jammy 2024-05-08T20:26:17.606 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322-gd21e4f96-1jammy is installed. 2024-05-08T20:26:17.608 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T20:26:17.608 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:17.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:26:17.622 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:17.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:26:17.661 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T20:26:17.661 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:17.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:26:17.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:26:17.727 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:17.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:26:17.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:26:17.796 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T20:26:17.796 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:17.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:26:17.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:26:17.864 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:17.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:26:17.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:26:17.931 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T20:26:17.932 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:17.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:26:17.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:26:17.999 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:18.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:26:18.012 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:26:18.067 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T20:26:18.154 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T20:26:18.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-05-08T20:26:18.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-05-08T20:26:18.169 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T20:26:18.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:26:18.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:26:18.223 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T20:26:18.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:26:18.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:26:18.286 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T20:26:18.286 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T20:26:18.286 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T20:26:18.286 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:18.286 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:26:18.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:26:18.396 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:18.396 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:26:18.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:26:18.481 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T20:26:18.481 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T20:26:18.481 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698003', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 2738, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '17/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCX4ZeGH/UALomv+8P+omEkUJY0002zBL7lyTx8dG0vCQuqQtHcDurF5lyS1XyR82c3CAf5QcOaiQT1YuyIh0NE=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAFyO6jbophzi76lXpKVvK9jSf8Hj7Rtxhn4jaZIPDTmRQEYHNKPU4nXTYwsCg4rSSd7VB8rWvo//4hTgUKYCEk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:22:21', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T20:26:18.482 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:26:18.484 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:26:18.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:26:18.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:26:18.580 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:18.581 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:26:18.592 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:26:18.592 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 20:19:21.555489298 +0000 2024-05-08T20:26:18.641 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 20:19:21.303491549 +0000 2024-05-08T20:26:18.642 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 20:19:21.303491549 +0000 2024-05-08T20:26:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T20:26:18.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:26:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T20:26:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T20:26:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000426498 s, 1.2 MB/s 2024-05-08T20:26:18.696 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:26:18.746 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 20:19:22.055484831 +0000 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 20:19:21.779487296 +0000 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 20:19:21.779487296 +0000 2024-05-08T20:26:18.793 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T20:26:18.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:26:18.847 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T20:26:18.847 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T20:26:18.847 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000442158 s, 1.2 MB/s 2024-05-08T20:26:18.848 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:26:18.897 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-05-08T20:26:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 20:19:22.575480187 +0000 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 20:19:22.271482902 +0000 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 20:19:22.271482902 +0000 2024-05-08T20:26:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T20:26:18.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T20:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T20:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000428578 s, 1.2 MB/s 2024-05-08T20:26:19.000 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:26:19.050 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 20:19:23.051475934 +0000 2024-05-08T20:26:19.097 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 20:19:22.795478222 +0000 2024-05-08T20:26:19.098 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 20:19:22.795478222 +0000 2024-05-08T20:26:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T20:26:19.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:26:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T20:26:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T20:26:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000379154 s, 1.4 MB/s 2024-05-08T20:26:19.153 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:26:19.206 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:19.206 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:19.206 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:26:19.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:26:19.212 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-08 20:19:21.540396489 +0000 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-08 20:19:21.288398735 +0000 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-08 20:19:21.288398735 +0000 2024-05-08T20:26:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-05-08T20:26:19.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:26:19.315 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-08T20:26:19.315 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-08T20:26:19.315 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000445352 s, 1.1 MB/s 2024-05-08T20:26:19.316 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:26:19.366 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-05-08T20:26:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-08 20:19:22.048391957 +0000 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-08 20:19:21.772394419 +0000 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-08 20:19:21.772394419 +0000 2024-05-08T20:26:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-05-08T20:26:19.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:26:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-08T20:26:19.466 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-08T20:26:19.467 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000442097 s, 1.2 MB/s 2024-05-08T20:26:19.468 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:26:19.517 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-05-08T20:26:19.564 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-08 20:19:22.584387174 +0000 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-08 20:19:22.328389459 +0000 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-08 20:19:22.328389459 +0000 2024-05-08T20:26:19.565 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-05-08T20:26:19.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:26:19.618 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-08T20:26:19.618 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-08T20:26:19.618 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000310614 s, 1.6 MB/s 2024-05-08T20:26:19.620 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:26:19.670 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-05-08T20:26:19.716 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-08 20:19:23.100382572 +0000 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-08 20:19:22.840384892 +0000 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-08 20:19:22.840384892 +0000 2024-05-08T20:26:19.717 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-05-08T20:26:19.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:26:19.771 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-08T20:26:19.771 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-08T20:26:19.771 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00039165 s, 1.3 MB/s 2024-05-08T20:26:19.772 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:26:19.822 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:19.822 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:26:19.822 INFO:tasks.ceph:Generating config... 2024-05-08T20:26:19.823 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T20:26:19.823 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-08T20:26:19.824 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T20:26:19.824 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T20:26:19.824 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T20:26:19.824 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T20:26:19.824 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T20:26:19.825 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T20:26:19.826 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T20:26:19.826 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T20:26:19.826 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T20:26:19.826 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T20:26:19.827 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T20:26:19.828 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T20:26:19.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T20:26:19.862 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T20:26:19.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T20:26:19.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:26:20.007 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-05-08T20:26:20.008 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T20:26:20.009 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:20.009 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:26:20.057 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid d71bfc5b-5bc0-431a-b162-ebb87bd62ea5 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:fsid d71bfc5b-5bc0-431a-b162-ebb87bd62ea5 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-05-08T20:26:20.143236+0000 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-05-08T20:26:20.143236+0000 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 16 (pacific) 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-05-08T20:26:20.142 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-05-08T20:26:20.143 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-05-08T20:26:20.143 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-05-08T20:26:20.143 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T20:26:20.144 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:26:20.193 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d71bfc5b-5bc0-431a-b162-ebb87bd62ea5... 2024-05-08T20:26:20.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:26:20.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:26:20.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:26:20.268 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-05-08T20:26:20.269 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = d71bfc5b-5bc0-431a-b162-ebb87bd62ea5 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-05-08T20:26:20.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-05-08T20:26:20.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: filestore flush min = 0 2024-05-08T20:26:20.272 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay max = 1 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay probability = 0.005 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay type = client mds 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 2500 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: osd blocked scrub grace period = 3600 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: osd max markdown count = 1000 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-05-08T20:26:20.274 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-05-08T20:26:20.275 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: client_shutdown_timeout = 120 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-05-08T20:26:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: mds bal fragment size max = 10000 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: mds bal merge size = 5 2024-05-08T20:26:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: mds bal split bits = 3 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mds bal split size = 100 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay max = 1 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay probability = 0.005 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject delay type = client mds osd 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 2500 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-05-08T20:26:20.278 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-05-08T20:26:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:26:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.81,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = d71bfc5b-5bc0-431a-b162-ebb87bd62ea5 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-05-08T20:26:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-05-08T20:26:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-05-08T20:26:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: filestore flush min = 0 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:26:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay max = 1 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay probability = 0.005 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay type = client mds 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 2500 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: osd blocked scrub grace period = 3600 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: osd max markdown count = 1000 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-05-08T20:26:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:26:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-08T20:26:20.289 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: client_shutdown_timeout = 120 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-05-08T20:26:20.290 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds bal fragment size max = 10000 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds bal merge size = 5 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds bal split bits = 3 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds bal split size = 100 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-05-08T20:26:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay max = 1 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay probability = 0.005 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject delay type = client mds osd 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 2500 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-05-08T20:26:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-05-08T20:26:20.292 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T20:26:20.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T20:26:20.372 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T20:26:20.372 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:20.372 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T20:26:20.378 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:20.378 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T20:26:20.425 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:26:20.425 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:20.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:26:20.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:26:20.490 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:20.490 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:20.537 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:26:20.537 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:20.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:26:20.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:26:20.561 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:20.561 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:20.609 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T20:26:20.609 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T20:26:20.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:26:20.652 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:26:20.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:26:20.699 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:26:20.708 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T20:26:20.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:26:20.747 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:26:20.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T20:26:20.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:26:20.891 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:26:20.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T20:26:20.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:26:20.994 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:26:20.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T20:26:21.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:26:21.093 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:26:21.095 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T20:26:21.153 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T20:26:21.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T20:26:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T20:26:21.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T20:26:21.235 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T20:26:21.247 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T20:26:21.247 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:26:21.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T20:26:21.260 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:21.260 INFO:tasks.ceph:role: osd.0 2024-05-08T20:26:21.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:26:21.261 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:21.328 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:21.329 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:21.329 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:21.329 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:21.329 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:21.779 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-05-08T20:26:21.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-05-08T20:26:21.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T20:26:21.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T20:26:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:21.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:21.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T20:26:21.943 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:21.943 INFO:tasks.ceph:role: osd.1 2024-05-08T20:26:21.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:26:21.943 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:22.006 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:22.472 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-05-08T20:26:22.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-05-08T20:26:22.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T20:26:22.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T20:26:22.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:22.627 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:22.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T20:26:22.680 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:22.680 INFO:tasks.ceph:role: osd.2 2024-05-08T20:26:22.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:26:22.680 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:26:22.745 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:22.747 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:23.225 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-05-08T20:26:23.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-05-08T20:26:23.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T20:26:23.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T20:26:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:23.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:23.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T20:26:23.424 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:23.425 INFO:tasks.ceph:role: osd.3 2024-05-08T20:26:23.425 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:26:23.425 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:26:23.488 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:23.488 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:23.488 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:23.923 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-05-08T20:26:23.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-05-08T20:26:23.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T20:26:24.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T20:26:24.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:24.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T20:26:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T20:26:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:26:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:26:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:26:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:24.177+0000 7f8bf230e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T20:26:27.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T20:26:27.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T20:26:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T20:26:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:26:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:26:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:26:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:27.277+0000 7f889aa357c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T20:26:30.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T20:26:30.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T20:26:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T20:26:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:26:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:26:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:26:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:30.397+0000 7f187e2a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T20:26:33.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T20:26:33.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:33.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T20:26:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T20:26:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:26:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:26:33.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:26:33.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:33.501+0000 7f09a716f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T20:26:36.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T20:26:36.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T20:26:36.552 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:36.552 INFO:tasks.ceph:role: osd.4 2024-05-08T20:26:36.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:26:36.552 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:26:36.619 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:36.620 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:37.067 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-08T20:26:37.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-08T20:26:37.070 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T20:26:37.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T20:26:37.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:37.174 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:37.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T20:26:37.226 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:37.226 INFO:tasks.ceph:role: osd.5 2024-05-08T20:26:37.226 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:26:37.226 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:37.287 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:37.753 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-08T20:26:37.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-08T20:26:37.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T20:26:37.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T20:26:37.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:37.895 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:37.895 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T20:26:37.949 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:37.949 INFO:tasks.ceph:role: osd.6 2024-05-08T20:26:37.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:26:37.949 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:26:38.013 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:38.014 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:38.015 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:38.015 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:38.015 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:38.499 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-08T20:26:38.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-08T20:26:38.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T20:26:38.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T20:26:38.668 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:38.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:38.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T20:26:38.724 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:26:38.724 INFO:tasks.ceph:role: osd.7 2024-05-08T20:26:38.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:26:38.725 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:26:38.788 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:26:38.789 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:26:38.789 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:26:38.789 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:26:39.212 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-08T20:26:39.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-08T20:26:39.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T20:26:39.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T20:26:39.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:26:39.317 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:26:39.318 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:39.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.412+0000 7f674e2287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T20:26:39.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.416+0000 7f674e2287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T20:26:39.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.416+0000 7f674e2287c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:26:39.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.416+0000 7f674e2287c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:26:39.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.416+0000 7f674e2287c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:26:39.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:39.424+0000 7f674e2287c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T20:26:42.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T20:26:42.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:42.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T20:26:42.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T20:26:42.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:26:42.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:26:42.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:26:42.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:42.496+0000 7fedd00b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T20:26:45.481 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T20:26:45.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T20:26:45.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T20:26:45.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:26:45.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:26:45.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:26:45.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:45.612+0000 7f587a64b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T20:26:48.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:26:48.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:26:48.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T20:26:48.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:48.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T20:26:48.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T20:26:48.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:26:48.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:26:48.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:26:48.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:48.704+0000 7ff8efd4e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T20:26:51.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T20:26:51.750 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T20:26:51.751 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T20:26:51.765 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T20:26:51.822 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T20:26:51.877 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T20:26:51.933 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T20:26:51.989 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:51.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T20:26:52.041 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:52.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T20:26:52.093 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T20:26:52.107 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T20:26:52.160 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T20:26:52.212 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T20:26:52.268 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.268 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T20:26:52.320 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T20:26:52.372 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T20:26:52.425 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:52.425 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T20:26:52.430 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:52.430 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T20:26:52.473 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T20:26:52.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:26:52.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:26:52.519 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-05-08T20:26:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3ztmp7H1JhAA6jAoAo/ydkT0h9jt+YaM3w== 2024-05-08T20:26:52.519 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3ztmhU2kLBAAEzD8ktoDxtI6ZN157IMQcg== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3ztm5/A7NRAAnYbC/lEr5XOgUcTHu91hXg== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDw3ztmzhLiChAAv1EB9F75h1hn/K/1NkdBNQ== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDz3ztmWyPmEBAAfjkDVheAO4NR63NQ0t541A== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD23ztm4oK4FxAAu9X89uEmnJGmDnhtlnMl0Q== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD53ztmF0HvHRAAM4MHOLuSCp3la7KoCLp+6g== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3ztm066uKRAA2GLDfGc8rQkGtgCuzbTpkg== 2024-05-08T20:26:52.520 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3ztmQ1tCOxAAGv5ers8bCzRIJ5NsTGJzFQ== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDt3ztmJfKMBRAARmSkZoOUPpBLVfGy5ZM82w== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD/3ztmua0MGRAArRGYycEJHTx4O0FoyUTEOQ== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAC4DtmIeXkHRAA33jJCBWtzYsLr8QD7mCOOA== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAF4DtmPFbKJBAA2mwd2E9qj5/ink0WUWVI4Q== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAI4DtmtCBAKhAAcD3iVZtSFleKXaEyvC2iOQ== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDt3ztmUah1CxAAVBh7F7sBU3YIeGmMXL9IPg== 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-05-08T20:26:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDt3ztmbY0KDhAALpQeVJsCj5elAWY6tcl94w== 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDs3ztmp7H1JhAA6jAoAo/ydkT0h9jt+YaM3w== 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDs3ztmhU2kLBAAEzD8ktoDxtI6ZN157IMQcg== 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-05-08T20:26:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDs3ztm5/A7NRAAnYbC/lEr5XOgUcTHu91hXg== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDw3ztmzhLiChAAv1EB9F75h1hn/K/1NkdBNQ== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDz3ztmWyPmEBAAfjkDVheAO4NR63NQ0t541A== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD23ztm4oK4FxAAu9X89uEmnJGmDnhtlnMl0Q== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD53ztmF0HvHRAAM4MHOLuSCp3la7KoCLp+6g== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDs3ztm066uKRAA2GLDfGc8rQkGtgCuzbTpkg== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDs3ztmQ1tCOxAAGv5ers8bCzRIJ5NsTGJzFQ== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDt3ztmJfKMBRAARmSkZoOUPpBLVfGy5ZM82w== 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-05-08T20:26:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQD/3ztmua0MGRAArRGYycEJHTx4O0FoyUTEOQ== 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAC4DtmIeXkHRAA33jJCBWtzYsLr8QD7mCOOA== 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAF4DtmPFbKJBAA2mwd2E9qj5/ink0WUWVI4Q== 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAI4DtmtCBAKhAAcD3iVZtSFleKXaEyvC2iOQ== 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDt3ztmUah1CxAAVBh7F7sBU3YIeGmMXL9IPg== 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-05-08T20:26:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDt3ztmbY0KDhAALpQeVJsCj5elAWY6tcl94w== 2024-05-08T20:26:52.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:26:52.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:26:52.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:52.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:52.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:52.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:52.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:52.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:52.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:52.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:52.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:52.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:26:53.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:26:53.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:53.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:53.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:53.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:26:53.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:26:53.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:26:53.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:26:53.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:26:53.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:26:53.830 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T20:26:53.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T20:26:53.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:26:53.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T20:26:53.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T20:26:53.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:26:54.055 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T20:26:54.066 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T20:26:54.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:26:54.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T20:26:54.262 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:54.265 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:26:54.309 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T20:26:54.309 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:26:54.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:26:54.312 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:26:54.312 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:26:54.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:26:54.354 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:26:54.354 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:26:54.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:26:54.356 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:26:54.357 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T20:26:54.357 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T20:26:54.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T20:26:54.359 INFO:tasks.ceph.mgr.y:Started 2024-05-08T20:26:54.359 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T20:26:54.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T20:26:54.361 INFO:tasks.ceph.mgr.x:Started 2024-05-08T20:26:54.362 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T20:26:54.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T20:26:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.472+0000 7fb2c534b640 1 Processor -- start 2024-05-08T20:26:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.472+0000 7fb2c534b640 1 -- start start 2024-05-08T20:26:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.472+0000 7fb2c534b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2c534b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00c1730 con 0x7fb2c0155670 2024-05-08T20:26:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2c534b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c0154b90 con 0x7fb2c00c47c0 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2c534b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00c1a10 con 0x7fb2c006d130 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2beffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2be7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2c0155670 0x7fb2c00bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45728/0 (socket says 172.21.15.81:45728) 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2be7fc640 1 -- 172.21.15.81:0/2607449211 learned_addr learned my addr 172.21.15.81:0/2607449211 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 msgr2=0x7fb2c00a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 msgr2=0x7fb2c00a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:26:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.476+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:26:54.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.680+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.680+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 msgr2=0x7fb2c00a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:26:54.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.680+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 msgr2=0x7fb2c00a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:26:54.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.680+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:26:54.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.680+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:26:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182761475 0 0) 0x7fb2c00c1730 con 0x7fb2c0155670 2024-05-08T20:26:54.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ac003530 con 0x7fb2c0155670 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102633825 0 0) 0x7fb2ac003530 con 0x7fb2c0155670 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 msgr2=0x7fb2c00a5e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 --2- 172.21.15.81:0/2607449211 >> v2:172.21.15.81:3300/0 conn(0x7fb2c006d130 0x7fb2c00a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 >> v1:172.21.15.117:6789/0 conn(0x7fb2c00c47c0 legacy=0x7fb2c01516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.716+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0154e70 con 0x7fb2c0155670 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb2a8001680 con 0x7fb2c0155670 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 >> v1:172.21.15.81:6789/0 conn(0x7fb2c0155670 legacy=0x7fb2c00bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 0x7fb2ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac0047d0 0x7fb2ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac005190 0x7fb2ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00c1a10 con 0x7fb2ac003980 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00c0e0 con 0x7fb2ac0047d0 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac00c2a0 con 0x7fb2ac005190 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 0x7fb2ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bf7fe640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac005190 0x7fb2ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac005190 msgr2=0x7fb2ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac005190 0x7fb2ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac0047d0 msgr2=0x7fb2ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac0047d0 0x7fb2ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2beffd640 1 -- 172.21.15.81:0/2607449211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac003530 con 0x7fb2ac003980 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bf7fe640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac005190 0x7fb2ac00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:26:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.720+0000 7fb2bf7fe640 1 -- 172.21.15.81:0/2607449211 reap_dead start 2024-05-08T20:26:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.724+0000 7fb2beffd640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 0x7fb2ac003da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800e8d0 tx=0x7fb2b801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cbbc015a1c349d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.724+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80ab670 con 0x7fb2ac003980 2024-05-08T20:26:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.724+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b80ab7d0 con 0x7fb2ac003980 2024-05-08T20:26:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.724+0000 7fb2bdffb640 1 -- 172.21.15.81:0/2607449211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80abbc0 con 0x7fb2ac003980 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 msgr2=0x7fb2ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 0x7fb2ac003da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800e8d0 tx=0x7fb2b801c870 comp rx=0 tx=0).stop 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- 172.21.15.81:0/2607449211 shutdown_connections 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 --2- 172.21.15.81:0/2607449211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2ac003980 0x7fb2ac003da0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- 172.21.15.81:0/2607449211 >> 172.21.15.81:0/2607449211 conn(0x7fb2c00c68c0 msgr2=0x7fb2c00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- 172.21.15.81:0/2607449211 shutdown_connections 2024-05-08T20:26:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- 172.21.15.81:0/2607449211 wait complete. 2024-05-08T20:26:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 Processor -- start 2024-05-08T20:26:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.728+0000 7fb2c534b640 1 -- start start 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac003980 0x7fb2c0151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2c00a8870 0x7fb2c00a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00a7e20 con 0x7fb2c01f1640 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0072600 con 0x7fb2ac003980 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2c534b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00728e0 con 0x7fb2c00a8870 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2beffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac003980 0x7fb2c0151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2bf7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2c00a8870 0x7fb2c00a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 -- 172.21.15.81:0/1826993928 learned_addr learned my addr 172.21.15.81:0/1826993928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 -- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2c00a8870 msgr2=0x7fb2c00a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2c00a8870 0x7fb2c00a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 -- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac003980 msgr2=0x7fb2c0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac003980 0x7fb2c0151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 -- 172.21.15.81:0/1826993928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00a8070 con 0x7fb2c01f1640 2024-05-08T20:26:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2be7fc640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800c790 tx=0x7fb2a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800cea0 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a80074e0 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.732+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004a10 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.736+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c00a8350 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.736+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c01f1ac0 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.736+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb2a800a640 con 0x7fb2c01f1640 2024-05-08T20:26:54.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.736+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb2a8012400 con 0x7fb2c01f1640 2024-05-08T20:26:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.736+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00a8540 con 0x7fb2c01f1640 2024-05-08T20:26:54.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.744+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb2a8018070 con 0x7fb2c01f1640 2024-05-08T20:26:54.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.808+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb2c0074950 con 0x7fb2c01f1640 2024-05-08T20:26:54.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2b77fe640 1 -- 172.21.15.81:0/1826993928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb2a800aa80 con 0x7fb2c01f1640 2024-05-08T20:26:54.816 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-05-08T20:26:54.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 msgr2=0x7fb2c0149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:54.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800c790 tx=0x7fb2a800cc50 comp rx=0 tx=0).stop 2024-05-08T20:26:54.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 shutdown_connections 2024-05-08T20:26:54.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2c00a8870 0x7fb2c00a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c01f1640 0x7fb2c0149f50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 --2- 172.21.15.81:0/1826993928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2ac003980 0x7fb2c0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 >> 172.21.15.81:0/1826993928 conn(0x7fb2c00c68c0 msgr2=0x7fb2c00c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 shutdown_connections 2024-05-08T20:26:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:54.812+0000 7fb2c534b640 1 -- 172.21.15.81:0/1826993928 wait complete. 2024-05-08T20:26:54.837 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T20:26:54.837 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T20:26:54.837 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:54.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T20:26:54.850 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:54.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T20:26:54.905 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:54.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T20:26:54.916 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:54.912+0000 7fb52b6e3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:26:54.943 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:54.940+0000 7f4060988180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:26:54.955 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:26:54.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T20:26:55.008 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:55.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T20:26:55.022 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:55.022 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T20:26:55.077 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:55.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T20:26:55.133 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:26:55.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T20:26:55.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 35d3a8b1-1b6b-459d-a234-cfb0e5f6758f 0 2024-05-08T20:26:55.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 Processor -- start 2024-05-08T20:26:55.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 -- start start 2024-05-08T20:26:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092806b230 0x7f09280c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0928070c00 0x7f092814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09280c3a50 con 0x7f092814edf0 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0928072940 con 0x7f0928070c00 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092d233640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280705e0 con 0x7f092806b230 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0928070c00 0x7f092814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f0926d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092806b230 0x7f09280c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092759e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f092814edf0 0x7f09281519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58088/0 (socket says 172.21.15.117:58088) 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092759e640 1 -- 172.21.15.117:0/1069786691 learned_addr learned my addr 172.21.15.117:0/1069786691 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092659c640 1 -- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092806b230 msgr2=0x7f09280c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092659c640 1 --2- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092806b230 0x7f09280c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092659c640 1 -- 172.21.15.117:0/1069786691 >> v1:172.21.15.117:6789/0 conn(0x7f092814edf0 legacy=0x7f09281519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f092659c640 1 -- 172.21.15.117:0/1069786691 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280708c0 con 0x7f0928070c00 2024-05-08T20:26:55.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.344+0000 7f0925d9b640 1 -- 172.21.15.117:0/1069786691 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549126369 0 0) 0x7f09280c3a50 con 0x7f092814edf0 2024-05-08T20:26:55.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092659c640 1 --2- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092814e8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376c04ef4bc0b7e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f0925d9b640 1 -- 172.21.15.117:0/1069786691 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0ab600 con 0x7f0928070c00 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f0925d9b640 1 -- 172.21.15.117:0/1069786691 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0a7050 con 0x7f0928070c00 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f0925d9b640 1 -- 172.21.15.117:0/1069786691 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0ab980 con 0x7f0928070c00 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 msgr2=0x7f092814e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 --2- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092814e8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c01c410 comp rx=0 tx=0).stop 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- 172.21.15.117:0/1069786691 shutdown_connections 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 --2- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092814e8b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 --2- 172.21.15.117:0/1069786691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092806b230 0x7f09280c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- 172.21.15.117:0/1069786691 >> 172.21.15.117:0/1069786691 conn(0x7f09280c71b0 msgr2=0x7f09280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- 172.21.15.117:0/1069786691 shutdown_connections 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- 172.21.15.117:0/1069786691 wait complete. 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 Processor -- start 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.348+0000 7f092d233640 1 -- start start 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092806b230 0x7f09281434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092814edf0 0x7f09281ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092814c440 con 0x7f092806b230 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928143a30 con 0x7f0928070c00 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092813dc70 con 0x7f092814edf0 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092814edf0 0x7f09281ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38354/0 (socket says 172.21.15.117:38354) 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 -- 172.21.15.117:0/2193342967 learned_addr learned my addr 172.21.15.117:0/2193342967 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 -- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092814edf0 msgr2=0x7f09281ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092814edf0 0x7f09281ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 -- 172.21.15.117:0/2193342967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092806b230 msgr2=0x7f09281434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092806b230 0x7f09281434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 -- 172.21.15.117:0/2193342967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009420 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092659c640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b4410 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0b4570 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b4920 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09280c6da0 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092815ac00 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f091c0b2040 con 0x7f0928070c00 2024-05-08T20:26:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f091c0bddc0 con 0x7f0928070c00 2024-05-08T20:26:55.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.352+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09280675e0 con 0x7f0928070c00 2024-05-08T20:26:55.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.360+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f091c0c2060 con 0x7f0928070c00 2024-05-08T20:26:55.371 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:55.368+0000 7fb52b6e3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:26:55.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.428+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35d3a8b1-1b6b-459d-a234-cfb0e5f6758f", "id": 0} v 0) v1 -- 0x7f0928074950 con 0x7f0928070c00 2024-05-08T20:26:55.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f090f7fe640 1 -- 172.21.15.117:0/2193342967 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35d3a8b1-1b6b-459d-a234-cfb0e5f6758f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f091c0b8070 con 0x7f0928070c00 2024-05-08T20:26:55.438 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-05-08T20:26:55.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 msgr2=0x7f092815a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c0191b0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 shutdown_connections 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092814edf0 0x7f09281ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0928070c00 0x7f092815a6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 --2- 172.21.15.117:0/2193342967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092806b230 0x7f09281434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 >> 172.21.15.117:0/2193342967 conn(0x7f09280c71b0 msgr2=0x7f09280c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 shutdown_connections 2024-05-08T20:26:55.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.436+0000 7f092d233640 1 -- 172.21.15.117:0/2193342967 wait complete. 2024-05-08T20:26:55.447 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:55.444+0000 7f4060988180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:26:55.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 057bf102-d571-4d10-b66b-8d5c09f237dd 1 2024-05-08T20:26:55.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 Processor -- start 2024-05-08T20:26:55.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 -- start start 2024-05-08T20:26:55.568 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:55.564+0000 7fb52b6e3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 0x7f75e00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 0x7f75e00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e0155e10 con 0x7f75e00a94b0 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e006e790 con 0x7f75e00c2bc0 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75e52df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e006f460 con 0x7f75e00c30d0 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 0x7f75e00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75df7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f75e00a94b0 0x7f75e00a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58098/0 (socket says 172.21.15.117:58098) 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75df7fe640 1 -- 172.21.15.117:0/1553886235 learned_addr learned my addr 172.21.15.117:0/1553886235 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:55.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.564+0000 7f75d7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 0x7f75e00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75deffd640 1 -- 172.21.15.117:0/1553886235 >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 msgr2=0x7f75e00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75deffd640 1 --2- 172.21.15.117:0/1553886235 >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 0x7f75e00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75deffd640 1 -- 172.21.15.117:0/1553886235 >> v1:172.21.15.117:6789/0 conn(0x7f75e00a94b0 legacy=0x7f75e00a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75de7fc640 1 -- 172.21.15.117:0/1553886235 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664942029 0 0) 0x7f75e0155e10 con 0x7f75e00a94b0 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75deffd640 1 -- 172.21.15.117:0/1553886235 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0156080 con 0x7f75e00c30d0 2024-05-08T20:26:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75d7fff640 1 --2- 172.21.15.117:0/1553886235 >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 0x7f75e00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:26:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75deffd640 1 --2- 172.21.15.117:0/1553886235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 0x7f75e00c34b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097c0 tx=0x7f75d001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc4156c85a66157 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75de7fc640 1 -- 172.21.15.117:0/1553886235 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00ac640 con 0x7f75e00c30d0 2024-05-08T20:26:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75de7fc640 1 -- 172.21.15.117:0/1553886235 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d00ac7a0 con 0x7f75e00c30d0 2024-05-08T20:26:55.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75de7fc640 1 -- 172.21.15.117:0/1553886235 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00acb30 con 0x7f75e00c30d0 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 -- 172.21.15.117:0/1553886235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 msgr2=0x7f75e00c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 --2- 172.21.15.117:0/1553886235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 0x7f75e00c34b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097c0 tx=0x7f75d001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 -- 172.21.15.117:0/1553886235 shutdown_connections 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 --2- 172.21.15.117:0/1553886235 >> v2:172.21.15.117:3300/0 conn(0x7f75e00c2bc0 0x7f75e00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 --2- 172.21.15.117:0/1553886235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c30d0 0x7f75e00c34b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 -- 172.21.15.117:0/1553886235 >> 172.21.15.117:0/1553886235 conn(0x7f75e00c4cc0 msgr2=0x7f75e00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 -- 172.21.15.117:0/1553886235 shutdown_connections 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.568+0000 7f75e52df640 1 -- 172.21.15.117:0/1553886235 wait complete. 2024-05-08T20:26:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 Processor -- start 2024-05-08T20:26:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- start start 2024-05-08T20:26:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 0x7f75e00ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 0x7f75e01518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0140b50 con 0x7f75e00c30d0 2024-05-08T20:26:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0149a20 con 0x7f75e00a94b0 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00ab1a0 con 0x7f75e00c2bc0 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75deffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 0x7f75e00ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75deffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 0x7f75e00ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38374/0 (socket says 172.21.15.117:38374) 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75deffd640 1 -- 172.21.15.117:0/4117847759 learned_addr learned my addr 172.21.15.117:0/4117847759 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54336/0 (socket says 172.21.15.117:54336) 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75df7fe640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 0x7f75e01518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 -- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 msgr2=0x7f75e00ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 0x7f75e00ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 -- 172.21.15.117:0/4117847759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 msgr2=0x7f75e01518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 0x7f75e01518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 -- 172.21.15.117:0/4117847759 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009420 con 0x7f75e00c2bc0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75df7fe640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 0x7f75e01518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d7fff640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e9b0 tx=0x7f75c800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800c9a0 con 0x7f75e00c2bc0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800cb00 con 0x7f75e00c2bc0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0009420 con 0x7f75e00c2bc0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8013470 con 0x7f75e00c2bc0 2024-05-08T20:26:55.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e0149ce0 con 0x7f75e00c2bc0 2024-05-08T20:26:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f75c8005ca0 con 0x7f75e00c2bc0 2024-05-08T20:26:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f75c80063d0 con 0x7f75e00c2bc0 2024-05-08T20:26:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.572+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0074950 con 0x7f75e00c2bc0 2024-05-08T20:26:55.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.576+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f75c8021060 con 0x7f75e00c2bc0 2024-05-08T20:26:55.644 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:55.640+0000 7f4060988180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:26:55.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.644+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "057bf102-d571-4d10-b66b-8d5c09f237dd", "id": 1} v 0) v1 -- 0x7f75e0072600 con 0x7f75e00c2bc0 2024-05-08T20:26:55.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75d77fe640 1 -- 172.21.15.117:0/4117847759 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "057bf102-d571-4d10-b66b-8d5c09f237dd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75c8017070 con 0x7f75e00c2bc0 2024-05-08T20:26:55.655 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 msgr2=0x7f75e01513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e9b0 tx=0x7f75c800ee70 comp rx=0 tx=0).stop 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 shutdown_connections 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e00c30d0 0x7f75e01518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e00c2bc0 0x7f75e01513b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 --2- 172.21.15.117:0/4117847759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e00a94b0 0x7f75e00ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 >> 172.21.15.117:0/4117847759 conn(0x7f75e00c4cc0 msgr2=0x7f75e015c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 shutdown_connections 2024-05-08T20:26:55.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.652+0000 7f75e52df640 1 -- 172.21.15.117:0/4117847759 wait complete. 2024-05-08T20:26:55.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 07ebdf02-bf28-4000-8328-1608230943c5 2 2024-05-08T20:26:55.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 Processor -- start 2024-05-08T20:26:55.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 -- start start 2024-05-08T20:26:55.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fddb006d130 0x7fddb0065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb00a6270 con 0x7fddb00c3890 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb0158de0 con 0x7fddb006d130 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.780+0000 7fddb5a40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb0158b00 con 0x7fddb00a5e30 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54344/0 (socket says 172.21.15.117:54344) 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 -- 172.21.15.117:0/829152508 learned_addr learned my addr 172.21.15.117:0/829152508 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddaeffd640 1 --2- 172.21.15.117:0/829152508 >> v2:172.21.15.81:3300/0 conn(0x7fddb006d130 0x7fddb0065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 -- 172.21.15.117:0/829152508 >> v2:172.21.15.81:3300/0 conn(0x7fddb006d130 msgr2=0x7fddb0065fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 --2- 172.21.15.117:0/829152508 >> v2:172.21.15.81:3300/0 conn(0x7fddb006d130 0x7fddb0065fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 -- 172.21.15.117:0/829152508 >> v1:172.21.15.81:6789/0 conn(0x7fddb00c3890 legacy=0x7fddb0154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:55.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 -- 172.21.15.117:0/829152508 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00c1360 con 0x7fddb00a5e30 2024-05-08T20:26:55.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddae7fc640 1 --2- 172.21.15.117:0/829152508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009870 tx=0x7fdda401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8af7a97ae79092a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddadffb640 1 -- 172.21.15.117:0/829152508 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40aa430 con 0x7fddb00a5e30 2024-05-08T20:26:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddadffb640 1 -- 172.21.15.117:0/829152508 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40aa590 con 0x7fddb00a5e30 2024-05-08T20:26:55.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddadffb640 1 -- 172.21.15.117:0/829152508 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40aa920 con 0x7fddb00a5e30 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 -- 172.21.15.117:0/829152508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 msgr2=0x7fddb00c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 --2- 172.21.15.117:0/829152508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009870 tx=0x7fdda401c4f0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 -- 172.21.15.117:0/829152508 shutdown_connections 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 --2- 172.21.15.117:0/829152508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00c3350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 --2- 172.21.15.117:0/829152508 >> v2:172.21.15.81:3300/0 conn(0x7fddb006d130 0x7fddb0065fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 -- 172.21.15.117:0/829152508 >> 172.21.15.117:0/829152508 conn(0x7fddb00c68c0 msgr2=0x7fddb00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 -- 172.21.15.117:0/829152508 shutdown_connections 2024-05-08T20:26:55.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.784+0000 7fddb5a40640 1 -- 172.21.15.117:0/829152508 wait complete. 2024-05-08T20:26:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 Processor -- start 2024-05-08T20:26:55.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- start start 2024-05-08T20:26:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb006d130 0x7fddb00a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddb00c3890 0x7fddb01ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01514f0 con 0x7fddb006d130 2024-05-08T20:26:55.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01f1420 con 0x7fddb00c3890 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00a7870 con 0x7fddb00a5e30 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54352/0 (socket says 172.21.15.117:54352) 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 -- 172.21.15.117:0/811073137 learned_addr learned my addr 172.21.15.117:0/811073137 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddaf7fe640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddb00c3890 0x7fddb01ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddaeffd640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb006d130 0x7fddb00a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 -- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddb00c3890 msgr2=0x7fddb01ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddb00c3890 0x7fddb01ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 -- 172.21.15.117:0/811073137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb006d130 msgr2=0x7fddb00a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb006d130 0x7fddb00a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 -- 172.21.15.117:0/811073137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40094d0 con 0x7fddb00a5e30 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddae7fc640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdda40ac040 tx=0x7fdda401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b3800 con 0x7fddb00a5e30 2024-05-08T20:26:55.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40b3980 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb01f1960 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b3d30 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb01f1680 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fdda40bd6f0 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdda40b2980 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.788+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb01ed4f0 con 0x7fddb00a5e30 2024-05-08T20:26:55.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.792+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fddb01ed4f0 con 0x7fddb00a5e30 2024-05-08T20:26:55.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.872+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "07ebdf02-bf28-4000-8328-1608230943c5", "id": 2} v 0) v1 -- 0x7fddb0074950 con 0x7fddb00a5e30 2024-05-08T20:26:55.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.880+0000 7fdd97fff640 1 -- 172.21.15.117:0/811073137 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07ebdf02-bf28-4000-8328-1608230943c5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdda40cd0b0 con 0x7fddb00a5e30 2024-05-08T20:26:55.885 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 msgr2=0x7fddb00aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdda40ac040 tx=0x7fdda401ad30 comp rx=0 tx=0).stop 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 shutdown_connections 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddb00c3890 0x7fddb01ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddb00a5e30 0x7fddb00aaa10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 --2- 172.21.15.117:0/811073137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb006d130 0x7fddb00a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 >> 172.21.15.117:0/811073137 conn(0x7fddb00c68c0 msgr2=0x7fddb00c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 shutdown_connections 2024-05-08T20:26:55.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:55.884+0000 7fddb5a40640 1 -- 172.21.15.117:0/811073137 wait complete. 2024-05-08T20:26:55.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 3a99259d-d34c-4598-8b08-ae343ca95d63 3 2024-05-08T20:26:56.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 Processor -- start 2024-05-08T20:26:56.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 -- start start 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2cd806c250 0x7f2cd80c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd81520a0 con 0x7f2cd814f1a0 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd80c13e0 con 0x7f2cd80c2570 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cde428640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd81517d0 con 0x7f2cd806c250 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cd77fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2cd806c250 0x7f2cd80c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cdc9c5640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2cd80c2570 0x7f2cd815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58100/0 (socket says 172.21.15.117:58100) 2024-05-08T20:26:56.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.016+0000 7f2cdc9c5640 1 -- 172.21.15.117:0/4167592698 learned_addr learned my addr 172.21.15.117:0/4167592698 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd77fe640 1 -- 172.21.15.117:0/4167592698 >> v1:172.21.15.117:6789/0 conn(0x7f2cd80c2570 legacy=0x7f2cd815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd77fe640 1 -- 172.21.15.117:0/4167592698 >> v1:172.21.15.81:6789/0 conn(0x7f2cd814f1a0 legacy=0x7f2cd80c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd77fe640 1 -- 172.21.15.117:0/4167592698 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80c1660 con 0x7f2cd806c250 2024-05-08T20:26:56.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd77fe640 1 --2- 172.21.15.117:0/4167592698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd806c250 0x7f2cd80c1940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0097c0 tx=0x7f2ccc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87686a0f1276abc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd6ffd640 1 -- 172.21.15.117:0/4167592698 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0ab600 con 0x7f2cd806c250 2024-05-08T20:26:56.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd6ffd640 1 -- 172.21.15.117:0/4167592698 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc0a7050 con 0x7f2cd806c250 2024-05-08T20:26:56.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cd6ffd640 1 -- 172.21.15.117:0/4167592698 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0ab980 con 0x7f2cd806c250 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 -- 172.21.15.117:0/4167592698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd806c250 msgr2=0x7f2cd80c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 --2- 172.21.15.117:0/4167592698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd806c250 0x7f2cd80c1940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0097c0 tx=0x7f2ccc01c380 comp rx=0 tx=0).stop 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 -- 172.21.15.117:0/4167592698 shutdown_connections 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 --2- 172.21.15.117:0/4167592698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd806c250 0x7f2cd80c1940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 -- 172.21.15.117:0/4167592698 >> 172.21.15.117:0/4167592698 conn(0x7f2cd80c68c0 msgr2=0x7f2cd80c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 -- 172.21.15.117:0/4167592698 shutdown_connections 2024-05-08T20:26:56.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.020+0000 7f2cde428640 1 -- 172.21.15.117:0/4167592698 wait complete. 2024-05-08T20:26:56.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 Processor -- start 2024-05-08T20:26:56.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- start start 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cd80c2570 0x7f2cd8146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 0x7f2cd8147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8153590 con 0x7f2cd80c2570 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81476b0 con 0x7f2cd814f1a0 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd814e910 con 0x7f2cd806c250 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cdc9c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 0x7f2cd8147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54368/0 (socket says 172.21.15.117:54368) 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2229730704 learned_addr learned my addr 172.21.15.117:0/2229730704 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd77fe640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cd80c2570 0x7f2cd8146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 msgr2=0x7f2cd8147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 0x7f2cd8147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2229730704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cd80c2570 msgr2=0x7f2cd8146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cd80c2570 0x7f2cd8146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2229730704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc009420 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cdc9c5640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 0x7f2cd8147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd7fff640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c7a0 tx=0x7f2cd000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0003b80 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0003ce0 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd80a6ae0 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000aa90 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd80a6800 con 0x7f2cd806c250 2024-05-08T20:26:56.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2cd00050d0 con 0x7f2cd806c250 2024-05-08T20:26:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2cd0012ab0 con 0x7f2cd806c250 2024-05-08T20:26:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.024+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd8074950 con 0x7f2cd806c250 2024-05-08T20:26:56.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.028+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2cd0012cc0 con 0x7f2cd806c250 2024-05-08T20:26:56.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.096+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3a99259d-d34c-4598-8b08-ae343ca95d63", "id": 3} v 0) v1 -- 0x7f2cd81515b0 con 0x7f2cd806c250 2024-05-08T20:26:56.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.104+0000 7f2cd4ff9640 1 -- 172.21.15.117:0/2229730704 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a99259d-d34c-4598-8b08-ae343ca95d63", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2cd00125e0 con 0x7f2cd806c250 2024-05-08T20:26:56.108 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-05-08T20:26:56.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 msgr2=0x7f2cd8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c7a0 tx=0x7f2cd000cc60 comp rx=0 tx=0).stop 2024-05-08T20:26:56.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 shutdown_connections 2024-05-08T20:26:56.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd814f1a0 0x7f2cd8147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cd80c2570 0x7f2cd8146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 --2- 172.21.15.117:0/2229730704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cd806c250 0x7f2cd8155100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 >> 172.21.15.117:0/2229730704 conn(0x7f2cd80c68c0 msgr2=0x7f2cd80aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 shutdown_connections 2024-05-08T20:26:56.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.108+0000 7f2cde428640 1 -- 172.21.15.117:0/2229730704 wait complete. 2024-05-08T20:26:56.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 2fc6a93a-5001-4e39-812a-16200995ae22 4 2024-05-08T20:26:56.143 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.140+0000 7fb52b6e3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:26:56.185 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.180+0000 7f4060988180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:26:56.198 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.196+0000 7fb52b6e3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:26:56.238 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.236+0000 7f4060988180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:26:56.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.236+0000 7fbd65015640 1 Processor -- start 2024-05-08T20:26:56.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.236+0000 7fbd65015640 1 -- start start 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd600c34e0 0x7fbd601554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd60158080 con 0x7fbd60152340 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6006ab70 con 0x7fbd600c34e0 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60154b10 con 0x7fbd600c2570 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd600c34e0 0x7fbd601554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd600c34e0 0x7fbd601554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38420/0 (socket says 172.21.15.117:38420) 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 -- 172.21.15.117:0/1139735094 learned_addr learned my addr 172.21.15.117:0/1139735094 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54370/0 (socket says 172.21.15.117:54370) 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 -- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 msgr2=0x7fbd60154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 -- 172.21.15.117:0/1139735094 >> v1:172.21.15.81:6789/0 conn(0x7fbd60152340 legacy=0x7fbd6006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 -- 172.21.15.117:0/1139735094 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6006a890 con 0x7fbd600c34e0 2024-05-08T20:26:56.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5e59c640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:26:56.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5f59e640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601554a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3c0298aaaf22eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5dd9b640 1 -- 172.21.15.117:0/1139735094 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580a57b0 con 0x7fbd600c34e0 2024-05-08T20:26:56.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5dd9b640 1 -- 172.21.15.117:0/1139735094 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580a5910 con 0x7fbd600c34e0 2024-05-08T20:26:56.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd5dd9b640 1 -- 172.21.15.117:0/1139735094 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580a5ca0 con 0x7fbd600c34e0 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 -- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 msgr2=0x7fbd601554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.240+0000 7fbd65015640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601554a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009e50 tx=0x7fbd5801c930 comp rx=0 tx=0).stop 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/1139735094 shutdown_connections 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601554a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 --2- 172.21.15.117:0/1139735094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd600c2570 0x7fbd60154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/1139735094 >> 172.21.15.117:0/1139735094 conn(0x7fbd600c71b0 msgr2=0x7fbd600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/1139735094 shutdown_connections 2024-05-08T20:26:56.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/1139735094 wait complete. 2024-05-08T20:26:56.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 Processor -- start 2024-05-08T20:26:56.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- start start 2024-05-08T20:26:56.248 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600c2570 0x7fbd601f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601f09b0 con 0x7fbd600c2570 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60151b00 con 0x7fbd600c34e0 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6013fad0 con 0x7fbd60152340 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54372/0 (socket says 172.21.15.117:54372) 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 -- 172.21.15.117:0/302429854 learned_addr learned my addr 172.21.15.117:0/302429854 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5e59c640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5ed9d640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600c2570 0x7fbd601f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 -- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 msgr2=0x7fbd601515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 -- 172.21.15.117:0/302429854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600c2570 msgr2=0x7fbd601f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600c2570 0x7fbd601f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 -- 172.21.15.117:0/302429854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009420 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd5f59e640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd5801afe0 tx=0x7fbd580196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580b8670 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580b87f0 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd58009b30 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580b8ba0 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60150dc0 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbd580c1400 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbd580b6950 con 0x7fbd60152340 2024-05-08T20:26:56.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.244+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600675e0 con 0x7fbd60152340 2024-05-08T20:26:56.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.248+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fbd580dfdc0 con 0x7fbd60152340 2024-05-08T20:26:56.254 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.252+0000 7fb52b6e3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:26:56.291 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.288+0000 7f4060988180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:26:56.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.316+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2fc6a93a-5001-4e39-812a-16200995ae22", "id": 4} v 0) v1 -- 0x7fbd601559e0 con 0x7fbd60152340 2024-05-08T20:26:56.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.324+0000 7fbd477fe640 1 -- 172.21.15.117:0/302429854 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fc6a93a-5001-4e39-812a-16200995ae22", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd580ce030 con 0x7fbd60152340 2024-05-08T20:26:56.328 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-05-08T20:26:56.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 msgr2=0x7fbd60071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd5801afe0 tx=0x7fbd580196d0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 shutdown_connections 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd60152340 0x7fbd60071890 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd600c34e0 0x7fbd601515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 --2- 172.21.15.117:0/302429854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600c2570 0x7fbd601f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 >> 172.21.15.117:0/302429854 conn(0x7fbd600c71b0 msgr2=0x7fbd6014ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 shutdown_connections 2024-05-08T20:26:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fbd65015640 1 -- 172.21.15.117:0/302429854 wait complete. 2024-05-08T20:26:56.332 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.328+0000 7fb52b6e3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:26:56.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f67ddc53-b077-466f-a37d-6d8d4634a98f 5 2024-05-08T20:26:56.368 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.364+0000 7f4060988180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:26:56.386 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.384+0000 7fb52b6e3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:26:56.419 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.416+0000 7f4060988180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:26:56.465 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.460+0000 7fb52b6e3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:26:56.496 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.492+0000 7f4060988180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:26:56.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.496+0000 7f48ac95c640 1 Processor -- start 2024-05-08T20:26:56.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.496+0000 7f48ac95c640 1 -- start start 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48ac95c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48a8072640 0x7f48a8070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48ac95c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a81523d0 con 0x7f48a814eab0 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48ac95c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a80c3240 con 0x7f48a80c2030 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48ac95c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a8071710 con 0x7f48a8072640 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f48a80c2030 0x7f48a806cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58114/0 (socket says 172.21.15.117:58114) 2024-05-08T20:26:56.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 -- 172.21.15.117:0/2192659526 learned_addr learned my addr 172.21.15.117:0/2192659526 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f489ffff640 1 --2- 172.21.15.117:0/2192659526 >> v2:172.21.15.81:3300/0 conn(0x7f48a8072640 0x7f48a8070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212581909 0 0) 0x7f48a80c3240 con 0x7f48a80c2030 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4894005740 con 0x7f48a80c2030 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420938957 0 0) 0x7f4894005740 con 0x7f48a80c2030 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 >> v2:172.21.15.81:3300/0 conn(0x7f48a8072640 msgr2=0x7f48a8070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 --2- 172.21.15.117:0/2192659526 >> v2:172.21.15.81:3300/0 conn(0x7f48a8072640 0x7f48a8070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 >> v1:172.21.15.81:6789/0 conn(0x7f48a814eab0 legacy=0x7f48a80c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80c3520 con 0x7f48a80c2030 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4898001680 con 0x7f48a80c2030 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 >> v1:172.21.15.117:6789/0 conn(0x7f48a80c2030 legacy=0x7f48a806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f4894005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48940069e0 0x7f4894006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48940074c0 0x7f489400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489400e360 con 0x7f48940069e0 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489400e4d0 con 0x7f48940074c0 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489400e690 con 0x7f4894005b90 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f4894005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a6d9d640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48940074c0 0x7f489400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f489ffff640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48940069e0 0x7f4894006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 -- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48940074c0 msgr2=0x7f489400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48940074c0 0x7f489400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 -- 172.21.15.117:0/2192659526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48940069e0 msgr2=0x7f4894006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:56.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48940069e0 0x7f4894006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 -- 172.21.15.117:0/2192659526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894005740 con 0x7f4894005b90 2024-05-08T20:26:56.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a6d9d640 1 -- 172.21.15.117:0/2192659526 reap_dead start 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a659c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f4894005fb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f489800c210 tx=0x7f489801cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6658c080002ad63a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898005ae0 con 0x7f4894005b90 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898005c40 con 0x7f4894005b90 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.500+0000 7f48a5d9b640 1 -- 172.21.15.117:0/2192659526 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980072b0 con 0x7f4894005b90 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 msgr2=0x7f4894005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f4894005fb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f489800c210 tx=0x7f489801cbe0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2192659526 shutdown_connections 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2192659526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f4894005fb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2192659526 >> 172.21.15.117:0/2192659526 conn(0x7f48a80c3cb0 msgr2=0x7f48a80c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2192659526 shutdown_connections 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2192659526 wait complete. 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 Processor -- start 2024-05-08T20:26:56.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- start start 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a80acda0 0x7f48a81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 0x7f48a81ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80aade0 con 0x7f48a80acda0 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80abc40 con 0x7f48a8153730 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a80ab030 con 0x7f4894005b90 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 0x7f48a81ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54396/0 (socket says 172.21.15.117:54396) 2024-05-08T20:26:56.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 -- 172.21.15.117:0/2989419259 learned_addr learned my addr 172.21.15.117:0/2989419259 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489ffff640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a80acda0 0x7f48a81531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 -- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 msgr2=0x7f48a81ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 0x7f48a81ec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 -- 172.21.15.117:0/2989419259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a80acda0 msgr2=0x7f48a81531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a80acda0 0x7f48a81531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 -- 172.21.15.117:0/2989419259 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80ab310 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a6d9d640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 0x7f48a81ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48a659c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f489800c210 tx=0x7f4894007a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980b4070 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4898001480 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48980070a0 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a80ab5f0 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a80c6d00 con 0x7f4894005b90 2024-05-08T20:26:56.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4898007200 con 0x7f4894005b90 2024-05-08T20:26:56.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f48980ae460 con 0x7f4894005b90 2024-05-08T20:26:56.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.504+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a80748b0 con 0x7f4894005b90 2024-05-08T20:26:56.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.508+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f4898007cf0 con 0x7f4894005b90 2024-05-08T20:26:56.519 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.516+0000 7fb52b6e3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:26:56.548 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.544+0000 7f4060988180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:26:56.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.576+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f67ddc53-b077-466f-a37d-6d8d4634a98f", "id": 5} v 0) v1 -- 0x7f48a814c850 con 0x7f4894005b90 2024-05-08T20:26:56.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f489effd640 1 -- 172.21.15.117:0/2989419259 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f67ddc53-b077-466f-a37d-6d8d4634a98f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48980075f0 con 0x7f4894005b90 2024-05-08T20:26:56.586 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-05-08T20:26:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 msgr2=0x7f48a80ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f489800c210 tx=0x7f4894007a10 comp rx=0 tx=0).stop 2024-05-08T20:26:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 shutdown_connections 2024-05-08T20:26:56.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48a8153730 0x7f48a81ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a80acda0 0x7f48a81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 --2- 172.21.15.117:0/2989419259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4894005b90 0x7f48a80ac860 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 >> 172.21.15.117:0/2989419259 conn(0x7f48a80c3cb0 msgr2=0x7f48a8151720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 shutdown_connections 2024-05-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.584+0000 7f48ac95c640 1 -- 172.21.15.117:0/2989419259 wait complete. 2024-05-08T20:26:56.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 6254b146-801c-4d69-af74-48327ce9b920 6 2024-05-08T20:26:56.674 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.672+0000 7fb52b6e3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:26:56.698 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.696+0000 7f4060988180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:26:56.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 Processor -- start 2024-05-08T20:26:56.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 -- start start 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f8c152220 0x7f5f8c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c155140 con 0x7f5f8c0c26e0 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c0c32d0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f912ad640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c0c4780 con 0x7f5f8c152220 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5f8c0aac30 0x7f5f8c0c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58116/0 (socket says 172.21.15.117:58116) 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8b7fe640 1 -- 172.21.15.117:0/1999146754 learned_addr learned my addr 172.21.15.117:0/1999146754 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8affd640 1 --2- 172.21.15.117:0/1999146754 >> v2:172.21.15.81:3300/0 conn(0x7f5f8c152220 0x7f5f8c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499314329 0 0) 0x7f5f8c0c32d0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f74003530 con 0x7f5f8c0aac30 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506032622 0 0) 0x7f5f74003530 con 0x7f5f8c0aac30 2024-05-08T20:26:56.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8affd640 1 -- 172.21.15.117:0/1999146754 >> v1:172.21.15.117:6789/0 conn(0x7f5f8c0aac30 legacy=0x7f5f8c0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8affd640 1 -- 172.21.15.117:0/1999146754 >> v1:172.21.15.81:6789/0 conn(0x7f5f8c0c26e0 legacy=0x7f5f8c0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.712+0000 7f5f8affd640 1 -- 172.21.15.117:0/1999146754 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c072650 con 0x7f5f8c152220 2024-05-08T20:26:56.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f8affd640 1 --2- 172.21.15.117:0/1999146754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c152220 0x7f5f8c1555d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009740 tx=0x7f5f7c01c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfc438eb7808361 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84001a00 con 0x7f5f8c152220 2024-05-08T20:26:56.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c0a7050 con 0x7f5f8c152220 2024-05-08T20:26:56.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f89ffb640 1 -- 172.21.15.117:0/1999146754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0ab600 con 0x7f5f8c152220 2024-05-08T20:26:56.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 -- 172.21.15.117:0/1999146754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c152220 msgr2=0x7f5f8c1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.720 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 --2- 172.21.15.117:0/1999146754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c152220 0x7f5f8c1555d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009740 tx=0x7f5f7c01c2a0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 -- 172.21.15.117:0/1999146754 shutdown_connections 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 --2- 172.21.15.117:0/1999146754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c152220 0x7f5f8c1555d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 -- 172.21.15.117:0/1999146754 >> 172.21.15.117:0/1999146754 conn(0x7f5f8c0c4cc0 msgr2=0x7f5f8c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 -- 172.21.15.117:0/1999146754 shutdown_connections 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.716+0000 7f5f912ad640 1 -- 172.21.15.117:0/1999146754 wait complete. 2024-05-08T20:26:56.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 Processor -- start 2024-05-08T20:26:56.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- start start 2024-05-08T20:26:56.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c0c26e0 0x7f5f8c14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f8c152220 0x7f5f8c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0c8020 con 0x7f5f8c0c26e0 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1edc00 con 0x7f5f8c152220 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1ecff0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f8c152220 0x7f5f8c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54398/0 (socket says 172.21.15.117:54398) 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 -- 172.21.15.117:0/3565068083 learned_addr learned my addr 172.21.15.117:0/3565068083 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8a7fc640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c0c26e0 0x7f5f8c14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 -- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f8c152220 msgr2=0x7f5f8c14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f8c152220 0x7f5f8c14fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 -- 172.21.15.117:0/3565068083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c0c26e0 msgr2=0x7f5f8c14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c0c26e0 0x7f5f8c14f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 -- 172.21.15.117:0/3565068083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c009420 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f8affd640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c10 tx=0x7f5f7c019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c003ab0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c003c10 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c1ed2d0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0b5410 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1ed890 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5f7c0b2050 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5f7c0becc0 con 0x7f5f8c0aac30 2024-05-08T20:26:56.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.720+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c074950 con 0x7f5f8c0aac30 2024-05-08T20:26:56.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.724+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5f7c0c3060 con 0x7f5f8c0aac30 2024-05-08T20:26:56.737 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:56.736+0000 7fb52b6e3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:26:56.759 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:56.756+0000 7f4060988180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:26:56.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.788+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6254b146-801c-4d69-af74-48327ce9b920", "id": 6} v 0) v1 -- 0x7f5f8c0aaa10 con 0x7f5f8c0aac30 2024-05-08T20:26:56.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.792+0000 7f5f737fe640 1 -- 172.21.15.117:0/3565068083 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6254b146-801c-4d69-af74-48327ce9b920", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f7c0b9070 con 0x7f5f8c0aac30 2024-05-08T20:26:56.796 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-05-08T20:26:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 msgr2=0x7f5f8c0c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c10 tx=0x7f5f7c019040 comp rx=0 tx=0).stop 2024-05-08T20:26:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 shutdown_connections 2024-05-08T20:26:56.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f8c152220 0x7f5f8c14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f8c0c26e0 0x7f5f8c14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 --2- 172.21.15.117:0/3565068083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f8c0aac30 0x7f5f8c0c7060 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 >> 172.21.15.117:0/3565068083 conn(0x7f5f8c0c4cc0 msgr2=0x7f5f8c14ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 shutdown_connections 2024-05-08T20:26:56.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.796+0000 7f5f912ad640 1 -- 172.21.15.117:0/3565068083 wait complete. 2024-05-08T20:26:56.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8f0d589f-2421-43e6-a265-88d4315ffb7e 7 2024-05-08T20:26:56.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 Processor -- start 2024-05-08T20:26:56.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 -- start start 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 0x7f205c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c152ab0 con 0x7f205c155e90 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c152d90 con 0x7f205c14fe70 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f206384c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c1528a0 con 0x7f205c06a6d0 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f20615e8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f205c14fe70 0x7f205c06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:58126/0 (socket says 172.21.15.117:58126) 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f20615e8640 1 -- 172.21.15.117:0/3184059657 learned_addr learned my addr 172.21.15.117:0/3184059657 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2061de9640 1 --2- 172.21.15.117:0/3184059657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 0x7f205c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2053fff640 1 -- 172.21.15.117:0/3184059657 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622944458 0 0) 0x7f205c152d90 con 0x7f205c14fe70 2024-05-08T20:26:56.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2053fff640 1 -- 172.21.15.117:0/3184059657 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2048003530 con 0x7f205c14fe70 2024-05-08T20:26:56.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2061de9640 1 -- 172.21.15.117:0/3184059657 >> v1:172.21.15.117:6789/0 conn(0x7f205c14fe70 legacy=0x7f205c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2061de9640 1 -- 172.21.15.117:0/3184059657 >> v1:172.21.15.81:6789/0 conn(0x7f205c155e90 legacy=0x7f205c069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:56.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.916+0000 7f2061de9640 1 -- 172.21.15.117:0/3184059657 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c153070 con 0x7f205c06a6d0 2024-05-08T20:26:56.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2061de9640 1 --2- 172.21.15.117:0/3184059657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 0x7f205c15e230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f205401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf43b61cf0024e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2053fff640 1 -- 172.21.15.117:0/3184059657 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540a58c0 con 0x7f205c06a6d0 2024-05-08T20:26:56.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2053fff640 1 -- 172.21.15.117:0/3184059657 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540a5a20 con 0x7f205c06a6d0 2024-05-08T20:26:56.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2053fff640 1 -- 172.21.15.117:0/3184059657 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540a5db0 con 0x7f205c06a6d0 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- 172.21.15.117:0/3184059657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 msgr2=0x7f205c15e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 --2- 172.21.15.117:0/3184059657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 0x7f205c15e230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f205401c800 comp rx=0 tx=0).stop 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- 172.21.15.117:0/3184059657 shutdown_connections 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 --2- 172.21.15.117:0/3184059657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c06a6d0 0x7f205c15e230 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- 172.21.15.117:0/3184059657 >> 172.21.15.117:0/3184059657 conn(0x7f205c0c71b0 msgr2=0x7f205c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- 172.21.15.117:0/3184059657 shutdown_connections 2024-05-08T20:26:56.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- 172.21.15.117:0/3184059657 wait complete. 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 Processor -- start 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- start start 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205c06a6d0 0x7f205c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 0x7f205c1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c54f0 con 0x7f205c06a6d0 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c4620 con 0x7f205c14fe70 2024-05-08T20:26:56.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f206384c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c4870 con 0x7f205c155e90 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2061de9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2060de7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 0x7f205c1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2061de9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:54418/0 (socket says 172.21.15.117:54418) 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.920+0000 7f2061de9640 1 -- 172.21.15.117:0/1560049661 learned_addr learned my addr 172.21.15.117:0/1560049661 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f20615e8640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205c06a6d0 0x7f205c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 -- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 msgr2=0x7f205c1ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 0x7f205c1ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 -- 172.21.15.117:0/1560049661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205c06a6d0 msgr2=0x7f205c151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205c06a6d0 0x7f205c151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 -- 172.21.15.117:0/1560049661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009a70 con 0x7f205c155e90 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2060de7640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 0x7f205c1ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2061de9640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f205401aeb0 tx=0x7f20540195a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:56.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b9650 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540b97b0 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c0c4b50 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b9b60 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c0c5110 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f20540ad440 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f20540c2b50 con 0x7f205c155e90 2024-05-08T20:26:56.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c0675e0 con 0x7f205c155e90 2024-05-08T20:26:56.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.924+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f20540bd020 con 0x7f205c155e90 2024-05-08T20:26:56.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:56.992+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8f0d589f-2421-43e6-a265-88d4315ffb7e", "id": 7} v 0) v1 -- 0x7f205c0c5630 con 0x7f205c155e90 2024-05-08T20:26:57.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.000+0000 7f2051ffb640 1 -- 172.21.15.117:0/1560049661 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f0d589f-2421-43e6-a265-88d4315ffb7e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20540b2070 con 0x7f205c155e90 2024-05-08T20:26:57.005 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-05-08T20:26:57.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 msgr2=0x7f205c1ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f205401aeb0 tx=0x7f20540195a0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 shutdown_connections 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f205c155e90 0x7f205c1ec6c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f205c14fe70 0x7f205c1ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 --2- 172.21.15.117:0/1560049661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205c06a6d0 0x7f205c151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 >> 172.21.15.117:0/1560049661 conn(0x7f205c0c71b0 msgr2=0x7f205c1473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 shutdown_connections 2024-05-08T20:26:57.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-08T20:26:57.004+0000 7f206384c640 1 -- 172.21.15.117:0/1560049661 wait complete. 2024-05-08T20:26:57.027 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T20:26:57.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T20:26:57.029 INFO:tasks.ceph.osd.0:Started 2024-05-08T20:26:57.029 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T20:26:57.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T20:26:57.032 INFO:tasks.ceph.osd.1:Started 2024-05-08T20:26:57.032 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T20:26:57.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T20:26:57.034 INFO:tasks.ceph.osd.2:Started 2024-05-08T20:26:57.034 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T20:26:57.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T20:26:57.036 INFO:tasks.ceph.osd.3:Started 2024-05-08T20:26:57.036 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T20:26:57.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T20:26:57.038 INFO:tasks.ceph.osd.4:Started 2024-05-08T20:26:57.038 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T20:26:57.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T20:26:57.040 INFO:tasks.ceph.osd.5:Started 2024-05-08T20:26:57.040 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T20:26:57.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T20:26:57.042 INFO:tasks.ceph.osd.6:Started 2024-05-08T20:26:57.042 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T20:26:57.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T20:26:57.045 INFO:tasks.ceph.osd.7:Started 2024-05-08T20:26:57.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:26:57.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 Processor -- start 2024-05-08T20:26:57.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 -- start start 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d0155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0158080 con 0x7fa8d00c2570 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d006a890 con 0x7fa8d0152340 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.204+0000 7fa8d57cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006ab70 con 0x7fa8d00c34e0 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8ce7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa8d00c2570 0x7fa8d0154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45766/0 (socket says 172.21.15.81:45766) 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8ce7fc640 1 -- 172.21.15.81:0/4111636266 learned_addr learned my addr 172.21.15.81:0/4111636266 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cf7fe640 1 --2- 172.21.15.81:0/4111636266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080689175 0 0) 0x7fa8d0158080 con 0x7fa8d00c2570 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b8003530 con 0x7fa8d00c2570 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43737845 0 0) 0x7fa8d006a890 con 0x7fa8d0152340 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d0158080 con 0x7fa8d0152340 2024-05-08T20:26:57.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cf7fe640 1 -- 172.21.15.81:0/4111636266 >> v1:172.21.15.117:6789/0 conn(0x7fa8d0152340 legacy=0x7fa8d006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cf7fe640 1 -- 172.21.15.81:0/4111636266 >> v1:172.21.15.81:6789/0 conn(0x7fa8d00c2570 legacy=0x7fa8d0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cf7fe640 1 -- 172.21.15.81:0/4111636266 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00c2d70 con 0x7fa8d00c34e0 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cf7fe640 1 --2- 172.21.15.81:0/4111636266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d0155670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009dc0 tx=0x7fa8c801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a63faa6aa4b8bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80a58d0 con 0x7fa8d00c34e0 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80a5a30 con 0x7fa8d00c34e0 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8cdffb640 1 -- 172.21.15.81:0/4111636266 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80a5da0 con 0x7fa8d00c34e0 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 -- 172.21.15.81:0/4111636266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 msgr2=0x7fa8d0155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/4111636266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d0155670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009dc0 tx=0x7fa8c801c900 comp rx=0 tx=0).stop 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 -- 172.21.15.81:0/4111636266 shutdown_connections 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/4111636266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d0155670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 -- 172.21.15.81:0/4111636266 >> 172.21.15.81:0/4111636266 conn(0x7fa8d00c71b0 msgr2=0x7fa8d00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 -- 172.21.15.81:0/4111636266 shutdown_connections 2024-05-08T20:26:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.208+0000 7fa8d57cd640 1 -- 172.21.15.81:0/4111636266 wait complete. 2024-05-08T20:26:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 Processor -- start 2024-05-08T20:26:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- start start 2024-05-08T20:26:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d01ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 0x7fa8d0145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d014b220 con 0x7fa8d00c2570 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0145090 con 0x7fa8d0152340 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0145370 con 0x7fa8d00c34e0 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51764/0 (socket says 172.21.15.81:51764) 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 -- 172.21.15.81:0/1019777215 learned_addr learned my addr 172.21.15.81:0/1019777215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8cf7fe640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 0x7fa8d0145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ce7fc640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d01ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 -- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 msgr2=0x7fa8d01ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d01ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 -- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 msgr2=0x7fa8d0145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 0x7fa8d0145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 -- 172.21.15.81:0/1019777215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009a70 con 0x7fa8d00c2570 2024-05-08T20:26:57.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8cf7fe640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 0x7fa8d0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8ceffd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c460 tx=0x7fa8c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00052d0 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0005450 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d01ed640 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0003840 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01edc00 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa8c0003ca0 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa8c0012af0 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.212+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00675e0 con 0x7fa8d00c2570 2024-05-08T20:26:57.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.216+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa8c0017070 con 0x7fa8d00c2570 2024-05-08T20:26:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d0074950 con 0x7fa8d00c2570 2024-05-08T20:26:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8b77fe640 1 -- 172.21.15.81:0/1019777215 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa8c0012420 con 0x7fa8d00c2570 2024-05-08T20:26:57.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:26:57.283 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:26:56.997819+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:26:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 msgr2=0x7fa8d00c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c460 tx=0x7fa8c000c920 comp rx=0 tx=0).stop 2024-05-08T20:26:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 shutdown_connections 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8d0152340 0x7fa8d0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8d00c34e0 0x7fa8d01ecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 --2- 172.21.15.81:0/1019777215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d00c2570 0x7fa8d00c65e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 >> 172.21.15.81:0/1019777215 conn(0x7fa8d00c71b0 msgr2=0x7fa8d014bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 shutdown_connections 2024-05-08T20:26:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:26:57.280+0000 7fa8d57cd640 1 -- 172.21.15.81:0/1019777215 wait complete. 2024-05-08T20:26:57.303 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T20:26:57.304 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T20:26:57.340 INFO:tasks.ceph.mgr.x.smithi117.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T20:26:57.340 INFO:tasks.ceph.mgr.x.smithi117.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T20:26:57.340 INFO:tasks.ceph.mgr.x.smithi117.stderr: from numpy import show_config as show_numpy_config 2024-05-08T20:26:57.348 INFO:tasks.ceph.mgr.y.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T20:26:57.348 INFO:tasks.ceph.mgr.y.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T20:26:57.348 INFO:tasks.ceph.mgr.y.smithi081.stderr: from numpy import show_config as show_numpy_config 2024-05-08T20:26:57.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:57.384+0000 7f4060988180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:26:57.405 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:57.400+0000 7fb52b6e3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:26:57.528 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:57.524+0000 7f4060988180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:26:57.566 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:57.564+0000 7fb52b6e3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:26:57.678 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-08T20:26:57.676+0000 7f0fb38cb7c0 -1 Falling back to public interface 2024-05-08T20:26:57.679 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-08T20:26:57.676+0000 7f7119e657c0 -1 Falling back to public interface 2024-05-08T20:26:57.683 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-05-08T20:26:57.680+0000 7f635df877c0 -1 Falling back to public interface 2024-05-08T20:26:57.683 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-05-08T20:26:57.680+0000 7f17fec4f7c0 -1 Falling back to public interface 2024-05-08T20:26:57.688 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:57.684+0000 7f4060988180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:26:57.694 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-05-08T20:26:57.692+0000 7f2b223657c0 -1 Falling back to public interface 2024-05-08T20:26:57.698 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-08T20:26:57.696+0000 7f050d1c57c0 -1 Falling back to public interface 2024-05-08T20:26:57.706 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-08T20:26:57.704+0000 7ff7bf93f7c0 -1 Falling back to public interface 2024-05-08T20:26:57.710 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-05-08T20:26:57.708+0000 7f02144537c0 -1 Falling back to public interface 2024-05-08T20:26:57.732 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:57.728+0000 7fb52b6e3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:26:57.754 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:57.752+0000 7f4060988180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:26:57.800 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:57.796+0000 7fb52b6e3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:26:57.887 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:57.884+0000 7f4060988180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:26:57.945 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:57.944+0000 7fb52b6e3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:26:58.108 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:26:58.213 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.208+0000 7effaeb67640 1 Processor -- start 2024-05-08T20:26:58.214 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.208+0000 7effaeb67640 1 -- start start 2024-05-08T20:26:58.215 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effaeb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814ee10 0x7effa80c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:58.215 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effaeb67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effa806d160 0x7effa80c2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effaeb67640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa814f1f0 con 0x7effa8070f30 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effaeb67640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa806dd70 con 0x7effa806d160 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effaeb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa8155a60 con 0x7effa814ee10 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effad104640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7effa8070f30 0x7effa8154c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45774/0 (socket says 172.21.15.81:45774) 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effad104640 1 -- 172.21.15.81:0/1324283999 learned_addr learned my addr 172.21.15.81:0/1324283999 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 --2- 172.21.15.81:0/1324283999 >> v2:172.21.15.81:3300/0 conn(0x7effa806d160 0x7effa80c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effac903640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814ee10 0x7effa80c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa77fe640 1 -- 172.21.15.81:0/1324283999 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986616091 0 0) 0x7effa814f1f0 con 0x7effa8070f30 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa77fe640 1 -- 172.21.15.81:0/1324283999 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff98003530 con 0x7effa8070f30 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 -- 172.21.15.81:0/1324283999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814ee10 msgr2=0x7effa80c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814ee10 0x7effa80c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 -- 172.21.15.81:0/1324283999 >> v1:172.21.15.81:6789/0 conn(0x7effa8070f30 legacy=0x7effa8154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:58.216 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 -- 172.21.15.81:0/1324283999 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa806e010 con 0x7effa806d160 2024-05-08T20:26:58.217 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa7fff640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa806d160 0x7effa80c2160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7eff940097c0 tx=0x7eff9401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1b74a616a26225 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:58.217 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa77fe640 1 -- 172.21.15.81:0/1324283999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940ab600 con 0x7effa806d160 2024-05-08T20:26:58.217 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa77fe640 1 -- 172.21.15.81:0/1324283999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940a7050 con 0x7effa806d160 2024-05-08T20:26:58.217 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.212+0000 7effa77fe640 1 -- 172.21.15.81:0/1324283999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940ab980 con 0x7effa806d160 2024-05-08T20:26:58.218 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/1324283999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa806d160 msgr2=0x7effa80c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:58.218 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa806d160 0x7effa80c2160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7eff940097c0 tx=0x7eff9401c380 comp rx=0 tx=0).stop 2024-05-08T20:26:58.218 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/1324283999 shutdown_connections 2024-05-08T20:26:58.219 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa806d160 0x7effa80c2160 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.219 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- 172.21.15.81:0/1324283999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa814ee10 0x7effa80c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.219 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/1324283999 >> 172.21.15.81:0/1324283999 conn(0x7effa80c7220 msgr2=0x7effa80c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:58.219 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/1324283999 shutdown_connections 2024-05-08T20:26:58.219 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/1324283999 wait complete. 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 Processor -- start 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- start start 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa8070f30 0x7effa81ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8145910 0x7effa8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8140960 con 0x7effa814ee10 2024-05-08T20:26:58.221 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81551e0 con 0x7effa8070f30 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa81ec180 con 0x7effa8145910 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51780/0 (socket says 172.21.15.81:51780) 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 -- 172.21.15.81:0/2643362150 learned_addr learned my addr 172.21.15.81:0/2643362150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effac903640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa8070f30 0x7effa81ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 -- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8145910 msgr2=0x7effa8144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8145910 0x7effa8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 -- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa8070f30 msgr2=0x7effa81ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa8070f30 0x7effa81ebc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 -- 172.21.15.81:0/2643362150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94009420 con 0x7effa814ee10 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa7fff640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7eff94019fb0 tx=0x7eff94019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940b4410 con 0x7effa814ee10 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940b4590 con 0x7effa814ee10 2024-05-08T20:26:58.222 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa8154c20 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940b4940 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa8144210 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7eff940b2040 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.216+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7eff940aaa70 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.220+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa806c710 con 0x7effa814ee10 2024-05-08T20:26:58.223 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.220+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7eff940c2060 con 0x7effa814ee10 2024-05-08T20:26:58.277 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.272+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effa80749a0 con 0x7effa814ee10 2024-05-08T20:26:58.278 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effa57fa640 1 -- 172.21.15.81:0/2643362150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7eff940b8070 con 0x7effa814ee10 2024-05-08T20:26:58.278 INFO:teuthology.misc.health.smithi081.stdout: 2024-05-08T20:26:58.278 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:26:56.997819+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 msgr2=0x7effa80acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7eff94019fb0 tx=0x7eff94019120 comp rx=0 tx=0).stop 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 shutdown_connections 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa8145910 0x7effa8144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa814ee10 0x7effa80acd80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 --2- 172.21.15.81:0/2643362150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa8070f30 0x7effa81ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:26:58.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 >> 172.21.15.81:0/2643362150 conn(0x7effa80c7220 msgr2=0x7effa814e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:26:58.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 shutdown_connections 2024-05-08T20:26:58.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:26:58.276+0000 7effaeb67640 1 -- 172.21.15.81:0/2643362150 wait complete. 2024-05-08T20:26:58.295 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:26:58.505 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:58.500+0000 7f4060988180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:26:58.574 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:58.572+0000 7fb52b6e3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:26:58.584 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:58.580+0000 7f4060988180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:26:58.649 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:58.648+0000 7fb52b6e3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:26:58.765 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:58.760+0000 7f4060988180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:26:58.828 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:58.824+0000 7fb52b6e3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:26:58.838 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:58.836+0000 7f4060988180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:26:58.902 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:58.900+0000 7fb52b6e3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:26:59.129 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:59.124+0000 7f4060988180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:26:59.189 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:59.188+0000 7fb52b6e3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:26:59.190 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:26:59.188+0000 7f4060988180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:26:59.252 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-08T20:26:59.248+0000 7fb52b6e3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:27:00.233 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:27:00.228+0000 7f4007e41640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T20:27:00.234 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-05-08T20:27:00.232+0000 7f4007e41640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T20:27:01.440 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-08T20:27:01.436+0000 7f7119e657c0 -1 osd.7 0 log_to_monitors true 2024-05-08T20:27:01.518 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-05-08T20:27:01.516+0000 7f2b223657c0 -1 osd.2 0 log_to_monitors true 2024-05-08T20:27:01.567 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-08T20:27:01.564+0000 7f050d1c57c0 -1 osd.5 0 log_to_monitors true 2024-05-08T20:27:01.582 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-05-08T20:27:01.580+0000 7f02144537c0 -1 osd.0 0 log_to_monitors true 2024-05-08T20:27:01.595 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-08T20:27:01.592+0000 7f0fb38cb7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T20:27:01.608 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-05-08T20:27:01.604+0000 7f17fec4f7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T20:27:01.611 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-08T20:27:01.608+0000 7ff7bf93f7c0 -1 osd.6 0 log_to_monitors true 2024-05-08T20:27:01.633 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-05-08T20:27:01.628+0000 7f635df877c0 -1 osd.3 0 log_to_monitors true 2024-05-08T20:27:05.102 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:05.268 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 Processor -- start 2024-05-08T20:27:05.268 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 -- start start 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2540afb20 0x7fa2540c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540c8690 con 0x7fa2540c6cf0 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540c8db0 con 0x7fa25406b970 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2594b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540c5110 con 0x7fa2540afb20 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2537fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2540c6cf0 0x7fa25406a590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35582/0 (socket says 172.21.15.81:35582) 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2537fe640 1 -- 172.21.15.81:0/461741699 learned_addr learned my addr 172.21.15.81:0/461741699 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa24bfff640 1 --1- 172.21.15.81:0/461741699 >> v1:172.21.15.117:6789/0 conn(0x7fa25406b970 0x7fa2540715f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:52202/0 (socket says 172.21.15.81:52202) 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534878139 0 0) 0x7fa2540c8db0 con 0x7fa25406b970 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.264+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240003530 con 0x7fa25406b970 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350679584 0 0) 0x7fa240003530 con 0x7fa25406b970 2024-05-08T20:27:05.270 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 >> v2:172.21.15.81:3300/0 conn(0x7fa2540afb20 msgr2=0x7fa2540c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:05.271 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa252ffd640 1 --2- 172.21.15.81:0/461741699 >> v2:172.21.15.81:3300/0 conn(0x7fa2540afb20 0x7fa2540c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 --2- 172.21.15.81:0/461741699 >> v2:172.21.15.81:3300/0 conn(0x7fa2540afb20 0x7fa2540c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 >> v1:172.21.15.81:6789/0 conn(0x7fa2540c6cf0 legacy=0x7fa25406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540c8ad0 con 0x7fa25406b970 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa23c0015b0 con 0x7fa25406b970 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 >> v1:172.21.15.117:6789/0 conn(0x7fa25406b970 legacy=0x7fa2540715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 0x7fa240004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2400052b0 0x7fa2400141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.273 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c5110 con 0x7fa2400047d0 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240014990 con 0x7fa240003980 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa240014b50 con 0x7fa2400052b0 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa252ffd640 1 --2- 172.21.15.81:0/461741699 >> v2:172.21.15.81:3300/0 conn(0x7fa2540afb20 0x7fa2540c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 0x7fa240004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2537fe640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2400052b0 0x7fa2400141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 -- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2400052b0 msgr2=0x7fa2400141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2400052b0 0x7fa2400141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.274 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 -- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa240003980 msgr2=0x7fa240003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:05.276 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa252ffd640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.276 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.276 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa2537fe640 1 -- 172.21.15.81:0/461741699 reap_dead start 2024-05-08T20:27:05.276 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa24bfff640 1 -- 172.21.15.81:0/461741699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240003530 con 0x7fa2400047d0 2024-05-08T20:27:05.276 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.268+0000 7fa252ffd640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:05.277 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.272+0000 7fa24bfff640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 0x7fa240004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2540c82a0 tx=0x7fa23c02da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed02eff903d14dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:05.278 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.272+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0b7710 con 0x7fa2400047d0 2024-05-08T20:27:05.280 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.276+0000 7fa2527fc640 1 -- 172.21.15.81:0/461741699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0b7870 con 0x7fa2400047d0 2024-05-08T20:27:05.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 msgr2=0x7fa240004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 0x7fa240004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2540c82a0 tx=0x7fa23c02da20 comp rx=0 tx=0).stop 2024-05-08T20:27:05.282 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- 172.21.15.81:0/461741699 shutdown_connections 2024-05-08T20:27:05.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 --2- 172.21.15.81:0/461741699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2400047d0 0x7fa240004c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- 172.21.15.81:0/461741699 >> 172.21.15.81:0/461741699 conn(0x7fa2540ca720 msgr2=0x7fa2540cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:05.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- 172.21.15.81:0/461741699 shutdown_connections 2024-05-08T20:27:05.283 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- 172.21.15.81:0/461741699 wait complete. 2024-05-08T20:27:05.285 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 Processor -- start 2024-05-08T20:27:05.285 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- start start 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 0x7fa2540b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2541e98d0 0x7fa2540c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c06e0 con 0x7fa2540bf2a0 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c2f30 con 0x7fa2541e98d0 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.280+0000 7fa2594b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c25d0 con 0x7fa2540c1cb0 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33836/0 (socket says 172.21.15.81:33836) 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 -- 172.21.15.81:0/3147675112 learned_addr learned my addr 172.21.15.81:0/3147675112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:05.286 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa252ffd640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 0x7fa2540b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.287 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa24bfff640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2541e98d0 0x7fa2540c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 -- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 msgr2=0x7fa2540b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 0x7fa2540b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 -- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2541e98d0 msgr2=0x7fa2540c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2541e98d0 0x7fa2540c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 -- 172.21.15.81:0/3147675112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540bfc70 con 0x7fa2540bf2a0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa252ffd640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 0x7fa2540b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2537fe640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ad220 tx=0x7fa24c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00e920 con 0x7fa2540bf2a0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c00eaa0 con 0x7fa2540bf2a0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2541e9db0 con 0x7fa2540bf2a0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00ee50 con 0x7fa2540bf2a0 2024-05-08T20:27:05.288 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2540c0400 con 0x7fa2540bf2a0 2024-05-08T20:27:05.289 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.284+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fa24c01d460 con 0x7fa2540bf2a0 2024-05-08T20:27:05.290 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.288+0000 7fa24b7fe640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 0x7fa234068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:05.290 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.288+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fa24c0832a0 con 0x7fa2540bf2a0 2024-05-08T20:27:05.290 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.288+0000 7fa252ffd640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 0x7fa234068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:05.290 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.288+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2540c2d90 con 0x7fa2540bf2a0 2024-05-08T20:27:05.291 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.288+0000 7fa252ffd640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 0x7fa234068af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa254071510 tx=0x7fa244008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:05.300 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.296+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa2540c2d90 con 0x7fa2540bf2a0 2024-05-08T20:27:05.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-08T20:27:05.360+0000 7ff7bb0c1640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T20:27:05.384 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-08T20:27:05.380+0000 7f050a182640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T20:27:05.390 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-08T20:27:05.388+0000 7ff7b3706640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-08T20:27:05.408+0000 7f7116e22640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T20:27:05.413 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-05-08T20:27:05.407+0000 7f635af44640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T20:27:05.413 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-08T20:27:05.412+0000 7f0500f8c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.434 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-08T20:27:05.432+0000 7f710dc2c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.447 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-05-08T20:27:05.443+0000 7f6351d4e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-08T20:27:05.456+0000 7f0fb0888640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T20:27:05.484 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-05-08T20:27:05.479+0000 7f2b1dae7640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T20:27:05.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-08T20:27:05.488+0000 7f0fa7692640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.508 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-05-08T20:27:05.503+0000 7f17fa3d1640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T20:27:05.510 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-05-08T20:27:05.507+0000 7f2b1612c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.530 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-05-08T20:27:05.527+0000 7f17f2a16640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:05.534 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-05-08T20:27:05.531+0000 7f020fbd5640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T20:27:05.551 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.547+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2540c2d90 con 0x7fa2540bf2a0 2024-05-08T20:27:05.552 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.547+0000 7fa24b7fe640 1 -- 172.21.15.81:0/3147675112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa2540c2d90 con 0x7fa2540bf2a0 2024-05-08T20:27:05.552 INFO:teuthology.misc.health.smithi081.stdout: 2024-05-08T20:27:05.552 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:03.237717+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.547+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 msgr2=0x7fa234068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 0x7fa234068af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa254071510 tx=0x7fa244008040 comp rx=0 tx=0).stop 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 msgr2=0x7fa2540bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ad220 tx=0x7fa24c007a80 comp rx=0 tx=0).stop 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 shutdown_connections 2024-05-08T20:27:05.554 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa234066630 0x7fa234068af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2540bf2a0 0x7fa2540bf730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2541e98d0 0x7fa2540c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 --2- 172.21.15.81:0/3147675112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2540c1cb0 0x7fa2540b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 >> 172.21.15.81:0/3147675112 conn(0x7fa2540ca720 msgr2=0x7fa2540c1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 shutdown_connections 2024-05-08T20:27:05.555 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:05.551+0000 7fa2594b3640 1 -- 172.21.15.81:0/3147675112 wait complete. 2024-05-08T20:27:05.569 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:27:05.574 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-05-08T20:27:05.571+0000 7f020821a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:27:12.376 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:12.499 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 Processor -- start 2024-05-08T20:27:12.499 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 -- start start 2024-05-08T20:27:12.500 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff160155d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.500 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1600c2670 0x7ff160156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff160153710 con 0x7ff16014ff30 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600c2c30 con 0x7ff1600c2670 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff167103640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601532f0 con 0x7ff1600725d0 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff164e9f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff16014ff30 0x7ff16006f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43808/0 (socket says 172.21.15.81:43808) 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff164e9f640 1 -- 172.21.15.81:0/3761173523 learned_addr learned my addr 172.21.15.81:0/3761173523 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff1656a0640 1 --2- 172.21.15.81:0/3761173523 >> v2:172.21.15.81:3300/0 conn(0x7ff1600c2670 0x7ff160156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff15ffff640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff160155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff15f7fe640 1 -- 172.21.15.81:0/3761173523 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259693872 0 0) 0x7ff160153710 con 0x7ff16014ff30 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff15f7fe640 1 -- 172.21.15.81:0/3761173523 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff148003530 con 0x7ff16014ff30 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff1656a0640 1 -- 172.21.15.81:0/3761173523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 msgr2=0x7ff160155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff1656a0640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff160155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff1656a0640 1 -- 172.21.15.81:0/3761173523 >> v1:172.21.15.81:6789/0 conn(0x7ff16014ff30 legacy=0x7ff16006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.501 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.495+0000 7ff1656a0640 1 -- 172.21.15.81:0/3761173523 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160152950 con 0x7ff1600c2670 2024-05-08T20:27:12.503 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff1656a0640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff160156270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff158009dc0 tx=0x7ff15801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a397cac1fa2e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.503 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15f7fe640 1 -- 172.21.15.81:0/3761173523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580a57e0 con 0x7ff1600c2670 2024-05-08T20:27:12.503 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15f7fe640 1 -- 172.21.15.81:0/3761173523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1580a5940 con 0x7ff1600c2670 2024-05-08T20:27:12.503 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15f7fe640 1 -- 172.21.15.81:0/3761173523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580a5cd0 con 0x7ff1600c2670 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- 172.21.15.81:0/3761173523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 msgr2=0x7ff160156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff160156270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff158009dc0 tx=0x7ff15801c830 comp rx=0 tx=0).stop 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- 172.21.15.81:0/3761173523 shutdown_connections 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff160156270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- 172.21.15.81:0/3761173523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff160155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- 172.21.15.81:0/3761173523 >> 172.21.15.81:0/3761173523 conn(0x7ff1600c2da0 msgr2=0x7ff1600c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- 172.21.15.81:0/3761173523 shutdown_connections 2024-05-08T20:27:12.504 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- 172.21.15.81:0/3761173523 wait complete. 2024-05-08T20:27:12.505 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 Processor -- start 2024-05-08T20:27:12.505 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- start start 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff1600aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16014ff30 0x7ff1600c1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16006d420 con 0x7ff1600c2670 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16006c5f0 con 0x7ff16014ff30 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff167103640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16006c160 con 0x7ff1600725d0 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59946/0 (socket says 172.21.15.81:59946) 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15ffff640 1 -- 172.21.15.81:0/3040979223 learned_addr learned my addr 172.21.15.81:0/3040979223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff164e9f640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff1600aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.507 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff1656a0640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16014ff30 0x7ff1600c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15ffff640 1 -- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 msgr2=0x7ff1600aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.499+0000 7ff15ffff640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff1600aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15ffff640 1 -- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16014ff30 msgr2=0x7ff1600c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15ffff640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16014ff30 0x7ff1600c1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15ffff640 1 -- 172.21.15.81:0/3040979223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009a70 con 0x7ff1600c2670 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff164e9f640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff1600aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15ffff640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff15400d620 tx=0x7ff15400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400b620 con 0x7ff1600c2670 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400b780 con 0x7ff1600c2670 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400bb10 con 0x7ff1600c2670 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600c6020 con 0x7ff1600c2670 2024-05-08T20:27:12.508 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16006b830 con 0x7ff1600c2670 2024-05-08T20:27:12.509 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1600749a0 con 0x7ff1600c2670 2024-05-08T20:27:12.509 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff15400bc70 con 0x7ff1600c2670 2024-05-08T20:27:12.509 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 0x7ff14c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.509 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff164e9f640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 0x7ff14c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.509 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1540842e0 con 0x7ff1600c2670 2024-05-08T20:27:12.510 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.503+0000 7ff164e9f640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 0x7ff14c068b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1500011f0 tx=0x7ff150009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.513 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.507+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff1540519a0 con 0x7ff1600c2670 2024-05-08T20:27:12.671 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.667+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1600ab6d0 con 0x7ff1600c2670 2024-05-08T20:27:12.673 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.667+0000 7ff15d7fa640 1 -- 172.21.15.81:0/3040979223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7ff154007380 con 0x7ff1600c2670 2024-05-08T20:27:12.673 INFO:teuthology.misc.health.smithi081.stdout: 2024-05-08T20:27:12.673 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:09.438880+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:12.675 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 msgr2=0x7ff14c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 0x7ff14c068b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1500011f0 tx=0x7ff150009040 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 msgr2=0x7ff1600c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff15400d620 tx=0x7ff15400dae0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 shutdown_connections 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff14c0666c0 0x7ff14c068b80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16014ff30 0x7ff1600c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1600c2670 0x7ff1600c5390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 --2- 172.21.15.81:0/3040979223 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1600725d0 0x7ff1600aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 >> 172.21.15.81:0/3040979223 conn(0x7ff1600c2da0 msgr2=0x7ff160147440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 shutdown_connections 2024-05-08T20:27:12.676 INFO:teuthology.misc.health.smithi081.stderr:2024-05-08T20:27:12.671+0000 7ff167103640 1 -- 172.21.15.81:0/3040979223 wait complete. 2024-05-08T20:27:12.691 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T20:27:12.692 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T20:27:12.692 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T20:27:12.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T20:27:12.694 INFO:tasks.ceph.mds.a:Started 2024-05-08T20:27:12.695 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T20:27:12.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T20:27:12.696 INFO:tasks.ceph.mds.c:Started 2024-05-08T20:27:12.697 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T20:27:12.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T20:27:12.699 INFO:tasks.ceph.mds.b:Started 2024-05-08T20:27:12.699 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T20:27:12.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T20:27:12.702 INFO:tasks.ceph.mds.d:Started 2024-05-08T20:27:12.702 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T20:27:12.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:12.760 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-05-08T20:27:12.761 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-05-08T20:27:12.778 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-05-08T20:27:12.778 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-05-08T20:27:12.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 Processor -- start 2024-05-08T20:27:12.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 -- start start 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe214152340 0x7fe21406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe214158080 con 0x7fe21406d7d0 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21406a890 con 0x7fe2140c2570 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21bf9b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21406ab70 con 0x7fe214152340 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21a538640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe21406d7d0 0x7fe21415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43830/0 (socket says 172.21.15.81:43830) 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe21a538640 1 -- 172.21.15.81:0/508705840 learned_addr learned my addr 172.21.15.81:0/508705840 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe219d37640 1 --2- 172.21.15.81:0/508705840 >> v2:172.21.15.117:3300/0 conn(0x7fe214152340 0x7fe21406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019246195 0 0) 0x7fe214158080 con 0x7fe21406d7d0 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe200003530 con 0x7fe21406d7d0 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882160784 0 0) 0x7fe21406a890 con 0x7fe2140c2570 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe214158080 con 0x7fe2140c2570 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe219d37640 1 -- 172.21.15.81:0/508705840 >> v1:172.21.15.117:6789/0 conn(0x7fe2140c2570 legacy=0x7fe214154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe219d37640 1 -- 172.21.15.81:0/508705840 >> v1:172.21.15.81:6789/0 conn(0x7fe21406d7d0 legacy=0x7fe21415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.811+0000 7fe219d37640 1 -- 172.21.15.81:0/508705840 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140c2d70 con 0x7fe214152340 2024-05-08T20:27:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 --2- 172.21.15.81:0/508705840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe21406d290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc05725a6321391 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100ab600 con 0x7fe214152340 2024-05-08T20:27:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100a7050 con 0x7fe214152340 2024-05-08T20:27:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe218d35640 1 -- 172.21.15.81:0/508705840 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100ab980 con 0x7fe214152340 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- 172.21.15.81:0/508705840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 msgr2=0x7fe21406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/508705840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe21406d290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe2100097c0 tx=0x7fe21001c410 comp rx=0 tx=0).stop 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- 172.21.15.81:0/508705840 shutdown_connections 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/508705840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe21406d290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- 172.21.15.81:0/508705840 >> 172.21.15.81:0/508705840 conn(0x7fe2140c71b0 msgr2=0x7fe2140c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- 172.21.15.81:0/508705840 shutdown_connections 2024-05-08T20:27:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- 172.21.15.81:0/508705840 wait complete. 2024-05-08T20:27:12.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 Processor -- start 2024-05-08T20:27:12.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- start start 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 0x7fe2140c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe2140c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214070780 con 0x7fe21406d7d0 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141ee0e0 con 0x7fe214152340 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21bf9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141ed7d0 con 0x7fe2140c2570 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59996/0 (socket says 172.21.15.81:59996) 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 -- 172.21.15.81:0/1292920643 learned_addr learned my addr 172.21.15.81:0/1292920643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe21a538640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe2140c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219536640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 0x7fe2140c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 -- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 msgr2=0x7fe2140c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 0x7fe2140c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 -- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 msgr2=0x7fe2140c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe2140c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219d37640 1 -- 172.21.15.81:0/1292920643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009420 con 0x7fe21406d7d0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.815+0000 7fe219536640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 0x7fe2140c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe219d37640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe21001a040 tx=0x7fe21001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100b7450 con 0x7fe21406d7d0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100b75d0 con 0x7fe21406d7d0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe214151540 con 0x7fe21406d7d0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100b7980 con 0x7fe21406d7d0 2024-05-08T20:27:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2141eda90 con 0x7fe21406d7d0 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2140675e0 con 0x7fe21406d7d0 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2100b7ae0 con 0x7fe21406d7d0 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 0x7fe1f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe21011e5a0 con 0x7fe21406d7d0 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe219536640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 0x7fe1f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.819+0000 7fe219536640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 0x7fe1f8068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2040011f0 tx=0x7fe204009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.823+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe2100ebe10 con 0x7fe21406d7d0 2024-05-08T20:27:12.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.983+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe214074950 con 0x7fe21406d7d0 2024-05-08T20:27:12.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe20a7fc640 1 -- 172.21.15.81:0/1292920643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fe2100ef430 con 0x7fe21406d7d0 2024-05-08T20:27:12.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:12.991 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:09.438880+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 msgr2=0x7fe1f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 0x7fe1f8068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2040011f0 tx=0x7fe204009040 comp rx=0 tx=0).stop 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 msgr2=0x7fe214142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe21001a040 tx=0x7fe21001ac50 comp rx=0 tx=0).stop 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 shutdown_connections 2024-05-08T20:27:12.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1f8066690 0x7fe1f8068b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe214152340 0x7fe2140c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2140c2570 0x7fe2140c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 --2- 172.21.15.81:0/1292920643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21406d7d0 0x7fe214142ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 >> 172.21.15.81:0/1292920643 conn(0x7fe2140c71b0 msgr2=0x7fe214153310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 shutdown_connections 2024-05-08T20:27:12.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:12.987+0000 7fe21bf9b640 1 -- 172.21.15.81:0/1292920643 wait complete. 2024-05-08T20:27:13.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:13.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:13.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 Processor -- start 2024-05-08T20:27:13.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 -- start start 2024-05-08T20:27:13.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d101501e0 0x7f6d1006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d100725f0 0x7f6d100c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d1006f400 0x7f6d100c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1006fd60 con 0x7f6d101501e0 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d10072180 con 0x7f6d1006f400 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d16573640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c0650 con 0x7f6d100725f0 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d101501e0 0x7f6d1006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d101501e0 0x7f6d1006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60006/0 (socket says 172.21.15.81:60006) 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 -- 172.21.15.81:0/1829347531 learned_addr learned my addr 172.21.15.81:0/1829347531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d14b10640 1 --2- 172.21.15.81:0/1829347531 >> v2:172.21.15.117:3300/0 conn(0x7f6d1006f400 0x7f6d100c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 -- 172.21.15.81:0/1829347531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d100725f0 msgr2=0x7f6d100c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d100725f0 0x7f6d100c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d100725f0 0x7f6d100c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 -- 172.21.15.81:0/1829347531 >> v2:172.21.15.117:3300/0 conn(0x7f6d1006f400 msgr2=0x7f6d100c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/1829347531 >> v2:172.21.15.117:3300/0 conn(0x7f6d1006f400 0x7f6d100c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.135+0000 7f6d0ffff640 1 -- 172.21.15.81:0/1829347531 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1006fa80 con 0x7f6d101501e0 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d101501e0 0x7f6d1006c930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d10066da0 tx=0x7f6d0001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c278b293fa69028 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0effd640 1 -- 172.21.15.81:0/1829347531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000ab600 con 0x7f6d101501e0 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0effd640 1 -- 172.21.15.81:0/1829347531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d000a7050 con 0x7f6d101501e0 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0effd640 1 -- 172.21.15.81:0/1829347531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000ab980 con 0x7f6d101501e0 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/1829347531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d101501e0 msgr2=0x7f6d1006c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d101501e0 0x7f6d1006c930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d10066da0 tx=0x7f6d0001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/1829347531 shutdown_connections 2024-05-08T20:27:13.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d100725f0 0x7f6d100c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- 172.21.15.81:0/1829347531 >> v2:172.21.15.117:3300/0 conn(0x7f6d1006f400 0x7f6d100c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- 172.21.15.81:0/1829347531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d101501e0 0x7f6d1006c930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/1829347531 >> 172.21.15.81:0/1829347531 conn(0x7f6d100c2ca0 msgr2=0x7f6d100c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/1829347531 shutdown_connections 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/1829347531 wait complete. 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 Processor -- start 2024-05-08T20:27:13.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- start start 2024-05-08T20:27:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d1006f400 0x7f6d100c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101501e0 0x7f6d100a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100c5810 con 0x7f6d100725f0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d101f1830 con 0x7f6d101501e0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d101f0c20 con 0x7f6d1006f400 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60020/0 (socket says 172.21.15.81:60020) 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/2649702124 learned_addr learned my addr 172.21.15.81:0/2649702124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d1006f400 0x7f6d100c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d14b10640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101501e0 0x7f6d100a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d1006f400 msgr2=0x7f6d100c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d1006f400 0x7f6d100c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101501e0 msgr2=0x7f6d100a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101501e0 0x7f6d100a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/2649702124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000094d0 con 0x7f6d100725f0 2024-05-08T20:27:13.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c7f0 tx=0x7f6d0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04004220 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040043a0 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d101f0f00 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.139+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04004510 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d101f14c0 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d101f1680 con 0x7f6d100725f0 2024-05-08T20:27:13.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d04003a70 con 0x7f6d100725f0 2024-05-08T20:27:13.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d0cff9640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d04083d70 con 0x7f6d100725f0 2024-05-08T20:27:13.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.143+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6d000ad000 tx=0x7f6d00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.147+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6d040514c0 con 0x7f6d100725f0 2024-05-08T20:27:13.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d10074950 con 0x7f6d100725f0 2024-05-08T20:27:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d0cff9640 1 -- 172.21.15.81:0/2649702124 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d0401e0a0 con 0x7f6d100725f0 2024-05-08T20:27:13.311 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:13.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 msgr2=0x7f6cfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6d000ad000 tx=0x7f6d00008040 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 msgr2=0x7f6d10142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c7f0 tx=0x7f6d0400ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 shutdown_connections 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101501e0 0x7f6d100a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d100725f0 0x7f6d10142dd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 --2- 172.21.15.81:0/2649702124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d1006f400 0x7f6d100c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 >> 172.21.15.81:0/2649702124 conn(0x7f6d100c2ca0 msgr2=0x7f6d100712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 shutdown_connections 2024-05-08T20:27:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.307+0000 7f6d16573640 1 -- 172.21.15.81:0/2649702124 wait complete. 2024-05-08T20:27:13.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.443+0000 7fc15cd5e640 1 Processor -- start 2024-05-08T20:27:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 -- start start 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1580aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc15806b6e0 0x7fc15815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580abc50 con 0x7fc1580aac20 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580c2900 con 0x7fc15806b6e0 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15cd5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580aa320 con 0x7fc15814e410 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc155d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1580aac20 0x7fc15806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43834/0 (socket says 172.21.15.81:43834) 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc155d9b640 1 -- 172.21.15.81:0/2876514074 learned_addr learned my addr 172.21.15.81:0/2876514074 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 --2- 172.21.15.81:0/2876514074 >> v2:172.21.15.117:3300/0 conn(0x7fc15806b6e0 0x7fc15815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15659c640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1580aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659470736 0 0) 0x7fc1580abc50 con 0x7fc1580aac20 2024-05-08T20:27:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc144003530 con 0x7fc1580aac20 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 995020113 0 0) 0x7fc144003530 con 0x7fc1580aac20 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 msgr2=0x7fc1580aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1580aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 >> v2:172.21.15.117:3300/0 conn(0x7fc15806b6e0 msgr2=0x7fc15815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 --2- 172.21.15.81:0/2876514074 >> v2:172.21.15.117:3300/0 conn(0x7fc15806b6e0 0x7fc15815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580a9560 con 0x7fc1580aac20 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc140001680 con 0x7fc1580aac20 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 >> v1:172.21.15.81:6789/0 conn(0x7fc1580aac20 legacy=0x7fc15806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1440039b0 0x7fc144003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144004d10 0x7fc144005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580c2900 con 0x7fc144004d10 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580aa320 con 0x7fc1440039b0 2024-05-08T20:27:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14400b9c0 con 0x7fc15814e410 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144004d10 0x7fc144005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc15659c640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1440039b0 0x7fc144003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc155d9b640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 -- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 msgr2=0x7fc1440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15814e410 0x7fc1440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 -- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1440039b0 msgr2=0x7fc144003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1440039b0 0x7fc144003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.447+0000 7fc156d9d640 1 -- 172.21.15.81:0/2876514074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144003530 con 0x7fc144004d10 2024-05-08T20:27:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc156d9d640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144004d10 0x7fc144005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc148009ae0 tx=0x7fc14801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6626b5fa5651394a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480a5590 con 0x7fc144004d10 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480a56f0 con 0x7fc144004d10 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15559a640 1 -- 172.21.15.81:0/2876514074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480a5aa0 con 0x7fc144004d10 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- 172.21.15.81:0/2876514074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144004d10 msgr2=0x7fc144005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/2876514074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144004d10 0x7fc144005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc148009ae0 tx=0x7fc14801cab0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc156d9d640 1 -- 172.21.15.81:0/2876514074 reap_dead start 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- 172.21.15.81:0/2876514074 shutdown_connections 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- 172.21.15.81:0/2876514074 >> 172.21.15.81:0/2876514074 conn(0x7fc1580c2ca0 msgr2=0x7fc1580c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- 172.21.15.81:0/2876514074 shutdown_connections 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- 172.21.15.81:0/2876514074 wait complete. 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 Processor -- start 2024-05-08T20:27:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- start start 2024-05-08T20:27:13.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc158152450 0x7fc1581ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 0x7fc158144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158145850 con 0x7fc158152830 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158146630 con 0x7fc158152450 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15cd5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc158145540 con 0x7fc1581461b0 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60030/0 (socket says 172.21.15.81:60030) 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 -- 172.21.15.81:0/3470449091 learned_addr learned my addr 172.21.15.81:0/3470449091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc156d9d640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 0x7fc158144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc15659c640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc158152450 0x7fc1581ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 -- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 msgr2=0x7fc158144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 0x7fc158144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 -- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc158152450 msgr2=0x7fc1581ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc158152450 0x7fc1581ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 -- 172.21.15.81:0/3470449091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1581ee900 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc156d9d640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 0x7fc158144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc155d9b640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc140011950 tx=0x7fc140011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.451+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000fb60 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000fcc0 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc158147a80 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140015650 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc158148040 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc158145990 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1400157b0 con 0x7fc158152830 2024-05-08T20:27:13.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc14effd640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 0x7fc138068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc140086f40 con 0x7fc158152830 2024-05-08T20:27:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc15659c640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 0x7fc138068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.455+0000 7fc15659c640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 0x7fc138068b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc150007380 tx=0x7fc15000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.459+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc158145990 con 0x7fc158152830 2024-05-08T20:27:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.647+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1581ee900 con 0x7fc158152830 2024-05-08T20:27:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.647+0000 7fc14effd640 1 -- 172.21.15.81:0/3470449091 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fc1581ee900 con 0x7fc158152830 2024-05-08T20:27:13.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:13.653 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T20:27:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-05-08T20:27:13.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 msgr2=0x7fc138068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 0x7fc138068b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc150007380 tx=0x7fc15000b040 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 msgr2=0x7fc158145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc140011950 tx=0x7fc140011e10 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 shutdown_connections 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1380666c0 0x7fc138068b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc1581461b0 0x7fc158144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc158152830 0x7fc158145c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 --2- 172.21.15.81:0/3470449091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc158152450 0x7fc1581ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 >> 172.21.15.81:0/3470449091 conn(0x7fc1580c2ca0 msgr2=0x7fc1580c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 shutdown_connections 2024-05-08T20:27:13.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:13.651+0000 7fc15cd5e640 1 -- 172.21.15.81:0/3470449091 wait complete. 2024-05-08T20:27:15.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 Processor -- start 2024-05-08T20:27:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 -- start start 2024-05-08T20:27:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa0c1501e0 0x7faa0c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c06f400 0x7faa0c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0c0650 con 0x7faa0c0725f0 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c06fd60 con 0x7faa0c1501e0 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa10a5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c072180 con 0x7faa0c06f400 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa0c1501e0 0x7faa0c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa0c1501e0 0x7faa0c06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60044/0 (socket says 172.21.15.81:60044) 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 -- 172.21.15.81:0/3648427596 learned_addr learned my addr 172.21.15.81:0/3648427596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa03fff640 1 --1- 172.21.15.81:0/3648427596 >> v1:172.21.15.81:6789/0 conn(0x7faa0c0725f0 0x7faa0c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43836/0 (socket says 172.21.15.81:43836) 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0ad9d640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c06f400 0x7faa0c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 -- 172.21.15.81:0/3648427596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c06f400 msgr2=0x7faa0c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c06f400 0x7faa0c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 -- 172.21.15.81:0/3648427596 >> v1:172.21.15.81:6789/0 conn(0x7faa0c0725f0 legacy=0x7faa0c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa0a59c640 1 -- 172.21.15.81:0/3648427596 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c06fa80 con 0x7faa0c1501e0 2024-05-08T20:27:15.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.799+0000 7faa09d9b640 1 -- 172.21.15.81:0/3648427596 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057842513 0 0) 0x7faa0c0c0650 con 0x7faa0c0725f0 2024-05-08T20:27:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c1501e0 0x7faa0c06c930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009870 tx=0x7fa9fc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dea17ce4fdbea4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa09d9b640 1 -- 172.21.15.81:0/3648427596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0a7070 con 0x7faa0c1501e0 2024-05-08T20:27:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa09d9b640 1 -- 172.21.15.81:0/3648427596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0ab430 con 0x7faa0c1501e0 2024-05-08T20:27:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa09d9b640 1 -- 172.21.15.81:0/3648427596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0ab7c0 con 0x7faa0c1501e0 2024-05-08T20:27:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3648427596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c1501e0 msgr2=0x7faa0c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c1501e0 0x7faa0c06c930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009870 tx=0x7fa9fc01c410 comp rx=0 tx=0).stop 2024-05-08T20:27:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3648427596 shutdown_connections 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c06f400 0x7faa0c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3648427596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c1501e0 0x7faa0c06c930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3648427596 >> 172.21.15.81:0/3648427596 conn(0x7faa0c0c2ca0 msgr2=0x7faa0c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3648427596 shutdown_connections 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3648427596 wait complete. 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 Processor -- start 2024-05-08T20:27:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- start start 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c0725f0 0x7faa0c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa0c1501e0 0x7faa0c0aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0a9580 con 0x7faa0c06f400 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1f08a0 con 0x7faa0c1501e0 2024-05-08T20:27:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1ecf70 con 0x7faa0c0725f0 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60050/0 (socket says 172.21.15.81:60050) 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 -- 172.21.15.81:0/3793217314 learned_addr learned my addr 172.21.15.81:0/3793217314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa03fff640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c0725f0 0x7faa0c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 -- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c0725f0 msgr2=0x7faa0c0aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c0725f0 0x7faa0c0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 -- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa0c1501e0 msgr2=0x7faa0c0aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa0c1501e0 0x7faa0c0aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 -- 172.21.15.81:0/3793217314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0094d0 con 0x7faa0c06f400 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa0a59c640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc01a040 tx=0x7fa9fc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004220 con 0x7faa0c06f400 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc004380 con 0x7faa0c06f400 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c150740 con 0x7faa0c06f400 2024-05-08T20:27:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.803+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc003820 con 0x7faa0c06f400 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c1edf40 con 0x7faa0c06f400 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c074950 con 0x7faa0c06f400 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9fc003980 con 0x7faa0c06f400 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa02ffd640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 0x7fa9ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9fc11e440 con 0x7faa0c06f400 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa03fff640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 0x7fa9ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.807+0000 7faa03fff640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 0x7fa9ec068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4007fd0 tx=0x7fa9f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:15.811+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa9fc0ebba0 con 0x7faa0c06f400 2024-05-08T20:27:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.003+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa0c1510a0 con 0x7faa0c06f400 2024-05-08T20:27:16.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.003+0000 7faa02ffd640 1 -- 172.21.15.81:0/3793217314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fa9fc0c3020 con 0x7faa0c06f400 2024-05-08T20:27:16.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:16.010 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T20:27:16.011 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-05-08T20:27:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 msgr2=0x7fa9ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 0x7fa9ec068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4007fd0 tx=0x7fa9f4009040 comp rx=0 tx=0).stop 2024-05-08T20:27:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 msgr2=0x7faa0c0bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc01a040 tx=0x7fa9fc01ac50 comp rx=0 tx=0).stop 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 shutdown_connections 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9ec066690 0x7fa9ec068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa0c1501e0 0x7faa0c0aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa0c0725f0 0x7faa0c0aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 --2- 172.21.15.81:0/3793217314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa0c06f400 0x7faa0c0bf830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 >> 172.21.15.81:0/3793217314 conn(0x7faa0c0c2ca0 msgr2=0x7faa0c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 shutdown_connections 2024-05-08T20:27:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.007+0000 7faa10a5f640 1 -- 172.21.15.81:0/3793217314 wait complete. 2024-05-08T20:27:16.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:16.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 Processor -- start 2024-05-08T20:27:16.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 -- start start 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc82c0ca000 0x7fc82c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c155860 con 0x7fc82c151f00 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c1522e0 con 0x7fc82c154cf0 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc831fa4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c06bb20 con 0x7fc82c0ca000 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc82c0ca000 0x7fc82c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc82c151f00 0x7fc82c1588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43846/0 (socket says 172.21.15.81:43846) 2024-05-08T20:27:16.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82b7fe640 1 -- 172.21.15.81:0/3909983628 learned_addr learned my addr 172.21.15.81:0/3909983628 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82bfff640 1 -- 172.21.15.81:0/3909983628 >> v1:172.21.15.117:6789/0 conn(0x7fc82c154cf0 legacy=0x7fc82c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82bfff640 1 -- 172.21.15.81:0/3909983628 >> v1:172.21.15.81:6789/0 conn(0x7fc82c151f00 legacy=0x7fc82c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82a7fc640 1 -- 172.21.15.81:0/3909983628 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843482544 0 0) 0x7fc82c155860 con 0x7fc82c151f00 2024-05-08T20:27:16.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.139+0000 7fc82bfff640 1 -- 172.21.15.81:0/3909983628 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0c5f80 con 0x7fc82c0ca000 2024-05-08T20:27:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc82bfff640 1 --2- 172.21.15.81:0/3909983628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c0ca000 0x7fc82c0ca440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc82c155a50 tx=0x7fc82401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95594a125cb94596 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc82a7fc640 1 -- 172.21.15.81:0/3909983628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240a5910 con 0x7fc82c0ca000 2024-05-08T20:27:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc82a7fc640 1 -- 172.21.15.81:0/3909983628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240a5a70 con 0x7fc82c0ca000 2024-05-08T20:27:16.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc82a7fc640 1 -- 172.21.15.81:0/3909983628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240a5e00 con 0x7fc82c0ca000 2024-05-08T20:27:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 -- 172.21.15.81:0/3909983628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c0ca000 msgr2=0x7fc82c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 --2- 172.21.15.81:0/3909983628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c0ca000 0x7fc82c0ca440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc82c155a50 tx=0x7fc82401c830 comp rx=0 tx=0).stop 2024-05-08T20:27:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 -- 172.21.15.81:0/3909983628 shutdown_connections 2024-05-08T20:27:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 --2- 172.21.15.81:0/3909983628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c0ca000 0x7fc82c0ca440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 -- 172.21.15.81:0/3909983628 >> 172.21.15.81:0/3909983628 conn(0x7fc82c0715f0 msgr2=0x7fc82c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 -- 172.21.15.81:0/3909983628 shutdown_connections 2024-05-08T20:27:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.143+0000 7fc831fa4640 1 -- 172.21.15.81:0/3909983628 wait complete. 2024-05-08T20:27:16.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 Processor -- start 2024-05-08T20:27:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- start start 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0ca000 0x7fc82c1476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 0x7fc82c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c156bb0 con 0x7fc82c151f00 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1ee220 con 0x7fc82c154cf0 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1f0ba0 con 0x7fc82c0ca000 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60062/0 (socket says 172.21.15.81:60062) 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 -- 172.21.15.81:0/2077480770 learned_addr learned my addr 172.21.15.81:0/2077480770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82b7fe640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0ca000 0x7fc82c1476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82bfff640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 0x7fc82c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 -- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0ca000 msgr2=0x7fc82c1476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0ca000 0x7fc82c1476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 -- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 msgr2=0x7fc82c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 0x7fc82c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 -- 172.21.15.81:0/2077480770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009a70 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82bfff640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 0x7fc82c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc82affd640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c500 tx=0x7fc82000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820005220 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820005380 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c1f08c0 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820007270 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c1ed740 con 0x7fc82c151f00 2024-05-08T20:27:16.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c074950 con 0x7fc82c151f00 2024-05-08T20:27:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8200073f0 con 0x7fc82c151f00 2024-05-08T20:27:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.147+0000 7fc813fff640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 0x7fc818068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.151+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8200837c0 con 0x7fc82c151f00 2024-05-08T20:27:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.151+0000 7fc82b7fe640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 0x7fc818068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.151+0000 7fc82b7fe640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 0x7fc818068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f70 tx=0x7fc81c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.155+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc820050e90 con 0x7fc82c151f00 2024-05-08T20:27:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.307+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc82c067560 con 0x7fc82c151f00 2024-05-08T20:27:16.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.307+0000 7fc813fff640 1 -- 172.21.15.81:0/2077480770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fc8200544b0 con 0x7fc82c151f00 2024-05-08T20:27:16.313 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:16.313 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:09.438880+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 msgr2=0x7fc818068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 0x7fc818068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f70 tx=0x7fc81c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 msgr2=0x7fc82c147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c500 tx=0x7fc82000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 shutdown_connections 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc818066690 0x7fc818068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c154cf0 0x7fc82c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc82c151f00 0x7fc82c147bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 --2- 172.21.15.81:0/2077480770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0ca000 0x7fc82c1476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 >> 172.21.15.81:0/2077480770 conn(0x7fc82c0715f0 msgr2=0x7fc82c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 shutdown_connections 2024-05-08T20:27:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.311+0000 7fc831fa4640 1 -- 172.21.15.81:0/2077480770 wait complete. 2024-05-08T20:27:16.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:16.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.447+0000 7f3d45008640 1 Processor -- start 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.447+0000 7f3d45008640 1 -- start start 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d45008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d4006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d45008640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d40159790 0x7f3d4015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d45008640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400abc50 con 0x7f3d4014e410 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d45008640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400c2900 con 0x7f3d40159790 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d45008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400aa320 con 0x7f3d4006afd0 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3d4014e410 0x7f3d400aa6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43860/0 (socket says 172.21.15.81:43860) 2024-05-08T20:27:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 -- 172.21.15.81:0/851332365 learned_addr learned my addr 172.21.15.81:0/851332365 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407822722 0 0) 0x7f3d400abc50 con 0x7f3d4014e410 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d2c003530 con 0x7f3d4014e410 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3659c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d4006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3f59e640 1 --2- 172.21.15.81:0/851332365 >> v2:172.21.15.117:3300/0 conn(0x7f3d40159790 0x7f3d4015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077644100 0 0) 0x7f3d2c003530 con 0x7f3d4014e410 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 msgr2=0x7f3d4006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d4006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 >> v2:172.21.15.117:3300/0 conn(0x7f3d40159790 msgr2=0x7f3d4015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 --2- 172.21.15.81:0/851332365 >> v2:172.21.15.117:3300/0 conn(0x7f3d40159790 0x7f3d4015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400a9560 con 0x7f3d4014e410 2024-05-08T20:27:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3d30001680 con 0x7f3d4014e410 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 >> v1:172.21.15.81:6789/0 conn(0x7f3d4014e410 legacy=0x7f3d400aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d2c003980 0x7f3d2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c004d10 0x7f3d2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400c2900 con 0x7f3d2c003980 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400aa320 con 0x7f3d2c004d10 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c00bb20 con 0x7f3d4006afd0 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d2c003980 0x7f3d2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3659c640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3f59e640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c004d10 0x7f3d2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 -- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 msgr2=0x7f3d2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4006afd0 0x7f3d2c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 -- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c004d10 msgr2=0x7f3d2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c004d10 0x7f3d2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3ed9d640 1 -- 172.21.15.81:0/851332365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c003530 con 0x7f3d2c003980 2024-05-08T20:27:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.451+0000 7f3d3f59e640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c004d10 0x7f3d2c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d2c003980 0x7f3d2c003da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c240 tx=0x7f3d3001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1200505f5d5f68d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30005ae0 con 0x7f3d2c003980 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30005c40 con 0x7f3d2c003980 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3e59c640 1 -- 172.21.15.81:0/851332365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300a5890 con 0x7f3d2c003980 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/851332365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d2c003980 msgr2=0x7f3d2c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 --2- 172.21.15.81:0/851332365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d2c003980 0x7f3d2c003da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000c240 tx=0x7f3d3001cc30 comp rx=0 tx=0).stop 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3f59e640 1 -- 172.21.15.81:0/851332365 reap_dead start 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/851332365 shutdown_connections 2024-05-08T20:27:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/851332365 >> 172.21.15.81:0/851332365 conn(0x7f3d400c2ca0 msgr2=0x7f3d400c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/851332365 shutdown_connections 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/851332365 wait complete. 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 Processor -- start 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- start start 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003980 0x7f3d400bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4014a480 0x7f3d4014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4014ab00 con 0x7f3d4014b050 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4014a900 con 0x7f3d2c003980 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40150d20 con 0x7f3d4014a480 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60078/0 (socket says 172.21.15.81:60078) 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 -- 172.21.15.81:0/896043345 learned_addr learned my addr 172.21.15.81:0/896043345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3f59e640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4014a480 0x7f3d4014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003980 0x7f3d400bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 -- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4014a480 msgr2=0x7f3d4014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4014a480 0x7f3d4014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 -- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003980 msgr2=0x7f3d400bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003980 0x7f3d400bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 -- 172.21.15.81:0/896043345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4014ad50 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d3659c640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800e810 tx=0x7f3d2800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800c6d0 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800c830 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d401ed7d0 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800cbe0 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.455+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d40150800 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4006f1e0 con 0x7f3d4014b050 2024-05-08T20:27:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d2800cd40 con 0x7f3d4014b050 2024-05-08T20:27:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d37fff640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 0x7f3d20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d28083af0 con 0x7f3d4014b050 2024-05-08T20:27:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 0x7f3d20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.459+0000 7f3d3ed9d640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 0x7f3d20068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d300ab000 tx=0x7f3d300a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.463+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3d4006f1e0 con 0x7f3d4014b050 2024-05-08T20:27:16.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.607+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d4006f1e0 con 0x7f3d4014b050 2024-05-08T20:27:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.607+0000 7f3d37fff640 1 -- 172.21.15.81:0/896043345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d4006f1e0 con 0x7f3d4014b050 2024-05-08T20:27:16.613 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 msgr2=0x7f3d20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 0x7f3d20068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d300ab000 tx=0x7f3d300a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 msgr2=0x7f3d40149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800e810 tx=0x7f3d2800ecd0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 shutdown_connections 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d20066690 0x7f3d20068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d4014a480 0x7f3d4014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d4014b050 0x7f3d40149f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 --2- 172.21.15.81:0/896043345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003980 0x7f3d400bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 >> 172.21.15.81:0/896043345 conn(0x7f3d400c2ca0 msgr2=0x7f3d4006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 shutdown_connections 2024-05-08T20:27:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.611+0000 7f3d45008640 1 -- 172.21.15.81:0/896043345 wait complete. 2024-05-08T20:27:16.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T20:27:16.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.743+0000 7ff5f1c3f640 1 Processor -- start 2024-05-08T20:27:16.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.743+0000 7ff5f1c3f640 1 -- start start 2024-05-08T20:27:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5f1c3f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5ec1501e0 0x7ff5ec06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5f1c3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec06f400 0x7ff5ec0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5f1c3f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0c0650 con 0x7ff5ec0725f0 2024-05-08T20:27:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5f1c3f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec06fd60 con 0x7ff5ec1501e0 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5f1c3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec072180 con 0x7ff5ec06f400 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5ec1501e0 0x7ff5ec06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5ec1501e0 0x7ff5ec06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60080/0 (socket says 172.21.15.81:60080) 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 -- 172.21.15.81:0/260220483 learned_addr learned my addr 172.21.15.81:0/260220483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 -- 172.21.15.81:0/260220483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec06f400 msgr2=0x7ff5ec0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5ebfff640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec06f400 0x7ff5ec0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec06f400 0x7ff5ec0c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 -- 172.21.15.81:0/260220483 >> v1:172.21.15.117:6789/0 conn(0x7ff5ec0725f0 legacy=0x7ff5ec0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 -- 172.21.15.81:0/260220483 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec06fa80 con 0x7ff5ec1501e0 2024-05-08T20:27:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5eb7fe640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec06c930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009870 tx=0x7ff5e001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf30e94b4b936dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5ea7fc640 1 -- 172.21.15.81:0/260220483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00ac410 con 0x7ff5ec1501e0 2024-05-08T20:27:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5ea7fc640 1 -- 172.21.15.81:0/260220483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e00ac570 con 0x7ff5ec1501e0 2024-05-08T20:27:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.747+0000 7ff5ea7fc640 1 -- 172.21.15.81:0/260220483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00ac900 con 0x7ff5ec1501e0 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/260220483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 msgr2=0x7ff5ec06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec06c930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009870 tx=0x7ff5e001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/260220483 shutdown_connections 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec06f400 0x7ff5ec0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/260220483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec06c930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/260220483 >> 172.21.15.81:0/260220483 conn(0x7ff5ec0c2ca0 msgr2=0x7ff5ec0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/260220483 shutdown_connections 2024-05-08T20:27:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/260220483 wait complete. 2024-05-08T20:27:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 Processor -- start 2024-05-08T20:27:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- start start 2024-05-08T20:27:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5ec06f400 0x7ff5ec1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 0x7ff5ec0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0bfca0 con 0x7ff5ec1501e0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec149340 con 0x7ff5ec06f400 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec148d90 con 0x7ff5ec0725f0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60094/0 (socket says 172.21.15.81:60094) 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 -- 172.21.15.81:0/688242006 learned_addr learned my addr 172.21.15.81:0/688242006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5eb7fe640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5ec06f400 0x7ff5ec1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5eaffd640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 0x7ff5ec0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 -- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 msgr2=0x7ff5ec0c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 0x7ff5ec0c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 -- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5ec06f400 msgr2=0x7ff5ec1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5ec06f400 0x7ff5ec1487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 -- 172.21.15.81:0/688242006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00094d0 con 0x7ff5ec1501e0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5eaffd640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 0x7ff5ec0c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5ebfff640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400cc30 tx=0x7ff5e400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400ce40 con 0x7ff5ec1501e0 2024-05-08T20:27:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e40039a0 con 0x7ff5ec1501e0 2024-05-08T20:27:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec150740 con 0x7ff5ec1501e0 2024-05-08T20:27:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003d30 con 0x7ff5ec1501e0 2024-05-08T20:27:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.751+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec149870 con 0x7ff5ec1501e0 2024-05-08T20:27:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec1482d0 con 0x7ff5ec1501e0 2024-05-08T20:27:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5e4003e90 con 0x7ff5ec1501e0 2024-05-08T20:27:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5d3fff640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 0x7ff5d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5e4084140 con 0x7ff5ec1501e0 2024-05-08T20:27:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5eb7fe640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 0x7ff5d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.755+0000 7ff5eb7fe640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 0x7ff5d8068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ae000 tx=0x7ff5e00a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.759+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff5e4051890 con 0x7ff5ec1501e0 2024-05-08T20:27:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5ec074950 con 0x7ff5ec1501e0 2024-05-08T20:27:16.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5d3fff640 1 -- 172.21.15.81:0/688242006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff5e401d090 con 0x7ff5ec1501e0 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:27:16.924 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 msgr2=0x7ff5d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 0x7ff5d8068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ae000 tx=0x7ff5e00a6040 comp rx=0 tx=0).stop 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 msgr2=0x7ff5ec1475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400cc30 tx=0x7ff5e400a5c0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 shutdown_connections 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5d8066690 0x7ff5d8068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5ec1501e0 0x7ff5ec1475d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5ec0725f0 0x7ff5ec0c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 --2- 172.21.15.81:0/688242006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5ec06f400 0x7ff5ec1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 >> 172.21.15.81:0/688242006 conn(0x7ff5ec0c2ca0 msgr2=0x7ff5ec14e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 shutdown_connections 2024-05-08T20:27:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:16.919+0000 7ff5f1c3f640 1 -- 172.21.15.81:0/688242006 wait complete. 2024-05-08T20:27:16.941 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-05-08T20:27:16.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-05-08T20:27:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 Processor -- start 2024-05-08T20:27:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 -- start start 2024-05-08T20:27:17.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 0x7ff580152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff580152100 0x7ff580155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff580154c70 con 0x7ff580155990 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58006f710 con 0x7ff580152100 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff58852b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800aba40 con 0x7ff58014edb0 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff585ac6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff580152100 0x7ff580155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff586ac8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff580155990 0x7ff58006c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43870/0 (socket says 172.21.15.81:43870) 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff586ac8640 1 -- 172.21.15.81:0/2633463411 learned_addr learned my addr 172.21.15.81:0/2633463411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff5862c7640 1 --2- 172.21.15.81:0/2633463411 >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 0x7ff580152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff585ac6640 1 -- 172.21.15.81:0/2633463411 >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 msgr2=0x7ff580152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff585ac6640 1 --2- 172.21.15.81:0/2633463411 >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 0x7ff580152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.043+0000 7ff585ac6640 1 -- 172.21.15.81:0/2633463411 >> v1:172.21.15.81:6789/0 conn(0x7ff580155990 legacy=0x7ff58006c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff585ac6640 1 -- 172.21.15.81:0/2633463411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800abd20 con 0x7ff580152100 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff5852c5640 1 -- 172.21.15.81:0/2633463411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599468580 0 0) 0x7ff580154c70 con 0x7ff580155990 2024-05-08T20:27:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff5862c7640 1 --2- 172.21.15.81:0/2633463411 >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 0x7ff580152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff585ac6640 1 --2- 172.21.15.81:0/2633463411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff580155450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff58006d310 tx=0x7ff57001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e86dca2f5e3e324 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff5852c5640 1 -- 172.21.15.81:0/2633463411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700ab600 con 0x7ff580152100 2024-05-08T20:27:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff5852c5640 1 -- 172.21.15.81:0/2633463411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5700a7050 con 0x7ff580152100 2024-05-08T20:27:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff5852c5640 1 -- 172.21.15.81:0/2633463411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700ab980 con 0x7ff580152100 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- 172.21.15.81:0/2633463411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 msgr2=0x7ff580155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 --2- 172.21.15.81:0/2633463411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff580155450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff58006d310 tx=0x7ff57001c3f0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- 172.21.15.81:0/2633463411 shutdown_connections 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 --2- 172.21.15.81:0/2633463411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff580155450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 --2- 172.21.15.81:0/2633463411 >> v2:172.21.15.117:3300/0 conn(0x7ff58014edb0 0x7ff580152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- 172.21.15.81:0/2633463411 >> 172.21.15.81:0/2633463411 conn(0x7ff5800c2d10 msgr2=0x7ff5800c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- 172.21.15.81:0/2633463411 shutdown_connections 2024-05-08T20:27:17.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- 172.21.15.81:0/2633463411 wait complete. 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 Processor -- start 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.047+0000 7ff58852b640 1 -- start start 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58014edb0 0x7ff5800aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 0x7ff5800bc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580150df0 con 0x7ff580152100 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801501e0 con 0x7ff580155990 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5801504c0 con 0x7ff58014edb0 2024-05-08T20:27:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60116/0 (socket says 172.21.15.81:60116) 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 -- 172.21.15.81:0/3439051165 learned_addr learned my addr 172.21.15.81:0/3439051165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff5862c7640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58014edb0 0x7ff5800aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff586ac8640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 0x7ff5800bc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 -- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58014edb0 msgr2=0x7ff5800aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58014edb0 0x7ff5800aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 -- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 msgr2=0x7ff5800bc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 0x7ff5800bc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 -- 172.21.15.81:0/3439051165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570009420 con 0x7ff580152100 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff586ac8640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 0x7ff5800bc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff585ac6640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ae040 tx=0x7ff570019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700b4840 con 0x7ff580152100 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5700b49c0 con 0x7ff580152100 2024-05-08T20:27:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5801507a0 con 0x7ff580152100 2024-05-08T20:27:17.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700b4d70 con 0x7ff580152100 2024-05-08T20:27:17.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5800aadd0 con 0x7ff580152100 2024-05-08T20:27:17.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff580150fa0 con 0x7ff580152100 2024-05-08T20:27:17.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5700b2040 con 0x7ff580152100 2024-05-08T20:27:17.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 0x7ff564068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff5862c7640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 0x7ff564068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff57011e300 con 0x7ff580152100 2024-05-08T20:27:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.051+0000 7ff5862c7640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 0x7ff564068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a9a0 tx=0x7ff57c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.055+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff580150fa0 con 0x7ff580152100 2024-05-08T20:27:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.203+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff580150fa0 con 0x7ff580152100 2024-05-08T20:27:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.479+0000 7ff576ffd640 1 -- 172.21.15.81:0/3439051165 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v17) v1 ==== 128+0+0 (secure 0 0 0) 0x7ff580150fa0 con 0x7ff580152100 2024-05-08T20:27:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'a_metadata' created 2024-05-08T20:27:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 msgr2=0x7ff564068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 0x7ff564068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00a9a0 tx=0x7ff57c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 msgr2=0x7ff5800bc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ae040 tx=0x7ff570019190 comp rx=0 tx=0).stop 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 shutdown_connections 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff564066690 0x7ff564068b50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff580155990 0x7ff5800bc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff580152100 0x7ff5800bc000 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5700ae040 tx=0x7ff570019190 comp rx=0 tx=0).stop 2024-05-08T20:27:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 --2- 172.21.15.81:0/3439051165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58014edb0 0x7ff5800aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 >> 172.21.15.81:0/3439051165 conn(0x7ff5800c2d10 msgr2=0x7ff5800717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 shutdown_connections 2024-05-08T20:27:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.487+0000 7ff58852b640 1 -- 172.21.15.81:0/3439051165 wait complete. 2024-05-08T20:27:17.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T20:27:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 Processor -- start 2024-05-08T20:27:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 -- start start 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f7c153270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0bbc10 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c150240 con 0x7f5f7c14fe60 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f81d8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c2720 con 0x7f5f7c0bcce0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f7c0bc0a0 0x7f5f7c0a94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43878/0 (socket says 172.21.15.81:43878) 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7affd640 1 -- 172.21.15.81:0/2901691897 learned_addr learned my addr 172.21.15.81:0/2901691897 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f7c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676527246 0 0) 0x7f5f7c0bbc10 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f64003530 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3849362309 0 0) 0x7f5f64003530 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 msgr2=0x7f5f7c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f7c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 >> v1:172.21.15.117:6789/0 conn(0x7f5f7c14fe60 legacy=0x7f5f7c0c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0bb020 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f5f70001680 con 0x7f5f7c0bc0a0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 >> v1:172.21.15.81:6789/0 conn(0x7f5f7c0bc0a0 legacy=0x7f5f7c0a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f64003f30 0x7f5f640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f64004d10 0x7f5f64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c2720 con 0x7f5f64004d10 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6400bb20 con 0x7f5f64003f30 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6400bce0 con 0x7f5f7c0bcce0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.639+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f64004d10 0x7f5f64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7affd640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f64003f30 0x7f5f640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7b7fe640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 -- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 msgr2=0x7f5f640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f7c0bcce0 0x7f5f640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 -- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f64003f30 msgr2=0x7f5f640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f64003f30 0x7f5f640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 -- 172.21.15.81:0/2901691897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64003530 con 0x7f5f64004d10 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f64004d10 0x7f5f64005190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009fc0 tx=0x7f5f7401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb12354d04b116e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740a5b80 con 0x7f5f64004d10 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7400f040 con 0x7f5f64004d10 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7a7fc640 1 -- 172.21.15.81:0/2901691897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740ad440 con 0x7f5f64004d10 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 -- 172.21.15.81:0/2901691897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f64004d10 msgr2=0x7f5f64005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/2901691897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f64004d10 0x7f5f64005190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f74009fc0 tx=0x7f5f7401cc80 comp rx=0 tx=0).stop 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f7bfff640 1 -- 172.21.15.81:0/2901691897 reap_dead start 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 -- 172.21.15.81:0/2901691897 shutdown_connections 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 -- 172.21.15.81:0/2901691897 >> 172.21.15.81:0/2901691897 conn(0x7f5f7c0c2b00 msgr2=0x7f5f7c0c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 -- 172.21.15.81:0/2901691897 shutdown_connections 2024-05-08T20:27:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.643+0000 7f5f81d8d640 1 -- 172.21.15.81:0/2901691897 wait complete. 2024-05-08T20:27:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 Processor -- start 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- start start 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f64004d10 0x7f5f7c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f7c072390 0x7f5f7c148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1e87d0 con 0x7f5f7c148b80 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1e7c20 con 0x7f5f7c072390 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1494b0 con 0x7f5f64004d10 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60122/0 (socket says 172.21.15.81:60122) 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 -- 172.21.15.81:0/402328806 learned_addr learned my addr 172.21.15.81:0/402328806 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7affd640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f7c072390 0x7f5f7c148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7b7fe640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f64004d10 0x7f5f7c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 -- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f64004d10 msgr2=0x7f5f7c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f64004d10 0x7f5f7c151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 -- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f7c072390 msgr2=0x7f5f7c148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f7c072390 0x7f5f7c148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 -- 172.21.15.81:0/402328806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c1e8bf0 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7bfff640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f74002240 tx=0x7f5f74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f740039a0 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74003b00 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c156660 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74003e70 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c1e8110 con 0x7f5f7c148b80 2024-05-08T20:27:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c1e8910 con 0x7f5f7c148b80 2024-05-08T20:27:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f740b4040 con 0x7f5f7c148b80 2024-05-08T20:27:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 0x7f5f68068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5222+0+0 (secure 0 0 0) 0x7f5f7411dc10 con 0x7f5f7c148b80 2024-05-08T20:27:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.647+0000 7f5f7b7fe640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 0x7f5f68068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.651+0000 7f5f7b7fe640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 0x7f5f68068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0015e0 tx=0x7f5f6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.655+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5f7c1e8910 con 0x7f5f7c148b80 2024-05-08T20:27:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:17.815+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f7c1e8910 con 0x7f5f7c148b80 2024-05-08T20:27:18.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.491+0000 7f5f63fff640 1 -- 172.21.15.81:0/402328806 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v18) v1 ==== 160+0+0 (secure 0 0 0) 0x7f5f7c1e8910 con 0x7f5f7c148b80 2024-05-08T20:27:18.497 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'a_data' created 2024-05-08T20:27:18.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 msgr2=0x7f5f68068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 0x7f5f68068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0015e0 tx=0x7f5f6c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:18.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 msgr2=0x7f5f7c1eb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f74002240 tx=0x7f5f74009750 comp rx=0 tx=0).stop 2024-05-08T20:27:18.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 shutdown_connections 2024-05-08T20:27:18.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f680666c0 0x7f5f68068b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f7c148b80 0x7f5f7c1eb1d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f7c072390 0x7f5f7c148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 --2- 172.21.15.81:0/402328806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f64004d10 0x7f5f7c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 >> 172.21.15.81:0/402328806 conn(0x7f5f7c0c2b00 msgr2=0x7f5f7c0c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 shutdown_connections 2024-05-08T20:27:18.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.507+0000 7f5f81d8d640 1 -- 172.21.15.81:0/402328806 wait complete. 2024-05-08T20:27:18.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-05-08T20:27:18.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:27:18.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:27:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 Processor -- start 2024-05-08T20:27:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 -- start start 2024-05-08T20:27:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f07801588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0780154cf0 0x7f0780155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0780158e20 con 0x7f0780155690 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078006bb20 con 0x7f0780154cf0 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f0785b58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07801548e0 con 0x7f0780151f00 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0780154cf0 0x7f0780155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0780154cf0 0x7f0780155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60136/0 (socket says 172.21.15.81:60136) 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 -- 172.21.15.81:0/3321025848 learned_addr learned my addr 172.21.15.81:0/3321025848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077ffff640 1 --1- 172.21.15.81:0/3321025848 >> v1:172.21.15.81:6789/0 conn(0x7f0780155690 0x7f07800ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43894/0 (socket says 172.21.15.81:43894) 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077f7fe640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f07801588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 -- 172.21.15.81:0/3321025848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 msgr2=0x7f07801588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f07801588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 -- 172.21.15.81:0/3321025848 >> v1:172.21.15.81:6789/0 conn(0x7f0780155690 legacy=0x7f07800ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077effd640 1 -- 172.21.15.81:0/3321025848 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07801522e0 con 0x7f0780154cf0 2024-05-08T20:27:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.655+0000 7f077e7fc640 1 -- 172.21.15.81:0/3321025848 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367691465 0 0) 0x7f0780158e20 con 0x7f0780155690 2024-05-08T20:27:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077effd640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780154cf0 0x7f0780155150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07740098a0 tx=0x7f077401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea72d37887938e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077e7fc640 1 -- 172.21.15.81:0/3321025848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740ab640 con 0x7f0780154cf0 2024-05-08T20:27:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077e7fc640 1 -- 172.21.15.81:0/3321025848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740a7070 con 0x7f0780154cf0 2024-05-08T20:27:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077e7fc640 1 -- 172.21.15.81:0/3321025848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740ab9c0 con 0x7f0780154cf0 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/3321025848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780154cf0 msgr2=0x7f0780155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780154cf0 0x7f0780155150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07740098a0 tx=0x7f077401c420 comp rx=0 tx=0).stop 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/3321025848 shutdown_connections 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780154cf0 0x7f0780155150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- 172.21.15.81:0/3321025848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f07801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/3321025848 >> 172.21.15.81:0/3321025848 conn(0x7f07800715f0 msgr2=0x7f0780071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/3321025848 shutdown_connections 2024-05-08T20:27:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/3321025848 wait complete. 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 Processor -- start 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- start start 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f078014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0780154cf0 0x7f0780150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0780150720 con 0x7f0780151340 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078014fb90 con 0x7f0780154cf0 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078014e6e0 con 0x7f0780151f00 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60142/0 (socket says 172.21.15.81:60142) 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 -- 172.21.15.81:0/1206872097 learned_addr learned my addr 172.21.15.81:0/1206872097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077f7fe640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f078014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077effd640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0780154cf0 0x7f0780150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 -- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 msgr2=0x7f078014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f078014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 -- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0780154cf0 msgr2=0x7f0780150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0780154cf0 0x7f0780150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 -- 172.21.15.81:0/1206872097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740094d0 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f077ffff640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f077800c750 tx=0x7f077800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800ce60 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800a640 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078014fda0 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800a9b0 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.659+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0780150060 con 0x7f0780151340 2024-05-08T20:27:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780150860 con 0x7f0780151340 2024-05-08T20:27:18.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f077800ab10 con 0x7f0780151340 2024-05-08T20:27:18.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f0767fff640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 0x7f076c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5599+0+0 (secure 0 0 0) 0x7f07780839b0 con 0x7f0780151340 2024-05-08T20:27:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f077f7fe640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 0x7f076c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.663+0000 7f077f7fe640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 0x7f076c068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f077000b9d0 tx=0x7f0770008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:18.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.667+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0778050f00 con 0x7f0780151340 2024-05-08T20:27:18.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.859+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) v1 -- 0x7f0780150860 con 0x7f0780151340 2024-05-08T20:27:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.871+0000 7f0767fff640 1 -- 172.21.15.81:0/1206872097 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0780150860 con 0x7f0780151340 2024-05-08T20:27:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T20:27:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 msgr2=0x7f076c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 0x7f076c068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f077000b9d0 tx=0x7f0770008040 comp rx=0 tx=0).stop 2024-05-08T20:27:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 msgr2=0x7f07800ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f077800c750 tx=0x7f077800cc10 comp rx=0 tx=0).stop 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 shutdown_connections 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f076c0666c0 0x7f076c068b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0780151340 0x7f07800ae380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0780154cf0 0x7f0780150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 --2- 172.21.15.81:0/1206872097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0780151f00 0x7f078014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 >> 172.21.15.81:0/1206872097 conn(0x7f07800715f0 msgr2=0x7f0780069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 shutdown_connections 2024-05-08T20:27:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:18.887+0000 7f0785b58640 1 -- 172.21.15.81:0/1206872097 wait complete. 2024-05-08T20:27:18.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.019+0000 7f764c175640 1 Processor -- start 2024-05-08T20:27:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.019+0000 7f764c175640 1 -- start start 2024-05-08T20:27:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764c175640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 0x7f76440a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764c175640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76440a8890 0x7f76440a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764c175640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76440c2a00 con 0x7f76440c1e10 2024-05-08T20:27:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764c175640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440aa950 con 0x7f76440a8890 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764c175640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440a94f0 con 0x7f76440c21f0 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76440a8890 0x7f76440a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f7649710640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 0x7f76440a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f7649f11640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f76440c1e10 0x7f7644158610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38090/0 (socket says 172.21.15.81:38090) 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f7649710640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 0x7f76440a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:56822/0 (socket says 172.21.15.81:56822) 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 --2- 172.21.15.81:0/669850880 >> v2:172.21.15.117:3300/0 conn(0x7f76440a8890 0x7f76440a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:45220/0 (socket says 172.21.15.81:45220) 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f7649f11640 1 -- 172.21.15.81:0/669850880 learned_addr learned my addr 172.21.15.81:0/669850880 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 -- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 msgr2=0x7f76440a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 --2- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 0x7f76440a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 -- 172.21.15.81:0/669850880 >> v1:172.21.15.117:6789/0 conn(0x7f76440c1e10 legacy=0x7f7644158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.023+0000 7f764a712640 1 -- 172.21.15.81:0/669850880 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440c0850 con 0x7f76440a8890 2024-05-08T20:27:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440a8890 0x7f76440a9ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097c0 tx=0x7f763c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2730d5f551d34e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f7648f0f640 1 -- 172.21.15.81:0/669850880 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0ab600 con 0x7f76440a8890 2024-05-08T20:27:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f7648f0f640 1 -- 172.21.15.81:0/669850880 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0a7050 con 0x7f76440a8890 2024-05-08T20:27:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f7648f0f640 1 -- 172.21.15.81:0/669850880 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0ab980 con 0x7f76440a8890 2024-05-08T20:27:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440a8890 msgr2=0x7f76440a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440a8890 0x7f76440a9ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097c0 tx=0x7f763c01c410 comp rx=0 tx=0).stop 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- 172.21.15.81:0/669850880 shutdown_connections 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440a8890 0x7f76440a9ec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- 172.21.15.81:0/669850880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440c21f0 0x7f76440a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- 172.21.15.81:0/669850880 >> 172.21.15.81:0/669850880 conn(0x7f76440c2ca0 msgr2=0x7f76440c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- 172.21.15.81:0/669850880 shutdown_connections 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- 172.21.15.81:0/669850880 wait complete. 2024-05-08T20:27:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 Processor -- start 2024-05-08T20:27:19.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- start start 2024-05-08T20:27:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440a8890 0x7f76441f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440c1e10 0x7f7644150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764414d250 con 0x7f76440c21f0 2024-05-08T20:27:19.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764406aea0 con 0x7f76440c1e10 2024-05-08T20:27:19.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764c175640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764414e050 con 0x7f76440a8890 2024-05-08T20:27:19.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54852/0 (socket says 172.21.15.81:54852) 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 -- 172.21.15.81:0/315968408 learned_addr learned my addr 172.21.15.81:0/315968408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f7649f11640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440a8890 0x7f76441f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f7649710640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440c1e10 0x7f7644150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 -- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440a8890 msgr2=0x7f76441f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440a8890 0x7f76441f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 -- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440c1e10 msgr2=0x7f7644150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440c1e10 0x7f7644150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 -- 172.21.15.81:0/315968408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009420 con 0x7f76440c21f0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.027+0000 7f764a712640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097c0 tx=0x7f763c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c006e20 con 0x7f76440c21f0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0b4400 con 0x7f76440c21f0 2024-05-08T20:27:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76441f5de0 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0b4790 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764414c8d0 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7644074950 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f763c0b2040 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 0x7f7628068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f763c11df40 con 0x7f76440c21f0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f7649f11640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 0x7f7628068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.031+0000 7f7649f11640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 0x7f7628068b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76440c5d50 tx=0x7f7640009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.035+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f763c0eb350 con 0x7f76440c21f0 2024-05-08T20:27:19.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.195+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f764414bc30 con 0x7f76440c21f0 2024-05-08T20:27:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.195+0000 7f763a7fc640 1 -- 172.21.15.81:0/315968408 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16030 (secure 0 0 0) 0x7f763c0ee970 con 0x7f76440c21f0 2024-05-08T20:27:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:19.202 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:18.865031+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 msgr2=0x7f7628068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 0x7f7628068b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76440c5d50 tx=0x7f7640009040 comp rx=0 tx=0).stop 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 msgr2=0x7f7644151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097c0 tx=0x7f763c0191b0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 shutdown_connections 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76280666c0 0x7f7628068b80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c21f0 0x7f7644151d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76440c1e10 0x7f7644150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 --2- 172.21.15.81:0/315968408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76440a8890 0x7f76441f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 >> 172.21.15.81:0/315968408 conn(0x7f76440c2ca0 msgr2=0x7f76441543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 shutdown_connections 2024-05-08T20:27:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.199+0000 7f764c175640 1 -- 172.21.15.81:0/315968408 wait complete. 2024-05-08T20:27:19.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:19.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 Processor -- start 2024-05-08T20:27:19.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 -- start start 2024-05-08T20:27:19.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b141501e0 0x7f0b1406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 0x7f0b140c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140c0650 con 0x7f0b1406f400 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1406fd60 con 0x7f0b141501e0 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b1a8d0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14072180 con 0x7f0b140725f0 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b141501e0 0x7f0b1406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b141501e0 0x7f0b1406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54868/0 (socket says 172.21.15.81:54868) 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 -- 172.21.15.81:0/948373741 learned_addr learned my addr 172.21.15.81:0/948373741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b137fe640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 0x7f0b140c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 -- 172.21.15.81:0/948373741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 msgr2=0x7f0b140c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 0x7f0b140c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 -- 172.21.15.81:0/948373741 >> v1:172.21.15.117:6789/0 conn(0x7f0b1406f400 legacy=0x7f0b140c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b13fff640 1 -- 172.21.15.81:0/948373741 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1406fa80 con 0x7f0b141501e0 2024-05-08T20:27:19.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.339+0000 7f0b137fe640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 0x7f0b140c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:19.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b13fff640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1406c930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b0ae6ee256ebb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b12ffd640 1 -- 172.21.15.81:0/948373741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040a7070 con 0x7f0b141501e0 2024-05-08T20:27:19.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b12ffd640 1 -- 172.21.15.81:0/948373741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040ab430 con 0x7f0b141501e0 2024-05-08T20:27:19.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b12ffd640 1 -- 172.21.15.81:0/948373741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ab7c0 con 0x7f0b141501e0 2024-05-08T20:27:19.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/948373741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 msgr2=0x7f0b1406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1406c930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0401c410 comp rx=0 tx=0).stop 2024-05-08T20:27:19.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/948373741 shutdown_connections 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b140725f0 0x7f0b140c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/948373741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1406c930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.343+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/948373741 >> 172.21.15.81:0/948373741 conn(0x7f0b140c2ca0 msgr2=0x7f0b140c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/948373741 shutdown_connections 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/948373741 wait complete. 2024-05-08T20:27:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 Processor -- start 2024-05-08T20:27:19.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- start start 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406f400 0x7f0b14140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b140725f0 0x7f0b14141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141f0960 con 0x7f0b141501e0 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1414bc20 con 0x7f0b140725f0 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1414bf00 con 0x7f0b1406f400 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54878/0 (socket says 172.21.15.81:54878) 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 -- 172.21.15.81:0/357286461 learned_addr learned my addr 172.21.15.81:0/357286461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b13fff640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406f400 0x7f0b14140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b137fe640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b140725f0 0x7f0b14141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 -- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406f400 msgr2=0x7f0b14140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406f400 0x7f0b14140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 -- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b140725f0 msgr2=0x7f0b14141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b140725f0 0x7f0b14141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 -- 172.21.15.81:0/357286461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040094d0 con 0x7f0b141501e0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b18e6d640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c730 tx=0x7f0b0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003b80 con 0x7f0b141501e0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c003ce0 con 0x7f0b141501e0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b14150740 con 0x7f0b141501e0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00aa30 con 0x7f0b141501e0 2024-05-08T20:27:19.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1414c4c0 con 0x7f0b141501e0 2024-05-08T20:27:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.347+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b141f0aa0 con 0x7f0b141501e0 2024-05-08T20:27:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.351+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b0c00ab90 con 0x7f0b141501e0 2024-05-08T20:27:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.351+0000 7f0b10ff9640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 0x7f0b00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.351+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f0b0c083ee0 con 0x7f0b141501e0 2024-05-08T20:27:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.351+0000 7f0b13fff640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 0x7f0b00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.351+0000 7f0b13fff640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 0x7f0b00068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b040af000 tx=0x7f0b04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.355+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0b0c0512f0 con 0x7f0b141501e0 2024-05-08T20:27:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.511+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b14074950 con 0x7f0b141501e0 2024-05-08T20:27:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.511+0000 7f0b10ff9640 1 -- 172.21.15.81:0/357286461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16030 (secure 0 0 0) 0x7f0b0c054910 con 0x7f0b141501e0 2024-05-08T20:27:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:19.516 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:18.865031+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:19.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 msgr2=0x7f0b00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 0x7f0b00068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b040af000 tx=0x7f0b04008040 comp rx=0 tx=0).stop 2024-05-08T20:27:19.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 msgr2=0x7f0b1413de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c730 tx=0x7f0b0c00cbf0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 shutdown_connections 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b00066690 0x7f0b00068b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b141501e0 0x7f0b1413de80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b140725f0 0x7f0b14141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 --2- 172.21.15.81:0/357286461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b1406f400 0x7f0b14140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 >> 172.21.15.81:0/357286461 conn(0x7f0b140c2ca0 msgr2=0x7f0b140c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 shutdown_connections 2024-05-08T20:27:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.515+0000 7f0b1a8d0640 1 -- 172.21.15.81:0/357286461 wait complete. 2024-05-08T20:27:19.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-05-08T20:27:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.639+0000 7f6c90149640 1 Processor -- start 2024-05-08T20:27:19.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.639+0000 7f6c90149640 1 -- start start 2024-05-08T20:27:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c90149640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c8806afd0 0x7f6c8806b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c90149640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 0x7f6c8815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c90149640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880abc50 con 0x7f6c8814e410 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c90149640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880c2900 con 0x7f6c8806afd0 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c90149640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880aa320 con 0x7f6c88159790 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c8806afd0 0x7f6c8806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c8806afd0 0x7f6c8806b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54894/0 (socket says 172.21.15.81:54894) 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/3082213414 learned_addr learned my addr 172.21.15.81:0/3082213414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8e6e6640 1 --2- 172.21.15.81:0/3082213414 >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 0x7f6c8815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/3082213414 >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 msgr2=0x7f6c8815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 --2- 172.21.15.81:0/3082213414 >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 0x7f6c8815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/3082213414 >> v1:172.21.15.117:6789/0 conn(0x7f6c8814e410 legacy=0x7f6c880aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/3082213414 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880a9560 con 0x7f6c8806afd0 2024-05-08T20:27:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8e6e6640 1 --2- 172.21.15.81:0/3082213414 >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 0x7f6c8815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8d6e4640 1 --2- 172.21.15.81:0/3082213414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8806afd0 0x7f6c8806b460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c88069b30 tx=0x7f6c7c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a450b6eecd07e47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8cee3640 1 -- 172.21.15.81:0/3082213414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0ab620 con 0x7f6c8806afd0 2024-05-08T20:27:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8cee3640 1 -- 172.21.15.81:0/3082213414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0ab780 con 0x7f6c8806afd0 2024-05-08T20:27:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.643+0000 7f6c8cee3640 1 -- 172.21.15.81:0/3082213414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0abb10 con 0x7f6c8806afd0 2024-05-08T20:27:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/3082213414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8806afd0 msgr2=0x7f6c8806b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- 172.21.15.81:0/3082213414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8806afd0 0x7f6c8806b460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c88069b30 tx=0x7f6c7c01c420 comp rx=0 tx=0).stop 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/3082213414 shutdown_connections 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- 172.21.15.81:0/3082213414 >> v2:172.21.15.117:3300/0 conn(0x7f6c88159790 0x7f6c8815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- 172.21.15.81:0/3082213414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8806afd0 0x7f6c8806b460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/3082213414 >> 172.21.15.81:0/3082213414 conn(0x7f6c880c2ca0 msgr2=0x7f6c880c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/3082213414 shutdown_connections 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/3082213414 wait complete. 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 Processor -- start 2024-05-08T20:27:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- start start 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c8806afd0 0x7f6c881f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c88159790 0x7f6c880bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88072180 con 0x7f6c8814e410 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c881ee600 con 0x7f6c8806afd0 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88150db0 con 0x7f6c88159790 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54902/0 (socket says 172.21.15.81:54902) 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/388369911 learned_addr learned my addr 172.21.15.81:0/388369911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c88159790 msgr2=0x7f6c880bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c88159790 0x7f6c880bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c8806afd0 msgr2=0x7f6c881f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c8806afd0 0x7f6c881f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 -- 172.21.15.81:0/388369911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0094d0 con 0x7f6c8814e410 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c8d6e4640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01a050 tx=0x7f6c7c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0be3f0 con 0x7f6c8814e410 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0be550 con 0x7f6c8814e410 2024-05-08T20:27:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0be8e0 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c881ecdf0 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880c5920 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.647+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c881ecc50 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.651+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c7c0c7440 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.651+0000 7f6c7a7fc640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 0x7f6c6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.651+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f6c7c11e9b0 con 0x7f6c8814e410 2024-05-08T20:27:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.651+0000 7f6c8dee5640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 0x7f6c6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.651+0000 7f6c8dee5640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 0x7f6c6c068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007fd0 tx=0x7f6c80007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.655+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6c881ecc50 con 0x7f6c8814e410 2024-05-08T20:27:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:19.847+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6c8806f1e0 con 0x7f6c8814e410 2024-05-08T20:27:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.511+0000 7f6c7a7fc640 1 -- 172.21.15.81:0/388369911 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 113+0+0 (secure 0 0 0) 0x7f6c8806f1e0 con 0x7f6c8814e410 2024-05-08T20:27:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.515+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 msgr2=0x7f6c6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 0x7f6c6c068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c80007fd0 tx=0x7f6c80007d40 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 msgr2=0x7f6c881ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01a050 tx=0x7f6c7c01ac60 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 shutdown_connections 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6c6c066690 0x7f6c6c068b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c88159790 0x7f6c880bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c8814e410 0x7f6c881ee0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 --2- 172.21.15.81:0/388369911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c8806afd0 0x7f6c881f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 >> 172.21.15.81:0/388369911 conn(0x7f6c880c2ca0 msgr2=0x7f6c88159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 shutdown_connections 2024-05-08T20:27:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.519+0000 7f6c90149640 1 -- 172.21.15.81:0/388369911 wait complete. 2024-05-08T20:27:20.543 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-08T20:27:20.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-05-08T20:27:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.667+0000 7f82dbf17640 1 Processor -- start 2024-05-08T20:27:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.667+0000 7f82dbf17640 1 -- start start 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d406f400 0x7f82d40c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40c0650 con 0x7f82d40725f0 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d406fa80 con 0x7f82d41501e0 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d406fd60 con 0x7f82d406f400 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82da4b4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d406f400 0x7f82d40c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82d94b2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82d40725f0 0x7f82d40c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52740/0 (socket says 172.21.15.81:52740) 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82d94b2640 1 -- 172.21.15.81:0/72480919 learned_addr learned my addr 172.21.15.81:0/72480919 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82da4b4640 1 -- 172.21.15.81:0/72480919 >> v1:172.21.15.117:6789/0 conn(0x7f82d41501e0 legacy=0x7f82d406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82da4b4640 1 -- 172.21.15.81:0/72480919 >> v1:172.21.15.81:6789/0 conn(0x7f82d40725f0 legacy=0x7f82d40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82da4b4640 1 -- 172.21.15.81:0/72480919 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4071ea0 con 0x7f82d406f400 2024-05-08T20:27:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82da4b4640 1 --2- 172.21.15.81:0/72480919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097c0 tx=0x7f82cc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffc6b26c9cf541b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82d8cb1640 1 -- 172.21.15.81:0/72480919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0ab600 con 0x7f82d406f400 2024-05-08T20:27:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82d8cb1640 1 -- 172.21.15.81:0/72480919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0a7050 con 0x7f82d406f400 2024-05-08T20:27:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82d8cb1640 1 -- 172.21.15.81:0/72480919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0ab980 con 0x7f82d406f400 2024-05-08T20:27:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- 172.21.15.81:0/72480919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 msgr2=0x7f82d40c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 --2- 172.21.15.81:0/72480919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097c0 tx=0x7f82cc01c340 comp rx=0 tx=0).stop 2024-05-08T20:27:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- 172.21.15.81:0/72480919 shutdown_connections 2024-05-08T20:27:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 --2- 172.21.15.81:0/72480919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.671+0000 7f82dbf17640 1 -- 172.21.15.81:0/72480919 >> 172.21.15.81:0/72480919 conn(0x7f82d40c2ca0 msgr2=0x7f82d40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- 172.21.15.81:0/72480919 shutdown_connections 2024-05-08T20:27:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- 172.21.15.81:0/72480919 wait complete. 2024-05-08T20:27:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 Processor -- start 2024-05-08T20:27:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- start start 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d413e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d41501e0 0x7f82d413ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4072180 con 0x7f82d406f400 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4141d90 con 0x7f82d40725f0 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d413ef80 con 0x7f82d41501e0 2024-05-08T20:27:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54922/0 (socket says 172.21.15.81:54922) 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 -- 172.21.15.81:0/3479686247 learned_addr learned my addr 172.21.15.81:0/3479686247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 -- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d41501e0 msgr2=0x7f82d413ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d41501e0 0x7f82d413ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 -- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 msgr2=0x7f82d413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d413e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 -- 172.21.15.81:0/3479686247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009420 con 0x7f82d406f400 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82d9cb3640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c7d0 tx=0x7f82d000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0003d90 con 0x7f82d406f400 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0005070 con 0x7f82d406f400 2024-05-08T20:27:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0005420 con 0x7f82d406f400 2024-05-08T20:27:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d4150740 con 0x7f82d406f400 2024-05-08T20:27:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d4153900 con 0x7f82d406f400 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.675+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d4074950 con 0x7f82d406f400 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.679+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82d0005580 con 0x7f82d406f400 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.679+0000 7f82ca7fc640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 0x7f82b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.679+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f82d00834a0 con 0x7f82d406f400 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.679+0000 7f82d94b2640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 0x7f82b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.679+0000 7f82d94b2640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 0x7f82b8068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82d4143fc0 tx=0x7f82c4007a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.683+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f82d00508b0 con 0x7f82d406f400 2024-05-08T20:27:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:20.875+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f82d4141ab0 con 0x7f82d406f400 2024-05-08T20:27:21.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.523+0000 7f82ca7fc640 1 -- 172.21.15.81:0/3479686247 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 117+0+0 (secure 0 0 0) 0x7f82d0053ed0 con 0x7f82d406f400 2024-05-08T20:27:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 msgr2=0x7f82b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 0x7f82b8068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82d4143fc0 tx=0x7f82c4007a50 comp rx=0 tx=0).stop 2024-05-08T20:27:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 msgr2=0x7f82d41433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c7d0 tx=0x7f82d000cc90 comp rx=0 tx=0).stop 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 shutdown_connections 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b8066690 0x7f82b8068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d41501e0 0x7f82d413ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d413e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 --2- 172.21.15.81:0/3479686247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d41433a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 >> 172.21.15.81:0/3479686247 conn(0x7f82d40c2ca0 msgr2=0x7f82d40712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:21.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 shutdown_connections 2024-05-08T20:27:21.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.527+0000 7f82dbf17640 1 -- 172.21.15.81:0/3479686247 wait complete. 2024-05-08T20:27:21.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-05-08T20:27:21.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.675+0000 7f7fc7e55640 1 Processor -- start 2024-05-08T20:27:21.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.675+0000 7f7fc7e55640 1 -- start start 2024-05-08T20:27:21.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc7e55640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fc01501e0 0x7f7fc006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc7e55640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 0x7f7fc00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc7e55640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc00c0650 con 0x7f7fc006f400 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc7e55640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc006fd60 con 0x7f7fc01501e0 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc7e55640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc0072180 con 0x7f7fc00725f0 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fc01501e0 0x7f7fc006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fc01501e0 0x7f7fc006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54938/0 (socket says 172.21.15.81:54938) 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 -- 172.21.15.81:0/158217687 learned_addr learned my addr 172.21.15.81:0/158217687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc53f0640 1 --2- 172.21.15.81:0/158217687 >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 0x7f7fc00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 -- 172.21.15.81:0/158217687 >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 msgr2=0x7f7fc00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 --2- 172.21.15.81:0/158217687 >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 0x7f7fc00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 -- 172.21.15.81:0/158217687 >> v1:172.21.15.117:6789/0 conn(0x7f7fc006f400 legacy=0x7f7fc00c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 -- 172.21.15.81:0/158217687 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc006fa80 con 0x7f7fc01501e0 2024-05-08T20:27:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc53f0640 1 --2- 172.21.15.81:0/158217687 >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 0x7f7fc00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc5bf1640 1 --2- 172.21.15.81:0/158217687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01501e0 0x7f7fc006c930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fc006f1b0 tx=0x7f7fb801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b6029abdf2ce40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc4bef640 1 -- 172.21.15.81:0/158217687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a5740 con 0x7f7fc01501e0 2024-05-08T20:27:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc4bef640 1 -- 172.21.15.81:0/158217687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb80a58a0 con 0x7f7fc01501e0 2024-05-08T20:27:21.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.679+0000 7f7fc4bef640 1 -- 172.21.15.81:0/158217687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80a5c30 con 0x7f7fc01501e0 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/158217687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01501e0 msgr2=0x7f7fc006c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/158217687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01501e0 0x7f7fc006c930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fc006f1b0 tx=0x7f7fb801c860 comp rx=0 tx=0).stop 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/158217687 shutdown_connections 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/158217687 >> v2:172.21.15.117:3300/0 conn(0x7f7fc00725f0 0x7f7fc00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/158217687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc01501e0 0x7f7fc006c930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/158217687 >> 172.21.15.81:0/158217687 conn(0x7f7fc00c2ca0 msgr2=0x7f7fc00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/158217687 shutdown_connections 2024-05-08T20:27:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/158217687 wait complete. 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 Processor -- start 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- start start 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc006f400 0x7f7fc01479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fc01501e0 0x7f7fc013c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0148450 con 0x7f7fc00725f0 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00c5bf0 con 0x7f7fc006f400 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00c5ed0 con 0x7f7fc01501e0 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54940/0 (socket says 172.21.15.81:54940) 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 -- 172.21.15.81:0/1159037164 learned_addr learned my addr 172.21.15.81:0/1159037164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc5bf1640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc006f400 0x7f7fc01479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc63f2640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fc01501e0 0x7f7fc013c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 -- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fc01501e0 msgr2=0x7f7fc013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fc01501e0 0x7f7fc013c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 -- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc006f400 msgr2=0x7f7fc01479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc006f400 0x7f7fc01479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 -- 172.21.15.81:0/1159037164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8009b30 con 0x7f7fc00725f0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc53f0640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c7f0 tx=0x7f7fb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0007820 con 0x7f7fc00725f0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0007980 con 0x7f7fc00725f0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc0150740 con 0x7f7fc00725f0 2024-05-08T20:27:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0007d30 con 0x7f7fc00725f0 2024-05-08T20:27:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.683+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc0149f40 con 0x7f7fc00725f0 2024-05-08T20:27:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc0074950 con 0x7f7fc00725f0 2024-05-08T20:27:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fb00113f0 con 0x7f7fc00725f0 2024-05-08T20:27:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fb67fc640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 0x7f7fa4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f7fb0084420 con 0x7f7fc00725f0 2024-05-08T20:27:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fc5bf1640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 0x7f7fa4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.687+0000 7f7fc5bf1640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 0x7f7fa4068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ae000 tx=0x7f7fb80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:21.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.691+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7fb0051830 con 0x7f7fc00725f0 2024-05-08T20:27:21.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:21.879+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f7fc006caf0 con 0x7f7fc00725f0 2024-05-08T20:27:22.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.527+0000 7f7fb67fc640 1 -- 172.21.15.81:0/1159037164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 110+0+0 (secure 0 0 0) 0x7f7fb0054e50 con 0x7f7fc00725f0 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 msgr2=0x7f7fa4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 0x7f7fa4068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ae000 tx=0x7f7fb80a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 msgr2=0x7f7fc0147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c7f0 tx=0x7f7fb000ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 shutdown_connections 2024-05-08T20:27:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fa40666c0 0x7f7fa4068b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fc01501e0 0x7f7fc013c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fc00725f0 0x7f7fc0147f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 --2- 172.21.15.81:0/1159037164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc006f400 0x7f7fc01479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 >> 172.21.15.81:0/1159037164 conn(0x7f7fc00c2ca0 msgr2=0x7f7fc0142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 shutdown_connections 2024-05-08T20:27:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.531+0000 7f7fc7e55640 1 -- 172.21.15.81:0/1159037164 wait complete. 2024-05-08T20:27:22.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-05-08T20:27:22.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.675+0000 7f91de96d640 1 Processor -- start 2024-05-08T20:27:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.675+0000 7f91de96d640 1 -- start start 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91de96d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f91d80c21f0 0x7f91d80a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91de96d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d80c2a00 con 0x7f91d80c1e10 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91de96d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d80a94f0 con 0x7f91d80a8890 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91de96d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80aa950 con 0x7f91d80c21f0 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f91d80c1e10 0x7f91d8158610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52742/0 (socket says 172.21.15.81:52742) 2024-05-08T20:27:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 -- 172.21.15.81:0/2851951714 learned_addr learned my addr 172.21.15.81:0/2851951714 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268973511 0 0) 0x7f91d80c2a00 con 0x7f91d80c1e10 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d77fe640 1 --2- 172.21.15.81:0/2851951714 >> v2:172.21.15.117:3300/0 conn(0x7f91d80c21f0 0x7f91d80a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c4003530 con 0x7f91d80c1e10 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385181007 0 0) 0x7f91c4003530 con 0x7f91d80c1e10 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 >> v2:172.21.15.117:3300/0 conn(0x7f91d80c21f0 msgr2=0x7f91d80a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 --2- 172.21.15.81:0/2851951714 >> v2:172.21.15.117:3300/0 conn(0x7f91d80c21f0 0x7f91d80a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 >> v1:172.21.15.117:6789/0 conn(0x7f91d80a8890 legacy=0x7f91d80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80c0850 con 0x7f91d80c1e10 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f91c0001680 con 0x7f91d80c1e10 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 >> v1:172.21.15.81:6789/0 conn(0x7f91d80c1e10 legacy=0x7f91d8158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c40047d0 0x7f91c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91c4005190 0x7f91c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400c100 con 0x7f91c4003980 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400c270 con 0x7f91c40047d0 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c400c430 con 0x7f91c4005190 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d77fe640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c40047d0 0x7f91c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91dcf0a640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91c4005190 0x7f91c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 -- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91c4005190 msgr2=0x7f91c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91c4005190 0x7f91c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 -- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c40047d0 msgr2=0x7f91c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c40047d0 0x7f91c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 -- 172.21.15.81:0/2851951714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4003530 con 0x7f91c4003980 2024-05-08T20:27:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91dcf0a640 1 -- 172.21.15.81:0/2851951714 reap_dead start 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d7fff640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91c4003da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c240 tx=0x7f91c001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8064b430a84839 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005ae0 con 0x7f91c4003980 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0005c40 con 0x7f91c4003980 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.679+0000 7f91d6ffd640 1 -- 172.21.15.81:0/2851951714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00a5a90 con 0x7f91c4003980 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 msgr2=0x7f91c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91c4003da0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c240 tx=0x7f91c001cc60 comp rx=0 tx=0).stop 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/2851951714 shutdown_connections 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 --2- 172.21.15.81:0/2851951714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91c4003da0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/2851951714 >> 172.21.15.81:0/2851951714 conn(0x7f91d80c2ca0 msgr2=0x7f91d80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/2851951714 shutdown_connections 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/2851951714 wait complete. 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 Processor -- start 2024-05-08T20:27:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- start start 2024-05-08T20:27:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91d80c5db0 0x7f91d815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91d815c8e0 0x7f91d81f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81e6000 con 0x7f91c4003980 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81e4ba0 con 0x7f91d815c8e0 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80c50c0 con 0x7f91d80c5db0 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54964/0 (socket says 172.21.15.81:54964) 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 -- 172.21.15.81:0/350410804 learned_addr learned my addr 172.21.15.81:0/350410804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91dcf0a640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91d815c8e0 0x7f91d81f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d77fe640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91d80c5db0 0x7f91d815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 -- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91d80c5db0 msgr2=0x7f91d815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91d80c5db0 0x7f91d815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 -- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91d815c8e0 msgr2=0x7f91d81f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91d815c8e0 0x7f91d81f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 -- 172.21.15.81:0/350410804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d81e4870 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d7fff640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91c001ca90 tx=0x7f91c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00b4070 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c00015c0 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d80c5360 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00a5a50 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.683+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d81e58e0 con 0x7f91c4003980 2024-05-08T20:27:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d8074950 con 0x7f91c4003980 2024-05-08T20:27:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91c00a5bb0 con 0x7f91c4003980 2024-05-08T20:27:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91d4ff9640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 0x7f91b8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f91c011dcd0 con 0x7f91c4003980 2024-05-08T20:27:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91d77fe640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 0x7f91b8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.687+0000 7f91d77fe640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 0x7f91b8068b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d81f27c0 tx=0x7f91c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.691+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f91c00eb050 con 0x7f91c4003980 2024-05-08T20:27:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.879+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d815d440 con 0x7f91c4003980 2024-05-08T20:27:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91d4ff9640 1 -- 172.21.15.81:0/350410804 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4727 (secure 0 0 0) 0x7f91c00a5e60 con 0x7f91c4003980 2024-05-08T20:27:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:27:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 msgr2=0x7f91b8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 0x7f91b8068b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d81f27c0 tx=0x7f91c800b040 comp rx=0 tx=0).stop 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 msgr2=0x7f91d81e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f91c001ca90 tx=0x7f91c4005800 comp rx=0 tx=0).stop 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 shutdown_connections 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f91b80666c0 0x7f91b8068b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91d815c8e0 0x7f91d81f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91d80c5db0 0x7f91d815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 --2- 172.21.15.81:0/350410804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91c4003980 0x7f91d81e53a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 >> 172.21.15.81:0/350410804 conn(0x7f91d80c2ca0 msgr2=0x7f91d8153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 shutdown_connections 2024-05-08T20:27:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:22.883+0000 7f91de96d640 1 -- 172.21.15.81:0/350410804 wait complete. 2024-05-08T20:27:22.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 Processor -- start 2024-05-08T20:27:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 -- start start 2024-05-08T20:27:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18240725f0 0x7f18240c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f18240c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18240c0650 con 0x7f18241501e0 2024-05-08T20:27:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182406fd60 con 0x7f18240725f0 2024-05-08T20:27:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f182a0ff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1824072180 con 0x7f182406f400 2024-05-08T20:27:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1822ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f18240725f0 0x7f18240c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1823fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f18240c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f18237fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f18241501e0 0x7f182406c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38150/0 (socket says 172.21.15.81:38150) 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f18237fe640 1 -- 172.21.15.81:0/3513332487 learned_addr learned my addr 172.21.15.81:0/3513332487 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1822ffd640 1 -- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 msgr2=0x7f18240c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1822ffd640 1 --2- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f18240c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1822ffd640 1 -- 172.21.15.81:0/3513332487 >> v1:172.21.15.117:6789/0 conn(0x7f18241501e0 legacy=0x7f182406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.015+0000 7f1822ffd640 1 -- 172.21.15.81:0/3513332487 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182406fa80 con 0x7f18240725f0 2024-05-08T20:27:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f1822ffd640 1 --2- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18240c1c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18140097c0 tx=0x7f181401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c7d4966b8edf43 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f18227fc640 1 -- 172.21.15.81:0/3513332487 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140ab600 con 0x7f18240725f0 2024-05-08T20:27:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f18227fc640 1 -- 172.21.15.81:0/3513332487 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140a7050 con 0x7f18240725f0 2024-05-08T20:27:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f18227fc640 1 -- 172.21.15.81:0/3513332487 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140ab980 con 0x7f18240725f0 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 -- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 msgr2=0x7f18240c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18240c1c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18140097c0 tx=0x7f181401c350 comp rx=0 tx=0).stop 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 -- 172.21.15.81:0/3513332487 shutdown_connections 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f18240c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3513332487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18240c1c40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 -- 172.21.15.81:0/3513332487 >> 172.21.15.81:0/3513332487 conn(0x7f18240c2ca0 msgr2=0x7f18240c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 -- 172.21.15.81:0/3513332487 shutdown_connections 2024-05-08T20:27:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.019+0000 7f182a0ff640 1 -- 172.21.15.81:0/3513332487 wait complete. 2024-05-08T20:27:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 Processor -- start 2024-05-08T20:27:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- start start 2024-05-08T20:27:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f1824148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18241ec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18241444f0 con 0x7f18241501e0 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1824148070 con 0x7f18240725f0 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1824148350 con 0x7f182406f400 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54978/0 (socket says 172.21.15.81:54978) 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 -- 172.21.15.81:0/3330954210 learned_addr learned my addr 172.21.15.81:0/3330954210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1822ffd640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18241ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f18237fe640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f1824148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 -- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 msgr2=0x7f1824148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f1824148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 -- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 msgr2=0x7f18241ec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18241ec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 -- 172.21.15.81:0/3330954210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814009420 con 0x7f18241501e0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f1823fff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f181c00efc0 tx=0x7f181c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c009ba0 con 0x7f18241501e0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c00f040 con 0x7f18241501e0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1824150740 con 0x7f18241501e0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0146c0 con 0x7f18241501e0 2024-05-08T20:27:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18241447d0 con 0x7f18241501e0 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18240696a0 con 0x7f18241501e0 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f181c014820 con 0x7f18241501e0 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.023+0000 7f181bfff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 0x7f1804068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.027+0000 7f18237fe640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 0x7f1804068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.027+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f181c084dd0 con 0x7f18241501e0 2024-05-08T20:27:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.027+0000 7f18237fe640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 0x7f1804068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f70 tx=0x7f180c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.031+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f181c0520c0 con 0x7f18241501e0 2024-05-08T20:27:23.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.179+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1824074950 con 0x7f18241501e0 2024-05-08T20:27:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.179+0000 7f181bfff640 1 -- 172.21.15.81:0/3330954210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16017 (secure 0 0 0) 0x7f181c018090 con 0x7f18241501e0 2024-05-08T20:27:23.186 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:23.186 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:19.868877+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 msgr2=0x7f1804068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 0x7f1804068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f70 tx=0x7f180c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 msgr2=0x7f18241460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f181c00efc0 tx=0x7f181c00c490 comp rx=0 tx=0).stop 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 shutdown_connections 2024-05-08T20:27:23.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1804066690 0x7f1804068b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18241501e0 0x7f18241460c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18240725f0 0x7f18241ec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 --2- 172.21.15.81:0/3330954210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f182406f400 0x7f1824148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 >> 172.21.15.81:0/3330954210 conn(0x7f18240c2ca0 msgr2=0x7f182406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 shutdown_connections 2024-05-08T20:27:23.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.183+0000 7f182a0ff640 1 -- 172.21.15.81:0/3330954210 wait complete. 2024-05-08T20:27:23.203 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T20:27:23.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 Processor -- start 2024-05-08T20:27:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 -- start start 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 0x7fc24806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc24806f400 0x7fc2480c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2480c0650 con 0x7fc2480725f0 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24806fd60 con 0x7fc24806f400 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.315+0000 7fc2500fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc248072180 con 0x7fc2481501e0 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2480725f0 0x7fc2480c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52752/0 (socket says 172.21.15.81:52752) 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 -- 172.21.15.81:0/3984855239 learned_addr learned my addr 172.21.15.81:0/3984855239 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24e69a640 1 --2- 172.21.15.81:0/3984855239 >> v2:172.21.15.117:3300/0 conn(0x7fc24806f400 0x7fc2480c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24de99640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 0x7fc24806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396551282 0 0) 0x7fc2480c0650 con 0x7fc2480725f0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc234003530 con 0x7fc2480725f0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063855912 0 0) 0x7fc234003530 con 0x7fc2480725f0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 msgr2=0x7fc24806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 0x7fc24806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 >> v2:172.21.15.117:3300/0 conn(0x7fc24806f400 msgr2=0x7fc2480c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 --2- 172.21.15.81:0/3984855239 >> v2:172.21.15.117:3300/0 conn(0x7fc24806f400 0x7fc2480c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24806fa80 con 0x7fc2480725f0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc238001680 con 0x7fc2480725f0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 >> v1:172.21.15.81:6789/0 conn(0x7fc2480725f0 legacy=0x7fc2480c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc234003980 0x7fc234003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2340047d0 0x7fc234004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 0x7fc234005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24806fd60 con 0x7fc2340047d0 2024-05-08T20:27:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248072180 con 0x7fc234003980 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23400ba10 con 0x7fc2481501e0 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2340047d0 0x7fc234004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24de99640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc234003980 0x7fc234003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 -- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 msgr2=0x7fc234005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2481501e0 0x7fc234005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 -- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc234003980 msgr2=0x7fc234003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc234003980 0x7fc234003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 -- 172.21.15.81:0/3984855239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234003530 con 0x7fc2340047d0 2024-05-08T20:27:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24d698640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2340047d0 0x7fc234004c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23800c290 tx=0x7fc23801ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdd1d9cbe15bbe5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380a5940 con 0x7fc2340047d0 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2380a5aa0 con 0x7fc2340047d0 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.319+0000 7fc24ce97640 1 -- 172.21.15.81:0/3984855239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380a5c50 con 0x7fc2340047d0 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/3984855239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2340047d0 msgr2=0x7fc234004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 --2- 172.21.15.81:0/3984855239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2340047d0 0x7fc234004c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc23800c290 tx=0x7fc23801ccd0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 -- 172.21.15.81:0/3984855239 reap_dead start 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/3984855239 shutdown_connections 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/3984855239 >> 172.21.15.81:0/3984855239 conn(0x7fc2480c2ca0 msgr2=0x7fc2480c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/3984855239 shutdown_connections 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/3984855239 wait complete. 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 Processor -- start 2024-05-08T20:27:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- start start 2024-05-08T20:27:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340047d0 0x7fc2481edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2481f0780 0x7fc2480c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481f0cf0 con 0x7fc2481508d0 2024-05-08T20:27:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481ecb50 con 0x7fc2481f0780 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481ec800 con 0x7fc2340047d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54998/0 (socket says 172.21.15.81:54998) 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 -- 172.21.15.81:0/973889399 learned_addr learned my addr 172.21.15.81:0/973889399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 -- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340047d0 msgr2=0x7fc2481edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340047d0 0x7fc2481edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 -- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2481f0780 msgr2=0x7fc2480c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2481f0780 0x7fc2480c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 -- 172.21.15.81:0/973889399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248150740 con 0x7fc2481508d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc24e69a640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc24806ec10 tx=0x7fc24000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240010040 con 0x7fc2481508d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000bce0 con 0x7fc2481508d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24815bc70 con 0x7fc2481508d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240014640 con 0x7fc2481508d0 2024-05-08T20:27:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2480c23c0 con 0x7fc2481508d0 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.323+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2481ec970 con 0x7fc2481508d0 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.327+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2400147a0 con 0x7fc2481508d0 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.327+0000 7fc23e7fc640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 0x7fc22c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.327+0000 7fc24de99640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 0x7fc22c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.327+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fc240084890 con 0x7fc2481508d0 2024-05-08T20:27:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.327+0000 7fc24de99640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 0x7fc22c068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc24814ae00 tx=0x7fc244008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.331+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc240051ca0 con 0x7fc2481508d0 2024-05-08T20:27:23.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.483+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2481eccc0 con 0x7fc22c0666c0 2024-05-08T20:27:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.495+0000 7fc23e7fc640 1 -- 172.21.15.81:0/973889399 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264622 (secure 0 0 0) 0x7fc2481eccc0 con 0x7fc22c0666c0 2024-05-08T20:27:23.504 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:23.506 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 msgr2=0x7fc22c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 0x7fc22c068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc24814ae00 tx=0x7fc244008040 comp rx=0 tx=0).stop 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 msgr2=0x7fc2481ecfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc24806ec10 tx=0x7fc24000b480 comp rx=0 tx=0).stop 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 shutdown_connections 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc22c0666c0 0x7fc22c068b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2481508d0 0x7fc2481ecfe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2481f0780 0x7fc2480c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 --2- 172.21.15.81:0/973889399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2340047d0 0x7fc2481edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 >> 172.21.15.81:0/973889399 conn(0x7fc2480c2ca0 msgr2=0x7fc24815c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 shutdown_connections 2024-05-08T20:27:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.499+0000 7fc2500fd640 1 -- 172.21.15.81:0/973889399 wait complete. 2024-05-08T20:27:23.522 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T20:27:23.224724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2887680,"data_stored":1750985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743603"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627495+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:20.627495+0000","last_peered":"2024-05-08T20:27:20.627495+0000","last_clean":"2024-05-08T20:27:20.627495+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:20.627495+0000","last_undegraded":"2024-05-08T20:27:20.627495+0000","last_fullsized":"2024-05-08T20:27:20.627495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626121+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:20.626121+0000","last_peered":"2024-05-08T20:27:20.626121+0000","last_clean":"2024-05-08T20:27:20.626121+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:20.626121+0000","last_undegraded":"2024-05-08T20:27:20.626121+0000","last_fullsized":"2024-05-08T20:27:20.626121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626836+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:20.626836+0000","last_peered":"2024-05-08T20:27:20.626836+0000","last_clean":"2024-05-08T20:27:20.626836+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:20.626836+0000","last_undegraded":"2024-05-08T20:27:20.626836+0000","last_fullsized":"2024-05-08T20:27:20.626836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885108+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:19.885108+0000","last_peered":"2024-05-08T20:27:19.885108+0000","last_clean":"2024-05-08T20:27:19.885108+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:19.885108+0000","last_undegraded":"2024-05-08T20:27:19.885108+0000","last_fullsized":"2024-05-08T20:27:19.885108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627148+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:20.627148+0000","last_peered":"2024-05-08T20:27:20.627148+0000","last_clean":"2024-05-08T20:27:20.627148+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:20.627148+0000","last_undegraded":"2024-05-08T20:27:20.627148+0000","last_fullsized":"2024-05-08T20:27:20.627148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884843+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:19.884843+0000","last_peered":"2024-05-08T20:27:19.884843+0000","last_clean":"2024-05-08T20:27:19.884843+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:19.884843+0000","last_undegraded":"2024-05-08T20:27:19.884843+0000","last_fullsized":"2024-05-08T20:27:19.884843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626486+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:20.626486+0000","last_peered":"2024-05-08T20:27:20.626486+0000","last_clean":"2024-05-08T20:27:20.626486+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:20.626486+0000","last_undegraded":"2024-05-08T20:27:20.626486+0000","last_fullsized":"2024-05-08T20:27:20.626486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624796+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:20.624796+0000","last_peered":"2024-05-08T20:27:20.624796+0000","last_clean":"2024-05-08T20:27:20.624796+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:20.624796+0000","last_undegraded":"2024-05-08T20:27:20.624796+0000","last_fullsized":"2024-05-08T20:27:20.624796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627508+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:20.627508+0000","last_peered":"2024-05-08T20:27:20.627508+0000","last_clean":"2024-05-08T20:27:20.627508+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:20.627508+0000","last_undegraded":"2024-05-08T20:27:20.627508+0000","last_fullsized":"2024-05-08T20:27:20.627508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886298+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:19.886298+0000","last_peered":"2024-05-08T20:27:19.886298+0000","last_clean":"2024-05-08T20:27:19.886298+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:19.886298+0000","last_undegraded":"2024-05-08T20:27:19.886298+0000","last_fullsized":"2024-05-08T20:27:19.886298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886070+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:19.886070+0000","last_peered":"2024-05-08T20:27:19.886070+0000","last_clean":"2024-05-08T20:27:19.886070+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:19.886070+0000","last_undegraded":"2024-05-08T20:27:19.886070+0000","last_fullsized":"2024-05-08T20:27:19.886070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887484+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:19.887484+0000","last_peered":"2024-05-08T20:27:19.887484+0000","last_clean":"2024-05-08T20:27:19.887484+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:19.887484+0000","last_undegraded":"2024-05-08T20:27:19.887484+0000","last_fullsized":"2024-05-08T20:27:19.887484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625237+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:20.625237+0000","last_peered":"2024-05-08T20:27:20.625237+0000","last_clean":"2024-05-08T20:27:20.625237+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:20.625237+0000","last_undegraded":"2024-05-08T20:27:20.625237+0000","last_fullsized":"2024-05-08T20:27:20.625237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626642+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:20.626642+0000","last_peered":"2024-05-08T20:27:20.626642+0000","last_clean":"2024-05-08T20:27:20.626642+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:20.626642+0000","last_undegraded":"2024-05-08T20:27:20.626642+0000","last_fullsized":"2024-05-08T20:27:20.626642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626013+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:20.626013+0000","last_peered":"2024-05-08T20:27:20.626013+0000","last_clean":"2024-05-08T20:27:20.626013+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:20.626013+0000","last_undegraded":"2024-05-08T20:27:20.626013+0000","last_fullsized":"2024-05-08T20:27:20.626013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884253+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:19.884253+0000","last_peered":"2024-05-08T20:27:19.884253+0000","last_clean":"2024-05-08T20:27:19.884253+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:19.884253+0000","last_undegraded":"2024-05-08T20:27:19.884253+0000","last_fullsized":"2024-05-08T20:27:19.884253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.888079+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:19.888079+0000","last_peered":"2024-05-08T20:27:19.888079+0000","last_clean":"2024-05-08T20:27:19.888079+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:19.888079+0000","last_undegraded":"2024-05-08T20:27:19.888079+0000","last_fullsized":"2024-05-08T20:27:19.888079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126684+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:20.126684+0000","last_peered":"2024-05-08T20:27:20.126684+0000","last_clean":"2024-05-08T20:27:20.126684+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:20.126684+0000","last_undegraded":"2024-05-08T20:27:20.126684+0000","last_fullsized":"2024-05-08T20:27:20.126684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627501+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:20.627501+0000","last_peered":"2024-05-08T20:27:20.627501+0000","last_clean":"2024-05-08T20:27:20.627501+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:20.627501+0000","last_undegraded":"2024-05-08T20:27:20.627501+0000","last_fullsized":"2024-05-08T20:27:20.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885598+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:19.885598+0000","last_peered":"2024-05-08T20:27:19.885598+0000","last_clean":"2024-05-08T20:27:19.885598+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:19.885598+0000","last_undegraded":"2024-05-08T20:27:19.885598+0000","last_fullsized":"2024-05-08T20:27:19.885598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626569+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:20.626569+0000","last_peered":"2024-05-08T20:27:20.626569+0000","last_clean":"2024-05-08T20:27:20.626569+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:20.626569+0000","last_undegraded":"2024-05-08T20:27:20.626569+0000","last_fullsized":"2024-05-08T20:27:20.626569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885728+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:19.885728+0000","last_peered":"2024-05-08T20:27:19.885728+0000","last_clean":"2024-05-08T20:27:19.885728+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:19.885728+0000","last_undegraded":"2024-05-08T20:27:19.885728+0000","last_fullsized":"2024-05-08T20:27:19.885728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624947+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:20.624947+0000","last_peered":"2024-05-08T20:27:20.624947+0000","last_clean":"2024-05-08T20:27:20.624947+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:20.624947+0000","last_undegraded":"2024-05-08T20:27:20.624947+0000","last_fullsized":"2024-05-08T20:27:20.624947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884520+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:19.884520+0000","last_peered":"2024-05-08T20:27:19.884520+0000","last_clean":"2024-05-08T20:27:19.884520+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:19.884520+0000","last_undegraded":"2024-05-08T20:27:19.884520+0000","last_fullsized":"2024-05-08T20:27:19.884520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625165+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:20.625165+0000","last_peered":"2024-05-08T20:27:20.625165+0000","last_clean":"2024-05-08T20:27:20.625165+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:20.625165+0000","last_undegraded":"2024-05-08T20:27:20.625165+0000","last_fullsized":"2024-05-08T20:27:20.625165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886546+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:19.886546+0000","last_peered":"2024-05-08T20:27:19.886546+0000","last_clean":"2024-05-08T20:27:19.886546+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:19.886546+0000","last_undegraded":"2024-05-08T20:27:19.886546+0000","last_fullsized":"2024-05-08T20:27:19.886546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626378+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:20.626378+0000","last_peered":"2024-05-08T20:27:20.626378+0000","last_clean":"2024-05-08T20:27:20.626378+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:20.626378+0000","last_undegraded":"2024-05-08T20:27:20.626378+0000","last_fullsized":"2024-05-08T20:27:20.626378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625261+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:20.625261+0000","last_peered":"2024-05-08T20:27:20.625261+0000","last_clean":"2024-05-08T20:27:20.625261+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:20.625261+0000","last_undegraded":"2024-05-08T20:27:20.625261+0000","last_fullsized":"2024-05-08T20:27:20.625261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626681+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:20.626681+0000","last_peered":"2024-05-08T20:27:20.626681+0000","last_clean":"2024-05-08T20:27:20.626681+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:20.626681+0000","last_undegraded":"2024-05-08T20:27:20.626681+0000","last_fullsized":"2024-05-08T20:27:20.626681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885099+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:19.885099+0000","last_peered":"2024-05-08T20:27:19.885099+0000","last_clean":"2024-05-08T20:27:19.885099+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:19.885099+0000","last_undegraded":"2024-05-08T20:27:19.885099+0000","last_fullsized":"2024-05-08T20:27:19.885099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126397+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:20.126397+0000","last_peered":"2024-05-08T20:27:20.126397+0000","last_clean":"2024-05-08T20:27:20.126397+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:20.126397+0000","last_undegraded":"2024-05-08T20:27:20.126397+0000","last_fullsized":"2024-05-08T20:27:20.126397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884481+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:19.884481+0000","last_peered":"2024-05-08T20:27:19.884481+0000","last_clean":"2024-05-08T20:27:19.884481+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:19.884481+0000","last_undegraded":"2024-05-08T20:27:19.884481+0000","last_fullsized":"2024-05-08T20:27:19.884481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886154+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:19.886154+0000","last_peered":"2024-05-08T20:27:19.886154+0000","last_clean":"2024-05-08T20:27:19.886154+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:19.886154+0000","last_undegraded":"2024-05-08T20:27:19.886154+0000","last_fullsized":"2024-05-08T20:27:19.886154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625443+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:20.625443+0000","last_peered":"2024-05-08T20:27:20.625443+0000","last_clean":"2024-05-08T20:27:20.625443+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:20.625443+0000","last_undegraded":"2024-05-08T20:27:20.625443+0000","last_fullsized":"2024-05-08T20:27:20.625443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627098+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:20.627098+0000","last_peered":"2024-05-08T20:27:20.627098+0000","last_clean":"2024-05-08T20:27:20.627098+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:20.627098+0000","last_undegraded":"2024-05-08T20:27:20.627098+0000","last_fullsized":"2024-05-08T20:27:20.627098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885569+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:19.885569+0000","last_peered":"2024-05-08T20:27:19.885569+0000","last_clean":"2024-05-08T20:27:19.885569+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:19.885569+0000","last_undegraded":"2024-05-08T20:27:19.885569+0000","last_fullsized":"2024-05-08T20:27:19.885569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625030+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:20.625030+0000","last_peered":"2024-05-08T20:27:20.625030+0000","last_clean":"2024-05-08T20:27:20.625030+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:20.625030+0000","last_undegraded":"2024-05-08T20:27:20.625030+0000","last_fullsized":"2024-05-08T20:27:20.625030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624907+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:20.624907+0000","last_peered":"2024-05-08T20:27:20.624907+0000","last_clean":"2024-05-08T20:27:20.624907+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:20.624907+0000","last_undegraded":"2024-05-08T20:27:20.624907+0000","last_fullsized":"2024-05-08T20:27:20.624907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884746+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:19.884746+0000","last_peered":"2024-05-08T20:27:19.884746+0000","last_clean":"2024-05-08T20:27:19.884746+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:19.884746+0000","last_undegraded":"2024-05-08T20:27:19.884746+0000","last_fullsized":"2024-05-08T20:27:19.884746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625733+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:20.625733+0000","last_peered":"2024-05-08T20:27:20.625733+0000","last_clean":"2024-05-08T20:27:20.625733+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:20.625733+0000","last_undegraded":"2024-05-08T20:27:20.625733+0000","last_fullsized":"2024-05-08T20:27:20.625733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886294+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:19.886294+0000","last_peered":"2024-05-08T20:27:19.886294+0000","last_clean":"2024-05-08T20:27:19.886294+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:19.886294+0000","last_undegraded":"2024-05-08T20:27:19.886294+0000","last_fullsized":"2024-05-08T20:27:19.886294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887995+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:19.887995+0000","last_peered":"2024-05-08T20:27:19.887995+0000","last_clean":"2024-05-08T20:27:19.887995+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:19.887995+0000","last_undegraded":"2024-05-08T20:27:19.887995+0000","last_fullsized":"2024-05-08T20:27:19.887995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.888246+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:19.888246+0000","last_peered":"2024-05-08T20:27:19.888246+0000","last_clean":"2024-05-08T20:27:19.888246+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:19.888246+0000","last_undegraded":"2024-05-08T20:27:19.888246+0000","last_fullsized":"2024-05-08T20:27:19.888246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626931+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:20.626931+0000","last_peered":"2024-05-08T20:27:20.626931+0000","last_clean":"2024-05-08T20:27:20.626931+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:20.626931+0000","last_undegraded":"2024-05-08T20:27:20.626931+0000","last_fullsized":"2024-05-08T20:27:20.626931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626595+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:20.626595+0000","last_peered":"2024-05-08T20:27:20.626595+0000","last_clean":"2024-05-08T20:27:20.626595+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:20.626595+0000","last_undegraded":"2024-05-08T20:27:20.626595+0000","last_fullsized":"2024-05-08T20:27:20.626595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887665+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:19.887665+0000","last_peered":"2024-05-08T20:27:19.887665+0000","last_clean":"2024-05-08T20:27:19.887665+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:19.887665+0000","last_undegraded":"2024-05-08T20:27:19.887665+0000","last_fullsized":"2024-05-08T20:27:19.887665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885856+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:19.885856+0000","last_peered":"2024-05-08T20:27:19.885856+0000","last_clean":"2024-05-08T20:27:19.885856+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:19.885856+0000","last_undegraded":"2024-05-08T20:27:19.885856+0000","last_fullsized":"2024-05-08T20:27:19.885856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627218+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:20.627218+0000","last_peered":"2024-05-08T20:27:20.627218+0000","last_clean":"2024-05-08T20:27:20.627218+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:20.627218+0000","last_undegraded":"2024-05-08T20:27:20.627218+0000","last_fullsized":"2024-05-08T20:27:20.627218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627040+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:20.627040+0000","last_peered":"2024-05-08T20:27:20.627040+0000","last_clean":"2024-05-08T20:27:20.627040+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:20.627040+0000","last_undegraded":"2024-05-08T20:27:20.627040+0000","last_fullsized":"2024-05-08T20:27:20.627040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626714+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:20.626714+0000","last_peered":"2024-05-08T20:27:20.626714+0000","last_clean":"2024-05-08T20:27:20.626714+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:20.626714+0000","last_undegraded":"2024-05-08T20:27:20.626714+0000","last_fullsized":"2024-05-08T20:27:20.626714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885291+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:19.885291+0000","last_peered":"2024-05-08T20:27:19.885291+0000","last_clean":"2024-05-08T20:27:19.885291+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:19.885291+0000","last_undegraded":"2024-05-08T20:27:19.885291+0000","last_fullsized":"2024-05-08T20:27:19.885291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627248+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:20.627248+0000","last_peered":"2024-05-08T20:27:20.627248+0000","last_clean":"2024-05-08T20:27:20.627248+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:20.627248+0000","last_undegraded":"2024-05-08T20:27:20.627248+0000","last_fullsized":"2024-05-08T20:27:20.627248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885683+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:19.885683+0000","last_peered":"2024-05-08T20:27:19.885683+0000","last_clean":"2024-05-08T20:27:19.885683+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:19.885683+0000","last_undegraded":"2024-05-08T20:27:19.885683+0000","last_fullsized":"2024-05-08T20:27:19.885683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885488+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:19.885488+0000","last_peered":"2024-05-08T20:27:19.885488+0000","last_clean":"2024-05-08T20:27:19.885488+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:19.885488+0000","last_undegraded":"2024-05-08T20:27:19.885488+0000","last_fullsized":"2024-05-08T20:27:19.885488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126364+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:20.126364+0000","last_peered":"2024-05-08T20:27:20.126364+0000","last_clean":"2024-05-08T20:27:20.126364+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:20.126364+0000","last_undegraded":"2024-05-08T20:27:20.126364+0000","last_fullsized":"2024-05-08T20:27:20.126364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626532+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:20.626532+0000","last_peered":"2024-05-08T20:27:20.626532+0000","last_clean":"2024-05-08T20:27:20.626532+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:20.626532+0000","last_undegraded":"2024-05-08T20:27:20.626532+0000","last_fullsized":"2024-05-08T20:27:20.626532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887597+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:19.887597+0000","last_peered":"2024-05-08T20:27:19.887597+0000","last_clean":"2024-05-08T20:27:19.887597+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:19.887597+0000","last_undegraded":"2024-05-08T20:27:19.887597+0000","last_fullsized":"2024-05-08T20:27:19.887597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627136+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:20.627136+0000","last_peered":"2024-05-08T20:27:20.627136+0000","last_clean":"2024-05-08T20:27:20.627136+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:20.627136+0000","last_undegraded":"2024-05-08T20:27:20.627136+0000","last_fullsized":"2024-05-08T20:27:20.627136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126729+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:20.126729+0000","last_peered":"2024-05-08T20:27:20.126729+0000","last_clean":"2024-05-08T20:27:20.126729+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:20.126729+0000","last_undegraded":"2024-05-08T20:27:20.126729+0000","last_fullsized":"2024-05-08T20:27:20.126729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627672+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:20.627672+0000","last_peered":"2024-05-08T20:27:20.627672+0000","last_clean":"2024-05-08T20:27:20.627672+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:20.627672+0000","last_undegraded":"2024-05-08T20:27:20.627672+0000","last_fullsized":"2024-05-08T20:27:20.627672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626807+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:20.626807+0000","last_peered":"2024-05-08T20:27:20.626807+0000","last_clean":"2024-05-08T20:27:20.626807+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:20.626807+0000","last_undegraded":"2024-05-08T20:27:20.626807+0000","last_fullsized":"2024-05-08T20:27:20.626807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885367+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:19.885367+0000","last_peered":"2024-05-08T20:27:19.885367+0000","last_clean":"2024-05-08T20:27:19.885367+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:19.885367+0000","last_undegraded":"2024-05-08T20:27:19.885367+0000","last_fullsized":"2024-05-08T20:27:19.885367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126524+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:20.126524+0000","last_peered":"2024-05-08T20:27:20.126524+0000","last_clean":"2024-05-08T20:27:20.126524+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:20.126524+0000","last_undegraded":"2024-05-08T20:27:20.126524+0000","last_fullsized":"2024-05-08T20:27:20.126524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627123+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:20.627123+0000","last_peered":"2024-05-08T20:27:20.627123+0000","last_clean":"2024-05-08T20:27:20.627123+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:20.627123+0000","last_undegraded":"2024-05-08T20:27:20.627123+0000","last_fullsized":"2024-05-08T20:27:20.627123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:27:18.885391+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:18.885391+0000","last_peered":"2024-05-08T20:27:18.885391+0000","last_clean":"2024-05-08T20:27:18.885391+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:18.885391+0000","last_undegraded":"2024-05-08T20:27:18.885391+0000","last_fullsized":"2024-05-08T20:27:18.885391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885604+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:19.885604+0000","last_peered":"2024-05-08T20:27:19.885604+0000","last_clean":"2024-05-08T20:27:19.885604+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:19.885604+0000","last_undegraded":"2024-05-08T20:27:19.885604+0000","last_fullsized":"2024-05-08T20:27:19.885604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626087+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:20.626087+0000","last_peered":"2024-05-08T20:27:20.626087+0000","last_clean":"2024-05-08T20:27:20.626087+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:20.626087+0000","last_undegraded":"2024-05-08T20:27:20.626087+0000","last_fullsized":"2024-05-08T20:27:20.626087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:20.626369+0000","last_peered":"2024-05-08T20:27:20.626369+0000","last_clean":"2024-05-08T20:27:20.626369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:20.626369+0000","last_undegraded":"2024-05-08T20:27:20.626369+0000","last_fullsized":"2024-05-08T20:27:20.626369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626520+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:20.626520+0000","last_peered":"2024-05-08T20:27:20.626520+0000","last_clean":"2024-05-08T20:27:20.626520+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:20.626520+0000","last_undegraded":"2024-05-08T20:27:20.626520+0000","last_fullsized":"2024-05-08T20:27:20.626520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126579+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:20.126579+0000","last_peered":"2024-05-08T20:27:20.126579+0000","last_clean":"2024-05-08T20:27:20.126579+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:20.126579+0000","last_undegraded":"2024-05-08T20:27:20.126579+0000","last_fullsized":"2024-05-08T20:27:20.126579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625752+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:20.625752+0000","last_peered":"2024-05-08T20:27:20.625752+0000","last_clean":"2024-05-08T20:27:20.625752+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:20.625752+0000","last_undegraded":"2024-05-08T20:27:20.625752+0000","last_fullsized":"2024-05-08T20:27:20.625752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885500+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:19.885500+0000","last_peered":"2024-05-08T20:27:19.885500+0000","last_clean":"2024-05-08T20:27:19.885500+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:19.885500+0000","last_undegraded":"2024-05-08T20:27:19.885500+0000","last_fullsized":"2024-05-08T20:27:19.885500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887029+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:19.887029+0000","last_peered":"2024-05-08T20:27:19.887029+0000","last_clean":"2024-05-08T20:27:19.887029+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:19.887029+0000","last_undegraded":"2024-05-08T20:27:19.887029+0000","last_fullsized":"2024-05-08T20:27:19.887029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625910+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:20.625910+0000","last_peered":"2024-05-08T20:27:20.625910+0000","last_clean":"2024-05-08T20:27:20.625910+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:20.625910+0000","last_undegraded":"2024-05-08T20:27:20.625910+0000","last_fullsized":"2024-05-08T20:27:20.625910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887430+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:19.887430+0000","last_peered":"2024-05-08T20:27:19.887430+0000","last_clean":"2024-05-08T20:27:19.887430+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:19.887430+0000","last_undegraded":"2024-05-08T20:27:19.887430+0000","last_fullsized":"2024-05-08T20:27:19.887430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627451+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:20.627451+0000","last_peered":"2024-05-08T20:27:20.627451+0000","last_clean":"2024-05-08T20:27:20.627451+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:20.627451+0000","last_undegraded":"2024-05-08T20:27:20.627451+0000","last_fullsized":"2024-05-08T20:27:20.627451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625828+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:20.625828+0000","last_peered":"2024-05-08T20:27:20.625828+0000","last_clean":"2024-05-08T20:27:20.625828+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:20.625828+0000","last_undegraded":"2024-05-08T20:27:20.625828+0000","last_fullsized":"2024-05-08T20:27:20.625828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625996+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:20.625996+0000","last_peered":"2024-05-08T20:27:20.625996+0000","last_clean":"2024-05-08T20:27:20.625996+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:20.625996+0000","last_undegraded":"2024-05-08T20:27:20.625996+0000","last_fullsized":"2024-05-08T20:27:20.625996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625988+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:20.625988+0000","last_peered":"2024-05-08T20:27:20.625988+0000","last_clean":"2024-05-08T20:27:20.625988+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:20.625988+0000","last_undegraded":"2024-05-08T20:27:20.625988+0000","last_fullsized":"2024-05-08T20:27:20.625988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886530+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:19.886530+0000","last_peered":"2024-05-08T20:27:19.886530+0000","last_clean":"2024-05-08T20:27:19.886530+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:19.886530+0000","last_undegraded":"2024-05-08T20:27:19.886530+0000","last_fullsized":"2024-05-08T20:27:19.886530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626895+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:20.626895+0000","last_peered":"2024-05-08T20:27:20.626895+0000","last_clean":"2024-05-08T20:27:20.626895+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:20.626895+0000","last_undegraded":"2024-05-08T20:27:20.626895+0000","last_fullsized":"2024-05-08T20:27:20.626895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626375+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:20.626375+0000","last_peered":"2024-05-08T20:27:20.626375+0000","last_clean":"2024-05-08T20:27:20.626375+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:20.626375+0000","last_undegraded":"2024-05-08T20:27:20.626375+0000","last_fullsized":"2024-05-08T20:27:20.626375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886914+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:19.886914+0000","last_peered":"2024-05-08T20:27:19.886914+0000","last_clean":"2024-05-08T20:27:19.886914+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:19.886914+0000","last_undegraded":"2024-05-08T20:27:19.886914+0000","last_fullsized":"2024-05-08T20:27:19.886914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625870+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:20.625870+0000","last_peered":"2024-05-08T20:27:20.625870+0000","last_clean":"2024-05-08T20:27:20.625870+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:20.625870+0000","last_undegraded":"2024-05-08T20:27:20.625870+0000","last_fullsized":"2024-05-08T20:27:20.625870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624950+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:20.624950+0000","last_peered":"2024-05-08T20:27:20.624950+0000","last_clean":"2024-05-08T20:27:20.624950+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:20.624950+0000","last_undegraded":"2024-05-08T20:27:20.624950+0000","last_fullsized":"2024-05-08T20:27:20.624950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626004+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:20.626004+0000","last_peered":"2024-05-08T20:27:20.626004+0000","last_clean":"2024-05-08T20:27:20.626004+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:20.626004+0000","last_undegraded":"2024-05-08T20:27:20.626004+0000","last_fullsized":"2024-05-08T20:27:20.626004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625358+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:20.625358+0000","last_peered":"2024-05-08T20:27:20.625358+0000","last_clean":"2024-05-08T20:27:20.625358+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:20.625358+0000","last_undegraded":"2024-05-08T20:27:20.625358+0000","last_fullsized":"2024-05-08T20:27:20.625358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627370+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:20.627370+0000","last_peered":"2024-05-08T20:27:20.627370+0000","last_clean":"2024-05-08T20:27:20.627370+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:20.627370+0000","last_undegraded":"2024-05-08T20:27:20.627370+0000","last_fullsized":"2024-05-08T20:27:20.627370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885309+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:19.885309+0000","last_peered":"2024-05-08T20:27:19.885309+0000","last_clean":"2024-05-08T20:27:19.885309+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:19.885309+0000","last_undegraded":"2024-05-08T20:27:19.885309+0000","last_fullsized":"2024-05-08T20:27:19.885309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887202+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:19.887202+0000","last_peered":"2024-05-08T20:27:19.887202+0000","last_clean":"2024-05-08T20:27:19.887202+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:19.887202+0000","last_undegraded":"2024-05-08T20:27:19.887202+0000","last_fullsized":"2024-05-08T20:27:19.887202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626939+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:20.626939+0000","last_peered":"2024-05-08T20:27:20.626939+0000","last_clean":"2024-05-08T20:27:20.626939+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:20.626939+0000","last_undegraded":"2024-05-08T20:27:20.626939+0000","last_fullsized":"2024-05-08T20:27:20.626939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885164+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:19.885164+0000","last_peered":"2024-05-08T20:27:19.885164+0000","last_clean":"2024-05-08T20:27:19.885164+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:19.885164+0000","last_undegraded":"2024-05-08T20:27:19.885164+0000","last_fullsized":"2024-05-08T20:27:19.885164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627327+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:20.627327+0000","last_peered":"2024-05-08T20:27:20.627327+0000","last_clean":"2024-05-08T20:27:20.627327+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:20.627327+0000","last_undegraded":"2024-05-08T20:27:20.627327+0000","last_fullsized":"2024-05-08T20:27:20.627327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626892+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:20.626892+0000","last_peered":"2024-05-08T20:27:20.626892+0000","last_clean":"2024-05-08T20:27:20.626892+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:20.626892+0000","last_undegraded":"2024-05-08T20:27:20.626892+0000","last_fullsized":"2024-05-08T20:27:20.626892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625877+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:20.625877+0000","last_peered":"2024-05-08T20:27:20.625877+0000","last_clean":"2024-05-08T20:27:20.625877+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:20.625877+0000","last_undegraded":"2024-05-08T20:27:20.625877+0000","last_fullsized":"2024-05-08T20:27:20.625877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625735+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:20.625735+0000","last_peered":"2024-05-08T20:27:20.625735+0000","last_clean":"2024-05-08T20:27:20.625735+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:20.625735+0000","last_undegraded":"2024-05-08T20:27:20.625735+0000","last_fullsized":"2024-05-08T20:27:20.625735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626957+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:20.626957+0000","last_peered":"2024-05-08T20:27:20.626957+0000","last_clean":"2024-05-08T20:27:20.626957+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:20.626957+0000","last_undegraded":"2024-05-08T20:27:20.626957+0000","last_fullsized":"2024-05-08T20:27:20.626957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":660805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:23.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.683+0000 7f6731ae6640 1 Processor -- start 2024-05-08T20:27:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.683+0000 7f6731ae6640 1 -- start start 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f6731ae6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f6731ae6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f672c06f400 0x7f672c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f6731ae6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0c0650 con 0x7f672c0725f0 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f6731ae6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c06fd60 con 0x7f672c06f400 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f6731ae6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c072180 con 0x7f672c1501e0 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f672c06f400 0x7f672c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f672c0725f0 0x7f672c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38158/0 (socket says 172.21.15.81:38158) 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672affd640 1 -- 172.21.15.81:0/3919403798 learned_addr learned my addr 172.21.15.81:0/3919403798 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672b7fe640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672a7fc640 1 -- 172.21.15.81:0/3919403798 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926817751 0 0) 0x7f672c0c0650 con 0x7f672c0725f0 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672a7fc640 1 -- 172.21.15.81:0/3919403798 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6714003530 con 0x7f672c0725f0 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 -- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 msgr2=0x7f672c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 -- 172.21.15.81:0/3919403798 >> v1:172.21.15.117:6789/0 conn(0x7f672c0725f0 legacy=0x7f672c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 -- 172.21.15.81:0/3919403798 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c06fa80 con 0x7f672c06f400 2024-05-08T20:27:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672b7fe640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672bfff640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c06f400 0x7f672c0c2350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6724009d90 tx=0x7f672401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a49843737ea01c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672a7fc640 1 -- 172.21.15.81:0/3919403798 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240a5900 con 0x7f672c06f400 2024-05-08T20:27:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672a7fc640 1 -- 172.21.15.81:0/3919403798 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67240a5a60 con 0x7f672c06f400 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.687+0000 7f672a7fc640 1 -- 172.21.15.81:0/3919403798 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240a5dd0 con 0x7f672c06f400 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c06f400 msgr2=0x7f672c0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c06f400 0x7f672c0c2350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6724009d90 tx=0x7f672401c820 comp rx=0 tx=0).stop 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/3919403798 shutdown_connections 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c06f400 0x7f672c0c2350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- 172.21.15.81:0/3919403798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/3919403798 >> 172.21.15.81:0/3919403798 conn(0x7f672c0c2ca0 msgr2=0x7f672c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/3919403798 shutdown_connections 2024-05-08T20:27:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/3919403798 wait complete. 2024-05-08T20:27:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 Processor -- start 2024-05-08T20:27:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- start start 2024-05-08T20:27:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c0725f0 0x7f672c1382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c139a90 con 0x7f672c06f400 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c4960 con 0x7f672c0725f0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c4c40 con 0x7f672c1501e0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55002/0 (socket says 172.21.15.81:55002) 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 -- 172.21.15.81:0/619695893 learned_addr learned my addr 172.21.15.81:0/619695893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672affd640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c0725f0 0x7f672c1382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672bfff640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 -- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 msgr2=0x7f672c138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 -- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c0725f0 msgr2=0x7f672c1382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c0725f0 0x7f672c1382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 -- 172.21.15.81:0/619695893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720009420 con 0x7f672c06f400 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f672b7fe640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f672000ebe0 tx=0x7f672000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672000eee0 con 0x7f672c06f400 2024-05-08T20:27:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672000cc30 con 0x7f672c06f400 2024-05-08T20:27:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724009a70 con 0x7f672c06f400 2024-05-08T20:27:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720013470 con 0x7f672c06f400 2024-05-08T20:27:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c150740 con 0x7f672c06f400 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.691+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c137f20 con 0x7f672c06f400 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.695+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f67200135d0 con 0x7f672c06f400 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.695+0000 7f6713fff640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 0x7f6718068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.695+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f6720084870 con 0x7f672c06f400 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.695+0000 7f672affd640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 0x7f6718068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.695+0000 7f672affd640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 0x7f6718068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f672c13a010 tx=0x7f671c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.699+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6720051bf0 con 0x7f672c06f400 2024-05-08T20:27:23.800 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-05-08T20:27:23.795+0000 7f5571d60640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T20:27:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.847+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f672c1505c0 con 0x7f6718066690 2024-05-08T20:27:23.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.867+0000 7f6713fff640 1 -- 172.21.15.81:0/619695893 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264622 (secure 0 0 0) 0x7f671c001c90 con 0x7f6718066690 2024-05-08T20:27:23.873 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 msgr2=0x7f6718068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 0x7f6718068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f672c13a010 tx=0x7f671c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 msgr2=0x7f672c13a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f672000ebe0 tx=0x7f672000c520 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 shutdown_connections 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6718066690 0x7f6718068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f672c1501e0 0x7f672c138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f672c0725f0 0x7f672c1382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 --2- 172.21.15.81:0/619695893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f672c06f400 0x7f672c13a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 >> 172.21.15.81:0/619695893 conn(0x7f672c0c2ca0 msgr2=0x7f672c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 shutdown_connections 2024-05-08T20:27:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:23.871+0000 7f6731ae6640 1 -- 172.21.15.81:0/619695893 wait complete. 2024-05-08T20:27:23.892 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T20:27:23.224724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2887680,"data_stored":1750985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743603"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627495+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:20.627495+0000","last_peered":"2024-05-08T20:27:20.627495+0000","last_clean":"2024-05-08T20:27:20.627495+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:20.627495+0000","last_undegraded":"2024-05-08T20:27:20.627495+0000","last_fullsized":"2024-05-08T20:27:20.627495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626121+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:20.626121+0000","last_peered":"2024-05-08T20:27:20.626121+0000","last_clean":"2024-05-08T20:27:20.626121+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:20.626121+0000","last_undegraded":"2024-05-08T20:27:20.626121+0000","last_fullsized":"2024-05-08T20:27:20.626121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626836+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:20.626836+0000","last_peered":"2024-05-08T20:27:20.626836+0000","last_clean":"2024-05-08T20:27:20.626836+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:20.626836+0000","last_undegraded":"2024-05-08T20:27:20.626836+0000","last_fullsized":"2024-05-08T20:27:20.626836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885108+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:19.885108+0000","last_peered":"2024-05-08T20:27:19.885108+0000","last_clean":"2024-05-08T20:27:19.885108+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:19.885108+0000","last_undegraded":"2024-05-08T20:27:19.885108+0000","last_fullsized":"2024-05-08T20:27:19.885108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627148+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:20.627148+0000","last_peered":"2024-05-08T20:27:20.627148+0000","last_clean":"2024-05-08T20:27:20.627148+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:20.627148+0000","last_undegraded":"2024-05-08T20:27:20.627148+0000","last_fullsized":"2024-05-08T20:27:20.627148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884843+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:19.884843+0000","last_peered":"2024-05-08T20:27:19.884843+0000","last_clean":"2024-05-08T20:27:19.884843+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:19.884843+0000","last_undegraded":"2024-05-08T20:27:19.884843+0000","last_fullsized":"2024-05-08T20:27:19.884843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626486+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:20.626486+0000","last_peered":"2024-05-08T20:27:20.626486+0000","last_clean":"2024-05-08T20:27:20.626486+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:20.626486+0000","last_undegraded":"2024-05-08T20:27:20.626486+0000","last_fullsized":"2024-05-08T20:27:20.626486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624796+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:20.624796+0000","last_peered":"2024-05-08T20:27:20.624796+0000","last_clean":"2024-05-08T20:27:20.624796+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:20.624796+0000","last_undegraded":"2024-05-08T20:27:20.624796+0000","last_fullsized":"2024-05-08T20:27:20.624796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627508+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:20.627508+0000","last_peered":"2024-05-08T20:27:20.627508+0000","last_clean":"2024-05-08T20:27:20.627508+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:20.627508+0000","last_undegraded":"2024-05-08T20:27:20.627508+0000","last_fullsized":"2024-05-08T20:27:20.627508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886298+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:19.886298+0000","last_peered":"2024-05-08T20:27:19.886298+0000","last_clean":"2024-05-08T20:27:19.886298+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:19.886298+0000","last_undegraded":"2024-05-08T20:27:19.886298+0000","last_fullsized":"2024-05-08T20:27:19.886298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886070+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:19.886070+0000","last_peered":"2024-05-08T20:27:19.886070+0000","last_clean":"2024-05-08T20:27:19.886070+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:19.886070+0000","last_undegraded":"2024-05-08T20:27:19.886070+0000","last_fullsized":"2024-05-08T20:27:19.886070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887484+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:19.887484+0000","last_peered":"2024-05-08T20:27:19.887484+0000","last_clean":"2024-05-08T20:27:19.887484+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:19.887484+0000","last_undegraded":"2024-05-08T20:27:19.887484+0000","last_fullsized":"2024-05-08T20:27:19.887484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625237+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:20.625237+0000","last_peered":"2024-05-08T20:27:20.625237+0000","last_clean":"2024-05-08T20:27:20.625237+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:20.625237+0000","last_undegraded":"2024-05-08T20:27:20.625237+0000","last_fullsized":"2024-05-08T20:27:20.625237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626642+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:20.626642+0000","last_peered":"2024-05-08T20:27:20.626642+0000","last_clean":"2024-05-08T20:27:20.626642+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:20.626642+0000","last_undegraded":"2024-05-08T20:27:20.626642+0000","last_fullsized":"2024-05-08T20:27:20.626642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626013+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:20.626013+0000","last_peered":"2024-05-08T20:27:20.626013+0000","last_clean":"2024-05-08T20:27:20.626013+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:20.626013+0000","last_undegraded":"2024-05-08T20:27:20.626013+0000","last_fullsized":"2024-05-08T20:27:20.626013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884253+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:19.884253+0000","last_peered":"2024-05-08T20:27:19.884253+0000","last_clean":"2024-05-08T20:27:19.884253+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:19.884253+0000","last_undegraded":"2024-05-08T20:27:19.884253+0000","last_fullsized":"2024-05-08T20:27:19.884253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.888079+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:19.888079+0000","last_peered":"2024-05-08T20:27:19.888079+0000","last_clean":"2024-05-08T20:27:19.888079+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:19.888079+0000","last_undegraded":"2024-05-08T20:27:19.888079+0000","last_fullsized":"2024-05-08T20:27:19.888079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126684+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:20.126684+0000","last_peered":"2024-05-08T20:27:20.126684+0000","last_clean":"2024-05-08T20:27:20.126684+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:20.126684+0000","last_undegraded":"2024-05-08T20:27:20.126684+0000","last_fullsized":"2024-05-08T20:27:20.126684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627501+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:20.627501+0000","last_peered":"2024-05-08T20:27:20.627501+0000","last_clean":"2024-05-08T20:27:20.627501+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:20.627501+0000","last_undegraded":"2024-05-08T20:27:20.627501+0000","last_fullsized":"2024-05-08T20:27:20.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885598+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:19.885598+0000","last_peered":"2024-05-08T20:27:19.885598+0000","last_clean":"2024-05-08T20:27:19.885598+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:19.885598+0000","last_undegraded":"2024-05-08T20:27:19.885598+0000","last_fullsized":"2024-05-08T20:27:19.885598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626569+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:20.626569+0000","last_peered":"2024-05-08T20:27:20.626569+0000","last_clean":"2024-05-08T20:27:20.626569+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:20.626569+0000","last_undegraded":"2024-05-08T20:27:20.626569+0000","last_fullsized":"2024-05-08T20:27:20.626569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885728+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:19.885728+0000","last_peered":"2024-05-08T20:27:19.885728+0000","last_clean":"2024-05-08T20:27:19.885728+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:19.885728+0000","last_undegraded":"2024-05-08T20:27:19.885728+0000","last_fullsized":"2024-05-08T20:27:19.885728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624947+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:20.624947+0000","last_peered":"2024-05-08T20:27:20.624947+0000","last_clean":"2024-05-08T20:27:20.624947+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:20.624947+0000","last_undegraded":"2024-05-08T20:27:20.624947+0000","last_fullsized":"2024-05-08T20:27:20.624947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884520+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:19.884520+0000","last_peered":"2024-05-08T20:27:19.884520+0000","last_clean":"2024-05-08T20:27:19.884520+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:19.884520+0000","last_undegraded":"2024-05-08T20:27:19.884520+0000","last_fullsized":"2024-05-08T20:27:19.884520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625165+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:20.625165+0000","last_peered":"2024-05-08T20:27:20.625165+0000","last_clean":"2024-05-08T20:27:20.625165+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:20.625165+0000","last_undegraded":"2024-05-08T20:27:20.625165+0000","last_fullsized":"2024-05-08T20:27:20.625165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886546+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:19.886546+0000","last_peered":"2024-05-08T20:27:19.886546+0000","last_clean":"2024-05-08T20:27:19.886546+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:19.886546+0000","last_undegraded":"2024-05-08T20:27:19.886546+0000","last_fullsized":"2024-05-08T20:27:19.886546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626378+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:20.626378+0000","last_peered":"2024-05-08T20:27:20.626378+0000","last_clean":"2024-05-08T20:27:20.626378+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:20.626378+0000","last_undegraded":"2024-05-08T20:27:20.626378+0000","last_fullsized":"2024-05-08T20:27:20.626378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625261+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:20.625261+0000","last_peered":"2024-05-08T20:27:20.625261+0000","last_clean":"2024-05-08T20:27:20.625261+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:20.625261+0000","last_undegraded":"2024-05-08T20:27:20.625261+0000","last_fullsized":"2024-05-08T20:27:20.625261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626681+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:20.626681+0000","last_peered":"2024-05-08T20:27:20.626681+0000","last_clean":"2024-05-08T20:27:20.626681+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:20.626681+0000","last_undegraded":"2024-05-08T20:27:20.626681+0000","last_fullsized":"2024-05-08T20:27:20.626681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885099+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:19.885099+0000","last_peered":"2024-05-08T20:27:19.885099+0000","last_clean":"2024-05-08T20:27:19.885099+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:19.885099+0000","last_undegraded":"2024-05-08T20:27:19.885099+0000","last_fullsized":"2024-05-08T20:27:19.885099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126397+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:20.126397+0000","last_peered":"2024-05-08T20:27:20.126397+0000","last_clean":"2024-05-08T20:27:20.126397+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:20.126397+0000","last_undegraded":"2024-05-08T20:27:20.126397+0000","last_fullsized":"2024-05-08T20:27:20.126397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884481+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:19.884481+0000","last_peered":"2024-05-08T20:27:19.884481+0000","last_clean":"2024-05-08T20:27:19.884481+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:19.884481+0000","last_undegraded":"2024-05-08T20:27:19.884481+0000","last_fullsized":"2024-05-08T20:27:19.884481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886154+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:19.886154+0000","last_peered":"2024-05-08T20:27:19.886154+0000","last_clean":"2024-05-08T20:27:19.886154+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:19.886154+0000","last_undegraded":"2024-05-08T20:27:19.886154+0000","last_fullsized":"2024-05-08T20:27:19.886154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625443+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:20.625443+0000","last_peered":"2024-05-08T20:27:20.625443+0000","last_clean":"2024-05-08T20:27:20.625443+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:20.625443+0000","last_undegraded":"2024-05-08T20:27:20.625443+0000","last_fullsized":"2024-05-08T20:27:20.625443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627098+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:20.627098+0000","last_peered":"2024-05-08T20:27:20.627098+0000","last_clean":"2024-05-08T20:27:20.627098+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:20.627098+0000","last_undegraded":"2024-05-08T20:27:20.627098+0000","last_fullsized":"2024-05-08T20:27:20.627098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885569+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:19.885569+0000","last_peered":"2024-05-08T20:27:19.885569+0000","last_clean":"2024-05-08T20:27:19.885569+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:19.885569+0000","last_undegraded":"2024-05-08T20:27:19.885569+0000","last_fullsized":"2024-05-08T20:27:19.885569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625030+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:20.625030+0000","last_peered":"2024-05-08T20:27:20.625030+0000","last_clean":"2024-05-08T20:27:20.625030+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:20.625030+0000","last_undegraded":"2024-05-08T20:27:20.625030+0000","last_fullsized":"2024-05-08T20:27:20.625030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624907+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:20.624907+0000","last_peered":"2024-05-08T20:27:20.624907+0000","last_clean":"2024-05-08T20:27:20.624907+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:20.624907+0000","last_undegraded":"2024-05-08T20:27:20.624907+0000","last_fullsized":"2024-05-08T20:27:20.624907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.884746+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:19.884746+0000","last_peered":"2024-05-08T20:27:19.884746+0000","last_clean":"2024-05-08T20:27:19.884746+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:19.884746+0000","last_undegraded":"2024-05-08T20:27:19.884746+0000","last_fullsized":"2024-05-08T20:27:19.884746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625733+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:20.625733+0000","last_peered":"2024-05-08T20:27:20.625733+0000","last_clean":"2024-05-08T20:27:20.625733+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:20.625733+0000","last_undegraded":"2024-05-08T20:27:20.625733+0000","last_fullsized":"2024-05-08T20:27:20.625733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886294+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:19.886294+0000","last_peered":"2024-05-08T20:27:19.886294+0000","last_clean":"2024-05-08T20:27:19.886294+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:19.886294+0000","last_undegraded":"2024-05-08T20:27:19.886294+0000","last_fullsized":"2024-05-08T20:27:19.886294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887995+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:19.887995+0000","last_peered":"2024-05-08T20:27:19.887995+0000","last_clean":"2024-05-08T20:27:19.887995+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:19.887995+0000","last_undegraded":"2024-05-08T20:27:19.887995+0000","last_fullsized":"2024-05-08T20:27:19.887995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.888246+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:19.888246+0000","last_peered":"2024-05-08T20:27:19.888246+0000","last_clean":"2024-05-08T20:27:19.888246+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:19.888246+0000","last_undegraded":"2024-05-08T20:27:19.888246+0000","last_fullsized":"2024-05-08T20:27:19.888246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626931+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:20.626931+0000","last_peered":"2024-05-08T20:27:20.626931+0000","last_clean":"2024-05-08T20:27:20.626931+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:20.626931+0000","last_undegraded":"2024-05-08T20:27:20.626931+0000","last_fullsized":"2024-05-08T20:27:20.626931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626595+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:20.626595+0000","last_peered":"2024-05-08T20:27:20.626595+0000","last_clean":"2024-05-08T20:27:20.626595+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:20.626595+0000","last_undegraded":"2024-05-08T20:27:20.626595+0000","last_fullsized":"2024-05-08T20:27:20.626595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887665+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:19.887665+0000","last_peered":"2024-05-08T20:27:19.887665+0000","last_clean":"2024-05-08T20:27:19.887665+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:19.887665+0000","last_undegraded":"2024-05-08T20:27:19.887665+0000","last_fullsized":"2024-05-08T20:27:19.887665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885856+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:19.885856+0000","last_peered":"2024-05-08T20:27:19.885856+0000","last_clean":"2024-05-08T20:27:19.885856+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:19.885856+0000","last_undegraded":"2024-05-08T20:27:19.885856+0000","last_fullsized":"2024-05-08T20:27:19.885856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627218+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:20.627218+0000","last_peered":"2024-05-08T20:27:20.627218+0000","last_clean":"2024-05-08T20:27:20.627218+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:20.627218+0000","last_undegraded":"2024-05-08T20:27:20.627218+0000","last_fullsized":"2024-05-08T20:27:20.627218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627040+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:20.627040+0000","last_peered":"2024-05-08T20:27:20.627040+0000","last_clean":"2024-05-08T20:27:20.627040+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:20.627040+0000","last_undegraded":"2024-05-08T20:27:20.627040+0000","last_fullsized":"2024-05-08T20:27:20.627040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626714+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:20.626714+0000","last_peered":"2024-05-08T20:27:20.626714+0000","last_clean":"2024-05-08T20:27:20.626714+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:20.626714+0000","last_undegraded":"2024-05-08T20:27:20.626714+0000","last_fullsized":"2024-05-08T20:27:20.626714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885291+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:19.885291+0000","last_peered":"2024-05-08T20:27:19.885291+0000","last_clean":"2024-05-08T20:27:19.885291+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:19.885291+0000","last_undegraded":"2024-05-08T20:27:19.885291+0000","last_fullsized":"2024-05-08T20:27:19.885291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627248+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:20.627248+0000","last_peered":"2024-05-08T20:27:20.627248+0000","last_clean":"2024-05-08T20:27:20.627248+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:20.627248+0000","last_undegraded":"2024-05-08T20:27:20.627248+0000","last_fullsized":"2024-05-08T20:27:20.627248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885683+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:19.885683+0000","last_peered":"2024-05-08T20:27:19.885683+0000","last_clean":"2024-05-08T20:27:19.885683+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:19.885683+0000","last_undegraded":"2024-05-08T20:27:19.885683+0000","last_fullsized":"2024-05-08T20:27:19.885683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885488+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:19.885488+0000","last_peered":"2024-05-08T20:27:19.885488+0000","last_clean":"2024-05-08T20:27:19.885488+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:19.885488+0000","last_undegraded":"2024-05-08T20:27:19.885488+0000","last_fullsized":"2024-05-08T20:27:19.885488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126364+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:20.126364+0000","last_peered":"2024-05-08T20:27:20.126364+0000","last_clean":"2024-05-08T20:27:20.126364+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:20.126364+0000","last_undegraded":"2024-05-08T20:27:20.126364+0000","last_fullsized":"2024-05-08T20:27:20.126364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626532+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:20.626532+0000","last_peered":"2024-05-08T20:27:20.626532+0000","last_clean":"2024-05-08T20:27:20.626532+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:20.626532+0000","last_undegraded":"2024-05-08T20:27:20.626532+0000","last_fullsized":"2024-05-08T20:27:20.626532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887597+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:19.887597+0000","last_peered":"2024-05-08T20:27:19.887597+0000","last_clean":"2024-05-08T20:27:19.887597+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:19.887597+0000","last_undegraded":"2024-05-08T20:27:19.887597+0000","last_fullsized":"2024-05-08T20:27:19.887597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627136+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:20.627136+0000","last_peered":"2024-05-08T20:27:20.627136+0000","last_clean":"2024-05-08T20:27:20.627136+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:20.627136+0000","last_undegraded":"2024-05-08T20:27:20.627136+0000","last_fullsized":"2024-05-08T20:27:20.627136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126729+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:20.126729+0000","last_peered":"2024-05-08T20:27:20.126729+0000","last_clean":"2024-05-08T20:27:20.126729+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:20.126729+0000","last_undegraded":"2024-05-08T20:27:20.126729+0000","last_fullsized":"2024-05-08T20:27:20.126729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627672+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:20.627672+0000","last_peered":"2024-05-08T20:27:20.627672+0000","last_clean":"2024-05-08T20:27:20.627672+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:20.627672+0000","last_undegraded":"2024-05-08T20:27:20.627672+0000","last_fullsized":"2024-05-08T20:27:20.627672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626807+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:20.626807+0000","last_peered":"2024-05-08T20:27:20.626807+0000","last_clean":"2024-05-08T20:27:20.626807+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:20.626807+0000","last_undegraded":"2024-05-08T20:27:20.626807+0000","last_fullsized":"2024-05-08T20:27:20.626807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885367+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:19.885367+0000","last_peered":"2024-05-08T20:27:19.885367+0000","last_clean":"2024-05-08T20:27:19.885367+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:19.885367+0000","last_undegraded":"2024-05-08T20:27:19.885367+0000","last_fullsized":"2024-05-08T20:27:19.885367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126524+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:20.126524+0000","last_peered":"2024-05-08T20:27:20.126524+0000","last_clean":"2024-05-08T20:27:20.126524+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:20.126524+0000","last_undegraded":"2024-05-08T20:27:20.126524+0000","last_fullsized":"2024-05-08T20:27:20.126524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627123+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:20.627123+0000","last_peered":"2024-05-08T20:27:20.627123+0000","last_clean":"2024-05-08T20:27:20.627123+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:20.627123+0000","last_undegraded":"2024-05-08T20:27:20.627123+0000","last_fullsized":"2024-05-08T20:27:20.627123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:27:18.885391+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:18.885391+0000","last_peered":"2024-05-08T20:27:18.885391+0000","last_clean":"2024-05-08T20:27:18.885391+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:18.885391+0000","last_undegraded":"2024-05-08T20:27:18.885391+0000","last_fullsized":"2024-05-08T20:27:18.885391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885604+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:19.885604+0000","last_peered":"2024-05-08T20:27:19.885604+0000","last_clean":"2024-05-08T20:27:19.885604+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:19.885604+0000","last_undegraded":"2024-05-08T20:27:19.885604+0000","last_fullsized":"2024-05-08T20:27:19.885604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626087+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:20.626087+0000","last_peered":"2024-05-08T20:27:20.626087+0000","last_clean":"2024-05-08T20:27:20.626087+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:20.626087+0000","last_undegraded":"2024-05-08T20:27:20.626087+0000","last_fullsized":"2024-05-08T20:27:20.626087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:20.626369+0000","last_peered":"2024-05-08T20:27:20.626369+0000","last_clean":"2024-05-08T20:27:20.626369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:20.626369+0000","last_undegraded":"2024-05-08T20:27:20.626369+0000","last_fullsized":"2024-05-08T20:27:20.626369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626520+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:20.626520+0000","last_peered":"2024-05-08T20:27:20.626520+0000","last_clean":"2024-05-08T20:27:20.626520+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:20.626520+0000","last_undegraded":"2024-05-08T20:27:20.626520+0000","last_fullsized":"2024-05-08T20:27:20.626520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.126579+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:20.126579+0000","last_peered":"2024-05-08T20:27:20.126579+0000","last_clean":"2024-05-08T20:27:20.126579+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:20.126579+0000","last_undegraded":"2024-05-08T20:27:20.126579+0000","last_fullsized":"2024-05-08T20:27:20.126579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625752+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:20.625752+0000","last_peered":"2024-05-08T20:27:20.625752+0000","last_clean":"2024-05-08T20:27:20.625752+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:20.625752+0000","last_undegraded":"2024-05-08T20:27:20.625752+0000","last_fullsized":"2024-05-08T20:27:20.625752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885500+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:19.885500+0000","last_peered":"2024-05-08T20:27:19.885500+0000","last_clean":"2024-05-08T20:27:19.885500+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:19.885500+0000","last_undegraded":"2024-05-08T20:27:19.885500+0000","last_fullsized":"2024-05-08T20:27:19.885500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887029+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:19.887029+0000","last_peered":"2024-05-08T20:27:19.887029+0000","last_clean":"2024-05-08T20:27:19.887029+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:19.887029+0000","last_undegraded":"2024-05-08T20:27:19.887029+0000","last_fullsized":"2024-05-08T20:27:19.887029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625910+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:20.625910+0000","last_peered":"2024-05-08T20:27:20.625910+0000","last_clean":"2024-05-08T20:27:20.625910+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:20.625910+0000","last_undegraded":"2024-05-08T20:27:20.625910+0000","last_fullsized":"2024-05-08T20:27:20.625910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887430+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:19.887430+0000","last_peered":"2024-05-08T20:27:19.887430+0000","last_clean":"2024-05-08T20:27:19.887430+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:19.887430+0000","last_undegraded":"2024-05-08T20:27:19.887430+0000","last_fullsized":"2024-05-08T20:27:19.887430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627451+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:20.627451+0000","last_peered":"2024-05-08T20:27:20.627451+0000","last_clean":"2024-05-08T20:27:20.627451+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:20.627451+0000","last_undegraded":"2024-05-08T20:27:20.627451+0000","last_fullsized":"2024-05-08T20:27:20.627451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625828+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:20.625828+0000","last_peered":"2024-05-08T20:27:20.625828+0000","last_clean":"2024-05-08T20:27:20.625828+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:20.625828+0000","last_undegraded":"2024-05-08T20:27:20.625828+0000","last_fullsized":"2024-05-08T20:27:20.625828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625996+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:20.625996+0000","last_peered":"2024-05-08T20:27:20.625996+0000","last_clean":"2024-05-08T20:27:20.625996+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:20.625996+0000","last_undegraded":"2024-05-08T20:27:20.625996+0000","last_fullsized":"2024-05-08T20:27:20.625996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625988+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:20.625988+0000","last_peered":"2024-05-08T20:27:20.625988+0000","last_clean":"2024-05-08T20:27:20.625988+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:20.625988+0000","last_undegraded":"2024-05-08T20:27:20.625988+0000","last_fullsized":"2024-05-08T20:27:20.625988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886530+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:19.886530+0000","last_peered":"2024-05-08T20:27:19.886530+0000","last_clean":"2024-05-08T20:27:19.886530+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:19.886530+0000","last_undegraded":"2024-05-08T20:27:19.886530+0000","last_fullsized":"2024-05-08T20:27:19.886530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626895+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:20.626895+0000","last_peered":"2024-05-08T20:27:20.626895+0000","last_clean":"2024-05-08T20:27:20.626895+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:20.626895+0000","last_undegraded":"2024-05-08T20:27:20.626895+0000","last_fullsized":"2024-05-08T20:27:20.626895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626375+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:20.626375+0000","last_peered":"2024-05-08T20:27:20.626375+0000","last_clean":"2024-05-08T20:27:20.626375+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:20.626375+0000","last_undegraded":"2024-05-08T20:27:20.626375+0000","last_fullsized":"2024-05-08T20:27:20.626375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.886914+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:19.886914+0000","last_peered":"2024-05-08T20:27:19.886914+0000","last_clean":"2024-05-08T20:27:19.886914+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:19.886914+0000","last_undegraded":"2024-05-08T20:27:19.886914+0000","last_fullsized":"2024-05-08T20:27:19.886914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625870+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:20.625870+0000","last_peered":"2024-05-08T20:27:20.625870+0000","last_clean":"2024-05-08T20:27:20.625870+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:20.625870+0000","last_undegraded":"2024-05-08T20:27:20.625870+0000","last_fullsized":"2024-05-08T20:27:20.625870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.624950+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:20.624950+0000","last_peered":"2024-05-08T20:27:20.624950+0000","last_clean":"2024-05-08T20:27:20.624950+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:20.624950+0000","last_undegraded":"2024-05-08T20:27:20.624950+0000","last_fullsized":"2024-05-08T20:27:20.624950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626004+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:20.626004+0000","last_peered":"2024-05-08T20:27:20.626004+0000","last_clean":"2024-05-08T20:27:20.626004+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:20.626004+0000","last_undegraded":"2024-05-08T20:27:20.626004+0000","last_fullsized":"2024-05-08T20:27:20.626004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625358+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:20.625358+0000","last_peered":"2024-05-08T20:27:20.625358+0000","last_clean":"2024-05-08T20:27:20.625358+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:20.625358+0000","last_undegraded":"2024-05-08T20:27:20.625358+0000","last_fullsized":"2024-05-08T20:27:20.625358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627370+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:20.627370+0000","last_peered":"2024-05-08T20:27:20.627370+0000","last_clean":"2024-05-08T20:27:20.627370+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:20.627370+0000","last_undegraded":"2024-05-08T20:27:20.627370+0000","last_fullsized":"2024-05-08T20:27:20.627370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885309+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:19.885309+0000","last_peered":"2024-05-08T20:27:19.885309+0000","last_clean":"2024-05-08T20:27:19.885309+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:19.885309+0000","last_undegraded":"2024-05-08T20:27:19.885309+0000","last_fullsized":"2024-05-08T20:27:19.885309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.887202+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:19.887202+0000","last_peered":"2024-05-08T20:27:19.887202+0000","last_clean":"2024-05-08T20:27:19.887202+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:19.887202+0000","last_undegraded":"2024-05-08T20:27:19.887202+0000","last_fullsized":"2024-05-08T20:27:19.887202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626939+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:20.626939+0000","last_peered":"2024-05-08T20:27:20.626939+0000","last_clean":"2024-05-08T20:27:20.626939+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:20.626939+0000","last_undegraded":"2024-05-08T20:27:20.626939+0000","last_fullsized":"2024-05-08T20:27:20.626939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:19.885164+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:19.885164+0000","last_peered":"2024-05-08T20:27:19.885164+0000","last_clean":"2024-05-08T20:27:19.885164+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:19.885164+0000","last_undegraded":"2024-05-08T20:27:19.885164+0000","last_fullsized":"2024-05-08T20:27:19.885164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.627327+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:20.627327+0000","last_peered":"2024-05-08T20:27:20.627327+0000","last_clean":"2024-05-08T20:27:20.627327+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:20.627327+0000","last_undegraded":"2024-05-08T20:27:20.627327+0000","last_fullsized":"2024-05-08T20:27:20.627327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626892+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:20.626892+0000","last_peered":"2024-05-08T20:27:20.626892+0000","last_clean":"2024-05-08T20:27:20.626892+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:20.626892+0000","last_undegraded":"2024-05-08T20:27:20.626892+0000","last_fullsized":"2024-05-08T20:27:20.626892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625877+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:20.625877+0000","last_peered":"2024-05-08T20:27:20.625877+0000","last_clean":"2024-05-08T20:27:20.625877+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:20.625877+0000","last_undegraded":"2024-05-08T20:27:20.625877+0000","last_fullsized":"2024-05-08T20:27:20.625877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.625735+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:20.625735+0000","last_peered":"2024-05-08T20:27:20.625735+0000","last_clean":"2024-05-08T20:27:20.625735+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:20.625735+0000","last_undegraded":"2024-05-08T20:27:20.625735+0000","last_fullsized":"2024-05-08T20:27:20.625735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626957+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:20.626957+0000","last_peered":"2024-05-08T20:27:20.626957+0000","last_clean":"2024-05-08T20:27:20.626957+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:20.626957+0000","last_undegraded":"2024-05-08T20:27:20.626957+0000","last_fullsized":"2024-05-08T20:27:20.626957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":660805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:23.896 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T20:27:23.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.043+0000 7f8e29829640 1 Processor -- start 2024-05-08T20:27:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.043+0000 7f8e29829640 1 -- start start 2024-05-08T20:27:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e24151f00 0x7f8e241588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8e24154cf0 0x7f8e24155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e24158e20 con 0x7f8e24155690 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2406bb20 con 0x7f8e24151f00 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e241548e0 con 0x7f8e24154cf0 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e24151f00 0x7f8e241588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e24151f00 0x7f8e241588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55014/0 (socket says 172.21.15.81:55014) 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 -- 172.21.15.81:0/982274972 learned_addr learned my addr 172.21.15.81:0/982274972 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e227fc640 1 --2- 172.21.15.81:0/982274972 >> v2:172.21.15.117:3300/0 conn(0x7f8e24154cf0 0x7f8e24155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 -- 172.21.15.81:0/982274972 >> v2:172.21.15.117:3300/0 conn(0x7f8e24154cf0 msgr2=0x7f8e24155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 --2- 172.21.15.81:0/982274972 >> v2:172.21.15.117:3300/0 conn(0x7f8e24154cf0 0x7f8e24155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 -- 172.21.15.81:0/982274972 >> v1:172.21.15.117:6789/0 conn(0x7f8e24155690 legacy=0x7f8e240ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 -- 172.21.15.81:0/982274972 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e241522e0 con 0x7f8e24151f00 2024-05-08T20:27:24.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e22ffd640 1 --2- 172.21.15.81:0/982274972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24151f00 0x7f8e241588e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e2408c580 tx=0x7f8e0c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d6077b8bb3b9d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e21ffb640 1 -- 172.21.15.81:0/982274972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0ac640 con 0x7f8e24151f00 2024-05-08T20:27:24.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e21ffb640 1 -- 172.21.15.81:0/982274972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0ac7a0 con 0x7f8e24151f00 2024-05-08T20:27:24.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e21ffb640 1 -- 172.21.15.81:0/982274972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0acb30 con 0x7f8e24151f00 2024-05-08T20:27:24.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- 172.21.15.81:0/982274972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24151f00 msgr2=0x7f8e241588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 --2- 172.21.15.81:0/982274972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24151f00 0x7f8e241588e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e2408c580 tx=0x7f8e0c01c3c0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- 172.21.15.81:0/982274972 shutdown_connections 2024-05-08T20:27:24.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 --2- 172.21.15.81:0/982274972 >> v2:172.21.15.117:3300/0 conn(0x7f8e24154cf0 0x7f8e24155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 --2- 172.21.15.81:0/982274972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24151f00 0x7f8e241588e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- 172.21.15.81:0/982274972 >> 172.21.15.81:0/982274972 conn(0x7f8e240715f0 msgr2=0x7f8e24071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- 172.21.15.81:0/982274972 shutdown_connections 2024-05-08T20:27:24.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.047+0000 7f8e29829640 1 -- 172.21.15.81:0/982274972 wait complete. 2024-05-08T20:27:24.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 Processor -- start 2024-05-08T20:27:24.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- start start 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e24151f00 0x7f8e24150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e2414ea60 0x7f8e24144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24150020 con 0x7f8e24154cf0 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24150a90 con 0x7f8e2414ea60 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2414f410 con 0x7f8e24151f00 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55022/0 (socket says 172.21.15.81:55022) 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 -- 172.21.15.81:0/2461282593 learned_addr learned my addr 172.21.15.81:0/2461282593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e22ffd640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e24151f00 0x7f8e24150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 -- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e24151f00 msgr2=0x7f8e24150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e24151f00 0x7f8e24150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 -- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e2414ea60 msgr2=0x7f8e24144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e2414ea60 0x7f8e24144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 -- 172.21.15.81:0/2461282593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0094d0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e227fc640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c7f0 tx=0x7f8e1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14004220 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140043a0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14004510 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2414f6f0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2414fcb0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240675e0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e14003a70 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.051+0000 7f8e1bfff640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 0x7f8e08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.055+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f8e140840c0 con 0x7f8e24154cf0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.055+0000 7f8e22ffd640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 0x7f8e08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.055+0000 7f8e22ffd640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 0x7f8e08068b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ae000 tx=0x7f8e0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.055+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8e140514d0 con 0x7f8e24154cf0 2024-05-08T20:27:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.203+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e24150160 con 0x7f8e24154cf0 2024-05-08T20:27:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e1bfff640 1 -- 172.21.15.81:0/2461282593 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16017 (secure 0 0 0) 0x7f8e14054af0 con 0x7f8e24154cf0 2024-05-08T20:27:24.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:24.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:19.868877+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 msgr2=0x7f8e08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 0x7f8e08068b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ae000 tx=0x7f8e0c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 msgr2=0x7f8e240c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400c7f0 tx=0x7f8e1400ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 shutdown_connections 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8e08066690 0x7f8e08068b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e2414ea60 0x7f8e24144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e24154cf0 0x7f8e240c8df0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 --2- 172.21.15.81:0/2461282593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e24151f00 0x7f8e24150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 >> 172.21.15.81:0/2461282593 conn(0x7f8e240715f0 msgr2=0x7f8e240abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 shutdown_connections 2024-05-08T20:27:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.207+0000 7f8e29829640 1 -- 172.21.15.81:0/2461282593 wait complete. 2024-05-08T20:27:24.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:24.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 Processor -- start 2024-05-08T20:27:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 -- start start 2024-05-08T20:27:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb83c0c1bb0 0x7fb83c151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0c2420 con 0x7fb83c0c1f90 2024-05-08T20:27:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c155060 con 0x7fb83c0c1bb0 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb842f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c155340 con 0x7fb83c1535a0 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb83bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb83c0c1f90 0x7fb83c152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52762/0 (socket says 172.21.15.81:52762) 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb83bfff640 1 -- 172.21.15.81:0/344112594 learned_addr learned my addr 172.21.15.81:0/344112594 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb841503640 1 --2- 172.21.15.81:0/344112594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb840d02640 1 --2- 172.21.15.81:0/344112594 >> v2:172.21.15.117:3300/0 conn(0x7fb83c0c1bb0 0x7fb83c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb83b7fe640 1 -- 172.21.15.81:0/344112594 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860816351 0 0) 0x7fb828001120 con 0x7fb83c0c1f90 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb83b7fe640 1 -- 172.21.15.81:0/344112594 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003530 con 0x7fb83c0c1f90 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb841503640 1 -- 172.21.15.81:0/344112594 >> v2:172.21.15.117:3300/0 conn(0x7fb83c0c1bb0 msgr2=0x7fb83c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb841503640 1 --2- 172.21.15.81:0/344112594 >> v2:172.21.15.117:3300/0 conn(0x7fb83c0c1bb0 0x7fb83c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb841503640 1 -- 172.21.15.81:0/344112594 >> v1:172.21.15.81:6789/0 conn(0x7fb83c0c1f90 legacy=0x7fb83c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.347+0000 7fb841503640 1 -- 172.21.15.81:0/344112594 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c155620 con 0x7fb83c1535a0 2024-05-08T20:27:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb841503640 1 --2- 172.21.15.81:0/344112594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c15c080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb834009d90 tx=0x7fb83401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e73a68e9ba9c3a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb83b7fe640 1 -- 172.21.15.81:0/344112594 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340a5850 con 0x7fb83c1535a0 2024-05-08T20:27:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb83b7fe640 1 -- 172.21.15.81:0/344112594 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8340a59b0 con 0x7fb83c1535a0 2024-05-08T20:27:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb83b7fe640 1 -- 172.21.15.81:0/344112594 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340a5d20 con 0x7fb83c1535a0 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- 172.21.15.81:0/344112594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 msgr2=0x7fb83c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 --2- 172.21.15.81:0/344112594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c15c080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb834009d90 tx=0x7fb83401c8b0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- 172.21.15.81:0/344112594 shutdown_connections 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 --2- 172.21.15.81:0/344112594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c15c080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 --2- 172.21.15.81:0/344112594 >> v2:172.21.15.117:3300/0 conn(0x7fb83c0c1bb0 0x7fb83c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- 172.21.15.81:0/344112594 >> 172.21.15.81:0/344112594 conn(0x7fb83c0c2ca0 msgr2=0x7fb83c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- 172.21.15.81:0/344112594 shutdown_connections 2024-05-08T20:27:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- 172.21.15.81:0/344112594 wait complete. 2024-05-08T20:27:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 Processor -- start 2024-05-08T20:27:24.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.351+0000 7fb842f66640 1 -- start start 2024-05-08T20:27:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c1bb0 0x7fb83c1ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c1eb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1e8b10 con 0x7fb83c0c1f90 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1eced0 con 0x7fb83c0c1bb0 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c14c410 con 0x7fb83c1535a0 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55036/0 (socket says 172.21.15.81:55036) 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 -- 172.21.15.81:0/1894647831 learned_addr learned my addr 172.21.15.81:0/1894647831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb840d02640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c1bb0 0x7fb83c1ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb841503640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c1eb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 -- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 msgr2=0x7fb83c1eb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c1eb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 -- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c1bb0 msgr2=0x7fb83c1ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c1bb0 0x7fb83c1ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 -- 172.21.15.81:0/1894647831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834009a70 con 0x7fb83c0c1f90 2024-05-08T20:27:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb841503640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c1eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb83bfff640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c700 tx=0x7fb82800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828005ac0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828005c60 con 0x7fb83c0c1f90 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c14cc40 con 0x7fb83c0c1f90 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828001d60 con 0x7fb83c0c1f90 2024-05-08T20:27:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c14d200 con 0x7fb83c0c1f90 2024-05-08T20:27:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c1e8cc0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb828007070 con 0x7fb83c0c1f90 2024-05-08T20:27:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 0x7fb820068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fb8280833b0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb840d02640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 0x7fb820068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.355+0000 7fb840d02640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 0x7fb820068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb83000bcf0 tx=0x7fb83000b3a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.359+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb83c1e8cc0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb83c1e8cc0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb8397fa640 1 -- 172.21.15.81:0/1894647831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb83c1e8cc0 con 0x7fb83c0c1f90 2024-05-08T20:27:24.524 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 msgr2=0x7fb820068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 0x7fb820068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb83000bcf0 tx=0x7fb83000b3a0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 msgr2=0x7fb83c0c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c700 tx=0x7fb82800cbc0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 shutdown_connections 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8200666c0 0x7fb820068b80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb83c1535a0 0x7fb83c1eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb83c0c1f90 0x7fb83c0c3e20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 --2- 172.21.15.81:0/1894647831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb83c0c1bb0 0x7fb83c1ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.519+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 >> 172.21.15.81:0/1894647831 conn(0x7fb83c0c2ca0 msgr2=0x7fb83c0c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.523+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 shutdown_connections 2024-05-08T20:27:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.523+0000 7fb842f66640 1 -- 172.21.15.81:0/1894647831 wait complete. 2024-05-08T20:27:24.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:27:24.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.655+0000 7f3b34a46640 1 Processor -- start 2024-05-08T20:27:24.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 -- start start 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 0x7f3b300c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b3006f400 0x7f3b300c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300c0650 con 0x7f3b301501e0 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3006fd60 con 0x7f3b3006f400 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b34a46640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b30072180 con 0x7f3b300725f0 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b3006f400 0x7f3b300c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b3006f400 0x7f3b300c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55046/0 (socket says 172.21.15.81:55046) 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 -- 172.21.15.81:0/1413026229 learned_addr learned my addr 172.21.15.81:0/1413026229 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2dd9b640 1 --2- 172.21.15.81:0/1413026229 >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 0x7f3b300c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 -- 172.21.15.81:0/1413026229 >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 msgr2=0x7f3b300c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 --2- 172.21.15.81:0/1413026229 >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 0x7f3b300c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 -- 172.21.15.81:0/1413026229 >> v1:172.21.15.117:6789/0 conn(0x7f3b301501e0 legacy=0x7f3b3006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 -- 172.21.15.81:0/1413026229 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3006fa80 con 0x7f3b3006f400 2024-05-08T20:27:24.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2dd9b640 1 --2- 172.21.15.81:0/1413026229 >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 0x7f3b300c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2ed9d640 1 --2- 172.21.15.81:0/1413026229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b3006f400 0x7f3b300c2180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b3006f1b0 tx=0x7f3b2001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fcb9e6dc32690b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2d59a640 1 -- 172.21.15.81:0/1413026229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200ab600 con 0x7f3b3006f400 2024-05-08T20:27:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.659+0000 7f3b2d59a640 1 -- 172.21.15.81:0/1413026229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200a7050 con 0x7f3b3006f400 2024-05-08T20:27:24.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2d59a640 1 -- 172.21.15.81:0/1413026229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200ab980 con 0x7f3b3006f400 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/1413026229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b3006f400 msgr2=0x7f3b300c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- 172.21.15.81:0/1413026229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b3006f400 0x7f3b300c2180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b3006f1b0 tx=0x7f3b2001c390 comp rx=0 tx=0).stop 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/1413026229 shutdown_connections 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- 172.21.15.81:0/1413026229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b3006f400 0x7f3b300c2180 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- 172.21.15.81:0/1413026229 >> v2:172.21.15.117:3300/0 conn(0x7f3b300725f0 0x7f3b300c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/1413026229 >> 172.21.15.81:0/1413026229 conn(0x7f3b300c2ca0 msgr2=0x7f3b300c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/1413026229 shutdown_connections 2024-05-08T20:27:24.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/1413026229 wait complete. 2024-05-08T20:27:24.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 Processor -- start 2024-05-08T20:27:24.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- start start 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 0x7f3b30142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 0x7f3b30156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30150f90 con 0x7f3b300725f0 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30155dd0 con 0x7f3b3006f400 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301557c0 con 0x7f3b301501e0 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55062/0 (socket says 172.21.15.81:55062) 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 -- 172.21.15.81:0/2419820678 learned_addr learned my addr 172.21.15.81:0/2419820678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2e59c640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 0x7f3b30142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2ed9d640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 0x7f3b30156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 -- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 msgr2=0x7f3b30156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 0x7f3b30156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 -- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 msgr2=0x7f3b30142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 0x7f3b30142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 -- 172.21.15.81:0/2419820678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200094d0 con 0x7f3b300725f0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2e59c640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 0x7f3b30142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2ed9d640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 0x7f3b30156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b2dd9b640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7f0 tx=0x7f3b1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18007820 con 0x7f3b300725f0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18007980 con 0x7f3b300725f0 2024-05-08T20:27:24.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30150740 con 0x7f3b300725f0 2024-05-08T20:27:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18007d30 con 0x7f3b300725f0 2024-05-08T20:27:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.663+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b301edb20 con 0x7f3b300725f0 2024-05-08T20:27:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30155f60 con 0x7f3b300725f0 2024-05-08T20:27:24.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b180113f0 con 0x7f3b300725f0 2024-05-08T20:27:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b26ffd640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 0x7f3b10068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f3b180842e0 con 0x7f3b300725f0 2024-05-08T20:27:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b2e59c640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 0x7f3b10068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.667+0000 7f3b2e59c640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 0x7f3b10068b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.671+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3b18051650 con 0x7f3b300725f0 2024-05-08T20:27:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.823+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b30074950 con 0x7f3b300725f0 2024-05-08T20:27:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.823+0000 7f3b26ffd640 1 -- 172.21.15.81:0/2419820678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v20) v1 ==== 99+0+11 (secure 0 0 0) 0x7f3b18054c70 con 0x7f3b300725f0 2024-05-08T20:27:24.829 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 msgr2=0x7f3b10068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 0x7f3b10068b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 msgr2=0x7f3b300c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7f0 tx=0x7f3b1800ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 shutdown_connections 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b100666c0 0x7f3b10068b80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b301501e0 0x7f3b30156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b300725f0 0x7f3b300c4de0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 --2- 172.21.15.81:0/2419820678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b3006f400 0x7f3b30142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 >> 172.21.15.81:0/2419820678 conn(0x7f3b300c2ca0 msgr2=0x7f3b300bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 shutdown_connections 2024-05-08T20:27:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.827+0000 7f3b34a46640 1 -- 172.21.15.81:0/2419820678 wait complete. 2024-05-08T20:27:24.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:27:24.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.947+0000 7fc153dfb640 1 Processor -- start 2024-05-08T20:27:24.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.947+0000 7fc153dfb640 1 -- start start 2024-05-08T20:27:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc153dfb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc14c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc153dfb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0c2400 con 0x7fc14c151740 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc153dfb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c155060 con 0x7fc14c0c1bb0 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc153dfb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c155340 con 0x7fc14c0c1f90 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc14c151740 0x7fc14c1535a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52770/0 (socket says 172.21.15.81:52770) 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 -- 172.21.15.81:0/4198732486 learned_addr learned my addr 172.21.15.81:0/4198732486 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc152398640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc14c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794204859 0 0) 0x7fc14c0c2400 con 0x7fc14c151740 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc138003530 con 0x7fc14c151740 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334384938 0 0) 0x7fc138003530 con 0x7fc14c151740 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 msgr2=0x7fc14c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc14c15d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 >> v1:172.21.15.117:6789/0 conn(0x7fc14c0c1bb0 legacy=0x7fc14c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c155620 con 0x7fc14c151740 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc13c001680 con 0x7fc14c151740 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 >> v1:172.21.15.81:6789/0 conn(0x7fc14c151740 legacy=0x7fc14c1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc1380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc138003f30 0x7fc1380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138004d10 0x7fc138005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c155340 con 0x7fc138003f30 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13800bbd0 con 0x7fc138004d10 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13800bd90 con 0x7fc14c0c1f90 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc138003f30 0x7fc1380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151b97640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc1380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc152398640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138004d10 0x7fc138005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 -- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 msgr2=0x7fc1380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c0c1f90 0x7fc1380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 -- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138004d10 msgr2=0x7fc138005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138004d10 0x7fc138005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.951+0000 7fc151396640 1 -- 172.21.15.81:0/4198732486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138003530 con 0x7fc138003f30 2024-05-08T20:27:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc151396640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc138003f30 0x7fc1380047d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c240 tx=0x7fc13c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5da9b2feeb0f29 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0a5af0 con 0x7fc138003f30 2024-05-08T20:27:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0a5c50 con 0x7fc138003f30 2024-05-08T20:27:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc150b95640 1 -- 172.21.15.81:0/4198732486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c005b20 con 0x7fc138003f30 2024-05-08T20:27:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- 172.21.15.81:0/4198732486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc138003f30 msgr2=0x7fc1380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 --2- 172.21.15.81:0/4198732486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc138003f30 0x7fc1380047d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c240 tx=0x7fc13c01cc30 comp rx=0 tx=0).stop 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc152398640 1 -- 172.21.15.81:0/4198732486 reap_dead start 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- 172.21.15.81:0/4198732486 shutdown_connections 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- 172.21.15.81:0/4198732486 >> 172.21.15.81:0/4198732486 conn(0x7fc14c0c2ca0 msgr2=0x7fc14c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- 172.21.15.81:0/4198732486 shutdown_connections 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- 172.21.15.81:0/4198732486 wait complete. 2024-05-08T20:27:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 Processor -- start 2024-05-08T20:27:24.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.955+0000 7fc153dfb640 1 -- start start 2024-05-08T20:27:24.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138003f30 0x7fc14c1eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c14dab0 0x7fc14c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1eb760 con 0x7fc14c159b40 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c158a60 con 0x7fc138003f30 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c14e970 con 0x7fc14c14dab0 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55072/0 (socket says 172.21.15.81:55072) 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 -- 172.21.15.81:0/31800607 learned_addr learned my addr 172.21.15.81:0/31800607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151b97640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138003f30 0x7fc14c1eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc152398640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c14dab0 0x7fc14c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 -- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c14dab0 msgr2=0x7fc14c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c14dab0 0x7fc14c14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 -- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138003f30 msgr2=0x7fc14c1eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138003f30 0x7fc14c1eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:24.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 -- 172.21.15.81:0/31800607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c14ec50 con 0x7fc14c159b40 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151396640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc13c01ca60 tx=0x7fc138005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0b4070 con 0x7fc14c159b40 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0a5a30 con 0x7fc14c159b40 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c158d00 con 0x7fc14c159b40 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0010e0 con 0x7fc14c159b40 2024-05-08T20:27:24.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c06c8f0 con 0x7fc14c159b40 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c14ede0 con 0x7fc14c159b40 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc13c001440 con 0x7fc14c159b40 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 0x7fc130068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fc13c11dbf0 con 0x7fc14c159b40 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151b97640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 0x7fc130068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:24.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.959+0000 7fc151b97640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 0x7fc130068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc148005510 tx=0x7fc148009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:24.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:24.963+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc13c0eb000 con 0x7fc14c159b40 2024-05-08T20:27:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.107+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fc14c074950 con 0x7fc14c159b40 2024-05-08T20:27:25.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc1427fc640 1 -- 172.21.15.81:0/31800607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v20) v1 ==== 95+0+11 (secure 0 0 0) 0x7fc13c0ee620 con 0x7fc14c159b40 2024-05-08T20:27:25.115 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 msgr2=0x7fc130068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 0x7fc130068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc148005510 tx=0x7fc148009040 comp rx=0 tx=0).stop 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 msgr2=0x7fc14c06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc13c01ca60 tx=0x7fc138005800 comp rx=0 tx=0).stop 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 shutdown_connections 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc1300666c0 0x7fc130068b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc14c14dab0 0x7fc14c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc14c159b40 0x7fc14c06c3b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 --2- 172.21.15.81:0/31800607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc138003f30 0x7fc14c1eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 >> 172.21.15.81:0/31800607 conn(0x7fc14c0c2ca0 msgr2=0x7fc14c0ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 shutdown_connections 2024-05-08T20:27:25.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.111+0000 7fc153dfb640 1 -- 172.21.15.81:0/31800607 wait complete. 2024-05-08T20:27:25.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T20:27:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.231+0000 7f743ad25640 1 Processor -- start 2024-05-08T20:27:25.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.231+0000 7f743ad25640 1 -- start start 2024-05-08T20:27:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f743ad25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74340725f0 0x7f74340c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f743ad25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f743406f400 0x7f74340c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f743ad25640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340c0650 con 0x7f74341501e0 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f743ad25640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743406fd60 con 0x7f743406f400 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f743ad25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7434072180 con 0x7f74340725f0 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f743406f400 0x7f74340c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f743406f400 0x7f74340c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55080/0 (socket says 172.21.15.81:55080) 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 -- 172.21.15.81:0/3381352249 learned_addr learned my addr 172.21.15.81:0/3381352249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 -- 172.21.15.81:0/3381352249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74340725f0 msgr2=0x7f74340c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 --2- 172.21.15.81:0/3381352249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74340725f0 0x7f74340c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 -- 172.21.15.81:0/3381352249 >> v1:172.21.15.117:6789/0 conn(0x7f74341501e0 legacy=0x7f743406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:25.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 -- 172.21.15.81:0/3381352249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743406fa80 con 0x7f743406f400 2024-05-08T20:27:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.235+0000 7f74392c2640 1 --2- 172.21.15.81:0/3381352249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743406f400 0x7f74340c2180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7424009870 tx=0x7f742401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aefa8676c9a790 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74337fe640 1 -- 172.21.15.81:0/3381352249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240ab600 con 0x7f743406f400 2024-05-08T20:27:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74337fe640 1 -- 172.21.15.81:0/3381352249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240a7050 con 0x7f743406f400 2024-05-08T20:27:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74337fe640 1 -- 172.21.15.81:0/3381352249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240ab980 con 0x7f743406f400 2024-05-08T20:27:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/3381352249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743406f400 msgr2=0x7f74340c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- 172.21.15.81:0/3381352249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743406f400 0x7f74340c2180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7424009870 tx=0x7f742401c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/3381352249 shutdown_connections 2024-05-08T20:27:25.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- 172.21.15.81:0/3381352249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743406f400 0x7f74340c2180 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- 172.21.15.81:0/3381352249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74340725f0 0x7f74340c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/3381352249 >> 172.21.15.81:0/3381352249 conn(0x7f74340c2ca0 msgr2=0x7f74340c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/3381352249 shutdown_connections 2024-05-08T20:27:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/3381352249 wait complete. 2024-05-08T20:27:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 Processor -- start 2024-05-08T20:27:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- start start 2024-05-08T20:27:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f743406f400 0x7f743413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74340725f0 0x7f7434140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743413c630 con 0x7f74341501e0 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743413c350 con 0x7f74340725f0 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743413df10 con 0x7f743406f400 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55088/0 (socket says 172.21.15.81:55088) 2024-05-08T20:27:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 -- 172.21.15.81:0/2778262417 learned_addr learned my addr 172.21.15.81:0/2778262417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 -- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f743406f400 msgr2=0x7f743413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f7438ac1640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f743406f400 0x7f743413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f7433fff640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74340725f0 0x7f7434140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f743406f400 0x7f743413fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 -- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74340725f0 msgr2=0x7f7434140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74340725f0 0x7f7434140100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 -- 172.21.15.81:0/2778262417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240094d0 con 0x7f74341501e0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74392c2640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f742401aa80 tx=0x7f7424019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240b4440 con 0x7f74341501e0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240b45a0 con 0x7f74341501e0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434150740 con 0x7f74341501e0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74240b4910 con 0x7f74341501e0 2024-05-08T20:27:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.239+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74340c57f0 con 0x7f74341501e0 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743413dd70 con 0x7f74341501e0 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74240b2070 con 0x7f74341501e0 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f74317fa640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 0x7f7414068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f742411e030 con 0x7f74341501e0 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f7438ac1640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 0x7f7414068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.243+0000 7f7438ac1640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 0x7f7414068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74341efd90 tx=0x7f741c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.247+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f743413dd70 con 0x7f74341501e0 2024-05-08T20:27:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.391+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74341ecdf0 con 0x7f74341501e0 2024-05-08T20:27:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.391+0000 7f74317fa640 1 -- 172.21.15.81:0/2778262417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+197 (secure 0 0 0) 0x7f74240b00e0 con 0x7f74341501e0 2024-05-08T20:27:25.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:25.398 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-05-08T20:27:25.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:27:25.398 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 2, 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "a_metadata" 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 3, 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": "a_data" 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:27:25.399 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-05-08T20:27:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 msgr2=0x7f7414068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 0x7f7414068b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74341efd90 tx=0x7f741c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 msgr2=0x7f743413b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f742401aa80 tx=0x7f7424019170 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 shutdown_connections 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f74140666c0 0x7f7414068b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74341501e0 0x7f743413b6f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74340725f0 0x7f7434140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 --2- 172.21.15.81:0/2778262417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f743406f400 0x7f743413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 >> 172.21.15.81:0/2778262417 conn(0x7f74340c2ca0 msgr2=0x7f74340c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 shutdown_connections 2024-05-08T20:27:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.395+0000 7f743ad25640 1 -- 172.21.15.81:0/2778262417 wait complete. 2024-05-08T20:27:25.415 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-05-08T20:27:25.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-05-08T20:27:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.531+0000 7fb64a818640 1 Processor -- start 2024-05-08T20:27:25.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.531+0000 7fb64a818640 1 -- start start 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb64a818640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb64414ff30 0x7fb64406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb64a818640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb64406be50 0x7fb6440ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb64a818640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64406c610 con 0x7fb64406b3f0 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb64a818640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64406cb40 con 0x7fb64414ff30 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb64a818640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb644153530 con 0x7fb64406be50 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb64414ff30 0x7fb64406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb64414ff30 0x7fb64406f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55098/0 (socket says 172.21.15.81:55098) 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 -- 172.21.15.81:0/1311014695 learned_addr learned my addr 172.21.15.81:0/1311014695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb648db5640 1 --2- 172.21.15.81:0/1311014695 >> v2:172.21.15.117:3300/0 conn(0x7fb64406be50 0x7fb6440ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 -- 172.21.15.81:0/1311014695 >> v2:172.21.15.117:3300/0 conn(0x7fb64406be50 msgr2=0x7fb6440ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 --2- 172.21.15.81:0/1311014695 >> v2:172.21.15.117:3300/0 conn(0x7fb64406be50 0x7fb6440ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 -- 172.21.15.81:0/1311014695 >> v1:172.21.15.81:6789/0 conn(0x7fb64406b3f0 legacy=0x7fb64406cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb642ffd640 1 -- 172.21.15.81:0/1311014695 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823424091 0 0) 0x7fb64406c610 con 0x7fb64406b3f0 2024-05-08T20:27:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.535+0000 7fb643fff640 1 -- 172.21.15.81:0/1311014695 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644150310 con 0x7fb64414ff30 2024-05-08T20:27:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb643fff640 1 --2- 172.21.15.81:0/1311014695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb64406f190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb64406d860 tx=0x7fb63401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefd8d4bd49c8340 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb642ffd640 1 -- 172.21.15.81:0/1311014695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340ab600 con 0x7fb64414ff30 2024-05-08T20:27:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb642ffd640 1 -- 172.21.15.81:0/1311014695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340ab760 con 0x7fb64414ff30 2024-05-08T20:27:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb642ffd640 1 -- 172.21.15.81:0/1311014695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340abaf0 con 0x7fb64414ff30 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- 172.21.15.81:0/1311014695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 msgr2=0x7fb64406f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- 172.21.15.81:0/1311014695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb64406f190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb64406d860 tx=0x7fb63401c400 comp rx=0 tx=0).stop 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- 172.21.15.81:0/1311014695 shutdown_connections 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- 172.21.15.81:0/1311014695 >> v2:172.21.15.117:3300/0 conn(0x7fb64406be50 0x7fb6440ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- 172.21.15.81:0/1311014695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb64406f190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- 172.21.15.81:0/1311014695 >> 172.21.15.81:0/1311014695 conn(0x7fb6440c2d10 msgr2=0x7fb6440c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- 172.21.15.81:0/1311014695 shutdown_connections 2024-05-08T20:27:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- 172.21.15.81:0/1311014695 wait complete. 2024-05-08T20:27:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 Processor -- start 2024-05-08T20:27:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- start start 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 0x7fb6440bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb644156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440ab490 con 0x7fb64414ff30 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c3e00 con 0x7fb64406be50 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb64a818640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb644156650 con 0x7fb64406b3f0 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb643fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 0x7fb6440bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb6437fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:45520/0 (socket says 172.21.15.81:45520) 2024-05-08T20:27:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.539+0000 7fb6437fe640 1 -- 172.21.15.81:0/991804585 learned_addr learned my addr 172.21.15.81:0/991804585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb648db5640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb644156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 -- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 msgr2=0x7fb644155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 -- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 msgr2=0x7fb644156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb644156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 -- 172.21.15.81:0/991804585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340094d0 con 0x7fb64406b3f0 2024-05-08T20:27:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb6437fe640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:25.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.543+0000 7fb643fff640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 0x7fb6440bf8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb64406adb0 tx=0x7fb63401ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340abce0 con 0x7fb64406b3f0 2024-05-08T20:27:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340b8070 con 0x7fb64406b3f0 2024-05-08T20:27:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440a9980 con 0x7fb64406b3f0 2024-05-08T20:27:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634004270 con 0x7fb64406b3f0 2024-05-08T20:27:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440a9f40 con 0x7fb64406b3f0 2024-05-08T20:27:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644074950 con 0x7fb64406b3f0 2024-05-08T20:27:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6340043d0 con 0x7fb64406b3f0 2024-05-08T20:27:25.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb640ff9640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 0x7fb630068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:25.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.547+0000 7fb6437fe640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 0x7fb630068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:25.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.551+0000 7fb6437fe640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 0x7fb630068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6441ee610 tx=0x7fb638009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:25.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.555+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fb6340abe40 con 0x7fb64406b3f0 2024-05-08T20:27:25.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.567+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb6340eb8a0 con 0x7fb64406b3f0 2024-05-08T20:27:25.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:25.723+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb6440c3b20 con 0x7fb64406b3f0 2024-05-08T20:27:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.567+0000 7fb640ff9640 1 -- 172.21.15.81:0/991804585 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v21) v1 ==== 128+0+0 (secure 0 0 0) 0x7fb6340ba070 con 0x7fb64406b3f0 2024-05-08T20:27:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'b_metadata' created 2024-05-08T20:27:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 msgr2=0x7fb630068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 0x7fb630068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6441ee610 tx=0x7fb638009040 comp rx=0 tx=0).stop 2024-05-08T20:27:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 msgr2=0x7fb6440bf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 0x7fb6440bf8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb64406adb0 tx=0x7fb63401ac40 comp rx=0 tx=0).stop 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 shutdown_connections 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb630066690 0x7fb630068b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb64414ff30 0x7fb644156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb64406be50 0x7fb644155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 --2- 172.21.15.81:0/991804585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb64406b3f0 0x7fb6440bf8a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 >> 172.21.15.81:0/991804585 conn(0x7fb6440c2d10 msgr2=0x7fb644151160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 shutdown_connections 2024-05-08T20:27:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.575+0000 7fb64a818640 1 -- 172.21.15.81:0/991804585 wait complete. 2024-05-08T20:27:26.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T20:27:26.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 Processor -- start 2024-05-08T20:27:26.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 -- start start 2024-05-08T20:27:26.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c740c30d0 0x7f2c740c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 0x7f2c740c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 0x7f2c740a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7406e790 con 0x7f2c740c30d0 2024-05-08T20:27:26.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7406f460 con 0x7f2c740c2bc0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7c7fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74155e10 con 0x7f2c740a94b0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c740c30d0 0x7f2c740c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c740c30d0 0x7f2c740c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55118/0 (socket says 172.21.15.81:55118) 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 -- 172.21.15.81:0/2623282497 learned_addr learned my addr 172.21.15.81:0/2623282497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7ad99640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 0x7f2c740a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c79d97640 1 --2- 172.21.15.81:0/2623282497 >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 0x7f2c740c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 -- 172.21.15.81:0/2623282497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 msgr2=0x7f2c740a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 0x7f2c740a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 -- 172.21.15.81:0/2623282497 >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 msgr2=0x7f2c740c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2623282497 >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 0x7f2c740c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7a598640 1 -- 172.21.15.81:0/2623282497 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740a9e20 con 0x7f2c740c30d0 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c7ad99640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 0x7f2c740a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:26.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.727+0000 7f2c79d97640 1 --2- 172.21.15.81:0/2623282497 >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 0x7f2c740c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:26.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c30d0 0x7f2c740c34b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2c74071050 tx=0x7f2c7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23532b59c539fbe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:26.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c79596640 1 -- 172.21.15.81:0/2623282497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700ab620 con 0x7f2c740c30d0 2024-05-08T20:27:26.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c79596640 1 -- 172.21.15.81:0/2623282497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c700ab780 con 0x7f2c740c30d0 2024-05-08T20:27:26.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c79596640 1 -- 172.21.15.81:0/2623282497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700abb10 con 0x7f2c740c30d0 2024-05-08T20:27:26.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2623282497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c30d0 msgr2=0x7f2c740c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:26.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c30d0 0x7f2c740c34b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2c74071050 tx=0x7f2c7001c460 comp rx=0 tx=0).stop 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2623282497 shutdown_connections 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740a94b0 0x7f2c740a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2623282497 >> v2:172.21.15.117:3300/0 conn(0x7f2c740c2bc0 0x7f2c740c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2623282497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c30d0 0x7f2c740c34b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2623282497 >> 172.21.15.81:0/2623282497 conn(0x7f2c740c4cc0 msgr2=0x7f2c740c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2623282497 shutdown_connections 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.731+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2623282497 wait complete. 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 Processor -- start 2024-05-08T20:27:26.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- start start 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c740a94b0 0x7f2c741f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740c30d0 0x7f2c74141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740c7230 con 0x7f2c740c2bc0 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7406b8a0 con 0x7f2c740a94b0 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741f1420 con 0x7f2c740c30d0 2024-05-08T20:27:26.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55126/0 (socket says 172.21.15.81:55126) 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 -- 172.21.15.81:0/2335303261 learned_addr learned my addr 172.21.15.81:0/2335303261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7ad99640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740c30d0 0x7f2c74141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c740a94b0 0x7f2c741f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 -- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740c30d0 msgr2=0x7f2c74141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740c30d0 0x7f2c74141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 -- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c740a94b0 msgr2=0x7f2c741f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c740a94b0 0x7f2c741f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 -- 172.21.15.81:0/2335303261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700094d0 con 0x7f2c740c2bc0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c79d97640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e810 tx=0x7f2c6400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400c6d0 con 0x7f2c740c2bc0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400c830 con 0x7f2c740c2bc0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400cbe0 con 0x7f2c740c2bc0 2024-05-08T20:27:26.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740c6410 con 0x7f2c740c2bc0 2024-05-08T20:27:26.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c740c69d0 con 0x7f2c740c2bc0 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.735+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7406ba10 con 0x7f2c740c2bc0 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.739+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c6400cd40 con 0x7f2c740c2bc0 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.739+0000 7f2c6affd640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 0x7f2c58068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.739+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6054+0+0 (secure 0 0 0) 0x7f2c64084470 con 0x7f2c740c2bc0 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.739+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 0x7f2c58068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:26.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.739+0000 7f2c7a598640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 0x7f2c58068b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c700af000 tx=0x7f2c70004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.743+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2c64051760 con 0x7f2c740c2bc0 2024-05-08T20:27:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:26.907+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2c74074950 con 0x7f2c740c2bc0 2024-05-08T20:27:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.579+0000 7f2c6affd640 1 -- 172.21.15.81:0/2335303261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v22) v1 ==== 160+0+0 (secure 0 0 0) 0x7f2c6405b030 con 0x7f2c740c2bc0 2024-05-08T20:27:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'b_data' created 2024-05-08T20:27:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.587+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 msgr2=0x7f2c58068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.587+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 0x7f2c58068b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c700af000 tx=0x7f2c70004740 comp rx=0 tx=0).stop 2024-05-08T20:27:27.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.587+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 msgr2=0x7f2c7415b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.587+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e810 tx=0x7f2c6400ecd0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 shutdown_connections 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c580666c0 0x7f2c58068b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c740c30d0 0x7f2c74141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c740c2bc0 0x7f2c7415b740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 --2- 172.21.15.81:0/2335303261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c740a94b0 0x7f2c741f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 >> 172.21.15.81:0/2335303261 conn(0x7f2c740c4cc0 msgr2=0x7f2c7406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:27.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 shutdown_connections 2024-05-08T20:27:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.591+0000 7f2c7c7fc640 1 -- 172.21.15.81:0/2335303261 wait complete. 2024-05-08T20:27:27.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-05-08T20:27:27.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 Processor -- start 2024-05-08T20:27:27.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 -- start start 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d9c0a9bc0 0x7f8d9c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c155e10 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c156080 con 0x7f8d9c0c2bc0 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da312c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c06e790 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da16c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8d9c0a9bc0 0x7f8d9c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da0ec8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d9c0c30d0 0x7f8d9c0c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52786/0 (socket says 172.21.15.81:52786) 2024-05-08T20:27:27.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da0ec8640 1 -- 172.21.15.81:0/1516360611 learned_addr learned my addr 172.21.15.81:0/1516360611 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da16c9640 1 -- 172.21.15.81:0/1516360611 >> v1:172.21.15.117:6789/0 conn(0x7f8d9c0c2bc0 legacy=0x7f8d9c0a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da16c9640 1 -- 172.21.15.81:0/1516360611 >> v1:172.21.15.81:6789/0 conn(0x7f8d9c0c30d0 legacy=0x7f8d9c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da16c9640 1 -- 172.21.15.81:0/1516360611 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c156360 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8d9b7fe640 1 -- 172.21.15.81:0/1516360611 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353670971 0 0) 0x7f8d9c155e10 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.743+0000 7f8da16c9640 1 --2- 172.21.15.81:0/1516360611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c0c34b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009d90 tx=0x7f8d9401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31661f7389dc387 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d9b7fe640 1 -- 172.21.15.81:0/1516360611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940a5870 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d9b7fe640 1 -- 172.21.15.81:0/1516360611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940a59d0 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d9b7fe640 1 -- 172.21.15.81:0/1516360611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940a5d60 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1516360611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0a9bc0 msgr2=0x7f8d9c0c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 --2- 172.21.15.81:0/1516360611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c0c34b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009d90 tx=0x7f8d9401c8a0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1516360611 shutdown_connections 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 --2- 172.21.15.81:0/1516360611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c0c34b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1516360611 >> 172.21.15.81:0/1516360611 conn(0x7f8d9c0c4cc0 msgr2=0x7f8d9c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1516360611 shutdown_connections 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1516360611 wait complete. 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 Processor -- start 2024-05-08T20:27:27.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- start start 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c0c2bc0 0x7f8d9c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0c25d0 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c1ef5f0 con 0x7f8d9c0a9bc0 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0ab410 con 0x7f8d9c0c2bc0 2024-05-08T20:27:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55140/0 (socket says 172.21.15.81:55140) 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 -- 172.21.15.81:0/1560906874 learned_addr learned my addr 172.21.15.81:0/1560906874 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da0ec8640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d9bfff640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c0c2bc0 0x7f8d9c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 -- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c0c2bc0 msgr2=0x7f8d9c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c0c2bc0 0x7f8d9c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 -- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c0a9bc0 msgr2=0x7f8d9c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 -- 172.21.15.81:0/1560906874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009a70 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da16c9640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8d940b0040 tx=0x7f8d94019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940ad850 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d940ad9b0 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c0c27e0 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940add20 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.747+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c155b50 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c074950 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d940b4050 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8d997fa640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 0x7f8d80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8d9411f720 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8da0ec8640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 0x7f8d80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.751+0000 7f8da0ec8640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 0x7f8d80068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000f70 tx=0x7f8d90007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.755+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8d940ec8a0 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.947+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) v1 -- 0x7f8d9c072600 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.955+0000 7f8d997fa640 1 -- 172.21.15.81:0/1560906874 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8d940efec0 con 0x7f8d9c0c30d0 2024-05-08T20:27:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 4 and data pool 5 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 msgr2=0x7f8d80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 0x7f8d80068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000f70 tx=0x7f8d90007b60 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 msgr2=0x7f8d9c1ee8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8d940b0040 tx=0x7f8d94019640 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 shutdown_connections 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d80066690 0x7f8d80068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d9c0c30d0 0x7f8d9c1ee8a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d9c0c2bc0 0x7f8d9c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 --2- 172.21.15.81:0/1560906874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d9c0a9bc0 0x7f8d9c142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 >> 172.21.15.81:0/1560906874 conn(0x7f8d9c0c4cc0 msgr2=0x7f8d9c14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 shutdown_connections 2024-05-08T20:27:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:27.959+0000 7f8da312c640 1 -- 172.21.15.81:0/1560906874 wait complete. 2024-05-08T20:27:27.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 Processor -- start 2024-05-08T20:27:28.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 -- start start 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f583c0c1bb0 0x7f583c151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c1535a0 0x7f583c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0c2420 con 0x7f583c0c1f90 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c155060 con 0x7f583c0c1bb0 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584418f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c155340 con 0x7f583c1535a0 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f583c0c1bb0 0x7f583c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f583c0c1bb0 0x7f583c151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55150/0 (socket says 172.21.15.81:55150) 2024-05-08T20:27:28.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 -- 172.21.15.81:0/1402102680 learned_addr learned my addr 172.21.15.81:0/1402102680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f584272c640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c1535a0 0x7f583c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 -- 172.21.15.81:0/1402102680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c1535a0 msgr2=0x7f583c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c1535a0 0x7f583c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 -- 172.21.15.81:0/1402102680 >> v1:172.21.15.117:6789/0 conn(0x7f583c0c1f90 legacy=0x7f583c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.103+0000 7f5841f2b640 1 -- 172.21.15.81:0/1402102680 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c155620 con 0x7f583c0c1bb0 2024-05-08T20:27:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f5841f2b640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c0c1bb0 0x7f583c151740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5838009870 tx=0x7f583801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d472b0a2198d5f3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f5840f29640 1 -- 172.21.15.81:0/1402102680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380ab680 con 0x7f583c0c1bb0 2024-05-08T20:27:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f5840f29640 1 -- 172.21.15.81:0/1402102680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380ab7e0 con 0x7f583c0c1bb0 2024-05-08T20:27:28.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f5840f29640 1 -- 172.21.15.81:0/1402102680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380abb70 con 0x7f583c0c1bb0 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- 172.21.15.81:0/1402102680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c0c1bb0 msgr2=0x7f583c151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c0c1bb0 0x7f583c151740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5838009870 tx=0x7f583801c4a0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- 172.21.15.81:0/1402102680 shutdown_connections 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c1535a0 0x7f583c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 --2- 172.21.15.81:0/1402102680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c0c1bb0 0x7f583c151740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- 172.21.15.81:0/1402102680 >> 172.21.15.81:0/1402102680 conn(0x7f583c0c2ca0 msgr2=0x7f583c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- 172.21.15.81:0/1402102680 shutdown_connections 2024-05-08T20:27:28.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- 172.21.15.81:0/1402102680 wait complete. 2024-05-08T20:27:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 Processor -- start 2024-05-08T20:27:28.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.107+0000 7f584418f640 1 -- start start 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0c1bb0 0x7f583c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0c1f90 0x7f583c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1514e0 con 0x7f583c1535a0 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1508d0 con 0x7f583c0c1bb0 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c5aa0 con 0x7f583c0c1f90 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55158/0 (socket says 172.21.15.81:55158) 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 -- 172.21.15.81:0/4161479158 learned_addr learned my addr 172.21.15.81:0/4161479158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584172a640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0c1f90 0x7f583c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f5841f2b640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0c1bb0 0x7f583c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 -- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0c1f90 msgr2=0x7f583c14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0c1f90 0x7f583c14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 -- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0c1bb0 msgr2=0x7f583c14f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0c1bb0 0x7f583c14f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 -- 172.21.15.81:0/4161479158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380094d0 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584272c640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5834007e70 tx=0x7f583400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834014620 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58340147a0 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c150b40 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834014b50 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c151100 con 0x7f583c1535a0 2024-05-08T20:27:28.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c074950 con 0x7f583c1535a0 2024-05-08T20:27:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5834014cb0 con 0x7f583c1535a0 2024-05-08T20:27:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 0x7f5820068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5834084d80 con 0x7f583c1535a0 2024-05-08T20:27:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f5841f2b640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 0x7f5820068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.111+0000 7f5841f2b640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 0x7f5820068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58380af000 tx=0x7f58380a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.115+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5834051e50 con 0x7f583c1535a0 2024-05-08T20:27:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.279+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f583c0c39a0 con 0x7f583c1535a0 2024-05-08T20:27:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.279+0000 7f58327fc640 1 -- 172.21.15.81:0/4161479158 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+19722 (secure 0 0 0) 0x7f5834055470 con 0x7f583c1535a0 2024-05-08T20:27:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:28.286 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:27.952703+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 msgr2=0x7f5820068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 0x7f5820068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58380af000 tx=0x7f58380a7000 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 msgr2=0x7f583c14e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5834007e70 tx=0x7f583400e4b0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 shutdown_connections 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5820066690 0x7f5820068b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c1535a0 0x7f583c14e840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0c1f90 0x7f583c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 --2- 172.21.15.81:0/4161479158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0c1bb0 0x7f583c14f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 >> 172.21.15.81:0/4161479158 conn(0x7f583c0c2ca0 msgr2=0x7f583c151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 shutdown_connections 2024-05-08T20:27:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.283+0000 7f584418f640 1 -- 172.21.15.81:0/4161479158 wait complete. 2024-05-08T20:27:28.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 Processor -- start 2024-05-08T20:27:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 -- start start 2024-05-08T20:27:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 0x7f7a4c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 0x7f7a4c0bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c155a20 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0aa830 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a535a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c072900 con 0x7f7a4c1521f0 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55162/0 (socket says 172.21.15.81:55162) 2024-05-08T20:27:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 -- 172.21.15.81:0/1921738564 learned_addr learned my addr 172.21.15.81:0/1921738564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a51345640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 0x7f7a4c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a51b46640 1 --2- 172.21.15.81:0/1921738564 >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 0x7f7a4c0bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 -- 172.21.15.81:0/1921738564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 msgr2=0x7f7a4c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 0x7f7a4c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 -- 172.21.15.81:0/1921738564 >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 msgr2=0x7f7a4c0bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1921738564 >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 0x7f7a4c0bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 -- 172.21.15.81:0/1921738564 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0c0640 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a51345640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 0x7f7a4c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a51b46640 1 --2- 172.21.15.81:0/1921738564 >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 0x7f7a4c0bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.419+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c072c40 tx=0x7f7a4801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f902b55bdd9a5227 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a43fff640 1 -- 172.21.15.81:0/1921738564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ac630 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a43fff640 1 -- 172.21.15.81:0/1921738564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480ac790 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a43fff640 1 -- 172.21.15.81:0/1921738564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480acb20 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1921738564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0c1bb0 msgr2=0x7f7a4c0c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c072c40 tx=0x7f7a4801c520 comp rx=0 tx=0).stop 2024-05-08T20:27:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1921738564 shutdown_connections 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1921738564 >> v2:172.21.15.117:3300/0 conn(0x7f7a4c0bf9b0 0x7f7a4c0bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0c1bb0 0x7f7a4c0c2010 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1921738564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c1521f0 0x7f7a4c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1921738564 >> 172.21.15.81:0/1921738564 conn(0x7f7a4c0c2ca0 msgr2=0x7f7a4c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1921738564 shutdown_connections 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1921738564 wait complete. 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 Processor -- start 2024-05-08T20:27:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- start start 2024-05-08T20:27:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c0c1bb0 0x7f7a4c1456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 0x7f7a4c0c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c145510 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c1ed7f0 con 0x7f7a4c1521f0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c14a9f0 con 0x7f7a4c0c1bb0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55168/0 (socket says 172.21.15.81:55168) 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 -- 172.21.15.81:0/1152346663 learned_addr learned my addr 172.21.15.81:0/1152346663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c0c1bb0 0x7f7a4c1456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51b46640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 0x7f7a4c0c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 -- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c0c1bb0 msgr2=0x7f7a4c1456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c0c1bb0 0x7f7a4c1456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 -- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 msgr2=0x7f7a4c0c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 0x7f7a4c0c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 -- 172.21.15.81:0/1152346663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480094d0 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51b46640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 0x7f7a4c0c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a51345640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c7c0 tx=0x7f7a3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c007a30 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c007b90 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c14acd0 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00ce70 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.423+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c146c00 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c14a850 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a3c0113f0 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a41ffb640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 0x7f7a30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7a3c0848d0 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 0x7f7a30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.427+0000 7f7a50b44640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 0x7f7a30068b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a480ae000 tx=0x7f7a48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.431+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7a4c14a850 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.591+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a4c14a850 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.591+0000 7f7a41ffb640 1 -- 172.21.15.81:0/1152346663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+19722 (secure 0 0 0) 0x7f7a4c14a850 con 0x7f7a4c0bf9b0 2024-05-08T20:27:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:28.599 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:27.952703+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:28.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 msgr2=0x7f7a30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 0x7f7a30068b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a480ae000 tx=0x7f7a48008040 comp rx=0 tx=0).stop 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 msgr2=0x7f7a4c14b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c7c0 tx=0x7f7a3c00cc80 comp rx=0 tx=0).stop 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 shutdown_connections 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7a30066690 0x7f7a30068b50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a4c1521f0 0x7f7a4c0c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a4c0c1bb0 0x7f7a4c1456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 --2- 172.21.15.81:0/1152346663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4c0bf9b0 0x7f7a4c14b4d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 >> 172.21.15.81:0/1152346663 conn(0x7f7a4c0c2ca0 msgr2=0x7f7a4c158890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 shutdown_connections 2024-05-08T20:27:28.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.595+0000 7f7a535a9640 1 -- 172.21.15.81:0/1152346663 wait complete. 2024-05-08T20:27:28.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-05-08T20:27:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 Processor -- start 2024-05-08T20:27:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 -- start start 2024-05-08T20:27:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040c2420 con 0x7f8d040c1f90 2024-05-08T20:27:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d04155060 con 0x7f8d040c1bb0 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d0a8a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04155340 con 0x7f8d041535a0 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d03fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:34994/0 (socket says 172.21.15.81:34994) 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d03fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33002/0 (socket says 172.21.15.81:33002) 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 -- 172.21.15.81:0/660013133 learned_addr learned my addr 172.21.15.81:0/660013133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d037fe640 1 --1- 172.21.15.81:0/660013133 >> v1:172.21.15.117:6789/0 conn(0x7f8d040c1f90 0x7f8d04152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45396/0 (socket says 172.21.15.81:45396) 2024-05-08T20:27:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 -- 172.21.15.81:0/660013133 >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 msgr2=0x7f8d04151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 --2- 172.21.15.81:0/660013133 >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 -- 172.21.15.81:0/660013133 >> v1:172.21.15.117:6789/0 conn(0x7f8d040c1f90 legacy=0x7f8d04152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d08e42640 1 -- 172.21.15.81:0/660013133 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04155620 con 0x7f8d041535a0 2024-05-08T20:27:28.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.730+0000 7f8d03fff640 1 --2- 172.21.15.81:0/660013133 >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d08e42640 1 --2- 172.21.15.81:0/660013133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009e50 tx=0x7f8cfc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6403ace6ca8b9cf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d02ffd640 1 -- 172.21.15.81:0/660013133 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a5810 con 0x7f8d041535a0 2024-05-08T20:27:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d02ffd640 1 -- 172.21.15.81:0/660013133 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0a5970 con 0x7f8d041535a0 2024-05-08T20:27:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d02ffd640 1 -- 172.21.15.81:0/660013133 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a5d00 con 0x7f8d041535a0 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/660013133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 msgr2=0x7f8d0415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/660013133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009e50 tx=0x7f8cfc01c970 comp rx=0 tx=0).stop 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/660013133 shutdown_connections 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/660013133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d0415c080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/660013133 >> v2:172.21.15.117:3300/0 conn(0x7f8d040c1bb0 0x7f8d04151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/660013133 >> 172.21.15.81:0/660013133 conn(0x7f8d040c2ca0 msgr2=0x7f8d040c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/660013133 shutdown_connections 2024-05-08T20:27:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/660013133 wait complete. 2024-05-08T20:27:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.734+0000 7f8d0a8a5640 1 Processor -- start 2024-05-08T20:27:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- start start 2024-05-08T20:27:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d040c1bb0 0x7f8d040bd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d041ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0406ba60 con 0x7f8d040c1f90 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0406bf20 con 0x7f8d040c1bb0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d041583b0 con 0x7f8d041535a0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38688/0 (socket says 172.21.15.81:38688) 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 -- 172.21.15.81:0/409201144 learned_addr learned my addr 172.21.15.81:0/409201144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d08e42640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d041ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d03fff640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d040c1bb0 0x7f8d040bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 -- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 msgr2=0x7f8d041ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d041ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 -- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d040c1bb0 msgr2=0x7f8d040bd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d040c1bb0 0x7f8d040bd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 -- 172.21.15.81:0/409201144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009420 con 0x7f8d040c1f90 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d037fe640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800c3a0 tx=0x7f8cf800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80074e0 con 0x7f8d040c1f90 2024-05-08T20:27:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8007640 con 0x7f8d040c1f90 2024-05-08T20:27:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc009b30 con 0x7f8d040c1f90 2024-05-08T20:27:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8004a30 con 0x7f8d040c1f90 2024-05-08T20:27:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d041ef0e0 con 0x7f8d040c1f90 2024-05-08T20:27:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d04074950 con 0x7f8d040c1f90 2024-05-08T20:27:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cf8004b90 con 0x7f8d040c1f90 2024-05-08T20:27:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 0x7f8cf0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8cf8083c50 con 0x7f8d040c1f90 2024-05-08T20:27:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.738+0000 7f8d03fff640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 0x7f8cf0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.742+0000 7f8d03fff640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 0x7f8cf0068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d040c0920 tx=0x7f8cf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.746+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8cf8089020 con 0x7f8d040c1f90 2024-05-08T20:27:28.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.938+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d04156a60 con 0x7f8d040c1f90 2024-05-08T20:27:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.966+0000 7f8d00ff9640 1 -- 172.21.15.81:0/409201144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 113+0+0 (secure 0 0 0) 0x7f8cf8050d20 con 0x7f8d040c1f90 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.966+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 msgr2=0x7f8cf0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.966+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 0x7f8cf0068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d040c0920 tx=0x7f8cf4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 msgr2=0x7f8d04156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800c3a0 tx=0x7f8cf800c860 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 shutdown_connections 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cf00666c0 0x7f8cf0068b80 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d040c0920 tx=0x7f8cf4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d041535a0 0x7f8d041ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d040c1f90 0x7f8d04156d00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 --2- 172.21.15.81:0/409201144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d040c1bb0 0x7f8d040bd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 >> 172.21.15.81:0/409201144 conn(0x7f8d040c2ca0 msgr2=0x7f8d0414e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:28.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 shutdown_connections 2024-05-08T20:27:28.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:28.970+0000 7f8d0a8a5640 1 -- 172.21.15.81:0/409201144 wait complete. 2024-05-08T20:27:28.991 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-08T20:27:28.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-05-08T20:27:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 Processor -- start 2024-05-08T20:27:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 -- start start 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f90b006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90b006f400 0x7f90b00c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b00c0650 con 0x7f90b00725f0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b006fd60 con 0x7f90b006f400 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90b66c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0072180 con 0x7f90b01501e0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90af7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90b00725f0 0x7f90b00c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53548/0 (socket says 172.21.15.81:53548) 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.102+0000 7f90af7fe640 1 -- 172.21.15.81:0/1647921581 learned_addr learned my addr 172.21.15.81:0/1647921581 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448556409 0 0) 0x7f90b00c0650 con 0x7f90b00725f0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9098003530 con 0x7f90b00725f0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90affff640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f90b006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b4c66640 1 --2- 172.21.15.81:0/1647921581 >> v2:172.21.15.117:3300/0 conn(0x7f90b006f400 0x7f90b00c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3218282423 0 0) 0x7f9098003530 con 0x7f90b00725f0 2024-05-08T20:27:29.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 msgr2=0x7f90b006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f90b006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 >> v2:172.21.15.117:3300/0 conn(0x7f90b006f400 msgr2=0x7f90b00c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 --2- 172.21.15.81:0/1647921581 >> v2:172.21.15.117:3300/0 conn(0x7f90b006f400 0x7f90b00c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b006fa80 con 0x7f90b00725f0 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f90a4001680 con 0x7f90b00725f0 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 >> v1:172.21.15.81:6789/0 conn(0x7f90b00725f0 legacy=0x7f90b00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9098003980 0x7f9098003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f9098004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f9098005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b006fd60 con 0x7f90980047d0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0072180 con 0x7f9098003980 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909800ba10 con 0x7f90b01501e0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f9098004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90affff640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9098003980 0x7f9098003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b4c66640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f9098005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 -- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 msgr2=0x7f9098005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01501e0 0x7f9098005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 -- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9098003980 msgr2=0x7f9098003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9098003980 0x7f9098003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 -- 172.21.15.81:0/1647921581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098003530 con 0x7f90980047d0 2024-05-08T20:27:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90affff640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9098003980 0x7f9098003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90af7fe640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f9098004c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c240 tx=0x7f90a401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be00fcb96da0128 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40a5950 con 0x7f90980047d0 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a40a5ab0 con 0x7f90980047d0 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90aeffd640 1 -- 172.21.15.81:0/1647921581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40a5c80 con 0x7f90980047d0 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 -- 172.21.15.81:0/1647921581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 msgr2=0x7f9098004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 --2- 172.21.15.81:0/1647921581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f9098004c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c240 tx=0x7f90a401cc50 comp rx=0 tx=0).stop 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b4c66640 1 -- 172.21.15.81:0/1647921581 reap_dead start 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 -- 172.21.15.81:0/1647921581 shutdown_connections 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 -- 172.21.15.81:0/1647921581 >> 172.21.15.81:0/1647921581 conn(0x7f90b00c2ca0 msgr2=0x7f90b00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 -- 172.21.15.81:0/1647921581 shutdown_connections 2024-05-08T20:27:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.106+0000 7f90b66c9640 1 -- 172.21.15.81:0/1647921581 wait complete. 2024-05-08T20:27:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 Processor -- start 2024-05-08T20:27:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- start start 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01edc70 0x7f90b0144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00a9c40 0x7f90b00c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b015c2d0 con 0x7f90980047d0 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00aa9f0 con 0x7f90b00a9c40 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00bf740 con 0x7f90b01edc70 2024-05-08T20:27:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38708/0 (socket says 172.21.15.81:38708) 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 -- 172.21.15.81:0/3977128989 learned_addr learned my addr 172.21.15.81:0/3977128989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90af7fe640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01edc70 0x7f90b0144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b4c66640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00a9c40 0x7f90b00c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 -- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01edc70 msgr2=0x7f90b0144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01edc70 0x7f90b0144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 -- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00a9c40 msgr2=0x7f90b00c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00a9c40 0x7f90b00c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 -- 172.21.15.81:0/3977128989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0150740 con 0x7f90980047d0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90affff640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90a000f380 tx=0x7f90a000f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003ba0 con 0x7f90980047d0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0011040 con 0x7f90980047d0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0004020 con 0x7f90980047d0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b01ed3b0 con 0x7f90980047d0 2024-05-08T20:27:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.110+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b00a9740 con 0x7f90980047d0 2024-05-08T20:27:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0074950 con 0x7f90980047d0 2024-05-08T20:27:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90a0004180 con 0x7f90980047d0 2024-05-08T20:27:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90acff9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 0x7f909c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f90a0084680 con 0x7f90980047d0 2024-05-08T20:27:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90af7fe640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 0x7f909c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.114+0000 7f90af7fe640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 0x7f909c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f90a40aa000 tx=0x7f90a4001a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.118+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f90a0051810 con 0x7f90980047d0 2024-05-08T20:27:29.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.298+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f90b014dd60 con 0x7f90980047d0 2024-05-08T20:27:29.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.974+0000 7f90acff9640 1 -- 172.21.15.81:0/3977128989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7f90a0054e30 con 0x7f90980047d0 2024-05-08T20:27:29.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 msgr2=0x7f909c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 0x7f909c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f90a40aa000 tx=0x7f90a4001a80 comp rx=0 tx=0).stop 2024-05-08T20:27:29.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 msgr2=0x7f90b01456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:29.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90a000f380 tx=0x7f90a000f840 comp rx=0 tx=0).stop 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 shutdown_connections 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f909c066690 0x7f909c068b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90b00a9c40 0x7f90b00c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90b01edc70 0x7f90b0144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 --2- 172.21.15.81:0/3977128989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90980047d0 0x7f90b01456f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 >> 172.21.15.81:0/3977128989 conn(0x7f90b00c2ca0 msgr2=0x7f90b014e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 shutdown_connections 2024-05-08T20:27:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:29.978+0000 7f90b66c9640 1 -- 172.21.15.81:0/3977128989 wait complete. 2024-05-08T20:27:30.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-05-08T20:27:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 Processor -- start 2024-05-08T20:27:30.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 -- start start 2024-05-08T20:27:30.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f82d40725f0 0x7f82d40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d406f400 0x7f82d40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40c0650 con 0x7f82d41501e0 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d406fd60 con 0x7f82d406f400 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82dac70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d4072180 con 0x7f82d40725f0 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d920d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82d406f400 0x7f82d40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d8a0c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82d41501e0 0x7f82d406c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53556/0 (socket says 172.21.15.81:53556) 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d8a0c640 1 -- 172.21.15.81:0/4157707309 learned_addr learned my addr 172.21.15.81:0/4157707309 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d3fff640 1 --2- 172.21.15.81:0/4157707309 >> v2:172.21.15.117:3300/0 conn(0x7f82d40725f0 0x7f82d40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d920d640 1 -- 172.21.15.81:0/4157707309 >> v2:172.21.15.117:3300/0 conn(0x7f82d40725f0 msgr2=0x7f82d40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d920d640 1 --2- 172.21.15.81:0/4157707309 >> v2:172.21.15.117:3300/0 conn(0x7f82d40725f0 0x7f82d40c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d920d640 1 -- 172.21.15.81:0/4157707309 >> v1:172.21.15.81:6789/0 conn(0x7f82d41501e0 legacy=0x7f82d406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d37fe640 1 -- 172.21.15.81:0/4157707309 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104074108 0 0) 0x7f82d40c0650 con 0x7f82d41501e0 2024-05-08T20:27:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.122+0000 7f82d920d640 1 -- 172.21.15.81:0/4157707309 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d406fa80 con 0x7f82d406f400 2024-05-08T20:27:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 --2- 172.21.15.81:0/4157707309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82d406f1b0 tx=0x7f82cc01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21285e5ebdf64820 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d37fe640 1 -- 172.21.15.81:0/4157707309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0a57d0 con 0x7f82d406f400 2024-05-08T20:27:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d37fe640 1 -- 172.21.15.81:0/4157707309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0a5930 con 0x7f82d406f400 2024-05-08T20:27:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d37fe640 1 -- 172.21.15.81:0/4157707309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0a5cc0 con 0x7f82d406f400 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- 172.21.15.81:0/4157707309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 msgr2=0x7f82d40c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- 172.21.15.81:0/4157707309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82d406f1b0 tx=0x7f82cc01c7e0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- 172.21.15.81:0/4157707309 shutdown_connections 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- 172.21.15.81:0/4157707309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d406f400 0x7f82d40c2180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- 172.21.15.81:0/4157707309 >> v2:172.21.15.117:3300/0 conn(0x7f82d40725f0 0x7f82d40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- 172.21.15.81:0/4157707309 >> 172.21.15.81:0/4157707309 conn(0x7f82d40c2ca0 msgr2=0x7f82d40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- 172.21.15.81:0/4157707309 shutdown_connections 2024-05-08T20:27:30.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- 172.21.15.81:0/4157707309 wait complete. 2024-05-08T20:27:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 Processor -- start 2024-05-08T20:27:30.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- start start 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d406f400 0x7f82d40bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d40a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4140150 con 0x7f82d41501e0 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40a97c0 con 0x7f82d40725f0 2024-05-08T20:27:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82dac70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4140360 con 0x7f82d406f400 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38736/0 (socket says 172.21.15.81:38736) 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 -- 172.21.15.81:0/1021149403 learned_addr learned my addr 172.21.15.81:0/1021149403 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d3fff640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d40a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d8a0c640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d406f400 0x7f82d40bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 -- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d406f400 msgr2=0x7f82d40bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d406f400 0x7f82d40bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 -- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 msgr2=0x7f82d40a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d40a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d920d640 1 -- 172.21.15.81:0/1021149403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009a70 con 0x7f82d41501e0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.126+0000 7f82d3fff640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d920d640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0b0040 tx=0x7f82cc019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0ad640 con 0x7f82d41501e0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0ad7a0 con 0x7f82d41501e0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d4150740 con 0x7f82d41501e0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0adb30 con 0x7f82d41501e0 2024-05-08T20:27:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d4154860 con 0x7f82d41501e0 2024-05-08T20:27:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d40a9590 con 0x7f82d41501e0 2024-05-08T20:27:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82cc0b4050 con 0x7f82d41501e0 2024-05-08T20:27:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 0x7f82b8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f82cc11eff0 con 0x7f82d41501e0 2024-05-08T20:27:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d8a0c640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 0x7f82b8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.130+0000 7f82d8a0c640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 0x7f82b8068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f70 tx=0x7f82c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:30.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.134+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f82d40a9590 con 0x7f82d41501e0 2024-05-08T20:27:30.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.314+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f82d40a9590 con 0x7f82d41501e0 2024-05-08T20:27:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.978+0000 7f82d17fa640 1 -- 172.21.15.81:0/1021149403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 110+0+0 (secure 0 0 0) 0x7f82d40a9590 con 0x7f82d41501e0 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 msgr2=0x7f82b8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 0x7f82b8068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f70 tx=0x7f82c8009040 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 msgr2=0x7f82d40aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0b0040 tx=0x7f82cc019580 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 shutdown_connections 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f82b80666c0 0x7f82b8068b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82d41501e0 0x7f82d40aa190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d40725f0 0x7f82d40a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 --2- 172.21.15.81:0/1021149403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82d406f400 0x7f82d40bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 >> 172.21.15.81:0/1021149403 conn(0x7f82d40c2ca0 msgr2=0x7f82d4142fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 shutdown_connections 2024-05-08T20:27:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:30.982+0000 7f82dac70640 1 -- 172.21.15.81:0/1021149403 wait complete. 2024-05-08T20:27:31.006 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-05-08T20:27:31.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.114+0000 7f0767c5b640 1 Processor -- start 2024-05-08T20:27:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.114+0000 7f0767c5b640 1 -- start start 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 0x7f0760155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0760155690 0x7f07600ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07601522e0 con 0x7f0760151f00 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076006bb20 con 0x7f0760155690 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07601548e0 con 0x7f0760154cf0 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07659f7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0760151f00 0x7f07601588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53568/0 (socket says 172.21.15.81:53568) 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0760155690 0x7f07600ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07659f7640 1 -- 172.21.15.81:0/3041904006 learned_addr learned my addr 172.21.15.81:0/3041904006 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07651f6640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 0x7f0760155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 -- 172.21.15.81:0/3041904006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 msgr2=0x7f0760155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 0x7f0760155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 -- 172.21.15.81:0/3041904006 >> v1:172.21.15.81:6789/0 conn(0x7f0760151f00 legacy=0x7f07601588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 -- 172.21.15.81:0/3041904006 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600c5f80 con 0x7f0760155690 2024-05-08T20:27:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07651f6640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 0x7f0760155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07661f8640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760155690 0x7f07600ca000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0750009dc0 tx=0x7f075001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a631f6c39fa37c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07649f5640 1 -- 172.21.15.81:0/3041904006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500a5890 con 0x7f0760155690 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07649f5640 1 -- 172.21.15.81:0/3041904006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500a59f0 con 0x7f0760155690 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f07649f5640 1 -- 172.21.15.81:0/3041904006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500a5d80 con 0x7f0760155690 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- 172.21.15.81:0/3041904006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760155690 msgr2=0x7f07600ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760155690 0x7f07600ca000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0750009dc0 tx=0x7f075001c830 comp rx=0 tx=0).stop 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- 172.21.15.81:0/3041904006 shutdown_connections 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760155690 0x7f07600ca000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 --2- 172.21.15.81:0/3041904006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760154cf0 0x7f0760155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- 172.21.15.81:0/3041904006 >> 172.21.15.81:0/3041904006 conn(0x7f07600715f0 msgr2=0x7f0760071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- 172.21.15.81:0/3041904006 shutdown_connections 2024-05-08T20:27:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.118+0000 7f0767c5b640 1 -- 172.21.15.81:0/3041904006 wait complete. 2024-05-08T20:27:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 Processor -- start 2024-05-08T20:27:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- start start 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760151f00 0x7f07601f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0760154cf0 0x7f0760156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601eef80 con 0x7f0760146e30 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601477b0 con 0x7f0760154cf0 2024-05-08T20:27:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0760157350 con 0x7f0760151f00 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38754/0 (socket says 172.21.15.81:38754) 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 -- 172.21.15.81:0/61808113 learned_addr learned my addr 172.21.15.81:0/61808113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07651f6640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0760154cf0 0x7f0760156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07659f7640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760151f00 0x7f07601f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 -- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760151f00 msgr2=0x7f07601f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760151f00 0x7f07601f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 -- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0760154cf0 msgr2=0x7f0760156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0760154cf0 0x7f0760156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 -- 172.21.15.81:0/61808113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750009a70 con 0x7f0760146e30 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f07661f8640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f075001aee0 tx=0x7f07500195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500b9860 con 0x7f0760146e30 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500b99c0 con 0x7f0760146e30 2024-05-08T20:27:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07601479c0 con 0x7f0760146e30 2024-05-08T20:27:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500b9d70 con 0x7f0760146e30 2024-05-08T20:27:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07601f15a0 con 0x7f0760146e30 2024-05-08T20:27:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07600675e0 con 0x7f0760146e30 2024-05-08T20:27:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.122+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07500ad440 con 0x7f0760146e30 2024-05-08T20:27:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.126+0000 7f075e7fc640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 0x7f074c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.126+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f075011f6c0 con 0x7f0760146e30 2024-05-08T20:27:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.126+0000 7f07659f7640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 0x7f074c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.126+0000 7f07659f7640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 0x7f074c068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0758005890 tx=0x7f0758009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.130+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f07500ec8b0 con 0x7f0760146e30 2024-05-08T20:27:31.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0760074950 con 0x7f0760146e30 2024-05-08T20:27:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f075e7fc640 1 -- 172.21.15.81:0/61808113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f07500efed0 con 0x7f0760146e30 2024-05-08T20:27:31.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:31.320 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:31.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:31.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 msgr2=0x7f074c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 0x7f074c068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0758005890 tx=0x7f0758009040 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 msgr2=0x7f07601f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.314+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f075001aee0 tx=0x7f07500195d0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 shutdown_connections 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f074c066690 0x7f074c068b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0760146e30 0x7f07601f4800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0760154cf0 0x7f0760156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 --2- 172.21.15.81:0/61808113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0760151f00 0x7f07601f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 >> 172.21.15.81:0/61808113 conn(0x7f07600715f0 msgr2=0x7f076006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 shutdown_connections 2024-05-08T20:27:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.318+0000 7f0767c5b640 1 -- 172.21.15.81:0/61808113 wait complete. 2024-05-08T20:27:31.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.438+0000 7f5133ac9640 1 Processor -- start 2024-05-08T20:27:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.438+0000 7f5133ac9640 1 -- start start 2024-05-08T20:27:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f512c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f512c1519d0 0x7f512c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c0c3a50 con 0x7f512c070c00 2024-05-08T20:27:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c072940 con 0x7f512c1519d0 2024-05-08T20:27:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0705e0 con 0x7f512c06b230 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f512c070c00 0x7f512c14e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53570/0 (socket says 172.21.15.81:53570) 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 -- 172.21.15.81:0/3042890690 learned_addr learned my addr 172.21.15.81:0/3042890690 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148531717 0 0) 0x7f512c0c3a50 con 0x7f512c070c00 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5118005740 con 0x7f512c070c00 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5132066640 1 --2- 172.21.15.81:0/3042890690 >> v2:172.21.15.117:3300/0 conn(0x7f512c1519d0 0x7f512c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131865640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f512c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136952588 0 0) 0x7f5118005740 con 0x7f512c070c00 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 msgr2=0x7f512c0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f512c0c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 >> v2:172.21.15.117:3300/0 conn(0x7f512c1519d0 msgr2=0x7f512c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 --2- 172.21.15.81:0/3042890690 >> v2:172.21.15.117:3300/0 conn(0x7f512c1519d0 0x7f512c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0708c0 con 0x7f512c070c00 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f511c001680 con 0x7f512c070c00 2024-05-08T20:27:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 >> v1:172.21.15.81:6789/0 conn(0x7f512c070c00 legacy=0x7f512c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118005b90 0x7f5118005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51180069e0 0x7f5118006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f51180073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c072940 con 0x7f51180069e0 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0705e0 con 0x7f5118005b90 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511800dd00 con 0x7f512c06b230 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51180069e0 0x7f5118006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5132066640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f51180073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 -- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 msgr2=0x7f51180073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f512c06b230 0x7f51180073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 -- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118005b90 msgr2=0x7f5118005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5118005b90 0x7f5118005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 -- 172.21.15.81:0/3042890690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118005740 con 0x7f51180069e0 2024-05-08T20:27:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5131064640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51180069e0 0x7f5118006e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f511c001ec0 tx=0x7f511c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93861b7dc4d7cf4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0058e0 con 0x7f51180069e0 2024-05-08T20:27:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c005a40 con 0x7f51180069e0 2024-05-08T20:27:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5130863640 1 -- 172.21.15.81:0/3042890690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c005e10 con 0x7f51180069e0 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 -- 172.21.15.81:0/3042890690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51180069e0 msgr2=0x7f5118006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 --2- 172.21.15.81:0/3042890690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51180069e0 0x7f5118006e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f511c001ec0 tx=0x7f511c01cc20 comp rx=0 tx=0).stop 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5132066640 1 -- 172.21.15.81:0/3042890690 reap_dead start 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.442+0000 7f5133ac9640 1 -- 172.21.15.81:0/3042890690 shutdown_connections 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/3042890690 >> 172.21.15.81:0/3042890690 conn(0x7f512c0c71b0 msgr2=0x7f512c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/3042890690 shutdown_connections 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/3042890690 wait complete. 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 Processor -- start 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- start start 2024-05-08T20:27:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51180069e0 0x7f512c0ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c0aced0 0x7f512c0ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c155270 con 0x7f512c1e9b40 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0abb10 con 0x7f512c0aced0 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0aac00 con 0x7f51180069e0 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38778/0 (socket says 172.21.15.81:38778) 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 -- 172.21.15.81:0/1477651382 learned_addr learned my addr 172.21.15.81:0/1477651382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 -- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51180069e0 msgr2=0x7f512c0ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5132066640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c0aced0 0x7f512c0ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131865640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51180069e0 0x7f512c0ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51180069e0 0x7f512c0ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 -- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c0aced0 msgr2=0x7f512c0ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c0aced0 0x7f512c0ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 -- 172.21.15.81:0/1477651382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c1ea0b0 con 0x7f512c1e9b40 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5131064640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f511c001ec0 tx=0x7f5118007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a5800 con 0x7f512c1e9b40 2024-05-08T20:27:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0a5960 con 0x7f512c1e9b40 2024-05-08T20:27:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a5cf0 con 0x7f512c1e9b40 2024-05-08T20:27:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c152af0 con 0x7f512c1e9b40 2024-05-08T20:27:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c0aa5b0 con 0x7f512c1e9b40 2024-05-08T20:27:31.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.446+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c0675e0 con 0x7f512c1e9b40 2024-05-08T20:27:31.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.450+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f511c0047f0 con 0x7f512c1e9b40 2024-05-08T20:27:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.450+0000 7f51227fc640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 0x7f5110068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.450+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f511c11def0 con 0x7f512c1e9b40 2024-05-08T20:27:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.450+0000 7f5131865640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 0x7f5110068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.450+0000 7f5131865640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 0x7f5110068b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5124006aa0 tx=0x7f5124008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.454+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f511c0eafc0 con 0x7f512c1e9b40 2024-05-08T20:27:31.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.610+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f512c074950 con 0x7f512c1e9b40 2024-05-08T20:27:31.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f51227fc640 1 -- 172.21.15.81:0/1477651382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f511c0ee5e0 con 0x7f512c1e9b40 2024-05-08T20:27:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:31.621 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 msgr2=0x7f5110068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 0x7f5110068b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5124006aa0 tx=0x7f5124008040 comp rx=0 tx=0).stop 2024-05-08T20:27:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 msgr2=0x7f512c0ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f511c001ec0 tx=0x7f5118007a10 comp rx=0 tx=0).stop 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 shutdown_connections 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51100666c0 0x7f5110068b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c0aced0 0x7f512c0ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f512c1e9b40 0x7f512c0ab090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 --2- 172.21.15.81:0/1477651382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51180069e0 0x7f512c0ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 >> 172.21.15.81:0/1477651382 conn(0x7f512c0c71b0 msgr2=0x7f512c14d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 shutdown_connections 2024-05-08T20:27:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.614+0000 7f5133ac9640 1 -- 172.21.15.81:0/1477651382 wait complete. 2024-05-08T20:27:31.639 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T20:27:31.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.738+0000 7fbdc027f640 1 Processor -- start 2024-05-08T20:27:31.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.738+0000 7fbdc027f640 1 -- start start 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.738+0000 7fbdc027f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbdb81501e0 0x7fbdb806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbdb806f400 0x7fbdb80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb80c0650 con 0x7fbdb80725f0 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb806fd60 con 0x7fbdb806f400 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb8072180 con 0x7fbdb81501e0 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbdb806f400 0x7fbdb80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbdb806f400 0x7fbdb80c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38784/0 (socket says 172.21.15.81:38784) 2024-05-08T20:27:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbd81a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbdb80725f0 0x7fbdb80c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53582/0 (socket says 172.21.15.81:53582) 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 -- 172.21.15.81:0/3787827490 learned_addr learned my addr 172.21.15.81:0/3787827490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe01b640 1 --2- 172.21.15.81:0/3787827490 >> v2:172.21.15.117:3300/0 conn(0x7fbdb81501e0 0x7fbdb806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 -- 172.21.15.81:0/3787827490 >> v2:172.21.15.117:3300/0 conn(0x7fbdb81501e0 msgr2=0x7fbdb806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 --2- 172.21.15.81:0/3787827490 >> v2:172.21.15.117:3300/0 conn(0x7fbdb81501e0 0x7fbdb806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 -- 172.21.15.81:0/3787827490 >> v1:172.21.15.81:6789/0 conn(0x7fbdb80725f0 legacy=0x7fbdb80c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 -- 172.21.15.81:0/3787827490 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb806fa80 con 0x7fbdb806f400 2024-05-08T20:27:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbe81c640 1 --2- 172.21.15.81:0/3787827490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb806f400 0x7fbdb80c2350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbdb806ae70 tx=0x7fbdb401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1e9f04023960a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbd019640 1 -- 172.21.15.81:0/3787827490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40ab5f0 con 0x7fbdb806f400 2024-05-08T20:27:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbd019640 1 -- 172.21.15.81:0/3787827490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb40ab750 con 0x7fbdb806f400 2024-05-08T20:27:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdbd019640 1 -- 172.21.15.81:0/3787827490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40abae0 con 0x7fbdb806f400 2024-05-08T20:27:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- 172.21.15.81:0/3787827490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb806f400 msgr2=0x7fbdb80c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3787827490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb806f400 0x7fbdb80c2350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbdb806ae70 tx=0x7fbdb401c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- 172.21.15.81:0/3787827490 shutdown_connections 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3787827490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb806f400 0x7fbdb80c2350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3787827490 >> v2:172.21.15.117:3300/0 conn(0x7fbdb81501e0 0x7fbdb806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- 172.21.15.81:0/3787827490 >> 172.21.15.81:0/3787827490 conn(0x7fbdb80c2ca0 msgr2=0x7fbdb80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- 172.21.15.81:0/3787827490 shutdown_connections 2024-05-08T20:27:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.742+0000 7fbdc027f640 1 -- 172.21.15.81:0/3787827490 wait complete. 2024-05-08T20:27:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 Processor -- start 2024-05-08T20:27:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- start start 2024-05-08T20:27:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 0x7fbdb8143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb81501e0 0x7fbdb813c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80aae00 con 0x7fbdb80725f0 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80c0350 con 0x7fbdb81501e0 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80bf8b0 con 0x7fbdb806f400 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38800/0 (socket says 172.21.15.81:38800) 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 -- 172.21.15.81:0/3578940772 learned_addr learned my addr 172.21.15.81:0/3578940772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbe81c640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb81501e0 0x7fbdb813c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbe01b640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 0x7fbdb8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 -- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 msgr2=0x7fbdb8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 0x7fbdb8143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 -- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb81501e0 msgr2=0x7fbdb813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb81501e0 0x7fbdb813c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 -- 172.21.15.81:0/3578940772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40094d0 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbe01b640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 0x7fbdb8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdbd81a640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c460 tx=0x7fbdac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac007480 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac0075e0 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb8150740 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac004a10 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb80bf5d0 con 0x7fbdb80725f0 2024-05-08T20:27:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb8074950 con 0x7fbdb80725f0 2024-05-08T20:27:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.746+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdac004b70 con 0x7fbdb80725f0 2024-05-08T20:27:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.750+0000 7fbdaaffd640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 0x7fbd9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.750+0000 7fbdbe01b640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 0x7fbd9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.750+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbdac083820 con 0x7fbdb80725f0 2024-05-08T20:27:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.750+0000 7fbdbe01b640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 0x7fbd9c068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0007330 tx=0x7fbdb000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.754+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbdac0508f0 con 0x7fbdb80725f0 2024-05-08T20:27:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.898+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdb80ab5d0 con 0x7fbd9c066690 2024-05-08T20:27:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.918+0000 7fbdaaffd640 1 -- 172.21.15.81:0/3578940772 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+492230 (secure 0 0 0) 0x7fbdb80ab5d0 con 0x7fbd9c066690 2024-05-08T20:27:31.925 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 msgr2=0x7fbd9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 0x7fbd9c068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0007330 tx=0x7fbdb000b040 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 msgr2=0x7fbdb813be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c460 tx=0x7fbdac00c920 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 shutdown_connections 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd9c066690 0x7fbd9c068b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdb81501e0 0x7fbdb813c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdb80725f0 0x7fbdb813be60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 --2- 172.21.15.81:0/3578940772 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdb806f400 0x7fbdb8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 >> 172.21.15.81:0/3578940772 conn(0x7fbdb80c2ca0 msgr2=0x7fbdb80712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 shutdown_connections 2024-05-08T20:27:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:31.926+0000 7fbdc027f640 1 -- 172.21.15.81:0/3578940772 wait complete. 2024-05-08T20:27:31.946 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-08T20:27:31.226942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2936832,"data_stored":1777541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661871"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258144+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:22.258144+0000","last_peered":"2024-05-08T20:27:22.258144+0000","last_clean":"2024-05-08T20:27:22.258144+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:22.258144+0000","last_undegraded":"2024-05-08T20:27:22.258144+0000","last_fullsized":"2024-05-08T20:27:22.258144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261052+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:22.261052+0000","last_peered":"2024-05-08T20:27:22.261052+0000","last_clean":"2024-05-08T20:27:22.261052+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:22.261052+0000","last_undegraded":"2024-05-08T20:27:22.261052+0000","last_fullsized":"2024-05-08T20:27:22.261052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575756+0000","last_change":"2024-05-08T20:27:26.575756+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575756+0000","last_undegraded":"2024-05-08T20:27:26.575756+0000","last_fullsized":"2024-05-08T20:27:26.575756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261097+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:22.261097+0000","last_peered":"2024-05-08T20:27:22.261097+0000","last_clean":"2024-05-08T20:27:22.261097+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:22.261097+0000","last_undegraded":"2024-05-08T20:27:22.261097+0000","last_fullsized":"2024-05-08T20:27:22.261097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258022+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:22.258022+0000","last_peered":"2024-05-08T20:27:22.258022+0000","last_clean":"2024-05-08T20:27:22.258022+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:22.258022+0000","last_undegraded":"2024-05-08T20:27:22.258022+0000","last_fullsized":"2024-05-08T20:27:22.258022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581298+0000","last_change":"2024-05-08T20:27:26.581298+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581298+0000","last_undegraded":"2024-05-08T20:27:26.581298+0000","last_fullsized":"2024-05-08T20:27:26.581298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268348+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:22.268348+0000","last_peered":"2024-05-08T20:27:22.268348+0000","last_clean":"2024-05-08T20:27:22.268348+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:22.268348+0000","last_undegraded":"2024-05-08T20:27:22.268348+0000","last_fullsized":"2024-05-08T20:27:22.268348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261347+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:22.261347+0000","last_peered":"2024-05-08T20:27:22.261347+0000","last_clean":"2024-05-08T20:27:22.261347+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:22.261347+0000","last_undegraded":"2024-05-08T20:27:22.261347+0000","last_fullsized":"2024-05-08T20:27:22.261347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.585893+0000","last_change":"2024-05-08T20:27:26.585893+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.585893+0000","last_undegraded":"2024-05-08T20:27:26.585893+0000","last_fullsized":"2024-05-08T20:27:26.585893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268249+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:22.268249+0000","last_peered":"2024-05-08T20:27:22.268249+0000","last_clean":"2024-05-08T20:27:22.268249+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:22.268249+0000","last_undegraded":"2024-05-08T20:27:22.268249+0000","last_fullsized":"2024-05-08T20:27:22.268249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261439+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:22.261439+0000","last_peered":"2024-05-08T20:27:22.261439+0000","last_clean":"2024-05-08T20:27:22.261439+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:22.261439+0000","last_undegraded":"2024-05-08T20:27:22.261439+0000","last_fullsized":"2024-05-08T20:27:22.261439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583545+0000","last_change":"2024-05-08T20:27:26.583545+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583545+0000","last_undegraded":"2024-05-08T20:27:26.583545+0000","last_fullsized":"2024-05-08T20:27:26.583545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257567+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:22.257567+0000","last_peered":"2024-05-08T20:27:22.257567+0000","last_clean":"2024-05-08T20:27:22.257567+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:22.257567+0000","last_undegraded":"2024-05-08T20:27:22.257567+0000","last_fullsized":"2024-05-08T20:27:22.257567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268224+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:22.268224+0000","last_peered":"2024-05-08T20:27:22.268224+0000","last_clean":"2024-05-08T20:27:22.268224+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:22.268224+0000","last_undegraded":"2024-05-08T20:27:22.268224+0000","last_fullsized":"2024-05-08T20:27:22.268224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581606+0000","last_change":"2024-05-08T20:27:26.581606+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581606+0000","last_undegraded":"2024-05-08T20:27:26.581606+0000","last_fullsized":"2024-05-08T20:27:26.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260967+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:22.260967+0000","last_peered":"2024-05-08T20:27:22.260967+0000","last_clean":"2024-05-08T20:27:22.260967+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:22.260967+0000","last_undegraded":"2024-05-08T20:27:22.260967+0000","last_fullsized":"2024-05-08T20:27:22.260967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264391+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:22.264391+0000","last_peered":"2024-05-08T20:27:22.264391+0000","last_clean":"2024-05-08T20:27:22.264391+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:22.264391+0000","last_undegraded":"2024-05-08T20:27:22.264391+0000","last_fullsized":"2024-05-08T20:27:22.264391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581456+0000","last_change":"2024-05-08T20:27:26.581456+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581456+0000","last_undegraded":"2024-05-08T20:27:26.581456+0000","last_fullsized":"2024-05-08T20:27:26.581456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260834+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:22.260834+0000","last_peered":"2024-05-08T20:27:22.260834+0000","last_clean":"2024-05-08T20:27:22.260834+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:22.260834+0000","last_undegraded":"2024-05-08T20:27:22.260834+0000","last_fullsized":"2024-05-08T20:27:22.260834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264368+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:22.264368+0000","last_peered":"2024-05-08T20:27:22.264368+0000","last_clean":"2024-05-08T20:27:22.264368+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:22.264368+0000","last_undegraded":"2024-05-08T20:27:22.264368+0000","last_fullsized":"2024-05-08T20:27:22.264368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572396+0000","last_change":"2024-05-08T20:27:26.572396+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572396+0000","last_undegraded":"2024-05-08T20:27:26.572396+0000","last_fullsized":"2024-05-08T20:27:26.572396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260148+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:22.260148+0000","last_peered":"2024-05-08T20:27:22.260148+0000","last_clean":"2024-05-08T20:27:22.260148+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:22.260148+0000","last_undegraded":"2024-05-08T20:27:22.260148+0000","last_fullsized":"2024-05-08T20:27:22.260148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.267972+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:22.267972+0000","last_peered":"2024-05-08T20:27:22.267972+0000","last_clean":"2024-05-08T20:27:22.267972+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:22.267972+0000","last_undegraded":"2024-05-08T20:27:22.267972+0000","last_fullsized":"2024-05-08T20:27:22.267972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.582451+0000","last_change":"2024-05-08T20:27:26.582451+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.582451+0000","last_undegraded":"2024-05-08T20:27:26.582451+0000","last_fullsized":"2024-05-08T20:27:26.582451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257988+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:22.257988+0000","last_peered":"2024-05-08T20:27:22.257988+0000","last_clean":"2024-05-08T20:27:22.257988+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:22.257988+0000","last_undegraded":"2024-05-08T20:27:22.257988+0000","last_fullsized":"2024-05-08T20:27:22.257988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257810+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:22.257810+0000","last_peered":"2024-05-08T20:27:22.257810+0000","last_clean":"2024-05-08T20:27:22.257810+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:22.257810+0000","last_undegraded":"2024-05-08T20:27:22.257810+0000","last_fullsized":"2024-05-08T20:27:22.257810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581739+0000","last_change":"2024-05-08T20:27:26.581739+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581739+0000","last_undegraded":"2024-05-08T20:27:26.581739+0000","last_fullsized":"2024-05-08T20:27:26.581739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261191+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:22.261191+0000","last_peered":"2024-05-08T20:27:22.261191+0000","last_clean":"2024-05-08T20:27:22.261191+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:22.261191+0000","last_undegraded":"2024-05-08T20:27:22.261191+0000","last_fullsized":"2024-05-08T20:27:22.261191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.767255+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:22.767255+0000","last_peered":"2024-05-08T20:27:22.767255+0000","last_clean":"2024-05-08T20:27:22.767255+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:22.767255+0000","last_undegraded":"2024-05-08T20:27:22.767255+0000","last_fullsized":"2024-05-08T20:27:22.767255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.579085+0000","last_change":"2024-05-08T20:27:26.579085+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.579085+0000","last_undegraded":"2024-05-08T20:27:26.579085+0000","last_fullsized":"2024-05-08T20:27:26.579085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264427+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:22.264427+0000","last_peered":"2024-05-08T20:27:22.264427+0000","last_clean":"2024-05-08T20:27:22.264427+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:22.264427+0000","last_undegraded":"2024-05-08T20:27:22.264427+0000","last_fullsized":"2024-05-08T20:27:22.264427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268416+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:22.268416+0000","last_peered":"2024-05-08T20:27:22.268416+0000","last_clean":"2024-05-08T20:27:22.268416+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:22.268416+0000","last_undegraded":"2024-05-08T20:27:22.268416+0000","last_fullsized":"2024-05-08T20:27:22.268416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261485+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:22.261485+0000","last_peered":"2024-05-08T20:27:22.261485+0000","last_clean":"2024-05-08T20:27:22.261485+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:22.261485+0000","last_undegraded":"2024-05-08T20:27:22.261485+0000","last_fullsized":"2024-05-08T20:27:22.261485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264450+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:22.264450+0000","last_peered":"2024-05-08T20:27:22.264450+0000","last_clean":"2024-05-08T20:27:22.264450+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:22.264450+0000","last_undegraded":"2024-05-08T20:27:22.264450+0000","last_fullsized":"2024-05-08T20:27:22.264450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570795+0000","last_change":"2024-05-08T20:27:26.570795+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570795+0000","last_undegraded":"2024-05-08T20:27:26.570795+0000","last_fullsized":"2024-05-08T20:27:26.570795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260211+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:22.260211+0000","last_peered":"2024-05-08T20:27:22.260211+0000","last_clean":"2024-05-08T20:27:22.260211+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:22.260211+0000","last_undegraded":"2024-05-08T20:27:22.260211+0000","last_fullsized":"2024-05-08T20:27:22.260211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261213+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:22.261213+0000","last_peered":"2024-05-08T20:27:22.261213+0000","last_clean":"2024-05-08T20:27:22.261213+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:22.261213+0000","last_undegraded":"2024-05-08T20:27:22.261213+0000","last_fullsized":"2024-05-08T20:27:22.261213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570786+0000","last_change":"2024-05-08T20:27:26.570786+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570786+0000","last_undegraded":"2024-05-08T20:27:26.570786+0000","last_fullsized":"2024-05-08T20:27:26.570786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264288+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:22.264288+0000","last_peered":"2024-05-08T20:27:22.264288+0000","last_clean":"2024-05-08T20:27:22.264288+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:22.264288+0000","last_undegraded":"2024-05-08T20:27:22.264288+0000","last_fullsized":"2024-05-08T20:27:22.264288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256661+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:22.256661+0000","last_peered":"2024-05-08T20:27:22.256661+0000","last_clean":"2024-05-08T20:27:22.256661+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:22.256661+0000","last_undegraded":"2024-05-08T20:27:22.256661+0000","last_fullsized":"2024-05-08T20:27:22.256661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570862+0000","last_change":"2024-05-08T20:27:26.570862+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570862+0000","last_undegraded":"2024-05-08T20:27:26.570862+0000","last_fullsized":"2024-05-08T20:27:26.570862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257684+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:22.257684+0000","last_peered":"2024-05-08T20:27:22.257684+0000","last_clean":"2024-05-08T20:27:22.257684+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:22.257684+0000","last_undegraded":"2024-05-08T20:27:22.257684+0000","last_fullsized":"2024-05-08T20:27:22.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268037+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:22.268037+0000","last_peered":"2024-05-08T20:27:22.268037+0000","last_clean":"2024-05-08T20:27:22.268037+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:22.268037+0000","last_undegraded":"2024-05-08T20:27:22.268037+0000","last_fullsized":"2024-05-08T20:27:22.268037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608063+0000","last_change":"2024-05-08T20:27:26.608063+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608063+0000","last_undegraded":"2024-05-08T20:27:26.608063+0000","last_fullsized":"2024-05-08T20:27:26.608063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260900+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:22.260900+0000","last_peered":"2024-05-08T20:27:22.260900+0000","last_clean":"2024-05-08T20:27:22.260900+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:22.260900+0000","last_undegraded":"2024-05-08T20:27:22.260900+0000","last_fullsized":"2024-05-08T20:27:22.260900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261254+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:22.261254+0000","last_peered":"2024-05-08T20:27:22.261254+0000","last_clean":"2024-05-08T20:27:22.261254+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:22.261254+0000","last_undegraded":"2024-05-08T20:27:22.261254+0000","last_fullsized":"2024-05-08T20:27:22.261254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626652+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:20.626652+0000","last_peered":"2024-05-08T20:27:20.626652+0000","last_clean":"2024-05-08T20:27:20.626652+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:20.626652+0000","last_undegraded":"2024-05-08T20:27:20.626652+0000","last_fullsized":"2024-05-08T20:27:20.626652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572168+0000","last_change":"2024-05-08T20:27:26.572168+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572168+0000","last_undegraded":"2024-05-08T20:27:26.572168+0000","last_fullsized":"2024-05-08T20:27:26.572168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268316+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:22.268316+0000","last_peered":"2024-05-08T20:27:22.268316+0000","last_clean":"2024-05-08T20:27:22.268316+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:22.268316+0000","last_undegraded":"2024-05-08T20:27:22.268316+0000","last_fullsized":"2024-05-08T20:27:22.268316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256689+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:22.256689+0000","last_peered":"2024-05-08T20:27:22.256689+0000","last_clean":"2024-05-08T20:27:22.256689+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:22.256689+0000","last_undegraded":"2024-05-08T20:27:22.256689+0000","last_fullsized":"2024-05-08T20:27:22.256689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572082+0000","last_change":"2024-05-08T20:27:26.572082+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572082+0000","last_undegraded":"2024-05-08T20:27:26.572082+0000","last_fullsized":"2024-05-08T20:27:26.572082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261393+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:22.261393+0000","last_peered":"2024-05-08T20:27:22.261393+0000","last_clean":"2024-05-08T20:27:22.261393+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:22.261393+0000","last_undegraded":"2024-05-08T20:27:22.261393+0000","last_fullsized":"2024-05-08T20:27:22.261393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264551+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:22.264551+0000","last_peered":"2024-05-08T20:27:22.264551+0000","last_clean":"2024-05-08T20:27:22.264551+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:22.264551+0000","last_undegraded":"2024-05-08T20:27:22.264551+0000","last_fullsized":"2024-05-08T20:27:22.264551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608054+0000","last_change":"2024-05-08T20:27:26.608054+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608054+0000","last_undegraded":"2024-05-08T20:27:26.608054+0000","last_fullsized":"2024-05-08T20:27:26.608054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268523+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:22.268523+0000","last_peered":"2024-05-08T20:27:22.268523+0000","last_clean":"2024-05-08T20:27:22.268523+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:22.268523+0000","last_undegraded":"2024-05-08T20:27:22.268523+0000","last_fullsized":"2024-05-08T20:27:22.268523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256738+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:22.256738+0000","last_peered":"2024-05-08T20:27:22.256738+0000","last_clean":"2024-05-08T20:27:22.256738+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:22.256738+0000","last_undegraded":"2024-05-08T20:27:22.256738+0000","last_fullsized":"2024-05-08T20:27:22.256738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572103+0000","last_change":"2024-05-08T20:27:26.572103+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572103+0000","last_undegraded":"2024-05-08T20:27:26.572103+0000","last_fullsized":"2024-05-08T20:27:26.572103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268452+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:22.268452+0000","last_peered":"2024-05-08T20:27:22.268452+0000","last_clean":"2024-05-08T20:27:22.268452+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:22.268452+0000","last_undegraded":"2024-05-08T20:27:22.268452+0000","last_fullsized":"2024-05-08T20:27:22.268452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260287+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:22.260287+0000","last_peered":"2024-05-08T20:27:22.260287+0000","last_clean":"2024-05-08T20:27:22.260287+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:22.260287+0000","last_undegraded":"2024-05-08T20:27:22.260287+0000","last_fullsized":"2024-05-08T20:27:22.260287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.584404+0000","last_change":"2024-05-08T20:27:26.584404+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.584404+0000","last_undegraded":"2024-05-08T20:27:26.584404+0000","last_fullsized":"2024-05-08T20:27:26.584404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268124+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:22.268124+0000","last_peered":"2024-05-08T20:27:22.268124+0000","last_clean":"2024-05-08T20:27:22.268124+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:22.268124+0000","last_undegraded":"2024-05-08T20:27:22.268124+0000","last_fullsized":"2024-05-08T20:27:22.268124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256541+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:22.256541+0000","last_peered":"2024-05-08T20:27:22.256541+0000","last_clean":"2024-05-08T20:27:22.256541+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:22.256541+0000","last_undegraded":"2024-05-08T20:27:22.256541+0000","last_fullsized":"2024-05-08T20:27:22.256541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257505+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:22.257505+0000","last_peered":"2024-05-08T20:27:22.257505+0000","last_clean":"2024-05-08T20:27:22.257505+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:22.257505+0000","last_undegraded":"2024-05-08T20:27:22.257505+0000","last_fullsized":"2024-05-08T20:27:22.257505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257541+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:22.257541+0000","last_peered":"2024-05-08T20:27:22.257541+0000","last_clean":"2024-05-08T20:27:22.257541+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:22.257541+0000","last_undegraded":"2024-05-08T20:27:22.257541+0000","last_fullsized":"2024-05-08T20:27:22.257541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576679+0000","last_change":"2024-05-08T20:27:26.576679+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576679+0000","last_undegraded":"2024-05-08T20:27:26.576679+0000","last_fullsized":"2024-05-08T20:27:26.576679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268197+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:22.268197+0000","last_peered":"2024-05-08T20:27:22.268197+0000","last_clean":"2024-05-08T20:27:22.268197+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:22.268197+0000","last_undegraded":"2024-05-08T20:27:22.268197+0000","last_fullsized":"2024-05-08T20:27:22.268197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261154+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:22.261154+0000","last_peered":"2024-05-08T20:27:22.261154+0000","last_clean":"2024-05-08T20:27:22.261154+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:22.261154+0000","last_undegraded":"2024-05-08T20:27:22.261154+0000","last_fullsized":"2024-05-08T20:27:22.261154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575918+0000","last_change":"2024-05-08T20:27:26.575918+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575918+0000","last_undegraded":"2024-05-08T20:27:26.575918+0000","last_fullsized":"2024-05-08T20:27:26.575918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257776+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:22.257776+0000","last_peered":"2024-05-08T20:27:22.257776+0000","last_clean":"2024-05-08T20:27:22.257776+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:22.257776+0000","last_undegraded":"2024-05-08T20:27:22.257776+0000","last_fullsized":"2024-05-08T20:27:22.257776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257929+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:22.257929+0000","last_peered":"2024-05-08T20:27:22.257929+0000","last_clean":"2024-05-08T20:27:22.257929+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:22.257929+0000","last_undegraded":"2024-05-08T20:27:22.257929+0000","last_fullsized":"2024-05-08T20:27:22.257929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.573162+0000","last_change":"2024-05-08T20:27:26.573162+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.573162+0000","last_undegraded":"2024-05-08T20:27:26.573162+0000","last_fullsized":"2024-05-08T20:27:26.573162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268276+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:22.268276+0000","last_peered":"2024-05-08T20:27:22.268276+0000","last_clean":"2024-05-08T20:27:22.268276+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:22.268276+0000","last_undegraded":"2024-05-08T20:27:22.268276+0000","last_fullsized":"2024-05-08T20:27:22.268276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257680+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:22.257680+0000","last_peered":"2024-05-08T20:27:22.257680+0000","last_clean":"2024-05-08T20:27:22.257680+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:22.257680+0000","last_undegraded":"2024-05-08T20:27:22.257680+0000","last_fullsized":"2024-05-08T20:27:22.257680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572155+0000","last_change":"2024-05-08T20:27:26.572155+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572155+0000","last_undegraded":"2024-05-08T20:27:26.572155+0000","last_fullsized":"2024-05-08T20:27:26.572155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260259+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:22.260259+0000","last_peered":"2024-05-08T20:27:22.260259+0000","last_clean":"2024-05-08T20:27:22.260259+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:22.260259+0000","last_undegraded":"2024-05-08T20:27:22.260259+0000","last_fullsized":"2024-05-08T20:27:22.260259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264497+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:22.264497+0000","last_peered":"2024-05-08T20:27:22.264497+0000","last_clean":"2024-05-08T20:27:22.264497+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:22.264497+0000","last_undegraded":"2024-05-08T20:27:22.264497+0000","last_fullsized":"2024-05-08T20:27:22.264497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583009+0000","last_change":"2024-05-08T20:27:26.583009+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583009+0000","last_undegraded":"2024-05-08T20:27:26.583009+0000","last_fullsized":"2024-05-08T20:27:26.583009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258095+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:22.258095+0000","last_peered":"2024-05-08T20:27:22.258095+0000","last_clean":"2024-05-08T20:27:22.258095+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:22.258095+0000","last_undegraded":"2024-05-08T20:27:22.258095+0000","last_fullsized":"2024-05-08T20:27:22.258095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261587+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:22.261587+0000","last_peered":"2024-05-08T20:27:22.261587+0000","last_clean":"2024-05-08T20:27:22.261587+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:22.261587+0000","last_undegraded":"2024-05-08T20:27:22.261587+0000","last_fullsized":"2024-05-08T20:27:22.261587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575782+0000","last_change":"2024-05-08T20:27:26.575782+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575782+0000","last_undegraded":"2024-05-08T20:27:26.575782+0000","last_fullsized":"2024-05-08T20:27:26.575782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261527+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:22.261527+0000","last_peered":"2024-05-08T20:27:22.261527+0000","last_clean":"2024-05-08T20:27:22.261527+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:22.261527+0000","last_undegraded":"2024-05-08T20:27:22.261527+0000","last_fullsized":"2024-05-08T20:27:22.261527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257787+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:22.257787+0000","last_peered":"2024-05-08T20:27:22.257787+0000","last_clean":"2024-05-08T20:27:22.257787+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:22.257787+0000","last_undegraded":"2024-05-08T20:27:22.257787+0000","last_fullsized":"2024-05-08T20:27:22.257787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576460+0000","last_change":"2024-05-08T20:27:26.576460+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576460+0000","last_undegraded":"2024-05-08T20:27:26.576460+0000","last_fullsized":"2024-05-08T20:27:26.576460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608514+0000","last_change":"2024-05-08T20:27:26.608514+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608514+0000","last_undegraded":"2024-05-08T20:27:26.608514+0000","last_fullsized":"2024-05-08T20:27:26.608514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264323+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:22.264323+0000","last_peered":"2024-05-08T20:27:22.264323+0000","last_clean":"2024-05-08T20:27:22.264323+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:22.264323+0000","last_undegraded":"2024-05-08T20:27:22.264323+0000","last_fullsized":"2024-05-08T20:27:22.264323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260973+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:22.260973+0000","last_peered":"2024-05-08T20:27:22.260973+0000","last_clean":"2024-05-08T20:27:22.260973+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:22.260973+0000","last_undegraded":"2024-05-08T20:27:22.260973+0000","last_fullsized":"2024-05-08T20:27:22.260973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572090+0000","last_change":"2024-05-08T20:27:26.572090+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572090+0000","last_undegraded":"2024-05-08T20:27:26.572090+0000","last_fullsized":"2024-05-08T20:27:26.572090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260809+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:22.260809+0000","last_peered":"2024-05-08T20:27:22.260809+0000","last_clean":"2024-05-08T20:27:22.260809+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:22.260809+0000","last_undegraded":"2024-05-08T20:27:22.260809+0000","last_fullsized":"2024-05-08T20:27:22.260809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260878+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:22.260878+0000","last_peered":"2024-05-08T20:27:22.260878+0000","last_clean":"2024-05-08T20:27:22.260878+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:22.260878+0000","last_undegraded":"2024-05-08T20:27:22.260878+0000","last_fullsized":"2024-05-08T20:27:22.260878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257632+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:22.257632+0000","last_peered":"2024-05-08T20:27:22.257632+0000","last_clean":"2024-05-08T20:27:22.257632+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:22.257632+0000","last_undegraded":"2024-05-08T20:27:22.257632+0000","last_fullsized":"2024-05-08T20:27:22.257632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257875+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:22.257875+0000","last_peered":"2024-05-08T20:27:22.257875+0000","last_clean":"2024-05-08T20:27:22.257875+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:22.257875+0000","last_undegraded":"2024-05-08T20:27:22.257875+0000","last_fullsized":"2024-05-08T20:27:22.257875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575595+0000","last_change":"2024-05-08T20:27:26.575595+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575595+0000","last_undegraded":"2024-05-08T20:27:26.575595+0000","last_fullsized":"2024-05-08T20:27:26.575595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260998+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:22.260998+0000","last_peered":"2024-05-08T20:27:22.260998+0000","last_clean":"2024-05-08T20:27:22.260998+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:22.260998+0000","last_undegraded":"2024-05-08T20:27:22.260998+0000","last_fullsized":"2024-05-08T20:27:22.260998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260184+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:22.260184+0000","last_peered":"2024-05-08T20:27:22.260184+0000","last_clean":"2024-05-08T20:27:22.260184+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:22.260184+0000","last_undegraded":"2024-05-08T20:27:22.260184+0000","last_fullsized":"2024-05-08T20:27:22.260184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576494+0000","last_change":"2024-05-08T20:27:26.576494+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576494+0000","last_undegraded":"2024-05-08T20:27:26.576494+0000","last_fullsized":"2024-05-08T20:27:26.576494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257470+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:22.257470+0000","last_peered":"2024-05-08T20:27:22.257470+0000","last_clean":"2024-05-08T20:27:22.257470+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:22.257470+0000","last_undegraded":"2024-05-08T20:27:22.257470+0000","last_fullsized":"2024-05-08T20:27:22.257470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256608+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:22.256608+0000","last_peered":"2024-05-08T20:27:22.256608+0000","last_clean":"2024-05-08T20:27:22.256608+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:22.256608+0000","last_undegraded":"2024-05-08T20:27:22.256608+0000","last_fullsized":"2024-05-08T20:27:22.256608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261103+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:22.261103+0000","last_peered":"2024-05-08T20:27:22.261103+0000","last_clean":"2024-05-08T20:27:22.261103+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:22.261103+0000","last_undegraded":"2024-05-08T20:27:22.261103+0000","last_fullsized":"2024-05-08T20:27:22.261103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257834+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:22.257834+0000","last_peered":"2024-05-08T20:27:22.257834+0000","last_clean":"2024-05-08T20:27:22.257834+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:22.257834+0000","last_undegraded":"2024-05-08T20:27:22.257834+0000","last_fullsized":"2024-05-08T20:27:22.257834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261023+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:22.261023+0000","last_peered":"2024-05-08T20:27:22.261023+0000","last_clean":"2024-05-08T20:27:22.261023+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:22.261023+0000","last_undegraded":"2024-05-08T20:27:22.261023+0000","last_fullsized":"2024-05-08T20:27:22.261023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264471+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:22.264471+0000","last_peered":"2024-05-08T20:27:22.264471+0000","last_clean":"2024-05-08T20:27:22.264471+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:22.264471+0000","last_undegraded":"2024-05-08T20:27:22.264471+0000","last_fullsized":"2024-05-08T20:27:22.264471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257751+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:22.257751+0000","last_peered":"2024-05-08T20:27:22.257751+0000","last_clean":"2024-05-08T20:27:22.257751+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:22.257751+0000","last_undegraded":"2024-05-08T20:27:22.257751+0000","last_fullsized":"2024-05-08T20:27:22.257751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261148+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:22.261148+0000","last_peered":"2024-05-08T20:27:22.261148+0000","last_clean":"2024-05-08T20:27:22.261148+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:22.261148+0000","last_undegraded":"2024-05-08T20:27:22.261148+0000","last_fullsized":"2024-05-08T20:27:22.261148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260921+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:22.260921+0000","last_peered":"2024-05-08T20:27:22.260921+0000","last_clean":"2024-05-08T20:27:22.260921+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:22.260921+0000","last_undegraded":"2024-05-08T20:27:22.260921+0000","last_fullsized":"2024-05-08T20:27:22.260921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260856+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:22.260856+0000","last_peered":"2024-05-08T20:27:22.260856+0000","last_clean":"2024-05-08T20:27:22.260856+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:22.260856+0000","last_undegraded":"2024-05-08T20:27:22.260856+0000","last_fullsized":"2024-05-08T20:27:22.260856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261062+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:22.261062+0000","last_peered":"2024-05-08T20:27:22.261062+0000","last_clean":"2024-05-08T20:27:22.261062+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:22.261062+0000","last_undegraded":"2024-05-08T20:27:22.261062+0000","last_fullsized":"2024-05-08T20:27:22.261062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257798+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:22.257798+0000","last_peered":"2024-05-08T20:27:22.257798+0000","last_clean":"2024-05-08T20:27:22.257798+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:22.257798+0000","last_undegraded":"2024-05-08T20:27:22.257798+0000","last_fullsized":"2024-05-08T20:27:22.257798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257657+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:22.257657+0000","last_peered":"2024-05-08T20:27:22.257657+0000","last_clean":"2024-05-08T20:27:22.257657+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:22.257657+0000","last_undegraded":"2024-05-08T20:27:22.257657+0000","last_fullsized":"2024-05-08T20:27:22.257657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268391+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:22.268391+0000","last_peered":"2024-05-08T20:27:22.268391+0000","last_clean":"2024-05-08T20:27:22.268391+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:22.268391+0000","last_undegraded":"2024-05-08T20:27:22.268391+0000","last_fullsized":"2024-05-08T20:27:22.268391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256712+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:22.256712+0000","last_peered":"2024-05-08T20:27:22.256712+0000","last_clean":"2024-05-08T20:27:22.256712+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:22.256712+0000","last_undegraded":"2024-05-08T20:27:22.256712+0000","last_fullsized":"2024-05-08T20:27:22.256712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261634+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:22.261634+0000","last_peered":"2024-05-08T20:27:22.261634+0000","last_clean":"2024-05-08T20:27:22.261634+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:22.261634+0000","last_undegraded":"2024-05-08T20:27:22.261634+0000","last_fullsized":"2024-05-08T20:27:22.261634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260863+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:22.260863+0000","last_peered":"2024-05-08T20:27:22.260863+0000","last_clean":"2024-05-08T20:27:22.260863+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:22.260863+0000","last_undegraded":"2024-05-08T20:27:22.260863+0000","last_fullsized":"2024-05-08T20:27:22.260863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264346+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:22.264346+0000","last_peered":"2024-05-08T20:27:22.264346+0000","last_clean":"2024-05-08T20:27:22.264346+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:22.264346+0000","last_undegraded":"2024-05-08T20:27:22.264346+0000","last_fullsized":"2024-05-08T20:27:22.264346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257738+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:22.257738+0000","last_peered":"2024-05-08T20:27:22.257738+0000","last_clean":"2024-05-08T20:27:22.257738+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:22.257738+0000","last_undegraded":"2024-05-08T20:27:22.257738+0000","last_fullsized":"2024-05-08T20:27:22.257738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260922+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:22.260922+0000","last_peered":"2024-05-08T20:27:22.260922+0000","last_clean":"2024-05-08T20:27:22.260922+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:22.260922+0000","last_undegraded":"2024-05-08T20:27:22.260922+0000","last_fullsized":"2024-05-08T20:27:22.260922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260236+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:22.260236+0000","last_peered":"2024-05-08T20:27:22.260236+0000","last_clean":"2024-05-08T20:27:22.260236+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:22.260236+0000","last_undegraded":"2024-05-08T20:27:22.260236+0000","last_fullsized":"2024-05-08T20:27:22.260236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257707+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:22.257707+0000","last_peered":"2024-05-08T20:27:22.257707+0000","last_clean":"2024-05-08T20:27:22.257707+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:22.257707+0000","last_undegraded":"2024-05-08T20:27:22.257707+0000","last_fullsized":"2024-05-08T20:27:22.257707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257729+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:22.257729+0000","last_peered":"2024-05-08T20:27:22.257729+0000","last_clean":"2024-05-08T20:27:22.257729+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:22.257729+0000","last_undegraded":"2024-05-08T20:27:22.257729+0000","last_fullsized":"2024-05-08T20:27:22.257729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268498+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:22.268498+0000","last_peered":"2024-05-08T20:27:22.268498+0000","last_clean":"2024-05-08T20:27:22.268498+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:22.268498+0000","last_undegraded":"2024-05-08T20:27:22.268498+0000","last_fullsized":"2024-05-08T20:27:22.268498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260773+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:22.260773+0000","last_peered":"2024-05-08T20:27:22.260773+0000","last_clean":"2024-05-08T20:27:22.260773+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:22.260773+0000","last_undegraded":"2024-05-08T20:27:22.260773+0000","last_fullsized":"2024-05-08T20:27:22.260773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268082+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:22.268082+0000","last_peered":"2024-05-08T20:27:22.268082+0000","last_clean":"2024-05-08T20:27:22.268082+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:22.268082+0000","last_undegraded":"2024-05-08T20:27:22.268082+0000","last_fullsized":"2024-05-08T20:27:22.268082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261016+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:22.261016+0000","last_peered":"2024-05-08T20:27:22.261016+0000","last_clean":"2024-05-08T20:27:22.261016+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:22.261016+0000","last_undegraded":"2024-05-08T20:27:22.261016+0000","last_fullsized":"2024-05-08T20:27:22.261016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268152+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:22.268152+0000","last_peered":"2024-05-08T20:27:22.268152+0000","last_clean":"2024-05-08T20:27:22.268152+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:22.268152+0000","last_undegraded":"2024-05-08T20:27:22.268152+0000","last_fullsized":"2024-05-08T20:27:22.268152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261300+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:22.261300+0000","last_peered":"2024-05-08T20:27:22.261300+0000","last_clean":"2024-05-08T20:27:22.261300+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:22.261300+0000","last_undegraded":"2024-05-08T20:27:22.261300+0000","last_fullsized":"2024-05-08T20:27:22.261300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257965+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:22.257965+0000","last_peered":"2024-05-08T20:27:22.257965+0000","last_clean":"2024-05-08T20:27:22.257965+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:22.257965+0000","last_undegraded":"2024-05-08T20:27:22.257965+0000","last_fullsized":"2024-05-08T20:27:22.257965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264591+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:22.264591+0000","last_peered":"2024-05-08T20:27:22.264591+0000","last_clean":"2024-05-08T20:27:22.264591+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:22.264591+0000","last_undegraded":"2024-05-08T20:27:22.264591+0000","last_fullsized":"2024-05-08T20:27:22.264591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268475+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:22.268475+0000","last_peered":"2024-05-08T20:27:22.268475+0000","last_clean":"2024-05-08T20:27:22.268475+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:22.268475+0000","last_undegraded":"2024-05-08T20:27:22.268475+0000","last_fullsized":"2024-05-08T20:27:22.268475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":668407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":77617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":660805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:31.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.094+0000 7f768b4fc640 1 Processor -- start 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.094+0000 7f768b4fc640 1 -- start start 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f76840c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76840c2bc0 0x7f76840c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7684155e10 con 0x7f76840a94b0 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768406e790 con 0x7f76840c2bc0 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768406f460 con 0x7f76840c30d0 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76840c2bc0 0x7f76840c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76840c2bc0 0x7f76840c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38810/0 (socket says 172.21.15.81:38810) 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 -- 172.21.15.81:0/4196849046 learned_addr learned my addr 172.21.15.81:0/4196849046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7689298640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f76840c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 -- 172.21.15.81:0/4196849046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 msgr2=0x7f76840c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f76840c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 -- 172.21.15.81:0/4196849046 >> v1:172.21.15.117:6789/0 conn(0x7f76840a94b0 legacy=0x7f76840a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 -- 172.21.15.81:0/4196849046 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684156080 con 0x7f76840c2bc0 2024-05-08T20:27:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7688a97640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f76840c4120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76780098a0 tx=0x7f767801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baea602df71f11a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7683fff640 1 -- 172.21.15.81:0/4196849046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780ab600 con 0x7f76840c2bc0 2024-05-08T20:27:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7683fff640 1 -- 172.21.15.81:0/4196849046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780ab760 con 0x7f76840c2bc0 2024-05-08T20:27:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f7683fff640 1 -- 172.21.15.81:0/4196849046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780abaf0 con 0x7f76840c2bc0 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- 172.21.15.81:0/4196849046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 msgr2=0x7f76840c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f76840c4120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76780098a0 tx=0x7f767801c440 comp rx=0 tx=0).stop 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- 172.21.15.81:0/4196849046 shutdown_connections 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f76840c4120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 --2- 172.21.15.81:0/4196849046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f76840c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- 172.21.15.81:0/4196849046 >> 172.21.15.81:0/4196849046 conn(0x7f76840c4cc0 msgr2=0x7f76840c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- 172.21.15.81:0/4196849046 shutdown_connections 2024-05-08T20:27:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.098+0000 7f768b4fc640 1 -- 172.21.15.81:0/4196849046 wait complete. 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 Processor -- start 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- start start 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76840a94b0 0x7f76841ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f7684145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840acd40 con 0x7f76840c2bc0 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76841edd50 con 0x7f76840a94b0 2024-05-08T20:27:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768406cb90 con 0x7f76840c30d0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38822/0 (socket says 172.21.15.81:38822) 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 -- 172.21.15.81:0/633699412 learned_addr learned my addr 172.21.15.81:0/633699412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7689a99640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f7684145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 -- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 msgr2=0x7f7684145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f7684145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 -- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76840a94b0 msgr2=0x7f76841ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76840a94b0 0x7f76841ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 -- 172.21.15.81:0/633699412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780094d0 con 0x7f76840c2bc0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7688a97640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76780ad040 tx=0x7f767801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780b4800 con 0x7f76840c2bc0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780b4980 con 0x7f76840c2bc0 2024-05-08T20:27:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768406ce70 con 0x7f76840c2bc0 2024-05-08T20:27:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780b4d30 con 0x7f76840c2bc0 2024-05-08T20:27:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76840ae230 con 0x7f76840c2bc0 2024-05-08T20:27:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7684074950 con 0x7f76840c2bc0 2024-05-08T20:27:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.102+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76780c7440 con 0x7f76840c2bc0 2024-05-08T20:27:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.106+0000 7f7681ffb640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 0x7f7670068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.106+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f767811f040 con 0x7f76840c2bc0 2024-05-08T20:27:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.106+0000 7f7689298640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 0x7f7670068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.106+0000 7f7689298640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 0x7f7670068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a810 tx=0x7f767c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.110+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f76780ec110 con 0x7f76840c2bc0 2024-05-08T20:27:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.258+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76840c4970 con 0x7f7670066690 2024-05-08T20:27:32.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.294+0000 7f7681ffb640 1 -- 172.21.15.81:0/633699412 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+492230 (secure 0 0 0) 0x7f767c00a400 con 0x7f7670066690 2024-05-08T20:27:32.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:32.308 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 msgr2=0x7f7670068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 0x7f7670068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a810 tx=0x7f767c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 msgr2=0x7f768415c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76780ad040 tx=0x7f767801ac80 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 shutdown_connections 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7670066690 0x7f7670068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76840c30d0 0x7f7684145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76840c2bc0 0x7f768415c7d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 --2- 172.21.15.81:0/633699412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76840a94b0 0x7f76841ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 >> 172.21.15.81:0/633699412 conn(0x7f76840c4cc0 msgr2=0x7f768414cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 shutdown_connections 2024-05-08T20:27:32.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.298+0000 7f768b4fc640 1 -- 172.21.15.81:0/633699412 wait complete. 2024-05-08T20:27:32.319 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-08T20:27:31.226942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2936832,"data_stored":1777541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661871"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258144+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:22.258144+0000","last_peered":"2024-05-08T20:27:22.258144+0000","last_clean":"2024-05-08T20:27:22.258144+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:22.258144+0000","last_undegraded":"2024-05-08T20:27:22.258144+0000","last_fullsized":"2024-05-08T20:27:22.258144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261052+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:22.261052+0000","last_peered":"2024-05-08T20:27:22.261052+0000","last_clean":"2024-05-08T20:27:22.261052+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:22.261052+0000","last_undegraded":"2024-05-08T20:27:22.261052+0000","last_fullsized":"2024-05-08T20:27:22.261052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575756+0000","last_change":"2024-05-08T20:27:26.575756+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575756+0000","last_undegraded":"2024-05-08T20:27:26.575756+0000","last_fullsized":"2024-05-08T20:27:26.575756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261097+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:22.261097+0000","last_peered":"2024-05-08T20:27:22.261097+0000","last_clean":"2024-05-08T20:27:22.261097+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:22.261097+0000","last_undegraded":"2024-05-08T20:27:22.261097+0000","last_fullsized":"2024-05-08T20:27:22.261097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258022+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:22.258022+0000","last_peered":"2024-05-08T20:27:22.258022+0000","last_clean":"2024-05-08T20:27:22.258022+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:22.258022+0000","last_undegraded":"2024-05-08T20:27:22.258022+0000","last_fullsized":"2024-05-08T20:27:22.258022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581298+0000","last_change":"2024-05-08T20:27:26.581298+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581298+0000","last_undegraded":"2024-05-08T20:27:26.581298+0000","last_fullsized":"2024-05-08T20:27:26.581298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268348+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:22.268348+0000","last_peered":"2024-05-08T20:27:22.268348+0000","last_clean":"2024-05-08T20:27:22.268348+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:22.268348+0000","last_undegraded":"2024-05-08T20:27:22.268348+0000","last_fullsized":"2024-05-08T20:27:22.268348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261347+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:22.261347+0000","last_peered":"2024-05-08T20:27:22.261347+0000","last_clean":"2024-05-08T20:27:22.261347+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:22.261347+0000","last_undegraded":"2024-05-08T20:27:22.261347+0000","last_fullsized":"2024-05-08T20:27:22.261347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.585893+0000","last_change":"2024-05-08T20:27:26.585893+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.585893+0000","last_undegraded":"2024-05-08T20:27:26.585893+0000","last_fullsized":"2024-05-08T20:27:26.585893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268249+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:22.268249+0000","last_peered":"2024-05-08T20:27:22.268249+0000","last_clean":"2024-05-08T20:27:22.268249+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:22.268249+0000","last_undegraded":"2024-05-08T20:27:22.268249+0000","last_fullsized":"2024-05-08T20:27:22.268249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261439+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:22.261439+0000","last_peered":"2024-05-08T20:27:22.261439+0000","last_clean":"2024-05-08T20:27:22.261439+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:22.261439+0000","last_undegraded":"2024-05-08T20:27:22.261439+0000","last_fullsized":"2024-05-08T20:27:22.261439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583545+0000","last_change":"2024-05-08T20:27:26.583545+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583545+0000","last_undegraded":"2024-05-08T20:27:26.583545+0000","last_fullsized":"2024-05-08T20:27:26.583545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257567+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:22.257567+0000","last_peered":"2024-05-08T20:27:22.257567+0000","last_clean":"2024-05-08T20:27:22.257567+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:22.257567+0000","last_undegraded":"2024-05-08T20:27:22.257567+0000","last_fullsized":"2024-05-08T20:27:22.257567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268224+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:22.268224+0000","last_peered":"2024-05-08T20:27:22.268224+0000","last_clean":"2024-05-08T20:27:22.268224+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:22.268224+0000","last_undegraded":"2024-05-08T20:27:22.268224+0000","last_fullsized":"2024-05-08T20:27:22.268224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581606+0000","last_change":"2024-05-08T20:27:26.581606+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581606+0000","last_undegraded":"2024-05-08T20:27:26.581606+0000","last_fullsized":"2024-05-08T20:27:26.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260967+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:22.260967+0000","last_peered":"2024-05-08T20:27:22.260967+0000","last_clean":"2024-05-08T20:27:22.260967+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:22.260967+0000","last_undegraded":"2024-05-08T20:27:22.260967+0000","last_fullsized":"2024-05-08T20:27:22.260967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264391+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:22.264391+0000","last_peered":"2024-05-08T20:27:22.264391+0000","last_clean":"2024-05-08T20:27:22.264391+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:22.264391+0000","last_undegraded":"2024-05-08T20:27:22.264391+0000","last_fullsized":"2024-05-08T20:27:22.264391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581456+0000","last_change":"2024-05-08T20:27:26.581456+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581456+0000","last_undegraded":"2024-05-08T20:27:26.581456+0000","last_fullsized":"2024-05-08T20:27:26.581456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260834+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:22.260834+0000","last_peered":"2024-05-08T20:27:22.260834+0000","last_clean":"2024-05-08T20:27:22.260834+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:22.260834+0000","last_undegraded":"2024-05-08T20:27:22.260834+0000","last_fullsized":"2024-05-08T20:27:22.260834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264368+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:22.264368+0000","last_peered":"2024-05-08T20:27:22.264368+0000","last_clean":"2024-05-08T20:27:22.264368+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:22.264368+0000","last_undegraded":"2024-05-08T20:27:22.264368+0000","last_fullsized":"2024-05-08T20:27:22.264368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572396+0000","last_change":"2024-05-08T20:27:26.572396+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572396+0000","last_undegraded":"2024-05-08T20:27:26.572396+0000","last_fullsized":"2024-05-08T20:27:26.572396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260148+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:22.260148+0000","last_peered":"2024-05-08T20:27:22.260148+0000","last_clean":"2024-05-08T20:27:22.260148+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:22.260148+0000","last_undegraded":"2024-05-08T20:27:22.260148+0000","last_fullsized":"2024-05-08T20:27:22.260148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.267972+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:22.267972+0000","last_peered":"2024-05-08T20:27:22.267972+0000","last_clean":"2024-05-08T20:27:22.267972+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:22.267972+0000","last_undegraded":"2024-05-08T20:27:22.267972+0000","last_fullsized":"2024-05-08T20:27:22.267972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.582451+0000","last_change":"2024-05-08T20:27:26.582451+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.582451+0000","last_undegraded":"2024-05-08T20:27:26.582451+0000","last_fullsized":"2024-05-08T20:27:26.582451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257988+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:22.257988+0000","last_peered":"2024-05-08T20:27:22.257988+0000","last_clean":"2024-05-08T20:27:22.257988+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:22.257988+0000","last_undegraded":"2024-05-08T20:27:22.257988+0000","last_fullsized":"2024-05-08T20:27:22.257988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257810+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:22.257810+0000","last_peered":"2024-05-08T20:27:22.257810+0000","last_clean":"2024-05-08T20:27:22.257810+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:22.257810+0000","last_undegraded":"2024-05-08T20:27:22.257810+0000","last_fullsized":"2024-05-08T20:27:22.257810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581739+0000","last_change":"2024-05-08T20:27:26.581739+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581739+0000","last_undegraded":"2024-05-08T20:27:26.581739+0000","last_fullsized":"2024-05-08T20:27:26.581739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261191+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:22.261191+0000","last_peered":"2024-05-08T20:27:22.261191+0000","last_clean":"2024-05-08T20:27:22.261191+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:22.261191+0000","last_undegraded":"2024-05-08T20:27:22.261191+0000","last_fullsized":"2024-05-08T20:27:22.261191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.767255+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:22.767255+0000","last_peered":"2024-05-08T20:27:22.767255+0000","last_clean":"2024-05-08T20:27:22.767255+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:22.767255+0000","last_undegraded":"2024-05-08T20:27:22.767255+0000","last_fullsized":"2024-05-08T20:27:22.767255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.579085+0000","last_change":"2024-05-08T20:27:26.579085+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.579085+0000","last_undegraded":"2024-05-08T20:27:26.579085+0000","last_fullsized":"2024-05-08T20:27:26.579085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264427+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:22.264427+0000","last_peered":"2024-05-08T20:27:22.264427+0000","last_clean":"2024-05-08T20:27:22.264427+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:22.264427+0000","last_undegraded":"2024-05-08T20:27:22.264427+0000","last_fullsized":"2024-05-08T20:27:22.264427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268416+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:22.268416+0000","last_peered":"2024-05-08T20:27:22.268416+0000","last_clean":"2024-05-08T20:27:22.268416+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:22.268416+0000","last_undegraded":"2024-05-08T20:27:22.268416+0000","last_fullsized":"2024-05-08T20:27:22.268416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261485+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:22.261485+0000","last_peered":"2024-05-08T20:27:22.261485+0000","last_clean":"2024-05-08T20:27:22.261485+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:22.261485+0000","last_undegraded":"2024-05-08T20:27:22.261485+0000","last_fullsized":"2024-05-08T20:27:22.261485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264450+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:22.264450+0000","last_peered":"2024-05-08T20:27:22.264450+0000","last_clean":"2024-05-08T20:27:22.264450+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:22.264450+0000","last_undegraded":"2024-05-08T20:27:22.264450+0000","last_fullsized":"2024-05-08T20:27:22.264450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570795+0000","last_change":"2024-05-08T20:27:26.570795+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570795+0000","last_undegraded":"2024-05-08T20:27:26.570795+0000","last_fullsized":"2024-05-08T20:27:26.570795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260211+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:22.260211+0000","last_peered":"2024-05-08T20:27:22.260211+0000","last_clean":"2024-05-08T20:27:22.260211+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:22.260211+0000","last_undegraded":"2024-05-08T20:27:22.260211+0000","last_fullsized":"2024-05-08T20:27:22.260211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261213+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:22.261213+0000","last_peered":"2024-05-08T20:27:22.261213+0000","last_clean":"2024-05-08T20:27:22.261213+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:22.261213+0000","last_undegraded":"2024-05-08T20:27:22.261213+0000","last_fullsized":"2024-05-08T20:27:22.261213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570786+0000","last_change":"2024-05-08T20:27:26.570786+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570786+0000","last_undegraded":"2024-05-08T20:27:26.570786+0000","last_fullsized":"2024-05-08T20:27:26.570786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264288+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:22.264288+0000","last_peered":"2024-05-08T20:27:22.264288+0000","last_clean":"2024-05-08T20:27:22.264288+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:22.264288+0000","last_undegraded":"2024-05-08T20:27:22.264288+0000","last_fullsized":"2024-05-08T20:27:22.264288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256661+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:22.256661+0000","last_peered":"2024-05-08T20:27:22.256661+0000","last_clean":"2024-05-08T20:27:22.256661+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:22.256661+0000","last_undegraded":"2024-05-08T20:27:22.256661+0000","last_fullsized":"2024-05-08T20:27:22.256661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570862+0000","last_change":"2024-05-08T20:27:26.570862+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570862+0000","last_undegraded":"2024-05-08T20:27:26.570862+0000","last_fullsized":"2024-05-08T20:27:26.570862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257684+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:22.257684+0000","last_peered":"2024-05-08T20:27:22.257684+0000","last_clean":"2024-05-08T20:27:22.257684+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:22.257684+0000","last_undegraded":"2024-05-08T20:27:22.257684+0000","last_fullsized":"2024-05-08T20:27:22.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268037+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:22.268037+0000","last_peered":"2024-05-08T20:27:22.268037+0000","last_clean":"2024-05-08T20:27:22.268037+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:22.268037+0000","last_undegraded":"2024-05-08T20:27:22.268037+0000","last_fullsized":"2024-05-08T20:27:22.268037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608063+0000","last_change":"2024-05-08T20:27:26.608063+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608063+0000","last_undegraded":"2024-05-08T20:27:26.608063+0000","last_fullsized":"2024-05-08T20:27:26.608063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260900+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:22.260900+0000","last_peered":"2024-05-08T20:27:22.260900+0000","last_clean":"2024-05-08T20:27:22.260900+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:22.260900+0000","last_undegraded":"2024-05-08T20:27:22.260900+0000","last_fullsized":"2024-05-08T20:27:22.260900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261254+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:22.261254+0000","last_peered":"2024-05-08T20:27:22.261254+0000","last_clean":"2024-05-08T20:27:22.261254+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:22.261254+0000","last_undegraded":"2024-05-08T20:27:22.261254+0000","last_fullsized":"2024-05-08T20:27:22.261254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626652+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:20.626652+0000","last_peered":"2024-05-08T20:27:20.626652+0000","last_clean":"2024-05-08T20:27:20.626652+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:20.626652+0000","last_undegraded":"2024-05-08T20:27:20.626652+0000","last_fullsized":"2024-05-08T20:27:20.626652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572168+0000","last_change":"2024-05-08T20:27:26.572168+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572168+0000","last_undegraded":"2024-05-08T20:27:26.572168+0000","last_fullsized":"2024-05-08T20:27:26.572168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268316+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:22.268316+0000","last_peered":"2024-05-08T20:27:22.268316+0000","last_clean":"2024-05-08T20:27:22.268316+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:22.268316+0000","last_undegraded":"2024-05-08T20:27:22.268316+0000","last_fullsized":"2024-05-08T20:27:22.268316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256689+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:22.256689+0000","last_peered":"2024-05-08T20:27:22.256689+0000","last_clean":"2024-05-08T20:27:22.256689+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:22.256689+0000","last_undegraded":"2024-05-08T20:27:22.256689+0000","last_fullsized":"2024-05-08T20:27:22.256689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572082+0000","last_change":"2024-05-08T20:27:26.572082+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572082+0000","last_undegraded":"2024-05-08T20:27:26.572082+0000","last_fullsized":"2024-05-08T20:27:26.572082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261393+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:22.261393+0000","last_peered":"2024-05-08T20:27:22.261393+0000","last_clean":"2024-05-08T20:27:22.261393+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:22.261393+0000","last_undegraded":"2024-05-08T20:27:22.261393+0000","last_fullsized":"2024-05-08T20:27:22.261393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264551+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:22.264551+0000","last_peered":"2024-05-08T20:27:22.264551+0000","last_clean":"2024-05-08T20:27:22.264551+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:22.264551+0000","last_undegraded":"2024-05-08T20:27:22.264551+0000","last_fullsized":"2024-05-08T20:27:22.264551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608054+0000","last_change":"2024-05-08T20:27:26.608054+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608054+0000","last_undegraded":"2024-05-08T20:27:26.608054+0000","last_fullsized":"2024-05-08T20:27:26.608054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268523+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:22.268523+0000","last_peered":"2024-05-08T20:27:22.268523+0000","last_clean":"2024-05-08T20:27:22.268523+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:22.268523+0000","last_undegraded":"2024-05-08T20:27:22.268523+0000","last_fullsized":"2024-05-08T20:27:22.268523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256738+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:22.256738+0000","last_peered":"2024-05-08T20:27:22.256738+0000","last_clean":"2024-05-08T20:27:22.256738+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:22.256738+0000","last_undegraded":"2024-05-08T20:27:22.256738+0000","last_fullsized":"2024-05-08T20:27:22.256738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572103+0000","last_change":"2024-05-08T20:27:26.572103+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572103+0000","last_undegraded":"2024-05-08T20:27:26.572103+0000","last_fullsized":"2024-05-08T20:27:26.572103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268452+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:22.268452+0000","last_peered":"2024-05-08T20:27:22.268452+0000","last_clean":"2024-05-08T20:27:22.268452+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:22.268452+0000","last_undegraded":"2024-05-08T20:27:22.268452+0000","last_fullsized":"2024-05-08T20:27:22.268452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260287+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:22.260287+0000","last_peered":"2024-05-08T20:27:22.260287+0000","last_clean":"2024-05-08T20:27:22.260287+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:22.260287+0000","last_undegraded":"2024-05-08T20:27:22.260287+0000","last_fullsized":"2024-05-08T20:27:22.260287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.584404+0000","last_change":"2024-05-08T20:27:26.584404+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.584404+0000","last_undegraded":"2024-05-08T20:27:26.584404+0000","last_fullsized":"2024-05-08T20:27:26.584404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268124+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:22.268124+0000","last_peered":"2024-05-08T20:27:22.268124+0000","last_clean":"2024-05-08T20:27:22.268124+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:22.268124+0000","last_undegraded":"2024-05-08T20:27:22.268124+0000","last_fullsized":"2024-05-08T20:27:22.268124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256541+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:22.256541+0000","last_peered":"2024-05-08T20:27:22.256541+0000","last_clean":"2024-05-08T20:27:22.256541+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:22.256541+0000","last_undegraded":"2024-05-08T20:27:22.256541+0000","last_fullsized":"2024-05-08T20:27:22.256541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257505+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:22.257505+0000","last_peered":"2024-05-08T20:27:22.257505+0000","last_clean":"2024-05-08T20:27:22.257505+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:22.257505+0000","last_undegraded":"2024-05-08T20:27:22.257505+0000","last_fullsized":"2024-05-08T20:27:22.257505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257541+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:22.257541+0000","last_peered":"2024-05-08T20:27:22.257541+0000","last_clean":"2024-05-08T20:27:22.257541+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:22.257541+0000","last_undegraded":"2024-05-08T20:27:22.257541+0000","last_fullsized":"2024-05-08T20:27:22.257541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576679+0000","last_change":"2024-05-08T20:27:26.576679+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576679+0000","last_undegraded":"2024-05-08T20:27:26.576679+0000","last_fullsized":"2024-05-08T20:27:26.576679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268197+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:22.268197+0000","last_peered":"2024-05-08T20:27:22.268197+0000","last_clean":"2024-05-08T20:27:22.268197+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:22.268197+0000","last_undegraded":"2024-05-08T20:27:22.268197+0000","last_fullsized":"2024-05-08T20:27:22.268197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261154+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:22.261154+0000","last_peered":"2024-05-08T20:27:22.261154+0000","last_clean":"2024-05-08T20:27:22.261154+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:22.261154+0000","last_undegraded":"2024-05-08T20:27:22.261154+0000","last_fullsized":"2024-05-08T20:27:22.261154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575918+0000","last_change":"2024-05-08T20:27:26.575918+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575918+0000","last_undegraded":"2024-05-08T20:27:26.575918+0000","last_fullsized":"2024-05-08T20:27:26.575918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257776+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:22.257776+0000","last_peered":"2024-05-08T20:27:22.257776+0000","last_clean":"2024-05-08T20:27:22.257776+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:22.257776+0000","last_undegraded":"2024-05-08T20:27:22.257776+0000","last_fullsized":"2024-05-08T20:27:22.257776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257929+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:22.257929+0000","last_peered":"2024-05-08T20:27:22.257929+0000","last_clean":"2024-05-08T20:27:22.257929+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:22.257929+0000","last_undegraded":"2024-05-08T20:27:22.257929+0000","last_fullsized":"2024-05-08T20:27:22.257929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.573162+0000","last_change":"2024-05-08T20:27:26.573162+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.573162+0000","last_undegraded":"2024-05-08T20:27:26.573162+0000","last_fullsized":"2024-05-08T20:27:26.573162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268276+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:22.268276+0000","last_peered":"2024-05-08T20:27:22.268276+0000","last_clean":"2024-05-08T20:27:22.268276+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:22.268276+0000","last_undegraded":"2024-05-08T20:27:22.268276+0000","last_fullsized":"2024-05-08T20:27:22.268276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257680+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:22.257680+0000","last_peered":"2024-05-08T20:27:22.257680+0000","last_clean":"2024-05-08T20:27:22.257680+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:22.257680+0000","last_undegraded":"2024-05-08T20:27:22.257680+0000","last_fullsized":"2024-05-08T20:27:22.257680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572155+0000","last_change":"2024-05-08T20:27:26.572155+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572155+0000","last_undegraded":"2024-05-08T20:27:26.572155+0000","last_fullsized":"2024-05-08T20:27:26.572155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260259+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:22.260259+0000","last_peered":"2024-05-08T20:27:22.260259+0000","last_clean":"2024-05-08T20:27:22.260259+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:22.260259+0000","last_undegraded":"2024-05-08T20:27:22.260259+0000","last_fullsized":"2024-05-08T20:27:22.260259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264497+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:22.264497+0000","last_peered":"2024-05-08T20:27:22.264497+0000","last_clean":"2024-05-08T20:27:22.264497+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:22.264497+0000","last_undegraded":"2024-05-08T20:27:22.264497+0000","last_fullsized":"2024-05-08T20:27:22.264497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583009+0000","last_change":"2024-05-08T20:27:26.583009+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583009+0000","last_undegraded":"2024-05-08T20:27:26.583009+0000","last_fullsized":"2024-05-08T20:27:26.583009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258095+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:22.258095+0000","last_peered":"2024-05-08T20:27:22.258095+0000","last_clean":"2024-05-08T20:27:22.258095+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:22.258095+0000","last_undegraded":"2024-05-08T20:27:22.258095+0000","last_fullsized":"2024-05-08T20:27:22.258095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261587+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:22.261587+0000","last_peered":"2024-05-08T20:27:22.261587+0000","last_clean":"2024-05-08T20:27:22.261587+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:22.261587+0000","last_undegraded":"2024-05-08T20:27:22.261587+0000","last_fullsized":"2024-05-08T20:27:22.261587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575782+0000","last_change":"2024-05-08T20:27:26.575782+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575782+0000","last_undegraded":"2024-05-08T20:27:26.575782+0000","last_fullsized":"2024-05-08T20:27:26.575782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261527+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:22.261527+0000","last_peered":"2024-05-08T20:27:22.261527+0000","last_clean":"2024-05-08T20:27:22.261527+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:22.261527+0000","last_undegraded":"2024-05-08T20:27:22.261527+0000","last_fullsized":"2024-05-08T20:27:22.261527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257787+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:22.257787+0000","last_peered":"2024-05-08T20:27:22.257787+0000","last_clean":"2024-05-08T20:27:22.257787+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:22.257787+0000","last_undegraded":"2024-05-08T20:27:22.257787+0000","last_fullsized":"2024-05-08T20:27:22.257787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576460+0000","last_change":"2024-05-08T20:27:26.576460+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576460+0000","last_undegraded":"2024-05-08T20:27:26.576460+0000","last_fullsized":"2024-05-08T20:27:26.576460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608514+0000","last_change":"2024-05-08T20:27:26.608514+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608514+0000","last_undegraded":"2024-05-08T20:27:26.608514+0000","last_fullsized":"2024-05-08T20:27:26.608514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264323+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:22.264323+0000","last_peered":"2024-05-08T20:27:22.264323+0000","last_clean":"2024-05-08T20:27:22.264323+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:22.264323+0000","last_undegraded":"2024-05-08T20:27:22.264323+0000","last_fullsized":"2024-05-08T20:27:22.264323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260973+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:22.260973+0000","last_peered":"2024-05-08T20:27:22.260973+0000","last_clean":"2024-05-08T20:27:22.260973+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:22.260973+0000","last_undegraded":"2024-05-08T20:27:22.260973+0000","last_fullsized":"2024-05-08T20:27:22.260973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572090+0000","last_change":"2024-05-08T20:27:26.572090+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572090+0000","last_undegraded":"2024-05-08T20:27:26.572090+0000","last_fullsized":"2024-05-08T20:27:26.572090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260809+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:22.260809+0000","last_peered":"2024-05-08T20:27:22.260809+0000","last_clean":"2024-05-08T20:27:22.260809+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:22.260809+0000","last_undegraded":"2024-05-08T20:27:22.260809+0000","last_fullsized":"2024-05-08T20:27:22.260809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260878+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:22.260878+0000","last_peered":"2024-05-08T20:27:22.260878+0000","last_clean":"2024-05-08T20:27:22.260878+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:22.260878+0000","last_undegraded":"2024-05-08T20:27:22.260878+0000","last_fullsized":"2024-05-08T20:27:22.260878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257632+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:22.257632+0000","last_peered":"2024-05-08T20:27:22.257632+0000","last_clean":"2024-05-08T20:27:22.257632+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:22.257632+0000","last_undegraded":"2024-05-08T20:27:22.257632+0000","last_fullsized":"2024-05-08T20:27:22.257632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257875+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:22.257875+0000","last_peered":"2024-05-08T20:27:22.257875+0000","last_clean":"2024-05-08T20:27:22.257875+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:22.257875+0000","last_undegraded":"2024-05-08T20:27:22.257875+0000","last_fullsized":"2024-05-08T20:27:22.257875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575595+0000","last_change":"2024-05-08T20:27:26.575595+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575595+0000","last_undegraded":"2024-05-08T20:27:26.575595+0000","last_fullsized":"2024-05-08T20:27:26.575595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260998+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:22.260998+0000","last_peered":"2024-05-08T20:27:22.260998+0000","last_clean":"2024-05-08T20:27:22.260998+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:22.260998+0000","last_undegraded":"2024-05-08T20:27:22.260998+0000","last_fullsized":"2024-05-08T20:27:22.260998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260184+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:22.260184+0000","last_peered":"2024-05-08T20:27:22.260184+0000","last_clean":"2024-05-08T20:27:22.260184+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:22.260184+0000","last_undegraded":"2024-05-08T20:27:22.260184+0000","last_fullsized":"2024-05-08T20:27:22.260184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576494+0000","last_change":"2024-05-08T20:27:26.576494+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576494+0000","last_undegraded":"2024-05-08T20:27:26.576494+0000","last_fullsized":"2024-05-08T20:27:26.576494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257470+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:22.257470+0000","last_peered":"2024-05-08T20:27:22.257470+0000","last_clean":"2024-05-08T20:27:22.257470+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:22.257470+0000","last_undegraded":"2024-05-08T20:27:22.257470+0000","last_fullsized":"2024-05-08T20:27:22.257470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256608+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:22.256608+0000","last_peered":"2024-05-08T20:27:22.256608+0000","last_clean":"2024-05-08T20:27:22.256608+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:22.256608+0000","last_undegraded":"2024-05-08T20:27:22.256608+0000","last_fullsized":"2024-05-08T20:27:22.256608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261103+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:22.261103+0000","last_peered":"2024-05-08T20:27:22.261103+0000","last_clean":"2024-05-08T20:27:22.261103+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:22.261103+0000","last_undegraded":"2024-05-08T20:27:22.261103+0000","last_fullsized":"2024-05-08T20:27:22.261103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257834+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:22.257834+0000","last_peered":"2024-05-08T20:27:22.257834+0000","last_clean":"2024-05-08T20:27:22.257834+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:22.257834+0000","last_undegraded":"2024-05-08T20:27:22.257834+0000","last_fullsized":"2024-05-08T20:27:22.257834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261023+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:22.261023+0000","last_peered":"2024-05-08T20:27:22.261023+0000","last_clean":"2024-05-08T20:27:22.261023+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:22.261023+0000","last_undegraded":"2024-05-08T20:27:22.261023+0000","last_fullsized":"2024-05-08T20:27:22.261023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264471+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:22.264471+0000","last_peered":"2024-05-08T20:27:22.264471+0000","last_clean":"2024-05-08T20:27:22.264471+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:22.264471+0000","last_undegraded":"2024-05-08T20:27:22.264471+0000","last_fullsized":"2024-05-08T20:27:22.264471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257751+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:22.257751+0000","last_peered":"2024-05-08T20:27:22.257751+0000","last_clean":"2024-05-08T20:27:22.257751+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:22.257751+0000","last_undegraded":"2024-05-08T20:27:22.257751+0000","last_fullsized":"2024-05-08T20:27:22.257751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261148+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:22.261148+0000","last_peered":"2024-05-08T20:27:22.261148+0000","last_clean":"2024-05-08T20:27:22.261148+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:22.261148+0000","last_undegraded":"2024-05-08T20:27:22.261148+0000","last_fullsized":"2024-05-08T20:27:22.261148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260921+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:22.260921+0000","last_peered":"2024-05-08T20:27:22.260921+0000","last_clean":"2024-05-08T20:27:22.260921+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:22.260921+0000","last_undegraded":"2024-05-08T20:27:22.260921+0000","last_fullsized":"2024-05-08T20:27:22.260921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260856+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:22.260856+0000","last_peered":"2024-05-08T20:27:22.260856+0000","last_clean":"2024-05-08T20:27:22.260856+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:22.260856+0000","last_undegraded":"2024-05-08T20:27:22.260856+0000","last_fullsized":"2024-05-08T20:27:22.260856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261062+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:22.261062+0000","last_peered":"2024-05-08T20:27:22.261062+0000","last_clean":"2024-05-08T20:27:22.261062+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:22.261062+0000","last_undegraded":"2024-05-08T20:27:22.261062+0000","last_fullsized":"2024-05-08T20:27:22.261062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257798+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:22.257798+0000","last_peered":"2024-05-08T20:27:22.257798+0000","last_clean":"2024-05-08T20:27:22.257798+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:22.257798+0000","last_undegraded":"2024-05-08T20:27:22.257798+0000","last_fullsized":"2024-05-08T20:27:22.257798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257657+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:22.257657+0000","last_peered":"2024-05-08T20:27:22.257657+0000","last_clean":"2024-05-08T20:27:22.257657+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:22.257657+0000","last_undegraded":"2024-05-08T20:27:22.257657+0000","last_fullsized":"2024-05-08T20:27:22.257657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268391+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:22.268391+0000","last_peered":"2024-05-08T20:27:22.268391+0000","last_clean":"2024-05-08T20:27:22.268391+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:22.268391+0000","last_undegraded":"2024-05-08T20:27:22.268391+0000","last_fullsized":"2024-05-08T20:27:22.268391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256712+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:22.256712+0000","last_peered":"2024-05-08T20:27:22.256712+0000","last_clean":"2024-05-08T20:27:22.256712+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:22.256712+0000","last_undegraded":"2024-05-08T20:27:22.256712+0000","last_fullsized":"2024-05-08T20:27:22.256712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261634+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:22.261634+0000","last_peered":"2024-05-08T20:27:22.261634+0000","last_clean":"2024-05-08T20:27:22.261634+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:22.261634+0000","last_undegraded":"2024-05-08T20:27:22.261634+0000","last_fullsized":"2024-05-08T20:27:22.261634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260863+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:22.260863+0000","last_peered":"2024-05-08T20:27:22.260863+0000","last_clean":"2024-05-08T20:27:22.260863+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:22.260863+0000","last_undegraded":"2024-05-08T20:27:22.260863+0000","last_fullsized":"2024-05-08T20:27:22.260863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264346+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:22.264346+0000","last_peered":"2024-05-08T20:27:22.264346+0000","last_clean":"2024-05-08T20:27:22.264346+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:22.264346+0000","last_undegraded":"2024-05-08T20:27:22.264346+0000","last_fullsized":"2024-05-08T20:27:22.264346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257738+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:22.257738+0000","last_peered":"2024-05-08T20:27:22.257738+0000","last_clean":"2024-05-08T20:27:22.257738+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:22.257738+0000","last_undegraded":"2024-05-08T20:27:22.257738+0000","last_fullsized":"2024-05-08T20:27:22.257738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260922+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:22.260922+0000","last_peered":"2024-05-08T20:27:22.260922+0000","last_clean":"2024-05-08T20:27:22.260922+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:22.260922+0000","last_undegraded":"2024-05-08T20:27:22.260922+0000","last_fullsized":"2024-05-08T20:27:22.260922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260236+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:22.260236+0000","last_peered":"2024-05-08T20:27:22.260236+0000","last_clean":"2024-05-08T20:27:22.260236+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:22.260236+0000","last_undegraded":"2024-05-08T20:27:22.260236+0000","last_fullsized":"2024-05-08T20:27:22.260236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257707+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:22.257707+0000","last_peered":"2024-05-08T20:27:22.257707+0000","last_clean":"2024-05-08T20:27:22.257707+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:22.257707+0000","last_undegraded":"2024-05-08T20:27:22.257707+0000","last_fullsized":"2024-05-08T20:27:22.257707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257729+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:22.257729+0000","last_peered":"2024-05-08T20:27:22.257729+0000","last_clean":"2024-05-08T20:27:22.257729+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:22.257729+0000","last_undegraded":"2024-05-08T20:27:22.257729+0000","last_fullsized":"2024-05-08T20:27:22.257729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268498+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:22.268498+0000","last_peered":"2024-05-08T20:27:22.268498+0000","last_clean":"2024-05-08T20:27:22.268498+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:22.268498+0000","last_undegraded":"2024-05-08T20:27:22.268498+0000","last_fullsized":"2024-05-08T20:27:22.268498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260773+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:22.260773+0000","last_peered":"2024-05-08T20:27:22.260773+0000","last_clean":"2024-05-08T20:27:22.260773+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:22.260773+0000","last_undegraded":"2024-05-08T20:27:22.260773+0000","last_fullsized":"2024-05-08T20:27:22.260773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268082+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:22.268082+0000","last_peered":"2024-05-08T20:27:22.268082+0000","last_clean":"2024-05-08T20:27:22.268082+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:22.268082+0000","last_undegraded":"2024-05-08T20:27:22.268082+0000","last_fullsized":"2024-05-08T20:27:22.268082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261016+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:22.261016+0000","last_peered":"2024-05-08T20:27:22.261016+0000","last_clean":"2024-05-08T20:27:22.261016+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:22.261016+0000","last_undegraded":"2024-05-08T20:27:22.261016+0000","last_fullsized":"2024-05-08T20:27:22.261016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268152+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:22.268152+0000","last_peered":"2024-05-08T20:27:22.268152+0000","last_clean":"2024-05-08T20:27:22.268152+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:22.268152+0000","last_undegraded":"2024-05-08T20:27:22.268152+0000","last_fullsized":"2024-05-08T20:27:22.268152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261300+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:22.261300+0000","last_peered":"2024-05-08T20:27:22.261300+0000","last_clean":"2024-05-08T20:27:22.261300+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:22.261300+0000","last_undegraded":"2024-05-08T20:27:22.261300+0000","last_fullsized":"2024-05-08T20:27:22.261300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257965+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:22.257965+0000","last_peered":"2024-05-08T20:27:22.257965+0000","last_clean":"2024-05-08T20:27:22.257965+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:22.257965+0000","last_undegraded":"2024-05-08T20:27:22.257965+0000","last_fullsized":"2024-05-08T20:27:22.257965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264591+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:22.264591+0000","last_peered":"2024-05-08T20:27:22.264591+0000","last_clean":"2024-05-08T20:27:22.264591+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:22.264591+0000","last_undegraded":"2024-05-08T20:27:22.264591+0000","last_fullsized":"2024-05-08T20:27:22.264591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268475+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:22.268475+0000","last_peered":"2024-05-08T20:27:22.268475+0000","last_clean":"2024-05-08T20:27:22.268475+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:22.268475+0000","last_undegraded":"2024-05-08T20:27:22.268475+0000","last_fullsized":"2024-05-08T20:27:22.268475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":668407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":77617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":660805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:32.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:32.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.474+0000 7f099b1ea640 1 Processor -- start 2024-05-08T20:27:32.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.474+0000 7f099b1ea640 1 -- start start 2024-05-08T20:27:32.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f099b1ea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09940c1bb0 0x7f0994151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f099b1ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940c1f90 0x7f0994152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f099b1ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940c23f0 con 0x7f09941533d0 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f099b1ea640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0994155060 con 0x7f09940c1bb0 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f099b1ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994155340 con 0x7f09940c1f90 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09940c1bb0 0x7f0994151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09940c1bb0 0x7f0994151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38836/0 (socket says 172.21.15.81:38836) 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 -- 172.21.15.81:0/3687075897 learned_addr learned my addr 172.21.15.81:0/3687075897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0993fff640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940c1f90 0x7f0994152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 -- 172.21.15.81:0/3687075897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940c1f90 msgr2=0x7f0994152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940c1f90 0x7f0994152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 -- 172.21.15.81:0/3687075897 >> v1:172.21.15.117:6789/0 conn(0x7f09941533d0 legacy=0x7f099406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 -- 172.21.15.81:0/3687075897 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994155620 con 0x7f09940c1bb0 2024-05-08T20:27:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f0998f86640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1bb0 0x7f0994151740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf17402a229702f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f09937fe640 1 -- 172.21.15.81:0/3687075897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0a5790 con 0x7f09940c1bb0 2024-05-08T20:27:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f09937fe640 1 -- 172.21.15.81:0/3687075897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0a58f0 con 0x7f09940c1bb0 2024-05-08T20:27:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.478+0000 7f09937fe640 1 -- 172.21.15.81:0/3687075897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0a5c80 con 0x7f09940c1bb0 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/3687075897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1bb0 msgr2=0x7f0994151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1bb0 0x7f0994151740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f098c009e50 tx=0x7f098c01c930 comp rx=0 tx=0).stop 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/3687075897 shutdown_connections 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09940c1f90 0x7f0994152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- 172.21.15.81:0/3687075897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1bb0 0x7f0994151740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/3687075897 >> 172.21.15.81:0/3687075897 conn(0x7f09940c2ca0 msgr2=0x7f09940c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/3687075897 shutdown_connections 2024-05-08T20:27:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/3687075897 wait complete. 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 Processor -- start 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- start start 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940c1bb0 0x7f099415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 0x7f09940bf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099415cd60 con 0x7f09940c1f90 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994150e40 con 0x7f09940c1bb0 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940bb590 con 0x7f09941533d0 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 -- 172.21.15.81:0/188559498 learned_addr learned my addr 172.21.15.81:0/188559498 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0998f86640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940c1bb0 0x7f099415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0999787640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 0x7f09940bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 -- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 msgr2=0x7f09940bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 0x7f09940bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 -- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940c1bb0 msgr2=0x7f099415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940c1bb0 0x7f099415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 -- 172.21.15.81:0/188559498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009b30 con 0x7f09940c1f90 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0999787640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 0x7f09940bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f0993fff640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c7f0 tx=0x7f097c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c007820 con 0x7f09940c1f90 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c007980 con 0x7f09940c1f90 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940bf040 con 0x7f09940c1f90 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c007d30 con 0x7f09940c1f90 2024-05-08T20:27:32.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09941ebe30 con 0x7f09940c1f90 2024-05-08T20:27:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.482+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994074950 con 0x7f09940c1f90 2024-05-08T20:27:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.486+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f097c0113f0 con 0x7f09940c1f90 2024-05-08T20:27:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.486+0000 7f09917fa640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 0x7f0974068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.486+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f097c084500 con 0x7f09940c1f90 2024-05-08T20:27:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.486+0000 7f0998f86640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 0x7f0974068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.486+0000 7f0998f86640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 0x7f0974068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ae000 tx=0x7f098c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.490+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f097c0515d0 con 0x7f09940c1f90 2024-05-08T20:27:32.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.630+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0994154cf0 con 0x7f0974066690 2024-05-08T20:27:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.650+0000 7f09917fa640 1 -- 172.21.15.81:0/188559498 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+492230 (secure 0 0 0) 0x7f098c009250 con 0x7f0974066690 2024-05-08T20:27:32.660 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 msgr2=0x7f0974068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 0x7f0974068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ae000 tx=0x7f098c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 msgr2=0x7f099415c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c7f0 tx=0x7f097c00ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 shutdown_connections 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0974066690 0x7f0974068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09941533d0 0x7f09940bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09940c1f90 0x7f099415c820 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 --2- 172.21.15.81:0/188559498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09940c1bb0 0x7f099415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 >> 172.21.15.81:0/188559498 conn(0x7f09940c2ca0 msgr2=0x7f099414e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 shutdown_connections 2024-05-08T20:27:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.654+0000 7f099b1ea640 1 -- 172.21.15.81:0/188559498 wait complete. 2024-05-08T20:27:32.676 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-08T20:27:31.226942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2936832,"data_stored":1777541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.661871"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258144+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:22.258144+0000","last_peered":"2024-05-08T20:27:22.258144+0000","last_clean":"2024-05-08T20:27:22.258144+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:22.258144+0000","last_undegraded":"2024-05-08T20:27:22.258144+0000","last_fullsized":"2024-05-08T20:27:22.258144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261052+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:22.261052+0000","last_peered":"2024-05-08T20:27:22.261052+0000","last_clean":"2024-05-08T20:27:22.261052+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:22.261052+0000","last_undegraded":"2024-05-08T20:27:22.261052+0000","last_fullsized":"2024-05-08T20:27:22.261052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575756+0000","last_change":"2024-05-08T20:27:26.575756+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575756+0000","last_undegraded":"2024-05-08T20:27:26.575756+0000","last_fullsized":"2024-05-08T20:27:26.575756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261097+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:22.261097+0000","last_peered":"2024-05-08T20:27:22.261097+0000","last_clean":"2024-05-08T20:27:22.261097+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:22.261097+0000","last_undegraded":"2024-05-08T20:27:22.261097+0000","last_fullsized":"2024-05-08T20:27:22.261097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258022+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:22.258022+0000","last_peered":"2024-05-08T20:27:22.258022+0000","last_clean":"2024-05-08T20:27:22.258022+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:22.258022+0000","last_undegraded":"2024-05-08T20:27:22.258022+0000","last_fullsized":"2024-05-08T20:27:22.258022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581298+0000","last_change":"2024-05-08T20:27:26.581298+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581298+0000","last_undegraded":"2024-05-08T20:27:26.581298+0000","last_fullsized":"2024-05-08T20:27:26.581298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268348+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:22.268348+0000","last_peered":"2024-05-08T20:27:22.268348+0000","last_clean":"2024-05-08T20:27:22.268348+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:22.268348+0000","last_undegraded":"2024-05-08T20:27:22.268348+0000","last_fullsized":"2024-05-08T20:27:22.268348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261347+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:22.261347+0000","last_peered":"2024-05-08T20:27:22.261347+0000","last_clean":"2024-05-08T20:27:22.261347+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:22.261347+0000","last_undegraded":"2024-05-08T20:27:22.261347+0000","last_fullsized":"2024-05-08T20:27:22.261347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.585893+0000","last_change":"2024-05-08T20:27:26.585893+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.585893+0000","last_undegraded":"2024-05-08T20:27:26.585893+0000","last_fullsized":"2024-05-08T20:27:26.585893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268249+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:22.268249+0000","last_peered":"2024-05-08T20:27:22.268249+0000","last_clean":"2024-05-08T20:27:22.268249+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:22.268249+0000","last_undegraded":"2024-05-08T20:27:22.268249+0000","last_fullsized":"2024-05-08T20:27:22.268249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261439+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:22.261439+0000","last_peered":"2024-05-08T20:27:22.261439+0000","last_clean":"2024-05-08T20:27:22.261439+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:22.261439+0000","last_undegraded":"2024-05-08T20:27:22.261439+0000","last_fullsized":"2024-05-08T20:27:22.261439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583545+0000","last_change":"2024-05-08T20:27:26.583545+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583545+0000","last_undegraded":"2024-05-08T20:27:26.583545+0000","last_fullsized":"2024-05-08T20:27:26.583545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257567+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:22.257567+0000","last_peered":"2024-05-08T20:27:22.257567+0000","last_clean":"2024-05-08T20:27:22.257567+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:22.257567+0000","last_undegraded":"2024-05-08T20:27:22.257567+0000","last_fullsized":"2024-05-08T20:27:22.257567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268224+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:22.268224+0000","last_peered":"2024-05-08T20:27:22.268224+0000","last_clean":"2024-05-08T20:27:22.268224+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:22.268224+0000","last_undegraded":"2024-05-08T20:27:22.268224+0000","last_fullsized":"2024-05-08T20:27:22.268224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581606+0000","last_change":"2024-05-08T20:27:26.581606+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581606+0000","last_undegraded":"2024-05-08T20:27:26.581606+0000","last_fullsized":"2024-05-08T20:27:26.581606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260967+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:22.260967+0000","last_peered":"2024-05-08T20:27:22.260967+0000","last_clean":"2024-05-08T20:27:22.260967+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:22.260967+0000","last_undegraded":"2024-05-08T20:27:22.260967+0000","last_fullsized":"2024-05-08T20:27:22.260967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264391+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:22.264391+0000","last_peered":"2024-05-08T20:27:22.264391+0000","last_clean":"2024-05-08T20:27:22.264391+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:22.264391+0000","last_undegraded":"2024-05-08T20:27:22.264391+0000","last_fullsized":"2024-05-08T20:27:22.264391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581456+0000","last_change":"2024-05-08T20:27:26.581456+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581456+0000","last_undegraded":"2024-05-08T20:27:26.581456+0000","last_fullsized":"2024-05-08T20:27:26.581456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260834+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:22.260834+0000","last_peered":"2024-05-08T20:27:22.260834+0000","last_clean":"2024-05-08T20:27:22.260834+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:22.260834+0000","last_undegraded":"2024-05-08T20:27:22.260834+0000","last_fullsized":"2024-05-08T20:27:22.260834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264368+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:22.264368+0000","last_peered":"2024-05-08T20:27:22.264368+0000","last_clean":"2024-05-08T20:27:22.264368+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:22.264368+0000","last_undegraded":"2024-05-08T20:27:22.264368+0000","last_fullsized":"2024-05-08T20:27:22.264368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572396+0000","last_change":"2024-05-08T20:27:26.572396+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572396+0000","last_undegraded":"2024-05-08T20:27:26.572396+0000","last_fullsized":"2024-05-08T20:27:26.572396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260148+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:22.260148+0000","last_peered":"2024-05-08T20:27:22.260148+0000","last_clean":"2024-05-08T20:27:22.260148+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:22.260148+0000","last_undegraded":"2024-05-08T20:27:22.260148+0000","last_fullsized":"2024-05-08T20:27:22.260148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.267972+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:22.267972+0000","last_peered":"2024-05-08T20:27:22.267972+0000","last_clean":"2024-05-08T20:27:22.267972+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:22.267972+0000","last_undegraded":"2024-05-08T20:27:22.267972+0000","last_fullsized":"2024-05-08T20:27:22.267972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.582451+0000","last_change":"2024-05-08T20:27:26.582451+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.582451+0000","last_undegraded":"2024-05-08T20:27:26.582451+0000","last_fullsized":"2024-05-08T20:27:26.582451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257988+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:22.257988+0000","last_peered":"2024-05-08T20:27:22.257988+0000","last_clean":"2024-05-08T20:27:22.257988+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:22.257988+0000","last_undegraded":"2024-05-08T20:27:22.257988+0000","last_fullsized":"2024-05-08T20:27:22.257988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257810+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:22.257810+0000","last_peered":"2024-05-08T20:27:22.257810+0000","last_clean":"2024-05-08T20:27:22.257810+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:22.257810+0000","last_undegraded":"2024-05-08T20:27:22.257810+0000","last_fullsized":"2024-05-08T20:27:22.257810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.581739+0000","last_change":"2024-05-08T20:27:26.581739+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.581739+0000","last_undegraded":"2024-05-08T20:27:26.581739+0000","last_fullsized":"2024-05-08T20:27:26.581739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261191+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:22.261191+0000","last_peered":"2024-05-08T20:27:22.261191+0000","last_clean":"2024-05-08T20:27:22.261191+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:22.261191+0000","last_undegraded":"2024-05-08T20:27:22.261191+0000","last_fullsized":"2024-05-08T20:27:22.261191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.767255+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:22.767255+0000","last_peered":"2024-05-08T20:27:22.767255+0000","last_clean":"2024-05-08T20:27:22.767255+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:22.767255+0000","last_undegraded":"2024-05-08T20:27:22.767255+0000","last_fullsized":"2024-05-08T20:27:22.767255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.579085+0000","last_change":"2024-05-08T20:27:26.579085+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.579085+0000","last_undegraded":"2024-05-08T20:27:26.579085+0000","last_fullsized":"2024-05-08T20:27:26.579085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264427+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:22.264427+0000","last_peered":"2024-05-08T20:27:22.264427+0000","last_clean":"2024-05-08T20:27:22.264427+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:22.264427+0000","last_undegraded":"2024-05-08T20:27:22.264427+0000","last_fullsized":"2024-05-08T20:27:22.264427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268416+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:22.268416+0000","last_peered":"2024-05-08T20:27:22.268416+0000","last_clean":"2024-05-08T20:27:22.268416+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:22.268416+0000","last_undegraded":"2024-05-08T20:27:22.268416+0000","last_fullsized":"2024-05-08T20:27:22.268416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261485+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:22.261485+0000","last_peered":"2024-05-08T20:27:22.261485+0000","last_clean":"2024-05-08T20:27:22.261485+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:22.261485+0000","last_undegraded":"2024-05-08T20:27:22.261485+0000","last_fullsized":"2024-05-08T20:27:22.261485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264450+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:22.264450+0000","last_peered":"2024-05-08T20:27:22.264450+0000","last_clean":"2024-05-08T20:27:22.264450+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:22.264450+0000","last_undegraded":"2024-05-08T20:27:22.264450+0000","last_fullsized":"2024-05-08T20:27:22.264450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570795+0000","last_change":"2024-05-08T20:27:26.570795+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570795+0000","last_undegraded":"2024-05-08T20:27:26.570795+0000","last_fullsized":"2024-05-08T20:27:26.570795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260211+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:22.260211+0000","last_peered":"2024-05-08T20:27:22.260211+0000","last_clean":"2024-05-08T20:27:22.260211+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:22.260211+0000","last_undegraded":"2024-05-08T20:27:22.260211+0000","last_fullsized":"2024-05-08T20:27:22.260211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261213+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:22.261213+0000","last_peered":"2024-05-08T20:27:22.261213+0000","last_clean":"2024-05-08T20:27:22.261213+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:22.261213+0000","last_undegraded":"2024-05-08T20:27:22.261213+0000","last_fullsized":"2024-05-08T20:27:22.261213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570786+0000","last_change":"2024-05-08T20:27:26.570786+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570786+0000","last_undegraded":"2024-05-08T20:27:26.570786+0000","last_fullsized":"2024-05-08T20:27:26.570786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264288+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:22.264288+0000","last_peered":"2024-05-08T20:27:22.264288+0000","last_clean":"2024-05-08T20:27:22.264288+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:22.264288+0000","last_undegraded":"2024-05-08T20:27:22.264288+0000","last_fullsized":"2024-05-08T20:27:22.264288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256661+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:22.256661+0000","last_peered":"2024-05-08T20:27:22.256661+0000","last_clean":"2024-05-08T20:27:22.256661+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:22.256661+0000","last_undegraded":"2024-05-08T20:27:22.256661+0000","last_fullsized":"2024-05-08T20:27:22.256661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.570862+0000","last_change":"2024-05-08T20:27:26.570862+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.570862+0000","last_undegraded":"2024-05-08T20:27:26.570862+0000","last_fullsized":"2024-05-08T20:27:26.570862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257684+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:22.257684+0000","last_peered":"2024-05-08T20:27:22.257684+0000","last_clean":"2024-05-08T20:27:22.257684+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:22.257684+0000","last_undegraded":"2024-05-08T20:27:22.257684+0000","last_fullsized":"2024-05-08T20:27:22.257684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268037+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:22.268037+0000","last_peered":"2024-05-08T20:27:22.268037+0000","last_clean":"2024-05-08T20:27:22.268037+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:22.268037+0000","last_undegraded":"2024-05-08T20:27:22.268037+0000","last_fullsized":"2024-05-08T20:27:22.268037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608063+0000","last_change":"2024-05-08T20:27:26.608063+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608063+0000","last_undegraded":"2024-05-08T20:27:26.608063+0000","last_fullsized":"2024-05-08T20:27:26.608063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260900+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:22.260900+0000","last_peered":"2024-05-08T20:27:22.260900+0000","last_clean":"2024-05-08T20:27:22.260900+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:22.260900+0000","last_undegraded":"2024-05-08T20:27:22.260900+0000","last_fullsized":"2024-05-08T20:27:22.260900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261254+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:22.261254+0000","last_peered":"2024-05-08T20:27:22.261254+0000","last_clean":"2024-05-08T20:27:22.261254+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:22.261254+0000","last_undegraded":"2024-05-08T20:27:22.261254+0000","last_fullsized":"2024-05-08T20:27:22.261254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:20.626652+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:20.626652+0000","last_peered":"2024-05-08T20:27:20.626652+0000","last_clean":"2024-05-08T20:27:20.626652+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:20.626652+0000","last_undegraded":"2024-05-08T20:27:20.626652+0000","last_fullsized":"2024-05-08T20:27:20.626652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572168+0000","last_change":"2024-05-08T20:27:26.572168+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572168+0000","last_undegraded":"2024-05-08T20:27:26.572168+0000","last_fullsized":"2024-05-08T20:27:26.572168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268316+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:22.268316+0000","last_peered":"2024-05-08T20:27:22.268316+0000","last_clean":"2024-05-08T20:27:22.268316+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:22.268316+0000","last_undegraded":"2024-05-08T20:27:22.268316+0000","last_fullsized":"2024-05-08T20:27:22.268316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256689+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:22.256689+0000","last_peered":"2024-05-08T20:27:22.256689+0000","last_clean":"2024-05-08T20:27:22.256689+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:22.256689+0000","last_undegraded":"2024-05-08T20:27:22.256689+0000","last_fullsized":"2024-05-08T20:27:22.256689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572082+0000","last_change":"2024-05-08T20:27:26.572082+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572082+0000","last_undegraded":"2024-05-08T20:27:26.572082+0000","last_fullsized":"2024-05-08T20:27:26.572082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261393+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:22.261393+0000","last_peered":"2024-05-08T20:27:22.261393+0000","last_clean":"2024-05-08T20:27:22.261393+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:22.261393+0000","last_undegraded":"2024-05-08T20:27:22.261393+0000","last_fullsized":"2024-05-08T20:27:22.261393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264551+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:22.264551+0000","last_peered":"2024-05-08T20:27:22.264551+0000","last_clean":"2024-05-08T20:27:22.264551+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:22.264551+0000","last_undegraded":"2024-05-08T20:27:22.264551+0000","last_fullsized":"2024-05-08T20:27:22.264551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608054+0000","last_change":"2024-05-08T20:27:26.608054+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608054+0000","last_undegraded":"2024-05-08T20:27:26.608054+0000","last_fullsized":"2024-05-08T20:27:26.608054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268523+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:22.268523+0000","last_peered":"2024-05-08T20:27:22.268523+0000","last_clean":"2024-05-08T20:27:22.268523+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:22.268523+0000","last_undegraded":"2024-05-08T20:27:22.268523+0000","last_fullsized":"2024-05-08T20:27:22.268523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256738+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:22.256738+0000","last_peered":"2024-05-08T20:27:22.256738+0000","last_clean":"2024-05-08T20:27:22.256738+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:22.256738+0000","last_undegraded":"2024-05-08T20:27:22.256738+0000","last_fullsized":"2024-05-08T20:27:22.256738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572103+0000","last_change":"2024-05-08T20:27:26.572103+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572103+0000","last_undegraded":"2024-05-08T20:27:26.572103+0000","last_fullsized":"2024-05-08T20:27:26.572103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268452+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:22.268452+0000","last_peered":"2024-05-08T20:27:22.268452+0000","last_clean":"2024-05-08T20:27:22.268452+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:22.268452+0000","last_undegraded":"2024-05-08T20:27:22.268452+0000","last_fullsized":"2024-05-08T20:27:22.268452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260287+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:22.260287+0000","last_peered":"2024-05-08T20:27:22.260287+0000","last_clean":"2024-05-08T20:27:22.260287+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:22.260287+0000","last_undegraded":"2024-05-08T20:27:22.260287+0000","last_fullsized":"2024-05-08T20:27:22.260287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.584404+0000","last_change":"2024-05-08T20:27:26.584404+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.584404+0000","last_undegraded":"2024-05-08T20:27:26.584404+0000","last_fullsized":"2024-05-08T20:27:26.584404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268124+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:22.268124+0000","last_peered":"2024-05-08T20:27:22.268124+0000","last_clean":"2024-05-08T20:27:22.268124+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:22.268124+0000","last_undegraded":"2024-05-08T20:27:22.268124+0000","last_fullsized":"2024-05-08T20:27:22.268124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256541+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:22.256541+0000","last_peered":"2024-05-08T20:27:22.256541+0000","last_clean":"2024-05-08T20:27:22.256541+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:22.256541+0000","last_undegraded":"2024-05-08T20:27:22.256541+0000","last_fullsized":"2024-05-08T20:27:22.256541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.607312+0000","last_change":"2024-05-08T20:27:26.607312+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.607312+0000","last_undegraded":"2024-05-08T20:27:26.607312+0000","last_fullsized":"2024-05-08T20:27:26.607312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257505+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:22.257505+0000","last_peered":"2024-05-08T20:27:22.257505+0000","last_clean":"2024-05-08T20:27:22.257505+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:22.257505+0000","last_undegraded":"2024-05-08T20:27:22.257505+0000","last_fullsized":"2024-05-08T20:27:22.257505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257541+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:22.257541+0000","last_peered":"2024-05-08T20:27:22.257541+0000","last_clean":"2024-05-08T20:27:22.257541+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:22.257541+0000","last_undegraded":"2024-05-08T20:27:22.257541+0000","last_fullsized":"2024-05-08T20:27:22.257541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576679+0000","last_change":"2024-05-08T20:27:26.576679+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576679+0000","last_undegraded":"2024-05-08T20:27:26.576679+0000","last_fullsized":"2024-05-08T20:27:26.576679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268197+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:22.268197+0000","last_peered":"2024-05-08T20:27:22.268197+0000","last_clean":"2024-05-08T20:27:22.268197+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:22.268197+0000","last_undegraded":"2024-05-08T20:27:22.268197+0000","last_fullsized":"2024-05-08T20:27:22.268197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261154+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:22.261154+0000","last_peered":"2024-05-08T20:27:22.261154+0000","last_clean":"2024-05-08T20:27:22.261154+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:22.261154+0000","last_undegraded":"2024-05-08T20:27:22.261154+0000","last_fullsized":"2024-05-08T20:27:22.261154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575918+0000","last_change":"2024-05-08T20:27:26.575918+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575918+0000","last_undegraded":"2024-05-08T20:27:26.575918+0000","last_fullsized":"2024-05-08T20:27:26.575918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257776+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:22.257776+0000","last_peered":"2024-05-08T20:27:22.257776+0000","last_clean":"2024-05-08T20:27:22.257776+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:22.257776+0000","last_undegraded":"2024-05-08T20:27:22.257776+0000","last_fullsized":"2024-05-08T20:27:22.257776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257929+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:22.257929+0000","last_peered":"2024-05-08T20:27:22.257929+0000","last_clean":"2024-05-08T20:27:22.257929+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:22.257929+0000","last_undegraded":"2024-05-08T20:27:22.257929+0000","last_fullsized":"2024-05-08T20:27:22.257929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.573162+0000","last_change":"2024-05-08T20:27:26.573162+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.573162+0000","last_undegraded":"2024-05-08T20:27:26.573162+0000","last_fullsized":"2024-05-08T20:27:26.573162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268276+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:22.268276+0000","last_peered":"2024-05-08T20:27:22.268276+0000","last_clean":"2024-05-08T20:27:22.268276+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:22.268276+0000","last_undegraded":"2024-05-08T20:27:22.268276+0000","last_fullsized":"2024-05-08T20:27:22.268276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257680+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:22.257680+0000","last_peered":"2024-05-08T20:27:22.257680+0000","last_clean":"2024-05-08T20:27:22.257680+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:22.257680+0000","last_undegraded":"2024-05-08T20:27:22.257680+0000","last_fullsized":"2024-05-08T20:27:22.257680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572155+0000","last_change":"2024-05-08T20:27:26.572155+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572155+0000","last_undegraded":"2024-05-08T20:27:26.572155+0000","last_fullsized":"2024-05-08T20:27:26.572155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260259+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:22.260259+0000","last_peered":"2024-05-08T20:27:22.260259+0000","last_clean":"2024-05-08T20:27:22.260259+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:22.260259+0000","last_undegraded":"2024-05-08T20:27:22.260259+0000","last_fullsized":"2024-05-08T20:27:22.260259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264497+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:22.264497+0000","last_peered":"2024-05-08T20:27:22.264497+0000","last_clean":"2024-05-08T20:27:22.264497+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:22.264497+0000","last_undegraded":"2024-05-08T20:27:22.264497+0000","last_fullsized":"2024-05-08T20:27:22.264497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.583009+0000","last_change":"2024-05-08T20:27:26.583009+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.583009+0000","last_undegraded":"2024-05-08T20:27:26.583009+0000","last_fullsized":"2024-05-08T20:27:26.583009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.258095+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:22.258095+0000","last_peered":"2024-05-08T20:27:22.258095+0000","last_clean":"2024-05-08T20:27:22.258095+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:22.258095+0000","last_undegraded":"2024-05-08T20:27:22.258095+0000","last_fullsized":"2024-05-08T20:27:22.258095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261587+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:22.261587+0000","last_peered":"2024-05-08T20:27:22.261587+0000","last_clean":"2024-05-08T20:27:22.261587+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:22.261587+0000","last_undegraded":"2024-05-08T20:27:22.261587+0000","last_fullsized":"2024-05-08T20:27:22.261587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575782+0000","last_change":"2024-05-08T20:27:26.575782+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575782+0000","last_undegraded":"2024-05-08T20:27:26.575782+0000","last_fullsized":"2024-05-08T20:27:26.575782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261527+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:22.261527+0000","last_peered":"2024-05-08T20:27:22.261527+0000","last_clean":"2024-05-08T20:27:22.261527+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:22.261527+0000","last_undegraded":"2024-05-08T20:27:22.261527+0000","last_fullsized":"2024-05-08T20:27:22.261527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257787+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:22.257787+0000","last_peered":"2024-05-08T20:27:22.257787+0000","last_clean":"2024-05-08T20:27:22.257787+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:22.257787+0000","last_undegraded":"2024-05-08T20:27:22.257787+0000","last_fullsized":"2024-05-08T20:27:22.257787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576460+0000","last_change":"2024-05-08T20:27:26.576460+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576460+0000","last_undegraded":"2024-05-08T20:27:26.576460+0000","last_fullsized":"2024-05-08T20:27:26.576460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.608514+0000","last_change":"2024-05-08T20:27:26.608514+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.608514+0000","last_undegraded":"2024-05-08T20:27:26.608514+0000","last_fullsized":"2024-05-08T20:27:26.608514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264323+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:22.264323+0000","last_peered":"2024-05-08T20:27:22.264323+0000","last_clean":"2024-05-08T20:27:22.264323+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:22.264323+0000","last_undegraded":"2024-05-08T20:27:22.264323+0000","last_fullsized":"2024-05-08T20:27:22.264323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260973+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:22.260973+0000","last_peered":"2024-05-08T20:27:22.260973+0000","last_clean":"2024-05-08T20:27:22.260973+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:22.260973+0000","last_undegraded":"2024-05-08T20:27:22.260973+0000","last_fullsized":"2024-05-08T20:27:22.260973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.572090+0000","last_change":"2024-05-08T20:27:26.572090+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.572090+0000","last_undegraded":"2024-05-08T20:27:26.572090+0000","last_fullsized":"2024-05-08T20:27:26.572090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260809+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:22.260809+0000","last_peered":"2024-05-08T20:27:22.260809+0000","last_clean":"2024-05-08T20:27:22.260809+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:22.260809+0000","last_undegraded":"2024-05-08T20:27:22.260809+0000","last_fullsized":"2024-05-08T20:27:22.260809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260878+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:22.260878+0000","last_peered":"2024-05-08T20:27:22.260878+0000","last_clean":"2024-05-08T20:27:22.260878+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:22.260878+0000","last_undegraded":"2024-05-08T20:27:22.260878+0000","last_fullsized":"2024-05-08T20:27:22.260878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257632+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:22.257632+0000","last_peered":"2024-05-08T20:27:22.257632+0000","last_clean":"2024-05-08T20:27:22.257632+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:22.257632+0000","last_undegraded":"2024-05-08T20:27:22.257632+0000","last_fullsized":"2024-05-08T20:27:22.257632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257875+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:22.257875+0000","last_peered":"2024-05-08T20:27:22.257875+0000","last_clean":"2024-05-08T20:27:22.257875+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:22.257875+0000","last_undegraded":"2024-05-08T20:27:22.257875+0000","last_fullsized":"2024-05-08T20:27:22.257875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.575595+0000","last_change":"2024-05-08T20:27:26.575595+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.575595+0000","last_undegraded":"2024-05-08T20:27:26.575595+0000","last_fullsized":"2024-05-08T20:27:26.575595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260998+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:22.260998+0000","last_peered":"2024-05-08T20:27:22.260998+0000","last_clean":"2024-05-08T20:27:22.260998+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:22.260998+0000","last_undegraded":"2024-05-08T20:27:22.260998+0000","last_fullsized":"2024-05-08T20:27:22.260998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260184+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:22.260184+0000","last_peered":"2024-05-08T20:27:22.260184+0000","last_clean":"2024-05-08T20:27:22.260184+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:22.260184+0000","last_undegraded":"2024-05-08T20:27:22.260184+0000","last_fullsized":"2024-05-08T20:27:22.260184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-08T20:27:26.576494+0000","last_change":"2024-05-08T20:27:26.576494+0000","last_active":"2024-05-08T20:27:26.551584+0000","last_peered":"2024-05-08T20:27:26.551584+0000","last_clean":"2024-05-08T20:27:26.551584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:26.576494+0000","last_undegraded":"2024-05-08T20:27:26.576494+0000","last_fullsized":"2024-05-08T20:27:26.576494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257470+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:22.257470+0000","last_peered":"2024-05-08T20:27:22.257470+0000","last_clean":"2024-05-08T20:27:22.257470+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:22.257470+0000","last_undegraded":"2024-05-08T20:27:22.257470+0000","last_fullsized":"2024-05-08T20:27:22.257470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256608+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:22.256608+0000","last_peered":"2024-05-08T20:27:22.256608+0000","last_clean":"2024-05-08T20:27:22.256608+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:22.256608+0000","last_undegraded":"2024-05-08T20:27:22.256608+0000","last_fullsized":"2024-05-08T20:27:22.256608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261103+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:22.261103+0000","last_peered":"2024-05-08T20:27:22.261103+0000","last_clean":"2024-05-08T20:27:22.261103+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:22.261103+0000","last_undegraded":"2024-05-08T20:27:22.261103+0000","last_fullsized":"2024-05-08T20:27:22.261103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257834+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:22.257834+0000","last_peered":"2024-05-08T20:27:22.257834+0000","last_clean":"2024-05-08T20:27:22.257834+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:22.257834+0000","last_undegraded":"2024-05-08T20:27:22.257834+0000","last_fullsized":"2024-05-08T20:27:22.257834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261023+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:22.261023+0000","last_peered":"2024-05-08T20:27:22.261023+0000","last_clean":"2024-05-08T20:27:22.261023+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:22.261023+0000","last_undegraded":"2024-05-08T20:27:22.261023+0000","last_fullsized":"2024-05-08T20:27:22.261023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264471+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:22.264471+0000","last_peered":"2024-05-08T20:27:22.264471+0000","last_clean":"2024-05-08T20:27:22.264471+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:22.264471+0000","last_undegraded":"2024-05-08T20:27:22.264471+0000","last_fullsized":"2024-05-08T20:27:22.264471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257751+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:22.257751+0000","last_peered":"2024-05-08T20:27:22.257751+0000","last_clean":"2024-05-08T20:27:22.257751+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:22.257751+0000","last_undegraded":"2024-05-08T20:27:22.257751+0000","last_fullsized":"2024-05-08T20:27:22.257751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261148+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:22.261148+0000","last_peered":"2024-05-08T20:27:22.261148+0000","last_clean":"2024-05-08T20:27:22.261148+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:22.261148+0000","last_undegraded":"2024-05-08T20:27:22.261148+0000","last_fullsized":"2024-05-08T20:27:22.261148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260921+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:22.260921+0000","last_peered":"2024-05-08T20:27:22.260921+0000","last_clean":"2024-05-08T20:27:22.260921+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:22.260921+0000","last_undegraded":"2024-05-08T20:27:22.260921+0000","last_fullsized":"2024-05-08T20:27:22.260921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260856+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:22.260856+0000","last_peered":"2024-05-08T20:27:22.260856+0000","last_clean":"2024-05-08T20:27:22.260856+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:22.260856+0000","last_undegraded":"2024-05-08T20:27:22.260856+0000","last_fullsized":"2024-05-08T20:27:22.260856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261062+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:22.261062+0000","last_peered":"2024-05-08T20:27:22.261062+0000","last_clean":"2024-05-08T20:27:22.261062+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:22.261062+0000","last_undegraded":"2024-05-08T20:27:22.261062+0000","last_fullsized":"2024-05-08T20:27:22.261062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257798+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:22.257798+0000","last_peered":"2024-05-08T20:27:22.257798+0000","last_clean":"2024-05-08T20:27:22.257798+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:22.257798+0000","last_undegraded":"2024-05-08T20:27:22.257798+0000","last_fullsized":"2024-05-08T20:27:22.257798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257657+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:22.257657+0000","last_peered":"2024-05-08T20:27:22.257657+0000","last_clean":"2024-05-08T20:27:22.257657+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:22.257657+0000","last_undegraded":"2024-05-08T20:27:22.257657+0000","last_fullsized":"2024-05-08T20:27:22.257657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268391+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:22.268391+0000","last_peered":"2024-05-08T20:27:22.268391+0000","last_clean":"2024-05-08T20:27:22.268391+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:22.268391+0000","last_undegraded":"2024-05-08T20:27:22.268391+0000","last_fullsized":"2024-05-08T20:27:22.268391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.256712+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:22.256712+0000","last_peered":"2024-05-08T20:27:22.256712+0000","last_clean":"2024-05-08T20:27:22.256712+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:22.256712+0000","last_undegraded":"2024-05-08T20:27:22.256712+0000","last_fullsized":"2024-05-08T20:27:22.256712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261634+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:22.261634+0000","last_peered":"2024-05-08T20:27:22.261634+0000","last_clean":"2024-05-08T20:27:22.261634+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:22.261634+0000","last_undegraded":"2024-05-08T20:27:22.261634+0000","last_fullsized":"2024-05-08T20:27:22.261634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260863+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:22.260863+0000","last_peered":"2024-05-08T20:27:22.260863+0000","last_clean":"2024-05-08T20:27:22.260863+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:22.260863+0000","last_undegraded":"2024-05-08T20:27:22.260863+0000","last_fullsized":"2024-05-08T20:27:22.260863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264346+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:22.264346+0000","last_peered":"2024-05-08T20:27:22.264346+0000","last_clean":"2024-05-08T20:27:22.264346+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:22.264346+0000","last_undegraded":"2024-05-08T20:27:22.264346+0000","last_fullsized":"2024-05-08T20:27:22.264346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257738+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:22.257738+0000","last_peered":"2024-05-08T20:27:22.257738+0000","last_clean":"2024-05-08T20:27:22.257738+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:22.257738+0000","last_undegraded":"2024-05-08T20:27:22.257738+0000","last_fullsized":"2024-05-08T20:27:22.257738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260922+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:22.260922+0000","last_peered":"2024-05-08T20:27:22.260922+0000","last_clean":"2024-05-08T20:27:22.260922+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:22.260922+0000","last_undegraded":"2024-05-08T20:27:22.260922+0000","last_fullsized":"2024-05-08T20:27:22.260922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260236+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:22.260236+0000","last_peered":"2024-05-08T20:27:22.260236+0000","last_clean":"2024-05-08T20:27:22.260236+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:22.260236+0000","last_undegraded":"2024-05-08T20:27:22.260236+0000","last_fullsized":"2024-05-08T20:27:22.260236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257707+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:22.257707+0000","last_peered":"2024-05-08T20:27:22.257707+0000","last_clean":"2024-05-08T20:27:22.257707+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:22.257707+0000","last_undegraded":"2024-05-08T20:27:22.257707+0000","last_fullsized":"2024-05-08T20:27:22.257707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257729+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:22.257729+0000","last_peered":"2024-05-08T20:27:22.257729+0000","last_clean":"2024-05-08T20:27:22.257729+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:22.257729+0000","last_undegraded":"2024-05-08T20:27:22.257729+0000","last_fullsized":"2024-05-08T20:27:22.257729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268498+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:22.268498+0000","last_peered":"2024-05-08T20:27:22.268498+0000","last_clean":"2024-05-08T20:27:22.268498+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:22.268498+0000","last_undegraded":"2024-05-08T20:27:22.268498+0000","last_fullsized":"2024-05-08T20:27:22.268498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.260773+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:22.260773+0000","last_peered":"2024-05-08T20:27:22.260773+0000","last_clean":"2024-05-08T20:27:22.260773+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:22.260773+0000","last_undegraded":"2024-05-08T20:27:22.260773+0000","last_fullsized":"2024-05-08T20:27:22.260773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268082+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:22.268082+0000","last_peered":"2024-05-08T20:27:22.268082+0000","last_clean":"2024-05-08T20:27:22.268082+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:22.268082+0000","last_undegraded":"2024-05-08T20:27:22.268082+0000","last_fullsized":"2024-05-08T20:27:22.268082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261016+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:22.261016+0000","last_peered":"2024-05-08T20:27:22.261016+0000","last_clean":"2024-05-08T20:27:22.261016+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:22.261016+0000","last_undegraded":"2024-05-08T20:27:22.261016+0000","last_fullsized":"2024-05-08T20:27:22.261016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268152+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:22.268152+0000","last_peered":"2024-05-08T20:27:22.268152+0000","last_clean":"2024-05-08T20:27:22.268152+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:22.268152+0000","last_undegraded":"2024-05-08T20:27:22.268152+0000","last_fullsized":"2024-05-08T20:27:22.268152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.261300+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:22.261300+0000","last_peered":"2024-05-08T20:27:22.261300+0000","last_clean":"2024-05-08T20:27:22.261300+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:22.261300+0000","last_undegraded":"2024-05-08T20:27:22.261300+0000","last_fullsized":"2024-05-08T20:27:22.261300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.257965+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:22.257965+0000","last_peered":"2024-05-08T20:27:22.257965+0000","last_clean":"2024-05-08T20:27:22.257965+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:22.257965+0000","last_undegraded":"2024-05-08T20:27:22.257965+0000","last_fullsized":"2024-05-08T20:27:22.257965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.264591+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:22.264591+0000","last_peered":"2024-05-08T20:27:22.264591+0000","last_clean":"2024-05-08T20:27:22.264591+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:22.264591+0000","last_undegraded":"2024-05-08T20:27:22.264591+0000","last_fullsized":"2024-05-08T20:27:22.264591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T20:27:27.565015+0000","last_change":"2024-05-08T20:27:27.565015+0000","last_active":"2024-05-08T20:27:27.565015+0000","last_peered":"2024-05-08T20:27:27.565015+0000","last_clean":"2024-05-08T20:27:27.565015+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T20:27:27.565015+0000","last_undegraded":"2024-05-08T20:27:27.565015+0000","last_fullsized":"2024-05-08T20:27:27.565015+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:27:22.268475+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:22.268475+0000","last_peered":"2024-05-08T20:27:22.268475+0000","last_clean":"2024-05-08T20:27:22.268475+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:22.268475+0000","last_undegraded":"2024-05-08T20:27:22.268475+0000","last_fullsized":"2024-05-08T20:27:22.268475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":668407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":79021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":77617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":660805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-05-08T20:27:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-05-08T20:27:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.575756+0000', 'last_change': '2024-05-08T20:27:26.575756+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.575756+0000', 'last_undegraded': '2024-05-08T20:27:26.575756+0000', 'last_fullsized': '2024-05-08T20:27:26.575756+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.581298+0000', 'last_change': '2024-05-08T20:27:26.581298+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.581298+0000', 'last_undegraded': '2024-05-08T20:27:26.581298+0000', 'last_fullsized': '2024-05-08T20:27:26.581298+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.585893+0000', 'last_change': '2024-05-08T20:27:26.585893+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.585893+0000', 'last_undegraded': '2024-05-08T20:27:26.585893+0000', 'last_fullsized': '2024-05-08T20:27:26.585893+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-05-08T20:27:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.583545+0000', 'last_change': '2024-05-08T20:27:26.583545+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.583545+0000', 'last_undegraded': '2024-05-08T20:27:26.583545+0000', 'last_fullsized': '2024-05-08T20:27:26.583545+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.581606+0000', 'last_change': '2024-05-08T20:27:26.581606+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.581606+0000', 'last_undegraded': '2024-05-08T20:27:26.581606+0000', 'last_fullsized': '2024-05-08T20:27:26.581606+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.581456+0000', 'last_change': '2024-05-08T20:27:26.581456+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.581456+0000', 'last_undegraded': '2024-05-08T20:27:26.581456+0000', 'last_fullsized': '2024-05-08T20:27:26.581456+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-05-08T20:27:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572396+0000', 'last_change': '2024-05-08T20:27:26.572396+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572396+0000', 'last_undegraded': '2024-05-08T20:27:26.572396+0000', 'last_fullsized': '2024-05-08T20:27:26.572396+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.582451+0000', 'last_change': '2024-05-08T20:27:26.582451+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.582451+0000', 'last_undegraded': '2024-05-08T20:27:26.582451+0000', 'last_fullsized': '2024-05-08T20:27:26.582451+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.581739+0000', 'last_change': '2024-05-08T20:27:26.581739+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.581739+0000', 'last_undegraded': '2024-05-08T20:27:26.581739+0000', 'last_fullsized': '2024-05-08T20:27:26.581739+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-05-08T20:27:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.579085+0000', 'last_change': '2024-05-08T20:27:26.579085+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.579085+0000', 'last_undegraded': '2024-05-08T20:27:26.579085+0000', 'last_fullsized': '2024-05-08T20:27:26.579085+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.607312+0000', 'last_change': '2024-05-08T20:27:26.607312+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.607312+0000', 'last_undegraded': '2024-05-08T20:27:26.607312+0000', 'last_fullsized': '2024-05-08T20:27:26.607312+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.570795+0000', 'last_change': '2024-05-08T20:27:26.570795+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.570795+0000', 'last_undegraded': '2024-05-08T20:27:26.570795+0000', 'last_fullsized': '2024-05-08T20:27:26.570795+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-05-08T20:27:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.570786+0000', 'last_change': '2024-05-08T20:27:26.570786+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.570786+0000', 'last_undegraded': '2024-05-08T20:27:26.570786+0000', 'last_fullsized': '2024-05-08T20:27:26.570786+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.570862+0000', 'last_change': '2024-05-08T20:27:26.570862+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.570862+0000', 'last_undegraded': '2024-05-08T20:27:26.570862+0000', 'last_fullsized': '2024-05-08T20:27:26.570862+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.608063+0000', 'last_change': '2024-05-08T20:27:26.608063+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.608063+0000', 'last_undegraded': '2024-05-08T20:27:26.608063+0000', 'last_fullsized': '2024-05-08T20:27:26.608063+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572168+0000', 'last_change': '2024-05-08T20:27:26.572168+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572168+0000', 'last_undegraded': '2024-05-08T20:27:26.572168+0000', 'last_fullsized': '2024-05-08T20:27:26.572168+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T20:27:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572082+0000', 'last_change': '2024-05-08T20:27:26.572082+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572082+0000', 'last_undegraded': '2024-05-08T20:27:26.572082+0000', 'last_fullsized': '2024-05-08T20:27:26.572082+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.608054+0000', 'last_change': '2024-05-08T20:27:26.608054+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.608054+0000', 'last_undegraded': '2024-05-08T20:27:26.608054+0000', 'last_fullsized': '2024-05-08T20:27:26.608054+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-05-08T20:27:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572103+0000', 'last_change': '2024-05-08T20:27:26.572103+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572103+0000', 'last_undegraded': '2024-05-08T20:27:26.572103+0000', 'last_fullsized': '2024-05-08T20:27:26.572103+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.584404+0000', 'last_change': '2024-05-08T20:27:26.584404+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.584404+0000', 'last_undegraded': '2024-05-08T20:27:26.584404+0000', 'last_fullsized': '2024-05-08T20:27:26.584404+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.607312+0000', 'last_change': '2024-05-08T20:27:26.607312+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.607312+0000', 'last_undegraded': '2024-05-08T20:27:26.607312+0000', 'last_fullsized': '2024-05-08T20:27:26.607312+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-05-08T20:27:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.576679+0000', 'last_change': '2024-05-08T20:27:26.576679+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.576679+0000', 'last_undegraded': '2024-05-08T20:27:26.576679+0000', 'last_fullsized': '2024-05-08T20:27:26.576679+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-05-08T20:27:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.575918+0000', 'last_change': '2024-05-08T20:27:26.575918+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.575918+0000', 'last_undegraded': '2024-05-08T20:27:26.575918+0000', 'last_fullsized': '2024-05-08T20:27:26.575918+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.573162+0000', 'last_change': '2024-05-08T20:27:26.573162+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.573162+0000', 'last_undegraded': '2024-05-08T20:27:26.573162+0000', 'last_fullsized': '2024-05-08T20:27:26.573162+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572155+0000', 'last_change': '2024-05-08T20:27:26.572155+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572155+0000', 'last_undegraded': '2024-05-08T20:27:26.572155+0000', 'last_fullsized': '2024-05-08T20:27:26.572155+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.583009+0000', 'last_change': '2024-05-08T20:27:26.583009+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.583009+0000', 'last_undegraded': '2024-05-08T20:27:26.583009+0000', 'last_fullsized': '2024-05-08T20:27:26.583009+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-05-08T20:27:32.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.575782+0000', 'last_change': '2024-05-08T20:27:26.575782+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.575782+0000', 'last_undegraded': '2024-05-08T20:27:26.575782+0000', 'last_fullsized': '2024-05-08T20:27:26.575782+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.576460+0000', 'last_change': '2024-05-08T20:27:26.576460+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.576460+0000', 'last_undegraded': '2024-05-08T20:27:26.576460+0000', 'last_fullsized': '2024-05-08T20:27:26.576460+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.608514+0000', 'last_change': '2024-05-08T20:27:26.608514+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.608514+0000', 'last_undegraded': '2024-05-08T20:27:26.608514+0000', 'last_fullsized': '2024-05-08T20:27:26.608514+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T20:27:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.572090+0000', 'last_change': '2024-05-08T20:27:26.572090+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.572090+0000', 'last_undegraded': '2024-05-08T20:27:26.572090+0000', 'last_fullsized': '2024-05-08T20:27:26.572090+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.575595+0000', 'last_change': '2024-05-08T20:27:26.575595+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.575595+0000', 'last_undegraded': '2024-05-08T20:27:26.575595+0000', 'last_fullsized': '2024-05-08T20:27:26.575595+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-05-08T20:27:32.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-08T20:27:26.576494+0000', 'last_change': '2024-05-08T20:27:26.576494+0000', 'last_active': '2024-05-08T20:27:26.551584+0000', 'last_peered': '2024-05-08T20:27:26.551584+0000', 'last_clean': '2024-05-08T20:27:26.551584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:26.576494+0000', 'last_undegraded': '2024-05-08T20:27:26.576494+0000', 'last_fullsized': '2024-05-08T20:27:26.576494+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:26.551584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-05-08T20:27:32.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-05-08T20:27:32.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-05-08T20:27:32.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-05-08T20:27:32.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T20:27:27.565015+0000', 'last_change': '2024-05-08T20:27:27.565015+0000', 'last_active': '2024-05-08T20:27:27.565015+0000', 'last_peered': '2024-05-08T20:27:27.565015+0000', 'last_clean': '2024-05-08T20:27:27.565015+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T20:27:27.565015+0000', 'last_undegraded': '2024-05-08T20:27:27.565015+0000', 'last_fullsized': '2024-05-08T20:27:27.565015+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'last_clean_scrub_stamp': '2024-05-08T20:27:27.565015+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T20:27:32.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T20:27:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 Processor -- start 2024-05-08T20:27:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 -- start start 2024-05-08T20:27:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b141501e0 0x7f3b1406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b1406f400 0x7f3b140c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140c0650 con 0x7f3b140725f0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1406fd60 con 0x7f3b141501e0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b192d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14072180 con 0x7f3b1406f400 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b127fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b140725f0 0x7f3b140c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53592/0 (socket says 172.21.15.81:53592) 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b127fc640 1 -- 172.21.15.81:0/3224272573 learned_addr learned my addr 172.21.15.81:0/3224272573 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b137fe640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b1406f400 0x7f3b140c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927545305 0 0) 0x7f3b140c0650 con 0x7f3b140725f0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b12ffd640 1 --2- 172.21.15.81:0/3224272573 >> v2:172.21.15.117:3300/0 conn(0x7f3b141501e0 0x7f3b1406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.826+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003530 con 0x7f3b140725f0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416861993 0 0) 0x7f3b00003530 con 0x7f3b140725f0 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b1406f400 msgr2=0x7f3b140c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b1406f400 0x7f3b140c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 >> v2:172.21.15.117:3300/0 conn(0x7f3b141501e0 msgr2=0x7f3b1406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 --2- 172.21.15.81:0/3224272573 >> v2:172.21.15.117:3300/0 conn(0x7f3b141501e0 0x7f3b1406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1406fa80 con 0x7f3b140725f0 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3afc001a00 con 0x7f3b140725f0 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 >> v1:172.21.15.81:6789/0 conn(0x7f3b140725f0 legacy=0x7f3b140c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b00003980 0x7f3b00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000047d0 0x7f3b00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b00005190 0x7f3b0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1406fd60 con 0x7f3b000047d0 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14072180 con 0x7f3b00005190 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0000c110 con 0x7f3b00003980 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b137fe640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b1406f400 0x7f3b140c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b12ffd640 1 --2- 172.21.15.81:0/3224272573 >> v2:172.21.15.117:3300/0 conn(0x7f3b141501e0 0x7f3b1406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000047d0 0x7f3b00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 -- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b00003980 msgr2=0x7f3b00003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b00003980 0x7f3b00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 -- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b00005190 msgr2=0x7f3b0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b00005190 0x7f3b0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 -- 172.21.15.81:0/3224272573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00003530 con 0x7f3b000047d0 2024-05-08T20:27:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b127fc640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000047d0 0x7f3b00004c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00a860 tx=0x7f3afc01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44085a25f08ccd5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0ad630 con 0x7f3b000047d0 2024-05-08T20:27:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0a8070 con 0x7f3b000047d0 2024-05-08T20:27:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b11ffb640 1 -- 172.21.15.81:0/3224272573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0ada30 con 0x7f3b000047d0 2024-05-08T20:27:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 -- 172.21.15.81:0/3224272573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000047d0 msgr2=0x7f3b00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 --2- 172.21.15.81:0/3224272573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000047d0 0x7f3b00004c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00a860 tx=0x7f3afc01d350 comp rx=0 tx=0).stop 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b137fe640 1 -- 172.21.15.81:0/3224272573 reap_dead start 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 -- 172.21.15.81:0/3224272573 shutdown_connections 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 -- 172.21.15.81:0/3224272573 >> 172.21.15.81:0/3224272573 conn(0x7f3b140c2ca0 msgr2=0x7f3b140c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 -- 172.21.15.81:0/3224272573 shutdown_connections 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.830+0000 7f3b192d9640 1 -- 172.21.15.81:0/3224272573 wait complete. 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 Processor -- start 2024-05-08T20:27:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- start start 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b000047d0 0x7f3b14140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 0x7f3b14143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14149290 con 0x7f3b14140340 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141ef460 con 0x7f3b1413de80 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141eb570 con 0x7f3b000047d0 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38874/0 (socket says 172.21.15.81:38874) 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 -- 172.21.15.81:0/1739935425 learned_addr learned my addr 172.21.15.81:0/1739935425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b137fe640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 0x7f3b14143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b12ffd640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b000047d0 0x7f3b14140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 -- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b000047d0 msgr2=0x7f3b14140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b000047d0 0x7f3b14140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 -- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 msgr2=0x7f3b14143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 0x7f3b14143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 -- 172.21.15.81:0/1739935425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14140ed0 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b137fe640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 0x7f3b14143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b127fc640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3afc01d180 tx=0x7f3b00005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0019c0 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0ad430 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141ef180 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0ad7a0 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b141ebf40 con 0x7f3b14140340 2024-05-08T20:27:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b141eb060 con 0x7f3b14140340 2024-05-08T20:27:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3afc0aa030 con 0x7f3b14140340 2024-05-08T20:27:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 0x7f3af4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.834+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3afc0a5e40 con 0x7f3b14140340 2024-05-08T20:27:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.838+0000 7f3b12ffd640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 0x7f3af4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.838+0000 7f3b12ffd640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 0x7f3af4068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006aa0 tx=0x7f3b0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:32.838+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3b141eb060 con 0x7f3b14140340 2024-05-08T20:27:33.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.038+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3b141eb060 con 0x7f3b14140340 2024-05-08T20:27:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.038+0000 7f3b0b7fe640 1 -- 172.21.15.81:0/1739935425 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1272 (secure 0 0 0) 0x7f3b141eb060 con 0x7f3b14140340 2024-05-08T20:27:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:33.046 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":38,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1715200026,"num_in_osds":8,"osd_in_since":1715200016,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":592730,"bytes_used":224296960,"bytes_avail":772869816320,"bytes_total":773094113280,"unknown_pgs_ratio":0.33160620927810669,"inactive_pgs_ratio":0.16580310463905334,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":12,"id":1,"up":1,"in":1,"max":1,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4266},{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4269}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T20:26:54.692268+0000","services":{}},"progress_events":{}} 2024-05-08T20:27:33.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 msgr2=0x7f3af4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 0x7f3af4068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006aa0 tx=0x7f3b0c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:33.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 msgr2=0x7f3b141eba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3afc01d180 tx=0x7f3b00005800 comp rx=0 tx=0).stop 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 shutdown_connections 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3af4066690 0x7f3af4068b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1413de80 0x7f3b14143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b14140340 0x7f3b141eba00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 --2- 172.21.15.81:0/1739935425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b000047d0 0x7f3b14140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 >> 172.21.15.81:0/1739935425 conn(0x7f3b140c2ca0 msgr2=0x7f3b14144db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 shutdown_connections 2024-05-08T20:27:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.042+0000 7f3b192d9640 1 -- 172.21.15.81:0/1739935425 wait complete. 2024-05-08T20:27:33.064 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T20:27:33.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.174+0000 7f9341d06640 1 Processor -- start 2024-05-08T20:27:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.174+0000 7f9341d06640 1 -- start start 2024-05-08T20:27:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.174+0000 7f9341d06640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f933c151f00 0x7f933c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.174+0000 7f9341d06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 0x7f933c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c158e20 con 0x7f933c155690 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c06bb20 con 0x7f933c151f00 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c1548e0 con 0x7f933c154cf0 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f933c151f00 0x7f933c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f933c155690 0x7f933c0ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53598/0 (socket says 172.21.15.81:53598) 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933bfff640 1 -- 172.21.15.81:0/2424450815 learned_addr learned my addr 172.21.15.81:0/2424450815 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933affd640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 0x7f933c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 -- 172.21.15.81:0/2424450815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 msgr2=0x7f933c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 0x7f933c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933a7fc640 1 -- 172.21.15.81:0/2424450815 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051899376 0 0) 0x7f933c158e20 con 0x7f933c155690 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 -- 172.21.15.81:0/2424450815 >> v1:172.21.15.81:6789/0 conn(0x7f933c155690 legacy=0x7f933c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 -- 172.21.15.81:0/2424450815 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c1522e0 con 0x7f933c151f00 2024-05-08T20:27:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933affd640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 0x7f933c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933b7fe640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c151f00 0x7f933c1588e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f932c0097f0 tx=0x7f932c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f86046b5129c3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933a7fc640 1 -- 172.21.15.81:0/2424450815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0ac600 con 0x7f933c151f00 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933a7fc640 1 -- 172.21.15.81:0/2424450815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c0a8050 con 0x7f933c151f00 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f933a7fc640 1 -- 172.21.15.81:0/2424450815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0ac980 con 0x7f933c151f00 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- 172.21.15.81:0/2424450815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c151f00 msgr2=0x7f933c1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c151f00 0x7f933c1588e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f932c0097f0 tx=0x7f932c01c380 comp rx=0 tx=0).stop 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- 172.21.15.81:0/2424450815 shutdown_connections 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c154cf0 0x7f933c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 --2- 172.21.15.81:0/2424450815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c151f00 0x7f933c1588e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- 172.21.15.81:0/2424450815 >> 172.21.15.81:0/2424450815 conn(0x7f933c0715f0 msgr2=0x7f933c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- 172.21.15.81:0/2424450815 shutdown_connections 2024-05-08T20:27:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.178+0000 7f9341d06640 1 -- 172.21.15.81:0/2424450815 wait complete. 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 Processor -- start 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- start start 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c151f00 0x7f933c0ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0aa310 0x7f933c0addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ad9a0 con 0x7f933c154cf0 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0ad300 con 0x7f933c0aa310 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0aa820 con 0x7f933c151f00 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38882/0 (socket says 172.21.15.81:38882) 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 -- 172.21.15.81:0/4085431644 learned_addr learned my addr 172.21.15.81:0/4085431644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933bfff640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0aa310 0x7f933c0addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933b7fe640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c151f00 0x7f933c0ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 -- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c151f00 msgr2=0x7f933c0ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c151f00 0x7f933c0ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 -- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0aa310 msgr2=0x7f933c0addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0aa310 0x7f933c0addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 -- 172.21.15.81:0/4085431644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c009420 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f933affd640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f933000c7c0 tx=0x7f933000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330007a30 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330007b90 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c0aab00 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933000ce70 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c0ac620 con 0x7f933c154cf0 2024-05-08T20:27:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c0675e0 con 0x7f933c154cf0 2024-05-08T20:27:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.182+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93300113f0 con 0x7f933c154cf0 2024-05-08T20:27:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.186+0000 7f9323fff640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 0x7f9328068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.186+0000 7f933b7fe640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 0x7f9328068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.186+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9330084890 con 0x7f933c154cf0 2024-05-08T20:27:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.186+0000 7f933b7fe640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 0x7f9328068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ae000 tx=0x7f932c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.190+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9330051960 con 0x7f933c154cf0 2024-05-08T20:27:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.330+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f933c0cab20 con 0x7f93280666c0 2024-05-08T20:27:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.366+0000 7f9323fff640 1 -- 172.21.15.81:0/4085431644 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503094 (secure 0 0 0) 0x7f932c0bb090 con 0x7f93280666c0 2024-05-08T20:27:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:33.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.370+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 msgr2=0x7f9328068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.370+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 0x7f9328068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ae000 tx=0x7f932c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.370+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 msgr2=0x7f933c0a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.370+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f933000c7c0 tx=0x7f933000cc80 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.370+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 shutdown_connections 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93280666c0 0x7f9328068b80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f933c0aa310 0x7f933c0addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f933c154cf0 0x7f933c0a9dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 --2- 172.21.15.81:0/4085431644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f933c151f00 0x7f933c0ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 >> 172.21.15.81:0/4085431644 conn(0x7f933c0715f0 msgr2=0x7f933c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 shutdown_connections 2024-05-08T20:27:33.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:33.374+0000 7f9341d06640 1 -- 172.21.15.81:0/4085431644 wait complete. 2024-05-08T20:27:33.396 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-05-08T20:27:33.227542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595092,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":364,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3346432,"data_stored":1982965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001918"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966918+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:27.966918+0000","last_peered":"2024-05-08T20:27:27.966918+0000","last_clean":"2024-05-08T20:27:27.966918+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:27.966918+0000","last_undegraded":"2024-05-08T20:27:27.966918+0000","last_fullsized":"2024-05-08T20:27:27.966918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.027823+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:28.027823+0000","last_peered":"2024-05-08T20:27:28.027823+0000","last_clean":"2024-05-08T20:27:28.027823+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:28.027823+0000","last_undegraded":"2024-05-08T20:27:28.027823+0000","last_fullsized":"2024-05-08T20:27:28.027823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971546+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:27.971546+0000","last_peered":"2024-05-08T20:27:27.971546+0000","last_clean":"2024-05-08T20:27:27.971546+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:27.971546+0000","last_undegraded":"2024-05-08T20:27:27.971546+0000","last_fullsized":"2024-05-08T20:27:27.971546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:33.801 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-05-08T20:27:33.794+0000 7f0c946a7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T20:27:36.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.526+0000 7f8a9aa7a640 1 Processor -- start 2024-05-08T20:27:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.526+0000 7f8a9aa7a640 1 -- start start 2024-05-08T20:27:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a9aa7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 0x7f8a940c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a9aa7a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a9406f400 0x7f8a940c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a9aa7a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940c0650 con 0x7f8a941501e0 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a9aa7a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9406fd60 con 0x7f8a9406f400 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a9aa7a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a94072180 con 0x7f8a940725f0 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a9406f400 0x7f8a940c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a98816640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a941501e0 0x7f8a9406c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53604/0 (socket says 172.21.15.81:53604) 2024-05-08T20:27:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a98816640 1 -- 172.21.15.81:0/2772164379 learned_addr learned my addr 172.21.15.81:0/2772164379 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a93fff640 1 --2- 172.21.15.81:0/2772164379 >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 0x7f8a940c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 -- 172.21.15.81:0/2772164379 >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 msgr2=0x7f8a940c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 --2- 172.21.15.81:0/2772164379 >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 0x7f8a940c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 -- 172.21.15.81:0/2772164379 >> v1:172.21.15.81:6789/0 conn(0x7f8a941501e0 legacy=0x7f8a9406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 -- 172.21.15.81:0/2772164379 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9406fa80 con 0x7f8a9406f400 2024-05-08T20:27:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a93fff640 1 --2- 172.21.15.81:0/2772164379 >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 0x7f8a940c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a99017640 1 --2- 172.21.15.81:0/2772164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9406f400 0x7f8a940c2180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9406f1b0 tx=0x7f8a8401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddecdbac5afa05a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a937fe640 1 -- 172.21.15.81:0/2772164379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a840a57d0 con 0x7f8a9406f400 2024-05-08T20:27:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a937fe640 1 -- 172.21.15.81:0/2772164379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a840a5930 con 0x7f8a9406f400 2024-05-08T20:27:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.530+0000 7f8a937fe640 1 -- 172.21.15.81:0/2772164379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a840a5cc0 con 0x7f8a9406f400 2024-05-08T20:27:36.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2772164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9406f400 msgr2=0x7f8a940c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2772164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9406f400 0x7f8a940c2180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a9406f1b0 tx=0x7f8a8401c7e0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2772164379 shutdown_connections 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2772164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a9406f400 0x7f8a940c2180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2772164379 >> v2:172.21.15.117:3300/0 conn(0x7f8a940725f0 0x7f8a940c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2772164379 >> 172.21.15.81:0/2772164379 conn(0x7f8a940c2ca0 msgr2=0x7f8a940c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2772164379 shutdown_connections 2024-05-08T20:27:36.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2772164379 wait complete. 2024-05-08T20:27:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 Processor -- start 2024-05-08T20:27:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- start start 2024-05-08T20:27:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 0x7f8a9414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a941501e0 0x7f8a941f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941ee0c0 con 0x7f8a940725f0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c5c90 con 0x7f8a9406f400 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a941f0720 con 0x7f8a941501e0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38908/0 (socket says 172.21.15.81:38908) 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 -- 172.21.15.81:0/2707286605 learned_addr learned my addr 172.21.15.81:0/2707286605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a98816640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 0x7f8a9414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a99017640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a941501e0 0x7f8a941f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 -- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a941501e0 msgr2=0x7f8a941f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a941501e0 0x7f8a941f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 -- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 msgr2=0x7f8a9414bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 0x7f8a9414bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 -- 172.21.15.81:0/2707286605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84009a70 con 0x7f8a940725f0 2024-05-08T20:27:36.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a98816640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 0x7f8a9414bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a93fff640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00c7f0 tx=0x7f8a7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c007820 con 0x7f8a940725f0 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c007980 con 0x7f8a940725f0 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c007d30 con 0x7f8a940725f0 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a94150740 con 0x7f8a940725f0 2024-05-08T20:27:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.534+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9414c320 con 0x7f8a940725f0 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a941f08e0 con 0x7f8a940725f0 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a7c0113f0 con 0x7f8a940725f0 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a917fa640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 0x7f8a74068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8a7c084700 con 0x7f8a940725f0 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a98816640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 0x7f8a74068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.538+0000 7f8a98816640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 0x7f8a74068b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005890 tx=0x7f8a8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.542+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8a7c0517d0 con 0x7f8a940725f0 2024-05-08T20:27:36.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.698+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a940ac4b0 con 0x7f8a740666c0 2024-05-08T20:27:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.730+0000 7f8a917fa640 1 -- 172.21.15.81:0/2707286605 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503094 (secure 0 0 0) 0x7f8a940ac4b0 con 0x7f8a740666c0 2024-05-08T20:27:36.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:36.746 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:36.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 msgr2=0x7f8a74068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 0x7f8a74068b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005890 tx=0x7f8a8c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 msgr2=0x7f8a941f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00c7f0 tx=0x7f8a7c00ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 shutdown_connections 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8a740666c0 0x7f8a74068b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a941501e0 0x7f8a941f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a940725f0 0x7f8a941f0c00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 --2- 172.21.15.81:0/2707286605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a9406f400 0x7f8a9414bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 >> 172.21.15.81:0/2707286605 conn(0x7f8a940c2ca0 msgr2=0x7f8a9406c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 shutdown_connections 2024-05-08T20:27:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.738+0000 7f8a9aa7a640 1 -- 172.21.15.81:0/2707286605 wait complete. 2024-05-08T20:27:36.766 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-05-08T20:27:35.228253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595092,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":364,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3346432,"data_stored":1982965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.651547"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966918+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:27.966918+0000","last_peered":"2024-05-08T20:27:27.966918+0000","last_clean":"2024-05-08T20:27:27.966918+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:27.966918+0000","last_undegraded":"2024-05-08T20:27:27.966918+0000","last_fullsized":"2024-05-08T20:27:27.966918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.027823+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:28.027823+0000","last_peered":"2024-05-08T20:27:28.027823+0000","last_clean":"2024-05-08T20:27:28.027823+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:28.027823+0000","last_undegraded":"2024-05-08T20:27:28.027823+0000","last_fullsized":"2024-05-08T20:27:28.027823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971546+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:27.971546+0000","last_peered":"2024-05-08T20:27:27.971546+0000","last_clean":"2024-05-08T20:27:27.971546+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:27.971546+0000","last_undegraded":"2024-05-08T20:27:27.971546+0000","last_fullsized":"2024-05-08T20:27:27.971546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:36.773 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T20:27:36.774 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T20:27:36.774 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T20:27:36.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T20:27:36.775 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T20:27:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 Processor -- start 2024-05-08T20:27:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 -- start start 2024-05-08T20:27:36.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a2c06f400 0x7f0a2c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0c0650 con 0x7f0a2c0725f0 2024-05-08T20:27:36.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c06fa80 con 0x7f0a2c1501e0 2024-05-08T20:27:36.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a30a89640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c06fd60 con 0x7f0a2c06f400 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a29d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a2c0725f0 0x7f0a2c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53620/0 (socket says 172.21.15.81:53620) 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a29d9b640 1 -- 172.21.15.81:0/2801003004 learned_addr learned my addr 172.21.15.81:0/2801003004 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2ad9d640 1 --2- 172.21.15.81:0/2801003004 >> v2:172.21.15.117:3300/0 conn(0x7f0a2c06f400 0x7f0a2c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2959a640 1 -- 172.21.15.81:0/2801003004 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554877978 0 0) 0x7f0a2c0c0650 con 0x7f0a2c0725f0 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2959a640 1 -- 172.21.15.81:0/2801003004 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a14003530 con 0x7f0a2c0725f0 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2ad9d640 1 -- 172.21.15.81:0/2801003004 >> v1:172.21.15.117:6789/0 conn(0x7f0a2c1501e0 legacy=0x7f0a2c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2ad9d640 1 -- 172.21.15.81:0/2801003004 >> v1:172.21.15.81:6789/0 conn(0x7f0a2c0725f0 legacy=0x7f0a2c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.930+0000 7f0a2ad9d640 1 -- 172.21.15.81:0/2801003004 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c071ea0 con 0x7f0a2c06f400 2024-05-08T20:27:36.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a2ad9d640 1 --2- 172.21.15.81:0/2801003004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c0c2350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2401c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562b5c9a98ed3325 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a2959a640 1 -- 172.21.15.81:0/2801003004 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20001680 con 0x7f0a2c06f400 2024-05-08T20:27:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a2959a640 1 -- 172.21.15.81:0/2801003004 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a240a6450 con 0x7f0a2c06f400 2024-05-08T20:27:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a2959a640 1 -- 172.21.15.81:0/2801003004 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a240a67e0 con 0x7f0a2c06f400 2024-05-08T20:27:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- 172.21.15.81:0/2801003004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 msgr2=0x7f0a2c0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 --2- 172.21.15.81:0/2801003004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c0c2350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2401c690 comp rx=0 tx=0).stop 2024-05-08T20:27:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- 172.21.15.81:0/2801003004 shutdown_connections 2024-05-08T20:27:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 --2- 172.21.15.81:0/2801003004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c0c2350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- 172.21.15.81:0/2801003004 >> 172.21.15.81:0/2801003004 conn(0x7f0a2c0c2ca0 msgr2=0x7f0a2c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- 172.21.15.81:0/2801003004 shutdown_connections 2024-05-08T20:27:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- 172.21.15.81:0/2801003004 wait complete. 2024-05-08T20:27:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 Processor -- start 2024-05-08T20:27:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- start start 2024-05-08T20:27:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 0x7f0a2c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c072180 con 0x7f0a2c0725f0 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c1440c0 con 0x7f0a2c06f400 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.934+0000 7f0a30a89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c156270 con 0x7f0a2c1501e0 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38914/0 (socket says 172.21.15.81:38914) 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 -- 172.21.15.81:0/3507127509 learned_addr learned my addr 172.21.15.81:0/3507127509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2ad9d640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 0x7f0a2c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2a59c640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 -- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 msgr2=0x7f0a2c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 0x7f0a2c14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 -- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 msgr2=0x7f0a2c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 -- 172.21.15.81:0/3507127509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24009a70 con 0x7f0a2c0725f0 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2ad9d640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 0x7f0a2c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2a59c640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a29d9b640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a20001ec0 tx=0x7f0a2000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200074e0 con 0x7f0a2c0725f0 2024-05-08T20:27:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c150740 con 0x7f0a2c0725f0 2024-05-08T20:27:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c156830 con 0x7f0a2c0725f0 2024-05-08T20:27:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20007640 con 0x7f0a2c0725f0 2024-05-08T20:27:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20004a10 con 0x7f0a2c0725f0 2024-05-08T20:27:36.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c074950 con 0x7f0a2c0725f0 2024-05-08T20:27:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a20004b70 con 0x7f0a2c0725f0 2024-05-08T20:27:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 0x7f0a0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0a20083ae0 con 0x7f0a2c0725f0 2024-05-08T20:27:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2a59c640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 0x7f0a0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.938+0000 7f0a2a59c640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 0x7f0a0c068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000f70 tx=0x7f0a1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:36.942+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0a20050aa0 con 0x7f0a2c0725f0 2024-05-08T20:27:37.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.138+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0a2c0c22b0 con 0x7f0a2c0725f0 2024-05-08T20:27:37.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.142+0000 7f0a1affd640 1 -- 172.21.15.81:0/3507127509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164885 (secure 0 0 0) 0x7f0a20018020 con 0x7f0a2c0725f0 2024-05-08T20:27:37.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 msgr2=0x7f0a0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 0x7f0a0c068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c000f70 tx=0x7f0a1c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 msgr2=0x7f0a2c1eedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a20001ec0 tx=0x7f0a2000cc00 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 shutdown_connections 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a0c066690 0x7f0a0c068b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a2c1501e0 0x7f0a2c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a2c0725f0 0x7f0a2c1eedc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 --2- 172.21.15.81:0/3507127509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2c06f400 0x7f0a2c155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 >> 172.21.15.81:0/3507127509 conn(0x7f0a2c0c2ca0 msgr2=0x7f0a2c14bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 shutdown_connections 2024-05-08T20:27:37.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.146+0000 7f0a30a89640 1 -- 172.21.15.81:0/3507127509 wait complete. 2024-05-08T20:27:37.168 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":27511},{"type":"v1","addr":"172.21.15.81:6833","nonce":27511}]},"active_addr":"172.21.15.81:6833/27511","active_change":"2024-05-08T20:26:59.210825+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2644620498}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3418126568}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3484137638}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1499505165}]}]} 2024-05-08T20:27:37.172 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T20:27:37.173 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T20:27:37.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:37.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 Processor -- start 2024-05-08T20:27:37.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 -- start start 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 0x7fdcf80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcf8070c00 0x7fdcf814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcf814edf0 0x7fdcf81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf8072940 con 0x7fdcf814edf0 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf80c3a50 con 0x7fdcf8070c00 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfe30c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80705e0 con 0x7fdcf806b230 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcf814edf0 0x7fdcf81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcf814edf0 0x7fdcf81519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38924/0 (socket says 172.21.15.81:38924) 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 -- 172.21.15.81:0/2849589333 learned_addr learned my addr 172.21.15.81:0/2849589333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcf7fff640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 0x7fdcf80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcf77fe640 1 --2- 172.21.15.81:0/2849589333 >> v2:172.21.15.117:3300/0 conn(0x7fdcf8070c00 0x7fdcf814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 -- 172.21.15.81:0/2849589333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 msgr2=0x7fdcf80c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 0x7fdcf80c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 -- 172.21.15.81:0/2849589333 >> v2:172.21.15.117:3300/0 conn(0x7fdcf8070c00 msgr2=0x7fdcf814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 --2- 172.21.15.81:0/2849589333 >> v2:172.21.15.117:3300/0 conn(0x7fdcf8070c00 0x7fdcf814e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcfc8a9640 1 -- 172.21.15.81:0/2849589333 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80708c0 con 0x7fdcf814edf0 2024-05-08T20:27:37.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.286+0000 7fdcf7fff640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 0x7fdcf80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.290+0000 7fdcfc8a9640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf814edf0 0x7fdcf81519d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcf806fd80 tx=0x7fdcf001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f6d45d30085989 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.290+0000 7fdcf6ffd640 1 -- 172.21.15.81:0/2849589333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8152720 con 0x7fdcf814edf0 2024-05-08T20:27:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.290+0000 7fdcf6ffd640 1 -- 172.21.15.81:0/2849589333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00a5800 con 0x7fdcf814edf0 2024-05-08T20:27:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.290+0000 7fdcf6ffd640 1 -- 172.21.15.81:0/2849589333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00a5b90 con 0x7fdcf814edf0 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/2849589333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf814edf0 msgr2=0x7fdcf81519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf814edf0 0x7fdcf81519d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcf806fd80 tx=0x7fdcf001c960 comp rx=0 tx=0).stop 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/2849589333 shutdown_connections 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf814edf0 0x7fdcf81519d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/2849589333 >> v2:172.21.15.117:3300/0 conn(0x7fdcf8070c00 0x7fdcf814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/2849589333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf806b230 0x7fdcf80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/2849589333 >> 172.21.15.81:0/2849589333 conn(0x7fdcf80c71b0 msgr2=0x7fdcf80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/2849589333 shutdown_connections 2024-05-08T20:27:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/2849589333 wait complete. 2024-05-08T20:27:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 Processor -- start 2024-05-08T20:27:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- start start 2024-05-08T20:27:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcf806b230 0x7fdcf81ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf814edf0 0x7fdcf813c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf81edda0 con 0x7fdcf8070c00 2024-05-08T20:27:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80ad0b0 con 0x7fdcf806b230 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80ad390 con 0x7fdcf814edf0 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38926/0 (socket says 172.21.15.81:38926) 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 -- 172.21.15.81:0/134375665 learned_addr learned my addr 172.21.15.81:0/134375665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf7fff640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcf806b230 0x7fdcf81ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfc8a9640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf814edf0 0x7fdcf813c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 -- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf814edf0 msgr2=0x7fdcf813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf814edf0 0x7fdcf813c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 -- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcf806b230 msgr2=0x7fdcf81ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcf806b230 0x7fdcf81ed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 -- 172.21.15.81:0/134375665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0009b30 con 0x7fdcf8070c00 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf77fe640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00fa70 tx=0x7fdcec00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec007c90 con 0x7fdcf8070c00 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec007df0 con 0x7fdcf8070c00 2024-05-08T20:27:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80aa260 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec01a660 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.294+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf8155730 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80675e0 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcec011450 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcf4ff9640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdcec086ca0 con 0x7fdcf8070c00 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcf7fff640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.298+0000 7fdcf7fff640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 0x7fdce4068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdce8006b20 tx=0x7fdce8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.302+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fdcec053d70 con 0x7fdcf8070c00 2024-05-08T20:27:37.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.458+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcf81541e0 con 0x7fdcf8070c00 2024-05-08T20:27:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcf4ff9640 1 -- 172.21.15.81:0/134375665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7fdcf81541e0 con 0x7fdcf8070c00 2024-05-08T20:27:37.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:37.469 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 msgr2=0x7fdce4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 0x7fdce4068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdce8006b20 tx=0x7fdce8008040 comp rx=0 tx=0).stop 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 msgr2=0x7fdcf81ed860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00fa70 tx=0x7fdcec00ff30 comp rx=0 tx=0).stop 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 shutdown_connections 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcf814edf0 0x7fdcf813c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8070c00 0x7fdcf81ed860 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.462+0000 7fdcfe30c640 1 --2- 172.21.15.81:0/134375665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcf806b230 0x7fdcf81ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.466+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 >> 172.21.15.81:0/134375665 conn(0x7fdcf80c71b0 msgr2=0x7fdcf814f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.466+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 shutdown_connections 2024-05-08T20:27:37.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.466+0000 7fdcfe30c640 1 -- 172.21.15.81:0/134375665 wait complete. 2024-05-08T20:27:37.488 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T20:27:37.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 Processor -- start 2024-05-08T20:27:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 -- start start 2024-05-08T20:27:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef00725f0 0x7f2ef00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef006f400 0x7f2ef00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00c0650 con 0x7f2ef01501e0 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef006fd60 con 0x7f2ef006f400 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef6b8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0072180 con 0x7f2ef00725f0 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef006f400 0x7f2ef00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef006f400 0x7f2ef00c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38928/0 (socket says 172.21.15.81:38928) 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 -- 172.21.15.81:0/3579005996 learned_addr learned my addr 172.21.15.81:0/3579005996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2eeffff640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef00725f0 0x7f2ef00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 -- 172.21.15.81:0/3579005996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef00725f0 msgr2=0x7f2ef00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef00725f0 0x7f2ef00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 -- 172.21.15.81:0/3579005996 >> v1:172.21.15.117:6789/0 conn(0x7f2ef01501e0 legacy=0x7f2ef006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.598+0000 7f2ef5127640 1 -- 172.21.15.81:0/3579005996 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef006fa80 con 0x7f2ef006f400 2024-05-08T20:27:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef006f400 0x7f2ef00c2180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009e50 tx=0x7f2ee801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957bc5900be23080 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eef7fe640 1 -- 172.21.15.81:0/3579005996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80a5650 con 0x7f2ef006f400 2024-05-08T20:27:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eef7fe640 1 -- 172.21.15.81:0/3579005996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80a57b0 con 0x7f2ef006f400 2024-05-08T20:27:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eef7fe640 1 -- 172.21.15.81:0/3579005996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80a5b40 con 0x7f2ef006f400 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3579005996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef006f400 msgr2=0x7f2ef00c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef006f400 0x7f2ef00c2180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009e50 tx=0x7f2ee801c8a0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3579005996 shutdown_connections 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef006f400 0x7f2ef00c2180 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3579005996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef00725f0 0x7f2ef00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3579005996 >> 172.21.15.81:0/3579005996 conn(0x7f2ef00c2ca0 msgr2=0x7f2ef00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3579005996 shutdown_connections 2024-05-08T20:27:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3579005996 wait complete. 2024-05-08T20:27:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 Processor -- start 2024-05-08T20:27:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- start start 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 0x7f2ef01ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ef00725f0 0x7f2ef01433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00bbb00 con 0x7f2ef01501e0 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0142f10 con 0x7f2ef00725f0 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0140d70 con 0x7f2ef006f400 2024-05-08T20:27:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38938/0 (socket says 172.21.15.81:38938) 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 -- 172.21.15.81:0/3127377320 learned_addr learned my addr 172.21.15.81:0/3127377320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eeffff640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ef00725f0 0x7f2ef01433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef4926640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 0x7f2ef01ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 -- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 msgr2=0x7f2ef01ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 0x7f2ef01ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 -- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ef00725f0 msgr2=0x7f2ef01433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ef00725f0 0x7f2ef01433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 -- 172.21.15.81:0/3127377320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009b30 con 0x7f2ef01501e0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef4926640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 0x7f2ef01ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef5127640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801af50 tx=0x7f2ee8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b8670 con 0x7f2ef01501e0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80b87d0 con 0x7f2ef01501e0 2024-05-08T20:27:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0150740 con 0x7f2ef01501e0 2024-05-08T20:27:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b8b60 con 0x7f2ef01501e0 2024-05-08T20:27:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.602+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef00bb540 con 0x7f2ef01501e0 2024-05-08T20:27:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef0143080 con 0x7f2ef01501e0 2024-05-08T20:27:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ee80b8cc0 con 0x7f2ef01501e0 2024-05-08T20:27:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2eed7fa640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 0x7f2ed4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2ef4926640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 0x7f2ed4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2ee811f980 con 0x7f2ef01501e0 2024-05-08T20:27:37.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.606+0000 7f2ef4926640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 0x7f2ed4068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400a850 tx=0x7f2ee4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.610+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2ee80eca70 con 0x7f2ef01501e0 2024-05-08T20:27:37.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.758+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ef0074950 con 0x7f2ef01501e0 2024-05-08T20:27:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.758+0000 7f2eed7fa640 1 -- 172.21.15.81:0/3127377320 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f2ee8009510 con 0x7f2ef01501e0 2024-05-08T20:27:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:37.766 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 msgr2=0x7f2ed4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 0x7f2ed4068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400a850 tx=0x7f2ee4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 msgr2=0x7f2ef01eda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801af50 tx=0x7f2ee8019640 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 shutdown_connections 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ed4066690 0x7f2ed4068b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef01501e0 0x7f2ef01eda50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ef00725f0 0x7f2ef01433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 --2- 172.21.15.81:0/3127377320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ef006f400 0x7f2ef01ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 >> 172.21.15.81:0/3127377320 conn(0x7f2ef00c2ca0 msgr2=0x7f2ef00712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 shutdown_connections 2024-05-08T20:27:37.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.762+0000 7f2ef6b8a640 1 -- 172.21.15.81:0/3127377320 wait complete. 2024-05-08T20:27:37.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T20:27:37.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T20:27:37.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T20:27:37.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T20:27:37.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T20:27:37.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T20:27:37.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T20:27:37.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T20:27:37.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f38160f2640 1 Processor -- start 2024-05-08T20:27:37.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f38160f2640 1 -- start start 2024-05-08T20:27:37.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f89f759e640 1 Processor -- start 2024-05-08T20:27:37.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7fd1cee1e640 1 Processor -- start 2024-05-08T20:27:37.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f89f759e640 1 -- start start 2024-05-08T20:27:37.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7fd1cee1e640 1 -- start start 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f38150f0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38080d7990 0x7f3808008bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53634/0 (socket says 172.21.15.81:53634) 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f38150f0640 1 -- 172.21.15.81:0/4134084755 learned_addr learned my addr 172.21.15.81:0/4134084755 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.954+0000 7f38160f2640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3808047fa0 0x7f38080dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3808048fe0 con 0x7f38080d7990 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080d7d70 con 0x7f380800b980 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380800c2a0 con 0x7f3808047fa0 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111929616 0 0) 0x7f3808048fe0 con 0x7f38080d7990 2024-05-08T20:27:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc003530 con 0x7f38080d7990 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1cee1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1cee1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1c806d7d0 0x7fd1c8071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1cee1e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c80706d0 con 0x7fd1c80c31a0 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1cee1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c8158df0 con 0x7fd1c806d7d0 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1cee1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c815d3b0 con 0x7fd1c8156430 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1c806d7d0 0x7fd1c8071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1c806d7d0 0x7fd1c8071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38952/0 (socket says 172.21.15.81:38952) 2024-05-08T20:27:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 -- 172.21.15.81:0/671606938 learned_addr learned my addr 172.21.15.81:0/671606938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89f0048320 0x7f89f004d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1151002162 0 0) 0x7f37fc003530 con 0x7f38080d7990 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3808047fa0 msgr2=0x7f38080dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3808047fa0 0x7f38080dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 >> v1:172.21.15.117:6789/0 conn(0x7f380800b980 legacy=0x7f38080ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380800c580 con 0x7f38080d7990 2024-05-08T20:27:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f380c001680 con 0x7f38080d7990 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 >> v1:172.21.15.81:6789/0 conn(0x7f38080d7990 legacy=0x7f3808008bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37fc0047d0 0x7f37fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37fc0052b0 0x7f37fc0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380800c2a0 con 0x7f37fc0052b0 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc014990 con 0x7f37fc0047d0 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc014b50 con 0x7f37fc0039b0 2024-05-08T20:27:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 0x7f89f0048700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f000c530 con 0x7f89f0049bb0 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0030310 con 0x7f89f0048320 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00da610 con 0x7f89f004bfc0 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37fc0052b0 0x7f37fc0141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38148ef640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37fc0047d0 0x7f37fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38150f0640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 0x7f89f0048700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 0x7f89f0048700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35280/0 (socket says 172.21.15.81:35280) 2024-05-08T20:27:37.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f6d9d640 1 -- 172.21.15.81:0/4168950903 learned_addr learned my addr 172.21.15.81:0/4168950903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f659c640 1 --2- 172.21.15.81:0/4168950903 >> v2:172.21.15.117:3300/0 conn(0x7f89f0048320 0x7f89f004d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 -- 172.21.15.81:0/671606938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 msgr2=0x7fd1c806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c77fe640 1 -- 172.21.15.81:0/671606938 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748073130 0 0) 0x7fd1c00014a0 con 0x7fd1c80c31a0 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1ccbba640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 -- 172.21.15.81:0/671606938 >> v1:172.21.15.117:6789/0 conn(0x7fd1c80c31a0 legacy=0x7fd1c8071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1c7fff640 1 -- 172.21.15.81:0/671606938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c81598f0 con 0x7fd1c806d7d0 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 -- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37fc0039b0 msgr2=0x7f37fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 -- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37fc0047d0 msgr2=0x7f37fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37fc0047d0 0x7f37fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f38158f1640 1 -- 172.21.15.81:0/4134084755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380800c580 con 0x7f37fc0052b0 2024-05-08T20:27:37.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7fd1ccbba640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f559a640 1 -- 172.21.15.81:0/4168950903 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901658542 0 0) 0x7f89f000c530 con 0x7f89f0049bb0 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f559a640 1 -- 172.21.15.81:0/4168950903 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e0003530 con 0x7f89f0049bb0 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f659c640 1 -- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 msgr2=0x7f89f0048700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f659c640 1 --2- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 0x7f89f0048700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f659c640 1 -- 172.21.15.81:0/4168950903 >> v1:172.21.15.117:6789/0 conn(0x7f89f0049bb0 legacy=0x7f89f000be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f89f659c640 1 -- 172.21.15.81:0/4168950903 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f004c810 con 0x7f89f0048320 2024-05-08T20:27:37.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f1f8c3ba640 1 Processor -- start 2024-05-08T20:27:37.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.958+0000 7f1f8c3ba640 1 -- start start 2024-05-08T20:27:37.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 Processor -- start 2024-05-08T20:27:37.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 -- start start 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8c3ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f84159930 0x7f1f840c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8c3ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840a9bb0 con 0x7f1f84072450 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8c3ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f84158e90 con 0x7f1f84156480 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8c3ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f84159d80 con 0x7f1f84159930 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f84159930 0x7f1f840c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f84159930 0x7f1f840c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38968/0 (socket says 172.21.15.81:38968) 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 -- 172.21.15.81:0/3168263841 learned_addr learned my addr 172.21.15.81:0/3168263841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 -- 172.21.15.81:0/3168263841 >> v1:172.21.15.117:6789/0 conn(0x7f1f84156480 legacy=0x7f1f840c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 -- 172.21.15.81:0/3168263841 >> v1:172.21.15.81:6789/0 conn(0x7f1f84072450 legacy=0x7f1f840a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f1f8a957640 1 -- 172.21.15.81:0/3168263841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840c1ef0 con 0x7f1f84159930 2024-05-08T20:27:37.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d7c155070 0x7f0d7c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38158f1640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37fc0052b0 0x7f37fc0141a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38100687d0 tx=0x7f3810096f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cedbe3085206d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d817f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d7c155070 0x7f0d7c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c14e830 con 0x7f0d7c06b840 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d817f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d7c155070 0x7f0d7c0c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38976/0 (socket says 172.21.15.81:38976) 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d817f5640 1 -- 172.21.15.81:0/1346023922 learned_addr learned my addr 172.21.15.81:0/1346023922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c06d6a0 con 0x7f0d7c0c6410 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c151900 con 0x7f0d7c155070 2024-05-08T20:27:37.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f659c640 1 --2- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0048320 0x7f89f004d2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097c0 tx=0x7f89ec024bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9718a6b34a7070eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 Processor -- start 2024-05-08T20:27:37.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f559a640 1 -- 172.21.15.81:0/4168950903 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0adac0 con 0x7f89f0048320 2024-05-08T20:27:37.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 -- start start 2024-05-08T20:27:37.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f559a640 1 -- 172.21.15.81:0/4168950903 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec0adc20 con 0x7f89f0048320 2024-05-08T20:27:37.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f559a640 1 -- 172.21.15.81:0/4168950903 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0b5440 con 0x7f89f0048320 2024-05-08T20:27:37.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381011fe10 con 0x7f37fc0052b0 2024-05-08T20:27:37.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810127440 con 0x7f37fc0052b0 2024-05-08T20:27:37.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f3803fff640 1 -- 172.21.15.81:0/4134084755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810127870 con 0x7f37fc0052b0 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015468211 0 0) 0x7f0d740014a0 con 0x7f0d7c06b840 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d68003450 con 0x7f0d7c06b840 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484824072 0 0) 0x7f0d7c06d6a0 con 0x7f0d7c0c6410 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d740014a0 con 0x7f0d7c0c6410 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652214983 0 0) 0x7f0d68003450 con 0x7f0d7c06b840 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 >> v2:172.21.15.81:3300/0 conn(0x7f0d7c155070 msgr2=0x7f0d7c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 --2- 172.21.15.81:0/1346023922 >> v2:172.21.15.81:3300/0 conn(0x7f0d7c155070 0x7f0d7c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 >> v1:172.21.15.117:6789/0 conn(0x7f0d7c0c6410 legacy=0x7f0d7c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c151be0 con 0x7f0d7c06b840 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f0d74001b90 con 0x7f0d7c06b840 2024-05-08T20:27:37.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 >> v1:172.21.15.81:6789/0 conn(0x7f0d7c06b840 legacy=0x7f0d7c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68003c00 0x7f0d68004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 0x7f0d68006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d68007200 0x7f0d680076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c151900 con 0x7f0d68007200 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68007f90 con 0x7f0d68006710 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68008150 con 0x7f0d68003c00 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37fc0052b0 msgr2=0x7f37fc0141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38160f2640 1 --2- 172.21.15.81:0/4134084755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37fc0052b0 0x7f37fc0141a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38100687d0 tx=0x7f3810096f50 comp rx=0 tx=0).stop 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38158f1640 1 -- 172.21.15.81:0/4134084755 reap_dead start 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 shutdown_connections 2024-05-08T20:27:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 >> 172.21.15.81:0/4134084755 conn(0x7f3808049340 msgr2=0x7f3808049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 -- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0048320 msgr2=0x7f89f004d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 --2- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0048320 0x7f89f004d2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097c0 tx=0x7f89ec024bf0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 -- 172.21.15.81:0/4168950903 shutdown_connections 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 --2- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f004bfc0 0x7f89f0048700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 --2- 172.21.15.81:0/4168950903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0048320 0x7f89f004d2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 -- 172.21.15.81:0/4168950903 >> 172.21.15.81:0/4168950903 conn(0x7f89f002f490 msgr2=0x7f89f002f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 -- 172.21.15.81:0/4168950903 shutdown_connections 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7f00bd9c0 0x7fb7f0159700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 0x7fb7f00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00c9d10 con 0x7fb7f00afb60 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00c56c0 con 0x7fb7f00bd9c0 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f7089640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f00c9a30 con 0x7fb7f0159c40 2024-05-08T20:27:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f4e25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f4e25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38994/0 (socket says 172.21.15.81:38994) 2024-05-08T20:27:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7fb7f4e25640 1 -- 172.21.15.81:0/3720683481 learned_addr learned my addr 172.21.15.81:0/3720683481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 0x7f0d68006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f0d817f5640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68003c00 0x7f0d68004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 --2- 172.21.15.81:0/3720683481 >> v2:172.21.15.117:3300/0 conn(0x7fb7f00bd9c0 0x7fb7f0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d81ff6640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d68007200 0x7f0d680076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8a957640 1 --2- 172.21.15.81:0/3168263841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84159930 0x7f1f840c32f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009870 tx=0x7f1f8001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f095a9ad211a5bec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 -- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68003c00 msgr2=0x7f0d68004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68003c00 0x7f0d68004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 -- 172.21.15.81:0/1346023922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d68007200 msgr2=0x7f0d680076b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d68007200 0x7f0d680076b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 -- 172.21.15.81:0/1346023922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c151be0 con 0x7f0d68006710 2024-05-08T20:27:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d81ff6640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d68007200 0x7f0d680076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d81ff6640 1 -- 172.21.15.81:0/1346023922 reap_dead start 2024-05-08T20:27:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 -- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 msgr2=0x7fb7f00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c806d7d0 0x7fd1c8071530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e3f1986687f448 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7f5626640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 0x7fb7f00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 Processor -- start 2024-05-08T20:27:37.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 -- start start 2024-05-08T20:27:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f89154640 1 -- 172.21.15.81:0/3168263841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f800a6040 con 0x7f1f84159930 2024-05-08T20:27:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f89154640 1 -- 172.21.15.81:0/3168263841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f800aa600 con 0x7f1f84159930 2024-05-08T20:27:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f89154640 1 -- 172.21.15.81:0/3168263841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f800aa990 con 0x7f1f84159930 2024-05-08T20:27:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.962+0000 7f89f759e640 1 -- 172.21.15.81:0/4168950903 wait complete. 2024-05-08T20:27:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 Processor -- start 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 0x7fb7f00c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 -- 172.21.15.81:0/3720683481 >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 msgr2=0x7fb7f01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 --2- 172.21.15.81:0/3720683481 >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7effff640 1 -- 172.21.15.81:0/3720683481 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00c5000 con 0x7fb7f00bd9c0 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7f4e25640 1 --2- 172.21.15.81:0/3720683481 >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fb7f5626640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 0x7fb7f00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 shutdown_connections 2024-05-08T20:27:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f38160f2640 1 -- 172.21.15.81:0/4134084755 wait complete. 2024-05-08T20:27:37.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/3168263841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84159930 msgr2=0x7f1f840c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 --2- 172.21.15.81:0/3168263841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84159930 0x7f1f840c32f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009870 tx=0x7f1f8001c4a0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 0x7f8d600c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/3168263841 shutdown_connections 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 --2- 172.21.15.81:0/3168263841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84159930 0x7f1f840c32f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/3168263841 >> 172.21.15.81:0/3168263841 conn(0x7f1f8406a2f0 msgr2=0x7f1f8406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fd1c77fe640 1 -- 172.21.15.81:0/671606938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0ad660 con 0x7fd1c806d7d0 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fd1c77fe640 1 -- 172.21.15.81:0/671606938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0ad7c0 con 0x7fd1c806d7d0 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7fd1c77fe640 1 -- 172.21.15.81:0/671606938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0adb50 con 0x7fd1c806d7d0 2024-05-08T20:27:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/3168263841 shutdown_connections 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d600c3a50 con 0x7f8d60070c00 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d5e7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d60070c00 0x7f8d6014e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53656/0 (socket says 172.21.15.81:53656) 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d5e7fc640 1 -- 172.21.15.81:0/3418541771 learned_addr learned my addr 172.21.15.81:0/3418541771 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d5effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 0x7f8d600c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 -- start start 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f0048320 0x7f89f0172e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0049bb0 0x7f89f017fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f004bfc0 0x7f89f0180180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f002de30 con 0x7f89f004bfc0 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f002ec40 con 0x7f89f0049bb0 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f002d430 con 0x7f89f0048320 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f5d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0049bb0 0x7f89f017fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f5d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0049bb0 0x7f89f017fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33244/0 (socket says 172.21.15.81:33244) 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f5d9b640 1 -- 172.21.15.81:0/449523842 learned_addr learned my addr 172.21.15.81:0/449523842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f659c640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f0048320 0x7f89f0172e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 0x7f0d68006b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0c67f0 tx=0x7f0d6c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ddd7159932e0f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d600705e0 con 0x7f8d601519d0 2024-05-08T20:27:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60072940 con 0x7f8d6006b230 2024-05-08T20:27:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f89f6d9d640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f004bfc0 0x7f89f0180180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f38160f2640 1 Processor -- start 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0052d0 con 0x7f0d68006710 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0a7050 con 0x7f0d68006710 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d73fff640 1 -- 172.21.15.81:0/1346023922 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003600 con 0x7f0d68006710 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 Processor -- start 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5dffb640 1 -- 172.21.15.81:0/3418541771 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679931268 0 0) 0x7f8d600705e0 con 0x7f8d601519d0 2024-05-08T20:27:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5dffb640 1 -- 172.21.15.81:0/3418541771 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d48003530 con 0x7f8d601519d0 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 -- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f0048320 msgr2=0x7f89f0172e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f0048320 0x7f89f0172e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 -- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0049bb0 msgr2=0x7f89f017fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89f0049bb0 0x7f89f017fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009420 con 0x7f89f004bfc0 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f659c640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89f0048320 0x7f89f0172e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 -- start start 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- start start 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 0x7f38080caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38080cb020 0x7f38080c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38080ca2a0 0x7f380816bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080dbe60 con 0x7f38080d5fd0 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38081700a0 con 0x7f38080cb020 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380816f2e0 con 0x7f38080ca2a0 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 0x7f38080caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 0x7f38080caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39016/0 (socket says 172.21.15.81:39016) 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 -- 172.21.15.81:0/2086691521 learned_addr learned my addr 172.21.15.81:0/2086691521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38158f1640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38080ca2a0 0x7f380816bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.966+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/3168263841 wait complete. 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 Processor -- start 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 -- 172.21.15.81:0/2086691521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38080ca2a0 msgr2=0x7f380816bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38080ca2a0 0x7f380816bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 -- 172.21.15.81:0/2086691521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38080cb020 msgr2=0x7f38080c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38080cb020 0x7f38080c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380816f5c0 con 0x7f38080d5fd0 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f6d9d640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f004bfc0 0x7f89f0180180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89f8063da0 tx=0x7f89f8067ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 msgr2=0x7f0d68006b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d83a59640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 0x7f0d68006b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0c67f0 tx=0x7f0d6c01c3e0 comp rx=0 tx=0).stop 2024-05-08T20:27:37.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 -- 172.21.15.81:0/671606938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c806d7d0 msgr2=0x7fd1c8071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:37.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c806d7d0 0x7fd1c8071530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc01c560 comp rx=0 tx=0).stop 2024-05-08T20:27:37.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38150f0640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 0x7f38080caa60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f380c0078d0 tx=0x7f380c012ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:37.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd0c06b230 0x7fcd0c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 0x7fcd0c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 -- start start 2024-05-08T20:27:38.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0c3a50 con 0x7fcd0c070c00 2024-05-08T20:27:38.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 -- 172.21.15.81:0/671606938 shutdown_connections 2024-05-08T20:27:38.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c806d7d0 0x7fd1c8071530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 --2- 172.21.15.81:0/671606938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 -- 172.21.15.81:0/671606938 >> 172.21.15.81:0/671606938 conn(0x7fd1c80c71b0 msgr2=0x7fd1c80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c072940 con 0x7fcd0c06b230 2024-05-08T20:27:38.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 shutdown_connections 2024-05-08T20:27:38.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d83a59640 1 --2- 172.21.15.81:0/1346023922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68006710 0x7f0d68006b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd10a5d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0705e0 con 0x7fcd0c1519d0 2024-05-08T20:27:38.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 >> 172.21.15.81:0/1346023922 conn(0x7f0d7c0c68c0 msgr2=0x7f0d7c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 -- 172.21.15.81:0/671606938 shutdown_connections 2024-05-08T20:27:38.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 -- 172.21.15.81:0/671606938 wait complete. 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8090070 con 0x7f89f004bfc0 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f80721d0 con 0x7f89f004bfc0 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8069ac0 con 0x7f89f004bfc0 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0108b0 con 0x7f38080d5fd0 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c010a30 con 0x7f38080d5fd0 2024-05-08T20:27:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c010de0 con 0x7f38080d5fd0 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380816f8a0 con 0x7f38080d5fd0 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38080ca750 con 0x7f38080d5fd0 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f759e640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f002d710 con 0x7f89f004bfc0 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f759e640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f002f150 con 0x7f89f004bfc0 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 0x7f1f841f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84156480 0x7f1f841509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84159930 0x7f1f841443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84151f20 con 0x7f1f84072450 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8414f790 con 0x7f1f84156480 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8c3ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8414fa30 con 0x7f1f84159930 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 0x7f1f841f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 0x7f1f841f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39022/0 (socket says 172.21.15.81:39022) 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 -- 172.21.15.81:0/2814094050 learned_addr learned my addr 172.21.15.81:0/2814094050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a957640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84159930 0x7f1f841443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f89955640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84156480 0x7f1f841509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5effd640 1 -- 172.21.15.81:0/3418541771 >> v1:172.21.15.117:6789/0 conn(0x7f8d601519d0 legacy=0x7f8d60151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5effd640 1 -- 172.21.15.81:0/3418541771 >> v1:172.21.15.81:6789/0 conn(0x7f8d60070c00 legacy=0x7f8d6014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5effd640 1 -- 172.21.15.81:0/3418541771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600708c0 con 0x7f8d6006b230 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd0ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 0x7fcd0c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 -- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84159930 msgr2=0x7f1f841443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f84159930 0x7f1f841443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 -- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84156480 msgr2=0x7f1f841509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f84156480 0x7f1f841509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800094d0 con 0x7f1f84072450 2024-05-08T20:27:38.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd0ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 0x7fcd0c151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33256/0 (socket says 172.21.15.81:33256) 2024-05-08T20:27:38.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd0ad9d640 1 -- 172.21.15.81:0/849501561 learned_addr learned my addr 172.21.15.81:0/849501561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fd1cee1e640 1 Processor -- start 2024-05-08T20:27:38.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/849501561 >> v2:172.21.15.81:3300/0 conn(0x7fcd0c06b230 0x7fcd0c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f1f8a156640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 0x7f1f841f1910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c7f0 tx=0x7f1f7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f8d5effd640 1 --2- 172.21.15.81:0/3418541771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 0x7f8d600c2800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d500097f0 tx=0x7f8d5001e6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea086044efb2e524 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.970+0000 7f89f759e640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89f00d4f80 con 0x7f89f004bfc0 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fcd0a59c640 1 -- 172.21.15.81:0/849501561 >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 msgr2=0x7fcd0c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/849501561 >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 0x7fcd0c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fcd0a59c640 1 -- 172.21.15.81:0/849501561 >> v1:172.21.15.81:6789/0 conn(0x7fcd0c070c00 legacy=0x7fcd0c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fcd0a59c640 1 -- 172.21.15.81:0/849501561 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0708c0 con 0x7fcd0c06b230 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 shutdown_connections 2024-05-08T20:27:38.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7effff640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f00bd9c0 0x7fb7f0159700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf20 tx=0x7fb7e001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a034fca96e946 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89f8072560 con 0x7f89f004bfc0 2024-05-08T20:27:38.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7ef7fe640 1 -- 172.21.15.81:0/3720683481 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00ad680 con 0x7fb7f00bd9c0 2024-05-08T20:27:38.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f380800cac0 con 0x7f38080d5fd0 2024-05-08T20:27:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7ef7fe640 1 -- 172.21.15.81:0/3720683481 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f00ca1c0 con 0x7fb7f00bd9c0 2024-05-08T20:27:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7ef7fe640 1 -- 172.21.15.81:0/3720683481 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00ada00 con 0x7fb7f00bd9c0 2024-05-08T20:27:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89d80666e0 0x7f89d8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f89f80fe5d0 con 0x7f89f004bfc0 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7f89d8070f00 0x7f89d8073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89d80739d0 con 0x7f89d8070f00 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89f5d9b640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7f89d8070f00 0x7f89d8073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 -- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f00bd9c0 msgr2=0x7fb7f0159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f00bd9c0 0x7fb7f0159700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf20 tx=0x7fb7e001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- 172.21.15.81:0/1346023922 wait complete. 2024-05-08T20:27:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 Processor -- start 2024-05-08T20:27:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fd1cee1e640 1 -- start start 2024-05-08T20:27:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c003b80 con 0x7f1f84072450 2024-05-08T20:27:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c003ce0 con 0x7f1f84072450 2024-05-08T20:27:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- start start 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f380c016410 con 0x7f38080d5fd0 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f37f4066790 0x7f37f4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f380c0873c0 con 0x7f38080d5fd0 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f37f4070fb0 0x7f37f40733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37f4073a80 con 0x7f37f4070fb0 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f38158f1640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f37f4070fb0 0x7f37f40733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f38148ef640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f37f4066790 0x7f37f4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f380c054470 con 0x7f38080d5fd0 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 -- 172.21.15.81:0/3720683481 shutdown_connections 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f0159c40 0x7fb7f00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 --2- 172.21.15.81:0/3720683481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f00bd9c0 0x7fb7f0159700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 --2- 172.21.15.81:0/3720683481 >> v2:172.21.15.81:3300/0 conn(0x7fb7f00afb60 0x7fb7f01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 -- 172.21.15.81:0/3720683481 >> 172.21.15.81:0/3720683481 conn(0x7fb7f00abe20 msgr2=0x7fb7f00ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00aa90 con 0x7f1f84072450 2024-05-08T20:27:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8414fd10 con 0x7f1f84072450 2024-05-08T20:27:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f8d5dffb640 1 -- 172.21.15.81:0/3418541771 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500ab630 con 0x7f8d6006b230 2024-05-08T20:27:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f841502d0 con 0x7f1f84072450 2024-05-08T20:27:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89f659c640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89d80666e0 0x7f89d8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89f5d9b640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7f89d8070f00 0x7f89d8073320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89f80cb830 con 0x7f89f004bfc0 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68006710 0x7f0d7c1ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 0x7f0d7c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d7c0a8e30 0x7f0d7c0a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c5130 con 0x7f0d7c0a8e30 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c1f2870 con 0x7f0d7c152f80 2024-05-08T20:27:38.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d83a59640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c153440 con 0x7f0d68006710 2024-05-08T20:27:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 -- 172.21.15.81:0/3720683481 shutdown_connections 2024-05-08T20:27:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7fb7f7089640 1 -- 172.21.15.81:0/3720683481 wait complete. 2024-05-08T20:27:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f38148ef640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f37f4066790 0x7f37f4068c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3804006c00 tx=0x7f3804006b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f840a8ac0 con 0x7f1f84072450 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d80ff4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 0x7f0d7c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f8d5dffb640 1 -- 172.21.15.81:0/3418541771 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d500ab790 con 0x7f8d6006b230 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f8d5dffb640 1 -- 172.21.15.81:0/3418541771 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500abb20 con 0x7f8d6006b230 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 msgr2=0x7f8d600c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f8d656b1640 1 --2- 172.21.15.81:0/3418541771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 0x7f8d600c2800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d500097f0 tx=0x7f8d5001e6a0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f89f659c640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89d80666e0 0x7f89d8068ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0b7000 tx=0x7f89ec0af070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f38158f1640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f37f4070fb0 0x7f37f40733d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 0x7fd1c81f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c80c31a0 0x7fd1c81f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81f4fc0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8150f40 con 0x7fd1c806d7d0 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cee1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81f5990 con 0x7fd1c8156430 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d80ff4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 0x7f0d7c1f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33280/0 (socket says 172.21.15.81:33280) 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.974+0000 7f0d80ff4640 1 -- 172.21.15.81:0/3718153924 learned_addr learned my addr 172.21.15.81:0/3718153924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d817f5640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68006710 0x7f0d7c1ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1ccbba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 0x7fd1c81f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1ccbba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 0x7fd1c81f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33286/0 (socket says 172.21.15.81:33286) 2024-05-08T20:27:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1ccbba640 1 -- 172.21.15.81:0/3118873788 learned_addr learned my addr 172.21.15.81:0/3118873788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d81ff6640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d7c0a8e30 0x7f0d7c0a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c80c31a0 0x7fd1c81f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1cd3bb640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 -- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68006710 msgr2=0x7f0d7c1ef860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d68006710 0x7f0d7c1ef860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 -- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d7c0a8e30 msgr2=0x7f0d7c0a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d7c0a8e30 0x7f0d7c0a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c153720 con 0x7f0d7c152f80 2024-05-08T20:27:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== osd.3 v2:172.21.15.81:6800/27591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f37f4073a80 con 0x7f37f4070fb0 2024-05-08T20:27:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 Processor -- start 2024-05-08T20:27:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== osd.5 v2:172.21.15.117:6816/27739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f89d80739d0 con 0x7f89d8070f00 2024-05-08T20:27:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 -- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 msgr2=0x7fd1c8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1c8156430 0x7fd1c8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 -- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 msgr2=0x7fd1c81f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 0x7fd1c81f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0094d0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1ccbba640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1c806d7d0 0x7fd1c81f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 -- start start 2024-05-08T20:27:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d80ff4640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 0x7f0d7c1f2330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c005040 tx=0x7f0d68003700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fd1c7fff640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c80c31a0 0x7fd1c81f1560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0ac000 tx=0x7fd1bc019320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f7c00abf0 con 0x7f1f84072450 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f00afb60 0x7fb7f01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f00bd9c0 0x7fb7f014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 0x7fb7f014c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f014e400 con 0x7fb7f00bd9c0 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f015c120 con 0x7fb7f0159c40 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f015a680 con 0x7fb7f00afb60 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f68066760 0x7f1f68068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1f7c084cd0 con 0x7f1f84072450 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f1f68071000 0x7f1f68073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f68073ad0 con 0x7f1f68071000 2024-05-08T20:27:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f7c085080 con 0x7f1f84072450 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 0x7fb7f014c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 0x7fb7f014c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33296/0 (socket says 172.21.15.81:33296) 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 -- 172.21.15.81:0/241941865 learned_addr learned my addr 172.21.15.81:0/241941865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 shutdown_connections 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f8d656b1640 1 --2- 172.21.15.81:0/3418541771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d6006b230 0x7f8d600c2800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 >> 172.21.15.81:0/3418541771 conn(0x7f8d600c71b0 msgr2=0x7f8d600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f8a957640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f1f68071000 0x7f1f68073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/849501561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c0c2800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0c2d40 tx=0x7fcd0401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf0d24e653e56d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 shutdown_connections 2024-05-08T20:27:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f8d656b1640 1 -- 172.21.15.81:0/3418541771 wait complete. 2024-05-08T20:27:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f1f8a957640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f1f68071000 0x7f1f68073420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 -- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f00afb60 msgr2=0x7fb7f01517e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7f00afb60 0x7fb7f01517e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 -- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f00bd9c0 msgr2=0x7fb7f014bf30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f00bd9c0 0x7fb7f014bf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8009b30 con 0x7fb7f0159c40 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f5626640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 0x7fb7f014c470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c590 tx=0x7fb7e400ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4011800 con 0x7fb7f0159c40 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4011980 con 0x7fb7f0159c40 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4011d30 con 0x7fb7f0159c40 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00093b0 con 0x7fb7f0159c40 2024-05-08T20:27:38.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== osd.0 v2:172.21.15.81:6824/27589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1f68073ad0 con 0x7f1f68071000 2024-05-08T20:27:38.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 Processor -- start 2024-05-08T20:27:38.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f015a3a0 con 0x7fb7f0159c40 2024-05-08T20:27:38.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7f0074950 con 0x7fb7f0159c40 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- start start 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006b230 0x7f8d600c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 0x7f8d60154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d601519d0 0x7f8d60155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60153500 con 0x7f8d60070c00 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60153750 con 0x7f8d6006b230 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60153a30 con 0x7f8d601519d0 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 0x7f8d60154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003ad0 con 0x7f0d7c152f80 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c003c50 con 0x7f0d7c152f80 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.978+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0067e0 con 0x7f0d7c152f80 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 0x7f8d60154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39062/0 (socket says 172.21.15.81:39062) 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 -- 172.21.15.81:0/2103577623 learned_addr learned my addr 172.21.15.81:0/2103577623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5effd640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006b230 0x7f8d600c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d601519d0 0x7f8d60155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f1f89955640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f68066760 0x7f1f68068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d601519d0 msgr2=0x7f8d60155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d601519d0 0x7f8d60155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006b230 msgr2=0x7f8d600c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d6006b230 0x7f8d600c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009420 con 0x7f8d60070c00 2024-05-08T20:27:38.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7e40233e0 con 0x7fb7f0159c40 2024-05-08T20:27:38.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fcd0959a640 1 -- 172.21.15.81:0/849501561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040a5960 con 0x7fcd0c06b230 2024-05-08T20:27:38.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7dc0666c0 0x7fb7dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f1f89955640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f68066760 0x7f1f68068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f841521e0 tx=0x7f1f74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb7e4084af0 con 0x7fb7f0159c40 2024-05-08T20:27:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7fb7dc070ee0 0x7fb7dc073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7dc0739b0 con 0x7fb7dc070ee0 2024-05-08T20:27:38.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e4084f40 con 0x7fb7f0159c40 2024-05-08T20:27:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d5e7fc640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 0x7f8d60154ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c500 tx=0x7f8d5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54005cf0 con 0x7f8d60070c00 2024-05-08T20:27:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54005e50 con 0x7f8d60070c00 2024-05-08T20:27:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d601546e0 con 0x7f8d60070c00 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d656b1640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6014f650 con 0x7f8d60070c00 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540072f0 con 0x7f8d60070c00 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fcd0959a640 1 -- 172.21.15.81:0/849501561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040a5ac0 con 0x7fcd0c06b230 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fcd0959a640 1 -- 172.21.15.81:0/849501561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040a5e50 con 0x7fcd0c06b230 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fcd10a5d640 1 -- 172.21.15.81:0/849501561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 msgr2=0x7fcd0c0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.982+0000 7fcd10a5d640 1 --2- 172.21.15.81:0/849501561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c0c2800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0c2d40 tx=0x7fcd0401c8a0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d656b1640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d40000fd0 con 0x7f8d60070c00 2024-05-08T20:27:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fb7f4e25640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7dc0666c0 0x7fb7dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fb7f4e25640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7dc0666c0 0x7fb7dc068b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0153770 tx=0x7fb7e800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f0d83a59640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0a66f0 con 0x7f0d7c152f80 2024-05-08T20:27:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f0d83a59640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0a92e0 con 0x7f0d7c152f80 2024-05-08T20:27:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d58000fd0 con 0x7f0d7c152f80 2024-05-08T20:27:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d54007450 con 0x7f8d60070c00 2024-05-08T20:27:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fb7effff640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7fb7dc070ee0 0x7fb7dc073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 -- 172.21.15.81:0/849501561 shutdown_connections 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 --2- 172.21.15.81:0/849501561 >> v2:172.21.15.117:3300/0 conn(0x7fcd0c1519d0 0x7fcd0c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 --2- 172.21.15.81:0/849501561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c0c2800 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 -- 172.21.15.81:0/849501561 >> 172.21.15.81:0/849501561 conn(0x7fcd0c0c71b0 msgr2=0x7fcd0c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 -- 172.21.15.81:0/849501561 shutdown_connections 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d4c066760 0x7f8d4c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8d54084130 con 0x7f8d60070c00 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d5effd640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d4c066760 0x7f8d4c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d4c073ad0 con 0x7f8d4c071000 2024-05-08T20:27:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d540844e0 con 0x7f8d60070c00 2024-05-08T20:27:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0bb070 con 0x7fd1c80c31a0 2024-05-08T20:27:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0b65b0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d6c006940 con 0x7f0d7c152f80 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0d600666c0 0x7f0d60068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0d6c11ecf0 con 0x7f0d7c152f80 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f0d60070f60 0x7f0d60073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d60073a30 con 0x7f0d60070f60 2024-05-08T20:27:38.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6c11f0a0 con 0x7f0d7c152f80 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5effd640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d4c066760 0x7f8d4c068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b0000 tx=0x7f8d500a9000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5f7fe640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 msgr2=0x7f8d4c073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5f7fe640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 msgr2=0x7f8d4c073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d817f5640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0d600666c0 0x7f0d60068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d81ff6640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f0d60070f60 0x7f0d60073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d81ff6640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f0d60070f60 0x7f0d60073380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d817f5640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0d600666c0 0x7f0d60068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d780099c0 tx=0x7f0d78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== osd.1 v2:172.21.15.81:6807/27590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0d60073a30 con 0x7f0d60070f60 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fb7effff640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7fb7dc070ee0 0x7fb7dc073300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== osd.4 v2:172.21.15.117:6800/27738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb7dc0739b0 con 0x7fb7dc070ee0 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.986+0000 7fcd10a5d640 1 -- 172.21.15.81:0/849501561 wait complete. 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 Processor -- start 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 -- start start 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0c070c00 0x7fcd0c1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0c1519d0 0x7fcd0c1eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c53f0 con 0x7fcd0c06b230 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0c6750 con 0x7fcd0c070c00 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd10a5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c1f26e0 con 0x7fcd0c1519d0 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c1f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39066/0 (socket says 172.21.15.81:39066) 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 -- 172.21.15.81:0/270828111 learned_addr learned my addr 172.21.15.81:0/270828111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd09d9b640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0c070c00 0x7fcd0c1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0ad9d640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0c1519d0 0x7fcd0c1eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 -- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0c1519d0 msgr2=0x7fcd0c1eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0c1519d0 0x7fcd0c1eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 -- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0c070c00 msgr2=0x7fcd0c1f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd0c070c00 0x7fcd0c1f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04009a70 con 0x7fcd0c06b230 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fcd0a59c640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c1f5970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd0401a4d0 tx=0x7fcd04019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1cee1e640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c8151200 con 0x7fd1c80c31a0 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1cee1e640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c81f4c50 con 0x7fd1c80c31a0 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0b6940 con 0x7fd1c80c31a0 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.990+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1a0000fd0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04009450 con 0x7fcd0c06b230 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040adbd0 con 0x7fcd0c06b230 2024-05-08T20:27:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040b8420 con 0x7fcd0c06b230 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fcd10a5d640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0c6470 con 0x7fcd0c06b230 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fcd10a5d640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c1f5170 con 0x7fcd0c06b230 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fcd10a5d640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd0c14f1d0 con 0x7fcd0c06b230 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1bc0b6aa0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd1ac066790 0x7fd1ac068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fd1bc11f4f0 con 0x7fd1c80c31a0 2024-05-08T20:27:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7fd1ac070e40 0x7fd1ac073260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1ac073910 con 0x7fd1ac070e40 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1ccbba640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd1ac066790 0x7fd1ac068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1cd3bb640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7fd1ac070e40 0x7fd1ac073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1ccbba640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd1ac066790 0x7fd1ac068c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4006fd0 tx=0x7fd1b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1cd3bb640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7fd1ac070e40 0x7fd1ac073260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.994+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1bc0ec630 con 0x7fd1c80c31a0 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd040b8580 con 0x7fcd0c06b230 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fccec066690 0x7fccec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcd0411ff80 con 0x7fcd0c06b230 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7fccec070e30 0x7fccec073250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccec073900 con 0x7fccec070e30 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd041202f0 con 0x7fcd0c06b230 2024-05-08T20:27:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== osd.7 v2:172.21.15.117:6804/27740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd1ac073910 con 0x7fd1ac070e40 2024-05-08T20:27:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fcd09d9b640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fccec066690 0x7fccec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fcd0ad9d640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7fccec070e30 0x7fccec073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fcd09d9b640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fccec066690 0x7fccec068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c154d10 tx=0x7fccfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fcd0ad9d640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7fccec070e30 0x7fccec073250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 --> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f841504f0 con 0x7f1f68071000 2024-05-08T20:27:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:37.998+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== osd.6 v2:172.21.15.117:6824/27741 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fccec073900 con 0x7fccec070e30 2024-05-08T20:27:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f7affd640 1 -- 172.21.15.81:0/2814094050 <== osd.0 v2:172.21.15.81:6824/27589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f841504f0 con 0x7f1f68071000 2024-05-08T20:27:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 --> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f380816fdc0 con 0x7f37f4070fb0 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f1f68071000 msgr2=0x7f1f68073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f1f68071000 0x7f1f68073420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f68066760 msgr2=0x7f1f68068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f68066760 0x7f1f68068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f841521e0 tx=0x7f1f74009040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 msgr2=0x7f1f841f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8c3ba640 1 --2- 172.21.15.81:0/2814094050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f84072450 0x7f1f841f1910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c7f0 tx=0x7f1f7c00ccb0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f1f8a957640 1 -- 172.21.15.81:0/2814094050 reap_dead start 2024-05-08T20:27:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f3801ffb640 1 -- 172.21.15.81:0/2086691521 <== osd.3 v2:172.21.15.81:6800/27591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f380816fdc0 con 0x7f37f4070fb0 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f37f4070fb0 msgr2=0x7f37f40733d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f37f4070fb0 0x7f37f40733d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f37f4066790 msgr2=0x7f37f4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f37f4066790 0x7f37f4068c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3804006c00 tx=0x7f3804006b90 comp rx=0 tx=0).stop 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 msgr2=0x7f38080caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 --2- 172.21.15.81:0/2086691521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38080d5fd0 0x7f38080caa60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f380c0078d0 tx=0x7f380c012ac0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38158f1640 1 -- 172.21.15.81:0/2086691521 reap_dead start 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 shutdown_connections 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.002+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 >> 172.21.15.81:0/2086691521 conn(0x7f3808049340 msgr2=0x7f38080ddeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 shutdown_connections 2024-05-08T20:27:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f38160f2640 1 -- 172.21.15.81:0/2086691521 wait complete. 2024-05-08T20:27:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 shutdown_connections 2024-05-08T20:27:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 >> 172.21.15.81:0/2814094050 conn(0x7f1f8406a2f0 msgr2=0x7f1f8406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 shutdown_connections 2024-05-08T20:27:38.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.006+0000 7f1f8c3ba640 1 -- 172.21.15.81:0/2814094050 wait complete. 2024-05-08T20:27:38.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89f759e640 1 -- 172.21.15.81:0/449523842 --> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89f0036570 con 0x7f89d8070f00 2024-05-08T20:27:38.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e6ffd640 1 -- 172.21.15.81:0/449523842 <== osd.5 v2:172.21.15.117:6816/27739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f89e8001560 con 0x7f89d8070f00 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7f89d8070f00 msgr2=0x7f89d8073320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7f89d8070f00 0x7f89d8073320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89d80666e0 msgr2=0x7f89d8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89d80666e0 0x7f89d8068ba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0b7000 tx=0x7f89ec0af070 comp rx=0 tx=0).stop 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f004bfc0 msgr2=0x7f89f0180180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 --2- 172.21.15.81:0/449523842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f004bfc0 0x7f89f0180180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89f8063da0 tx=0x7f89f8067ba0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89f6d9d640 1 -- 172.21.15.81:0/449523842 reap_dead start 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.010+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 shutdown_connections 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.014+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 >> 172.21.15.81:0/449523842 conn(0x7f89f002f490 msgr2=0x7f89f00da8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.014+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 shutdown_connections 2024-05-08T20:27:38.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.014+0000 7f89e4ff9640 1 -- 172.21.15.81:0/449523842 wait complete. 2024-05-08T20:27:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.014+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 --> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7f015c260 con 0x7fb7dc070ee0 2024-05-08T20:27:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 --> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d58002cf0 con 0x7f0d60070f60 2024-05-08T20:27:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7ed7fa640 1 -- 172.21.15.81:0/241941865 <== osd.4 v2:172.21.15.117:6800/27738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7f015c260 con 0x7fb7dc070ee0 2024-05-08T20:27:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7fb7dc070ee0 msgr2=0x7fb7dc073300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7fb7dc070ee0 0x7fb7dc073300 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7f0d71ffb640 1 -- 172.21.15.81:0/3718153924 <== osd.1 v2:172.21.15.81:6807/27590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d58002cf0 con 0x7f0d60070f60 2024-05-08T20:27:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7dc0666c0 msgr2=0x7fb7dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7dc0666c0 0x7fb7dc068b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0153770 tx=0x7fb7e800d040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 msgr2=0x7fb7f014c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 --2- 172.21.15.81:0/241941865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7f0159c40 0x7fb7f014c470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c590 tx=0x7fb7e400ca50 comp rx=0 tx=0).stop 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f5626640 1 -- 172.21.15.81:0/241941865 reap_dead start 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 shutdown_connections 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 >> 172.21.15.81:0/241941865 conn(0x7fb7f00abe20 msgr2=0x7fb7f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 shutdown_connections 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.018+0000 7fb7f7089640 1 -- 172.21.15.81:0/241941865 wait complete. 2024-05-08T20:27:38.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f0d60070f60 msgr2=0x7f0d60073380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fcd10a5d640 1 -- 172.21.15.81:0/270828111 --> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd0c1473d0 con 0x7fccec070e30 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f0d60070f60 0x7f0d60073380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0d600666c0 msgr2=0x7f0d60068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0d600666c0 0x7f0d60068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d780099c0 tx=0x7f0d78008040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 msgr2=0x7f0d7c1f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 --2- 172.21.15.81:0/3718153924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c152f80 0x7f0d7c1f2330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c005040 tx=0x7f0d68003700 comp rx=0 tx=0).stop 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d81ff6640 1 -- 172.21.15.81:0/3718153924 reap_dead start 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 shutdown_connections 2024-05-08T20:27:38.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 >> 172.21.15.81:0/3718153924 conn(0x7f0d7c0c68c0 msgr2=0x7f0d7c150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 shutdown_connections 2024-05-08T20:27:38.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7f0d5f7fe640 1 -- 172.21.15.81:0/3718153924 wait complete. 2024-05-08T20:27:38.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccfaffd640 1 -- 172.21.15.81:0/270828111 <== osd.6 v2:172.21.15.117:6824/27741 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd0c1473d0 con 0x7fccec070e30 2024-05-08T20:27:38.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 --> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1a0002cc0 con 0x7fd1ac070e40 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7fccec070e30 msgr2=0x7fccec073250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7fccec070e30 0x7fccec073250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fccec066690 msgr2=0x7fccec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fccec066690 0x7fccec068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c154d10 tx=0x7fccfc009040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 msgr2=0x7fcd0c1f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 --2- 172.21.15.81:0/270828111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd0c06b230 0x7fcd0c1f5970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd0401a4d0 tx=0x7fcd04019640 comp rx=0 tx=0).stop 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fcd0ad9d640 1 -- 172.21.15.81:0/270828111 reap_dead start 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 shutdown_connections 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 >> 172.21.15.81:0/270828111 conn(0x7fcd0c0c71b0 msgr2=0x7fcd0c14ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 shutdown_connections 2024-05-08T20:27:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.022+0000 7fccf8ff9640 1 -- 172.21.15.81:0/270828111 wait complete. 2024-05-08T20:27:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.026+0000 7fd1c57fa640 1 -- 172.21.15.81:0/3118873788 <== osd.7 v2:172.21.15.117:6804/27740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1a0002cc0 con 0x7fd1ac070e40 2024-05-08T20:27:38.070 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-05-08T20:27:38.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.030+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7fd1ac070e40 msgr2=0x7fd1ac073260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.030+0000 7fd1b2ffd640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7fd1ac070e40 0x7fd1ac073260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd1ac066790 msgr2=0x7fd1ac068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd1ac066790 0x7fd1ac068c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4006fd0 tx=0x7fd1b4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c80c31a0 msgr2=0x7fd1c81f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 --2- 172.21.15.81:0/3118873788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1c80c31a0 0x7fd1c81f1560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0ac000 tx=0x7fd1bc019320 comp rx=0 tx=0).stop 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1cd3bb640 1 -- 172.21.15.81:0/3118873788 reap_dead start 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 shutdown_connections 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 >> 172.21.15.81:0/3118873788 conn(0x7fd1c80c71b0 msgr2=0x7fd1c8072240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 shutdown_connections 2024-05-08T20:27:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.034+0000 7fd1b2ffd640 1 -- 172.21.15.81:0/3118873788 wait complete. 2024-05-08T20:27:38.073 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:38.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T20:27:38.074 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-05-08T20:27:38.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:27:38.075 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:38.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T20:27:38.076 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-05-08T20:27:38.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T20:27:38.077 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-05-08T20:27:38.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T20:27:38.078 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:38.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:27:38.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.194+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.194+0000 7f8d5f7fe640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.194+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== osd.2 v2:172.21.15.81:6816/27592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8d4c073ad0 con 0x7f8d4c071000 2024-05-08T20:27:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d656b1640 1 -- 172.21.15.81:0/2103577623 --> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d40002cc0 con 0x7f8d4c071000 2024-05-08T20:27:38.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d477fe640 1 -- 172.21.15.81:0/2103577623 <== osd.2 v2:172.21.15.81:6816/27592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d40002cc0 con 0x7f8d4c071000 2024-05-08T20:27:38.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 msgr2=0x7f8d4c073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d457fa640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f8d4c071000 0x7f8d4c073420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d4c066760 msgr2=0x7f8d4c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.222+0000 7f8d457fa640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8d4c066760 0x7f8d4c068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b0000 tx=0x7f8d500a9000 comp rx=0 tx=0).stop 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 msgr2=0x7f8d60154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 --2- 172.21.15.81:0/2103577623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d60070c00 0x7f8d60154ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400c500 tx=0x7f8d5400c9c0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d5f7fe640 1 -- 172.21.15.81:0/2103577623 reap_dead start 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 shutdown_connections 2024-05-08T20:27:38.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 >> 172.21.15.81:0/2103577623 conn(0x7f8d600c71b0 msgr2=0x7f8d6014e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 shutdown_connections 2024-05-08T20:27:38.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.226+0000 7f8d457fa640 1 -- 172.21.15.81:0/2103577623 wait complete. 2024-05-08T20:27:38.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 Processor -- start 2024-05-08T20:27:38.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 -- start start 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94900bf160 0x7f94901545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94900bdb80 con 0x7f94900a9830 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94900bd590 con 0x7f949014ddd0 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f9495923640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9490154b10 con 0x7f94900bf160 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948effd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f949014ddd0 0x7f94900bea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-05-08T20:27:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948effd640 1 -- 172.21.15.81:0/1688297523 learned_addr learned my addr 172.21.15.81:0/1688297523 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94900bf160 0x7f94901545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948f7fe640 1 -- 172.21.15.81:0/1688297523 >> v1:172.21.15.117:6789/0 conn(0x7f949014ddd0 legacy=0x7f94900bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948f7fe640 1 -- 172.21.15.81:0/1688297523 >> v1:172.21.15.81:6789/0 conn(0x7f94900a9830 legacy=0x7f9490153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.242+0000 7f948f7fe640 1 -- 172.21.15.81:0/1688297523 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900ab060 con 0x7f94900bf160 2024-05-08T20:27:38.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.246+0000 7f948f7fe640 1 --2- 172.21.15.81:0/1688297523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900bf160 0x7f94901545d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f94840097c0 tx=0x7f948401c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1e7a214351415d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.246+0000 7f948dffb640 1 -- 172.21.15.81:0/1688297523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840ab600 con 0x7f94900bf160 2024-05-08T20:27:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.246+0000 7f948dffb640 1 -- 172.21.15.81:0/1688297523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840a7050 con 0x7f94900bf160 2024-05-08T20:27:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.246+0000 7f948dffb640 1 -- 172.21.15.81:0/1688297523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840ab980 con 0x7f94900bf160 2024-05-08T20:27:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 -- 172.21.15.81:0/1688297523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900bf160 msgr2=0x7f94901545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 --2- 172.21.15.81:0/1688297523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900bf160 0x7f94901545d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f94840097c0 tx=0x7f948401c1e0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 -- 172.21.15.81:0/1688297523 shutdown_connections 2024-05-08T20:27:38.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 --2- 172.21.15.81:0/1688297523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900bf160 0x7f94901545d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 -- 172.21.15.81:0/1688297523 >> 172.21.15.81:0/1688297523 conn(0x7f94900c3e00 msgr2=0x7f94900c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 -- 172.21.15.81:0/1688297523 shutdown_connections 2024-05-08T20:27:38.259 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-05-08T20:27:38.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:27:38.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.250+0000 7f9495923640 1 -- 172.21.15.81:0/1688297523 wait complete. 2024-05-08T20:27:38.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 Processor -- start 2024-05-08T20:27:38.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 -- start start 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 0x7f94901ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 0x7f9490149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901f9ed0 con 0x7f94900a9830 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901f8c60 con 0x7f94900bf160 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f9495923640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94901fa120 con 0x7f949014ddd0 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39080/0 (socket says 172.21.15.81:39080) 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948effd640 1 -- 172.21.15.81:0/679208011 learned_addr learned my addr 172.21.15.81:0/679208011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 0x7f9490149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948e7fc640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 0x7f94901ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 -- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 msgr2=0x7f94901ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 0x7f94901ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 -- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 msgr2=0x7f9490149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948f7fe640 1 -- 172.21.15.81:0/679208011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009420 con 0x7f949014ddd0 2024-05-08T20:27:38.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948e7fc640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 0x7f94901ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:38.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.254+0000 7f948effd640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f948f7fe640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 0x7f9490149220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f94840ab000 tx=0x7f948401aa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840aa970 con 0x7f949014ddd0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840aaad0 con 0x7f949014ddd0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840aae80 con 0x7f949014ddd0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9495923640 1 -- 172.21.15.81:0/679208011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94901fa400 con 0x7f949014ddd0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9495923640 1 -- 172.21.15.81:0/679208011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94901fa9c0 con 0x7f949014ddd0 2024-05-08T20:27:38.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9495923640 1 -- 172.21.15.81:0/679208011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900747d0 con 0x7f949014ddd0 2024-05-08T20:27:38.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94840b7450 con 0x7f949014ddd0 2024-05-08T20:27:38.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.258+0000 7f9477fff640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 0x7f947c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.262+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f948411f7f0 con 0x7f949014ddd0 2024-05-08T20:27:38.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.262+0000 7f948effd640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 0x7f947c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.262+0000 7f948effd640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 0x7f947c068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9488000f90 tx=0x7f9488001930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.270+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f94840eca50 con 0x7f949014ddd0 2024-05-08T20:27:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 Processor -- start 2024-05-08T20:27:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 -- start start 2024-05-08T20:27:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbff4156430 0x7fbff406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40706d0 con 0x7fbff406d7d0 2024-05-08T20:27:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff41598f0 con 0x7fbff40c31a0 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff99ea640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4158df0 con 0x7fbff4156430 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbff4156430 0x7fbff406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbfebfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbff406d7d0 0x7fbff4071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53688/0 (socket says 172.21.15.81:53688) 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbfebfff640 1 -- 172.21.15.81:0/1631384741 learned_addr learned my addr 172.21.15.81:0/1631384741 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff27fc640 1 -- 172.21.15.81:0/1631384741 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865193161 0 0) 0x7fbfdc001120 con 0x7fbff406d7d0 2024-05-08T20:27:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff27fc640 1 -- 172.21.15.81:0/1631384741 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd4003530 con 0x7fbff406d7d0 2024-05-08T20:27:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fee6d372640 1 Processor -- start 2024-05-08T20:27:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff2ffd640 1 -- 172.21.15.81:0/1631384741 >> v1:172.21.15.117:6789/0 conn(0x7fbff40c31a0 legacy=0x7fbff4163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff2ffd640 1 -- 172.21.15.81:0/1631384741 >> v1:172.21.15.81:6789/0 conn(0x7fbff406d7d0 legacy=0x7fbff4071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fbff2ffd640 1 -- 172.21.15.81:0/1631384741 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4159000 con 0x7fbff4156430 2024-05-08T20:27:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 Processor -- start 2024-05-08T20:27:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.278+0000 7fee6d372640 1 -- start start 2024-05-08T20:27:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee6d372640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee680aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee6d372640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee681516f0 0x7fee680c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee6d372640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68150c50 con 0x7fee6814e1c0 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee6d372640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680aa8c0 con 0x7fee681516f0 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee6d372640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68150ef0 con 0x7fee680c2800 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee66ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee6814e1c0 0x7fee68151f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53698/0 (socket says 172.21.15.81:53698) 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee66ffd640 1 -- 172.21.15.81:0/4223689611 learned_addr learned my addr 172.21.15.81:0/4223689611 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee667fc640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee680aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee677fe640 1 --2- 172.21.15.81:0/4223689611 >> v2:172.21.15.81:3300/0 conn(0x7fee681516f0 0x7fee680c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee677fe640 1 -- 172.21.15.81:0/4223689611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 msgr2=0x7fee680aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee677fe640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee680aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee677fe640 1 -- 172.21.15.81:0/4223689611 >> v1:172.21.15.81:6789/0 conn(0x7fee6814e1c0 legacy=0x7fee68151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fee677fe640 1 -- 172.21.15.81:0/4223689611 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee681511d0 con 0x7fee681516f0 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fbff2ffd640 1 --2- 172.21.15.81:0/1631384741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff4156430 0x7fbff406d290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40097c0 tx=0x7fbfe401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08ef0dfae96c166 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fbff27fc640 1 -- 172.21.15.81:0/1631384741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40ab600 con 0x7fbff4156430 2024-05-08T20:27:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 -- start start 2024-05-08T20:27:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 Processor -- start 2024-05-08T20:27:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fbff27fc640 1 -- 172.21.15.81:0/1631384741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40a7050 con 0x7fbff4156430 2024-05-08T20:27:38.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fbff27fc640 1 -- 172.21.15.81:0/1631384741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40ab980 con 0x7fbff4156430 2024-05-08T20:27:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb1804a9c0 0x7fcb1804ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb180db120 0x7fcb180d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180d76a0 con 0x7fcb18047220 2024-05-08T20:27:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180476b0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb26ab0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb18047990 con 0x7fcb180db120 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb252ad640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcb18047220 0x7fcb18007ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45550/0 (socket says 172.21.15.81:45550) 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb252ad640 1 -- 172.21.15.81:0/359690758 learned_addr learned my addr 172.21.15.81:0/359690758 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb262af640 1 --2- 172.21.15.81:0/359690758 >> v2:172.21.15.117:3300/0 conn(0x7fcb180db120 0x7fcb180d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 -- start start 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c30138fa0 0x7f3c300aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c30150fe0 con 0x7f3c30150790 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c301512c0 con 0x7f3c300a9be0 2024-05-08T20:27:38.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c34e9b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300a94b0 con 0x7f3c30138fa0 2024-05-08T20:27:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f1cbc983640 1 Processor -- start 2024-05-08T20:27:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f1cbc983640 1 -- start start 2024-05-08T20:27:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb24aac640 1 -- 172.21.15.81:0/359690758 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280646978 0 0) 0x7fcb180d76a0 con 0x7fcb18047220 2024-05-08T20:27:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb24aac640 1 -- 172.21.15.81:0/359690758 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0c003530 con 0x7fcb18047220 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c2ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3c300a9be0 0x7f3c3015b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45558/0 (socket says 172.21.15.81:45558) 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3360146344 learned_addr learned my addr 172.21.15.81:0/3360146344 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb262af640 1 -- 172.21.15.81:0/359690758 >> v2:172.21.15.81:3300/0 conn(0x7fcb1804a9c0 msgr2=0x7fcb1804ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb262af640 1 --2- 172.21.15.81:0/359690758 >> v2:172.21.15.81:3300/0 conn(0x7fcb1804a9c0 0x7fcb1804ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb262af640 1 -- 172.21.15.81:0/359690758 >> v1:172.21.15.117:6789/0 conn(0x7fcb18047220 legacy=0x7fcb18007ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7fcb262af640 1 -- 172.21.15.81:0/359690758 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18047c70 con 0x7fcb180db120 2024-05-08T20:27:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279139174 0 0) 0x7f3c301512c0 con 0x7f3c300a9be0 2024-05-08T20:27:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.282+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c18003530 con 0x7f3c300a9be0 2024-05-08T20:27:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599748293 0 0) 0x7f3c18003530 con 0x7f3c300a9be0 2024-05-08T20:27:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 >> v2:172.21.15.81:3300/0 conn(0x7f3c30138fa0 msgr2=0x7f3c300aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 --2- 172.21.15.81:0/3360146344 >> v2:172.21.15.81:3300/0 conn(0x7f3c30138fa0 0x7f3c300aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 >> v1:172.21.15.81:6789/0 conn(0x7f3c30150790 legacy=0x7f3c300c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c301515a0 con 0x7f3c300a9be0 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3c28001a00 con 0x7f3c300a9be0 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 >> v1:172.21.15.117:6789/0 conn(0x7f3c300a9be0 legacy=0x7f3c3015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18003980 0x7f3c18003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c180047d0 0x7f3c18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 0x7f3c1800b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300a94b0 con 0x7f3c180047d0 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1800c2d0 con 0x7f3c18003980 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1800c490 con 0x7f3c18005390 2024-05-08T20:27:38.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- 172.21.15.81:0/1631384741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff4156430 msgr2=0x7fbff406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 --2- 172.21.15.81:0/1631384741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff4156430 0x7fbff406d290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40097c0 tx=0x7fbfe401c4c0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cbc983640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cbc983640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cbc983640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb80aa450 con 0x7f1cb814e9f0 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cbc983640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb8154a30 con 0x7f1cb80ab2b0 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cbc983640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8154c40 con 0x7f1cb80bfb10 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39136/0 (socket says 172.21.15.81:39136) 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 -- 172.21.15.81:0/2347018081 learned_addr learned my addr 172.21.15.81:0/2347018081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb6d9d640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fee677fe640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee681516f0 0x7fee680c1bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee60009d90 tx=0x7fee6001c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb53d2608b0e068 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 0x7f3c1800b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- 172.21.15.81:0/1631384741 shutdown_connections 2024-05-08T20:27:38.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 --2- 172.21.15.81:0/1631384741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff4156430 0x7fbff406d290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- 172.21.15.81:0/1631384741 >> 172.21.15.81:0/1631384741 conn(0x7fbff40c71b0 msgr2=0x7fbff40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2effd640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c180047d0 0x7f3c18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- 172.21.15.81:0/1631384741 shutdown_connections 2024-05-08T20:27:38.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- 172.21.15.81:0/1631384741 wait complete. 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18003980 msgr2=0x7f3c18003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18003980 0x7f3c18003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3360146344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c180047d0 msgr2=0x7f3c18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c180047d0 0x7f3c18004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3360146344 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c301515a0 con 0x7f3c18005390 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 -- 172.21.15.81:0/2347018081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 msgr2=0x7f1cb815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 -- 172.21.15.81:0/2347018081 >> v1:172.21.15.117:6789/0 conn(0x7f1cb814e9f0 legacy=0x7f1cb80c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f1cb5d9b640 1 -- 172.21.15.81:0/2347018081 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8154f20 con 0x7f1cb80ab2b0 2024-05-08T20:27:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7f3c2effd640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c180047d0 0x7f3c18004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fcb262af640 1 --2- 172.21.15.81:0/359690758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb180db120 0x7fcb180d7b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb20063c00 tx=0x7fcb20096e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dacf3d94cc6e7d01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fcb24aac640 1 -- 172.21.15.81:0/359690758 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2011fcc0 con 0x7fcb180db120 2024-05-08T20:27:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fcb24aac640 1 -- 172.21.15.81:0/359690758 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2011fe60 con 0x7fcb180db120 2024-05-08T20:27:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fcb24aac640 1 -- 172.21.15.81:0/359690758 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20127640 con 0x7fcb180db120 2024-05-08T20:27:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 Processor -- start 2024-05-08T20:27:38.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.286+0000 7fbff99ea640 1 -- start start 2024-05-08T20:27:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee65ffb640 1 -- 172.21.15.81:0/4223689611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a5790 con 0x7fee681516f0 2024-05-08T20:27:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee65ffb640 1 -- 172.21.15.81:0/4223689611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600a58f0 con 0x7fee681516f0 2024-05-08T20:27:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3360146344 reap_dead start 2024-05-08T20:27:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cb5d9b640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190a8a5521d6188e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 0x7f3c1800b9f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c28005450 tx=0x7f3c2801d060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc367162e3f70e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cb559a640 1 -- 172.21.15.81:0/2347018081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80ab650 con 0x7f1cb80ab2b0 2024-05-08T20:27:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cb559a640 1 -- 172.21.15.81:0/2347018081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca80ab7b0 con 0x7f1cb80ab2b0 2024-05-08T20:27:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cb559a640 1 -- 172.21.15.81:0/2347018081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80abb40 con 0x7f1cb80ab2b0 2024-05-08T20:27:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40c31a0 0x7fbff4069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbff4156430 0x7fbff406a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff406a940 con 0x7fbff406d7d0 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff414c760 con 0x7fbff40c31a0 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff99ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41f1c00 con 0x7fbff4156430 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39162/0 (socket says 172.21.15.81:39162) 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 -- 172.21.15.81:0/2821222077 learned_addr learned my addr 172.21.15.81:0/2821222077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbfebfff640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40c31a0 0x7fbff4069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff37fe640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbff4156430 0x7fbff406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- 172.21.15.81:0/4223689611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee681516f0 msgr2=0x7fee680c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee681516f0 0x7fee680c1bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee60009d90 tx=0x7fee6001c7d0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- 172.21.15.81:0/4223689611 shutdown_connections 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee681516f0 0x7fee680c1bb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 --2- 172.21.15.81:0/4223689611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee680aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- 172.21.15.81:0/4223689611 >> 172.21.15.81:0/4223689611 conn(0x7fee680c2ca0 msgr2=0x7fee680c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- 172.21.15.81:0/4223689611 shutdown_connections 2024-05-08T20:27:38.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- 172.21.15.81:0/4223689611 wait complete. 2024-05-08T20:27:38.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 -- 172.21.15.81:0/2347018081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb80ab2b0 msgr2=0x7f1cb80bf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c5a0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 -- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbff4156430 msgr2=0x7fbff406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbff4156430 0x7fbff406a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 -- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40c31a0 msgr2=0x7fbff4069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40c31a0 0x7fbff4069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 -- 172.21.15.81:0/2821222077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4009420 con 0x7fbff406d7d0 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 -- 172.21.15.81:0/2347018081 shutdown_connections 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 --2- 172.21.15.81:0/2347018081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb80ab2b0 0x7f1cb80bf5d0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c5a0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 -- 172.21.15.81:0/2347018081 >> 172.21.15.81:0/2347018081 conn(0x7f1cb80c2ca0 msgr2=0x7f1cb80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28008270 con 0x7f3c18005390 2024-05-08T20:27:38.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 -- 172.21.15.81:0/2347018081 shutdown_connections 2024-05-08T20:27:38.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280a5b60 con 0x7f3c18005390 2024-05-08T20:27:38.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c2e7fc640 1 -- 172.21.15.81:0/3360146344 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280064f0 con 0x7f3c18005390 2024-05-08T20:27:38.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 msgr2=0x7f3c1800b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 0x7f3c1800b9f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c28005450 tx=0x7f3c2801d060 comp rx=0 tx=0).stop 2024-05-08T20:27:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 -- 172.21.15.81:0/2347018081 wait complete. 2024-05-08T20:27:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3360146344 shutdown_connections 2024-05-08T20:27:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3360146344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c18005390 0x7f3c1800b9f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3360146344 >> 172.21.15.81:0/3360146344 conn(0x7f3c300c2a90 msgr2=0x7f3c300c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3360146344 shutdown_connections 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 -- 172.21.15.81:0/359690758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb180db120 msgr2=0x7fcb180d7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/359690758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb180db120 0x7fcb180d7b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb20063c00 tx=0x7fcb20096e90 comp rx=0 tx=0).stop 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 -- 172.21.15.81:0/359690758 shutdown_connections 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/359690758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb180db120 0x7fcb180d7b30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/359690758 >> v2:172.21.15.81:3300/0 conn(0x7fcb1804a9c0 0x7fcb1804ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 -- 172.21.15.81:0/359690758 >> 172.21.15.81:0/359690758 conn(0x7fcb18049320 msgr2=0x7fcb18049730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 -- 172.21.15.81:0/359690758 shutdown_connections 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3360146344 wait complete. 2024-05-08T20:27:38.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f3c34e9b640 1 Processor -- start 2024-05-08T20:27:38.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fbff2ffd640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40190d0 tx=0x7fbfe4019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fcb26ab0640 1 -- 172.21.15.81:0/359690758 wait complete. 2024-05-08T20:27:38.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 Processor -- start 2024-05-08T20:27:38.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7fee6d372640 1 -- start start 2024-05-08T20:27:38.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 Processor -- start 2024-05-08T20:27:38.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.290+0000 7f1cbc983640 1 Processor -- start 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee6814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6814e1c0 0x7fee6806c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6814e920 con 0x7fee6814e1c0 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c4110 con 0x7fee6814d600 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee6d372640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c3e30 con 0x7fee680c2800 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33344/0 (socket says 172.21.15.81:33344) 2024-05-08T20:27:38.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 -- 172.21.15.81:0/12655849 learned_addr learned my addr 172.21.15.81:0/12655849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40b4610 con 0x7fbff406d7d0 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 -- start start 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cb814e9f0 0x7f1cb8148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb814d350 0x7f1cb81489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8072060 con 0x7f1cb814d350 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8157070 con 0x7f1cb814e9f0 2024-05-08T20:27:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cbc983640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8070a70 con 0x7f1cb80bfb10 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 -- start start 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180db120 0x7fcb1802d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb180d6cc0 0x7fcb1817f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18043fd0 con 0x7fcb180db120 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181833f0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb26ab0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18043a10 con 0x7fcb180d6cc0 2024-05-08T20:27:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35428/0 (socket says 172.21.15.81:35428) 2024-05-08T20:27:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 -- 172.21.15.81:0/4203685841 learned_addr learned my addr 172.21.15.81:0/4203685841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33360/0 (socket says 172.21.15.81:33360) 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 -- 172.21.15.81:0/1714793441 learned_addr learned my addr 172.21.15.81:0/1714793441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb262af640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb180d6cc0 0x7fcb1817f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 -- start start 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 0x7f3c30147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c300c5870 0x7f3c30132690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 0x7f3c30136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c5400 con 0x7f3c300c5870 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c30147340 con 0x7f3c18005390 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c34e9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301475e0 con 0x7f3c30132bd0 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee66ffd640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee6814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff41f1ee0 con 0x7fbff406d7d0 2024-05-08T20:27:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff41f24a0 con 0x7fbff406d7d0 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c2f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 0x7f3c30147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c2f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 0x7f3c30147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33362/0 (socket says 172.21.15.81:33362) 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c2f7fe640 1 -- 172.21.15.81:0/3369239515 learned_addr learned my addr 172.21.15.81:0/3369239515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 -- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cb814e9f0 msgr2=0x7f1cb8148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cb814e9f0 0x7f1cb8148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 -- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb814d350 msgr2=0x7f1cb81489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb814d350 0x7f1cb81489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 -- 172.21.15.81:0/4203685841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80094d0 con 0x7f1cb80bfb10 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40b4770 con 0x7fbff406d7d0 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 -- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb180d6cc0 msgr2=0x7fcb1817f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb180d6cc0 0x7fcb1817f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 -- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180db120 msgr2=0x7fcb1802d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180db120 0x7fcb1802d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 -- 172.21.15.81:0/1714793441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20072040 con 0x7fcb1804a9c0 2024-05-08T20:27:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40b4ae0 con 0x7fbff406d7d0 2024-05-08T20:27:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f1cb659c640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c530 tx=0x7f1cac00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb25aae640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000b550 tx=0x7fcb1000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfe40b2040 con 0x7fbff406d7d0 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 0x7f3c30136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 -- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 msgr2=0x7fee6814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee6814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 -- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6814e1c0 msgr2=0x7fee6806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6814e1c0 0x7fee6806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fee677fe640 1 -- 172.21.15.81:0/12655849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009a70 con 0x7fee6814d600 2024-05-08T20:27:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.294+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10010870 con 0x7fcb1804a9c0 2024-05-08T20:27:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180d4bd0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 Processor -- start 2024-05-08T20:27:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fbff0ff9640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 0x7fbfd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fbfe411e6a0 con 0x7fbff406d7d0 2024-05-08T20:27:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2effd640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c300c5870 0x7f3c30132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fbfebfff640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 0x7fbfd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac005220 con 0x7f1cb80bfb10 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac005380 con 0x7f1cb80bfb10 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac007270 con 0x7f1cb80bfb10 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee677fe640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee6001ae80 tx=0x7fee60019570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 msgr2=0x7f3c30147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 0x7f3c30147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c300c5870 msgr2=0x7f3c30132690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c300c5870 0x7f3c30132690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 -- 172.21.15.81:0/3369239515 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300c4db0 con 0x7f3c30132bd0 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb8071ac0 con 0x7f1cb80bfb10 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb80717a0 con 0x7f1cb80bfb10 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a5ea0 con 0x7fee6814d600 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600ad850 con 0x7fee6814d600 2024-05-08T20:27:38.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600adbe0 con 0x7fee6814d600 2024-05-08T20:27:38.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fbfebfff640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 0x7fbfd8068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbff4158bb0 tx=0x7fbfdc007bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f3c2ffff640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 0x7f3c30136860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006ae60 tx=0x7f3c18005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 -- start start 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80c1596e0 0x7ff80c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c071fe0 con 0x7ff80c06e010 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c15c460 con 0x7ff80c0c3530 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff8138a1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c070860 con 0x7ff80c1596e0 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff81163d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff80c0c3530 0x7ff80c06aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45580/0 (socket says 172.21.15.81:45580) 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff81163d640 1 -- 172.21.15.81:0/1317631855 learned_addr learned my addr 172.21.15.81:0/1317631855 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1802d800 con 0x7fcb1804a9c0 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180e0d00 con 0x7fcb1804a9c0 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100109f0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10010da0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb8070840 con 0x7f1cb80bfb10 2024-05-08T20:27:38.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff811e3e640 1 --2- 172.21.15.81:0/1317631855 >> v2:172.21.15.117:3300/0 conn(0x7ff80c1596e0 0x7ff80c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee681edc00 con 0x7fee6814d600 2024-05-08T20:27:38.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6806c6c0 con 0x7fee6814d600 2024-05-08T20:27:38.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff811e3e640 1 -- 172.21.15.81:0/1317631855 >> v1:172.21.15.117:6789/0 conn(0x7ff80c0c3530 legacy=0x7ff80c06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff811e3e640 1 -- 172.21.15.81:0/1317631855 >> v1:172.21.15.81:6789/0 conn(0x7ff80c06e010 legacy=0x7ff80c071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7ff811e3e640 1 -- 172.21.15.81:0/1317631855 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c15c740 con 0x7ff80c1596e0 2024-05-08T20:27:38.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.298+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee680c3f70 con 0x7fee6814d600 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb10023480 con 0x7fcb1804a9c0 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7fcb167fc640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 0x7fcb04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcb10084790 con 0x7fcb1804a9c0 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cac0073d0 con 0x7f1cb80bfb10 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7f1ca6ffd640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 0x7f1c98068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1cac083f50 con 0x7f1cb80bfb10 2024-05-08T20:27:38.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7f1cb5d9b640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 0x7f1c98068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7fcb252ad640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 0x7fcb04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7fcb252ad640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 0x7fcb04068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c007fd0 tx=0x7fcb1c007940 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7f1cb5d9b640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 0x7f1c98068ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80af000 tx=0x7f1ca8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.302+0000 7ff811e3e640 1 --2- 172.21.15.81:0/1317631855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c1596e0 0x7ff80c071aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff804009d90 tx=0x7ff80401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acaf91ffc27aff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280019c0 con 0x7f3c30132bd0 2024-05-08T20:27:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28001fc0 con 0x7f3c30132bd0 2024-05-08T20:27:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280082c0 con 0x7f3c30132bd0 2024-05-08T20:27:38.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c300c5090 con 0x7f3c30132bd0 2024-05-08T20:27:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30133060 con 0x7f3c30132bd0 2024-05-08T20:27:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc005260 con 0x7fbff406d7d0 2024-05-08T20:27:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.306+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c30137560 con 0x7f3c30132bd0 2024-05-08T20:27:38.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.310+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbfe40eb780 con 0x7fbff406d7d0 2024-05-08T20:27:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcb10055480 con 0x7fcb1804a9c0 2024-05-08T20:27:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1cac051100 con 0x7f1cb80bfb10 2024-05-08T20:27:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c280058e0 con 0x7f3c30132bd0 2024-05-08T20:27:38.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f3c17fff640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 0x7f3c1c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee600b4070 con 0x7fee6814d600 2024-05-08T20:27:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7fee4f7fe640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 0x7fee54068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fee6011f220 con 0x7fee6814d600 2024-05-08T20:27:38.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f3c2f7fe640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 0x7f3c1c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f3c2f7fe640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 0x7f3c1c068bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c200099f0 tx=0x7f3c20009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3c2811e5c0 con 0x7f3c30132bd0 2024-05-08T20:27:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.314+0000 7fee66ffd640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 0x7fee54068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7fee66ffd640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 0x7fee54068c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f70 tx=0x7fee5c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff803fff640 1 -- 172.21.15.81:0/1317631855 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040a5860 con 0x7ff80c1596e0 2024-05-08T20:27:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff803fff640 1 -- 172.21.15.81:0/1317631855 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8040a59c0 con 0x7ff80c1596e0 2024-05-08T20:27:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 -- 172.21.15.81:0/1317631855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c1596e0 msgr2=0x7ff80c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 --2- 172.21.15.81:0/1317631855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c1596e0 0x7ff80c071aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff804009d90 tx=0x7ff80401c800 comp rx=0 tx=0).stop 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 -- 172.21.15.81:0/1317631855 shutdown_connections 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 --2- 172.21.15.81:0/1317631855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c1596e0 0x7ff80c071aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 -- 172.21.15.81:0/1317631855 >> 172.21.15.81:0/1317631855 conn(0x7ff80c0c7a90 msgr2=0x7ff80c0c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 -- 172.21.15.81:0/1317631855 shutdown_connections 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.318+0000 7ff8138a1640 1 -- 172.21.15.81:0/1317631855 wait complete. 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 Processor -- start 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 -- start start 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80c06e010 0x7ff80c14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c158f60 con 0x7ff80c1596e0 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1ef0e0 con 0x7ff80c0c3530 2024-05-08T20:27:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff8138a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1eedb0 con 0x7ff80c06e010 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff811e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff81163d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80c06e010 0x7ff80c14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff811e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39214/0 (socket says 172.21.15.81:39214) 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33380/0 (socket says 172.21.15.81:33380) 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 -- 172.21.15.81:0/2142403716 learned_addr learned my addr 172.21.15.81:0/2142403716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 -- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80c06e010 msgr2=0x7ff80c14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80c06e010 0x7ff80c14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 -- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 msgr2=0x7ff80c1eb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 -- 172.21.15.81:0/2142403716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009a70 con 0x7ff80c0c3530 2024-05-08T20:27:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff811e3e640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.322+0000 7ff810e3c640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009e00 tx=0x7ff7fc00c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3c280eb820 con 0x7f3c30132bd0 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00cdb0 con 0x7ff80c0c3530 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc004020 con 0x7ff80c0c3530 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff8138a1640 1 -- 172.21.15.81:0/2142403716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c15bf00 con 0x7ff80c0c3530 2024-05-08T20:27:38.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc004410 con 0x7ff80c0c3530 2024-05-08T20:27:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fee600ec380 con 0x7fee6814d600 2024-05-08T20:27:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff8138a1640 1 -- 172.21.15.81:0/2142403716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c14fb00 con 0x7ff80c0c3530 2024-05-08T20:27:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.326+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c0747d0 con 0x7ff80c0c3530 2024-05-08T20:27:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.334+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7fc0087f0 con 0x7ff80c0c3530 2024-05-08T20:27:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.334+0000 7ff801ffb640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 0x7ff7f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.334+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff7fc086e60 con 0x7ff80c0c3530 2024-05-08T20:27:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.334+0000 7ff81163d640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 0x7ff7f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.334+0000 7ff81163d640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 0x7ff7f0068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff808005890 tx=0x7ff808009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.342+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff7fc053f40 con 0x7ff80c0c3530 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.414+0000 7f393103a640 1 Processor -- start 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.414+0000 7f393103a640 1 -- start start 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 0x7f392c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f392c0a94b0 0x7f392c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f392c15c120 0x7f392c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c1530a0 con 0x7f392c15c120 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0bc900 con 0x7f392c0a94b0 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f393103a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0725d0 con 0x7f392c152cc0 2024-05-08T20:27:38.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f392c15c120 0x7f392c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f392c15c120 0x7f392c15c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39226/0 (socket says 172.21.15.81:39226) 2024-05-08T20:27:38.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 -- 172.21.15.81:0/329510961 learned_addr learned my addr 172.21.15.81:0/329510961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392a59c640 1 --2- 172.21.15.81:0/329510961 >> v2:172.21.15.117:3300/0 conn(0x7f392c0a94b0 0x7f392c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392ad9d640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 0x7f392c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 -- 172.21.15.81:0/329510961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 msgr2=0x7f392c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 0x7f392c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 -- 172.21.15.81:0/329510961 >> v2:172.21.15.117:3300/0 conn(0x7f392c0a94b0 msgr2=0x7f392c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 --2- 172.21.15.81:0/329510961 >> v2:172.21.15.117:3300/0 conn(0x7f392c0a94b0 0x7f392c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392b59e640 1 -- 172.21.15.81:0/329510961 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0bbb40 con 0x7f392c15c120 2024-05-08T20:27:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.418+0000 7f392ad9d640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 0x7f392c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f392b59e640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c15c120 0x7f392c15c590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f392c06e360 tx=0x7f392401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb9aa1cafb91709 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f3929d9b640 1 -- 172.21.15.81:0/329510961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a5550 con 0x7f392c15c120 2024-05-08T20:27:38.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f3929d9b640 1 -- 172.21.15.81:0/329510961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39240a56b0 con 0x7f392c15c120 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 -- 172.21.15.81:0/329510961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c15c120 msgr2=0x7f392c15c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c15c120 0x7f392c15c590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f392c06e360 tx=0x7f392401c8d0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 -- 172.21.15.81:0/329510961 shutdown_connections 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c15c120 0x7f392c15c590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 --2- 172.21.15.81:0/329510961 >> v2:172.21.15.117:3300/0 conn(0x7f392c0a94b0 0x7f392c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 --2- 172.21.15.81:0/329510961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c152cc0 0x7f392c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 -- 172.21.15.81:0/329510961 >> 172.21.15.81:0/329510961 conn(0x7f392c0c3e00 msgr2=0x7f392c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 -- 172.21.15.81:0/329510961 shutdown_connections 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.422+0000 7f393103a640 1 -- 172.21.15.81:0/329510961 wait complete. 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 Processor -- start 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- start start 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c0a94b0 0x7f392c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f392c15c120 0x7f392c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c174320 con 0x7f392c152cc0 2024-05-08T20:27:38.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0c0480 con 0x7f392c15c120 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1520e0 con 0x7f392c0a94b0 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39234/0 (socket says 172.21.15.81:39234) 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 -- 172.21.15.81:0/2737452205 learned_addr learned my addr 172.21.15.81:0/2737452205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 -- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c0a94b0 msgr2=0x7f392c0c14c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c0a94b0 0x7f392c0c14c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 -- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f392c15c120 msgr2=0x7f392c1451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f392c15c120 0x7f392c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 -- 172.21.15.81:0/2737452205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009b30 con 0x7f392c152cc0 2024-05-08T20:27:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f392a59c640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e8b0 tx=0x7f391c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00c940 con 0x7f392c152cc0 2024-05-08T20:27:38.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c1523c0 con 0x7f392c152cc0 2024-05-08T20:27:38.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c146490 con 0x7f392c152cc0 2024-05-08T20:27:38.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.426+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00caa0 con 0x7f392c152cc0 2024-05-08T20:27:38.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.430+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00ce10 con 0x7f392c152cc0 2024-05-08T20:27:38.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.430+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f391c013470 con 0x7f392c152cc0 2024-05-08T20:27:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.430+0000 7f391b7fe640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 0x7f3910068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.430+0000 7f392ad9d640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 0x7f3910068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.430+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f391c084750 con 0x7f392c152cc0 2024-05-08T20:27:38.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.434+0000 7f392ad9d640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 0x7f3910068ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3920006b20 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.438+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3908005260 con 0x7f392c152cc0 2024-05-08T20:27:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.446+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f391c051800 con 0x7f392c152cc0 2024-05-08T20:27:38.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.574+0000 7f9495923640 1 -- 172.21.15.81:0/679208011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f94900747d0 con 0x7f949014ddd0 2024-05-08T20:27:38.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.578+0000 7f9477fff640 1 -- 172.21.15.81:0/679208011 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94840f0070 con 0x7f949014ddd0 2024-05-08T20:27:38.586 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-05-08T20:27:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.578+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 msgr2=0x7f947c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.578+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 0x7f947c068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9488000f90 tx=0x7f9488001930 comp rx=0 tx=0).stop 2024-05-08T20:27:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 msgr2=0x7f9490149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 0x7f9490149220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f94840ab000 tx=0x7f948401aa20 comp rx=0 tx=0).stop 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 shutdown_connections 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f947c066690 0x7f947c068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f949014ddd0 0x7f9490149220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94900bf160 0x7f94901ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 --2- 172.21.15.81:0/679208011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94900a9830 0x7f9490149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 >> 172.21.15.81:0/679208011 conn(0x7f94900c3e00 msgr2=0x7f949014b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 shutdown_connections 2024-05-08T20:27:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.582+0000 7f9475ffb640 1 -- 172.21.15.81:0/679208011 wait complete. 2024-05-08T20:27:38.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2024-05-08T20:27:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.614+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1cb8070840 con 0x7f1cb80bfb10 2024-05-08T20:27:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.614+0000 7f1ca6ffd640 1 -- 172.21.15.81:0/4203685841 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cb8070840 con 0x7f1cb80bfb10 2024-05-08T20:27:38.621 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-05-08T20:27:38.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 msgr2=0x7f1c98068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 0x7f1c98068ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80af000 tx=0x7f1ca8008040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 msgr2=0x7f1cb814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c530 tx=0x7f1cac00c9f0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 shutdown_connections 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c980666e0 0x7f1c98068ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb814d350 0x7f1cb81489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cb814e9f0 0x7f1cb8148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 --2- 172.21.15.81:0/4203685841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cb80bfb10 0x7f1cb814b690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 >> 172.21.15.81:0/4203685841 conn(0x7f1cb80c2ca0 msgr2=0x7f1cb8154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 shutdown_connections 2024-05-08T20:27:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.618+0000 7f1cbc983640 1 -- 172.21.15.81:0/4203685841 wait complete. 2024-05-08T20:27:38.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.626+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbfcc005510 con 0x7fbff406d7d0 2024-05-08T20:27:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.626+0000 7fbff0ff9640 1 -- 172.21.15.81:0/2821222077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfe40b0030 con 0x7fbff406d7d0 2024-05-08T20:27:38.632 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb180057c0 con 0x7fcb1804a9c0 2024-05-08T20:27:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 msgr2=0x7fbfd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 0x7fbfd8068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbff4158bb0 tx=0x7fbfdc007bc0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 msgr2=0x7fbff40c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40190d0 tx=0x7fbfe4019260 comp rx=0 tx=0).stop 2024-05-08T20:27:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 shutdown_connections 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfd8066690 0x7fbfd8068b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbff4156430 0x7fbff406a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40c31a0 0x7fbff4069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 --2- 172.21.15.81:0/2821222077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff406d7d0 0x7fbff40c6050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 >> 172.21.15.81:0/2821222077 conn(0x7fbff40c71b0 msgr2=0x7fbff414fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 shutdown_connections 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fbff99ea640 1 -- 172.21.15.81:0/2821222077 wait complete. 2024-05-08T20:27:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.630+0000 7fcb167fc640 1 -- 172.21.15.81:0/1714793441 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb10014020 con 0x7fcb1804a9c0 2024-05-08T20:27:38.638 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-05-08T20:27:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 msgr2=0x7fcb04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 0x7fcb04068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c007fd0 tx=0x7fcb1c007940 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 msgr2=0x7fcb1803edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000b550 tx=0x7fcb1000ba10 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 shutdown_connections 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb04066690 0x7fcb04068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb180d6cc0 0x7fcb1817f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb180db120 0x7fcb1802d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 --2- 172.21.15.81:0/1714793441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1804a9c0 0x7fcb1803edf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 >> 172.21.15.81:0/1714793441 conn(0x7fcb18049320 msgr2=0x7fcb180d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 shutdown_connections 2024-05-08T20:27:38.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fcb26ab0640 1 -- 172.21.15.81:0/1714793441 wait complete. 2024-05-08T20:27:38.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.634+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee680c4890 con 0x7fee6814d600 2024-05-08T20:27:38.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3c300c5220 con 0x7f3c30132bd0 2024-05-08T20:27:38.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2024-05-08T20:27:38.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7f3c17fff640 1 -- 172.21.15.81:0/3369239515 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c280eee40 con 0x7f3c30132bd0 2024-05-08T20:27:38.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee4f7fe640 1 -- 172.21.15.81:0/12655849 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee680c4890 con 0x7fee6814d600 2024-05-08T20:27:38.646 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-05-08T20:27:38.646 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-05-08T20:27:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 msgr2=0x7fee54068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 0x7fee54068c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f70 tx=0x7fee5c007e30 comp rx=0 tx=0).stop 2024-05-08T20:27:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 msgr2=0x7fee680c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee6001ae80 tx=0x7fee60019570 comp rx=0 tx=0).stop 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 shutdown_connections 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee54066790 0x7fee54068c50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee6814d600 0x7fee680c5860 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee6814e1c0 0x7fee6806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 --2- 172.21.15.81:0/12655849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee680c2800 0x7fee6814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 >> 172.21.15.81:0/12655849 conn(0x7fee680c2ca0 msgr2=0x7fee680bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 shutdown_connections 2024-05-08T20:27:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.638+0000 7fee6d372640 1 -- 172.21.15.81:0/12655849 wait complete. 2024-05-08T20:27:38.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 msgr2=0x7f3c1c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 0x7f3c1c068bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c200099f0 tx=0x7f3c20009190 comp rx=0 tx=0).stop 2024-05-08T20:27:38.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 msgr2=0x7f3c30136860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 0x7f3c30136860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006ae60 tx=0x7f3c18005800 comp rx=0 tx=0).stop 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 shutdown_connections 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3c1c066710 0x7f3c1c068bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3c30132bd0 0x7f3c30136860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c300c5870 0x7f3c30132690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 --2- 172.21.15.81:0/3369239515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c18005390 0x7f3c30147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 >> 172.21.15.81:0/3369239515 conn(0x7f3c300c2a90 msgr2=0x7f3c3006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 shutdown_connections 2024-05-08T20:27:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.642+0000 7f3c34e9b640 1 -- 172.21.15.81:0/3369239515 wait complete. 2024-05-08T20:27:38.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2024-05-08T20:27:38.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-05-08T20:27:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.662+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff80c1ef220 con 0x7ff80c0c3530 2024-05-08T20:27:38.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2024-05-08T20:27:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff801ffb640 1 -- 172.21.15.81:0/2142403716 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7fc018070 con 0x7ff80c0c3530 2024-05-08T20:27:38.671 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 msgr2=0x7ff7f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 0x7ff7f0068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff808005890 tx=0x7ff808009040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 msgr2=0x7ff80c1eb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009e00 tx=0x7ff7fc00c430 comp rx=0 tx=0).stop 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 shutdown_connections 2024-05-08T20:27:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7f0066690 0x7ff7f0068b50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80c1596e0 0x7ff80c1eb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80c0c3530 0x7ff80c1eb350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 --2- 172.21.15.81:0/2142403716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80c06e010 0x7ff80c14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 >> 172.21.15.81:0/2142403716 conn(0x7ff80c0c7a90 msgr2=0x7ff80c0c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 shutdown_connections 2024-05-08T20:27:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.666+0000 7ff7f77fe640 1 -- 172.21.15.81:0/2142403716 wait complete. 2024-05-08T20:27:38.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2024-05-08T20:27:38.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.5 2024-05-08T20:27:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.710+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3908005510 con 0x7f392c152cc0 2024-05-08T20:27:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f391b7fe640 1 -- 172.21.15.81:0/2737452205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f391c021020 con 0x7f392c152cc0 2024-05-08T20:27:38.719 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 msgr2=0x7f3910068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 0x7f3910068ca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3920006b20 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 msgr2=0x7f392c0c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f391c00e8b0 tx=0x7f391c00ed70 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 shutdown_connections 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39100667e0 0x7f3910068ca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f392c15c120 0x7f392c1451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392c152cc0 0x7f392c0c1e30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 --2- 172.21.15.81:0/2737452205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392c0a94b0 0x7f392c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 >> 172.21.15.81:0/2737452205 conn(0x7f392c0c3e00 msgr2=0x7f392c0bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 shutdown_connections 2024-05-08T20:27:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:38.714+0000 7f393103a640 1 -- 172.21.15.81:0/2737452205 wait complete. 2024-05-08T20:27:38.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2024-05-08T20:27:39.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T20:27:39.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:27:39.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T20:27:39.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T20:27:39.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T20:27:39.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T20:27:39.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:27:39.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:27:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 Processor -- start 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 -- start start 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe16814e1c0 0x7fe1680aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 0x7fe168151f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe168150c50 con 0x7fe168152460 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1680aa8c0 con 0x7fe1680c2800 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.750+0000 7fe16cfed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe168150ef0 con 0x7fe16814e1c0 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe165d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 0x7fe168151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe165d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 0x7fe168151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48196/0 (socket says 172.21.15.81:48196) 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe165d9b640 1 -- 172.21.15.81:0/382378015 learned_addr learned my addr 172.21.15.81:0/382378015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe16659c640 1 --2- 172.21.15.81:0/382378015 >> v2:172.21.15.117:3300/0 conn(0x7fe16814e1c0 0x7fe1680aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe16659c640 1 -- 172.21.15.81:0/382378015 >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 msgr2=0x7fe168151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe16659c640 1 --2- 172.21.15.81:0/382378015 >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 0x7fe168151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe16659c640 1 -- 172.21.15.81:0/382378015 >> v1:172.21.15.81:6789/0 conn(0x7fe168152460 legacy=0x7fe1680c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.754+0000 7fe16659c640 1 -- 172.21.15.81:0/382378015 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1681511d0 con 0x7fe16814e1c0 2024-05-08T20:27:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16659c640 1 --2- 172.21.15.81:0/382378015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe16814e1c0 0x7fe1680aa200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe168072af0 tx=0x7fe16001cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e393e798785e484 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16559a640 1 -- 172.21.15.81:0/382378015 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600a5bb0 con 0x7fe16814e1c0 2024-05-08T20:27:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16559a640 1 -- 172.21.15.81:0/382378015 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600a5d10 con 0x7fe16814e1c0 2024-05-08T20:27:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16559a640 1 -- 172.21.15.81:0/382378015 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600ad660 con 0x7fe16814e1c0 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 -- 172.21.15.81:0/382378015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe16814e1c0 msgr2=0x7fe1680aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 --2- 172.21.15.81:0/382378015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe16814e1c0 0x7fe1680aa200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe168072af0 tx=0x7fe16001cbb0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 -- 172.21.15.81:0/382378015 shutdown_connections 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 --2- 172.21.15.81:0/382378015 >> v2:172.21.15.81:3300/0 conn(0x7fe1680c2800 0x7fe168151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 --2- 172.21.15.81:0/382378015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe16814e1c0 0x7fe1680aa200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 -- 172.21.15.81:0/382378015 >> 172.21.15.81:0/382378015 conn(0x7fe1680c2ca0 msgr2=0x7fe1680c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 -- 172.21.15.81:0/382378015 shutdown_connections 2024-05-08T20:27:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.758+0000 7fe16cfed640 1 -- 172.21.15.81:0/382378015 wait complete. 2024-05-08T20:27:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 Processor -- start 2024-05-08T20:27:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- start start 2024-05-08T20:27:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1680c2800 0x7fe1681eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe168152460 0x7fe168149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1681ef540 con 0x7fe16814e1c0 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1681454e0 con 0x7fe168152460 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe168141800 con 0x7fe1680c2800 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48210/0 (socket says 172.21.15.81:48210) 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 -- 172.21.15.81:0/2662788851 learned_addr learned my addr 172.21.15.81:0/2662788851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16659c640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1680c2800 0x7fe1681eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe166d9d640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe168152460 0x7fe168149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 -- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1680c2800 msgr2=0x7fe1681eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1680c2800 0x7fe1681eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 -- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe168152460 msgr2=0x7fe168149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe168152460 0x7fe168149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 -- 172.21.15.81:0/2662788851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009770 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe165d9b640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe15800f9c0 tx=0x7fe15800fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800c070 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800dc70 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158009620 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- 172.21.15.81:0/2662788851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680c4190 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.762+0000 7fe16cfed640 1 -- 172.21.15.81:0/2662788851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe168147f70 con 0x7fe16814e1c0 2024-05-08T20:27:39.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.766+0000 7fe16cfed640 1 -- 172.21.15.81:0/2662788851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c005260 con 0x7fe16814e1c0 2024-05-08T20:27:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.766+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe15801a480 con 0x7fe16814e1c0 2024-05-08T20:27:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.766+0000 7fe156ffd640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 0x7fe148068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.766+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe158015070 con 0x7fe16814e1c0 2024-05-08T20:27:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.766+0000 7fe16659c640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 0x7fe148068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.770+0000 7fe16659c640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 0x7fe148068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe1600af000 tx=0x7fe1600a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.774+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe158051aa0 con 0x7fe16814e1c0 2024-05-08T20:27:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 Processor -- start 2024-05-08T20:27:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 -- start start 2024-05-08T20:27:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f83500bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83500a9830 0x7f83500bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500bdb80 con 0x7f8350153ec0 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500bd590 con 0x7f83500a9830 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f8355238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500ab060 con 0x7f835014ddd0 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f834e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83500a9830 0x7f83500bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f834e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83500a9830 0x7f83500bef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48222/0 (socket says 172.21.15.81:48222) 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.814+0000 7f834e59c640 1 -- 172.21.15.81:0/2510611038 learned_addr learned my addr 172.21.15.81:0/2510611038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834ed9d640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f83500bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834dd9b640 1 -- 172.21.15.81:0/2510611038 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059401975 0 0) 0x7f8340001120 con 0x7f8350153ec0 2024-05-08T20:27:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834e59c640 1 -- 172.21.15.81:0/2510611038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 msgr2=0x7f83500bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834e59c640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f83500bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834e59c640 1 -- 172.21.15.81:0/2510611038 >> v1:172.21.15.81:6789/0 conn(0x7f8350153ec0 legacy=0x7f83501542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834e59c640 1 -- 172.21.15.81:0/2510611038 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500ab340 con 0x7f83500a9830 2024-05-08T20:27:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.818+0000 7f834e59c640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83500a9830 0x7f83500bef90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8348007e30 tx=0x7f834801cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19299f419286e8e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f834ed9d640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f83500bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f834dd9b640 1 -- 172.21.15.81:0/2510611038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480a5e40 con 0x7f83500a9830 2024-05-08T20:27:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f834dd9b640 1 -- 172.21.15.81:0/2510611038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800a0d0 con 0x7f83500a9830 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 -- 172.21.15.81:0/2510611038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83500a9830 msgr2=0x7f83500bef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83500a9830 0x7f83500bef90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8348007e30 tx=0x7f834801cd70 comp rx=0 tx=0).stop 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 -- 172.21.15.81:0/2510611038 shutdown_connections 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83500a9830 0x7f83500bef90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 --2- 172.21.15.81:0/2510611038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f83500bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 -- 172.21.15.81:0/2510611038 >> 172.21.15.81:0/2510611038 conn(0x7f83500c3e00 msgr2=0x7f83500c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 -- 172.21.15.81:0/2510611038 shutdown_connections 2024-05-08T20:27:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.822+0000 7f8355238640 1 -- 172.21.15.81:0/2510611038 wait complete. 2024-05-08T20:27:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 Processor -- start 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 -- start start 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83500a9830 0x7f83500c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f835006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c1a00 con 0x7f8350153ec0 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83501f4ec0 con 0x7f83500a9830 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f8355238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83501f51a0 con 0x7f835014ddd0 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48228/0 (socket says 172.21.15.81:48228) 2024-05-08T20:27:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 -- 172.21.15.81:0/3786413459 learned_addr learned my addr 172.21.15.81:0/3786413459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834e59c640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f835006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 -- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 msgr2=0x7f835006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f835006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 -- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83500a9830 msgr2=0x7f83500c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83500a9830 0x7f83500c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 -- 172.21.15.81:0/3786413459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348007b10 con 0x7f8350153ec0 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.826+0000 7f834f59e640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f834000c410 tx=0x7f834000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.830+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400054e0 con 0x7f8350153ec0 2024-05-08T20:27:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.830+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83501f5480 con 0x7f8350153ec0 2024-05-08T20:27:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.830+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835006c8e0 con 0x7f8350153ec0 2024-05-08T20:27:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.830+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340003600 con 0x7f8350153ec0 2024-05-08T20:27:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340003990 con 0x7f8350153ec0 2024-05-08T20:27:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8340003bb0 con 0x7f8350153ec0 2024-05-08T20:27:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f833f7fe640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 0x7f8334068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f834ed9d640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 0x7f8334068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f834ed9d640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 0x7f8334068cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f834400b240 tx=0x7f8344008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8340083a50 con 0x7f8350153ec0 2024-05-08T20:27:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.834+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c005260 con 0x7f8350153ec0 2024-05-08T20:27:39.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.846+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8340050b00 con 0x7f8350153ec0 2024-05-08T20:27:39.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 Processor -- start 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 -- start start 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fd4153ec0 0x7f5fd41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40bdb80 con 0x7f5fd414ddd0 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40bf6a0 con 0x7f5fd4153ec0 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fdb7ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40bd590 con 0x7f5fd40a9830 2024-05-08T20:27:39.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fd8d87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fd8d87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:49230/0 (socket says 172.21.15.81:49230) 2024-05-08T20:27:39.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fd8d87640 1 -- 172.21.15.81:0/531588934 learned_addr learned my addr 172.21.15.81:0/531588934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.862+0000 7f5fd9d89640 1 --2- 172.21.15.81:0/531588934 >> v2:172.21.15.117:3300/0 conn(0x7f5fd4153ec0 0x7f5fd41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd9d89640 1 -- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 msgr2=0x7f5fd40bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd9d89640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd9d89640 1 -- 172.21.15.81:0/531588934 >> v1:172.21.15.117:6789/0 conn(0x7f5fd414ddd0 legacy=0x7f5fd40bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd9d89640 1 -- 172.21.15.81:0/531588934 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40ab060 con 0x7f5fd4153ec0 2024-05-08T20:27:39.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd8d87640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 Processor -- start 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 -- start start 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 0x7f397c0bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f397c0a9830 0x7f397c0bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c153ec0 0x7f397c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0bdb80 con 0x7f397c0a9830 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0bd590 con 0x7f397c153ec0 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3980ab5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c0ab060 con 0x7f397c14ddd0 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c153ec0 0x7f397c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c153ec0 0x7f397c1542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52374/0 (socket says 172.21.15.81:52374) 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 -- 172.21.15.81:0/663882639 learned_addr learned my addr 172.21.15.81:0/663882639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f3979d9b640 1 --2- 172.21.15.81:0/663882639 >> v2:172.21.15.81:3300/0 conn(0x7f397c0a9830 0x7f397c0bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 Processor -- start 2024-05-08T20:27:39.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 -- start start 2024-05-08T20:27:39.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397a59c640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 0x7f397c0bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6600d79d0 0x7fa66004a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6600071d0 0x7fa660007630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66004aa10 con 0x7fa66000e180 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 -- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 msgr2=0x7f397c0bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 0x7f397c0bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 -- 172.21.15.81:0/663882639 >> v2:172.21.15.81:3300/0 conn(0x7f397c0a9830 msgr2=0x7f397c0bef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 --2- 172.21.15.81:0/663882639 >> v2:172.21.15.81:3300/0 conn(0x7f397c0a9830 0x7f397c0bef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397ad9d640 1 -- 172.21.15.81:0/663882639 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0ab340 con 0x7f397c153ec0 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f397a59c640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 0x7f397c0bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:39.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7f5fd9d89640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd4153ec0 0x7f5fd41542f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097c0 tx=0x7f5fd001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19de8caedc5293c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66004b520 con 0x7fa6600d79d0 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa66d8b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600dd890 con 0x7fa6600071d0 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.866+0000 7fa666ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6600d79d0 0x7fa66004a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6600d79d0 0x7fa66004a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48252/0 (socket says 172.21.15.81:48252) 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 -- 172.21.15.81:0/3600304479 learned_addr learned my addr 172.21.15.81:0/3600304479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa6667fc640 1 --2- 172.21.15.81:0/3600304479 >> v2:172.21.15.117:3300/0 conn(0x7fa6600071d0 0x7fa660007630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fcbfff640 1 -- 172.21.15.81:0/531588934 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00a6040 con 0x7f5fd4153ec0 2024-05-08T20:27:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 -- 172.21.15.81:0/3600304479 >> v2:172.21.15.117:3300/0 conn(0x7fa6600071d0 msgr2=0x7fa660007630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 --2- 172.21.15.81:0/3600304479 >> v2:172.21.15.117:3300/0 conn(0x7fa6600071d0 0x7fa660007630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 -- 172.21.15.81:0/3600304479 >> v1:172.21.15.117:6789/0 conn(0x7fa66000e180 legacy=0x7fa6600da320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 -- 172.21.15.81:0/3600304479 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600d7db0 con 0x7fa6600d79d0 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fcbfff640 1 -- 172.21.15.81:0/531588934 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00aa600 con 0x7f5fd4153ec0 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fcbfff640 1 -- 172.21.15.81:0/531588934 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00aa990 con 0x7f5fd4153ec0 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd4153ec0 msgr2=0x7f5fd41542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd4153ec0 0x7f5fd41542f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097c0 tx=0x7f5fd001c4c0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/531588934 shutdown_connections 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd4153ec0 0x7f5fd41542f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/531588934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd40a9830 0x7f5fd40bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/531588934 >> 172.21.15.81:0/531588934 conn(0x7f5fd40c3e00 msgr2=0x7f5fd40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/531588934 shutdown_connections 2024-05-08T20:27:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa666ffd640 1 --2- 172.21.15.81:0/3600304479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600d79d0 0x7fa66004a4d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa66004c530 tx=0x7fa65c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bf53ab7922b3fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa665ffb640 1 -- 172.21.15.81:0/3600304479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600db240 con 0x7fa6600d79d0 2024-05-08T20:27:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa665ffb640 1 -- 172.21.15.81:0/3600304479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c0a7050 con 0x7fa6600d79d0 2024-05-08T20:27:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa665ffb640 1 -- 172.21.15.81:0/3600304479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0ab820 con 0x7fa6600d79d0 2024-05-08T20:27:39.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f397ad9d640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c153ec0 0x7f397c1542f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f397c06e690 tx=0x7f3974021100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05b4296ad770517 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/531588934 wait complete. 2024-05-08T20:27:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f397959a640 1 -- 172.21.15.81:0/663882639 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740b0400 con 0x7f397c153ec0 2024-05-08T20:27:39.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 Processor -- start 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f397959a640 1 -- 172.21.15.81:0/663882639 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39740ac050 con 0x7f397c153ec0 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3600304479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600d79d0 msgr2=0x7fa66004a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3600304479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600d79d0 0x7fa66004a4d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa66004c530 tx=0x7fa65c01c420 comp rx=0 tx=0).stop 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3600304479 shutdown_connections 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3600304479 >> v2:172.21.15.117:3300/0 conn(0x7fa6600071d0 0x7fa660007630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3600304479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600d79d0 0x7fa66004a4d0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa66004c530 tx=0x7fa65c01c420 comp rx=0 tx=0).stop 2024-05-08T20:27:39.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3600304479 >> 172.21.15.81:0/3600304479 conn(0x7fa66004c5d0 msgr2=0x7fa66004c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.870+0000 7f5fdb7ec640 1 -- start start 2024-05-08T20:27:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3600304479 shutdown_connections 2024-05-08T20:27:39.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f397959a640 1 -- 172.21.15.81:0/663882639 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740b0780 con 0x7f397c153ec0 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c153ec0 msgr2=0x7f397c1542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c153ec0 0x7f397c1542f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f397c06e690 tx=0x7f3974021100 comp rx=0 tx=0).stop 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- 172.21.15.81:0/663882639 shutdown_connections 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c153ec0 0x7f397c1542f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- 172.21.15.81:0/663882639 >> v2:172.21.15.81:3300/0 conn(0x7f397c0a9830 0x7f397c0bef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- 172.21.15.81:0/663882639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c14ddd0 0x7f397c0bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- 172.21.15.81:0/663882639 >> 172.21.15.81:0/663882639 conn(0x7f397c0c3e00 msgr2=0x7f397c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- 172.21.15.81:0/663882639 shutdown_connections 2024-05-08T20:27:39.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- 172.21.15.81:0/663882639 wait complete. 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 0x7f5fd413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd4153ec0 0x7f5fd41f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c1960 con 0x7f5fd414ddd0 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4149fe0 con 0x7f5fd40a9830 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41f5b70 con 0x7f5fd4153ec0 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48258/0 (socket says 172.21.15.81:48258) 2024-05-08T20:27:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 -- 172.21.15.81:0/4187456440 learned_addr learned my addr 172.21.15.81:0/4187456440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 Processor -- start 2024-05-08T20:27:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd9588640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 0x7f5fd413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd9d89640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd4153ec0 0x7f5fd41f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 -- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd4153ec0 msgr2=0x7f5fd41f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd4153ec0 0x7f5fd41f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 -- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 msgr2=0x7f5fd413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 0x7f5fd413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 -- 172.21.15.81:0/4187456440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc00d050 con 0x7f5fd414ddd0 2024-05-08T20:27:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd9588640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 0x7f5fd413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fd8d87640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d2b0 tx=0x7f5fcc00d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3600304479 wait complete. 2024-05-08T20:27:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 Processor -- start 2024-05-08T20:27:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 Processor -- start 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 -- start start 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f972006db80 0x7f9720069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200c1aa0 0x7f97200c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972006b530 con 0x7f97200c2800 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97200c35f0 con 0x7f972006db80 2024-05-08T20:27:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9726a96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97201590f0 con 0x7f97200c1aa0 2024-05-08T20:27:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc010040 con 0x7f5fd414ddd0 2024-05-08T20:27:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc003ba0 con 0x7f5fd414ddd0 2024-05-08T20:27:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc007b30 con 0x7f5fd414ddd0 2024-05-08T20:27:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd0009420 con 0x7f5fd414ddd0 2024-05-08T20:27:39.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd4149c70 con 0x7f5fd414ddd0 2024-05-08T20:27:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9724832640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f97200c2800 0x7f9720159580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:42928/0 (socket says 172.21.15.81:42928) 2024-05-08T20:27:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9724832640 1 -- 172.21.15.81:0/4277991198 learned_addr learned my addr 172.21.15.81:0/4277991198 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- start start 2024-05-08T20:27:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600071d0 0x7fa660180b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 0x7fa660034630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 0x7fa6600494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa660047410 con 0x7fa6600071d0 2024-05-08T20:27:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66017de00 con 0x7fa66000e180 2024-05-08T20:27:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa66d8b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66000dc10 con 0x7fa660049010 2024-05-08T20:27:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f9725033640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200c1aa0 0x7f97200c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa6667fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 0x7fa660034630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- start start 2024-05-08T20:27:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c14ddd0 0x7f397c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c153ec0 0x7f397c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c0c2710 con 0x7f397c0a9830 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c1f61e0 con 0x7f397c14ddd0 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f3980ab5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c142270 con 0x7f397c153ec0 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f397a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f397a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48282/0 (socket says 172.21.15.81:48282) 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f397a59c640 1 -- 172.21.15.81:0/2259253040 learned_addr learned my addr 172.21.15.81:0/2259253040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa6667fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 0x7fa660034630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52402/0 (socket says 172.21.15.81:52402) 2024-05-08T20:27:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa6677fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 0x7fa6600494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7fa6667fc640 1 -- 172.21.15.81:0/3887318353 learned_addr learned my addr 172.21.15.81:0/3887318353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405228171 0 0) 0x7f972006b530 con 0x7f97200c2800 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9708003530 con 0x7f97200c2800 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 -- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 msgr2=0x7fa660034630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 0x7fa660034630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 -- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600071d0 msgr2=0x7fa660180b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600071d0 0x7fa660180b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 -- 172.21.15.81:0/3887318353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0094d0 con 0x7fa660049010 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.874+0000 7f397ad9d640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c153ec0 0x7f397c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 -- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c153ec0 msgr2=0x7f397c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c153ec0 0x7f397c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 -- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c14ddd0 msgr2=0x7f397c140870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c14ddd0 0x7f397c140870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 -- 172.21.15.81:0/2259253040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397400c3d0 con 0x7f397c0a9830 2024-05-08T20:27:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004011827 0 0) 0x7f9708003530 con 0x7f97200c2800 2024-05-08T20:27:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200c1aa0 msgr2=0x7f97200c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200c1aa0 0x7f97200c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 >> v2:172.21.15.81:3300/0 conn(0x7f972006db80 msgr2=0x7f9720069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 --2- 172.21.15.81:0/4277991198 >> v2:172.21.15.81:3300/0 conn(0x7f972006db80 0x7f9720069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720158da0 con 0x7f97200c2800 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9718001a00 con 0x7f97200c2800 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 >> v1:172.21.15.117:6789/0 conn(0x7f97200c2800 legacy=0x7f9720159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9708003980 0x7f9708003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97080047d0 0x7f9708004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97080051e0 0x7f970800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97201590f0 con 0x7f97080051e0 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970800c110 con 0x7f9708003980 2024-05-08T20:27:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970800c2d0 con 0x7f97080047d0 2024-05-08T20:27:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa6677fe640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 0x7fa6600494c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c390 tx=0x7fa65800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f397a59c640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f397000c7c0 tx=0x7f397000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9708003980 0x7f9708003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5fcc004030 con 0x7f5fd414ddd0 2024-05-08T20:27:39.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580052d0 con 0x7fa660049010 2024-05-08T20:27:39.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa658005430 con 0x7fa660049010 2024-05-08T20:27:39.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9725033640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97080051e0 0x7f970800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970007a30 con 0x7f397c0a9830 2024-05-08T20:27:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970007b90 con 0x7f397c0a9830 2024-05-08T20:27:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c1f5420 con 0x7f397c0a9830 2024-05-08T20:27:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000ce70 con 0x7f397c0a9830 2024-05-08T20:27:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c1f59e0 con 0x7f397c0a9830 2024-05-08T20:27:39.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f5fc9ffb640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 0x7f5fb8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5fcc084b80 con 0x7f5fd414ddd0 2024-05-08T20:27:39.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f5fd9588640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 0x7f5fb8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb4005260 con 0x7f5fd414ddd0 2024-05-08T20:27:39.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658011890 con 0x7fa660049010 2024-05-08T20:27:39.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6601810b0 con 0x7fa660049010 2024-05-08T20:27:39.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660046d50 con 0x7fa660049010 2024-05-08T20:27:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 -- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97080047d0 msgr2=0x7f9708004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:27:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97080047d0 0x7f9708004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 -- 172.21.15.81:0/4277991198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97080051e0 msgr2=0x7f970800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97080051e0 0x7f970800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.878+0000 7f9724832640 1 -- 172.21.15.81:0/4277991198 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708003530 con 0x7f9708003980 2024-05-08T20:27:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9725033640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97080051e0 0x7f970800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:39.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66000df60 con 0x7fa660049010 2024-05-08T20:27:39.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c0747d0 con 0x7f397c0a9830 2024-05-08T20:27:39.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9724832640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9708003980 0x7f9708003da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f971800a780 tx=0x7f971801d2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bfa6c5e7bd86fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180ad630 con 0x7f9708003980 2024-05-08T20:27:39.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97180a8070 con 0x7f9708003980 2024-05-08T20:27:39.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f971f7fe640 1 -- 172.21.15.81:0/4277991198 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180ad9d0 con 0x7f9708003980 2024-05-08T20:27:39.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f5fd9588640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 0x7f5fb8068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40bcbd0 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 -- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9708003980 msgr2=0x7f9708003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 --2- 172.21.15.81:0/4277991198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9708003980 0x7f9708003da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f971800a780 tx=0x7f971801d2c0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9725033640 1 -- 172.21.15.81:0/4277991198 reap_dead start 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 -- 172.21.15.81:0/4277991198 shutdown_connections 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 -- 172.21.15.81:0/4277991198 >> 172.21.15.81:0/4277991198 conn(0x7f97200c3ba0 msgr2=0x7f97200c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 -- 172.21.15.81:0/4277991198 shutdown_connections 2024-05-08T20:27:39.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7f9726a96640 1 -- 172.21.15.81:0/4277991198 wait complete. 2024-05-08T20:27:39.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fe407606640 1 Processor -- start 2024-05-08T20:27:39.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fe407606640 1 -- start start 2024-05-08T20:27:39.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6580119f0 con 0x7fa660049010 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa64ffff640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 0x7fa654068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa658083bb0 con 0x7fa660049010 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa666ffd640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 0x7fa654068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.882+0000 7fa666ffd640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 0x7fa654068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0ad000 tx=0x7fa65c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe407606640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3f8047740 0x7fe3f804e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 Processor -- start 2024-05-08T20:27:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe407606640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3f80df480 0x7fe3f80e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 -- start start 2024-05-08T20:27:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe407606640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f804ef00 con 0x7fe3f80d52a0 2024-05-08T20:27:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe407606640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80de790 con 0x7fe3f8047740 2024-05-08T20:27:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe407606640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80d5680 con 0x7fe3f80df480 2024-05-08T20:27:39.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe4053a2640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe3f80d52a0 0x7fe3f8052100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:42940/0 (socket says 172.21.15.81:42940) 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe4053a2640 1 -- 172.21.15.81:0/1737029296 learned_addr learned my addr 172.21.15.81:0/1737029296 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 --2- 172.21.15.81:0/1737029296 >> v2:172.21.15.117:3300/0 conn(0x7fe3f80df480 0x7fe3f80e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe3f7fff640 1 -- 172.21.15.81:0/1737029296 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302935964 0 0) 0x7fe3f804ef00 con 0x7fe3f80d52a0 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe3f7fff640 1 -- 172.21.15.81:0/1737029296 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ec003530 con 0x7fe3f80d52a0 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 -- 172.21.15.81:0/1737029296 >> v2:172.21.15.81:3300/0 conn(0x7fe3f8047740 msgr2=0x7fe3f804e9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 --2- 172.21.15.81:0/1737029296 >> v2:172.21.15.81:3300/0 conn(0x7fe3f8047740 0x7fe3f804e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 -- 172.21.15.81:0/1737029296 >> v1:172.21.15.117:6789/0 conn(0x7fe3f80d52a0 legacy=0x7fe3f8052100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 -- 172.21.15.81:0/1737029296 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f804f410 con 0x7fe3f80df480 2024-05-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200abaa0 0x7f972015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f972014a080 0x7f972014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9720146aa0 con 0x7f9708003980 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97201472b0 con 0x7f972014a080 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9726a96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97200abff0 con 0x7f97200abaa0 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48310/0 (socket says 172.21.15.81:48310) 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 -- 172.21.15.81:0/430887542 learned_addr learned my addr 172.21.15.81:0/430887542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f971ffff640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200abaa0 0x7f972015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9725033640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f972014a080 0x7f972014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 -- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200abaa0 msgr2=0x7f972015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200abaa0 0x7f972015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 -- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f972014a080 msgr2=0x7f972014a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f972014a080 0x7f972014a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 -- 172.21.15.81:0/430887542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972015af80 con 0x7f9708003980 2024-05-08T20:27:39.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f9724832640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f971800a780 tx=0x7f9708005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5fcc01a020 con 0x7f5fd414ddd0 2024-05-08T20:27:39.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f39700113f0 con 0x7f397c0a9830 2024-05-08T20:27:39.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7f396affd640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 0x7f395c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3970084b50 con 0x7f397c0a9830 2024-05-08T20:27:39.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7f3979d9b640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 0x7f395c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7f3979d9b640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 0x7f395c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f397c142060 tx=0x7f396c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe405ba3640 1 --2- 172.21.15.81:0/1737029296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f80df480 0x7fe3f80e1d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4000638e0 tx=0x7fe400096f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1de13956e399b4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe3f7fff640 1 -- 172.21.15.81:0/1737029296 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40011fbc0 con 0x7fe3f80df480 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.886+0000 7fe3f7fff640 1 -- 172.21.15.81:0/1737029296 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40011fd20 con 0x7fe3f80df480 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe3f7fff640 1 -- 172.21.15.81:0/1737029296 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400127640 con 0x7fe3f80df480 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- 172.21.15.81:0/1737029296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f80df480 msgr2=0x7fe3f80e1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- 172.21.15.81:0/1737029296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f80df480 0x7fe3f80e1d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4000638e0 tx=0x7fe400096f60 comp rx=0 tx=0).stop 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- 172.21.15.81:0/1737029296 shutdown_connections 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- 172.21.15.81:0/1737029296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f80df480 0x7fe3f80e1d80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- 172.21.15.81:0/1737029296 >> v2:172.21.15.81:3300/0 conn(0x7fe3f8047740 0x7fe3f804e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- 172.21.15.81:0/1737029296 >> 172.21.15.81:0/1737029296 conn(0x7fe3f8007020 msgr2=0x7fe3f8007430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- 172.21.15.81:0/1737029296 shutdown_connections 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- 172.21.15.81:0/1737029296 wait complete. 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 Processor -- start 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- start start 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 0x7fe3f80d4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3f80d52a0 0x7fe3f8035e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 0x7fe3f80d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80dbe30 con 0x7fe3f80df480 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80d9450 con 0x7fe3f8047740 2024-05-08T20:27:39.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe407606640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80d9170 con 0x7fe3f80d52a0 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe405ba3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 0x7fe3f80d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe405ba3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 0x7fe3f80d25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48312/0 (socket says 172.21.15.81:48312) 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe405ba3640 1 -- 172.21.15.81:0/666232156 learned_addr learned my addr 172.21.15.81:0/666232156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe404ba1640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3f80d52a0 0x7fe3f8035e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.890+0000 7fe4053a2640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 0x7fe3f80d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718001a40 con 0x7f9708003980 2024-05-08T20:27:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718004b70 con 0x7f9708003980 2024-05-08T20:27:39.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972015b260 con 0x7f9708003980 2024-05-08T20:27:39.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180ad430 con 0x7f9708003980 2024-05-08T20:27:39.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97200c5f20 con 0x7f9708003980 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 -- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3f80d52a0 msgr2=0x7fe3f8035e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3f80d52a0 0x7fe3f8035e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 -- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 msgr2=0x7fe3f80d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 0x7fe3f80d25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 -- 172.21.15.81:0/666232156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400072040 con 0x7fe3f8047740 2024-05-08T20:27:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe4053a2640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 0x7fe3f80d4590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00c400 tx=0x7fe3fc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc005cf0 con 0x7fe3f8047740 2024-05-08T20:27:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc005e50 con 0x7fe3f8047740 2024-05-08T20:27:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0072d0 con 0x7fe3f8047740 2024-05-08T20:27:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f80db7e0 con 0x7fe3f8047740 2024-05-08T20:27:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f8036350 con 0x7fe3f8047740 2024-05-08T20:27:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97200736a0 con 0x7f9708003980 2024-05-08T20:27:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80db640 con 0x7fe3f8047740 2024-05-08T20:27:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3fc007430 con 0x7fe3f8047740 2024-05-08T20:27:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa658050e10 con 0x7fa660049010 2024-05-08T20:27:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 0x7fe3e4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.894+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe3fc084060 con 0x7fe3f8047740 2024-05-08T20:27:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.898+0000 7fe404ba1640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 0x7fe3e4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.898+0000 7fe404ba1640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 0x7fe3e4068c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8036650 tx=0x7fe3f0009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.902+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3970084e60 con 0x7f397c0a9830 2024-05-08T20:27:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.902+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97180aa030 con 0x7f9708003980 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.906+0000 7f971d7fa640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 0x7f970c068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.906+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f971811e540 con 0x7f9708003980 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.906+0000 7f971ffff640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 0x7f970c068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.906+0000 7f971ffff640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 0x7f970c068c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f972014acd0 tx=0x7f9714009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.910+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe3fc051130 con 0x7fe3f8047740 2024-05-08T20:27:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.910+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f97180eb560 con 0x7f9708003980 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 Processor -- start 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 -- start start 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b78161010 0x7f9b780c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b780c1ee0 0x7f9b780a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b78162500 con 0x7f9b78161fb0 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b781613f0 con 0x7f9b78161010 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7806d8d0 con 0x7f9b780c1ee0 2024-05-08T20:27:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b7659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b78161010 0x7f9b780c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b75d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9b78161fb0 0x7f9b780a9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:42948/0 (socket says 172.21.15.81:42948) 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b75d9b640 1 -- 172.21.15.81:0/1778190079 learned_addr learned my addr 172.21.15.81:0/1778190079 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.926+0000 7f9b76d9d640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b780c1ee0 0x7f9b780a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.930+0000 7f9b7659c640 1 -- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b780c1ee0 msgr2=0x7f9b780a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.930+0000 7f9b7659c640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b780c1ee0 0x7f9b780a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.930+0000 7f9b7659c640 1 -- 172.21.15.81:0/1778190079 >> v1:172.21.15.117:6789/0 conn(0x7f9b78161fb0 legacy=0x7f9b780a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.930+0000 7f9b7659c640 1 -- 172.21.15.81:0/1778190079 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780aa4e0 con 0x7f9b78161010 2024-05-08T20:27:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7659c640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78161010 0x7f9b780c19a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005dc0 tx=0x7f9b6801eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3d402ff78ee488 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7559a640 1 -- 172.21.15.81:0/1778190079 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680a7bc0 con 0x7f9b78161010 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7559a640 1 -- 172.21.15.81:0/1778190079 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680a7d20 con 0x7f9b78161010 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78161010 msgr2=0x7f9b780c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78161010 0x7f9b780c19a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005dc0 tx=0x7f9b6801eaf0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- 172.21.15.81:0/1778190079 shutdown_connections 2024-05-08T20:27:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b780c1ee0 0x7f9b780a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 --2- 172.21.15.81:0/1778190079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78161010 0x7f9b780c19a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- 172.21.15.81:0/1778190079 >> 172.21.15.81:0/1778190079 conn(0x7f9b780c2a90 msgr2=0x7f9b780c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- 172.21.15.81:0/1778190079 shutdown_connections 2024-05-08T20:27:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- 172.21.15.81:0/1778190079 wait complete. 2024-05-08T20:27:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 Processor -- start 2024-05-08T20:27:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.934+0000 7f9b7759e640 1 -- start start 2024-05-08T20:27:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 0x7f9b780c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78161010 0x7f9b7815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780724f0 con 0x7f9b78161fb0 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781fe830 con 0x7f9b780c1ee0 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780c5e10 con 0x7f9b78161010 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48326/0 (socket says 172.21.15.81:48326) 2024-05-08T20:27:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 -- 172.21.15.81:0/2791708603 learned_addr learned my addr 172.21.15.81:0/2791708603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b75d9b640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78161010 0x7f9b7815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7659c640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 0x7f9b780c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 -- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78161010 msgr2=0x7f9b7815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78161010 0x7f9b7815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 -- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 msgr2=0x7f9b780c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 0x7f9b780c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 -- 172.21.15.81:0/2791708603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6800b840 con 0x7f9b78161fb0 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7659c640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 0x7f9b780c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b76d9d640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e880 tx=0x7f9b6c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c009630 con 0x7f9b78161fb0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b781fe3a0 con 0x7f9b78161fb0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b780c5b70 con 0x7f9b78161fb0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00c940 con 0x7f9b78161fb0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.938+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00ccd0 con 0x7f9b78161fb0 2024-05-08T20:27:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c005260 con 0x7f9b78161fb0 2024-05-08T20:27:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b6c013470 con 0x7f9b78161fb0 2024-05-08T20:27:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b66ffd640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 0x7f9b58068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9b6c084540 con 0x7f9b78161fb0 2024-05-08T20:27:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b7659c640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 0x7f9b58068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.942+0000 7f9b7659c640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 0x7f9b58068c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b680b1000 tx=0x7f9b680a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:39.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:39.954+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9b6c051610 con 0x7f9b78161fb0 2024-05-08T20:27:40.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.106+0000 7fe16cfed640 1 -- 172.21.15.81:0/2662788851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe14c005510 con 0x7fe16814e1c0 2024-05-08T20:27:40.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.106+0000 7fe156ffd640 1 -- 172.21.15.81:0/2662788851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1580550c0 con 0x7fe16814e1c0 2024-05-08T20:27:40.115 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 msgr2=0x7fe148068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 0x7fe148068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe1600af000 tx=0x7fe1600a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 msgr2=0x7fe1681ef000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe15800f9c0 tx=0x7fe15800fe80 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 shutdown_connections 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe148066690 0x7fe148068b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe168152460 0x7fe168149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe16814e1c0 0x7fe1681ef000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 --2- 172.21.15.81:0/2662788851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1680c2800 0x7fe1681eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.110+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 >> 172.21.15.81:0/2662788851 conn(0x7fe1680c2ca0 msgr2=0x7fe1680c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.114+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 shutdown_connections 2024-05-08T20:27:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.114+0000 7fe154ff9640 1 -- 172.21.15.81:0/2662788851 wait complete. 2024-05-08T20:27:40.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-05-08T20:27:40.141 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.170+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f832c005510 con 0x7f8350153ec0 2024-05-08T20:27:40.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.170+0000 7f833f7fe640 1 -- 172.21.15.81:0/3786413459 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8340017030 con 0x7f8350153ec0 2024-05-08T20:27:40.176 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:40.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 msgr2=0x7f8334068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 0x7f8334068cd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f834400b240 tx=0x7f8344008040 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 msgr2=0x7f83501452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f834000c410 tx=0x7f834000c8d0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 shutdown_connections 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8334066810 0x7f8334068cd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8350153ec0 0x7f83501452e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f835014ddd0 0x7f835006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 --2- 172.21.15.81:0/3786413459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83500a9830 0x7f83500c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 >> 172.21.15.81:0/3786413459 conn(0x7f83500c3e00 msgr2=0x7f835014a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 shutdown_connections 2024-05-08T20:27:40.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f8355238640 1 -- 172.21.15.81:0/3786413459 wait complete. 2024-05-08T20:27:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fb4005510 con 0x7f5fd414ddd0 2024-05-08T20:27:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.174+0000 7f5fc9ffb640 1 -- 172.21.15.81:0/4187456440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fcc051c30 con 0x7f5fd414ddd0 2024-05-08T20:27:40.181 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-05-08T20:27:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.178+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 msgr2=0x7f5fb8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.178+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 0x7f5fb8068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40bcbd0 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2024-05-08T20:27:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.178+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 msgr2=0x7f5fd4143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.178+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d2b0 tx=0x7f5fcc00d770 comp rx=0 tx=0).stop 2024-05-08T20:27:40.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 shutdown_connections 2024-05-08T20:27:40.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5fb8066760 0x7f5fb8068c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fd4153ec0 0x7f5fd41f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd414ddd0 0x7f5fd4143c40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 --2- 172.21.15.81:0/4187456440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fd40a9830 0x7f5fd413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 >> 172.21.15.81:0/4187456440 conn(0x7f5fd40c3e00 msgr2=0x7f5fd40a9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 shutdown_connections 2024-05-08T20:27:40.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.182+0000 7f5fdb7ec640 1 -- 172.21.15.81:0/4187456440 wait complete. 2024-05-08T20:27:40.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-05-08T20:27:40.204 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-05-08T20:27:40.207 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f97200747d0 con 0x7f9708003980 2024-05-08T20:27:40.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f971d7fa640 1 -- 172.21.15.81:0/430887542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97180eeb80 con 0x7f9708003980 2024-05-08T20:27:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-05-08T20:27:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 msgr2=0x7f970c068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 0x7f970c068c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f972014acd0 tx=0x7f9714009110 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 msgr2=0x7f9720146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f971800a780 tx=0x7f9708005800 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 shutdown_connections 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f970c066790 0x7f970c068c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f972014a080 0x7f972014a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97200abaa0 0x7f972015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 --2- 172.21.15.81:0/430887542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9708003980 0x7f9720146d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.210+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 >> 172.21.15.81:0/430887542 conn(0x7f97200c3ba0 msgr2=0x7f97200c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.214+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 shutdown_connections 2024-05-08T20:27:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.214+0000 7f9726a96640 1 -- 172.21.15.81:0/430887542 wait complete. 2024-05-08T20:27:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.214+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f397c14b190 con 0x7f397c0a9830 2024-05-08T20:27:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.214+0000 7f396affd640 1 -- 172.21.15.81:0/2259253040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3970055700 con 0x7f397c0a9830 2024-05-08T20:27:40.220 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-05-08T20:27:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 msgr2=0x7f395c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 0x7f395c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f397c142060 tx=0x7f396c009190 comp rx=0 tx=0).stop 2024-05-08T20:27:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 msgr2=0x7f397c1417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f397000c7c0 tx=0x7f397000cc80 comp rx=0 tx=0).stop 2024-05-08T20:27:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa660047550 con 0x7fa660049010 2024-05-08T20:27:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7fa64ffff640 1 -- 172.21.15.81:0/3887318353 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa660047550 con 0x7fa660049010 2024-05-08T20:27:40.224 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-05-08T20:27:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe3f80db640 con 0x7fe3f8047740 2024-05-08T20:27:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.218+0000 7fe3f5ffb640 1 -- 172.21.15.81:0/666232156 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3f80db640 con 0x7fe3f8047740 2024-05-08T20:27:40.225 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-05-08T20:27:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 msgr2=0x7fa654068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 0x7fa654068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0ad000 tx=0x7fa65c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 msgr2=0x7fa6600494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 0x7fa6600494c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c390 tx=0x7fa65800c850 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 shutdown_connections 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa654066690 0x7fa654068b50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa660049010 0x7fa6600494c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa66000e180 0x7fa660034630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 --2- 172.21.15.81:0/3887318353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6600071d0 0x7fa660180b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 >> 172.21.15.81:0/3887318353 conn(0x7fa66004c5d0 msgr2=0x7fa6600d5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 shutdown_connections 2024-05-08T20:27:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fa66d8b0640 1 -- 172.21.15.81:0/3887318353 wait complete. 2024-05-08T20:27:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 msgr2=0x7fe3e4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 0x7fe3e4068c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8036650 tx=0x7fe3f0009110 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 msgr2=0x7fe3f80d4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 0x7fe3f80d4590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00c400 tx=0x7fe3fc00c800 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 shutdown_connections 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3e4066790 0x7fe3e4068c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3f80df480 0x7fe3f80d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3f80d52a0 0x7fe3f8035e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 --2- 172.21.15.81:0/666232156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8047740 0x7fe3f80d4590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 >> 172.21.15.81:0/666232156 conn(0x7fe3f8007020 msgr2=0x7fe3f804e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 shutdown_connections 2024-05-08T20:27:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.222+0000 7fe407606640 1 -- 172.21.15.81:0/666232156 wait complete. 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 shutdown_connections 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f395c066690 0x7f395c068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c153ec0 0x7f397c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c14ddd0 0x7f397c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 --2- 172.21.15.81:0/2259253040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f397c0a9830 0x7f397c1417a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 >> 172.21.15.81:0/2259253040 conn(0x7f397c0c3e00 msgr2=0x7f397c0aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 shutdown_connections 2024-05-08T20:27:40.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.226+0000 7f3980ab5640 1 -- 172.21.15.81:0/2259253040 wait complete. 2024-05-08T20:27:40.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-05-08T20:27:40.238 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-05-08T20:27:40.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-05-08T20:27:40.257 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.257 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-05-08T20:27:40.258 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.254+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b5c005510 con 0x7f9b78161fb0 2024-05-08T20:27:40.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.254+0000 7f9b66ffd640 1 -- 172.21.15.81:0/2791708603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b6c054c30 con 0x7f9b78161fb0 2024-05-08T20:27:40.262 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 msgr2=0x7f9b58068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 0x7f9b58068c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b680b1000 tx=0x7f9b680a9070 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 msgr2=0x7f9b78155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e880 tx=0x7f9b6c00ed40 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 shutdown_connections 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b58066760 0x7f9b58068c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b78161fb0 0x7f9b78155260 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78161010 0x7f9b7815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 --2- 172.21.15.81:0/2791708603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b780c1ee0 0x7f9b780c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 >> 172.21.15.81:0/2791708603 conn(0x7f9b780c2a90 msgr2=0x7f9b78161550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 shutdown_connections 2024-05-08T20:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.258+0000 7f9b7759e640 1 -- 172.21.15.81:0/2791708603 wait complete. 2024-05-08T20:27:40.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-05-08T20:27:40.279 DEBUG:teuthology.parallel:result is None 2024-05-08T20:27:40.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T20:27:40.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.418+0000 7f936b7e0640 1 Processor -- start 2024-05-08T20:27:40.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.418+0000 7f936b7e0640 1 -- start start 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936b7e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93640aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936b7e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93640aac20 0x7f936406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936b7e0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640abc50 con 0x7f936406b510 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936b7e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640c2900 con 0x7f93640aac20 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936b7e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93640aa320 con 0x7f936414e410 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f936406b510 0x7f9364154410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39016/0 (socket says 172.21.15.81:39016) 2024-05-08T20:27:40.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 -- 172.21.15.81:0/4147117708 learned_addr learned my addr 172.21.15.81:0/4147117708 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936957c640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93640aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625281007 0 0) 0x7f93640abc50 con 0x7f936406b510 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9368d7b640 1 --2- 172.21.15.81:0/4147117708 >> v2:172.21.15.117:3300/0 conn(0x7f93640aac20 0x7f936406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9350004640 con 0x7f936406b510 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1417896706 0 0) 0x7f9350004640 con 0x7f936406b510 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 msgr2=0x7f93640aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93640aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 >> v2:172.21.15.117:3300/0 conn(0x7f93640aac20 msgr2=0x7f936406afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 --2- 172.21.15.81:0/4147117708 >> v2:172.21.15.117:3300/0 conn(0x7f93640aac20 0x7f936406afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640a9560 con 0x7f936406b510 2024-05-08T20:27:40.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f935c001a00 con 0x7f936406b510 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 >> v1:172.21.15.81:6789/0 conn(0x7f936406b510 legacy=0x7f9364154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350004a90 0x7f9350004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93500058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9350005e20 0x7f93500062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640c2900 con 0x7f9350005e20 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640aa320 con 0x7f9350004a90 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935000caa0 con 0x7f936414e410 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9350005e20 0x7f93500062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9368d7b640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93500058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f936957c640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350004a90 0x7f9350004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 -- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 msgr2=0x7f93500058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93500058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 -- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350004a90 msgr2=0x7f9350004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350004a90 0x7f9350004eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 -- 172.21.15.81:0/4147117708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350004640 con 0x7f9350005e20 2024-05-08T20:27:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9368d7b640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f936414e410 0x7f93500058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f9369d7d640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9350005e20 0x7f93500062a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f935c00a8d0 tx=0x7f935c01fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd3a317b7a48643 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0aa700 con 0x7f9350005e20 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c0aa860 con 0x7f9350005e20 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.422+0000 7f935bfff640 1 -- 172.21.15.81:0/4147117708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0aac10 con 0x7f9350005e20 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/4147117708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9350005e20 msgr2=0x7f93500062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 --2- 172.21.15.81:0/4147117708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9350005e20 0x7f93500062a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f935c00a8d0 tx=0x7f935c01fb60 comp rx=0 tx=0).stop 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f9369d7d640 1 -- 172.21.15.81:0/4147117708 reap_dead start 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/4147117708 shutdown_connections 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/4147117708 >> 172.21.15.81:0/4147117708 conn(0x7f93640c2ca0 msgr2=0x7f93640c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/4147117708 shutdown_connections 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/4147117708 wait complete. 2024-05-08T20:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 Processor -- start 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- start start 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9364145b20 0x7f9364153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93641455d0 0x7f93641eb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9364154800 con 0x7f93640c47a0 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93641453b0 con 0x7f93641455d0 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936414b000 con 0x7f9364145b20 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48346/0 (socket says 172.21.15.81:48346) 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 -- 172.21.15.81:0/3580395892 learned_addr learned my addr 172.21.15.81:0/3580395892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 -- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9364145b20 msgr2=0x7f9364153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9364145b20 0x7f9364153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 -- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93641455d0 msgr2=0x7f93641eb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93641455d0 0x7f93641eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 -- 172.21.15.81:0/3580395892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93641543e0 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936957c640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93600108c0 tx=0x7f9360010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360009630 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000ea80 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93641e8770 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000ee30 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9364145080 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.426+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9364074950 con 0x7f93640c47a0 2024-05-08T20:27:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.430+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f936001c400 con 0x7f93640c47a0 2024-05-08T20:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.430+0000 7f9359ffb640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 0x7f9348068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.430+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f93600849b0 con 0x7f93640c47a0 2024-05-08T20:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.430+0000 7f9368d7b640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 0x7f9348068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.430+0000 7f9368d7b640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 0x7f9348068b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9364145f40 tx=0x7f9354008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.434+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9360051a90 con 0x7f93640c47a0 2024-05-08T20:27:40.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.578+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93640a9e00 con 0x7f93480666c0 2024-05-08T20:27:40.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.590+0000 7f9359ffb640 1 -- 172.21.15.81:0/3580395892 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+502998 (secure 0 0 0) 0x7f9354010880 con 0x7f93480666c0 2024-05-08T20:27:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 msgr2=0x7f9348068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 0x7f9348068b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9364145f40 tx=0x7f9354008040 comp rx=0 tx=0).stop 2024-05-08T20:27:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 msgr2=0x7f9364153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93600108c0 tx=0x7f9360010d80 comp rx=0 tx=0).stop 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 shutdown_connections 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93480666c0 0x7f9348068b80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93641455d0 0x7f93641eb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9364145b20 0x7f9364153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 --2- 172.21.15.81:0/3580395892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93640c47a0 0x7f9364153960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 >> 172.21.15.81:0/3580395892 conn(0x7f93640c2ca0 msgr2=0x7f9364073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 shutdown_connections 2024-05-08T20:27:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.594+0000 7f936b7e0640 1 -- 172.21.15.81:0/3580395892 wait complete. 2024-05-08T20:27:40.617 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-05-08T20:27:39.229343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595092,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3346432,"data_stored":1982965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.269768"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962513+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:28.962513+0000","last_peered":"2024-05-08T20:27:28.962513+0000","last_clean":"2024-05-08T20:27:28.962513+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:28.962513+0000","last_undegraded":"2024-05-08T20:27:28.962513+0000","last_fullsized":"2024-05-08T20:27:28.962513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.027823+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:28.027823+0000","last_peered":"2024-05-08T20:27:28.027823+0000","last_clean":"2024-05-08T20:27:28.027823+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:28.027823+0000","last_undegraded":"2024-05-08T20:27:28.027823+0000","last_fullsized":"2024-05-08T20:27:28.027823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971546+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:27.971546+0000","last_peered":"2024-05-08T20:27:27.971546+0000","last_clean":"2024-05-08T20:27:27.971546+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:27.971546+0000","last_undegraded":"2024-05-08T20:27:27.971546+0000","last_fullsized":"2024-05-08T20:27:27.971546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:40.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.762+0000 7ff0c8ae1640 1 Processor -- start 2024-05-08T20:27:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.762+0000 7ff0c8ae1640 1 -- start start 2024-05-08T20:27:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0c41501e0 0x7ff0c406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0c40725f0 0x7ff0c40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40c0650 con 0x7ff0c406f400 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c406fd60 con 0x7ff0c40725f0 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c4072180 con 0x7ff0c41501e0 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0c40725f0 0x7ff0c40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0c40725f0 0x7ff0c40c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48348/0 (socket says 172.21.15.81:48348) 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 -- 172.21.15.81:0/1553099596 learned_addr learned my addr 172.21.15.81:0/1553099596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 -- 172.21.15.81:0/1553099596 >> v2:172.21.15.117:3300/0 conn(0x7ff0c41501e0 msgr2=0x7ff0c406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/1553099596 >> v2:172.21.15.117:3300/0 conn(0x7ff0c41501e0 0x7ff0c406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 -- 172.21.15.81:0/1553099596 >> v1:172.21.15.117:6789/0 conn(0x7ff0c406f400 legacy=0x7ff0c40c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 -- 172.21.15.81:0/1553099596 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c406fa80 con 0x7ff0c40725f0 2024-05-08T20:27:40.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/1553099596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40725f0 0x7ff0c40c1c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0c406ae70 tx=0x7ff0b401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809c0f0608ceb933 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c159a640 1 -- 172.21.15.81:0/1553099596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ac410 con 0x7ff0c40725f0 2024-05-08T20:27:40.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c159a640 1 -- 172.21.15.81:0/1553099596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b40ac570 con 0x7ff0c40725f0 2024-05-08T20:27:40.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c159a640 1 -- 172.21.15.81:0/1553099596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40ac900 con 0x7ff0c40725f0 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/1553099596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40725f0 msgr2=0x7ff0c40c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/1553099596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40725f0 0x7ff0c40c1c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0c406ae70 tx=0x7ff0b401c390 comp rx=0 tx=0).stop 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/1553099596 shutdown_connections 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/1553099596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40725f0 0x7ff0c40c1c40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/1553099596 >> v2:172.21.15.117:3300/0 conn(0x7ff0c41501e0 0x7ff0c406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/1553099596 >> 172.21.15.81:0/1553099596 conn(0x7ff0c40c2ca0 msgr2=0x7ff0c40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/1553099596 shutdown_connections 2024-05-08T20:27:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.766+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/1553099596 wait complete. 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 Processor -- start 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- start start 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 0x7ff0c4148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c41501e0 0x7ff0c41eaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c41462c0 con 0x7ff0c406f400 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4145fc0 con 0x7ff0c40725f0 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4149150 con 0x7ff0c41501e0 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48352/0 (socket says 172.21.15.81:48352) 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 -- 172.21.15.81:0/3991161340 learned_addr learned my addr 172.21.15.81:0/3991161340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 0x7ff0c4148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 -- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c41501e0 msgr2=0x7ff0c41eaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c41501e0 0x7ff0c41eaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 -- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 msgr2=0x7ff0c4148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 0x7ff0c4148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 -- 172.21.15.81:0/3991161340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40094d0 con 0x7ff0c406f400 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 0x7ff0c4148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c259c640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b580 tx=0x7ff0b800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8010870 con 0x7ff0c406f400 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b80109f0 con 0x7ff0c406f400 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c4150740 con 0x7ff0c406f400 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8010da0 con 0x7ff0c406f400 2024-05-08T20:27:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c414a000 con 0x7ff0c406f400 2024-05-08T20:27:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c4074950 con 0x7ff0c406f400 2024-05-08T20:27:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.770+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0b800f3c0 con 0x7ff0c406f400 2024-05-08T20:27:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.774+0000 7ff0b2ffd640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 0x7ff0a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.774+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 0x7ff0a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.774+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff0b80844c0 con 0x7ff0c406f400 2024-05-08T20:27:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.774+0000 7ff0c1d9b640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 0x7ff0a4068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40ae000 tx=0x7ff0b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.778+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff0b8051510 con 0x7ff0c406f400 2024-05-08T20:27:40.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.918+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0c41505c0 con 0x7ff0a4066690 2024-05-08T20:27:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.954+0000 7ff0b2ffd640 1 -- 172.21.15.81:0/3991161340 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+502998 (secure 0 0 0) 0x7ff0b40ac880 con 0x7ff0a4066690 2024-05-08T20:27:40.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 msgr2=0x7ff0a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 0x7ff0a4068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40ae000 tx=0x7ff0b4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 msgr2=0x7ff0c4146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b580 tx=0x7ff0b800ba40 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 shutdown_connections 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0a4066690 0x7ff0a4068b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c41501e0 0x7ff0c41eaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c40725f0 0x7ff0c4148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 --2- 172.21.15.81:0/3991161340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c406f400 0x7ff0c4146750 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 >> 172.21.15.81:0/3991161340 conn(0x7ff0c40c2ca0 msgr2=0x7ff0c406c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 shutdown_connections 2024-05-08T20:27:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:40.958+0000 7ff0c8ae1640 1 -- 172.21.15.81:0/3991161340 wait complete. 2024-05-08T20:27:40.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-05-08T20:27:39.229343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595092,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3346432,"data_stored":1982965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.269768"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962513+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:28.962513+0000","last_peered":"2024-05-08T20:27:28.962513+0000","last_clean":"2024-05-08T20:27:28.962513+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:28.962513+0000","last_undegraded":"2024-05-08T20:27:28.962513+0000","last_fullsized":"2024-05-08T20:27:28.962513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.027823+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:28.027823+0000","last_peered":"2024-05-08T20:27:28.027823+0000","last_clean":"2024-05-08T20:27:28.027823+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:28.027823+0000","last_undegraded":"2024-05-08T20:27:28.027823+0000","last_fullsized":"2024-05-08T20:27:28.027823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971546+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:27.971546+0000","last_peered":"2024-05-08T20:27:27.971546+0000","last_clean":"2024-05-08T20:27:27.971546+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:27.971546+0000","last_undegraded":"2024-05-08T20:27:27.971546+0000","last_fullsized":"2024-05-08T20:27:27.971546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:40.991 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T20:27:40.991 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T20:27:40.992 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T20:27:40.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T20:27:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 Processor -- start 2024-05-08T20:27:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 -- start start 2024-05-08T20:27:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8341501e0 0x7ff83406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8340725f0 0x7ff8340c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340c0650 con 0x7ff83406f400 2024-05-08T20:27:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83406fd60 con 0x7ff8340725f0 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff83bd58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834072180 con 0x7ff8341501e0 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8340725f0 0x7ff8340c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8340725f0 0x7ff8340c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48362/0 (socket says 172.21.15.81:48362) 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 -- 172.21.15.81:0/29181667 learned_addr learned my addr 172.21.15.81:0/29181667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff839af4640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8341501e0 0x7ff83406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 -- 172.21.15.81:0/29181667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8341501e0 msgr2=0x7ff83406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8341501e0 0x7ff83406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 -- 172.21.15.81:0/29181667 >> v1:172.21.15.117:6789/0 conn(0x7ff83406f400 legacy=0x7ff8340c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.138+0000 7ff8392f3640 1 -- 172.21.15.81:0/29181667 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83406fa80 con 0x7ff8340725f0 2024-05-08T20:27:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff8392f3640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8340725f0 0x7ff8340c1c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff824009870 tx=0x7ff82401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6820dc87ea5b0a5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff838af2640 1 -- 172.21.15.81:0/29181667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240ac410 con 0x7ff8340725f0 2024-05-08T20:27:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff838af2640 1 -- 172.21.15.81:0/29181667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8240ac570 con 0x7ff8340725f0 2024-05-08T20:27:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff838af2640 1 -- 172.21.15.81:0/29181667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240ac900 con 0x7ff8340725f0 2024-05-08T20:27:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- 172.21.15.81:0/29181667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8340725f0 msgr2=0x7ff8340c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8340725f0 0x7ff8340c1c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff824009870 tx=0x7ff82401c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- 172.21.15.81:0/29181667 shutdown_connections 2024-05-08T20:27:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8340725f0 0x7ff8340c1c40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 --2- 172.21.15.81:0/29181667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8341501e0 0x7ff83406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- 172.21.15.81:0/29181667 >> 172.21.15.81:0/29181667 conn(0x7ff8340c2ca0 msgr2=0x7ff8340c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- 172.21.15.81:0/29181667 shutdown_connections 2024-05-08T20:27:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- 172.21.15.81:0/29181667 wait complete. 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 Processor -- start 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.142+0000 7ff83bd58640 1 -- start start 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 0x7ff8341464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8340725f0 0x7ff834146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341eef60 con 0x7ff8341501e0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83414cd10 con 0x7ff8340725f0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83406c200 con 0x7ff83406f400 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48364/0 (socket says 172.21.15.81:48364) 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 -- 172.21.15.81:0/681286316 learned_addr learned my addr 172.21.15.81:0/681286316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff839af4640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 0x7ff8341464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 -- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 msgr2=0x7ff8341464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 0x7ff8341464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff8392f3640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8340725f0 0x7ff834146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 -- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8340725f0 msgr2=0x7ff834146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8340725f0 0x7ff834146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 -- 172.21.15.81:0/681286316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240094d0 con 0x7ff8341501e0 2024-05-08T20:27:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff839af4640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 0x7ff8341464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83a2f5640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b9a0 tx=0x7ff82c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00cb40 con 0x7ff8341501e0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00cca0 con 0x7ff8341501e0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c014680 con 0x7ff8341501e0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff834150740 con 0x7ff8341501e0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834146f70 con 0x7ff8341501e0 2024-05-08T20:27:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff834074950 con 0x7ff8341501e0 2024-05-08T20:27:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff82c01d3b0 con 0x7ff8341501e0 2024-05-08T20:27:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 0x7ff818068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff82c0841b0 con 0x7ff8341501e0 2024-05-08T20:27:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff839af4640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 0x7ff818068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.146+0000 7ff839af4640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 0x7ff818068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff830009840 tx=0x7ff830008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.150+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff82c051280 con 0x7ff8341501e0 2024-05-08T20:27:41.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.330+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8341ec4e0 con 0x7ff8341501e0 2024-05-08T20:27:41.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.330+0000 7ff82a7fc640 1 -- 172.21.15.81:0/681286316 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff82c0548a0 con 0x7ff8341501e0 2024-05-08T20:27:41.338 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:41.338 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T20:27:41.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 msgr2=0x7ff818068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 0x7ff818068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff830009840 tx=0x7ff830008040 comp rx=0 tx=0).stop 2024-05-08T20:27:41.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 msgr2=0x7ff83413c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b9a0 tx=0x7ff82c00be60 comp rx=0 tx=0).stop 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 shutdown_connections 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8180666c0 0x7ff818068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8341501e0 0x7ff83413c3b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8340725f0 0x7ff834146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 --2- 172.21.15.81:0/681286316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff83406f400 0x7ff8341464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 >> 172.21.15.81:0/681286316 conn(0x7ff8340c2ca0 msgr2=0x7ff8340712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 shutdown_connections 2024-05-08T20:27:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.334+0000 7ff83bd58640 1 -- 172.21.15.81:0/681286316 wait complete. 2024-05-08T20:27:41.355 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T20:27:41.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 Processor -- start 2024-05-08T20:27:41.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 -- start start 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae8154cf0 0x7f8ae8155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae8158e20 con 0x7f8ae8155690 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae806bb20 con 0x7f8ae8154cf0 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8aed40c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81548e0 con 0x7f8ae8151f00 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae8154cf0 0x7f8ae8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ae8154cf0 0x7f8ae8155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48380/0 (socket says 172.21.15.81:48380) 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 -- 172.21.15.81:0/464176587 learned_addr learned my addr 172.21.15.81:0/464176587 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 -- 172.21.15.81:0/464176587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 msgr2=0x7f8ae81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae81588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 -- 172.21.15.81:0/464176587 >> v1:172.21.15.117:6789/0 conn(0x7f8ae8155690 legacy=0x7f8ae80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae67fc640 1 -- 172.21.15.81:0/464176587 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae81522e0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.458+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:41.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8155150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00098a0 tx=0x7f8ad001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8252dcef13047b4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae5ffb640 1 -- 172.21.15.81:0/464176587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00ac620 con 0x7f8ae8154cf0 2024-05-08T20:27:41.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae5ffb640 1 -- 172.21.15.81:0/464176587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00ac780 con 0x7f8ae8154cf0 2024-05-08T20:27:41.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae5ffb640 1 -- 172.21.15.81:0/464176587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00acb10 con 0x7f8ae8154cf0 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/464176587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 msgr2=0x7f8ae8155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8155150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00098a0 tx=0x7f8ad001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/464176587 shutdown_connections 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8155150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- 172.21.15.81:0/464176587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/464176587 >> 172.21.15.81:0/464176587 conn(0x7f8ae80715f0 msgr2=0x7f8ae8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/464176587 shutdown_connections 2024-05-08T20:27:41.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/464176587 wait complete. 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 Processor -- start 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- start start 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 0x7f8ae8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81f1720 con 0x7f8ae8154cf0 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae814dde0 con 0x7f8ae80aeb90 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8155d10 con 0x7f8ae8151f00 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48394/0 (socket says 172.21.15.81:48394) 2024-05-08T20:27:41.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 -- 172.21.15.81:0/3763801581 learned_addr learned my addr 172.21.15.81:0/3763801581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae77fe640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 0x7f8ae8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 -- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 msgr2=0x7f8ae8150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae8150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 -- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 msgr2=0x7f8ae8157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 0x7f8ae8157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 -- 172.21.15.81:0/3763801581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00094d0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae77fe640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 0x7f8ae8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8ae67fc640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00af040 tx=0x7f8ad001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b7620 con 0x7f8ae8154cf0 2024-05-08T20:27:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00b77a0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae8155ff0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b7b50 con 0x7f8ae8154cf0 2024-05-08T20:27:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.462+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80c9680 con 0x7f8ae8154cf0 2024-05-08T20:27:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae8156180 con 0x7f8ae8154cf0 2024-05-08T20:27:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ad00b3040 con 0x7f8ae8154cf0 2024-05-08T20:27:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8adf7fe640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 0x7f8ac8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8ad011e9f0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 0x7f8ac8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.466+0000 7f8ae6ffd640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 0x7f8ac8068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8008930 tx=0x7f8ad8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.470+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8ad00ebb80 con 0x7f8ae8154cf0 2024-05-08T20:27:41.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.618+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ae8074950 con 0x7f8ae8154cf0 2024-05-08T20:27:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8adf7fe640 1 -- 172.21.15.81:0/3763801581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f8ad00ef1a0 con 0x7f8ae8154cf0 2024-05-08T20:27:41.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:41.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 msgr2=0x7f8ac8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 0x7f8ac8068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8008930 tx=0x7f8ad8008040 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 msgr2=0x7f8ae8151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00af040 tx=0x7f8ad001ac20 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 shutdown_connections 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8ac8066690 0x7f8ac8068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ae80aeb90 0x7f8ae8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae8154cf0 0x7f8ae8151270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 --2- 172.21.15.81:0/3763801581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ae8151f00 0x7f8ae8150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 >> 172.21.15.81:0/3763801581 conn(0x7f8ae80715f0 msgr2=0x7f8ae8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 shutdown_connections 2024-05-08T20:27:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.622+0000 7f8aed40c640 1 -- 172.21.15.81:0/3763801581 wait complete. 2024-05-08T20:27:41.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:41.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:41.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.746+0000 7fc34a299640 1 Processor -- start 2024-05-08T20:27:41.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.746+0000 7fc34a299640 1 -- start start 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc34a299640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3440c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc34a299640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344155e10 con 0x7fc3440c2bc0 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc34a299640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344156080 con 0x7fc3440a94b0 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc34a299640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406e790 con 0x7fc3440c30d0 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc33b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3440c2bc0 0x7fc3440c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39018/0 (socket says 172.21.15.81:39018) 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc33b7fe640 1 -- 172.21.15.81:0/422337020 learned_addr learned my addr 172.21.15.81:0/422337020 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007214269 0 0) 0x7fc344155e10 con 0x7fc3440c2bc0 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc330003530 con 0x7fc3440c2bc0 2024-05-08T20:27:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc343fff640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3440c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195351992 0 0) 0x7fc330003530 con 0x7fc3440c2bc0 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 msgr2=0x7fc3440c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3440c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 >> v1:172.21.15.117:6789/0 conn(0x7fc3440a94b0 legacy=0x7fc3440a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344156360 con 0x7fc3440c2bc0 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc32c001680 con 0x7fc3440c2bc0 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc343fff640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3440c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 >> v1:172.21.15.81:6789/0 conn(0x7fc3440c2bc0 legacy=0x7fc3440c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300039b0 0x7fc330003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc330004d10 0x7fc330005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406e790 con 0x7fc330004d10 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33000bb20 con 0x7fc3300039b0 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33000bce0 con 0x7fc3440c30d0 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc330004d10 0x7fc330005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc343fff640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300039b0 0x7fc330003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc33b7fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 -- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 msgr2=0x7fc3300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 -- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300039b0 msgr2=0x7fc330003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3300039b0 0x7fc330003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc348836640 1 -- 172.21.15.81:0/422337020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330003530 con 0x7fc330004d10 2024-05-08T20:27:41.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.750+0000 7fc33b7fe640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3440c30d0 0x7fc3300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:41.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc330004d10 0x7fc330005190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc33c001e70 tx=0x7fc33c01c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78026257e93f6f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c003b80 con 0x7fc330004d10 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c003ce0 con 0x7fc330004d10 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3437fe640 1 -- 172.21.15.81:0/422337020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c005310 con 0x7fc330004d10 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/422337020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc330004d10 msgr2=0x7fc330005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 --2- 172.21.15.81:0/422337020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc330004d10 0x7fc330005190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc33c001e70 tx=0x7fc33c01c5a0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 -- 172.21.15.81:0/422337020 reap_dead start 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/422337020 shutdown_connections 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/422337020 >> 172.21.15.81:0/422337020 conn(0x7fc3440c4cc0 msgr2=0x7fc3440c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/422337020 shutdown_connections 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/422337020 wait complete. 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 Processor -- start 2024-05-08T20:27:41.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- start start 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc330004d10 0x7fc34406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406ca90 0x7fc34414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441eb290 con 0x7fc34406c3b0 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406b780 con 0x7fc34406ca90 2024-05-08T20:27:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440c1bc0 con 0x7fc330004d10 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48414/0 (socket says 172.21.15.81:48414) 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 -- 172.21.15.81:0/1867281754 learned_addr learned my addr 172.21.15.81:0/1867281754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc343fff640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc330004d10 0x7fc34406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc33b7fe640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406ca90 0x7fc34414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 -- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc330004d10 msgr2=0x7fc34406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc330004d10 0x7fc34406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 -- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406ca90 msgr2=0x7fc34414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406ca90 0x7fc34414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 -- 172.21.15.81:0/1867281754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34406c150 con 0x7fc34406c3b0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc348836640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005040 tx=0x7fc330005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c003e50 con 0x7fc34406c3b0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c003980 con 0x7fc34406c3b0 2024-05-08T20:27:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34406b170 con 0x7fc34406c3b0 2024-05-08T20:27:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c005310 con 0x7fc34406c3b0 2024-05-08T20:27:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.754+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3441eafb0 con 0x7fc34406c3b0 2024-05-08T20:27:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34406afd0 con 0x7fc34406c3b0 2024-05-08T20:27:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc33c0a8050 con 0x7fc34406c3b0 2024-05-08T20:27:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc3417fa640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 0x7fc324068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fc33c11e090 con 0x7fc34406c3b0 2024-05-08T20:27:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc343fff640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 0x7fc324068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.758+0000 7fc343fff640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 0x7fc324068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e900 tx=0x7fc334008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.762+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc34406afd0 con 0x7fc34406c3b0 2024-05-08T20:27:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc34406afd0 con 0x7fc34406c3b0 2024-05-08T20:27:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc3417fa640 1 -- 172.21.15.81:0/1867281754 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc34406afd0 con 0x7fc34406c3b0 2024-05-08T20:27:41.913 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 msgr2=0x7fc324068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 0x7fc324068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc33400e900 tx=0x7fc334008040 comp rx=0 tx=0).stop 2024-05-08T20:27:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 msgr2=0x7fc344151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005040 tx=0x7fc330005800 comp rx=0 tx=0).stop 2024-05-08T20:27:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.906+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 shutdown_connections 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066690 0x7fc324068b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc34406c3b0 0x7fc344151ac0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34406ca90 0x7fc34414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 --2- 172.21.15.81:0/1867281754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc330004d10 0x7fc34406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 >> 172.21.15.81:0/1867281754 conn(0x7fc3440c4cc0 msgr2=0x7fc34414f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 shutdown_connections 2024-05-08T20:27:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:41.910+0000 7fc34a299640 1 -- 172.21.15.81:0/1867281754 wait complete. 2024-05-08T20:27:41.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:27:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.038+0000 7fcda2803640 1 Processor -- start 2024-05-08T20:27:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.038+0000 7fcda2803640 1 -- start start 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcda2803640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd9c154cf0 0x7fcd9c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcda2803640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd9c155690 0x7fcd9c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcda2803640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c1522e0 con 0x7fcd9c151f00 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcda2803640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c06bb20 con 0x7fcd9c154cf0 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcda2803640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c1548e0 con 0x7fcd9c155690 2024-05-08T20:27:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd9c154cf0 0x7fcd9c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd9c154cf0 0x7fcd9c155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48424/0 (socket says 172.21.15.81:48424) 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 -- 172.21.15.81:0/3404593556 learned_addr learned my addr 172.21.15.81:0/3404593556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 -- 172.21.15.81:0/3404593556 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c155690 msgr2=0x7fcd9c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3404593556 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c155690 0x7fcd9c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 -- 172.21.15.81:0/3404593556 >> v1:172.21.15.117:6789/0 conn(0x7fcd9c151f00 legacy=0x7fcd9c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 -- 172.21.15.81:0/3404593556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0c5f80 con 0x7fcd9c154cf0 2024-05-08T20:27:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3404593556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c155150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0caee0 tx=0x7fcd8401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86984fdcd923c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd9b7fe640 1 -- 172.21.15.81:0/3404593556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840ad660 con 0x7fcd9c154cf0 2024-05-08T20:27:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd9b7fe640 1 -- 172.21.15.81:0/3404593556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd840ad7c0 con 0x7fcd9c154cf0 2024-05-08T20:27:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.042+0000 7fcd9b7fe640 1 -- 172.21.15.81:0/3404593556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd840adb50 con 0x7fcd9c154cf0 2024-05-08T20:27:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/3404593556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c154cf0 msgr2=0x7fcd9c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- 172.21.15.81:0/3404593556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c155150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0caee0 tx=0x7fcd8401c3c0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/3404593556 shutdown_connections 2024-05-08T20:27:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- 172.21.15.81:0/3404593556 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c155690 0x7fcd9c0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- 172.21.15.81:0/3404593556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c155150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/3404593556 >> 172.21.15.81:0/3404593556 conn(0x7fcd9c0715f0 msgr2=0x7fcd9c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/3404593556 shutdown_connections 2024-05-08T20:27:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/3404593556 wait complete. 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 Processor -- start 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- start start 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c151f00 0x7fcd9c144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c1ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1ecf90 con 0x7fcd9c144bc0 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c14e230 con 0x7fcd9c154cf0 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c157810 con 0x7fcd9c151f00 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48434/0 (socket says 172.21.15.81:48434) 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 -- 172.21.15.81:0/4183698870 learned_addr learned my addr 172.21.15.81:0/4183698870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcd937fe640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c1ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcd9bfff640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c151f00 0x7fcd9c144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 -- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c151f00 msgr2=0x7fcd9c144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c151f00 0x7fcd9c144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 -- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c154cf0 msgr2=0x7fcd9c1ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c1ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 -- 172.21.15.81:0/4183698870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840094d0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda0da0640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b970 tx=0x7fcd9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400cb40 con 0x7fcd9c144bc0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400ccc0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c1f1110 con 0x7fcd9c144bc0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94014680 con 0x7fcd9c144bc0 2024-05-08T20:27:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.046+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c14e760 con 0x7fcd9c144bc0 2024-05-08T20:27:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c152730 con 0x7fcd9c144bc0 2024-05-08T20:27:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd9401d3b0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcd997fa640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 0x7fcd7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcd940843b0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcd9bfff640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 0x7fcd7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.050+0000 7fcd9bfff640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 0x7fcd7c068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c004e30 tx=0x7fcd8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.054+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcd94051480 con 0x7fcd9c144bc0 2024-05-08T20:27:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.198+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd9c0675e0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.198+0000 7fcd997fa640 1 -- 172.21.15.81:0/4183698870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7fcd94054aa0 con 0x7fcd9c144bc0 2024-05-08T20:27:42.206 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 msgr2=0x7fcd7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 0x7fcd7c068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c004e30 tx=0x7fcd8c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 msgr2=0x7fcd9c1ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b970 tx=0x7fcd9400be30 comp rx=0 tx=0).stop 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 shutdown_connections 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd7c066690 0x7fcd7c068b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd9c144bc0 0x7fcd9c1ed8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c154cf0 0x7fcd9c1ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 --2- 172.21.15.81:0/4183698870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c151f00 0x7fcd9c144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 >> 172.21.15.81:0/4183698870 conn(0x7fcd9c0715f0 msgr2=0x7fcd9c15e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 shutdown_connections 2024-05-08T20:27:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.202+0000 7fcda2803640 1 -- 172.21.15.81:0/4183698870 wait complete. 2024-05-08T20:27:42.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:27:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.334+0000 7f90ccb74640 1 Processor -- start 2024-05-08T20:27:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.334+0000 7f90ccb74640 1 -- start start 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90ccb74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c8151740 0x7f90c80c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90ccb74640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c81535a0 0x7f90c815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90ccb74640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c8155060 con 0x7f90c80c1bb0 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90ccb74640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c8155340 con 0x7f90c81535a0 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90ccb74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8155620 con 0x7f90c8151740 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c81535a0 0x7f90c815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90c81535a0 0x7f90c815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48442/0 (socket says 172.21.15.81:48442) 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 -- 172.21.15.81:0/2510956133 learned_addr learned my addr 172.21.15.81:0/2510956133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c5d9b640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c8151740 0x7f90c80c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 -- 172.21.15.81:0/2510956133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c8151740 msgr2=0x7f90c80c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c8151740 0x7f90c80c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 -- 172.21.15.81:0/2510956133 >> v1:172.21.15.117:6789/0 conn(0x7f90c80c1bb0 legacy=0x7f90c8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 -- 172.21.15.81:0/2510956133 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8155900 con 0x7f90c81535a0 2024-05-08T20:27:42.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c6d9d640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c81535a0 0x7f90c815c080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a4fb1da63154d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c559a640 1 -- 172.21.15.81:0/2510956133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00ad660 con 0x7f90c81535a0 2024-05-08T20:27:42.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c559a640 1 -- 172.21.15.81:0/2510956133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00ad7c0 con 0x7f90c81535a0 2024-05-08T20:27:42.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.338+0000 7f90c559a640 1 -- 172.21.15.81:0/2510956133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00adb50 con 0x7f90c81535a0 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/2510956133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c81535a0 msgr2=0x7f90c815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c81535a0 0x7f90c815c080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009870 tx=0x7f90c001c450 comp rx=0 tx=0).stop 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/2510956133 shutdown_connections 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c81535a0 0x7f90c815c080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- 172.21.15.81:0/2510956133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c8151740 0x7f90c80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/2510956133 >> 172.21.15.81:0/2510956133 conn(0x7f90c80c2ca0 msgr2=0x7f90c80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/2510956133 shutdown_connections 2024-05-08T20:27:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/2510956133 wait complete. 2024-05-08T20:27:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 Processor -- start 2024-05-08T20:27:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- start start 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90c8151740 0x7f90c806bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c81535a0 0x7f90c806c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c814bb70 con 0x7f90c80c1bb0 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8145de0 con 0x7f90c8151740 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c81464e0 con 0x7f90c81535a0 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48454/0 (socket says 172.21.15.81:48454) 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 -- 172.21.15.81:0/3492331835 learned_addr learned my addr 172.21.15.81:0/3492331835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c5d9b640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90c8151740 0x7f90c806bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c6d9d640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c81535a0 0x7f90c806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 -- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c81535a0 msgr2=0x7f90c806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c81535a0 0x7f90c806c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 -- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90c8151740 msgr2=0x7f90c806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90c8151740 0x7f90c806bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 -- 172.21.15.81:0/3492331835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00094d0 con 0x7f90c80c1bb0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90c659c640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b410 tx=0x7f90bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004020 con 0x7f90c80c1bb0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc004180 con 0x7f90c80c1bb0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c814f190 con 0x7f90c80c1bb0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc011630 con 0x7f90c80c1bb0 2024-05-08T20:27:42.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c806b220 con 0x7f90c80c1bb0 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.342+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8074950 con 0x7f90c80c1bb0 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.346+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90bc011790 con 0x7f90c80c1bb0 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.346+0000 7f90b6ffd640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 0x7f90a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.346+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f90bc084200 con 0x7f90c80c1bb0 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.346+0000 7f90c5d9b640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 0x7f90a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.346+0000 7f90c5d9b640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 0x7f90a8068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f90c80aa740 tx=0x7f90b80083a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.350+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f90bc0512d0 con 0x7f90c80c1bb0 2024-05-08T20:27:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.502+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f90c80c39a0 con 0x7f90c80c1bb0 2024-05-08T20:27:42.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90b6ffd640 1 -- 172.21.15.81:0/3492331835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7f90bc0548f0 con 0x7f90c80c1bb0 2024-05-08T20:27:42.511 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 msgr2=0x7f90a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 0x7f90a8068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f90c80aa740 tx=0x7f90b80083a0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 msgr2=0x7f90c80714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b410 tx=0x7f90bc00b8d0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 shutdown_connections 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f90a8066690 0x7f90a8068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90c81535a0 0x7f90c806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90c8151740 0x7f90c806bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 --2- 172.21.15.81:0/3492331835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c80c1bb0 0x7f90c80714c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 >> 172.21.15.81:0/3492331835 conn(0x7f90c80c2ca0 msgr2=0x7f90c80c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 shutdown_connections 2024-05-08T20:27:42.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.506+0000 7f90ccb74640 1 -- 172.21.15.81:0/3492331835 wait complete. 2024-05-08T20:27:42.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:27:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 Processor -- start 2024-05-08T20:27:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 -- start start 2024-05-08T20:27:42.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb600a9bc0 0x7ffb600c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60155e10 con 0x7ffb600c30d0 2024-05-08T20:27:42.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60156080 con 0x7ffb600c2bc0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb6492e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6006e790 con 0x7ffb600a9bc0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffb600c30d0 0x7ffb600c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39034/0 (socket says 172.21.15.81:39034) 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5e59c640 1 -- 172.21.15.81:0/3441714024 learned_addr learned my addr 172.21.15.81:0/3441714024 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/3441714024 >> v2:172.21.15.117:3300/0 conn(0x7ffb600a9bc0 0x7ffb600c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280285739 0 0) 0x7ffb60155e10 con 0x7ffb600c30d0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb48003530 con 0x7ffb600c30d0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501022665 0 0) 0x7ffb48003530 con 0x7ffb600c30d0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 >> v2:172.21.15.117:3300/0 conn(0x7ffb600a9bc0 msgr2=0x7ffb600c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 --2- 172.21.15.81:0/3441714024 >> v2:172.21.15.117:3300/0 conn(0x7ffb600a9bc0 0x7ffb600c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 >> v1:172.21.15.117:6789/0 conn(0x7ffb600c2bc0 legacy=0x7ffb600a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60156360 con 0x7ffb600c30d0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ffb50001680 con 0x7ffb600c30d0 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 >> v1:172.21.15.81:6789/0 conn(0x7ffb600c30d0 legacy=0x7ffb600c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb48003980 0x7ffb48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb480047d0 0x7ffb48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6006e790 con 0x7ffb480052b0 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800c180 con 0x7ffb480047d0 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4800c340 con 0x7ffb48003980 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5dd9b640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb480047d0 0x7ffb48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5e59c640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb48003980 0x7ffb48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 -- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb48003980 msgr2=0x7ffb48003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb48003980 0x7ffb48003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 -- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb480047d0 msgr2=0x7ffb48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb480047d0 0x7ffb48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.642+0000 7ffb5ed9d640 1 -- 172.21.15.81:0/3441714024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48003530 con 0x7ffb480052b0 2024-05-08T20:27:42.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5ed9d640 1 -- 172.21.15.81:0/3441714024 reap_dead start 2024-05-08T20:27:42.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb4800b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007330 tx=0x7ffb5801ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abdc752b7dd2f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580a5d60 con 0x7ffb480052b0 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580039a0 con 0x7ffb480052b0 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5d59a640 1 -- 172.21.15.81:0/3441714024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58003d50 con 0x7ffb480052b0 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 msgr2=0x7ffb4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb4800b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb58007330 tx=0x7ffb5801ce60 comp rx=0 tx=0).stop 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- 172.21.15.81:0/3441714024 shutdown_connections 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 --2- 172.21.15.81:0/3441714024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb4800b990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- 172.21.15.81:0/3441714024 >> 172.21.15.81:0/3441714024 conn(0x7ffb600c4cc0 msgr2=0x7ffb600c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- 172.21.15.81:0/3441714024 shutdown_connections 2024-05-08T20:27:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- 172.21.15.81:0/3441714024 wait complete. 2024-05-08T20:27:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 Processor -- start 2024-05-08T20:27:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- start start 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb60155880 0x7ffb6013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb600c7b60 0x7ffb6013ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60147470 con 0x7ffb480052b0 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601ea050 con 0x7ffb60155880 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb6492e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601ea240 con 0x7ffb600c7b60 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48474/0 (socket says 172.21.15.81:48474) 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 -- 172.21.15.81:0/1494703980 learned_addr learned my addr 172.21.15.81:0/1494703980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5ed9d640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb600c7b60 0x7ffb6013ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5dd9b640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb60155880 0x7ffb6013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 -- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb600c7b60 msgr2=0x7ffb6013ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb600c7b60 0x7ffb6013ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 -- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb60155880 msgr2=0x7ffb6013e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb60155880 0x7ffb6013e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 -- 172.21.15.81:0/1494703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb601ea520 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb5e59c640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000fc0 tx=0x7ffb5000e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.646+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000ed10 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5000ee70 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb601ea800 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500145a0 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb601eadc0 con 0x7ffb480052b0 2024-05-08T20:27:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb601eafe0 con 0x7ffb480052b0 2024-05-08T20:27:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb50014700 con 0x7ffb480052b0 2024-05-08T20:27:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb4effd640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 0x7ffb40068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ffb500873a0 con 0x7ffb480052b0 2024-05-08T20:27:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb5dd9b640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 0x7ffb40068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.650+0000 7ffb5dd9b640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 0x7ffb40068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffb60146b00 tx=0x7ffb54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.654+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ffb50054470 con 0x7ffb480052b0 2024-05-08T20:27:42.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.798+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb60074950 con 0x7ffb480052b0 2024-05-08T20:27:42.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.798+0000 7ffb4effd640 1 -- 172.21.15.81:0/1494703980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7ffb50057a90 con 0x7ffb480052b0 2024-05-08T20:27:42.806 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 msgr2=0x7ffb40068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 0x7ffb40068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffb60146b00 tx=0x7ffb54009040 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 msgr2=0x7ffb60154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000fc0 tx=0x7ffb5000e100 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 shutdown_connections 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb400666c0 0x7ffb40068b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb600c7b60 0x7ffb6013ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb60155880 0x7ffb6013e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 --2- 172.21.15.81:0/1494703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb480052b0 0x7ffb60154ca0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 >> 172.21.15.81:0/1494703980 conn(0x7ffb600c4cc0 msgr2=0x7ffb6014daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 shutdown_connections 2024-05-08T20:27:42.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.802+0000 7ffb6492e640 1 -- 172.21.15.81:0/1494703980 wait complete. 2024-05-08T20:27:42.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:27:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.934+0000 7fdfe00c4640 1 Processor -- start 2024-05-08T20:27:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.934+0000 7fdfe00c4640 1 -- start start 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfe00c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfd81522b0 0x7fdfd80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfe00c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfe00c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80c8b10 con 0x7fdfd8154970 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfe00c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd8152690 con 0x7fdfd81522b0 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfe00c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8069ec0 con 0x7fdfd80c7280 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdd65f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfd81522b0 0x7fdfd80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdd65f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:49480/0 (socket says 172.21.15.81:49480) 2024-05-08T20:27:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfd81522b0 0x7fdfd80c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52590/0 (socket says 172.21.15.81:52590) 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdd65f640 1 -- 172.21.15.81:0/3697524878 learned_addr learned my addr 172.21.15.81:0/3697524878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfde661640 1 --1- 172.21.15.81:0/3697524878 >> v1:172.21.15.117:6789/0 conn(0x7fdfd8154970 0x7fdfd806a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:43018/0 (socket says 172.21.15.81:43018) 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 -- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 msgr2=0x7fdfd806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 -- 172.21.15.81:0/3697524878 >> v1:172.21.15.117:6789/0 conn(0x7fdfd8154970 legacy=0x7fdfd806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 -- 172.21.15.81:0/3697524878 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8154ee0 con 0x7fdfd81522b0 2024-05-08T20:27:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdd65f640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:27:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdde60640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd81522b0 0x7fdfd80c6d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40097c0 tx=0x7fdfd401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77fba07f71df66ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdce5e640 1 -- 172.21.15.81:0/3697524878 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40ac640 con 0x7fdfd81522b0 2024-05-08T20:27:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdce5e640 1 -- 172.21.15.81:0/3697524878 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40ac7a0 con 0x7fdfd81522b0 2024-05-08T20:27:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.938+0000 7fdfdce5e640 1 -- 172.21.15.81:0/3697524878 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40acb30 con 0x7fdfd81522b0 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd81522b0 msgr2=0x7fdfd80c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd81522b0 0x7fdfd80c6d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40097c0 tx=0x7fdfd401c3e0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3697524878 shutdown_connections 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd80c7280 0x7fdfd806a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3697524878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd81522b0 0x7fdfd80c6d40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3697524878 >> 172.21.15.81:0/3697524878 conn(0x7fdfd80ca330 msgr2=0x7fdfd80ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3697524878 shutdown_connections 2024-05-08T20:27:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3697524878 wait complete. 2024-05-08T20:27:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 Processor -- start 2024-05-08T20:27:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- start start 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd8154970 0x7fdfd80bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 0x7fdfd81edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c32e0 con 0x7fdfd80c7280 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81ed330 con 0x7fdfd814bba0 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81f17a0 con 0x7fdfd8154970 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48478/0 (socket says 172.21.15.81:48478) 2024-05-08T20:27:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 -- 172.21.15.81:0/3834240522 learned_addr learned my addr 172.21.15.81:0/3834240522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfde661640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 0x7fdfd81edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdd65f640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd8154970 0x7fdfd80bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 -- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd8154970 msgr2=0x7fdfd80bd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd8154970 0x7fdfd80bd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 -- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 msgr2=0x7fdfd81edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 0x7fdfd81edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 -- 172.21.15.81:0/3834240522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009480 con 0x7fdfd80c7280 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfde661640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 0x7fdfd81edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfdde60640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40af040 tx=0x7fdfd401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40b8650 con 0x7fdfd80c7280 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40b87b0 con 0x7fdfd80c7280 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd4009420 con 0x7fdfd80c7280 2024-05-08T20:27:42.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40b8b60 con 0x7fdfd80c7280 2024-05-08T20:27:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd814db10 con 0x7fdfd80c7280 2024-05-08T20:27:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.942+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd80675e0 con 0x7fdfd80c7280 2024-05-08T20:27:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.946+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfd40b8cc0 con 0x7fdfd80c7280 2024-05-08T20:27:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.946+0000 7fdfce7fc640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 0x7fdfbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.946+0000 7fdfdd65f640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 0x7fdfbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.946+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdfd411ef50 con 0x7fdfd80c7280 2024-05-08T20:27:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.946+0000 7fdfdd65f640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 0x7fdfbc068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8006fd0 tx=0x7fdfc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:42.950+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fdfd40ec020 con 0x7fdfd80c7280 2024-05-08T20:27:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.106+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fdfd8074950 con 0x7fdfd80c7280 2024-05-08T20:27:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.106+0000 7fdfce7fc640 1 -- 172.21.15.81:0/3834240522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7fdfd40b1020 con 0x7fdfd80c7280 2024-05-08T20:27:43.114 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 msgr2=0x7fdfbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 0x7fdfbc068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8006fd0 tx=0x7fdfc8008040 comp rx=0 tx=0).stop 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 msgr2=0x7fdfd81f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40af040 tx=0x7fdfd401ac20 comp rx=0 tx=0).stop 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 shutdown_connections 2024-05-08T20:27:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfbc066690 0x7fdfbc068b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfd814bba0 0x7fdfd81edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfd8154970 0x7fdfd80bd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 --2- 172.21.15.81:0/3834240522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd80c7280 0x7fdfd81f1260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 >> 172.21.15.81:0/3834240522 conn(0x7fdfd80ca330 msgr2=0x7fdfd814fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 shutdown_connections 2024-05-08T20:27:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.110+0000 7fdfe00c4640 1 -- 172.21.15.81:0/3834240522 wait complete. 2024-05-08T20:27:43.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 Processor -- start 2024-05-08T20:27:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 -- start start 2024-05-08T20:27:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b5c160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c0aa830 con 0x7f2b5c1521f0 2024-05-08T20:27:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c072900 con 0x7f2b5c1554e0 2024-05-08T20:27:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b63ebb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c0640 con 0x7f2b5c0c00c0 2024-05-08T20:27:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61c57640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2b5c1521f0 0x7f2b5c0c1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39048/0 (socket says 172.21.15.81:39048) 2024-05-08T20:27:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61c57640 1 -- 172.21.15.81:0/2082384053 learned_addr learned my addr 172.21.15.81:0/2082384053 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329059228 0 0) 0x7f2b5c0aa830 con 0x7f2b5c1521f0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b62458640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b5c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b44003530 con 0x7f2b5c1521f0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1608283850 0 0) 0x7f2b44003530 con 0x7f2b5c1521f0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 msgr2=0x7f2b5c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b5c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 >> v1:172.21.15.117:6789/0 conn(0x7f2b5c1554e0 legacy=0x7f2b5c0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c155970 con 0x7f2b5c1521f0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2b4c001680 con 0x7f2b5c1521f0 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 >> v1:172.21.15.81:6789/0 conn(0x7f2b5c1521f0 legacy=0x7f2b5c0c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b44004d10 0x7f2b44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c0640 con 0x7f2b44003f30 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4400ba70 con 0x7f2b44004d10 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4400bc30 con 0x7f2b5c0c00c0 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61c57640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 -- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 msgr2=0x7f2b440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b62458640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b44004d10 0x7f2b44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b440039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 -- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b44004d10 msgr2=0x7f2b44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b44004d10 0x7f2b44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61456640 1 -- 172.21.15.81:0/2082384053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44003530 con 0x7f2b44003f30 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b62458640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b44004d10 0x7f2b44005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.242+0000 7f2b61c57640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c0c00c0 0x7f2b440039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b61456640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b440047d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b50001cd0 tx=0x7f2b5001c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5453e3954de3040 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50003b80 con 0x7f2b44003f30 2024-05-08T20:27:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c001d80 con 0x7f2b44003f30 2024-05-08T20:27:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b60c55640 1 -- 172.21.15.81:0/2082384053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500050d0 con 0x7f2b44003f30 2024-05-08T20:27:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- 172.21.15.81:0/2082384053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 msgr2=0x7f2b440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/2082384053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b440047d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b50001cd0 tx=0x7f2b5001c5e0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b62458640 1 -- 172.21.15.81:0/2082384053 reap_dead start 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- 172.21.15.81:0/2082384053 shutdown_connections 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- 172.21.15.81:0/2082384053 >> 172.21.15.81:0/2082384053 conn(0x7f2b5c0c2ca0 msgr2=0x7f2b5c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- 172.21.15.81:0/2082384053 shutdown_connections 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- 172.21.15.81:0/2082384053 wait complete. 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 Processor -- start 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 -- start start 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 0x7f2b5c1eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.246+0000 7f2b63ebb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 0x7f2b5c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c1ea540 con 0x7f2b44003f30 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c06c540 con 0x7f2b5c06d040 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c1ea730 con 0x7f2b5c06fff0 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48490/0 (socket says 172.21.15.81:48490) 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 -- 172.21.15.81:0/1695768000 learned_addr learned my addr 172.21.15.81:0/1695768000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61456640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 0x7f2b5c1eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b62458640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 0x7f2b5c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 -- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 msgr2=0x7f2b5c06aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 0x7f2b5c06aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 -- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 msgr2=0x7f2b5c1eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 0x7f2b5c1eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 -- 172.21.15.81:0/1695768000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c06f550 con 0x7f2b44003f30 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61456640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 0x7f2b5c1eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b62458640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 0x7f2b5c06aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61c57640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c010b80 tx=0x7f2b4c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00ed80 con 0x7f2b44003f30 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c0143a0 con 0x7f2b44003f30 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c014710 con 0x7f2b44003f30 2024-05-08T20:27:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c1ee4c0 con 0x7f2b44003f30 2024-05-08T20:27:43.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0c5d70 con 0x7f2b44003f30 2024-05-08T20:27:43.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c1ee9e0 con 0x7f2b44003f30 2024-05-08T20:27:43.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b4c014870 con 0x7f2b44003f30 2024-05-08T20:27:43.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 0x7f2b48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2b4c0870a0 con 0x7f2b44003f30 2024-05-08T20:27:43.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61456640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 0x7f2b48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.250+0000 7f2b61456640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 0x7f2b48068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ac000 tx=0x7f2b50001520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.254+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2b4c054170 con 0x7f2b44003f30 2024-05-08T20:27:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b5c074950 con 0x7f2b44003f30 2024-05-08T20:27:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b5a7fc640 1 -- 172.21.15.81:0/1695768000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f2b4c057790 con 0x7f2b44003f30 2024-05-08T20:27:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:43.445 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:43.445 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 msgr2=0x7f2b48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 0x7f2b48068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ac000 tx=0x7f2b50001520 comp rx=0 tx=0).stop 2024-05-08T20:27:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 msgr2=0x7f2b5c0c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.438+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c010b80 tx=0x7f2b4c00e4d0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 shutdown_connections 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2b48066690 0x7f2b48068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b5c06fff0 0x7f2b5c06aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b5c06d040 0x7f2b5c1eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 --2- 172.21.15.81:0/1695768000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b44003f30 0x7f2b5c0c5830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 >> 172.21.15.81:0/1695768000 conn(0x7f2b5c0c2ca0 msgr2=0x7f2b5c152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 shutdown_connections 2024-05-08T20:27:43.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.442+0000 7f2b63ebb640 1 -- 172.21.15.81:0/1695768000 wait complete. 2024-05-08T20:27:43.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:43.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 Processor -- start 2024-05-08T20:27:43.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 -- start start 2024-05-08T20:27:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f25d014fe70 0x7f25d006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d0152ab0 con 0x7f25d0155e90 2024-05-08T20:27:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d0152d90 con 0x7f25d006d7d0 2024-05-08T20:27:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d70c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d01528a0 con 0x7f25d014fe70 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25d0155e90 0x7f25d0069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39062/0 (socket says 172.21.15.81:39062) 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 -- 172.21.15.81:0/4045586816 learned_addr learned my addr 172.21.15.81:0/4045586816 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d4e63640 1 --2- 172.21.15.81:0/4045586816 >> v2:172.21.15.117:3300/0 conn(0x7f25d014fe70 0x7f25d006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958319540 0 0) 0x7f25d0152ab0 con 0x7f25d0155e90 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b8003530 con 0x7f25d0155e90 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330522318 0 0) 0x7f25b8003530 con 0x7f25d0155e90 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 >> v2:172.21.15.117:3300/0 conn(0x7f25d014fe70 msgr2=0x7f25d006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/4045586816 >> v2:172.21.15.117:3300/0 conn(0x7f25d014fe70 0x7f25d006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 >> v1:172.21.15.117:6789/0 conn(0x7f25d006d7d0 legacy=0x7f25d006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0153070 con 0x7f25d0155e90 2024-05-08T20:27:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f25c0001680 con 0x7f25d0155e90 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 >> v1:172.21.15.81:6789/0 conn(0x7f25d0155e90 legacy=0x7f25d0069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8003980 0x7f25b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b80052b0 0x7f25b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d01528a0 con 0x7f25b80047d0 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b800c180 con 0x7f25b80052b0 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b800c340 con 0x7f25b8003980 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d4e63640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8003980 0x7f25b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d5664640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b80052b0 0x7f25b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 -- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8003980 msgr2=0x7f25b8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25b8003980 0x7f25b8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 -- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b80052b0 msgr2=0x7f25b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b80052b0 0x7f25b800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25cffff640 1 -- 172.21.15.81:0/4045586816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8003530 con 0x7f25b80047d0 2024-05-08T20:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.566+0000 7f25d5664640 1 -- 172.21.15.81:0/4045586816 reap_dead start 2024-05-08T20:27:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25cffff640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25b8004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c210 tx=0x7f25c001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cc5c409e4a0402 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0005ae0 con 0x7f25b80047d0 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0005c40 con 0x7f25b80047d0 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25cf7fe640 1 -- 172.21.15.81:0/4045586816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00a5a40 con 0x7f25b80047d0 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 msgr2=0x7f25b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25b8004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c210 tx=0x7f25c001cc10 comp rx=0 tx=0).stop 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- 172.21.15.81:0/4045586816 shutdown_connections 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 --2- 172.21.15.81:0/4045586816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25b8004c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- 172.21.15.81:0/4045586816 >> 172.21.15.81:0/4045586816 conn(0x7f25d00c71b0 msgr2=0x7f25d00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- 172.21.15.81:0/4045586816 shutdown_connections 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- 172.21.15.81:0/4045586816 wait complete. 2024-05-08T20:27:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 Processor -- start 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.570+0000 7f25d70c7640 1 -- start start 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d0070210 0x7f25d00c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d01f0f60 0x7f25d0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d01ee1d0 con 0x7f25b80047d0 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0154bc0 con 0x7f25d01f0f60 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d01f0ad0 con 0x7f25d0070210 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48516/0 (socket says 172.21.15.81:48516) 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 -- 172.21.15.81:0/510196542 learned_addr learned my addr 172.21.15.81:0/510196542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cffff640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d0070210 0x7f25d00c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d5664640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d01f0f60 0x7f25d0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 -- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d0070210 msgr2=0x7f25d00c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d0070210 0x7f25d00c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 -- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d01f0f60 msgr2=0x7f25d0149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d01f0f60 0x7f25d0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 -- 172.21.15.81:0/510196542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d014db10 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d4e63640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25c8007f30 tx=0x7f25c8011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c800e030 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8016470 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0071e30 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8016820 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d01f0760 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d00675e0 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25c8016980 con 0x7f25b80047d0 2024-05-08T20:27:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 0x7f25bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f25c800f070 con 0x7f25b80047d0 2024-05-08T20:27:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cffff640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 0x7f25bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.574+0000 7f25cffff640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 0x7f25bc068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ab000 tx=0x7f25c00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.578+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f25c8052540 con 0x7f25b80047d0 2024-05-08T20:27:43.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.730+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25d0074950 con 0x7f25b80047d0 2024-05-08T20:27:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.734+0000 7f25cd7fa640 1 -- 172.21.15.81:0/510196542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f25c8055b60 con 0x7f25b80047d0 2024-05-08T20:27:43.741 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:43.741 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 msgr2=0x7f25bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 0x7f25bc068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ab000 tx=0x7f25c00a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 msgr2=0x7f25d01edbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25c8007f30 tx=0x7f25c8011660 comp rx=0 tx=0).stop 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 shutdown_connections 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f25bc0666c0 0x7f25bc068b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25d01f0f60 0x7f25d0149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25d0070210 0x7f25d00c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 --2- 172.21.15.81:0/510196542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25b80047d0 0x7f25d01edbf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 >> 172.21.15.81:0/510196542 conn(0x7f25d00c71b0 msgr2=0x7f25d00ac790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 shutdown_connections 2024-05-08T20:27:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.738+0000 7f25d70c7640 1 -- 172.21.15.81:0/510196542 wait complete. 2024-05-08T20:27:43.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:43.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:43.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.874+0000 7f26cf2f0640 1 Processor -- start 2024-05-08T20:27:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.874+0000 7f26cf2f0640 1 -- start start 2024-05-08T20:27:43.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26c80c1f90 0x7f26c815d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c80c23c0 con 0x7f26c8151740 2024-05-08T20:27:43.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c8155060 con 0x7f26c80c1bb0 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c8155340 con 0x7f26c80c1f90 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26c80c1f90 0x7f26c815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26c80c1f90 0x7f26c815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48520/0 (socket says 172.21.15.81:48520) 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cc88b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26c8151740 0x7f26c81535a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39064/0 (socket says 172.21.15.81:39064) 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 -- 172.21.15.81:0/4200850689 learned_addr learned my addr 172.21.15.81:0/4200850689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 -- 172.21.15.81:0/4200850689 >> v1:172.21.15.117:6789/0 conn(0x7f26c80c1bb0 legacy=0x7f26c8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 -- 172.21.15.81:0/4200850689 >> v1:172.21.15.81:6789/0 conn(0x7f26c8151740 legacy=0x7f26c81535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 -- 172.21.15.81:0/4200850689 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8155620 con 0x7f26c80c1f90 2024-05-08T20:27:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26bffff640 1 -- 172.21.15.81:0/4200850689 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806488912 0 0) 0x7f26c80c23c0 con 0x7f26c8151740 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cd88d640 1 --2- 172.21.15.81:0/4200850689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c815d090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009e50 tx=0x7f26c001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa0373dc0983835 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26bffff640 1 -- 172.21.15.81:0/4200850689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a5740 con 0x7f26c80c1f90 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26bffff640 1 -- 172.21.15.81:0/4200850689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00a58a0 con 0x7f26c80c1f90 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26bffff640 1 -- 172.21.15.81:0/4200850689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a5c30 con 0x7f26c80c1f90 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- 172.21.15.81:0/4200850689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 msgr2=0x7f26c815d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/4200850689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c815d090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009e50 tx=0x7f26c001c8a0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- 172.21.15.81:0/4200850689 shutdown_connections 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/4200850689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c815d090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- 172.21.15.81:0/4200850689 >> 172.21.15.81:0/4200850689 conn(0x7f26c80c2ca0 msgr2=0x7f26c80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- 172.21.15.81:0/4200850689 shutdown_connections 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.878+0000 7f26cf2f0640 1 -- 172.21.15.81:0/4200850689 wait complete. 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 Processor -- start 2024-05-08T20:27:43.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- start start 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c1bb0 0x7f26c8070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c8151740 0x7f26c8146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8146750 con 0x7f26c80c1f90 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8071520 con 0x7f26c8151740 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80aa050 con 0x7f26c80c1bb0 2024-05-08T20:27:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48522/0 (socket says 172.21.15.81:48522) 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 -- 172.21.15.81:0/2638116443 learned_addr learned my addr 172.21.15.81:0/2638116443 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 -- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c1bb0 msgr2=0x7f26c8070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c1bb0 0x7f26c8070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 -- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c8151740 msgr2=0x7f26c8146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c8151740 0x7f26c8146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 -- 172.21.15.81:0/2638116443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009b30 con 0x7f26c80c1f90 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cc88b640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c480 tx=0x7f26b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80074e0 con 0x7f26c80c1f90 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8007660 con 0x7f26c80c1f90 2024-05-08T20:27:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8004a30 con 0x7f26c80c1f90 2024-05-08T20:27:43.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c80aa330 con 0x7f26c80c1f90 2024-05-08T20:27:43.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c8146100 con 0x7f26c80c1f90 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c80a9eb0 con 0x7f26c80c1f90 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.882+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26b8004b90 con 0x7f26c80c1f90 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.886+0000 7f26bdffb640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 0x7f26ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.886+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f26b8083640 con 0x7f26c80c1f90 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.886+0000 7f26cd08c640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 0x7f26ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:43.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.886+0000 7f26cd08c640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 0x7f26ac068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f26c80c5220 tx=0x7f26c4006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:43.890+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f26c80a9eb0 con 0x7f26c80c1f90 2024-05-08T20:27:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.050+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26c80a9eb0 con 0x7f26c80c1f90 2024-05-08T20:27:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.050+0000 7f26bdffb640 1 -- 172.21.15.81:0/2638116443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26c80a9eb0 con 0x7f26c80c1f90 2024-05-08T20:27:44.057 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 msgr2=0x7f26ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 0x7f26ac068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f26c80c5220 tx=0x7f26c4006bd0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 msgr2=0x7f26c8070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c480 tx=0x7f26b800c940 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 shutdown_connections 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26ac066690 0x7f26ac068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c8151740 0x7f26c8146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c1f90 0x7f26c8070ed0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 --2- 172.21.15.81:0/2638116443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c1bb0 0x7f26c8070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 >> 172.21.15.81:0/2638116443 conn(0x7f26c80c2ca0 msgr2=0x7f26c80c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 shutdown_connections 2024-05-08T20:27:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.054+0000 7f26cf2f0640 1 -- 172.21.15.81:0/2638116443 wait complete. 2024-05-08T20:27:44.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:27:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.186+0000 7f7631803640 1 Processor -- start 2024-05-08T20:27:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.186+0000 7f7631803640 1 -- start start 2024-05-08T20:27:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7631803640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f762c0c1f90 0x7f762c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7631803640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0c23c0 con 0x7f762c0c1bb0 2024-05-08T20:27:44.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7631803640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c155060 con 0x7f762c151740 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7631803640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c155340 con 0x7f762c0c1f90 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f762c0c1bb0 0x7f762c152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39072/0 (socket says 172.21.15.81:39072) 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762affd640 1 -- 172.21.15.81:0/1232485584 learned_addr learned my addr 172.21.15.81:0/1232485584 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762b7fe640 1 --2- 172.21.15.81:0/1232485584 >> v2:172.21.15.117:3300/0 conn(0x7f762c0c1f90 0x7f762c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077928751 0 0) 0x7f762c0c23c0 con 0x7f762c0c1bb0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7614003530 con 0x7f762c0c1bb0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424353633 0 0) 0x7f7614003530 con 0x7f762c0c1bb0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 >> v2:172.21.15.117:3300/0 conn(0x7f762c0c1f90 msgr2=0x7f762c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 --2- 172.21.15.81:0/1232485584 >> v2:172.21.15.117:3300/0 conn(0x7f762c0c1f90 0x7f762c15d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 >> v1:172.21.15.117:6789/0 conn(0x7f762c151740 legacy=0x7f762c1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c155620 con 0x7f762c0c1bb0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f761c001680 con 0x7f762c0c1bb0 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 >> v1:172.21.15.81:6789/0 conn(0x7f762c0c1bb0 legacy=0x7f762c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7614003980 0x7f7614003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f7614004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7614005390 0x7f761400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c155340 con 0x7f76140047d0 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761400c220 con 0x7f7614005390 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761400c3e0 con 0x7f7614003980 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f7614004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762affd640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7614003980 0x7f7614003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762b7fe640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7614005390 0x7f761400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 -- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7614003980 msgr2=0x7f7614003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7614003980 0x7f7614003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 -- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7614005390 msgr2=0x7f761400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7614005390 0x7f761400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762b7fe640 1 -- 172.21.15.81:0/1232485584 reap_dead start 2024-05-08T20:27:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 -- 172.21.15.81:0/1232485584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614003530 con 0x7f76140047d0 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f762a7fc640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f7614004c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7620001780 tx=0x7f762001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edad5bb1ea0c5d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76200052d0 con 0x7f76140047d0 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76200a7050 con 0x7f76140047d0 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.190+0000 7f7629ffb640 1 -- 172.21.15.81:0/1232485584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620003600 con 0x7f76140047d0 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 msgr2=0x7f7614004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f7614004c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7620001780 tx=0x7f762001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/1232485584 shutdown_connections 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 --2- 172.21.15.81:0/1232485584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f7614004c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/1232485584 >> 172.21.15.81:0/1232485584 conn(0x7f762c0c2ca0 msgr2=0x7f762c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/1232485584 shutdown_connections 2024-05-08T20:27:44.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/1232485584 wait complete. 2024-05-08T20:27:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 Processor -- start 2024-05-08T20:27:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- start start 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762c0bf470 0x7f762c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 0x7f762c1eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c09cac0 con 0x7f76140047d0 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0be570 con 0x7f762c09af90 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c1ebd20 con 0x7f762c0bf470 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48526/0 (socket says 172.21.15.81:48526) 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 -- 172.21.15.81:0/2717472534 learned_addr learned my addr 172.21.15.81:0/2717472534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762a7fc640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762c0bf470 0x7f762c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762b7fe640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 0x7f762c1eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 -- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762c0bf470 msgr2=0x7f762c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762c0bf470 0x7f762c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 -- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 msgr2=0x7f762c1eb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 0x7f762c1eb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 -- 172.21.15.81:0/2717472534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0bdf20 con 0x7f76140047d0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762b7fe640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 0x7f762c1eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f762affd640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f761c00e780 tx=0x7f761c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c00ee90 con 0x7f76140047d0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c00c8d0 con 0x7f76140047d0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0be200 con 0x7f76140047d0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c00cc80 con 0x7f76140047d0 2024-05-08T20:27:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0c4660 con 0x7f76140047d0 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.194+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c074950 con 0x7f76140047d0 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.198+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f761c01d460 con 0x7f76140047d0 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.198+0000 7f7613fff640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 0x7f7618068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.198+0000 7f762a7fc640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 0x7f7618068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.198+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f761c0843c0 con 0x7f76140047d0 2024-05-08T20:27:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.198+0000 7f762a7fc640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 0x7f7618068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7620001750 tx=0x7f76200011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.202+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f761c054f20 con 0x7f76140047d0 2024-05-08T20:27:44.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.346+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f762c14f410 con 0x7f76140047d0 2024-05-08T20:27:44.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.346+0000 7f7613fff640 1 -- 172.21.15.81:0/2717472534 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f762c14f410 con 0x7f76140047d0 2024-05-08T20:27:44.354 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 msgr2=0x7f7618068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 0x7f7618068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7620001750 tx=0x7f76200011a0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 msgr2=0x7f762c0bea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f761c00e780 tx=0x7f761c00ec40 comp rx=0 tx=0).stop 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 shutdown_connections 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76180666c0 0x7f7618068b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f762c09af90 0x7f762c1eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f762c0bf470 0x7f762c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 --2- 172.21.15.81:0/2717472534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76140047d0 0x7f762c0bea00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 >> 172.21.15.81:0/2717472534 conn(0x7f762c0c2ca0 msgr2=0x7f762c0c5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 shutdown_connections 2024-05-08T20:27:44.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.350+0000 7f7631803640 1 -- 172.21.15.81:0/2717472534 wait complete. 2024-05-08T20:27:44.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:27:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 Processor -- start 2024-05-08T20:27:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 -- start start 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0e40c30d0 0x7ff0e40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e40a94b0 0x7ff0e40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e4155e10 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e406e790 con 0x7ff0e40c30d0 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ec228640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e406f460 con 0x7ff0e40a94b0 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e97c3640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff0e40c2bc0 0x7ff0e40c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39074/0 (socket says 172.21.15.81:39074) 2024-05-08T20:27:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e97c3640 1 -- 172.21.15.81:0/2704529582 learned_addr learned my addr 172.21.15.81:0/2704529582 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:44.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891326115 0 0) 0x7ff0e4155e10 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/2704529582 >> v2:172.21.15.117:3300/0 conn(0x7ff0e40c30d0 0x7ff0e40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d0003530 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e40a94b0 0x7ff0e40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906327303 0 0) 0x7ff0d0003530 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e40a94b0 msgr2=0x7ff0e40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e40a94b0 0x7ff0e40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 >> v2:172.21.15.117:3300/0 conn(0x7ff0e40c30d0 msgr2=0x7ff0e40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 --2- 172.21.15.81:0/2704529582 >> v2:172.21.15.117:3300/0 conn(0x7ff0e40c30d0 0x7ff0e40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40a9e20 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/2704529582 >> v2:172.21.15.117:3300/0 conn(0x7ff0e40c30d0 0x7ff0e40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff0d8001680 con 0x7ff0e40c2bc0 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 >> v1:172.21.15.81:6789/0 conn(0x7ff0e40c2bc0 legacy=0x7ff0e40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d0003980 0x7ff0d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00047d0 0x7ff0d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d0005190 0x7ff0d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e406e790 con 0x7ff0d0005190 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d000bfe0 con 0x7ff0d00047d0 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d000c1a0 con 0x7ff0d0003980 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e40a94b0 0x7ff0e40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:44.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d0005190 0x7ff0d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d0003980 0x7ff0d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e97c3640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00047d0 0x7ff0d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d0003980 msgr2=0x7ff0d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d0003980 0x7ff0d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00047d0 msgr2=0x7ff0d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00047d0 0x7ff0d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/2704529582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0003530 con 0x7ff0d0005190 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.490+0000 7ff0e97c3640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00047d0 0x7ff0d0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d0005190 0x7ff0d000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40a9890 tx=0x7ff0dc01cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b07d61bd30d41d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0a5c00 con 0x7ff0d0005190 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0a5d60 con 0x7ff0d0005190 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e8fc2640 1 -- 172.21.15.81:0/2704529582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc003bc0 con 0x7ff0d0005190 2024-05-08T20:27:44.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- 172.21.15.81:0/2704529582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d0005190 msgr2=0x7ff0d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 --2- 172.21.15.81:0/2704529582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d0005190 0x7ff0d000b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40a9890 tx=0x7ff0dc01cd10 comp rx=0 tx=0).stop 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/2704529582 reap_dead start 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- 172.21.15.81:0/2704529582 shutdown_connections 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- 172.21.15.81:0/2704529582 >> 172.21.15.81:0/2704529582 conn(0x7ff0e40c4cc0 msgr2=0x7ff0e40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- 172.21.15.81:0/2704529582 shutdown_connections 2024-05-08T20:27:44.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- 172.21.15.81:0/2704529582 wait complete. 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 Processor -- start 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- start start 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 0x7ff0e40ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 0x7ff0e4150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41ec5b0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40acef0 con 0x7ff0e40adee0 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ec228640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40abbb0 con 0x7ff0e41eb800 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48546/0 (socket says 172.21.15.81:48546) 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/366548075 learned_addr learned my addr 172.21.15.81:0/366548075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:44.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 0x7ff0e40ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e97c3640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 0x7ff0e4150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 msgr2=0x7ff0e40ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 0x7ff0e40ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 msgr2=0x7ff0e4150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 0x7ff0e4150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0ea7c5640 1 -- 172.21.15.81:0/366548075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40ad100 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 0x7ff0e40ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.494+0000 7ff0e97c3640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 0x7ff0e4150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0ea7c5640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc098820 tx=0x7ff0d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004240 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0043c0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004770 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40ad3e0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40ac0e0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e40ac2d0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0dc0b0460 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 0x7ff0c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 0x7ff0c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff0dc11db20 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.498+0000 7ff0e9fc4640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 0x7ff0c8068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c8d0 tx=0x7ff0e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.502+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff0dc0eabf0 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7ff0e4074950 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0d67fc640 1 -- 172.21.15.81:0/366548075 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7ff0dc0ee210 con 0x7ff0e41ebbe0 2024-05-08T20:27:44.668 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 msgr2=0x7ff0c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 0x7ff0c8068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c8d0 tx=0x7ff0e0008040 comp rx=0 tx=0).stop 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 msgr2=0x7ff0e41ec070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.662+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc098820 tx=0x7ff0d0005800 comp rx=0 tx=0).stop 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 shutdown_connections 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff0c8066690 0x7ff0c8068b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e41ebbe0 0x7ff0e41ec070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0e40adee0 0x7ff0e4150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 --2- 172.21.15.81:0/366548075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0e41eb800 0x7ff0e40ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 >> 172.21.15.81:0/366548075 conn(0x7ff0e40c4cc0 msgr2=0x7ff0e414efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 shutdown_connections 2024-05-08T20:27:44.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.666+0000 7ff0ec228640 1 -- 172.21.15.81:0/366548075 wait complete. 2024-05-08T20:27:44.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:27:44.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.806+0000 7f4397018640 1 Processor -- start 2024-05-08T20:27:44.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.806+0000 7f4397018640 1 -- start start 2024-05-08T20:27:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f439014e410 0x7f43900aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43900aac20 0x7f439006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439006b510 0x7f4390154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900abc50 con 0x7f439014e410 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900c2900 con 0x7f43900aac20 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900aa320 con 0x7f439006b510 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f439014e410 0x7f43900aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f439014e410 0x7f43900aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48550/0 (socket says 172.21.15.81:48550) 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 -- 172.21.15.81:0/2615451823 learned_addr learned my addr 172.21.15.81:0/2615451823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 -- 172.21.15.81:0/2615451823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439006b510 msgr2=0x7f4390154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 --2- 172.21.15.81:0/2615451823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439006b510 0x7f4390154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 -- 172.21.15.81:0/2615451823 >> v2:172.21.15.117:3300/0 conn(0x7f43900aac20 msgr2=0x7f439006afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f438ffff640 1 --2- 172.21.15.81:0/2615451823 >> v2:172.21.15.117:3300/0 conn(0x7f43900aac20 0x7f439006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 --2- 172.21.15.81:0/2615451823 >> v2:172.21.15.117:3300/0 conn(0x7f43900aac20 0x7f439006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 -- 172.21.15.81:0/2615451823 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900a9560 con 0x7f439014e410 2024-05-08T20:27:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4394db4640 1 --2- 172.21.15.81:0/2615451823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439014e410 0x7f43900aa6e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f439006ec10 tx=0x7f438001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b513950cdcf183b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f438f7fe640 1 -- 172.21.15.81:0/2615451823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380004230 con 0x7f439014e410 2024-05-08T20:27:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f438f7fe640 1 -- 172.21.15.81:0/2615451823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43800ab070 con 0x7f439014e410 2024-05-08T20:27:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f438f7fe640 1 -- 172.21.15.81:0/2615451823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43800a7720 con 0x7f439014e410 2024-05-08T20:27:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- 172.21.15.81:0/2615451823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439014e410 msgr2=0x7f43900aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- 172.21.15.81:0/2615451823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439014e410 0x7f43900aa6e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f439006ec10 tx=0x7f438001e910 comp rx=0 tx=0).stop 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- 172.21.15.81:0/2615451823 shutdown_connections 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- 172.21.15.81:0/2615451823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439006b510 0x7f4390154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- 172.21.15.81:0/2615451823 >> v2:172.21.15.117:3300/0 conn(0x7f43900aac20 0x7f439006afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 --2- 172.21.15.81:0/2615451823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439014e410 0x7f43900aa6e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- 172.21.15.81:0/2615451823 >> 172.21.15.81:0/2615451823 conn(0x7f43900c2ca0 msgr2=0x7f43900c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- 172.21.15.81:0/2615451823 shutdown_connections 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.810+0000 7f4397018640 1 -- 172.21.15.81:0/2615451823 wait complete. 2024-05-08T20:27:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 Processor -- start 2024-05-08T20:27:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- start start 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43900aac20 0x7f4390070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439014e410 0x7f4390071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390154da0 con 0x7f439006b510 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439006fa00 con 0x7f43900aac20 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439014c060 con 0x7f439014e410 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48558/0 (socket says 172.21.15.81:48558) 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 -- 172.21.15.81:0/2392865362 learned_addr learned my addr 172.21.15.81:0/2392865362 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 -- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439014e410 msgr2=0x7f4390071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439014e410 0x7f4390071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 -- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43900aac20 msgr2=0x7f4390070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43900aac20 0x7f4390070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 -- 172.21.15.81:0/2392865362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438000b780 con 0x7f439006b510 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4394db4640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f438001cfc0 tx=0x7f438001b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43800a7bf0 con 0x7f439006b510 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43800a7d50 con 0x7f439006b510 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439006ff30 con 0x7f439006b510 2024-05-08T20:27:44.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380003840 con 0x7f439006b510 2024-05-08T20:27:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43900704f0 con 0x7f439006b510 2024-05-08T20:27:44.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.814+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439006f1e0 con 0x7f439006b510 2024-05-08T20:27:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.818+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43800039a0 con 0x7f439006b510 2024-05-08T20:27:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.818+0000 7f438d7fa640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 0x7f4370068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.818+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4380120730 con 0x7f439006b510 2024-05-08T20:27:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.818+0000 7f438ffff640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 0x7f4370068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.818+0000 7f438ffff640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 0x7f4370068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4390073a40 tx=0x7f4378008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.822+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f439006f1e0 con 0x7f439006b510 2024-05-08T20:27:44.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f439006f1e0 con 0x7f439006b510 2024-05-08T20:27:44.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f438d7fa640 1 -- 172.21.15.81:0/2392865362 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f43800ad020 con 0x7f439006b510 2024-05-08T20:27:44.988 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 msgr2=0x7f4370068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 0x7f4370068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4390073a40 tx=0x7f4378008040 comp rx=0 tx=0).stop 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 msgr2=0x7f439014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f438001cfc0 tx=0x7f438001b6b0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 shutdown_connections 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4370066690 0x7f4370068b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f439014e410 0x7f4390071540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43900aac20 0x7f4390070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 --2- 172.21.15.81:0/2392865362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f439006b510 0x7f439014bb20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 >> 172.21.15.81:0/2392865362 conn(0x7f43900c2ca0 msgr2=0x7f4390150780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 shutdown_connections 2024-05-08T20:27:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:44.982+0000 7f4397018640 1 -- 172.21.15.81:0/2392865362 wait complete. 2024-05-08T20:27:45.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:27:45.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.110+0000 7f5154c9b640 1 Processor -- start 2024-05-08T20:27:45.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.110+0000 7f5154c9b640 1 -- start start 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f5154c9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5150151f00 0x7f51501588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f5154c9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 0x7f5150155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f5154c9b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150158e20 con 0x7f5150155690 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f5154c9b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515006bb20 con 0x7f5150151f00 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f5154c9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501548e0 con 0x7f5150154cf0 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5150151f00 0x7f51501588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5150151f00 0x7f51501588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48570/0 (socket says 172.21.15.81:48570) 2024-05-08T20:27:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 -- 172.21.15.81:0/356955545 learned_addr learned my addr 172.21.15.81:0/356955545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514dd9b640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 0x7f5150155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 -- 172.21.15.81:0/356955545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 msgr2=0x7f5150155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 0x7f5150155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 -- 172.21.15.81:0/356955545 >> v1:172.21.15.117:6789/0 conn(0x7f5150155690 legacy=0x7f51500ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514e59c640 1 -- 172.21.15.81:0/356955545 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51501522e0 con 0x7f5150151f00 2024-05-08T20:27:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.114+0000 7f514dd9b640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 0x7f5150155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f514e59c640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150151f00 0x7f51501588e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51400098a0 tx=0x7f514001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507cee763224a944 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f514d59a640 1 -- 172.21.15.81:0/356955545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400ab640 con 0x7f5150151f00 2024-05-08T20:27:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f514d59a640 1 -- 172.21.15.81:0/356955545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51400a7070 con 0x7f5150151f00 2024-05-08T20:27:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f514d59a640 1 -- 172.21.15.81:0/356955545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400ab9c0 con 0x7f5150151f00 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- 172.21.15.81:0/356955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150151f00 msgr2=0x7f51501588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150151f00 0x7f51501588e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51400098a0 tx=0x7f514001c420 comp rx=0 tx=0).stop 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- 172.21.15.81:0/356955545 shutdown_connections 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150154cf0 0x7f5150155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 --2- 172.21.15.81:0/356955545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150151f00 0x7f51501588e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- 172.21.15.81:0/356955545 >> 172.21.15.81:0/356955545 conn(0x7f51500715f0 msgr2=0x7f5150071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- 172.21.15.81:0/356955545 shutdown_connections 2024-05-08T20:27:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- 172.21.15.81:0/356955545 wait complete. 2024-05-08T20:27:45.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 Processor -- start 2024-05-08T20:27:45.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.118+0000 7f5154c9b640 1 -- start start 2024-05-08T20:27:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150151f00 0x7f51500a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51500aebf0 0x7f51500ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ad160 con 0x7f5150154cf0 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51500ae760 con 0x7f51500aebf0 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5150148de0 con 0x7f5150151f00 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48580/0 (socket says 172.21.15.81:48580) 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 -- 172.21.15.81:0/3992675886 learned_addr learned my addr 172.21.15.81:0/3992675886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 -- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150151f00 msgr2=0x7f51500a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150151f00 0x7f51500a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 -- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51500aebf0 msgr2=0x7f51500ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51500aebf0 0x7f51500ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 -- 172.21.15.81:0/3992675886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400094d0 con 0x7f5150154cf0 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514dd9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f514400e810 tx=0x7f514400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400c870 con 0x7f5150154cf0 2024-05-08T20:27:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514400c9d0 con 0x7f5150154cf0 2024-05-08T20:27:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51501f1710 con 0x7f5150154cf0 2024-05-08T20:27:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400cd80 con 0x7f5150154cf0 2024-05-08T20:27:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5150148b00 con 0x7f5150154cf0 2024-05-08T20:27:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150074950 con 0x7f5150154cf0 2024-05-08T20:27:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5144013410 con 0x7f5150154cf0 2024-05-08T20:27:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 0x7f5130068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5144084210 con 0x7f5150154cf0 2024-05-08T20:27:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514e59c640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 0x7f5130068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.122+0000 7f514e59c640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 0x7f5130068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51400af000 tx=0x7f5140008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.126+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f51440512e0 con 0x7f5150154cf0 2024-05-08T20:27:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f51500ae8a0 con 0x7f5150154cf0 2024-05-08T20:27:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f513effd640 1 -- 172.21.15.81:0/3992675886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7f5144054900 con 0x7f5150154cf0 2024-05-08T20:27:45.292 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 msgr2=0x7f5130068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 0x7f5130068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51400af000 tx=0x7f5140008040 comp rx=0 tx=0).stop 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 msgr2=0x7f51501f11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f514400e810 tx=0x7f514400ecd0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 shutdown_connections 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5130066690 0x7f5130068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51500aebf0 0x7f51500ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5150154cf0 0x7f51501f11d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 --2- 172.21.15.81:0/3992675886 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5150151f00 0x7f51500a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 >> 172.21.15.81:0/3992675886 conn(0x7f51500715f0 msgr2=0x7f51500719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 shutdown_connections 2024-05-08T20:27:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.286+0000 7f5154c9b640 1 -- 172.21.15.81:0/3992675886 wait complete. 2024-05-08T20:27:45.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 Processor -- start 2024-05-08T20:27:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 -- start start 2024-05-08T20:27:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bc41501e0 0x7f7bc406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc40725f0 0x7f7bc40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40c0650 con 0x7f7bc406f400 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc406fd60 con 0x7f7bc41501e0 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc8c24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4072180 con 0x7f7bc40725f0 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bc41501e0 0x7f7bc406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bc41501e0 0x7f7bc406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48586/0 (socket says 172.21.15.81:48586) 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 -- 172.21.15.81:0/3306065943 learned_addr learned my addr 172.21.15.81:0/3306065943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc1d9b640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc40725f0 0x7f7bc40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 -- 172.21.15.81:0/3306065943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc40725f0 msgr2=0x7f7bc40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc40725f0 0x7f7bc40c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 -- 172.21.15.81:0/3306065943 >> v1:172.21.15.117:6789/0 conn(0x7f7bc406f400 legacy=0x7f7bc40c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.418+0000 7f7bc259c640 1 -- 172.21.15.81:0/3306065943 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc406fa80 con 0x7f7bc41501e0 2024-05-08T20:27:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc259c640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc406c930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009870 tx=0x7f7bb401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c129a606a602a801 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc159a640 1 -- 172.21.15.81:0/3306065943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40ac410 con 0x7f7bc41501e0 2024-05-08T20:27:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc159a640 1 -- 172.21.15.81:0/3306065943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb40ac570 con 0x7f7bc41501e0 2024-05-08T20:27:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc159a640 1 -- 172.21.15.81:0/3306065943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40ac900 con 0x7f7bc41501e0 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- 172.21.15.81:0/3306065943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 msgr2=0x7f7bc406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc406c930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009870 tx=0x7f7bb401c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- 172.21.15.81:0/3306065943 shutdown_connections 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc40725f0 0x7f7bc40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/3306065943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc406c930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- 172.21.15.81:0/3306065943 >> 172.21.15.81:0/3306065943 conn(0x7f7bc40c2ca0 msgr2=0x7f7bc40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- 172.21.15.81:0/3306065943 shutdown_connections 2024-05-08T20:27:45.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- 172.21.15.81:0/3306065943 wait complete. 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 Processor -- start 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- start start 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc406f400 0x7f7bc414ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 0x7f7bc414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc414b690 con 0x7f7bc41501e0 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc414a8f0 con 0x7f7bc40725f0 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.422+0000 7f7bc8c24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41490e0 con 0x7f7bc406f400 2024-05-08T20:27:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48598/0 (socket says 172.21.15.81:48598) 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 -- 172.21.15.81:0/2080602859 learned_addr learned my addr 172.21.15.81:0/2080602859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc259c640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc406f400 0x7f7bc414ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc1d9b640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 0x7f7bc414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 -- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc406f400 msgr2=0x7f7bc414ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc406f400 0x7f7bc414ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 -- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 msgr2=0x7f7bc414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 0x7f7bc414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 -- 172.21.15.81:0/2080602859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40094d0 con 0x7f7bc41501e0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc1d9b640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 0x7f7bc414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc2d9d640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00b970 tx=0x7f7bbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00cb40 con 0x7f7bc41501e0 2024-05-08T20:27:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00cca0 con 0x7f7bc41501e0 2024-05-08T20:27:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4150740 con 0x7f7bc41501e0 2024-05-08T20:27:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc014680 con 0x7f7bc41501e0 2024-05-08T20:27:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4148b20 con 0x7f7bc41501e0 2024-05-08T20:27:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc414aa60 con 0x7f7bc41501e0 2024-05-08T20:27:45.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7bbc01d3b0 con 0x7f7bc41501e0 2024-05-08T20:27:45.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 0x7f7ba4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7bbc084200 con 0x7f7bc41501e0 2024-05-08T20:27:45.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc259c640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 0x7f7ba4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.426+0000 7f7bc259c640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 0x7f7ba4068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ae000 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.430+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7bbc0512b0 con 0x7f7bc41501e0 2024-05-08T20:27:45.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.618+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc4074950 con 0x7f7bc41501e0 2024-05-08T20:27:45.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.618+0000 7f7bb2ffd640 1 -- 172.21.15.81:0/2080602859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f7bbc0548d0 con 0x7f7bc41501e0 2024-05-08T20:27:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:45.626 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:45.626 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 msgr2=0x7f7ba4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 0x7f7ba4068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ae000 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 msgr2=0x7f7bc414c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00b970 tx=0x7f7bbc00be30 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 shutdown_connections 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ba40666c0 0x7f7ba4068b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bc41501e0 0x7f7bc414c780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bc40725f0 0x7f7bc414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 --2- 172.21.15.81:0/2080602859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7bc406f400 0x7f7bc414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 >> 172.21.15.81:0/2080602859 conn(0x7f7bc40c2ca0 msgr2=0x7f7bc4145420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 shutdown_connections 2024-05-08T20:27:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.622+0000 7f7bc8c24640 1 -- 172.21.15.81:0/2080602859 wait complete. 2024-05-08T20:27:45.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:45.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 Processor -- start 2024-05-08T20:27:45.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 -- start start 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c00c26e0 0x7f34c01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 0x7f34c00c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c0155140 con 0x7f34c0152220 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00c4780 con 0x7f34c00c26e0 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34c48bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00c32d0 con 0x7f34c00aac30 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c00c26e0 0x7f34c01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34be59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34c0152220 0x7f34c00c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39082/0 (socket says 172.21.15.81:39082) 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c00c26e0 0x7f34c01555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48614/0 (socket says 172.21.15.81:48614) 2024-05-08T20:27:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34be59c640 1 -- 172.21.15.81:0/1743227331 learned_addr learned my addr 172.21.15.81:0/1743227331 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 -- 172.21.15.81:0/1743227331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 msgr2=0x7f34c00c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34bed9d640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 0x7f34c00c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 0x7f34c00c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34bdd9b640 1 -- 172.21.15.81:0/1743227331 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761655157 0 0) 0x7f34c0155140 con 0x7f34c0152220 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 -- 172.21.15.81:0/1743227331 >> v1:172.21.15.81:6789/0 conn(0x7f34c0152220 legacy=0x7f34c00c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34b7fff640 1 -- 172.21.15.81:0/1743227331 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0072650 con 0x7f34c00c26e0 2024-05-08T20:27:45.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.754+0000 7f34bed9d640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 0x7f34c00c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:45.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34b7fff640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c00c26e0 0x7f34c01555d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a80097c0 tx=0x7f34a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fe2361a59500b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bdd9b640 1 -- 172.21.15.81:0/1743227331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80ac640 con 0x7f34c00c26e0 2024-05-08T20:27:45.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bdd9b640 1 -- 172.21.15.81:0/1743227331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80ac7a0 con 0x7f34c00c26e0 2024-05-08T20:27:45.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bdd9b640 1 -- 172.21.15.81:0/1743227331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80acb30 con 0x7f34c00c26e0 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1743227331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c00c26e0 msgr2=0x7f34c01555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c00c26e0 0x7f34c01555d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34a80097c0 tx=0x7f34a801c3e0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1743227331 shutdown_connections 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00aac30 0x7f34c00c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1743227331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c00c26e0 0x7f34c01555d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1743227331 >> 172.21.15.81:0/1743227331 conn(0x7f34c00c4cc0 msgr2=0x7f34c00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1743227331 shutdown_connections 2024-05-08T20:27:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1743227331 wait complete. 2024-05-08T20:27:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 Processor -- start 2024-05-08T20:27:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- start start 2024-05-08T20:27:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 0x7f34c0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00c26e0 0x7f34c014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c006b380 con 0x7f34c0152220 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0156530 con 0x7f34c00aac30 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0156810 con 0x7f34c00c26e0 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48618/0 (socket says 172.21.15.81:48618) 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 -- 172.21.15.81:0/1118770957 learned_addr learned my addr 172.21.15.81:0/1118770957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34be59c640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 0x7f34c0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 -- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00c26e0 msgr2=0x7f34c014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00c26e0 0x7f34c014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 -- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 msgr2=0x7f34c0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 0x7f34c0155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 -- 172.21.15.81:0/1118770957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8009420 con 0x7f34c0152220 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34be59c640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 0x7f34c0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34bed9d640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f34b800cef0 tx=0x7f34b800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800d840 con 0x7f34c0152220 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b800d9c0 con 0x7f34c0152220 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c0156af0 con 0x7f34c0152220 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800dd70 con 0x7f34c0152220 2024-05-08T20:27:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.758+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c01570b0 con 0x7f34c0152220 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c0074950 con 0x7f34c0152220 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34b801e3b0 con 0x7f34c0152220 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34b6ffd640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 0x7f34a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f34b8084ef0 con 0x7f34c0152220 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34be59c640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 0x7f34a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:45.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.762+0000 7f34be59c640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 0x7f34a4068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34b0007fd0 tx=0x7f34b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:45.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.766+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f34b8052080 con 0x7f34c0152220 2024-05-08T20:27:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.926+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34c00aaa10 con 0x7f34c0152220 2024-05-08T20:27:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.926+0000 7f34b6ffd640 1 -- 172.21.15.81:0/1118770957 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f34b801a020 con 0x7f34c0152220 2024-05-08T20:27:45.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:45.934 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 msgr2=0x7f34a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 0x7f34a4068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f34b0007fd0 tx=0x7f34b0009040 comp rx=0 tx=0).stop 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 msgr2=0x7f34c013b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f34b800cef0 tx=0x7f34b800a710 comp rx=0 tx=0).stop 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 shutdown_connections 2024-05-08T20:27:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34a4066690 0x7f34a4068b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0152220 0x7f34c013b8a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34c00c26e0 0x7f34c014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 --2- 172.21.15.81:0/1118770957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34c00aac30 0x7f34c0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 >> 172.21.15.81:0/1118770957 conn(0x7f34c00c4cc0 msgr2=0x7f34c00a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 shutdown_connections 2024-05-08T20:27:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:45.930+0000 7f34c48bb640 1 -- 172.21.15.81:0/1118770957 wait complete. 2024-05-08T20:27:45.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.058+0000 7f869432a640 1 Processor -- start 2024-05-08T20:27:46.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.058+0000 7f869432a640 1 -- start start 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f869432a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f868c150110 0x7f868c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f869432a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c0c47c0 con 0x7f868c0c3510 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f869432a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c0c6220 con 0x7f868c0a9970 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f869432a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0c6500 con 0x7f868c150110 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86928c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f868c150110 0x7f868c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86920c6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f868c0c3510 0x7f868c0c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39098/0 (socket says 172.21.15.81:39098) 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86920c6640 1 -- 172.21.15.81:0/4055374128 learned_addr learned my addr 172.21.15.81:0/4055374128 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:46.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86928c7640 1 -- 172.21.15.81:0/4055374128 >> v1:172.21.15.117:6789/0 conn(0x7f868c0a9970 legacy=0x7f868c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86928c7640 1 -- 172.21.15.81:0/4055374128 >> v1:172.21.15.81:6789/0 conn(0x7f868c0c3510 legacy=0x7f868c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86928c7640 1 -- 172.21.15.81:0/4055374128 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c0c4a10 con 0x7f868c150110 2024-05-08T20:27:46.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86910c4640 1 -- 172.21.15.81:0/4055374128 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399541055 0 0) 0x7f868c0c47c0 con 0x7f868c0c3510 2024-05-08T20:27:46.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86928c7640 1 --2- 172.21.15.81:0/4055374128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c0aaa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8684009d90 tx=0x7f868401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38800add5a9339c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86910c4640 1 -- 172.21.15.81:0/4055374128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840a58d0 con 0x7f868c150110 2024-05-08T20:27:46.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86910c4640 1 -- 172.21.15.81:0/4055374128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86840a5a30 con 0x7f868c150110 2024-05-08T20:27:46.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.062+0000 7f86910c4640 1 -- 172.21.15.81:0/4055374128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840a5dc0 con 0x7f868c150110 2024-05-08T20:27:46.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/4055374128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 msgr2=0x7f868c0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 --2- 172.21.15.81:0/4055374128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c0aaa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8684009d90 tx=0x7f868401c870 comp rx=0 tx=0).stop 2024-05-08T20:27:46.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/4055374128 shutdown_connections 2024-05-08T20:27:46.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 --2- 172.21.15.81:0/4055374128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c0aaa80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/4055374128 >> 172.21.15.81:0/4055374128 conn(0x7f868c0c68c0 msgr2=0x7f868c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/4055374128 shutdown_connections 2024-05-08T20:27:46.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/4055374128 wait complete. 2024-05-08T20:27:46.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 Processor -- start 2024-05-08T20:27:46.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- start start 2024-05-08T20:27:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868c0a9970 0x7f868c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 0x7f868c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c14d1a0 con 0x7f868c150110 2024-05-08T20:27:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c14d760 con 0x7f868c0c3510 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c072740 con 0x7f868c0a9970 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48638/0 (socket says 172.21.15.81:48638) 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 -- 172.21.15.81:0/3310513676 learned_addr learned my addr 172.21.15.81:0/3310513676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86920c6640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868c0a9970 0x7f868c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 -- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868c0a9970 msgr2=0x7f868c147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868c0a9970 0x7f868c147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86918c5640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 0x7f868c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 -- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 msgr2=0x7f868c14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 0x7f868c14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 -- 172.21.15.81:0/3310513676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684009a70 con 0x7f868c150110 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86918c5640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 0x7f868c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f86928c7640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8684019480 tx=0x7f8684019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840ad850 con 0x7f868c150110 2024-05-08T20:27:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86840ad9d0 con 0x7f868c150110 2024-05-08T20:27:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c156d00 con 0x7f868c150110 2024-05-08T20:27:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840add80 con 0x7f868c150110 2024-05-08T20:27:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c14d3f0 con 0x7f868c150110 2024-05-08T20:27:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.066+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c14d8d0 con 0x7f868c150110 2024-05-08T20:27:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.070+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86840b4050 con 0x7f868c150110 2024-05-08T20:27:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.070+0000 7f8682ffd640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 0x7f8670068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.070+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f868411f490 con 0x7f868c150110 2024-05-08T20:27:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.070+0000 7f86920c6640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 0x7f8670068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.070+0000 7f86920c6640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 0x7f8670068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8688000f70 tx=0x7f8688007b80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.074+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f86840ec560 con 0x7f868c150110 2024-05-08T20:27:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.250+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f868c074950 con 0x7f868c150110 2024-05-08T20:27:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.250+0000 7f8682ffd640 1 -- 172.21.15.81:0/3310513676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f86840efb80 con 0x7f868c150110 2024-05-08T20:27:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:46.259 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 msgr2=0x7f8670068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 0x7f8670068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8688000f70 tx=0x7f8688007b80 comp rx=0 tx=0).stop 2024-05-08T20:27:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 msgr2=0x7f868c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8684019480 tx=0x7f8684019610 comp rx=0 tx=0).stop 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 shutdown_connections 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8670066690 0x7f8670068b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868c150110 0x7f868c070440 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f868c0c3510 0x7f868c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 --2- 172.21.15.81:0/3310513676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f868c0a9970 0x7f868c147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 >> 172.21.15.81:0/3310513676 conn(0x7f868c0c68c0 msgr2=0x7f868c150730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 shutdown_connections 2024-05-08T20:27:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.254+0000 7f869432a640 1 -- 172.21.15.81:0/3310513676 wait complete. 2024-05-08T20:27:46.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T20:27:18.865500+0000', 'modified': '2024-05-08T20:27:22.524425+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3150527784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3150527784}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3150527784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:27:46.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T20:27:46.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T20:27:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 Processor -- start 2024-05-08T20:27:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 -- start start 2024-05-08T20:27:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f367414e810 0x7f36740c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f367406ab90 0x7f367415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36740c4da0 con 0x7f36741553a0 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36740c5080 con 0x7f367406ab90 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36799d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3674069f60 con 0x7f367414e810 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f367406ab90 0x7f367415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36727fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f36741553a0 0x7f367406a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39102/0 (socket says 172.21.15.81:39102) 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36727fc640 1 -- 172.21.15.81:0/1121820693 learned_addr learned my addr 172.21.15.81:0/1121820693 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1121820693 >> v2:172.21.15.117:3300/0 conn(0x7f367414e810 0x7f36740c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36737fe640 1 -- 172.21.15.81:0/1121820693 >> v2:172.21.15.117:3300/0 conn(0x7f367414e810 msgr2=0x7f36740c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36737fe640 1 --2- 172.21.15.81:0/1121820693 >> v2:172.21.15.117:3300/0 conn(0x7f367414e810 0x7f36740c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36737fe640 1 -- 172.21.15.81:0/1121820693 >> v1:172.21.15.81:6789/0 conn(0x7f36741553a0 legacy=0x7f367406a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.802+0000 7f36737fe640 1 -- 172.21.15.81:0/1121820693 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740c8c30 con 0x7f367406ab90 2024-05-08T20:27:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36737fe640 1 --2- 172.21.15.81:0/1121820693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367406ab90 0x7f367415f2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36740c6d60 tx=0x7f366401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167972f824f07c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f3671ffb640 1 -- 172.21.15.81:0/1121820693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5820 con 0x7f367406ab90 2024-05-08T20:27:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f3671ffb640 1 -- 172.21.15.81:0/1121820693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640a5980 con 0x7f367406ab90 2024-05-08T20:27:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f3671ffb640 1 -- 172.21.15.81:0/1121820693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5d10 con 0x7f367406ab90 2024-05-08T20:27:46.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- 172.21.15.81:0/1121820693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367406ab90 msgr2=0x7f367415f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 --2- 172.21.15.81:0/1121820693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367406ab90 0x7f367415f2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f36740c6d60 tx=0x7f366401c7c0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- 172.21.15.81:0/1121820693 shutdown_connections 2024-05-08T20:27:46.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 --2- 172.21.15.81:0/1121820693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367406ab90 0x7f367415f2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 --2- 172.21.15.81:0/1121820693 >> v2:172.21.15.117:3300/0 conn(0x7f367414e810 0x7f36740c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- 172.21.15.81:0/1121820693 >> 172.21.15.81:0/1121820693 conn(0x7f36740abfb0 msgr2=0x7f36740ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- 172.21.15.81:0/1121820693 shutdown_connections 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- 172.21.15.81:0/1121820693 wait complete. 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 Processor -- start 2024-05-08T20:27:46.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.806+0000 7f36799d4640 1 -- start start 2024-05-08T20:27:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f367406ab90 0x7f3674151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 0x7f367414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36741561e0 con 0x7f36741553a0 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367414c410 con 0x7f367414e810 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36741ee870 con 0x7f367406ab90 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48654/0 (socket says 172.21.15.81:48654) 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 -- 172.21.15.81:0/330160210 learned_addr learned my addr 172.21.15.81:0/330160210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f3672ffd640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f367406ab90 0x7f3674151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36727fc640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 0x7f367414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 -- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f367406ab90 msgr2=0x7f3674151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f367406ab90 0x7f3674151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 -- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 msgr2=0x7f367414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 0x7f367414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 -- 172.21.15.81:0/330160210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009a70 con 0x7f36741553a0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36727fc640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 0x7f367414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36737fe640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f366401a3f0 tx=0x7f3664019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f366bfff640 1 -- 172.21.15.81:0/330160210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640adc00 con 0x7f36741553a0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f366bfff640 1 -- 172.21.15.81:0/330160210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640add60 con 0x7f36741553a0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f366bfff640 1 -- 172.21.15.81:0/330160210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640b9690 con 0x7f36741553a0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36741ee3e0 con 0x7f36741553a0 2024-05-08T20:27:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36741edd90 con 0x7f36741553a0 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f366bfff640 1 -- 172.21.15.81:0/330160210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36640b97f0 con 0x7f36741553a0 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.810+0000 7f366bfff640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 0x7f3654068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f366bfff640 1 -- 172.21.15.81:0/330160210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f366411faa0 con 0x7f36741553a0 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f3672ffd640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 0x7f3654068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f3672ffd640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 0x7f3654068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3674154c20 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 Processor -- start 2024-05-08T20:27:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- start start 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1ed6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1ed6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1da1e80 con 0x5598c1ed70b0 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1d2faf0 con 0x5598c1ed6790 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c1d2d0c0 con 0x5598c1f148d0 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48660/0 (socket says 172.21.15.81:48660) 2024-05-08T20:27:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 -- 172.21.15.81:0/2388126819 learned_addr learned my addr 172.21.15.81:0/2388126819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f3672ffd640 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1ed6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 -- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 msgr2=0x5598c1ed6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36727fc640 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1ed6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1ed6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 -- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 msgr2=0x5598c1ed6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1ed6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 -- 172.21.15.81:0/2388126819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c1a24890 con 0x5598c1ed70b0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36737fe640 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f366411dd50 tx=0x7f36640f04a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed94532b93a9f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36697fa640 1 -- 172.21.15.81:0/2388126819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640f0830 con 0x5598c1ed70b0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36697fa640 1 -- 172.21.15.81:0/2388126819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640f4660 con 0x5598c1ed70b0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f36697fa640 1 -- 172.21.15.81:0/2388126819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640f8c20 con 0x5598c1ed70b0 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- 172.21.15.81:0/2388126819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 msgr2=0x5598c1ed7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f366411dd50 tx=0x7f36640f04a0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- 172.21.15.81:0/2388126819 shutdown_connections 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed70b0 0x5598c1ed7490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1ed6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2388126819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1ed6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- 172.21.15.81:0/2388126819 >> 172.21.15.81:0/2388126819 conn(0x5598c1edff00 msgr2=0x5598c1ee02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- 172.21.15.81:0/2388126819 shutdown_connections 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- 172.21.15.81:0/2388126819 wait complete. 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 -- start start 2024-05-08T20:27:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.814+0000 7f367cb1a000 1 Processor -- start 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 0x5598c1f135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1f13b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1d289b0 con 0x5598c1ed6790 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1cc7c00 con 0x5598c1ed70b0 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c1ce6070 con 0x5598c1f148d0 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 10 client.0 _ll_register_callbacks cb 0x5598c1ec5ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48676/0 (socket says 172.21.15.81:48676) 2024-05-08T20:27:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 -- 172.21.15.81:0/2055231142 learned_addr learned my addr 172.21.15.81:0/2055231142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36727fc640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 0x5598c1f135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36737fe640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1f13b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 -- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 msgr2=0x5598c1f13b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1f13b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 -- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 msgr2=0x5598c1f135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 0x5598c1f135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 -- 172.21.15.81:0/2055231142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36741edd90 con 0x5598c1ed6790 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36737fe640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1f13b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36727fc640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 0x5598c1f135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f3672ffd640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f366c014770 tx=0x7f366c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b7bb47a3f31396 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c015960 con 0x5598c1ed6790 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f366c015ac0 con 0x5598c1ed6790 2024-05-08T20:27:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c1ce55f0 con 0x5598c1ed6790 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f366c015c80 con 0x5598c1ed6790 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 10 client.4827 fetch_fsmap learned FSMap version 12 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5598c1cedab0 con 0x5598c1ed6790 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5598c1ce55f0 con 0x5598c1ed6790 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 12) v1 ==== 3668+0+0 (secure 0 0 0) 0x7f366c02a3f0 con 0x5598c1ed6790 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 10 client.4827 fetch_fsmap finished waiting for FSMap version 12 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 10 client.4827 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 20 client.4827 populate_metadata read hostname 'smithi081' 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f1e0b0 0x5598c1f1e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 4 client.4827 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 --> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598c1d25790 con 0x5598c1f1e0b0 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36727fc640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f1e0b0 0x5598c1f1e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 10 client.4827 ms_handle_connect on v2:172.21.15.81:6835/3150527784 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36727fc640 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f1e0b0 0x5598c1f1e490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68aa3ee4df6710cd server_cookie=1b22d40c2a940e9a in_seq=0 out_seq=0 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 1 -- 172.21.15.81:0/2055231142 <== mds.0 v2:172.21.15.81:6835/3150527784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5598c1d25790 con 0x5598c1f1e0b0 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 10 client.4827 handle_command_reply: tid=0 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 client.4827 shutdown 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 msgr2=0x5598c1f21540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f366c014770 tx=0x7f366c004740 comp rx=0 tx=0).stop 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 shutdown_connections 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f1e0b0 0x5598c1f1e490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1f148d0 0x5598c1f13b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f36527fc640 0 client.4827 ms_handle_reset on v2:172.21.15.81:6835/3150527784 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed70b0 0x5598c1f135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2055231142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1ed6790 0x5598c1f21540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 >> 172.21.15.81:0/2055231142 conn(0x5598c1edff00 msgr2=0x5598c1ed59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 shutdown_connections 2024-05-08T20:27:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 1 -- 172.21.15.81:0/2055231142 wait complete. 2024-05-08T20:27:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.818+0000 7f367cb1a000 20 client.4827 trim_cache size 0 max 16384 2024-05-08T20:27:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 Processor -- start 2024-05-08T20:27:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- start start 2024-05-08T20:27:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f1b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c19e5940 con 0x5598c1f148d0 2024-05-08T20:27:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1cc5c10 con 0x5598c1ed6790 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c1d2c9b0 con 0x5598c1ed70b0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48680/0 (socket says 172.21.15.81:48680) 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 -- 172.21.15.81:0/2033535668 learned_addr learned my addr 172.21.15.81:0/2033535668 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 -- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 msgr2=0x5598c1f1b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f1b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 -- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 msgr2=0x5598c1f16cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 -- 172.21.15.81:0/2033535668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c1cd3c00 con 0x5598c1f148d0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f36737fe640 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f366401cd30 tx=0x7f36640b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3f036c28f843f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f3669ffb640 1 -- 172.21.15.81:0/2033535668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640f0f30 con 0x5598c1f148d0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f3669ffb640 1 -- 172.21.15.81:0/2033535668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640f4660 con 0x5598c1f148d0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f3669ffb640 1 -- 172.21.15.81:0/2033535668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640f8c20 con 0x5598c1f148d0 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- 172.21.15.81:0/2033535668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 msgr2=0x5598c1f1bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f366401cd30 tx=0x7f36640b2000 comp rx=0 tx=0).stop 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- 172.21.15.81:0/2033535668 shutdown_connections 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f1bc40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f1b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 --2- 172.21.15.81:0/2033535668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- 172.21.15.81:0/2033535668 >> 172.21.15.81:0/2033535668 conn(0x5598c1edff00 msgr2=0x5598c1f17af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- 172.21.15.81:0/2033535668 shutdown_connections 2024-05-08T20:27:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.834+0000 7f367cb1a000 1 -- 172.21.15.81:0/2033535668 wait complete. 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- start start 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 Processor -- start 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f7bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f79900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1ce1f80 con 0x5598c1f148d0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1cf3820 con 0x5598c1ed6790 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c1cf6420 con 0x5598c1ed70b0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 10 client.0 _ll_register_callbacks cb 0x5598c1de2100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48692/0 (socket says 172.21.15.81:48692) 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 -- 172.21.15.81:0/1204155945 learned_addr learned my addr 172.21.15.81:0/1204155945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f7bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36727fc640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f79900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 -- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 msgr2=0x5598c1f79900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f79900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 -- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 msgr2=0x5598c1f7bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f7bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 -- 172.21.15.81:0/1204155945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598c1a24890 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36727fc640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f79900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36737fe640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36640f0530 tx=0x7f3664009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07de3dc9001092d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640f0f30 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f36640f0830 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c1cf8460 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36640f8e70 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 10 client.4833 fetch_fsmap learned FSMap version 12 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5598c1a24cc0 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640fc020 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 12) v1 ==== 3668+0+0 (secure 0 0 0) 0x7f3664005d20 con 0x5598c1f148d0 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 10 client.4833 fetch_fsmap finished waiting for FSMap version 12 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 10 client.4833 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:27:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 20 client.4833 populate_metadata read hostname 'smithi081' 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 4 client.4833 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 --> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5598c1cf19c0 con 0x5598c1f71250 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 -- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 msgr2=0x5598c1f71630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 -- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 msgr2=0x5598c1f71630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:27:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:46.838+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:27:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.042+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.042+0000 7f3672ffd640 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25dcb2cb614a39d0 server_cookie=30ca8a7d3f6af620 in_seq=0 out_seq=0 2024-05-08T20:27:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.042+0000 7f36527fc640 10 client.4833 ms_handle_connect on v2:172.21.15.81:6835/3150527784 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36527fc640 1 -- 172.21.15.81:0/1204155945 <== mds.0 v2:172.21.15.81:6835/3150527784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5598c1cf19c0 con 0x5598c1f71250 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36527fc640 10 client.4833 handle_command_reply: tid=0 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 client.4833 shutdown 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 msgr2=0x5598c1f79e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36640f0530 tx=0x7f3664009750 comp rx=0 tx=0).stop 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 shutdown_connections 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:6835/3150527784,v1:172.21.15.81:6837/3150527784] conn(0x5598c1f71250 0x5598c1f71630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5598c1f148d0 0x5598c1f79e40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5598c1ed70b0 0x5598c1f79900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 --2- 172.21.15.81:0/1204155945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5598c1ed6790 0x5598c1f7bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36527fc640 0 client.4833 ms_handle_reset on v2:172.21.15.81:6835/3150527784 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 >> 172.21.15.81:0/1204155945 conn(0x5598c1edff00 msgr2=0x5598c1f74480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 shutdown_connections 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 1 -- 172.21.15.81:0/1204155945 wait complete. 2024-05-08T20:27:47.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f367cb1a000 20 client.4833 trim_cache size 0 max 16384 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4269, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "a", 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 28.533620735, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 8, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 20, 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 34.640633258000001 2024-05-08T20:27:47.407 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:27:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 msgr2=0x7f3654068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 0x7f3654068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3674154c20 tx=0x7f366c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 msgr2=0x7f367414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f366401a3f0 tx=0x7f3664019560 comp rx=0 tx=0).stop 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 shutdown_connections 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3654066690 0x7f3654068b50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36741553a0 0x7f367414bed0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f367414e810 0x7f367414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 --2- 172.21.15.81:0/330160210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f367406ab90 0x7f3674151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 >> 172.21.15.81:0/330160210 conn(0x7f36740abfb0 msgr2=0x7f3674152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 shutdown_connections 2024-05-08T20:27:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.398+0000 7f36799d4640 1 -- 172.21.15.81:0/330160210 wait complete. 2024-05-08T20:27:47.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.550+0000 7feb1a401640 1 Processor -- start 2024-05-08T20:27:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.550+0000 7feb1a401640 1 -- start start 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb1a401640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb1406d130 0x7feb140a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb1a401640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140c1730 con 0x7feb14155670 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb1a401640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb14154b90 con 0x7feb140c47c0 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb1a401640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140c1a10 con 0x7feb1406d130 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb13fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb1406d130 0x7feb140a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb137fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb14155670 0x7feb140bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39112/0 (socket says 172.21.15.81:39112) 2024-05-08T20:27:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb137fe640 1 -- 172.21.15.81:0/90718474 learned_addr learned my addr 172.21.15.81:0/90718474 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb13fff640 1 -- 172.21.15.81:0/90718474 >> v1:172.21.15.117:6789/0 conn(0x7feb140c47c0 legacy=0x7feb141516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb13fff640 1 -- 172.21.15.81:0/90718474 >> v1:172.21.15.81:6789/0 conn(0x7feb14155670 legacy=0x7feb140bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb13fff640 1 -- 172.21.15.81:0/90718474 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14154e70 con 0x7feb1406d130 2024-05-08T20:27:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb12ffd640 1 -- 172.21.15.81:0/90718474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045539037 0 0) 0x7feb140c1730 con 0x7feb14155670 2024-05-08T20:27:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb13fff640 1 --2- 172.21.15.81:0/90718474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1406d130 0x7feb140a5e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feafc0097f0 tx=0x7feafc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb6321a68516da2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb12ffd640 1 -- 172.21.15.81:0/90718474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0ab600 con 0x7feb1406d130 2024-05-08T20:27:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb12ffd640 1 -- 172.21.15.81:0/90718474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc0a7050 con 0x7feb1406d130 2024-05-08T20:27:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.554+0000 7feb12ffd640 1 -- 172.21.15.81:0/90718474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0ab980 con 0x7feb1406d130 2024-05-08T20:27:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/90718474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1406d130 msgr2=0x7feb140a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 --2- 172.21.15.81:0/90718474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1406d130 0x7feb140a5e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feafc0097f0 tx=0x7feafc01c460 comp rx=0 tx=0).stop 2024-05-08T20:27:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/90718474 shutdown_connections 2024-05-08T20:27:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 --2- 172.21.15.81:0/90718474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1406d130 0x7feb140a5e30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/90718474 >> 172.21.15.81:0/90718474 conn(0x7feb140c68c0 msgr2=0x7feb140c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/90718474 shutdown_connections 2024-05-08T20:27:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/90718474 wait complete. 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 Processor -- start 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- start start 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1406d130 0x7feb140a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 0x7feb1414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14150e70 con 0x7feb140c47c0 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1414dab0 con 0x7feb14155670 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb14151b80 con 0x7feb1406d130 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48704/0 (socket says 172.21.15.81:48704) 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 -- 172.21.15.81:0/2667560839 learned_addr learned my addr 172.21.15.81:0/2667560839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb13fff640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1406d130 0x7feb140a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1899e640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 0x7feb1414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 -- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1406d130 msgr2=0x7feb140a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1406d130 0x7feb140a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 -- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 msgr2=0x7feb1414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 0x7feb1414df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 -- 172.21.15.81:0/2667560839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009420 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1899e640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 0x7feb1414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb137fe640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb04001570 tx=0x7feb0400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400a640 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400a7c0 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb141500d0 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ab70 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140a7770 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.558+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb141512c0 con 0x7feb140c47c0 2024-05-08T20:27:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.562+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb0400acd0 con 0x7feb140c47c0 2024-05-08T20:27:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.562+0000 7feb10ff9640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 0x7feaf4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.562+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7feb04083e10 con 0x7feb140c47c0 2024-05-08T20:27:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.562+0000 7feb13fff640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 0x7feaf4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.562+0000 7feb13fff640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 0x7feaf4068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feafc0ad000 tx=0x7feafc0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.566+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7feb141512c0 con 0x7feb140c47c0 2024-05-08T20:27:47.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.726+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb141512c0 con 0x7feb140c47c0 2024-05-08T20:27:47.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.730+0000 7feb10ff9640 1 -- 172.21.15.81:0/2667560839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7feb141512c0 con 0x7feb140c47c0 2024-05-08T20:27:47.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:47.738 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 msgr2=0x7feaf4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 0x7feaf4068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feafc0ad000 tx=0x7feafc0a6000 comp rx=0 tx=0).stop 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 msgr2=0x7feb140a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb04001570 tx=0x7feb0400cd20 comp rx=0 tx=0).stop 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 shutdown_connections 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feaf4066690 0x7feaf4068b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb14155670 0x7feb1414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb140c47c0 0x7feb140a7230 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 --2- 172.21.15.81:0/2667560839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1406d130 0x7feb140a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 >> 172.21.15.81:0/2667560839 conn(0x7feb140c68c0 msgr2=0x7feb141588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 shutdown_connections 2024-05-08T20:27:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.734+0000 7feb1a401640 1 -- 172.21.15.81:0/2667560839 wait complete. 2024-05-08T20:27:47.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:47.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.874+0000 7fc63aea9640 1 Processor -- start 2024-05-08T20:27:47.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.874+0000 7fc63aea9640 1 -- start start 2024-05-08T20:27:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc63aea9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc6341588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc63aea9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc634154cf0 0x7fc634155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc63aea9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634158e20 con 0x7fc634155690 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc63aea9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63406bb20 con 0x7fc634154cf0 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc63aea9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341548e0 con 0x7fc634151f00 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc634155690 0x7fc6340ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39124/0 (socket says 172.21.15.81:39124) 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 -- 172.21.15.81:0/3444485520 learned_addr learned my addr 172.21.15.81:0/3444485520 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc633fff640 1 --2- 172.21.15.81:0/3444485520 >> v2:172.21.15.117:3300/0 conn(0x7fc634154cf0 0x7fc634155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc638c45640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc6341588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861829089 0 0) 0x7fc634158e20 con 0x7fc634155690 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620003530 con 0x7fc634155690 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951222463 0 0) 0x7fc620003530 con 0x7fc634155690 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 msgr2=0x7fc6341588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc6341588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 >> v2:172.21.15.117:3300/0 conn(0x7fc634154cf0 msgr2=0x7fc634155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:47.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 --2- 172.21.15.81:0/3444485520 >> v2:172.21.15.117:3300/0 conn(0x7fc634154cf0 0x7fc634155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6341522e0 con 0x7fc634155690 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc62c001680 con 0x7fc634155690 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 >> v1:172.21.15.81:6789/0 conn(0x7fc634155690 legacy=0x7fc6340ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc620003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc620003f00 0x7fc6200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc620004d10 0x7fc620005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62000b9c0 con 0x7fc620004d10 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62000bb30 con 0x7fc620003f00 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62000bcf0 con 0x7fc634151f00 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc620004d10 0x7fc620005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc633fff640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc620003f00 0x7fc6200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc638c45640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc620003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 -- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 msgr2=0x7fc620003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc634151f00 0x7fc620003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 -- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc620003f00 msgr2=0x7fc6200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc620003f00 0x7fc6200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc639446640 1 -- 172.21.15.81:0/3444485520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620003530 con 0x7fc620004d10 2024-05-08T20:27:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.878+0000 7fc633fff640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc620003f00 0x7fc6200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:47.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc639446640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc620004d10 0x7fc620005190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c210 tx=0x7fc62c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb5779026a3f3dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0a5b40 con 0x7fc620004d10 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0a5ca0 con 0x7fc620004d10 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc6337fe640 1 -- 172.21.15.81:0/3444485520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c005b20 con 0x7fc620004d10 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- 172.21.15.81:0/3444485520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc620004d10 msgr2=0x7fc620005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 --2- 172.21.15.81:0/3444485520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc620004d10 0x7fc620005190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c210 tx=0x7fc62c01cc40 comp rx=0 tx=0).stop 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc639446640 1 -- 172.21.15.81:0/3444485520 reap_dead start 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- 172.21.15.81:0/3444485520 shutdown_connections 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- 172.21.15.81:0/3444485520 >> 172.21.15.81:0/3444485520 conn(0x7fc6340715f0 msgr2=0x7fc634071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- 172.21.15.81:0/3444485520 shutdown_connections 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- 172.21.15.81:0/3444485520 wait complete. 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 Processor -- start 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- start start 2024-05-08T20:27:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c8ab0 0x7fc6341f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 0x7fc6341ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340ad5e0 con 0x7fc6340c9560 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341f1620 con 0x7fc63414be60 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc63aea9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340ad950 con 0x7fc6340c8ab0 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48728/0 (socket says 172.21.15.81:48728) 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 -- 172.21.15.81:0/1341137733 learned_addr learned my addr 172.21.15.81:0/1341137733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc638c45640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c8ab0 0x7fc6341f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc639446640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 0x7fc6341ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 -- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c8ab0 msgr2=0x7fc6341f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c8ab0 0x7fc6341f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 -- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 msgr2=0x7fc6341ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 0x7fc6341ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 -- 172.21.15.81:0/1341137733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340ad300 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc639446640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 0x7fc6341ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc633fff640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0116a0 tx=0x7fc61c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.882+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c004220 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c004380 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6340adba0 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00f980 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6340acf90 con 0x7fc6340c9560 2024-05-08T20:27:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634074950 con 0x7fc6340c9560 2024-05-08T20:27:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc61c00fae0 con 0x7fc6340c9560 2024-05-08T20:27:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc6317fa640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 0x7fc614068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fc61c0849e0 con 0x7fc6340c9560 2024-05-08T20:27:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc638c45640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 0x7fc614068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.886+0000 7fc638c45640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 0x7fc614068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc624007520 tx=0x7fc62400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:47.890+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc61c051ab0 con 0x7fc6340c9560 2024-05-08T20:27:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc63406ab10 con 0x7fc6340c9560 2024-05-08T20:27:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc6317fa640 1 -- 172.21.15.81:0/1341137733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc61c0220a0 con 0x7fc6340c9560 2024-05-08T20:27:48.056 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 msgr2=0x7fc614068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 0x7fc614068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc624007520 tx=0x7fc62400b040 comp rx=0 tx=0).stop 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 msgr2=0x7fc63414b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0116a0 tx=0x7fc61c011b60 comp rx=0 tx=0).stop 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 shutdown_connections 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc6140666c0 0x7fc614068b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63414be60 0x7fc6341ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6340c9560 0x7fc63414b920 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 --2- 172.21.15.81:0/1341137733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6340c8ab0 0x7fc6341f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 >> 172.21.15.81:0/1341137733 conn(0x7fc6340715f0 msgr2=0x7fc6341508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 shutdown_connections 2024-05-08T20:27:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.050+0000 7fc63aea9640 1 -- 172.21.15.81:0/1341137733 wait complete. 2024-05-08T20:27:48.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:27:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 Processor -- start 2024-05-08T20:27:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 -- start start 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb524151f00 0x7fb5241588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb524154cf0 0x7fb524155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb524158e20 con 0x7fb524155690 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52406bb20 con 0x7fb524151f00 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.190+0000 7fb529572640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5241548e0 con 0x7fb524154cf0 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb524151f00 0x7fb5241588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb5237fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb524155690 0x7fb5240ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39136/0 (socket says 172.21.15.81:39136) 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb524151f00 0x7fb5241588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48744/0 (socket says 172.21.15.81:48744) 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb5237fe640 1 -- 172.21.15.81:0/1124980736 learned_addr learned my addr 172.21.15.81:0/1124980736 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 -- 172.21.15.81:0/1124980736 >> v2:172.21.15.117:3300/0 conn(0x7fb524154cf0 msgr2=0x7fb524155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 --2- 172.21.15.81:0/1124980736 >> v2:172.21.15.117:3300/0 conn(0x7fb524154cf0 0x7fb524155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 -- 172.21.15.81:0/1124980736 >> v1:172.21.15.81:6789/0 conn(0x7fb524155690 legacy=0x7fb5240ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 -- 172.21.15.81:0/1124980736 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5241522e0 con 0x7fb524151f00 2024-05-08T20:27:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb522ffd640 1 --2- 172.21.15.81:0/1124980736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524151f00 0x7fb5241588e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb52408c580 tx=0x7fb51401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d723baa57a14b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb5227fc640 1 -- 172.21.15.81:0/1124980736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140ad680 con 0x7fb524151f00 2024-05-08T20:27:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb5227fc640 1 -- 172.21.15.81:0/1124980736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5140ad7e0 con 0x7fb524151f00 2024-05-08T20:27:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb5227fc640 1 -- 172.21.15.81:0/1124980736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140adb70 con 0x7fb524151f00 2024-05-08T20:27:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 -- 172.21.15.81:0/1124980736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524151f00 msgr2=0x7fb5241588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 --2- 172.21.15.81:0/1124980736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524151f00 0x7fb5241588e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb52408c580 tx=0x7fb51401c360 comp rx=0 tx=0).stop 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 -- 172.21.15.81:0/1124980736 shutdown_connections 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 --2- 172.21.15.81:0/1124980736 >> v2:172.21.15.117:3300/0 conn(0x7fb524154cf0 0x7fb524155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 --2- 172.21.15.81:0/1124980736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524151f00 0x7fb5241588e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 -- 172.21.15.81:0/1124980736 >> 172.21.15.81:0/1124980736 conn(0x7fb5240715f0 msgr2=0x7fb524071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 -- 172.21.15.81:0/1124980736 shutdown_connections 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.194+0000 7fb529572640 1 -- 172.21.15.81:0/1124980736 wait complete. 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 Processor -- start 2024-05-08T20:27:48.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- start start 2024-05-08T20:27:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 0x7fb524147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb524154cf0 0x7fb5240a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240aabd0 con 0x7fb5240ab4b0 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb524157240 con 0x7fb524154cf0 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb524155ce0 con 0x7fb524151f00 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48756/0 (socket says 172.21.15.81:48756) 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 -- 172.21.15.81:0/4149866968 learned_addr learned my addr 172.21.15.81:0/4149866968 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb51a7fc640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb524154cf0 0x7fb5240a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb522ffd640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 0x7fb524147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 -- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 msgr2=0x7fb524147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 0x7fb524147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 -- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb524154cf0 msgr2=0x7fb5240a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb524154cf0 0x7fb5240a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 -- 172.21.15.81:0/4149866968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009420 con 0x7fb5240ab4b0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb522ffd640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 0x7fb524147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb5237fe640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00cbc0 tx=0x7fb51c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00ad40 con 0x7fb5240ab4b0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c012400 con 0x7fb5240ab4b0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241f1260 con 0x7fb5240ab4b0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00aea0 con 0x7fb5240ab4b0 2024-05-08T20:27:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5240aaee0 con 0x7fb5240ab4b0 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.198+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb524155e50 con 0x7fb5240ab4b0 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.202+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb51c007070 con 0x7fb5240ab4b0 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.202+0000 7fb51bfff640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 0x7fb504068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.202+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb51c084220 con 0x7fb5240ab4b0 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.202+0000 7fb522ffd640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 0x7fb504068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.202+0000 7fb522ffd640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 0x7fb504068b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5140af000 tx=0x7fb514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.206+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb524155e50 con 0x7fb5240ab4b0 2024-05-08T20:27:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb524155e50 con 0x7fb5240ab4b0 2024-05-08T20:27:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb51bfff640 1 -- 172.21.15.81:0/4149866968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7fb524155e50 con 0x7fb5240ab4b0 2024-05-08T20:27:48.372 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 msgr2=0x7fb504068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 0x7fb504068b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5140af000 tx=0x7fb514008040 comp rx=0 tx=0).stop 2024-05-08T20:27:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 msgr2=0x7fb524156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00cbc0 tx=0x7fb51c00a430 comp rx=0 tx=0).stop 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 shutdown_connections 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5040666c0 0x7fb504068b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240ab4b0 0x7fb524156130 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb524154cf0 0x7fb5240a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 --2- 172.21.15.81:0/4149866968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb524151f00 0x7fb524147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 >> 172.21.15.81:0/4149866968 conn(0x7fb5240715f0 msgr2=0x7fb5241539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 shutdown_connections 2024-05-08T20:27:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.366+0000 7fb529572640 1 -- 172.21.15.81:0/4149866968 wait complete. 2024-05-08T20:27:48.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:27:48.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.506+0000 7f4434578640 1 Processor -- start 2024-05-08T20:27:48.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.506+0000 7f4434578640 1 -- start start 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4434578640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f442c151740 0x7f442c0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4434578640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f442c1535a0 0x7f442c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4434578640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c155060 con 0x7f442c0c1bb0 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4434578640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c155340 con 0x7f442c151740 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4434578640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c155620 con 0x7f442c1535a0 2024-05-08T20:27:48.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f442c151740 0x7f442c0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f442c151740 0x7f442c0c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48760/0 (socket says 172.21.15.81:48760) 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 -- 172.21.15.81:0/983590802 learned_addr learned my addr 172.21.15.81:0/983590802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4432b15640 1 --2- 172.21.15.81:0/983590802 >> v2:172.21.15.117:3300/0 conn(0x7f442c1535a0 0x7f442c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 -- 172.21.15.81:0/983590802 >> v2:172.21.15.117:3300/0 conn(0x7f442c1535a0 msgr2=0x7f442c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 --2- 172.21.15.81:0/983590802 >> v2:172.21.15.117:3300/0 conn(0x7f442c1535a0 0x7f442c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 -- 172.21.15.81:0/983590802 >> v1:172.21.15.117:6789/0 conn(0x7f442c0c1bb0 legacy=0x7f442c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:48.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.510+0000 7f4431b13640 1 -- 172.21.15.81:0/983590802 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c155900 con 0x7f442c151740 2024-05-08T20:27:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 --2- 172.21.15.81:0/983590802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c151740 0x7f442c0c1f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f442c06f190 tx=0x7f441c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d420fec133ea1284 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431312640 1 -- 172.21.15.81:0/983590802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0ab670 con 0x7f442c151740 2024-05-08T20:27:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431312640 1 -- 172.21.15.81:0/983590802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c0ab7d0 con 0x7f442c151740 2024-05-08T20:27:48.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431312640 1 -- 172.21.15.81:0/983590802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0abb60 con 0x7f442c151740 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- 172.21.15.81:0/983590802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c151740 msgr2=0x7f442c0c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- 172.21.15.81:0/983590802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c151740 0x7f442c0c1f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f442c06f190 tx=0x7f441c01c410 comp rx=0 tx=0).stop 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- 172.21.15.81:0/983590802 shutdown_connections 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- 172.21.15.81:0/983590802 >> v2:172.21.15.117:3300/0 conn(0x7f442c1535a0 0x7f442c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- 172.21.15.81:0/983590802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c151740 0x7f442c0c1f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- 172.21.15.81:0/983590802 >> 172.21.15.81:0/983590802 conn(0x7f442c0c2ca0 msgr2=0x7f442c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- 172.21.15.81:0/983590802 shutdown_connections 2024-05-08T20:27:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- 172.21.15.81:0/983590802 wait complete. 2024-05-08T20:27:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 Processor -- start 2024-05-08T20:27:48.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- start start 2024-05-08T20:27:48.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f442c0c1bb0 0x7f442c14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f442c14b560 0x7f442c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0718c0 con 0x7f442c1535a0 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0c01a0 con 0x7f442c14b560 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4434578640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c151e20 con 0x7f442c0c1bb0 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48762/0 (socket says 172.21.15.81:48762) 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 -- 172.21.15.81:0/3406908003 learned_addr learned my addr 172.21.15.81:0/3406908003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4432314640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f442c0c1bb0 0x7f442c14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4432b15640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f442c14b560 0x7f442c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 -- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f442c0c1bb0 msgr2=0x7f442c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f442c0c1bb0 0x7f442c14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 -- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f442c14b560 msgr2=0x7f442c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f442c14b560 0x7f442c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.514+0000 7f4431b13640 1 -- 172.21.15.81:0/3406908003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0094d0 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4431b13640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f441c01ccb0 tx=0x7f441c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c004220 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c004380 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c071300 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c003840 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c0bfe30 con 0x7f442c1535a0 2024-05-08T20:27:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c0bfc90 con 0x7f442c1535a0 2024-05-08T20:27:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f441c0039a0 con 0x7f442c1535a0 2024-05-08T20:27:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 0x7f4410068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f441c11edc0 con 0x7f442c1535a0 2024-05-08T20:27:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4432314640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 0x7f4410068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.518+0000 7f4432314640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 0x7f4410068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f442c0c60c0 tx=0x7f4428008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.522+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f442c0bfc90 con 0x7f442c1535a0 2024-05-08T20:27:48.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.678+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f442c0bfc90 con 0x7f442c1535a0 2024-05-08T20:27:48.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4422ffd640 1 -- 172.21.15.81:0/3406908003 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7f442c0bfc90 con 0x7f442c1535a0 2024-05-08T20:27:48.687 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:48.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 msgr2=0x7f4410068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 0x7f4410068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f442c0c60c0 tx=0x7f4428008040 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 msgr2=0x7f442c0bf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f441c01ccb0 tx=0x7f441c01ac50 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 shutdown_connections 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4410066690 0x7f4410068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f442c14b560 0x7f442c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442c1535a0 0x7f442c0bf440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 --2- 172.21.15.81:0/3406908003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f442c0c1bb0 0x7f442c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 >> 172.21.15.81:0/3406908003 conn(0x7f442c0c2ca0 msgr2=0x7f442c14e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 shutdown_connections 2024-05-08T20:27:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.682+0000 7f4434578640 1 -- 172.21.15.81:0/3406908003 wait complete. 2024-05-08T20:27:48.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:27:48.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:27:48.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:27:48.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 Processor -- start 2024-05-08T20:27:48.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 -- start start 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe278151740 0x7fe2780c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe278155060 con 0x7fe2781535a0 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe278155340 con 0x7fe2780c1bb0 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27f2d3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe278155620 con 0x7fe278151740 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27c86e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe278151740 0x7fe2780c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27d870640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe2781535a0 0x7fe27815c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59204/0 (socket says 172.21.15.81:59204) 2024-05-08T20:27:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27d870640 1 -- 172.21.15.81:0/1896890474 learned_addr learned my addr 172.21.15.81:0/1896890474 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27c86e640 1 -- 172.21.15.81:0/1896890474 >> v1:172.21.15.117:6789/0 conn(0x7fe2780c1bb0 legacy=0x7fe278152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27c86e640 1 -- 172.21.15.81:0/1896890474 >> v1:172.21.15.81:6789/0 conn(0x7fe2781535a0 legacy=0x7fe27815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe27c86e640 1 -- 172.21.15.81:0/1896890474 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278155900 con 0x7fe278151740 2024-05-08T20:27:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.818+0000 7fe277fff640 1 -- 172.21.15.81:0/1896890474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076221587 0 0) 0x7fe278155060 con 0x7fe2781535a0 2024-05-08T20:27:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27c86e640 1 --2- 172.21.15.81:0/1896890474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278151740 0x7fe2780c1f90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58dd73510231bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe277fff640 1 -- 172.21.15.81:0/1896890474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0ac670 con 0x7fe278151740 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe277fff640 1 -- 172.21.15.81:0/1896890474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c0ac7d0 con 0x7fe278151740 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe277fff640 1 -- 172.21.15.81:0/1896890474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0acb60 con 0x7fe278151740 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1896890474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278151740 msgr2=0x7fe2780c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1896890474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278151740 0x7fe2780c1f90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01e5a0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1896890474 shutdown_connections 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1896890474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278151740 0x7fe2780c1f90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1896890474 >> 172.21.15.81:0/1896890474 conn(0x7fe2780c2ca0 msgr2=0x7fe2780c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1896890474 shutdown_connections 2024-05-08T20:27:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1896890474 wait complete. 2024-05-08T20:27:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.822+0000 7fe27f2d3640 1 Processor -- start 2024-05-08T20:27:48.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- start start 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2780c1bb0 0x7fe2780bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 0x7fe278147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278147de0 con 0x7fe2781535a0 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814b6d0 con 0x7fe2780c1bb0 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814eaa0 con 0x7fe278151740 2024-05-08T20:27:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50488/0 (socket says 172.21.15.81:50488) 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 -- 172.21.15.81:0/1044153894 learned_addr learned my addr 172.21.15.81:0/1044153894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27c86e640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 0x7fe278147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d06f640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2780c1bb0 0x7fe2780bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 -- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 msgr2=0x7fe278147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 0x7fe278147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 -- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2780c1bb0 msgr2=0x7fe2780bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2780c1bb0 0x7fe2780bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 -- 172.21.15.81:0/1044153894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c009420 con 0x7fe2781535a0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27c86e640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 0x7fe278147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d870640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c3c0 tx=0x7fe26800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680074e0 con 0x7fe2781535a0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268007640 con 0x7fe2781535a0 2024-05-08T20:27:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27814b920 con 0x7fe2781535a0 2024-05-08T20:27:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268004a30 con 0x7fe2781535a0 2024-05-08T20:27:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27814e730 con 0x7fe2781535a0 2024-05-08T20:27:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27814ec10 con 0x7fe2781535a0 2024-05-08T20:27:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe268004b90 con 0x7fe2781535a0 2024-05-08T20:27:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 0x7fe264068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe268084270 con 0x7fe2781535a0 2024-05-08T20:27:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d06f640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 0x7fe264068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.826+0000 7fe27d06f640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 0x7fe264068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe270007bf0 tx=0x7fe270007240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:48.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.830+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe2680512b0 con 0x7fe2781535a0 2024-05-08T20:27:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe278074950 con 0x7fe2781535a0 2024-05-08T20:27:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe275ffb640 1 -- 172.21.15.81:0/1044153894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7fe2680548d0 con 0x7fe2781535a0 2024-05-08T20:27:48.996 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 msgr2=0x7fe264068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 0x7fe264068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe270007bf0 tx=0x7fe270007240 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 msgr2=0x7fe2781478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c3c0 tx=0x7fe26800c880 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 shutdown_connections 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe264066690 0x7fe264068b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781535a0 0x7fe2781478a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe278151740 0x7fe278147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 --2- 172.21.15.81:0/1044153894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2780c1bb0 0x7fe2780bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 >> 172.21.15.81:0/1044153894 conn(0x7fe2780c2ca0 msgr2=0x7fe2780c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 shutdown_connections 2024-05-08T20:27:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:48.990+0000 7fe27f2d3640 1 -- 172.21.15.81:0/1044153894 wait complete. 2024-05-08T20:27:49.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:27:49.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.170+0000 7fcfffe1e640 1 Processor -- start 2024-05-08T20:27:49.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.170+0000 7fcfffe1e640 1 -- start start 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcfffe1e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 0x7fcff8151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcfffe1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcff80c1f90 0x7fcff8152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcfffe1e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80c2420 con 0x7fcff81533d0 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcfffe1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8155060 con 0x7fcff80c1f90 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcfffe1e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8155340 con 0x7fcff80c1bb0 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcff80c1f90 0x7fcff8152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcff80c1f90 0x7fcff8152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50494/0 (socket says 172.21.15.81:50494) 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 -- 172.21.15.81:0/2462672255 learned_addr learned my addr 172.21.15.81:0/2462672255 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffdbba640 1 --2- 172.21.15.81:0/2462672255 >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 0x7fcff8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 -- 172.21.15.81:0/2462672255 >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 msgr2=0x7fcff8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 --2- 172.21.15.81:0/2462672255 >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 0x7fcff8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 -- 172.21.15.81:0/2462672255 >> v1:172.21.15.117:6789/0 conn(0x7fcff81533d0 legacy=0x7fcff806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 -- 172.21.15.81:0/2462672255 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8155620 con 0x7fcff80c1f90 2024-05-08T20:27:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffdbba640 1 --2- 172.21.15.81:0/2462672255 >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 0x7fcff8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.174+0000 7fcffd3b9640 1 --2- 172.21.15.81:0/2462672255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff80c1f90 0x7fcff8152e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcff8073fc0 tx=0x7fcfe801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a718c2e678e702b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffcbb8640 1 -- 172.21.15.81:0/2462672255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80ab600 con 0x7fcff80c1f90 2024-05-08T20:27:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffcbb8640 1 -- 172.21.15.81:0/2462672255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe80a7050 con 0x7fcff80c1f90 2024-05-08T20:27:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffcbb8640 1 -- 172.21.15.81:0/2462672255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80ab980 con 0x7fcff80c1f90 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/2462672255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff80c1f90 msgr2=0x7fcff8152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/2462672255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff80c1f90 0x7fcff8152e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcff8073fc0 tx=0x7fcfe801c420 comp rx=0 tx=0).stop 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/2462672255 shutdown_connections 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/2462672255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff80c1f90 0x7fcff8152e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/2462672255 >> v2:172.21.15.117:3300/0 conn(0x7fcff80c1bb0 0x7fcff8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/2462672255 >> 172.21.15.81:0/2462672255 conn(0x7fcff80c2ca0 msgr2=0x7fcff80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/2462672255 shutdown_connections 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/2462672255 wait complete. 2024-05-08T20:27:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 Processor -- start 2024-05-08T20:27:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- start start 2024-05-08T20:27:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff80c1bb0 0x7fcff814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff80c1f90 0x7fcff8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80bb2c0 con 0x7fcff81533d0 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80aab20 con 0x7fcff80c1bb0 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80bbfd0 con 0x7fcff80c1f90 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffdbba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff80c1bb0 0x7fcff814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50510/0 (socket says 172.21.15.81:50510) 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 -- 172.21.15.81:0/909827285 learned_addr learned my addr 172.21.15.81:0/909827285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffd3b9640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff80c1f90 0x7fcff8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 -- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff80c1f90 msgr2=0x7fcff8150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff80c1f90 0x7fcff8150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 -- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff80c1bb0 msgr2=0x7fcff814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff80c1bb0 0x7fcff814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 -- 172.21.15.81:0/909827285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80094d0 con 0x7fcff81533d0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcffe3bb640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcff000c780 tx=0x7fcff000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0004b70 con 0x7fcff81533d0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000ce90 con 0x7fcff81533d0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000a850 con 0x7fcff81533d0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff814b520 con 0x7fcff81533d0 2024-05-08T20:27:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.178+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff814bae0 con 0x7fcff81533d0 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff80aa670 con 0x7fcff81533d0 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcff000a9b0 con 0x7fcff81533d0 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcfee7fc640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 0x7fcfdc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcffdbba640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 0x7fcfdc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcff00844e0 con 0x7fcff81533d0 2024-05-08T20:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.182+0000 7fcffdbba640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 0x7fcfdc068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.186+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcff0051660 con 0x7fcff81533d0 2024-05-08T20:27:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fcff8074950 con 0x7fcff81533d0 2024-05-08T20:27:49.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfee7fc640 1 -- 172.21.15.81:0/909827285 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7fcff0054c80 con 0x7fcff81533d0 2024-05-08T20:27:49.345 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:49.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 msgr2=0x7fcfdc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 0x7fcfdc068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4008040 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 msgr2=0x7fcff814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcff000c780 tx=0x7fcff000cc40 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 shutdown_connections 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfdc066690 0x7fcfdc068b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff81533d0 0x7fcff814d260 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcff80c1f90 0x7fcff8150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 --2- 172.21.15.81:0/909827285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcff80c1bb0 0x7fcff814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 >> 172.21.15.81:0/909827285 conn(0x7fcff80c2ca0 msgr2=0x7fcff8070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 shutdown_connections 2024-05-08T20:27:49.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.338+0000 7fcfffe1e640 1 -- 172.21.15.81:0/909827285 wait complete. 2024-05-08T20:27:49.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:49.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 Processor -- start 2024-05-08T20:27:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 -- start start 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1bb0 0x7fa56c151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa56c0c1f90 0x7fa56c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa56c1533d0 0x7fa56c06c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0c23f0 con 0x7fa56c1533d0 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c155060 con 0x7fa56c0c1f90 2024-05-08T20:27:49.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa572644640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c155340 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa570be1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa56c1533d0 0x7fa56c06c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa570be1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa56c1533d0 0x7fa56c06c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50514/0 (socket says 172.21.15.81:50514) 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.470+0000 7fa570be1640 1 -- 172.21.15.81:0/4290253550 learned_addr learned my addr 172.21.15.81:0/4290253550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/4290253550 >> v2:172.21.15.117:3300/0 conn(0x7fa56c0c1f90 0x7fa56c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa56bfff640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1bb0 0x7fa56c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 -- 172.21.15.81:0/4290253550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1bb0 msgr2=0x7fa56c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1bb0 0x7fa56c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 -- 172.21.15.81:0/4290253550 >> v2:172.21.15.117:3300/0 conn(0x7fa56c0c1f90 msgr2=0x7fa56c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 --2- 172.21.15.81:0/4290253550 >> v2:172.21.15.117:3300/0 conn(0x7fa56c0c1f90 0x7fa56c152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 -- 172.21.15.81:0/4290253550 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c155620 con 0x7fa56c1533d0 2024-05-08T20:27:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa570be1640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c1533d0 0x7fa56c06c0e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa56c06eed0 tx=0x7fa56401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d84c7145a425f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa56affd640 1 -- 172.21.15.81:0/4290253550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5790 con 0x7fa56c1533d0 2024-05-08T20:27:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa56affd640 1 -- 172.21.15.81:0/4290253550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640a58f0 con 0x7fa56c1533d0 2024-05-08T20:27:49.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa56affd640 1 -- 172.21.15.81:0/4290253550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5c80 con 0x7fa56c1533d0 2024-05-08T20:27:49.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 -- 172.21.15.81:0/4290253550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c1533d0 msgr2=0x7fa56c06c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c1533d0 0x7fa56c06c0e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa56c06eed0 tx=0x7fa56401c930 comp rx=0 tx=0).stop 2024-05-08T20:27:49.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 -- 172.21.15.81:0/4290253550 shutdown_connections 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c1533d0 0x7fa56c06c0e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 --2- 172.21.15.81:0/4290253550 >> v2:172.21.15.117:3300/0 conn(0x7fa56c0c1f90 0x7fa56c152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 --2- 172.21.15.81:0/4290253550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1bb0 0x7fa56c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 -- 172.21.15.81:0/4290253550 >> 172.21.15.81:0/4290253550 conn(0x7fa56c0c2ca0 msgr2=0x7fa56c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 -- 172.21.15.81:0/4290253550 shutdown_connections 2024-05-08T20:27:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.474+0000 7fa572644640 1 -- 172.21.15.81:0/4290253550 wait complete. 2024-05-08T20:27:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 Processor -- start 2024-05-08T20:27:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- start start 2024-05-08T20:27:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1f90 0x7fa56c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c1533d0 0x7fa56c1f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c15ae40 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c150d20 con 0x7fa56c1533d0 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c151000 con 0x7fa56c0c1f90 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50526/0 (socket says 172.21.15.81:50526) 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 -- 172.21.15.81:0/1887361603 learned_addr learned my addr 172.21.15.81:0/1887361603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa570be1640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c1533d0 0x7fa56c1f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1f90 0x7fa56c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 -- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1f90 msgr2=0x7fa56c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1f90 0x7fa56c158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 -- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c1533d0 msgr2=0x7fa56c1f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c1533d0 0x7fa56c1f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 -- 172.21.15.81:0/1887361603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009b30 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d5f0 tx=0x7fa55c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0125f0 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c012750 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1512e0 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c012ae0 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c159e30 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c074950 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa55c012c40 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 0x7fa558068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa55c084960 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.478+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 0x7fa558068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.482+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 0x7fa558068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0c3490 tx=0x7fa560008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.486+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa55c051a30 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.674+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa56c0c39a0 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa568ff9640 1 -- 172.21.15.81:0/1887361603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7fa55c055050 con 0x7fa56c0c1bb0 2024-05-08T20:27:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:49.684 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:49.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 msgr2=0x7fa558068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 0x7fa558068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0c3490 tx=0x7fa560008040 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 msgr2=0x7fa56c141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d5f0 tx=0x7fa55c00dab0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 shutdown_connections 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa558066690 0x7fa558068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c1533d0 0x7fa56c1f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0c1f90 0x7fa56c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 --2- 172.21.15.81:0/1887361603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c0c1bb0 0x7fa56c141800 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 >> 172.21.15.81:0/1887361603 conn(0x7fa56c0c2ca0 msgr2=0x7fa56c14e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 shutdown_connections 2024-05-08T20:27:49.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.678+0000 7fa572644640 1 -- 172.21.15.81:0/1887361603 wait complete. 2024-05-08T20:27:49.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:49.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 Processor -- start 2024-05-08T20:27:49.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 -- start start 2024-05-08T20:27:49.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 0x7fabd0160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00c4d00 con 0x7fabd0152120 2024-05-08T20:27:49.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00c52c0 con 0x7fabd00c8280 2024-05-08T20:27:49.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabd56f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c5bd0 con 0x7fabd01551f0 2024-05-08T20:27:49.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabd0152120 0x7fabd00c6d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59206/0 (socket says 172.21.15.81:59206) 2024-05-08T20:27:49.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 -- 172.21.15.81:0/2429312417 learned_addr learned my addr 172.21.15.81:0/2429312417 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcf7fe640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 0x7fabd0160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073228121 0 0) 0x7fabd00c4d00 con 0x7fabd0152120 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb8003530 con 0x7fabd0152120 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615235253 0 0) 0x7fabb8003530 con 0x7fabd0152120 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 msgr2=0x7fabd0160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 0x7fabd0160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 >> v1:172.21.15.117:6789/0 conn(0x7fabd00c8280 legacy=0x7fabd0154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd006a970 con 0x7fabd0152120 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fabc0001680 con 0x7fabd0152120 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 >> v1:172.21.15.81:6789/0 conn(0x7fabd0152120 legacy=0x7fabd00c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabb80039b0 0x7fabb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80047d0 0x7fabb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 0x7fabb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800ba40 con 0x7fabb80039b0 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800bb80 con 0x7fabb80047d0 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800bd40 con 0x7fabd01551f0 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabb80039b0 0x7fabb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 -- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 msgr2=0x7fabb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd01551f0 0x7fabb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 -- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80047d0 msgr2=0x7fabb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80047d0 0x7fabb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.814+0000 7fabceffd640 1 -- 172.21.15.81:0/2429312417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8003530 con 0x7fabb80039b0 2024-05-08T20:27:49.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabceffd640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabb80039b0 0x7fabb8003dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c210 tx=0x7fabc001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec00179a4423c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0005ae0 con 0x7fabb80039b0 2024-05-08T20:27:49.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc0005c60 con 0x7fabb80039b0 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabcdffb640 1 -- 172.21.15.81:0/2429312417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00a58d0 con 0x7fabb80039b0 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- 172.21.15.81:0/2429312417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabb80039b0 msgr2=0x7fabb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 --2- 172.21.15.81:0/2429312417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabb80039b0 0x7fabb8003dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fabc000c210 tx=0x7fabc001cbf0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabcf7fe640 1 -- 172.21.15.81:0/2429312417 reap_dead start 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- 172.21.15.81:0/2429312417 shutdown_connections 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- 172.21.15.81:0/2429312417 >> 172.21.15.81:0/2429312417 conn(0x7fabd00abfb0 msgr2=0x7fabd00ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- 172.21.15.81:0/2429312417 shutdown_connections 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- 172.21.15.81:0/2429312417 wait complete. 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 Processor -- start 2024-05-08T20:27:49.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 -- start start 2024-05-08T20:27:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80039b0 0x7fabd00af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 0x7fabd01ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.818+0000 7fabd56f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00afe10 con 0x7fabd01ecfe0 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c2940 con 0x7fabb80039b0 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01586e0 con 0x7fabd00c1450 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50538/0 (socket says 172.21.15.81:50538) 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 -- 172.21.15.81:0/7788276 learned_addr learned my addr 172.21.15.81:0/7788276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabce7fc640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 0x7fabd01ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 -- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 msgr2=0x7fabd01ecaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 0x7fabd01ecaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 -- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80039b0 msgr2=0x7fabd00af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabceffd640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80039b0 0x7fabd00af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80039b0 0x7fabd00af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 -- 172.21.15.81:0/7788276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd01f0ac0 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabce7fc640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 0x7fabd01ecaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabcf7fe640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabd00c6120 tx=0x7fabc800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8010040 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800bae0 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd0158e50 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800be70 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0158930 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd0158b50 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabc801d400 con 0x7fabd01ecfe0 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 0x7fabbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabceffd640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 0x7fabbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:49.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fabc8084b80 con 0x7fabd01ecfe0 2024-05-08T20:27:49.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.822+0000 7fabceffd640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 0x7fabbc068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabc00ab000 tx=0x7fabc00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:49.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.826+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fabc8055640 con 0x7fabd01ecfe0 2024-05-08T20:27:49.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.986+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd00c8710 con 0x7fabd01ecfe0 2024-05-08T20:27:49.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.986+0000 7fabb77fe640 1 -- 172.21.15.81:0/7788276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7fabc80551d0 con 0x7fabd01ecfe0 2024-05-08T20:27:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:49.994 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 msgr2=0x7fabbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 0x7fabbc068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabc00ab000 tx=0x7fabc00a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 msgr2=0x7fabd0155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fabd00c6120 tx=0x7fabc800b480 comp rx=0 tx=0).stop 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 shutdown_connections 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fabbc066690 0x7fabbc068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabd01ecfe0 0x7fabd0155ac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabd00c1450 0x7fabd01ecaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 --2- 172.21.15.81:0/7788276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb80039b0 0x7fabd00af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 >> 172.21.15.81:0/7788276 conn(0x7fabd00abfb0 msgr2=0x7fabd00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 shutdown_connections 2024-05-08T20:27:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:49.990+0000 7fabd56f1640 1 -- 172.21.15.81:0/7788276 wait complete. 2024-05-08T20:27:50.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:27:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 Processor -- start 2024-05-08T20:27:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 -- start start 2024-05-08T20:27:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1e40c00c0 0x7ff1e4160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40aa830 con 0x7ff1e41521f0 2024-05-08T20:27:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e4072900 con 0x7ff1e41554e0 2024-05-08T20:27:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e912b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40c0640 con 0x7ff1e40c00c0 2024-05-08T20:27:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1e41521f0 0x7ff1e40c1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59220/0 (socket says 172.21.15.81:59220) 2024-05-08T20:27:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 -- 172.21.15.81:0/4219949410 learned_addr learned my addr 172.21.15.81:0/4219949410 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e359e640 1 --2- 172.21.15.81:0/4219949410 >> v2:172.21.15.117:3300/0 conn(0x7ff1e40c00c0 0x7ff1e4160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291802197 0 0) 0x7ff1e40aa830 con 0x7ff1e41521f0 2024-05-08T20:27:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d0003530 con 0x7ff1e41521f0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279197243 0 0) 0x7ff1cc001120 con 0x7ff1e41554e0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e40aa830 con 0x7ff1e41554e0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681828032 0 0) 0x7ff1d0003530 con 0x7ff1e41521f0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 >> v2:172.21.15.117:3300/0 conn(0x7ff1e40c00c0 msgr2=0x7ff1e4160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 --2- 172.21.15.81:0/4219949410 >> v2:172.21.15.117:3300/0 conn(0x7ff1e40c00c0 0x7ff1e4160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 >> v1:172.21.15.117:6789/0 conn(0x7ff1e41554e0 legacy=0x7ff1e40bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4155970 con 0x7ff1e41521f0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff1dc001a00 con 0x7ff1e41521f0 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 >> v1:172.21.15.81:6789/0 conn(0x7ff1e41521f0 legacy=0x7ff1e40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 0x7ff1d0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d00047d0 0x7ff1d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0005190 0x7ff1d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c0640 con 0x7ff1d0003b10 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d000c010 con 0x7ff1d0005190 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d000c1d0 con 0x7ff1d00047d0 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 0x7ff1d0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e359e640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0005190 0x7ff1d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e259c640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d00047d0 0x7ff1d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 -- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d00047d0 msgr2=0x7ff1d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d00047d0 0x7ff1d0004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 -- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0005190 msgr2=0x7ff1d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0005190 0x7ff1d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e359e640 1 -- 172.21.15.81:0/4219949410 reap_dead start 2024-05-08T20:27:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.122+0000 7ff1e2d9d640 1 -- 172.21.15.81:0/4219949410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0003530 con 0x7ff1d0003b10 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 0x7ff1d0003f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a7c0 tx=0x7ff1dc01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a09d57acf176bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0ad430 con 0x7ff1d0003b10 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0a8070 con 0x7ff1d0003b10 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e1d9b640 1 -- 172.21.15.81:0/4219949410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0ad830 con 0x7ff1d0003b10 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 msgr2=0x7ff1d0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 0x7ff1d0003f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00a7c0 tx=0x7ff1dc01d2e0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- 172.21.15.81:0/4219949410 shutdown_connections 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 --2- 172.21.15.81:0/4219949410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d0003b10 0x7ff1d0003f10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- 172.21.15.81:0/4219949410 >> 172.21.15.81:0/4219949410 conn(0x7ff1e40c2ca0 msgr2=0x7ff1e40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- 172.21.15.81:0/4219949410 shutdown_connections 2024-05-08T20:27:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- 172.21.15.81:0/4219949410 wait complete. 2024-05-08T20:27:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 Processor -- start 2024-05-08T20:27:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.126+0000 7ff1e912b640 1 -- start start 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0003b10 0x7ff1e406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e41e2190 0x7ff1e41e2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e406fea0 con 0x7ff1e406ae70 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e406cb60 con 0x7ff1d0003b10 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e406c550 con 0x7ff1e41e2190 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50554/0 (socket says 172.21.15.81:50554) 2024-05-08T20:27:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 -- 172.21.15.81:0/549134206 learned_addr learned my addr 172.21.15.81:0/549134206 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e359e640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e41e2190 0x7ff1e41e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0003b10 0x7ff1e406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 -- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e41e2190 msgr2=0x7ff1e41e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e41e2190 0x7ff1e41e2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 -- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0003b10 msgr2=0x7ff1e406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0003b10 0x7ff1e406f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 -- 172.21.15.81:0/549134206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4070370 con 0x7ff1e406ae70 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e259c640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d6f0 tx=0x7ff1cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00b8b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00ba10 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4070090 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00bdc0 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40720b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e406c3b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1cc0123f0 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 0x7ff1c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff1cc084420 con 0x7ff1e406ae70 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 0x7ff1c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.130+0000 7ff1e2d9d640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 0x7ff1c4068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ad000 tx=0x7ff1dc007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.134+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff1e406c3b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.322+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1e406c3b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.322+0000 7ff1db7fe640 1 -- 172.21.15.81:0/549134206 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7ff1e406c3b0 con 0x7ff1e406ae70 2024-05-08T20:27:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:50.331 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:27:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 msgr2=0x7ff1c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 0x7ff1c4068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ad000 tx=0x7ff1dc007040 comp rx=0 tx=0).stop 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 msgr2=0x7ff1e4071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d6f0 tx=0x7ff1cc00dbb0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 shutdown_connections 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff1c40666c0 0x7ff1c4068b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e41e2190 0x7ff1e41e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e406ae70 0x7ff1e4071b70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 --2- 172.21.15.81:0/549134206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d0003b10 0x7ff1e406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 >> 172.21.15.81:0/549134206 conn(0x7ff1e40c2ca0 msgr2=0x7ff1e4157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 shutdown_connections 2024-05-08T20:27:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.326+0000 7ff1e912b640 1 -- 172.21.15.81:0/549134206 wait complete. 2024-05-08T20:27:50.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T20:27:27.953430+0000', 'modified': '2024-05-08T20:27:30.976398+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6836/2268408600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2268408600}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 2268408600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:27:50.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T20:27:50.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-08T20:27:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 Processor -- start 2024-05-08T20:27:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 -- start start 2024-05-08T20:27:50.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5400c26e0 0x7fb5401555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb540155140 con 0x7fb540152220 2024-05-08T20:27:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5400c32d0 con 0x7fb5400aac30 2024-05-08T20:27:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb547169640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400c4780 con 0x7fb5400c26e0 2024-05-08T20:27:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb540152220 0x7fb5400c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59224/0 (socket says 172.21.15.81:59224) 2024-05-08T20:27:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 -- 172.21.15.81:0/466055941 learned_addr learned my addr 172.21.15.81:0/466055941 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53ffff640 1 --2- 172.21.15.81:0/466055941 >> v2:172.21.15.117:3300/0 conn(0x7fb5400c26e0 0x7fb5401555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143658852 0 0) 0x7fb540155140 con 0x7fb540152220 2024-05-08T20:27:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb530003530 con 0x7fb540152220 2024-05-08T20:27:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1434839002 0 0) 0x7fb530003530 con 0x7fb540152220 2024-05-08T20:27:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 >> v2:172.21.15.117:3300/0 conn(0x7fb5400c26e0 msgr2=0x7fb5401555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 --2- 172.21.15.81:0/466055941 >> v2:172.21.15.117:3300/0 conn(0x7fb5400c26e0 0x7fb5401555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 >> v1:172.21.15.117:6789/0 conn(0x7fb5400aac30 legacy=0x7fb5400c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540072650 con 0x7fb540152220 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53ffff640 1 --2- 172.21.15.81:0/466055941 >> v2:172.21.15.117:3300/0 conn(0x7fb5400c26e0 0x7fb5401555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb534001680 con 0x7fb540152220 2024-05-08T20:27:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 >> v1:172.21.15.81:6789/0 conn(0x7fb540152220 legacy=0x7fb5400c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 0x7fb530003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5300047d0 0x7fb530004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5300052b0 0x7fb53000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c150 con 0x7fb530003980 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c2c0 con 0x7fb5300047d0 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c480 con 0x7fb5300052b0 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 0x7fb530003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb53ffff640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5300047d0 0x7fb530004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb545706640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5300052b0 0x7fb53000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 -- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5300052b0 msgr2=0x7fb53000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5300052b0 0x7fb53000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 -- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5300047d0 msgr2=0x7fb530004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5300047d0 0x7fb530004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb544f05640 1 -- 172.21.15.81:0/466055941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530003530 con 0x7fb530003980 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb545706640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5300052b0 0x7fb53000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.882+0000 7fb545706640 1 -- 172.21.15.81:0/466055941 reap_dead start 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb544f05640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 0x7fb530003da0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c210 tx=0x7fb53401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410f3683174c1433 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534005ae0 con 0x7fb530003980 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534005c40 con 0x7fb530003980 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb53f7fe640 1 -- 172.21.15.81:0/466055941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340a57e0 con 0x7fb530003980 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 -- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 msgr2=0x7fb530003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 0x7fb530003da0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c210 tx=0x7fb53401cbf0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 -- 172.21.15.81:0/466055941 shutdown_connections 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 --2- 172.21.15.81:0/466055941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb530003980 0x7fb530003da0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 -- 172.21.15.81:0/466055941 >> 172.21.15.81:0/466055941 conn(0x7fb5400c4cc0 msgr2=0x7fb5400c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 -- 172.21.15.81:0/466055941 shutdown_connections 2024-05-08T20:27:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.886+0000 7fb547169640 1 -- 172.21.15.81:0/466055941 wait complete. 2024-05-08T20:27:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 Processor -- start 2024-05-08T20:27:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- start start 2024-05-08T20:27:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb530003980 0x7fb540156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 0x7fb54014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54006c020 con 0x7fb54014c4d0 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54014d450 con 0x7fb5401eda60 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54014ef00 con 0x7fb530003980 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50580/0 (socket says 172.21.15.81:50580) 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 -- 172.21.15.81:0/472879259 learned_addr learned my addr 172.21.15.81:0/472879259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb544f05640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb530003980 0x7fb540156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb545706640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 0x7fb54014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 -- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb530003980 msgr2=0x7fb540156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb530003980 0x7fb540156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 -- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 msgr2=0x7fb54014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 0x7fb54014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 -- 172.21.15.81:0/472879259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54006bc70 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb545706640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 0x7fb54014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53ffff640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb52c010810 tx=0x7fb52c010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53d7fa640 1 -- 172.21.15.81:0/472879259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00eb00 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53d7fa640 1 -- 172.21.15.81:0/472879259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c00c050 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54014f4c0 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53d7fa640 1 -- 172.21.15.81:0/472879259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00eea0 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401ee590 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.890+0000 7fb53d7fa640 1 -- 172.21.15.81:0/472879259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb52c015470 con 0x7fb54014c4d0 2024-05-08T20:27:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb53d7fa640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 0x7fb524068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb53d7fa640 1 -- 172.21.15.81:0/472879259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb52c084d10 con 0x7fb54014c4d0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 0x7fb524068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 0x7fb524068b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ab000 tx=0x7fb5340a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 Processor -- start 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- start start 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x56131063bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063c0b0 0x56131063c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561310506e80 con 0x5613106798d0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x561310494af0 con 0x56131063c0b0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613104920c0 con 0x56131063b790 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50586/0 (socket says 172.21.15.81:50586) 2024-05-08T20:27:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 -- 172.21.15.81:0/4012326667 learned_addr learned my addr 172.21.15.81:0/4012326667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb53ffff640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x56131063bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb545706640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063c0b0 0x56131063c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 -- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 msgr2=0x56131063bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x56131063bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 -- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063c0b0 msgr2=0x56131063c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063c0b0 0x56131063c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 -- 172.21.15.81:0/4012326667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561310189890 con 0x5613106798d0 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb53ffff640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x56131063bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb544f05640 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb534098500 tx=0x7fb534001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aca9bbe6c5f8fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb52a7fc640 1 -- 172.21.15.81:0/4012326667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b4070 con 0x5613106798d0 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb52a7fc640 1 -- 172.21.15.81:0/4012326667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534004d40 con 0x5613106798d0 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb52a7fc640 1 -- 172.21.15.81:0/4012326667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340a59e0 con 0x5613106798d0 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- 172.21.15.81:0/4012326667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 msgr2=0x56131063b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb534098500 tx=0x7fb534001a10 comp rx=0 tx=0).stop 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- 172.21.15.81:0/4012326667 shutdown_connections 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063c0b0 0x56131063c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x56131063bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4012326667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613106798d0 0x56131063b250 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- 172.21.15.81:0/4012326667 >> 172.21.15.81:0/4012326667 conn(0x561310644f00 msgr2=0x5613106452e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- 172.21.15.81:0/4012326667 shutdown_connections 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.894+0000 7fb54a2af000 1 -- 172.21.15.81:0/4012326667 wait complete. 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- start start 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 Processor -- start 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x5613106864d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613106798d0 0x561310683120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131048d9b0 con 0x56131063c0b0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131042cc00 con 0x5613106798d0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131044b070 con 0x56131063b790 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 10 client.0 _ll_register_callbacks cb 0x56131062aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50598/0 (socket says 172.21.15.81:50598) 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 -- 172.21.15.81:0/3532813028 learned_addr learned my addr 172.21.15.81:0/3532813028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb544f05640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x5613106864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb545706640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613106798d0 0x561310683120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 -- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 msgr2=0x5613106864d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x5613106864d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 -- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613106798d0 msgr2=0x561310683120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613106798d0 0x561310683120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 -- 172.21.15.81:0/3532813028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530003530 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb53ffff640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb52c055a30 tx=0x7fb52c0561a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a9e067def07938 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c07cea0 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb52c0598d0 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56131044a5f0 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb52c027550 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 10 client.4908 fetch_fsmap learned FSMap version 12 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x561310452ab0 con 0x56131063c0b0 2024-05-08T20:27:50.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c071080 con 0x56131063c0b0 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 12) v1 ==== 3668+0+0 (secure 0 0 0) 0x7fb52c05da00 con 0x56131063c0b0 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 10 client.4908 fetch_fsmap finished waiting for FSMap version 12 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 10 client.4908 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 20 client.4908 populate_metadata read hostname 'smithi081' 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x561310678b50 0x561310678f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 4 client.4908 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 --> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56131048a790 con 0x561310678b50 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb544f05640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x561310678b50 0x561310678f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb544f05640 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x561310678b50 0x561310678f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c8a602e2f3ef4d server_cookie=39ed34ed20a858e in_seq=0 out_seq=0 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 10 client.4908 ms_handle_connect on v2:172.21.15.81:6834/2268408600 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 1 -- 172.21.15.81:0/3532813028 <== mds.0 v2:172.21.15.81:6834/2268408600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56131048a790 con 0x561310678b50 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 10 client.4908 handle_command_reply: tid=0 2024-05-08T20:27:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 client.4908 shutdown 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 msgr2=0x561310682be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb52c055a30 tx=0x7fb52c0561a0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 shutdown_connections 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x561310678b50 0x561310678f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613106798d0 0x561310683120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310682be0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 --2- 172.21.15.81:0/3532813028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56131063b790 0x5613106864d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 >> 172.21.15.81:0/3532813028 conn(0x561310644f00 msgr2=0x56131063a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb51f7fe640 0 client.4908 ms_handle_reset on v2:172.21.15.81:6834/2268408600 2024-05-08T20:27:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.898+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 shutdown_connections 2024-05-08T20:27:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.902+0000 7fb54a2af000 1 -- 172.21.15.81:0/3532813028 wait complete. 2024-05-08T20:27:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.902+0000 7fb54a2af000 20 client.4908 trim_cache size 0 max 16384 2024-05-08T20:27:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.914+0000 7fb54a2af000 1 Processor -- start 2024-05-08T20:27:50.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- start start 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x56131067cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x561310680c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131014a940 con 0x56131063c0b0 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x561310446f80 con 0x56131063b790 2024-05-08T20:27:50.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x561310539b60 con 0x5613106798d0 2024-05-08T20:27:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50600/0 (socket says 172.21.15.81:50600) 2024-05-08T20:27:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/4268153156 learned_addr learned my addr 172.21.15.81:0/4268153156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 msgr2=0x561310680c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x561310680c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 msgr2=0x56131067cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x56131067cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/4268153156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561310438c00 con 0x56131063c0b0 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb52c05d960 tx=0x7fb52c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656a3782ab1d837e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb52affd640 1 -- 172.21.15.81:0/4268153156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c07cea0 con 0x56131063c0b0 2024-05-08T20:27:50.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb52affd640 1 -- 172.21.15.81:0/4268153156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56131044a5f0 con 0x56131063c0b0 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb52affd640 1 -- 172.21.15.81:0/4268153156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c027550 con 0x56131063c0b0 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- 172.21.15.81:0/4268153156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 msgr2=0x561310680700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb52c05d960 tx=0x7fb52c021000 comp rx=0 tx=0).stop 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- 172.21.15.81:0/4268153156 shutdown_connections 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x561310680c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x561310680700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- 172.21.15.81:0/4268153156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x56131067cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- 172.21.15.81:0/4268153156 >> 172.21.15.81:0/4268153156 conn(0x561310644f00 msgr2=0x56131067c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- 172.21.15.81:0/4268153156 shutdown_connections 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- 172.21.15.81:0/4268153156 wait complete. 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- start start 2024-05-08T20:27:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 Processor -- start 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x5613106dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x5613106de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561310435560 con 0x56131063c0b0 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131045b420 con 0x56131063b790 2024-05-08T20:27:50.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131048d1c0 con 0x5613106798d0 2024-05-08T20:27:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb54a2af000 10 client.0 _ll_register_callbacks cb 0x561310547100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:27:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50614/0 (socket says 172.21.15.81:50614) 2024-05-08T20:27:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/536603622 learned_addr learned my addr 172.21.15.81:0/536603622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:50.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb545706640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x5613106de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x5613106dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 msgr2=0x5613106de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x5613106de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 msgr2=0x5613106dd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:50.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x5613106dd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 -- 172.21.15.81:0/536603622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561310452ab0 con 0x56131063c0b0 2024-05-08T20:27:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb545706640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x5613106de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x5613106dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb53ffff640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb52c05d960 tx=0x7fb52c082e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d954c5c733cced4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.918+0000 7fb51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-08T20:27:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c07cea0 con 0x56131063c0b0 2024-05-08T20:27:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb52c0598d0 con 0x56131063c0b0 2024-05-08T20:27:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56131063b500 con 0x56131063c0b0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb52c0555e0 con 0x56131063c0b0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 10 client.4914 fetch_fsmap learned FSMap version 12 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x561310189cc0 con 0x56131063c0b0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56131063b500 con 0x56131063c0b0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 12) v1 ==== 3668+0+0 (secure 0 0 0) 0x7fb52c051890 con 0x56131063c0b0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 10 client.4914 fetch_fsmap finished waiting for FSMap version 12 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 10 client.4914 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 20 client.4914 populate_metadata read hostname 'smithi081' 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 4 client.4914 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 --> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56131045d460 con 0x5613106def30 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb544f05640 1 -- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 msgr2=0x5613106df310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-08T20:27:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb544f05640 1 -- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 msgr2=0x5613106df310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:27:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:27:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:50.922+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:27:51.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb544f05640 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e5f6e1c9cf6ff5 server_cookie=4fc18f5b1a5059b6 in_seq=0 out_seq=0 2024-05-08T20:27:51.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb51f7fe640 10 client.4914 ms_handle_connect on v2:172.21.15.81:6834/2268408600 2024-05-08T20:27:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb51f7fe640 1 -- 172.21.15.81:0/536603622 <== mds.0 v2:172.21.15.81:6834/2268408600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x56131045d460 con 0x5613106def30 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb51f7fe640 10 client.4914 handle_command_reply: tid=0 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 client.4914 shutdown 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 msgr2=0x5613106ddef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb52c05d960 tx=0x7fb52c082e70 comp rx=0 tx=0).stop 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 shutdown_connections 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:6834/2268408600,v1:172.21.15.81:6836/2268408600] conn(0x5613106def30 0x5613106df310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5613106798d0 0x5613106de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56131063c0b0 0x5613106ddef0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb51f7fe640 0 client.4914 ms_handle_reset on v2:172.21.15.81:6834/2268408600 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 --2- 172.21.15.81:0/536603622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56131063b790 0x5613106dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 >> 172.21.15.81:0/536603622 conn(0x561310644f00 msgr2=0x561310682340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 shutdown_connections 2024-05-08T20:27:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 1 -- 172.21.15.81:0/536603622 wait complete. 2024-05-08T20:27:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb54a2af000 20 client.4914 trim_cache size 0 max 16384 2024-05-08T20:27:51.137 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:27:51.137 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:27:51.137 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4266, 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "b", 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 23.174025973999999, 2024-05-08T20:27:51.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 12, 2024-05-08T20:27:51.139 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-05-08T20:27:51.139 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2024-05-08T20:27:51.139 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 38.369251945000002 2024-05-08T20:27:51.139 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 msgr2=0x7fb524068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 0x7fb524068b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb5340ab000 tx=0x7fb5340a7070 comp rx=0 tx=0).stop 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 msgr2=0x7fb54006b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb52c010810 tx=0x7fb52c010cd0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 shutdown_connections 2024-05-08T20:27:51.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb5240666c0 0x7fb524068b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5401eda60 0x7fb54014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb54014c4d0 0x7fb54006b730 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 --2- 172.21.15.81:0/472879259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb530003980 0x7fb540156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 >> 172.21.15.81:0/472879259 conn(0x7fb5400c4cc0 msgr2=0x7fb540152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 shutdown_connections 2024-05-08T20:27:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.126+0000 7fb547169640 1 -- 172.21.15.81:0/472879259 wait complete. 2024-05-08T20:27:51.162 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T20:27:51.172 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T20:27:51.172 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T20:27:51.172 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T20:27:51.172 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-08T20:27:51.268 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T20:27:51.268 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-05-08T20:27:51.268 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2024-05-08T20:27:51.269 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:27:51.269 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:51.269 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2024-05-08T20:27:51.269 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:27:51.269 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:51.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.269 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-08T20:27:51.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-08T20:27:51.336 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-05-08T20:27:51.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:27:51.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.339 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-08T20:27:51.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-05-08T20:27:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-05-08T20:27:51.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:27:51.408 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T20:27:51.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:27:51.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 Processor -- start 2024-05-08T20:27:51.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 -- start start 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18541501e0 0x7f185406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18540725f0 0x7f18540c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f185406f400 0x7f18540c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185406fd60 con 0x7f18541501e0 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1854072180 con 0x7f185406f400 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.534+0000 7f1859c2a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c0650 con 0x7f18540725f0 2024-05-08T20:27:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18541501e0 0x7f185406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18541501e0 0x7f185406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50628/0 (socket says 172.21.15.81:50628) 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 -- 172.21.15.81:0/3931599151 learned_addr learned my addr 172.21.15.81:0/3931599151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1852ffd640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18540725f0 0x7f18540c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1853fff640 1 --2- 172.21.15.81:0/3931599151 >> v2:172.21.15.117:3300/0 conn(0x7f185406f400 0x7f18540c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 -- 172.21.15.81:0/3931599151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18540725f0 msgr2=0x7f18540c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18540725f0 0x7f18540c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 -- 172.21.15.81:0/3931599151 >> v2:172.21.15.117:3300/0 conn(0x7f185406f400 msgr2=0x7f18540c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 --2- 172.21.15.81:0/3931599151 >> v2:172.21.15.117:3300/0 conn(0x7f185406f400 0x7f18540c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 -- 172.21.15.81:0/3931599151 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185406fa80 con 0x7f18541501e0 2024-05-08T20:27:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18537fe640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18541501e0 0x7f185406c930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1854066da0 tx=0x7f184801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808506d0b8f2f924 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18527fc640 1 -- 172.21.15.81:0/3931599151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480ab600 con 0x7f18541501e0 2024-05-08T20:27:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18527fc640 1 -- 172.21.15.81:0/3931599151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18480a7050 con 0x7f18541501e0 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f18527fc640 1 -- 172.21.15.81:0/3931599151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480ab980 con 0x7f18541501e0 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 -- 172.21.15.81:0/3931599151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18541501e0 msgr2=0x7f185406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18541501e0 0x7f185406c930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1854066da0 tx=0x7f184801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 -- 172.21.15.81:0/3931599151 shutdown_connections 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18540725f0 0x7f18540c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 --2- 172.21.15.81:0/3931599151 >> v2:172.21.15.117:3300/0 conn(0x7f185406f400 0x7f18540c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 --2- 172.21.15.81:0/3931599151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18541501e0 0x7f185406c930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 -- 172.21.15.81:0/3931599151 >> 172.21.15.81:0/3931599151 conn(0x7f18540c2ca0 msgr2=0x7f18540c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 -- 172.21.15.81:0/3931599151 shutdown_connections 2024-05-08T20:27:51.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.538+0000 7f1859c2a640 1 -- 172.21.15.81:0/3931599151 wait complete. 2024-05-08T20:27:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 Processor -- start 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- start start 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185406f400 0x7f18541edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 0x7f18540aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540ab490 con 0x7f18540725f0 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1854146970 con 0x7f185406f400 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18541edad0 con 0x7f18541501e0 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f18537fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185406f400 0x7f18541edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50638/0 (socket says 172.21.15.81:50638) 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 -- 172.21.15.81:0/1204586468 learned_addr learned my addr 172.21.15.81:0/1204586468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1853fff640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 0x7f18540aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 -- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 msgr2=0x7f18540aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 0x7f18540aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 -- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185406f400 msgr2=0x7f18541edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185406f400 0x7f18541edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 -- 172.21.15.81:0/1204586468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480094d0 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1853fff640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 0x7f18540aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1852ffd640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f184400d800 tx=0x7f184400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400b6c0 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400b820 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18541ed4a0 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400bb90 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18541f17a0 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.542+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185406beb0 con 0x7f18540725f0 2024-05-08T20:27:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.546+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f184400bcf0 con 0x7f18540725f0 2024-05-08T20:27:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.546+0000 7f183bfff640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 0x7f1840068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.546+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1844084940 con 0x7f18540725f0 2024-05-08T20:27:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.546+0000 7f18537fe640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 0x7f1840068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.546+0000 7f18537fe640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 0x7f1840068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18480ad000 tx=0x7f18480a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:51.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.550+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f18440519f0 con 0x7f18540725f0 2024-05-08T20:27:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.742+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1854074950 con 0x7f18540725f0 2024-05-08T20:27:51.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f183bfff640 1 -- 172.21.15.81:0/1204586468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+116 (secure 0 0 0) 0x7f1844055010 con 0x7f18540725f0 2024-05-08T20:27:51.751 INFO:teuthology.orchestra.run.smithi081.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-08T20:27:51.751 INFO:teuthology.orchestra.run.smithi081.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-08T20:27:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 msgr2=0x7f1840068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 0x7f1840068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18480ad000 tx=0x7f18480a6000 comp rx=0 tx=0).stop 2024-05-08T20:27:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 msgr2=0x7f18540bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f184400d800 tx=0x7f184400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 shutdown_connections 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1840066690 0x7f1840068b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18541501e0 0x7f18540aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18540725f0 0x7f18540bf830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 --2- 172.21.15.81:0/1204586468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f185406f400 0x7f18541edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 >> 172.21.15.81:0/1204586468 conn(0x7f18540c2ca0 msgr2=0x7f185414efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 shutdown_connections 2024-05-08T20:27:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:51.746+0000 7f1859c2a640 1 -- 172.21.15.81:0/1204586468 wait complete. 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:27:51.769 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:27:51.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.770 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:51.775 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42457sec preferred_lft 42457sec 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:4d:e8:58:98 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:27:51.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:51.777 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:27:51.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:27:51.777 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-08T20:27:51.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.860 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:27:51.915 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-05-08T20:27:51.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.917 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T20:27:51.982 INFO:teuthology.orchestra.run.smithi081.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:51.983 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:51.983 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:51.983 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:27:51.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:27:51.983 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-08T20:27:52.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.055 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-08T20:27:52.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.104 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-05-08T20:27:52.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.152 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-08T20:27:52.153 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-08T20:27:52.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:27:52.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T20:27:52.153 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-08T20:27:52.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T20:27:52.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T20:27:52.223 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-08T20:27:52.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.332 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-08T20:27:52.332 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-08T20:27:52.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-05-08T20:27:52.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:27:52.333 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-08T20:27:52.352 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2024-05-08T20:27:52.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:27:52.353 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:52.399 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:27:52.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:27:52.400 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:52.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-08T20:27:52.504 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:52.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:52.560 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:52.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.560 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-08T20:27:52.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:27:52.609 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=a) 2024-05-08T20:27:52.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-08T20:27:52.667 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:52.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:52.722 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:52.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:52.723 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-08T20:27:52.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-05-08T20:27:52.726+0000 7ff1566ac580 -1 init, newargv = 0x55df5465e900 newargc=15 2024-05-08T20:27:52.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[36000]: starting ceph client 2024-05-08T20:27:52.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[36000]: starting fuse 2024-05-08T20:27:53.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-05-08T20:27:53.854 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:53.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:53.909 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:53.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:53.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:53.911 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-05-08T20:27:53.963 INFO:teuthology.orchestra.run.smithi081.stdout:45 2024-05-08T20:27:53.964 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T20:27:53.964 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-05-08T20:27:53.965 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-05-08T20:27:54.084 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.36000.asok 2024-05-08T20:27:54.266 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36000.asok 2024-05-08T20:27:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:54.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36000.asok status 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T20:27:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "36000", 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4929, 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4929 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2777804856 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2777804856 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4929 192.168.0.1:0/2777804856", 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2777804856", 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 8, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 24, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "a" 2024-05-08T20:27:54.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:27:54.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:27:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 Processor -- start 2024-05-08T20:27:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 -- start start 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6eb814e410 0x7f6eb80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eb806b6e0 0x7f6eb815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80abc50 con 0x7f6eb80aac20 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80c2900 con 0x7f6eb806b6e0 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebf1f4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80aa320 con 0x7f6eb814e410 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eb806b6e0 0x7f6eb815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6eb80aac20 0x7f6eb806afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59236/0 (socket says 172.21.15.81:59236) 2024-05-08T20:27:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb7fff640 1 -- 172.21.15.81:0/3742526686 learned_addr learned my addr 172.21.15.81:0/3742526686 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebcf90640 1 --2- 172.21.15.81:0/3742526686 >> v2:172.21.15.117:3300/0 conn(0x7f6eb814e410 0x7f6eb80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 -- 172.21.15.81:0/3742526686 >> v2:172.21.15.117:3300/0 conn(0x7f6eb814e410 msgr2=0x7f6eb80aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 --2- 172.21.15.81:0/3742526686 >> v2:172.21.15.117:3300/0 conn(0x7f6eb814e410 0x7f6eb80aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 -- 172.21.15.81:0/3742526686 >> v1:172.21.15.81:6789/0 conn(0x7f6eb80aac20 legacy=0x7f6eb806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 -- 172.21.15.81:0/3742526686 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80a9560 con 0x7f6eb806b6e0 2024-05-08T20:27:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb77fe640 1 -- 172.21.15.81:0/3742526686 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235052721 0 0) 0x7f6eb80abc50 con 0x7f6eb80aac20 2024-05-08T20:27:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6ebd791640 1 --2- 172.21.15.81:0/3742526686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb806b6e0 0x7f6eb815b7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6eb806aea0 tx=0x7f6eb001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0f67ee74a5e382 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb77fe640 1 -- 172.21.15.81:0/3742526686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab600 con 0x7f6eb806b6e0 2024-05-08T20:27:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb77fe640 1 -- 172.21.15.81:0/3742526686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00a7050 con 0x7f6eb806b6e0 2024-05-08T20:27:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.558+0000 7f6eb77fe640 1 -- 172.21.15.81:0/3742526686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab980 con 0x7f6eb806b6e0 2024-05-08T20:27:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/3742526686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb806b6e0 msgr2=0x7f6eb815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/3742526686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb806b6e0 0x7f6eb815b7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6eb806aea0 tx=0x7f6eb001c3c0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/3742526686 shutdown_connections 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/3742526686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb806b6e0 0x7f6eb815b7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/3742526686 >> v2:172.21.15.117:3300/0 conn(0x7f6eb814e410 0x7f6eb80aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/3742526686 >> 172.21.15.81:0/3742526686 conn(0x7f6eb80c2ca0 msgr2=0x7f6eb80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/3742526686 shutdown_connections 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/3742526686 wait complete. 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 Processor -- start 2024-05-08T20:27:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- start start 2024-05-08T20:27:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb806b6e0 0x7f6eb814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eb814e410 0x7f6eb81ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8146100 con 0x7f6eb80aac20 2024-05-08T20:27:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8150790 con 0x7f6eb806b6e0 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8145a40 con 0x7f6eb814e410 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50670/0 (socket says 172.21.15.81:50670) 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 -- 172.21.15.81:0/1857375824 learned_addr learned my addr 172.21.15.81:0/1857375824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 -- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eb814e410 msgr2=0x7f6eb81ed560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eb814e410 0x7f6eb81ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebcf90640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb806b6e0 0x7f6eb814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 -- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb806b6e0 msgr2=0x7f6eb814c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb806b6e0 0x7f6eb814c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 -- 172.21.15.81:0/1857375824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009420 con 0x7f6eb80aac20 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb7fff640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0011f0 tx=0x7f6eac00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0074e0 con 0x7f6eb80aac20 2024-05-08T20:27:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac007640 con 0x7f6eb80aac20 2024-05-08T20:27:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8145d20 con 0x7f6eb80aac20 2024-05-08T20:27:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac004a10 con 0x7f6eb80aac20 2024-05-08T20:27:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.562+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8144480 con 0x7f6eb80aac20 2024-05-08T20:27:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb806f1e0 con 0x7f6eb80aac20 2024-05-08T20:27:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6eac004b70 con 0x7f6eb80aac20 2024-05-08T20:27:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6eb57fa640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 0x7f6ea4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f6eac0835e0 con 0x7f6eb80aac20 2024-05-08T20:27:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6ebcf90640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 0x7f6ea4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.566+0000 7f6ebcf90640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 0x7f6ea4068b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8008e50 tx=0x7f6ea80083a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.570+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6eb806f1e0 con 0x7f6eb80aac20 2024-05-08T20:27:54.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.766+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6eb8146240 con 0x7f6eb80aac20 2024-05-08T20:27:54.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.766+0000 7f6eb57fa640 1 -- 172.21.15.81:0/1857375824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+116 (secure 0 0 0) 0x7f6eb8146240 con 0x7f6eb80aac20 2024-05-08T20:27:54.773 INFO:teuthology.orchestra.run.smithi081.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-05-08T20:27:54.774 INFO:teuthology.orchestra.run.smithi081.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-05-08T20:27:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 msgr2=0x7f6ea4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 0x7f6ea4068b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8008e50 tx=0x7f6ea80083a0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 msgr2=0x7f6eb81ed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0011f0 tx=0x7f6eac00c9b0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 shutdown_connections 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ea40666c0 0x7f6ea4068b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eb814e410 0x7f6eb81ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb80aac20 0x7f6eb81ed020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 --2- 172.21.15.81:0/1857375824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb806b6e0 0x7f6eb814c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 >> 172.21.15.81:0/1857375824 conn(0x7f6eb80c2ca0 msgr2=0x7f6eb806aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 shutdown_connections 2024-05-08T20:27:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:54.770+0000 7f6ebf1f4640 1 -- 172.21.15.81:0/1857375824 wait complete. 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:27:54.791 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T20:27:54.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:54.792 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-05-08T20:27:54.798 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:5f:df:75:0f brd ff:ff:ff:ff:ff:ff 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:27:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:27:54.801 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:27:54.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:27:54.801 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-08T20:27:54.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:54.881 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:27:54.935 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-05-08T20:27:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:54.937 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-05-08T20:27:55.002 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:27:55.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:27:55.004 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-08T20:27:55.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.080 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-08T20:27:55.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.127 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-05-08T20:27:55.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.175 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-08T20:27:55.175 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-08T20:27:55.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T20:27:55.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T20:27:55.175 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-08T20:27:55.243 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T20:27:55.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T20:27:55.244 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-08T20:27:55.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.347 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-08T20:27:55.347 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-08T20:27:55.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-05-08T20:27:55.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:27:55.347 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-08T20:27:55.368 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2024-05-08T20:27:55.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:27:55.368 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:55.414 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T20:27:55.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:27:55.414 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:55.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-05-08T20:27:55.519 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:55.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:55.574 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:55.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.575 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-05-08T20:27:55.621 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:27:55.622 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=b) 2024-05-08T20:27:55.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-05-08T20:27:55.681 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:55.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:55.738 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:55.739 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:55.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:55.740 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-05-08T20:27:55.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-05-08T20:27:55.742+0000 7f87d1808580 -1 init, newargv = 0x55b17de2b370 newargc=15 2024-05-08T20:27:55.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[33493]: starting ceph client 2024-05-08T20:27:55.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[33493]: starting fuse 2024-05-08T20:27:56.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-05-08T20:27:56.870 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:27:56.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:27:56.925 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:27:56.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:27:56.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:56.927 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-05-08T20:27:56.974 INFO:teuthology.orchestra.run.smithi117.stdout:45 2024-05-08T20:27:56.975 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-05-08T20:27:56.975 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:27:56.976 DEBUG:teuthology.orchestra.run.smithi117:> 2024-05-08T20:27:56.977 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-05-08T20:27:56.977 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-05-08T20:27:57.095 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.33493.asok 2024-05-08T20:27:57.277 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33493.asok 2024-05-08T20:27:57.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:57.277 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33493.asok status 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-05-08T20:27:57.438 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "33493", 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4648, 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4648 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-05-08T20:27:57.439 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2768592033 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2768592033 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4648 192.168.0.1:0/2768592033", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2768592033", 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 12, 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 24, 2024-05-08T20:27:57.440 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:27:57.441 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-05-08T20:27:57.441 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "b" 2024-05-08T20:27:57.441 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-05-08T20:27:57.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:57.452 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-05-08T20:27:57.452 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:57.459 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-05-08T20:27:57.459 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:57.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:57.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:27:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:57.517 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-05-08T20:27:57.517 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:57.524 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-05-08T20:27:57.524 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:27:57.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T20:27:57.580 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-05-08T20:27:57.592 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-05-08T20:27:57.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:27:57.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 Processor -- start 2024-05-08T20:27:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 -- start start 2024-05-08T20:27:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b1806f400 0x7f3b180c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180c0650 con 0x7f3b180725f0 2024-05-08T20:27:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1806fa80 con 0x7f3b181501e0 2024-05-08T20:27:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1fa58640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1806fd60 con 0x7f3b1806f400 2024-05-08T20:27:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1cff3640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b180725f0 0x7f3b180c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59242/0 (socket says 172.21.15.81:59242) 2024-05-08T20:27:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1cff3640 1 -- 172.21.15.81:0/2786746637 learned_addr learned my addr 172.21.15.81:0/2786746637 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:57.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1dff5640 1 --2- 172.21.15.81:0/2786746637 >> v2:172.21.15.117:3300/0 conn(0x7f3b1806f400 0x7f3b180c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027110575 0 0) 0x7f3b180c0650 con 0x7f3b180725f0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04003530 con 0x7f3b180725f0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944100574 0 0) 0x7f3b04003530 con 0x7f3b180725f0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 >> v2:172.21.15.117:3300/0 conn(0x7f3b1806f400 msgr2=0x7f3b180c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 --2- 172.21.15.81:0/2786746637 >> v2:172.21.15.117:3300/0 conn(0x7f3b1806f400 0x7f3b180c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 >> v1:172.21.15.117:6789/0 conn(0x7f3b181501e0 legacy=0x7f3b1806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18071ea0 con 0x7f3b180725f0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3b08001680 con 0x7f3b180725f0 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 >> v1:172.21.15.81:6789/0 conn(0x7f3b180725f0 legacy=0x7f3b180c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 0x7f3b04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b040047d0 0x7f3b04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b040052b0 0x7f3b0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1806fd60 con 0x7f3b04003980 2024-05-08T20:27:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0400c180 con 0x7f3b040047d0 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0400c340 con 0x7f3b040052b0 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 0x7f3b04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1dff5640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b040052b0 0x7f3b0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1cff3640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b040047d0 0x7f3b04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 -- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b040052b0 msgr2=0x7f3b0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b040052b0 0x7f3b0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 -- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b040047d0 msgr2=0x7f3b04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b040047d0 0x7f3b04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1d7f4640 1 -- 172.21.15.81:0/2786746637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04003530 con 0x7f3b04003980 2024-05-08T20:27:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.714+0000 7f3b1dff5640 1 -- 172.21.15.81:0/2786746637 reap_dead start 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 0x7f3b04003da0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001750 tx=0x7f3b1401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfe922b46650011 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140050d0 con 0x7f3b04003980 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b140a7050 con 0x7f3b04003980 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b0ffff640 1 -- 172.21.15.81:0/2786746637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14005490 con 0x7f3b04003980 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 msgr2=0x7f3b04003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 0x7f3b04003da0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001750 tx=0x7f3b1401c3c0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2786746637 shutdown_connections 2024-05-08T20:27:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2786746637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04003980 0x7f3b04003da0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2786746637 >> 172.21.15.81:0/2786746637 conn(0x7f3b180c2ca0 msgr2=0x7f3b180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2786746637 shutdown_connections 2024-05-08T20:27:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2786746637 wait complete. 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 Processor -- start 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.718+0000 7f3b1fa58640 1 -- start start 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04003980 0x7f3b1806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 0x7f3b181ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18072180 con 0x7f3b181ee690 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18145ce0 con 0x7f3b04003980 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18150a00 con 0x7f3b18152c70 2024-05-08T20:27:57.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50686/0 (socket says 172.21.15.81:50686) 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 -- 172.21.15.81:0/2704743508 learned_addr learned my addr 172.21.15.81:0/2704743508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04003980 0x7f3b1806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1cff3640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 0x7f3b181ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 -- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 msgr2=0x7f3b181ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 0x7f3b181ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 -- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04003980 msgr2=0x7f3b1806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04003980 0x7f3b1806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 -- 172.21.15.81:0/2704743508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b181534b0 con 0x7f3b181ee690 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1cff3640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 0x7f3b181ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1dff5640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3b180c2b80 tx=0x7f3b100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000e070 con 0x7f3b181ee690 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10011e10 con 0x7f3b181ee690 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b18153790 con 0x7f3b181ee690 2024-05-08T20:27:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100039a0 con 0x7f3b181ee690 2024-05-08T20:27:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1806c2e0 con 0x7f3b181ee690 2024-05-08T20:27:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b18074950 con 0x7f3b181ee690 2024-05-08T20:27:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b10003b00 con 0x7f3b181ee690 2024-05-08T20:27:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 0x7f3afc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3b10084c20 con 0x7f3b181ee690 2024-05-08T20:27:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 0x7f3afc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.722+0000 7f3b1d7f4640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 0x7f3afc068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b040057b0 tx=0x7f3b140011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.726+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3b10051cf0 con 0x7f3b181ee690 2024-05-08T20:27:57.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.890+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b181e0f60 con 0x7f3b181ee690 2024-05-08T20:27:57.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.890+0000 7f3b0dffb640 1 -- 172.21.15.81:0/2704743508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+19709 (secure 0 0 0) 0x7f3b10055310 con 0x7f3b181ee690 2024-05-08T20:27:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:57.899 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:27:28.956158+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:27:57.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 msgr2=0x7f3afc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 0x7f3afc068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b040057b0 tx=0x7f3b140011a0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 msgr2=0x7f3b180c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:57.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3b180c2b80 tx=0x7f3b100115a0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 shutdown_connections 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3afc066690 0x7f3afc068b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b181ee690 0x7f3b180c49d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b18152c70 0x7f3b181ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 --2- 172.21.15.81:0/2704743508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b04003980 0x7f3b1806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 >> 172.21.15.81:0/2704743508 conn(0x7f3b180c2ca0 msgr2=0x7f3b181461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 shutdown_connections 2024-05-08T20:27:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:57.894+0000 7f3b1fa58640 1 -- 172.21.15.81:0/2704743508 wait complete. 2024-05-08T20:27:57.916 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:27:57.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:27:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 Processor -- start 2024-05-08T20:27:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 -- start start 2024-05-08T20:27:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa56c1501e0 0x7fa56c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0725f0 0x7fa56c0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c0c0650 con 0x7fa56c06f400 2024-05-08T20:27:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c06fd60 con 0x7fa56c1501e0 2024-05-08T20:27:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa572c3a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c072180 con 0x7fa56c0725f0 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5711d7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa56c06f400 0x7fa56c0c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59248/0 (socket says 172.21.15.81:59248) 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5711d7640 1 -- 172.21.15.81:0/488891099 learned_addr learned my addr 172.21.15.81:0/488891099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 --2- 172.21.15.81:0/488891099 >> v2:172.21.15.117:3300/0 conn(0x7fa56c1501e0 0x7fa56c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56bfff640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0725f0 0x7fa56c0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295737528 0 0) 0x7fa56c0c0650 con 0x7fa56c06f400 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003530 con 0x7fa56c06f400 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4253569374 0 0) 0x7fa554003530 con 0x7fa56c06f400 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0725f0 msgr2=0x7fa56c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0725f0 0x7fa56c0c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 >> v2:172.21.15.117:3300/0 conn(0x7fa56c1501e0 msgr2=0x7fa56c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/488891099 >> v2:172.21.15.117:3300/0 conn(0x7fa56c1501e0 0x7fa56c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c06fa80 con 0x7fa56c06f400 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa564001a00 con 0x7fa56c06f400 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 >> v1:172.21.15.81:6789/0 conn(0x7fa56c06f400 legacy=0x7fa56c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554003980 0x7fa554003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554005190 0x7fa55400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c06fd60 con 0x7fa554003980 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c072180 con 0x7fa5540047d0 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400c030 con 0x7fa554005190 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56bfff640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0725f0 0x7fa56c0c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554003980 0x7fa554003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa56bfff640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5711d7640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554005190 0x7fa55400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 -- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554005190 msgr2=0x7fa55400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554005190 0x7fa55400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 -- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 msgr2=0x7fa554004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.022+0000 7fa5709d6640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa5709d6640 1 -- 172.21.15.81:0/488891099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554003530 con 0x7fa554003980 2024-05-08T20:27:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa56bfff640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa5711d7640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554005190 0x7fa55400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa5709d6640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554003980 0x7fa554003da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009ae0 tx=0x7fa55c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d496d5b3a2f80af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a5670 con 0x7fa554003980 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a57d0 con 0x7fa554003980 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa56b7fe640 1 -- 172.21.15.81:0/488891099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a5b80 con 0x7fa554003980 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 -- 172.21.15.81:0/488891099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554003980 msgr2=0x7fa554003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 --2- 172.21.15.81:0/488891099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554003980 0x7fa554003da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009ae0 tx=0x7fa55c01ca80 comp rx=0 tx=0).stop 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa5711d7640 1 -- 172.21.15.81:0/488891099 reap_dead start 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 -- 172.21.15.81:0/488891099 shutdown_connections 2024-05-08T20:27:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 -- 172.21.15.81:0/488891099 >> 172.21.15.81:0/488891099 conn(0x7fa56c0c2ca0 msgr2=0x7fa56c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 -- 172.21.15.81:0/488891099 shutdown_connections 2024-05-08T20:27:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.026+0000 7fa572c3a640 1 -- 172.21.15.81:0/488891099 wait complete. 2024-05-08T20:27:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 Processor -- start 2024-05-08T20:27:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- start start 2024-05-08T20:27:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c144710 0x7fa56c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c06c060 0x7fa56c1eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1ee780 con 0x7fa56c144330 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1eea20 con 0x7fa56c144710 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1eed00 con 0x7fa56c06c060 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50696/0 (socket says 172.21.15.81:50696) 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 -- 172.21.15.81:0/1861800138 learned_addr learned my addr 172.21.15.81:0/1861800138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c144710 0x7fa56c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 -- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c06c060 msgr2=0x7fa56c1eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c06c060 0x7fa56c1eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 -- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c144710 msgr2=0x7fa56c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c144710 0x7fa56c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 -- 172.21.15.81:0/1861800138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c150740 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5709d6640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009ae0 tx=0x7fa55c019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a5670 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00f000 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1eefe0 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004240 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c0c36b0 con 0x7fa56c144330 2024-05-08T20:27:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c1ef1a0 con 0x7fa56c144330 2024-05-08T20:27:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.030+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa55c0b4070 con 0x7fa56c144330 2024-05-08T20:27:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.034+0000 7fa5697fa640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 0x7fa558068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.034+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 0x7fa558068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.034+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa55c11e9b0 con 0x7fa56c144330 2024-05-08T20:27:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.034+0000 7fa56bfff640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 0x7fa558068b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa56c144d60 tx=0x7fa560008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.038+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa55c0eba80 con 0x7fa56c144330 2024-05-08T20:27:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.190+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa56c1ef630 con 0x7fa56c144330 2024-05-08T20:27:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.190+0000 7fa5697fa640 1 -- 172.21.15.81:0/1861800138 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa56c1ef630 con 0x7fa56c144330 2024-05-08T20:27:58.196 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 msgr2=0x7fa558068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 0x7fa558068b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa56c144d60 tx=0x7fa560008040 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 msgr2=0x7fa56c155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009ae0 tx=0x7fa55c019820 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 shutdown_connections 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5580666c0 0x7fa558068b80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c06c060 0x7fa56c1eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c144710 0x7fa56c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 --2- 172.21.15.81:0/1861800138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa56c144330 0x7fa56c155660 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 >> 172.21.15.81:0/1861800138 conn(0x7fa56c0c2ca0 msgr2=0x7fa56c149700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 shutdown_connections 2024-05-08T20:27:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.194+0000 7fa572c3a640 1 -- 172.21.15.81:0/1861800138 wait complete. 2024-05-08T20:27:58.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:27:58.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 Processor -- start 2024-05-08T20:27:58.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 -- start start 2024-05-08T20:27:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fceac06f400 0x7fceac0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0c0650 con 0x7fceac1501e0 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac06fa80 con 0x7fceac0725f0 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceb09be640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac06fd60 con 0x7fceac06f400 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaa59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fceac1501e0 0x7fceac06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59264/0 (socket says 172.21.15.81:59264) 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaa59c640 1 -- 172.21.15.81:0/3836577267 learned_addr learned my addr 172.21.15.81:0/3836577267 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaad9d640 1 --2- 172.21.15.81:0/3836577267 >> v2:172.21.15.81:3300/0 conn(0x7fceac06f400 0x7fceac0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fcea9d9b640 1 -- 172.21.15.81:0/3836577267 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515705146 0 0) 0x7fceac0c0650 con 0x7fceac1501e0 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fcea9d9b640 1 -- 172.21.15.81:0/3836577267 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce98003530 con 0x7fceac1501e0 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaad9d640 1 -- 172.21.15.81:0/3836577267 >> v1:172.21.15.117:6789/0 conn(0x7fceac0725f0 legacy=0x7fceac0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaad9d640 1 -- 172.21.15.81:0/3836577267 >> v1:172.21.15.81:6789/0 conn(0x7fceac1501e0 legacy=0x7fceac06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.330+0000 7fceaad9d640 1 -- 172.21.15.81:0/3836577267 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac071ea0 con 0x7fceac06f400 2024-05-08T20:27:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceaad9d640 1 --2- 172.21.15.81:0/3836577267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac06f400 0x7fceac0c2350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009d90 tx=0x7fcea401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32eac95edd49f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fcea9d9b640 1 -- 172.21.15.81:0/3836577267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a5840 con 0x7fceac06f400 2024-05-08T20:27:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fcea9d9b640 1 -- 172.21.15.81:0/3836577267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40a59a0 con 0x7fceac06f400 2024-05-08T20:27:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fcea9d9b640 1 -- 172.21.15.81:0/3836577267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a5d30 con 0x7fceac06f400 2024-05-08T20:27:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- 172.21.15.81:0/3836577267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac06f400 msgr2=0x7fceac0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 --2- 172.21.15.81:0/3836577267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac06f400 0x7fceac0c2350 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009d90 tx=0x7fcea401c850 comp rx=0 tx=0).stop 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- 172.21.15.81:0/3836577267 shutdown_connections 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 --2- 172.21.15.81:0/3836577267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac06f400 0x7fceac0c2350 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- 172.21.15.81:0/3836577267 >> 172.21.15.81:0/3836577267 conn(0x7fceac0c2ca0 msgr2=0x7fceac0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- 172.21.15.81:0/3836577267 shutdown_connections 2024-05-08T20:27:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- 172.21.15.81:0/3836577267 wait complete. 2024-05-08T20:27:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 Processor -- start 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.334+0000 7fceb09be640 1 -- start start 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 0x7fceac0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fceac1501e0 0x7fceac1ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac072180 con 0x7fceac0725f0 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1440f0 con 0x7fceac1501e0 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1f0e40 con 0x7fceac06f400 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50716/0 (socket says 172.21.15.81:50716) 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 -- 172.21.15.81:0/2715951557 learned_addr learned my addr 172.21.15.81:0/2715951557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceaad9d640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fceac1501e0 0x7fceac1ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceaa59c640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 0x7fceac0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 -- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 msgr2=0x7fceac0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 0x7fceac0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 -- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fceac1501e0 msgr2=0x7fceac1ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fceac1501e0 0x7fceac1ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 -- 172.21.15.81:0/2715951557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009a70 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceaa59c640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 0x7fceac0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea3fff640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c3c0 tx=0x7fce9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940052d0 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94005430 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac150740 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94003840 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac0bfb20 con 0x7fceac0725f0 2024-05-08T20:27:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac1f0fb0 con 0x7fceac0725f0 2024-05-08T20:27:58.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce940039a0 con 0x7fceac0725f0 2024-05-08T20:27:58.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 0x7fce8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fce940839d0 con 0x7fceac0725f0 2024-05-08T20:27:58.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceaa59c640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 0x7fce8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.338+0000 7fceaa59c640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 0x7fce8c068b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0011f0 tx=0x7fce9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.342+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fce94050a00 con 0x7fceac0725f0 2024-05-08T20:27:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fceac074930 con 0x7fceac0725f0 2024-05-08T20:27:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fcea2ffd640 1 -- 172.21.15.81:0/2715951557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7fce94054020 con 0x7fceac0725f0 2024-05-08T20:27:58.509 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 msgr2=0x7fce8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 0x7fce8c068b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0011f0 tx=0x7fce9c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 msgr2=0x7fceac1ecf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.502+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c3c0 tx=0x7fce9400c880 comp rx=0 tx=0).stop 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 shutdown_connections 2024-05-08T20:27:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce8c0666c0 0x7fce8c068b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fceac1501e0 0x7fceac1ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac0725f0 0x7fceac1ecf00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 --2- 172.21.15.81:0/2715951557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fceac06f400 0x7fceac0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 >> 172.21.15.81:0/2715951557 conn(0x7fceac0c2ca0 msgr2=0x7fceac14b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 shutdown_connections 2024-05-08T20:27:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.506+0000 7fceb09be640 1 -- 172.21.15.81:0/2715951557 wait complete. 2024-05-08T20:27:58.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:27:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 Processor -- start 2024-05-08T20:27:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 -- start start 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feec806cc40 0x7feec8153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feec806b080 0x7feec806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec806ba30 con 0x7feec814c6b0 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80c2570 con 0x7feec806b080 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feece0ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec8153780 con 0x7feec806cc40 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feec814c6b0 0x7feec806f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59268/0 (socket says 172.21.15.81:59268) 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec77fe640 1 -- 172.21.15.81:0/2026072789 learned_addr learned my addr 172.21.15.81:0/2026072789 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 --2- 172.21.15.81:0/2026072789 >> v2:172.21.15.81:3300/0 conn(0x7feec806b080 0x7feec806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec6ffd640 1 --2- 172.21.15.81:0/2026072789 >> v2:172.21.15.117:3300/0 conn(0x7feec806cc40 0x7feec8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec67fc640 1 -- 172.21.15.81:0/2026072789 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674492490 0 0) 0x7feec806ba30 con 0x7feec814c6b0 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec67fc640 1 -- 172.21.15.81:0/2026072789 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb0003530 con 0x7feec814c6b0 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 -- 172.21.15.81:0/2026072789 >> v2:172.21.15.117:3300/0 conn(0x7feec806cc40 msgr2=0x7feec8153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 --2- 172.21.15.81:0/2026072789 >> v2:172.21.15.117:3300/0 conn(0x7feec806cc40 0x7feec8153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 -- 172.21.15.81:0/2026072789 >> v1:172.21.15.81:6789/0 conn(0x7feec814c6b0 legacy=0x7feec806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 -- 172.21.15.81:0/2026072789 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80715f0 con 0x7feec806b080 2024-05-08T20:27:58.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec7fff640 1 --2- 172.21.15.81:0/2026072789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806b080 0x7feec806b4f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feec806c8a0 tx=0x7feec001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b103a3140799b3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.642+0000 7feec67fc640 1 -- 172.21.15.81:0/2026072789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a58e0 con 0x7feec806b080 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec67fc640 1 -- 172.21.15.81:0/2026072789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00a5a40 con 0x7feec806b080 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec67fc640 1 -- 172.21.15.81:0/2026072789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a5dd0 con 0x7feec806b080 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/2026072789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806b080 msgr2=0x7feec806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- 172.21.15.81:0/2026072789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806b080 0x7feec806b4f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feec806c8a0 tx=0x7feec001c930 comp rx=0 tx=0).stop 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/2026072789 shutdown_connections 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- 172.21.15.81:0/2026072789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec806b080 0x7feec806b4f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- 172.21.15.81:0/2026072789 >> v2:172.21.15.117:3300/0 conn(0x7feec806cc40 0x7feec8153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/2026072789 >> 172.21.15.81:0/2026072789 conn(0x7feec80c6000 msgr2=0x7feec80c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/2026072789 shutdown_connections 2024-05-08T20:27:58.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/2026072789 wait complete. 2024-05-08T20:27:58.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 Processor -- start 2024-05-08T20:27:58.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- start start 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 0x7feec814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feec806cc40 0x7feec81456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8143640 con 0x7feec814c6b0 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8143be0 con 0x7feec806b080 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec81eb740 con 0x7feec806cc40 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50734/0 (socket says 172.21.15.81:50734) 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 -- 172.21.15.81:0/4271994903 learned_addr learned my addr 172.21.15.81:0/4271994903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec77fe640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 0x7feec814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 -- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feec806cc40 msgr2=0x7feec81456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec6ffd640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feec806cc40 0x7feec81456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feec806cc40 0x7feec81456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 -- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 msgr2=0x7feec814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 0x7feec814d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 -- 172.21.15.81:0/4271994903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009a70 con 0x7feec814c6b0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec77fe640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 0x7feec814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feec7fff640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feec0019540 tx=0x7feec00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00ad850 con 0x7feec814c6b0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00ad9b0 con 0x7feec814c6b0 2024-05-08T20:27:58.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec8143e80 con 0x7feec814c6b0 2024-05-08T20:27:58.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00add60 con 0x7feec814c6b0 2024-05-08T20:27:58.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.646+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec81eba20 con 0x7feec814c6b0 2024-05-08T20:27:58.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec81443a0 con 0x7feec814c6b0 2024-05-08T20:27:58.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feec00b4050 con 0x7feec814c6b0 2024-05-08T20:27:58.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feeaffff640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 0x7feeb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feec77fe640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 0x7feeb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7feec011f4d0 con 0x7feec814c6b0 2024-05-08T20:27:58.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.650+0000 7feec77fe640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 0x7feeb4068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feebc005890 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.654+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7feec00ec680 con 0x7feec814c6b0 2024-05-08T20:27:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.810+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7feec81443a0 con 0x7feec814c6b0 2024-05-08T20:27:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feeaffff640 1 -- 172.21.15.81:0/4271994903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7feec81443a0 con 0x7feec814c6b0 2024-05-08T20:27:58.819 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 msgr2=0x7feeb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 0x7feeb4068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feebc005890 tx=0x7feebc009040 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 msgr2=0x7feec814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feec0019540 tx=0x7feec00196d0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 shutdown_connections 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feeb4066690 0x7feeb4068b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec814c6b0 0x7feec814b7d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feec806cc40 0x7feec81456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 --2- 172.21.15.81:0/4271994903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec806b080 0x7feec814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 >> 172.21.15.81:0/4271994903 conn(0x7feec80c6000 msgr2=0x7feec80c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 shutdown_connections 2024-05-08T20:27:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.814+0000 7feece0ee640 1 -- 172.21.15.81:0/4271994903 wait complete. 2024-05-08T20:27:58.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:27:58.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 Processor -- start 2024-05-08T20:27:58.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 -- start start 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff448155e90 0x7ff448069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff448152ab0 con 0x7ff44806a500 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff448152d90 con 0x7ff44814fe70 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44e77c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4481528a0 con 0x7ff448155e90 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44cd19640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff44806a500 0x7ff44815d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50588/0 (socket says 172.21.15.81:50588) 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff44cd19640 1 -- 172.21.15.81:0/4122459320 learned_addr learned my addr 172.21.15.81:0/4122459320 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff4477fe640 1 --2- 172.21.15.81:0/4122459320 >> v2:172.21.15.81:3300/0 conn(0x7ff448155e90 0x7ff448069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff446ffd640 1 -- 172.21.15.81:0/4122459320 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480900108 0 0) 0x7ff448152ab0 con 0x7ff44806a500 2024-05-08T20:27:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff446ffd640 1 -- 172.21.15.81:0/4122459320 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff430003530 con 0x7ff44806a500 2024-05-08T20:27:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff4477fe640 1 -- 172.21.15.81:0/4122459320 >> v1:172.21.15.117:6789/0 conn(0x7ff44814fe70 legacy=0x7ff44806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff4477fe640 1 -- 172.21.15.81:0/4122459320 >> v1:172.21.15.81:6789/0 conn(0x7ff44806a500 legacy=0x7ff44815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.950+0000 7ff4477fe640 1 -- 172.21.15.81:0/4122459320 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448153070 con 0x7ff448155e90 2024-05-08T20:27:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff4477fe640 1 --2- 172.21.15.81:0/4122459320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff448155e90 0x7ff448069fc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0097c0 tx=0x7ff43c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224858656e25e2a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff446ffd640 1 -- 172.21.15.81:0/4122459320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0ab600 con 0x7ff448155e90 2024-05-08T20:27:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff446ffd640 1 -- 172.21.15.81:0/4122459320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c0a7050 con 0x7ff448155e90 2024-05-08T20:27:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff446ffd640 1 -- 172.21.15.81:0/4122459320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0ab980 con 0x7ff448155e90 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- 172.21.15.81:0/4122459320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff448155e90 msgr2=0x7ff448069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 --2- 172.21.15.81:0/4122459320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff448155e90 0x7ff448069fc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0097c0 tx=0x7ff43c01c350 comp rx=0 tx=0).stop 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- 172.21.15.81:0/4122459320 shutdown_connections 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 --2- 172.21.15.81:0/4122459320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff448155e90 0x7ff448069fc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- 172.21.15.81:0/4122459320 >> 172.21.15.81:0/4122459320 conn(0x7ff4480c71b0 msgr2=0x7ff4480c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- 172.21.15.81:0/4122459320 shutdown_connections 2024-05-08T20:27:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- 172.21.15.81:0/4122459320 wait complete. 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 Processor -- start 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- start start 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44814fe70 0x7ff4480c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 0x7ff44814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480bf9a0 con 0x7ff44806a500 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481ec500 con 0x7ff44814fe70 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44e77c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44814daa0 con 0x7ff448155e90 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff447fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff447fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58998/0 (socket says 172.21.15.81:58998) 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff447fff640 1 -- 172.21.15.81:0/3082241044 learned_addr learned my addr 172.21.15.81:0/3082241044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:58.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff4477fe640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44814fe70 0x7ff4480c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.954+0000 7ff44cd19640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 0x7ff44814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 -- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 msgr2=0x7ff44814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 0x7ff44814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 -- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44814fe70 msgr2=0x7ff4480c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44814fe70 0x7ff4480c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 -- 172.21.15.81:0/3082241044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009420 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff44cd19640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 0x7ff44814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff447fff640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c530 tx=0x7ff43800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438005220 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438005380 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480c1800 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438007270 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480bc920 con 0x7ff44806a500 2024-05-08T20:27:58.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4480675e0 con 0x7ff44806a500 2024-05-08T20:27:58.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4380073d0 con 0x7ff44806a500 2024-05-08T20:27:58.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 0x7ff434068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:58.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff4477fe640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 0x7ff434068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:58.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff438084a30 con 0x7ff44806a500 2024-05-08T20:27:58.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.958+0000 7ff4477fe640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 0x7ff434068b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0ad000 tx=0x7ff43c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:58.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:58.962+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff438051be0 con 0x7ff44806a500 2024-05-08T20:27:59.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff448074950 con 0x7ff44806a500 2024-05-08T20:27:59.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff444ff9640 1 -- 172.21.15.81:0/3082241044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7ff438055200 con 0x7ff44806a500 2024-05-08T20:27:59.128 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:27:59.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 msgr2=0x7ff434068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 0x7ff434068b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0ad000 tx=0x7ff43c008040 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 msgr2=0x7ff4480c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c530 tx=0x7ff43800c9f0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 shutdown_connections 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4340666c0 0x7ff434068b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff448155e90 0x7ff44814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff44814fe70 0x7ff4480c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 --2- 172.21.15.81:0/3082241044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff44806a500 0x7ff4480c0d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 >> 172.21.15.81:0/3082241044 conn(0x7ff4480c71b0 msgr2=0x7ff4480c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 shutdown_connections 2024-05-08T20:27:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.122+0000 7ff44e77c640 1 -- 172.21.15.81:0/3082241044 wait complete. 2024-05-08T20:27:59.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:27:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.262+0000 7f4cb162d640 1 Processor -- start 2024-05-08T20:27:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.262+0000 7f4cb162d640 1 -- start start 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cb162d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4cac13dfe0 0x7f4cac0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cb162d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4cac154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cb162d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac0c27e0 con 0x7f4cac070810 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cb162d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac158b30 con 0x7f4cac13dfe0 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cb162d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac158fc0 con 0x7f4cac154a90 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4cac070810 0x7f4cac0c1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50596/0 (socket says 172.21.15.81:50596) 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 -- 172.21.15.81:0/3042482831 learned_addr learned my addr 172.21.15.81:0/3042482831 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361001920 0 0) 0x7f4c9c001120 con 0x7f4cac070810 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c94003530 con 0x7f4cac070810 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caaffd640 1 --2- 172.21.15.81:0/3042482831 >> v2:172.21.15.117:3300/0 conn(0x7f4cac13dfe0 0x7f4cac0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cab7fe640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4cac154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2319501505 0 0) 0x7f4c94003530 con 0x7f4cac070810 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 msgr2=0x7f4cac154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4cac154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 >> v2:172.21.15.117:3300/0 conn(0x7f4cac13dfe0 msgr2=0x7f4cac0702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 --2- 172.21.15.81:0/3042482831 >> v2:172.21.15.117:3300/0 conn(0x7f4cac13dfe0 0x7f4cac0702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac158200 con 0x7f4cac070810 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4c9c001810 con 0x7f4cac070810 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 >> v1:172.21.15.81:6789/0 conn(0x7f4cac070810 legacy=0x7f4cac0c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94003980 0x7f4c94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4c94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4c94005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac158b30 con 0x7f4c940047d0 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac158fc0 con 0x7f4c94003980 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9400bb70 con 0x7f4cac154a90 2024-05-08T20:27:59.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4c94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caaffd640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94003980 0x7f4c94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cab7fe640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4c94005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 -- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 msgr2=0x7f4c94005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4c94005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 -- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94003980 msgr2=0x7f4c94003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c94003980 0x7f4c94003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4caa7fc640 1 -- 172.21.15.81:0/3042482831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94003530 con 0x7f4c940047d0 2024-05-08T20:27:59.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.266+0000 7f4cab7fe640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac154a90 0x7f4c94005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:59.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4c94004c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c210 tx=0x7f4c9c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b14070c5367775 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005ae0 con 0x7f4c940047d0 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0a7070 con 0x7f4c940047d0 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4ca9ffb640 1 -- 172.21.15.81:0/3042482831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005e80 con 0x7f4c940047d0 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3042482831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 msgr2=0x7f4c94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3042482831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4c94004c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c210 tx=0x7f4c9c01c8e0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cab7fe640 1 -- 172.21.15.81:0/3042482831 reap_dead start 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3042482831 shutdown_connections 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3042482831 >> 172.21.15.81:0/3042482831 conn(0x7f4cac0c3db0 msgr2=0x7f4cac0c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3042482831 shutdown_connections 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3042482831 wait complete. 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 Processor -- start 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- start start 2024-05-08T20:27:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 0x7f4cac153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac1eefc0 0x7f4cac13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c4e80 con 0x7f4c940047d0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c5440 con 0x7f4cac1f1ad0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0c6c70 con 0x7f4cac1eefc0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59016/0 (socket says 172.21.15.81:59016) 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 -- 172.21.15.81:0/3797160274 learned_addr learned my addr 172.21.15.81:0/3797160274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 0x7f4cac153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cab7fe640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac1eefc0 0x7f4cac13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 -- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac1eefc0 msgr2=0x7f4cac13aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac1eefc0 0x7f4cac13aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 -- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 msgr2=0x7f4cac153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 0x7f4cac153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 -- 172.21.15.81:0/3797160274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0c6f50 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 0x7f4cac153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4caaffd640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000f610 tx=0x7f4ca000fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0004020 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00041a0 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0c50d0 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0014670 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.270+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac1542b0 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac074950 con 0x7f4c940047d0 2024-05-08T20:27:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ca00147d0 con 0x7f4c940047d0 2024-05-08T20:27:59.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4c937fe640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 0x7f4c98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 0x7f4c98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4ca0084c00 con 0x7f4c940047d0 2024-05-08T20:27:59.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.274+0000 7f4caa7fc640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 0x7f4c98068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0aa000 tx=0x7f4c9c001ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.278+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4ca0051ba0 con 0x7f4c940047d0 2024-05-08T20:27:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.442+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f4cac13d470 con 0x7f4c940047d0 2024-05-08T20:27:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.442+0000 7f4c937fe640 1 -- 172.21.15.81:0/3797160274 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) v1 ==== 95+0+11 (secure 0 0 0) 0x7f4ca00551c0 con 0x7f4c940047d0 2024-05-08T20:27:59.451 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 msgr2=0x7f4c98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 0x7f4c98068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0aa000 tx=0x7f4c9c001ba0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 msgr2=0x7f4cac0c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000f610 tx=0x7f4ca000fad0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 shutdown_connections 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4c98066690 0x7f4c98068b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cac1eefc0 0x7f4cac13aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cac1f1ad0 0x7f4cac153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 --2- 172.21.15.81:0/3797160274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c940047d0 0x7f4cac0c58d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 >> 172.21.15.81:0/3797160274 conn(0x7f4cac0c3db0 msgr2=0x7f4cac0c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 shutdown_connections 2024-05-08T20:27:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.446+0000 7f4cb162d640 1 -- 172.21.15.81:0/3797160274 wait complete. 2024-05-08T20:27:59.470 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-05-08T20:27:59.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:59.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.582+0000 7f2a72cf7640 1 Processor -- start 2024-05-08T20:27:59.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.582+0000 7f2a72cf7640 1 -- start start 2024-05-08T20:27:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a72cf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a6c06f400 0x7f2a6c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a72cf7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c0c0650 con 0x7f2a6c1501e0 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a72cf7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c06fa80 con 0x7f2a6c0725f0 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a72cf7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c06fd60 con 0x7f2a6c06f400 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a71294640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a6c06f400 0x7f2a6c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a70a93640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a6c1501e0 0x7f2a6c06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50610/0 (socket says 172.21.15.81:50610) 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a70a93640 1 -- 172.21.15.81:0/1489277411 learned_addr learned my addr 172.21.15.81:0/1489277411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a71294640 1 -- 172.21.15.81:0/1489277411 >> v1:172.21.15.117:6789/0 conn(0x7f2a6c0725f0 legacy=0x7f2a6c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a71294640 1 -- 172.21.15.81:0/1489277411 >> v1:172.21.15.81:6789/0 conn(0x7f2a6c1501e0 legacy=0x7f2a6c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a71294640 1 -- 172.21.15.81:0/1489277411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c071ea0 con 0x7f2a6c06f400 2024-05-08T20:27:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a6b7fe640 1 -- 172.21.15.81:0/1489277411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123190121 0 0) 0x7f2a6c0c0650 con 0x7f2a6c1501e0 2024-05-08T20:27:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a71294640 1 --2- 172.21.15.81:0/1489277411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c06f400 0x7f2a6c0c2350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009d90 tx=0x7f2a6401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae225903e97d86f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a6b7fe640 1 -- 172.21.15.81:0/1489277411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640a5800 con 0x7f2a6c06f400 2024-05-08T20:27:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a6b7fe640 1 -- 172.21.15.81:0/1489277411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a640a5960 con 0x7f2a6c06f400 2024-05-08T20:27:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a6b7fe640 1 -- 172.21.15.81:0/1489277411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640a5cf0 con 0x7f2a6c06f400 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.586+0000 7f2a72cf7640 1 -- 172.21.15.81:0/1489277411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c06f400 msgr2=0x7f2a6c0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/1489277411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c06f400 0x7f2a6c0c2350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009d90 tx=0x7f2a6401c810 comp rx=0 tx=0).stop 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/1489277411 shutdown_connections 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/1489277411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c06f400 0x7f2a6c0c2350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/1489277411 >> 172.21.15.81:0/1489277411 conn(0x7f2a6c0c2ca0 msgr2=0x7f2a6c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/1489277411 shutdown_connections 2024-05-08T20:27:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/1489277411 wait complete. 2024-05-08T20:27:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 Processor -- start 2024-05-08T20:27:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- start start 2024-05-08T20:27:59.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 0x7f2a6c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6c0725f0 0x7f2a6c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c072180 con 0x7f2a6c1501e0 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c0aae40 con 0x7f2a6c0725f0 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c143b40 con 0x7f2a6c06f400 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59034/0 (socket says 172.21.15.81:59034) 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 -- 172.21.15.81:0/3870225729 learned_addr learned my addr 172.21.15.81:0/3870225729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a6bfff640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6c0725f0 0x7f2a6c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a70a93640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 0x7f2a6c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 -- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 msgr2=0x7f2a6c143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 0x7f2a6c143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 -- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6c0725f0 msgr2=0x7f2a6c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6c0725f0 0x7f2a6c06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 -- 172.21.15.81:0/3870225729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64009a70 con 0x7f2a6c1501e0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a70a93640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 0x7f2a6c143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a71294640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a640b0040 tx=0x7f2a640195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640ad850 con 0x7f2a6c1501e0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a640ad9b0 con 0x7f2a6c1501e0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c150740 con 0x7f2a6c1501e0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640add80 con 0x7f2a6c1501e0 2024-05-08T20:27:59.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.590+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c0ab050 con 0x7f2a6c1501e0 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c143320 con 0x7f2a6c1501e0 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a640b4050 con 0x7f2a6c1501e0 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a697fa640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 0x7f2a58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2a6411f3f0 con 0x7f2a6c1501e0 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a70a93640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 0x7f2a58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.594+0000 7f2a70a93640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 0x7f2a58068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c000f70 tx=0x7f2a5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.598+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2a6c143320 con 0x7f2a6c1501e0 2024-05-08T20:27:59.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.758+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a6c1505c0 con 0x7f2a58066690 2024-05-08T20:27:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.770+0000 7f2a697fa640 1 -- 172.21.15.81:0/3870225729 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503004 (secure 0 0 0) 0x7f2a5c001d60 con 0x7f2a58066690 2024-05-08T20:27:59.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:27:59.786 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 msgr2=0x7f2a58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 0x7f2a58068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c000f70 tx=0x7f2a5c009040 comp rx=0 tx=0).stop 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 msgr2=0x7f2a6c1f01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a640b0040 tx=0x7f2a640195b0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 shutdown_connections 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a58066690 0x7f2a58068b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a6c1501e0 0x7f2a6c1f01d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a6c0725f0 0x7f2a6c06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 --2- 172.21.15.81:0/3870225729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a6c06f400 0x7f2a6c143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 >> 172.21.15.81:0/3870225729 conn(0x7f2a6c0c2ca0 msgr2=0x7f2a6c14e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 shutdown_connections 2024-05-08T20:27:59.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.774+0000 7f2a72cf7640 1 -- 172.21.15.81:0/3870225729 wait complete. 2024-05-08T20:27:59.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-08T20:27:59.380334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595978,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3346432,"data_stored":1984737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":886,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.146976"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962513+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:28.962513+0000","last_peered":"2024-05-08T20:27:28.962513+0000","last_clean":"2024-05-08T20:27:28.962513+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:28.962513+0000","last_undegraded":"2024-05-08T20:27:28.962513+0000","last_fullsized":"2024-05-08T20:27:28.962513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:55.752903+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:55.752903+0000","last_peered":"2024-05-08T20:27:55.752903+0000","last_clean":"2024-05-08T20:27:55.752903+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:55.752903+0000","last_undegraded":"2024-05-08T20:27:55.752903+0000","last_fullsized":"2024-05-08T20:27:55.752903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:52.738349+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:52.738349+0000","last_peered":"2024-05-08T20:27:52.738349+0000","last_clean":"2024-05-08T20:27:52.738349+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:52.738349+0000","last_undegraded":"2024-05-08T20:27:52.738349+0000","last_fullsized":"2024-05-08T20:27:52.738349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2805,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2805,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":103261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":101414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:27:59.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:27:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 Processor -- start 2024-05-08T20:27:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 -- start start 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac01501e0 0x7fdac006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdac00725f0 0x7fdac00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdac006f400 0x7fdac00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac006fd60 con 0x7fdac006f400 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac0072180 con 0x7fdac00725f0 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac6a43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c0650 con 0x7fdac01501e0 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdac006f400 0x7fdac00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdac006f400 0x7fdac00c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59038/0 (socket says 172.21.15.81:59038) 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 -- 172.21.15.81:0/2469368321 learned_addr learned my addr 172.21.15.81:0/2469368321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdabffff640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac01501e0 0x7fdac006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdabf7fe640 1 --2- 172.21.15.81:0/2469368321 >> v2:172.21.15.117:3300/0 conn(0x7fdac00725f0 0x7fdac00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 -- 172.21.15.81:0/2469368321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac01501e0 msgr2=0x7fdac006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac01501e0 0x7fdac006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 -- 172.21.15.81:0/2469368321 >> v2:172.21.15.117:3300/0 conn(0x7fdac00725f0 msgr2=0x7fdac00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:27:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 --2- 172.21.15.81:0/2469368321 >> v2:172.21.15.117:3300/0 conn(0x7fdac00725f0 0x7fdac00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.954+0000 7fdac4fe0640 1 -- 172.21.15.81:0/2469368321 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac006fa80 con 0x7fdac006f400 2024-05-08T20:27:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac4fe0640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c2180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdac006eed0 tx=0x7fdab801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7439cded2d4e2c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabeffd640 1 -- 172.21.15.81:0/2469368321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80a5650 con 0x7fdac006f400 2024-05-08T20:27:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabeffd640 1 -- 172.21.15.81:0/2469368321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab80a57b0 con 0x7fdac006f400 2024-05-08T20:27:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabeffd640 1 -- 172.21.15.81:0/2469368321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80a5b40 con 0x7fdac006f400 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- 172.21.15.81:0/2469368321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 msgr2=0x7fdac00c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c2180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdac006eed0 tx=0x7fdab801c8a0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- 172.21.15.81:0/2469368321 shutdown_connections 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c2180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- 172.21.15.81:0/2469368321 >> v2:172.21.15.117:3300/0 conn(0x7fdac00725f0 0x7fdac00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- 172.21.15.81:0/2469368321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac01501e0 0x7fdac006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- 172.21.15.81:0/2469368321 >> 172.21.15.81:0/2469368321 conn(0x7fdac00c2ca0 msgr2=0x7fdac00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:27:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- 172.21.15.81:0/2469368321 shutdown_connections 2024-05-08T20:27:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- 172.21.15.81:0/2469368321 wait complete. 2024-05-08T20:27:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 Processor -- start 2024-05-08T20:27:59.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- start start 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac00725f0 0x7fdac00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac01501e0 0x7fdac01eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c4bd0 con 0x7fdac006f400 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac013d570 con 0x7fdac01501e0 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdac6a43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac013d7e0 con 0x7fdac00725f0 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59040/0 (socket says 172.21.15.81:59040) 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.958+0000 7fdabffff640 1 -- 172.21.15.81:0/1064625097 learned_addr learned my addr 172.21.15.81:0/1064625097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 -- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac00725f0 msgr2=0x7fdac00c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabf7fe640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac00725f0 0x7fdac00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac00725f0 0x7fdac00c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 -- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac01501e0 msgr2=0x7fdac01eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac01501e0 0x7fdac01eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 -- 172.21.15.81:0/1064625097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009b30 con 0x7fdac006f400 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabffff640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdab000d620 tx=0x7fdab000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000b620 con 0x7fdac006f400 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab000b780 con 0x7fdac006f400 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac013dac0 con 0x7fdac006f400 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000bb10 con 0x7fdac006f400 2024-05-08T20:27:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac013e2c0 con 0x7fdac006f400 2024-05-08T20:27:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0155db0 con 0x7fdac006f400 2024-05-08T20:27:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdab000bc70 con 0x7fdac006f400 2024-05-08T20:27:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 0x7fdaac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:27:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fdab0084a30 con 0x7fdac006f400 2024-05-08T20:27:59.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabf7fe640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 0x7fdaac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:27:59.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.962+0000 7fdabf7fe640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 0x7fdaac068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdac014e2b0 tx=0x7fdab4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:27:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:27:59.966+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fdab0051a00 con 0x7fdac006f400 2024-05-08T20:28:00.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.114+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdac013df70 con 0x7fdaac066690 2024-05-08T20:28:00.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.126+0000 7fdabcff9640 1 -- 172.21.15.81:0/1064625097 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503004 (secure 0 0 0) 0x7fdab400e4c0 con 0x7fdaac066690 2024-05-08T20:28:00.138 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:28:00.143 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 msgr2=0x7fdaac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 0x7fdaac068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdac014e2b0 tx=0x7fdab4008040 comp rx=0 tx=0).stop 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 msgr2=0x7fdac00c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdab000d620 tx=0x7fdab000dae0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 shutdown_connections 2024-05-08T20:28:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdaac066690 0x7fdaac068b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac01501e0 0x7fdac01eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac00725f0 0x7fdac00c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 --2- 172.21.15.81:0/1064625097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac006f400 0x7fdac00c4150 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 >> 172.21.15.81:0/1064625097 conn(0x7fdac00c2ca0 msgr2=0x7fdac014d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 shutdown_connections 2024-05-08T20:28:00.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.134+0000 7fdac6a43640 1 -- 172.21.15.81:0/1064625097 wait complete. 2024-05-08T20:28:00.156 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-08T20:27:59.380334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595978,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3268,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3346432,"data_stored":1984737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":886,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.146976"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121176+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:27:30.121176+0000","last_peered":"2024-05-08T20:27:30.121176+0000","last_clean":"2024-05-08T20:27:30.121176+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:27:30.121176+0000","last_undegraded":"2024-05-08T20:27:30.121176+0000","last_fullsized":"2024-05-08T20:27:30.121176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968190+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:27:27.968190+0000","last_peered":"2024-05-08T20:27:27.968190+0000","last_clean":"2024-05-08T20:27:27.968190+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:27:27.968190+0000","last_undegraded":"2024-05-08T20:27:27.968190+0000","last_fullsized":"2024-05-08T20:27:27.968190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975578+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:27:27.975578+0000","last_peered":"2024-05-08T20:27:27.975578+0000","last_clean":"2024-05-08T20:27:27.975578+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:27:27.975578+0000","last_undegraded":"2024-05-08T20:27:27.975578+0000","last_fullsized":"2024-05-08T20:27:27.975578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974829+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:27:27.974829+0000","last_peered":"2024-05-08T20:27:27.974829+0000","last_clean":"2024-05-08T20:27:27.974829+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:27:27.974829+0000","last_undegraded":"2024-05-08T20:27:27.974829+0000","last_fullsized":"2024-05-08T20:27:27.974829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117143+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:27:29.117143+0000","last_peered":"2024-05-08T20:27:29.117143+0000","last_clean":"2024-05-08T20:27:29.117143+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:27:29.117143+0000","last_undegraded":"2024-05-08T20:27:29.117143+0000","last_fullsized":"2024-05-08T20:27:29.117143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975668+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:27:27.975668+0000","last_peered":"2024-05-08T20:27:27.975668+0000","last_clean":"2024-05-08T20:27:27.975668+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:27:27.975668+0000","last_undegraded":"2024-05-08T20:27:27.975668+0000","last_fullsized":"2024-05-08T20:27:27.975668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968096+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:27:27.968096+0000","last_peered":"2024-05-08T20:27:27.968096+0000","last_clean":"2024-05-08T20:27:27.968096+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:27:27.968096+0000","last_undegraded":"2024-05-08T20:27:27.968096+0000","last_fullsized":"2024-05-08T20:27:27.968096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965148+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:27:27.965148+0000","last_peered":"2024-05-08T20:27:27.965148+0000","last_clean":"2024-05-08T20:27:27.965148+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:27:27.965148+0000","last_undegraded":"2024-05-08T20:27:27.965148+0000","last_fullsized":"2024-05-08T20:27:27.965148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122073+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:27:30.122073+0000","last_peered":"2024-05-08T20:27:30.122073+0000","last_clean":"2024-05-08T20:27:30.122073+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:27:30.122073+0000","last_undegraded":"2024-05-08T20:27:30.122073+0000","last_fullsized":"2024-05-08T20:27:30.122073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983020+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:27:27.983020+0000","last_peered":"2024-05-08T20:27:27.983020+0000","last_clean":"2024-05-08T20:27:27.983020+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:27:27.983020+0000","last_undegraded":"2024-05-08T20:27:27.983020+0000","last_fullsized":"2024-05-08T20:27:27.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983268+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:27:27.983268+0000","last_peered":"2024-05-08T20:27:27.983268+0000","last_clean":"2024-05-08T20:27:27.983268+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:27:27.983268+0000","last_undegraded":"2024-05-08T20:27:27.983268+0000","last_fullsized":"2024-05-08T20:27:27.983268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.022909+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:27:28.022909+0000","last_peered":"2024-05-08T20:27:28.022909+0000","last_clean":"2024-05-08T20:27:28.022909+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:27:28.022909+0000","last_undegraded":"2024-05-08T20:27:28.022909+0000","last_fullsized":"2024-05-08T20:27:28.022909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965808+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:27:28.965808+0000","last_peered":"2024-05-08T20:27:28.965808+0000","last_clean":"2024-05-08T20:27:28.965808+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:27:28.965808+0000","last_undegraded":"2024-05-08T20:27:28.965808+0000","last_fullsized":"2024-05-08T20:27:28.965808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977907+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:27:27.977907+0000","last_peered":"2024-05-08T20:27:27.977907+0000","last_clean":"2024-05-08T20:27:27.977907+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:27:27.977907+0000","last_undegraded":"2024-05-08T20:27:27.977907+0000","last_fullsized":"2024-05-08T20:27:27.977907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972617+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:27:27.972617+0000","last_peered":"2024-05-08T20:27:27.972617+0000","last_clean":"2024-05-08T20:27:27.972617+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:27:27.972617+0000","last_undegraded":"2024-05-08T20:27:27.972617+0000","last_fullsized":"2024-05-08T20:27:27.972617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.025263+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:27:28.025263+0000","last_peered":"2024-05-08T20:27:28.025263+0000","last_clean":"2024-05-08T20:27:28.025263+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:27:28.025263+0000","last_undegraded":"2024-05-08T20:27:28.025263+0000","last_fullsized":"2024-05-08T20:27:28.025263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117823+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:27:29.117823+0000","last_peered":"2024-05-08T20:27:29.117823+0000","last_clean":"2024-05-08T20:27:29.117823+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:27:29.117823+0000","last_undegraded":"2024-05-08T20:27:29.117823+0000","last_fullsized":"2024-05-08T20:27:29.117823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972725+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:27:27.972725+0000","last_peered":"2024-05-08T20:27:27.972725+0000","last_clean":"2024-05-08T20:27:27.972725+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:27:27.972725+0000","last_undegraded":"2024-05-08T20:27:27.972725+0000","last_fullsized":"2024-05-08T20:27:27.972725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978407+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:27:27.978407+0000","last_peered":"2024-05-08T20:27:27.978407+0000","last_clean":"2024-05-08T20:27:27.978407+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:27:27.978407+0000","last_undegraded":"2024-05-08T20:27:27.978407+0000","last_fullsized":"2024-05-08T20:27:27.978407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.019418+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:27:28.019418+0000","last_peered":"2024-05-08T20:27:28.019418+0000","last_clean":"2024-05-08T20:27:28.019418+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:27:28.019418+0000","last_undegraded":"2024-05-08T20:27:28.019418+0000","last_fullsized":"2024-05-08T20:27:28.019418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828763+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:27:29.828763+0000","last_peered":"2024-05-08T20:27:29.828763+0000","last_clean":"2024-05-08T20:27:29.828763+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:27:29.828763+0000","last_undegraded":"2024-05-08T20:27:29.828763+0000","last_fullsized":"2024-05-08T20:27:29.828763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975294+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:27:27.975294+0000","last_peered":"2024-05-08T20:27:27.975294+0000","last_clean":"2024-05-08T20:27:27.975294+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:27:27.975294+0000","last_undegraded":"2024-05-08T20:27:27.975294+0000","last_fullsized":"2024-05-08T20:27:27.975294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967286+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:27:27.967286+0000","last_peered":"2024-05-08T20:27:27.967286+0000","last_clean":"2024-05-08T20:27:27.967286+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:27:27.967286+0000","last_undegraded":"2024-05-08T20:27:27.967286+0000","last_fullsized":"2024-05-08T20:27:27.967286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970209+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:27:27.970209+0000","last_peered":"2024-05-08T20:27:27.970209+0000","last_clean":"2024-05-08T20:27:27.970209+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:27:27.970209+0000","last_undegraded":"2024-05-08T20:27:27.970209+0000","last_fullsized":"2024-05-08T20:27:27.970209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124326+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:27:30.124326+0000","last_peered":"2024-05-08T20:27:30.124326+0000","last_clean":"2024-05-08T20:27:30.124326+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:27:30.124326+0000","last_undegraded":"2024-05-08T20:27:30.124326+0000","last_fullsized":"2024-05-08T20:27:30.124326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975363+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:27:27.975363+0000","last_peered":"2024-05-08T20:27:27.975363+0000","last_clean":"2024-05-08T20:27:27.975363+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:27:27.975363+0000","last_undegraded":"2024-05-08T20:27:27.975363+0000","last_fullsized":"2024-05-08T20:27:27.975363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967383+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:27:27.967383+0000","last_peered":"2024-05-08T20:27:27.967383+0000","last_clean":"2024-05-08T20:27:27.967383+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:27:27.967383+0000","last_undegraded":"2024-05-08T20:27:27.967383+0000","last_fullsized":"2024-05-08T20:27:27.967383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982892+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:27:27.982892+0000","last_peered":"2024-05-08T20:27:27.982892+0000","last_clean":"2024-05-08T20:27:27.982892+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:27:27.982892+0000","last_undegraded":"2024-05-08T20:27:27.982892+0000","last_fullsized":"2024-05-08T20:27:27.982892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968089+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:27:28.968089+0000","last_peered":"2024-05-08T20:27:28.968089+0000","last_clean":"2024-05-08T20:27:28.968089+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:27:28.968089+0000","last_undegraded":"2024-05-08T20:27:28.968089+0000","last_fullsized":"2024-05-08T20:27:28.968089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968954+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:27:27.968954+0000","last_peered":"2024-05-08T20:27:27.968954+0000","last_clean":"2024-05-08T20:27:27.968954+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:27:27.968954+0000","last_undegraded":"2024-05-08T20:27:27.968954+0000","last_fullsized":"2024-05-08T20:27:27.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979034+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:27:27.979034+0000","last_peered":"2024-05-08T20:27:27.979034+0000","last_clean":"2024-05-08T20:27:27.979034+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:27:27.979034+0000","last_undegraded":"2024-05-08T20:27:27.979034+0000","last_fullsized":"2024-05-08T20:27:27.979034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.016911+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:27:28.016911+0000","last_peered":"2024-05-08T20:27:28.016911+0000","last_clean":"2024-05-08T20:27:28.016911+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:27:28.016911+0000","last_undegraded":"2024-05-08T20:27:28.016911+0000","last_fullsized":"2024-05-08T20:27:28.016911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.119936+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:27:30.119936+0000","last_peered":"2024-05-08T20:27:30.119936+0000","last_clean":"2024-05-08T20:27:30.119936+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:27:30.119936+0000","last_undegraded":"2024-05-08T20:27:30.119936+0000","last_fullsized":"2024-05-08T20:27:30.119936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967097+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:27:27.967097+0000","last_peered":"2024-05-08T20:27:27.967097+0000","last_clean":"2024-05-08T20:27:27.967097+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:27:27.967097+0000","last_undegraded":"2024-05-08T20:27:27.967097+0000","last_fullsized":"2024-05-08T20:27:27.967097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972444+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:27:27.972444+0000","last_peered":"2024-05-08T20:27:27.972444+0000","last_clean":"2024-05-08T20:27:27.972444+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:27:27.972444+0000","last_undegraded":"2024-05-08T20:27:27.972444+0000","last_fullsized":"2024-05-08T20:27:27.972444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966116+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:27:27.966116+0000","last_peered":"2024-05-08T20:27:27.966116+0000","last_clean":"2024-05-08T20:27:27.966116+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:27:27.966116+0000","last_undegraded":"2024-05-08T20:27:27.966116+0000","last_fullsized":"2024-05-08T20:27:27.966116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122571+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:27:30.122571+0000","last_peered":"2024-05-08T20:27:30.122571+0000","last_clean":"2024-05-08T20:27:30.122571+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:27:30.122571+0000","last_undegraded":"2024-05-08T20:27:30.122571+0000","last_fullsized":"2024-05-08T20:27:30.122571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975629+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:27:27.975629+0000","last_peered":"2024-05-08T20:27:27.975629+0000","last_clean":"2024-05-08T20:27:27.975629+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:27:27.975629+0000","last_undegraded":"2024-05-08T20:27:27.975629+0000","last_fullsized":"2024-05-08T20:27:27.975629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967752+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:27:27.967752+0000","last_peered":"2024-05-08T20:27:27.967752+0000","last_clean":"2024-05-08T20:27:27.967752+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:27:27.967752+0000","last_undegraded":"2024-05-08T20:27:27.967752+0000","last_fullsized":"2024-05-08T20:27:27.967752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976284+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:27:27.976284+0000","last_peered":"2024-05-08T20:27:27.976284+0000","last_clean":"2024-05-08T20:27:27.976284+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:27:27.976284+0000","last_undegraded":"2024-05-08T20:27:27.976284+0000","last_fullsized":"2024-05-08T20:27:27.976284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965705+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:27:28.965705+0000","last_peered":"2024-05-08T20:27:28.965705+0000","last_clean":"2024-05-08T20:27:28.965705+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:27:28.965705+0000","last_undegraded":"2024-05-08T20:27:28.965705+0000","last_fullsized":"2024-05-08T20:27:28.965705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967591+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:27:27.967591+0000","last_peered":"2024-05-08T20:27:27.967591+0000","last_clean":"2024-05-08T20:27:27.967591+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:27:27.967591+0000","last_undegraded":"2024-05-08T20:27:27.967591+0000","last_fullsized":"2024-05-08T20:27:27.967591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983449+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:27:27.983449+0000","last_peered":"2024-05-08T20:27:27.983449+0000","last_clean":"2024-05-08T20:27:27.983449+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:27:27.983449+0000","last_undegraded":"2024-05-08T20:27:27.983449+0000","last_fullsized":"2024-05-08T20:27:27.983449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968120+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:27:27.968120+0000","last_peered":"2024-05-08T20:27:27.968120+0000","last_clean":"2024-05-08T20:27:27.968120+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:27:27.968120+0000","last_undegraded":"2024-05-08T20:27:27.968120+0000","last_fullsized":"2024-05-08T20:27:27.968120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962673+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:27:28.962673+0000","last_peered":"2024-05-08T20:27:28.962673+0000","last_clean":"2024-05-08T20:27:28.962673+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:27:28.962673+0000","last_undegraded":"2024-05-08T20:27:28.962673+0000","last_fullsized":"2024-05-08T20:27:28.962673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972819+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:27:27.972819+0000","last_peered":"2024-05-08T20:27:27.972819+0000","last_clean":"2024-05-08T20:27:27.972819+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:27:27.972819+0000","last_undegraded":"2024-05-08T20:27:27.972819+0000","last_fullsized":"2024-05-08T20:27:27.972819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970122+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:27:27.970122+0000","last_peered":"2024-05-08T20:27:27.970122+0000","last_clean":"2024-05-08T20:27:27.970122+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:27:27.970122+0000","last_undegraded":"2024-05-08T20:27:27.970122+0000","last_fullsized":"2024-05-08T20:27:27.970122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967042+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:27:27.967042+0000","last_peered":"2024-05-08T20:27:27.967042+0000","last_clean":"2024-05-08T20:27:27.967042+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:27:27.967042+0000","last_undegraded":"2024-05-08T20:27:27.967042+0000","last_fullsized":"2024-05-08T20:27:27.967042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962552+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:27:28.962552+0000","last_peered":"2024-05-08T20:27:28.962552+0000","last_clean":"2024-05-08T20:27:28.962552+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:27:28.962552+0000","last_undegraded":"2024-05-08T20:27:28.962552+0000","last_fullsized":"2024-05-08T20:27:28.962552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968874+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:27:27.968874+0000","last_peered":"2024-05-08T20:27:27.968874+0000","last_clean":"2024-05-08T20:27:27.968874+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:27:27.968874+0000","last_undegraded":"2024-05-08T20:27:27.968874+0000","last_fullsized":"2024-05-08T20:27:27.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966584+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:27:27.966584+0000","last_peered":"2024-05-08T20:27:27.966584+0000","last_clean":"2024-05-08T20:27:27.966584+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:27:27.966584+0000","last_undegraded":"2024-05-08T20:27:27.966584+0000","last_fullsized":"2024-05-08T20:27:27.966584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967469+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:27:27.967469+0000","last_peered":"2024-05-08T20:27:27.967469+0000","last_clean":"2024-05-08T20:27:27.967469+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:27:27.967469+0000","last_undegraded":"2024-05-08T20:27:27.967469+0000","last_fullsized":"2024-05-08T20:27:27.967469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828770+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:27:29.828770+0000","last_peered":"2024-05-08T20:27:29.828770+0000","last_clean":"2024-05-08T20:27:29.828770+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:27:29.828770+0000","last_undegraded":"2024-05-08T20:27:29.828770+0000","last_fullsized":"2024-05-08T20:27:29.828770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966544+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:27:27.966544+0000","last_peered":"2024-05-08T20:27:27.966544+0000","last_clean":"2024-05-08T20:27:27.966544+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:27:27.966544+0000","last_undegraded":"2024-05-08T20:27:27.966544+0000","last_fullsized":"2024-05-08T20:27:27.966544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959505+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:27:27.959505+0000","last_peered":"2024-05-08T20:27:27.959505+0000","last_clean":"2024-05-08T20:27:27.959505+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:27:27.959505+0000","last_undegraded":"2024-05-08T20:27:27.959505+0000","last_fullsized":"2024-05-08T20:27:27.959505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.001445+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:27:28.001445+0000","last_peered":"2024-05-08T20:27:28.001445+0000","last_clean":"2024-05-08T20:27:28.001445+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:27:28.001445+0000","last_undegraded":"2024-05-08T20:27:28.001445+0000","last_fullsized":"2024-05-08T20:27:28.001445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.968467+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:27:28.968467+0000","last_peered":"2024-05-08T20:27:28.968467+0000","last_clean":"2024-05-08T20:27:28.968467+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:27:28.968467+0000","last_undegraded":"2024-05-08T20:27:28.968467+0000","last_fullsized":"2024-05-08T20:27:28.968467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968405+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:27:27.968405+0000","last_peered":"2024-05-08T20:27:27.968405+0000","last_clean":"2024-05-08T20:27:27.968405+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:27:27.968405+0000","last_undegraded":"2024-05-08T20:27:27.968405+0000","last_fullsized":"2024-05-08T20:27:27.968405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979249+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:27:27.979249+0000","last_peered":"2024-05-08T20:27:27.979249+0000","last_clean":"2024-05-08T20:27:27.979249+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:27:27.979249+0000","last_undegraded":"2024-05-08T20:27:27.979249+0000","last_fullsized":"2024-05-08T20:27:27.979249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962513+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:27:28.962513+0000","last_peered":"2024-05-08T20:27:28.962513+0000","last_clean":"2024-05-08T20:27:28.962513+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:27:28.962513+0000","last_undegraded":"2024-05-08T20:27:28.962513+0000","last_fullsized":"2024-05-08T20:27:28.962513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121812+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:27:30.121812+0000","last_peered":"2024-05-08T20:27:30.121812+0000","last_clean":"2024-05-08T20:27:30.121812+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:27:30.121812+0000","last_undegraded":"2024-05-08T20:27:30.121812+0000","last_fullsized":"2024-05-08T20:27:30.121812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:27:27.974960+0000","last_peered":"2024-05-08T20:27:27.974960+0000","last_clean":"2024-05-08T20:27:27.974960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:27:27.974960+0000","last_undegraded":"2024-05-08T20:27:27.974960+0000","last_fullsized":"2024-05-08T20:27:27.974960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980441+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:27:27.980441+0000","last_peered":"2024-05-08T20:27:27.980441+0000","last_clean":"2024-05-08T20:27:27.980441+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:27:27.980441+0000","last_undegraded":"2024-05-08T20:27:27.980441+0000","last_fullsized":"2024-05-08T20:27:27.980441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981375+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:27:27.981375+0000","last_peered":"2024-05-08T20:27:27.981375+0000","last_clean":"2024-05-08T20:27:27.981375+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:27:27.981375+0000","last_undegraded":"2024-05-08T20:27:27.981375+0000","last_fullsized":"2024-05-08T20:27:27.981375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971288+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:27:27.971288+0000","last_peered":"2024-05-08T20:27:27.971288+0000","last_clean":"2024-05-08T20:27:27.971288+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:27:27.971288+0000","last_undegraded":"2024-05-08T20:27:27.971288+0000","last_fullsized":"2024-05-08T20:27:27.971288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829124+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:27:29.829124+0000","last_peered":"2024-05-08T20:27:29.829124+0000","last_clean":"2024-05-08T20:27:29.829124+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:27:29.829124+0000","last_undegraded":"2024-05-08T20:27:29.829124+0000","last_fullsized":"2024-05-08T20:27:29.829124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982792+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:27:27.982792+0000","last_peered":"2024-05-08T20:27:27.982792+0000","last_clean":"2024-05-08T20:27:27.982792+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:27:27.982792+0000","last_undegraded":"2024-05-08T20:27:27.982792+0000","last_fullsized":"2024-05-08T20:27:27.982792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.961887+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:27:27.961887+0000","last_peered":"2024-05-08T20:27:27.961887+0000","last_clean":"2024-05-08T20:27:27.961887+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:27:27.961887+0000","last_undegraded":"2024-05-08T20:27:27.961887+0000","last_fullsized":"2024-05-08T20:27:27.961887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972289+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:27:27.972289+0000","last_peered":"2024-05-08T20:27:27.972289+0000","last_clean":"2024-05-08T20:27:27.972289+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:27:27.972289+0000","last_undegraded":"2024-05-08T20:27:27.972289+0000","last_fullsized":"2024-05-08T20:27:27.972289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828513+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:27:29.828513+0000","last_peered":"2024-05-08T20:27:29.828513+0000","last_clean":"2024-05-08T20:27:29.828513+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:27:29.828513+0000","last_undegraded":"2024-05-08T20:27:29.828513+0000","last_fullsized":"2024-05-08T20:27:29.828513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986720+0000","last_change":"2024-05-08T20:27:18.929776+0000","last_active":"2024-05-08T20:27:27.986720+0000","last_peered":"2024-05-08T20:27:27.986720+0000","last_clean":"2024-05-08T20:27:27.986720+0000","last_became_active":"2024-05-08T20:27:18.927426+0000","last_became_peered":"2024-05-08T20:27:18.927426+0000","last_unstale":"2024-05-08T20:27:27.986720+0000","last_undegraded":"2024-05-08T20:27:27.986720+0000","last_fullsized":"2024-05-08T20:27:27.986720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:52.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967741+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:27:27.967741+0000","last_peered":"2024-05-08T20:27:27.967741+0000","last_clean":"2024-05-08T20:27:27.967741+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:27:27.967741+0000","last_undegraded":"2024-05-08T20:27:27.967741+0000","last_fullsized":"2024-05-08T20:27:27.967741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177837+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:27:28.177837+0000","last_peered":"2024-05-08T20:27:28.177837+0000","last_clean":"2024-05-08T20:27:28.177837+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:27:28.177837+0000","last_undegraded":"2024-05-08T20:27:28.177837+0000","last_fullsized":"2024-05-08T20:27:28.177837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121041+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:27:30.121041+0000","last_peered":"2024-05-08T20:27:30.121041+0000","last_clean":"2024-05-08T20:27:30.121041+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:27:30.121041+0000","last_undegraded":"2024-05-08T20:27:30.121041+0000","last_fullsized":"2024-05-08T20:27:30.121041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983535+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:27:27.983535+0000","last_peered":"2024-05-08T20:27:27.983535+0000","last_clean":"2024-05-08T20:27:27.983535+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:27:27.983535+0000","last_undegraded":"2024-05-08T20:27:27.983535+0000","last_fullsized":"2024-05-08T20:27:27.983535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960731+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:27:27.960731+0000","last_peered":"2024-05-08T20:27:27.960731+0000","last_clean":"2024-05-08T20:27:27.960731+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:27:27.960731+0000","last_undegraded":"2024-05-08T20:27:27.960731+0000","last_fullsized":"2024-05-08T20:27:27.960731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966310+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:27:27.966310+0000","last_peered":"2024-05-08T20:27:27.966310+0000","last_clean":"2024-05-08T20:27:27.966310+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:27:27.966310+0000","last_undegraded":"2024-05-08T20:27:27.966310+0000","last_fullsized":"2024-05-08T20:27:27.966310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828422+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:27:29.828422+0000","last_peered":"2024-05-08T20:27:29.828422+0000","last_clean":"2024-05-08T20:27:29.828422+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:27:29.828422+0000","last_undegraded":"2024-05-08T20:27:29.828422+0000","last_fullsized":"2024-05-08T20:27:29.828422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.979219+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:27:27.979219+0000","last_peered":"2024-05-08T20:27:27.979219+0000","last_clean":"2024-05-08T20:27:27.979219+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:27:27.979219+0000","last_undegraded":"2024-05-08T20:27:27.979219+0000","last_fullsized":"2024-05-08T20:27:27.979219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.970205+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:27:27.970205+0000","last_peered":"2024-05-08T20:27:27.970205+0000","last_clean":"2024-05-08T20:27:27.970205+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:27:27.970205+0000","last_undegraded":"2024-05-08T20:27:27.970205+0000","last_fullsized":"2024-05-08T20:27:27.970205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965848+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:27:27.965848+0000","last_peered":"2024-05-08T20:27:27.965848+0000","last_clean":"2024-05-08T20:27:27.965848+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:27:27.965848+0000","last_undegraded":"2024-05-08T20:27:27.965848+0000","last_fullsized":"2024-05-08T20:27:27.965848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120712+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:27:30.120712+0000","last_peered":"2024-05-08T20:27:30.120712+0000","last_clean":"2024-05-08T20:27:30.120712+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:27:30.120712+0000","last_undegraded":"2024-05-08T20:27:30.120712+0000","last_fullsized":"2024-05-08T20:27:30.120712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980706+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:27:27.980706+0000","last_peered":"2024-05-08T20:27:27.980706+0000","last_clean":"2024-05-08T20:27:27.980706+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:27:27.980706+0000","last_undegraded":"2024-05-08T20:27:27.980706+0000","last_fullsized":"2024-05-08T20:27:27.980706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959329+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:27:27.959329+0000","last_peered":"2024-05-08T20:27:27.959329+0000","last_clean":"2024-05-08T20:27:27.959329+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:27:27.959329+0000","last_undegraded":"2024-05-08T20:27:27.959329+0000","last_fullsized":"2024-05-08T20:27:27.959329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967053+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:27:27.967053+0000","last_peered":"2024-05-08T20:27:27.967053+0000","last_clean":"2024-05-08T20:27:27.967053+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:27:27.967053+0000","last_undegraded":"2024-05-08T20:27:27.967053+0000","last_fullsized":"2024-05-08T20:27:27.967053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966398+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:27:28.966398+0000","last_peered":"2024-05-08T20:27:28.966398+0000","last_clean":"2024-05-08T20:27:28.966398+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:27:28.966398+0000","last_undegraded":"2024-05-08T20:27:28.966398+0000","last_fullsized":"2024-05-08T20:27:28.966398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.969141+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:27:27.969141+0000","last_peered":"2024-05-08T20:27:27.969141+0000","last_clean":"2024-05-08T20:27:27.969141+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:27:27.969141+0000","last_undegraded":"2024-05-08T20:27:27.969141+0000","last_fullsized":"2024-05-08T20:27:27.969141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971014+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:27:27.971014+0000","last_peered":"2024-05-08T20:27:27.971014+0000","last_clean":"2024-05-08T20:27:27.971014+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:27:27.971014+0000","last_undegraded":"2024-05-08T20:27:27.971014+0000","last_fullsized":"2024-05-08T20:27:27.971014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975474+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:27:27.975474+0000","last_peered":"2024-05-08T20:27:27.975474+0000","last_clean":"2024-05-08T20:27:27.975474+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:27:27.975474+0000","last_undegraded":"2024-05-08T20:27:27.975474+0000","last_fullsized":"2024-05-08T20:27:27.975474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965771+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:27:28.965771+0000","last_peered":"2024-05-08T20:27:28.965771+0000","last_clean":"2024-05-08T20:27:28.965771+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:27:28.965771+0000","last_undegraded":"2024-05-08T20:27:28.965771+0000","last_fullsized":"2024-05-08T20:27:28.965771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.978160+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:27:27.978160+0000","last_peered":"2024-05-08T20:27:27.978160+0000","last_clean":"2024-05-08T20:27:27.978160+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:27:27.978160+0000","last_undegraded":"2024-05-08T20:27:27.978160+0000","last_fullsized":"2024-05-08T20:27:27.978160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966347+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:27:27.966347+0000","last_peered":"2024-05-08T20:27:27.966347+0000","last_clean":"2024-05-08T20:27:27.966347+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:27:27.966347+0000","last_undegraded":"2024-05-08T20:27:27.966347+0000","last_fullsized":"2024-05-08T20:27:27.966347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:55.752903+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:27:55.752903+0000","last_peered":"2024-05-08T20:27:55.752903+0000","last_clean":"2024-05-08T20:27:55.752903+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:27:55.752903+0000","last_undegraded":"2024-05-08T20:27:55.752903+0000","last_fullsized":"2024-05-08T20:27:55.752903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121232+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:27:30.121232+0000","last_peered":"2024-05-08T20:27:30.121232+0000","last_clean":"2024-05-08T20:27:30.121232+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:27:30.121232+0000","last_undegraded":"2024-05-08T20:27:30.121232+0000","last_fullsized":"2024-05-08T20:27:30.121232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967147+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:27:27.967147+0000","last_peered":"2024-05-08T20:27:27.967147+0000","last_clean":"2024-05-08T20:27:27.967147+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:27:27.967147+0000","last_undegraded":"2024-05-08T20:27:27.967147+0000","last_fullsized":"2024-05-08T20:27:27.967147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968924+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:27:27.968924+0000","last_peered":"2024-05-08T20:27:27.968924+0000","last_clean":"2024-05-08T20:27:27.968924+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:27:27.968924+0000","last_undegraded":"2024-05-08T20:27:27.968924+0000","last_fullsized":"2024-05-08T20:27:27.968924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.002412+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:27:28.002412+0000","last_peered":"2024-05-08T20:27:28.002412+0000","last_clean":"2024-05-08T20:27:28.002412+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:27:28.002412+0000","last_undegraded":"2024-05-08T20:27:28.002412+0000","last_fullsized":"2024-05-08T20:27:28.002412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120490+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:27:30.120490+0000","last_peered":"2024-05-08T20:27:30.120490+0000","last_clean":"2024-05-08T20:27:30.120490+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:27:30.120490+0000","last_undegraded":"2024-05-08T20:27:30.120490+0000","last_fullsized":"2024-05-08T20:27:30.120490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.982575+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:27:27.982575+0000","last_peered":"2024-05-08T20:27:27.982575+0000","last_clean":"2024-05-08T20:27:27.982575+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:27:27.982575+0000","last_undegraded":"2024-05-08T20:27:27.982575+0000","last_fullsized":"2024-05-08T20:27:27.982575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:52.738349+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:27:52.738349+0000","last_peered":"2024-05-08T20:27:52.738349+0000","last_clean":"2024-05-08T20:27:52.738349+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:27:52.738349+0000","last_undegraded":"2024-05-08T20:27:52.738349+0000","last_fullsized":"2024-05-08T20:27:52.738349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966961+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:27:27.966961+0000","last_peered":"2024-05-08T20:27:27.966961+0000","last_clean":"2024-05-08T20:27:27.966961+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:27:27.966961+0000","last_undegraded":"2024-05-08T20:27:27.966961+0000","last_fullsized":"2024-05-08T20:27:27.966961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117532+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:27:29.117532+0000","last_peered":"2024-05-08T20:27:29.117532+0000","last_clean":"2024-05-08T20:27:29.117532+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:27:29.117532+0000","last_undegraded":"2024-05-08T20:27:29.117532+0000","last_fullsized":"2024-05-08T20:27:29.117532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990856+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:27:27.990856+0000","last_peered":"2024-05-08T20:27:27.990856+0000","last_clean":"2024-05-08T20:27:27.990856+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:27:27.990856+0000","last_undegraded":"2024-05-08T20:27:27.990856+0000","last_fullsized":"2024-05-08T20:27:27.990856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967710+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:27:27.967710+0000","last_peered":"2024-05-08T20:27:27.967710+0000","last_clean":"2024-05-08T20:27:27.967710+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:27:27.967710+0000","last_undegraded":"2024-05-08T20:27:27.967710+0000","last_fullsized":"2024-05-08T20:27:27.967710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.015491+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:27:28.015491+0000","last_peered":"2024-05-08T20:27:28.015491+0000","last_clean":"2024-05-08T20:27:28.015491+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:27:28.015491+0000","last_undegraded":"2024-05-08T20:27:28.015491+0000","last_fullsized":"2024-05-08T20:27:28.015491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965107+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:27:28.965107+0000","last_peered":"2024-05-08T20:27:28.965107+0000","last_clean":"2024-05-08T20:27:28.965107+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:27:28.965107+0000","last_undegraded":"2024-05-08T20:27:28.965107+0000","last_fullsized":"2024-05-08T20:27:28.965107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968226+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:27:27.968226+0000","last_peered":"2024-05-08T20:27:27.968226+0000","last_clean":"2024-05-08T20:27:27.968226+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:27:27.968226+0000","last_undegraded":"2024-05-08T20:27:27.968226+0000","last_fullsized":"2024-05-08T20:27:27.968226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974750+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:27:27.974750+0000","last_peered":"2024-05-08T20:27:27.974750+0000","last_clean":"2024-05-08T20:27:27.974750+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:27:27.974750+0000","last_undegraded":"2024-05-08T20:27:27.974750+0000","last_fullsized":"2024-05-08T20:27:27.974750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989245+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:27:27.989245+0000","last_peered":"2024-05-08T20:27:27.989245+0000","last_clean":"2024-05-08T20:27:27.989245+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:27:27.989245+0000","last_undegraded":"2024-05-08T20:27:27.989245+0000","last_fullsized":"2024-05-08T20:27:27.989245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121185+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:27:30.121185+0000","last_peered":"2024-05-08T20:27:30.121185+0000","last_clean":"2024-05-08T20:27:30.121185+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:27:30.121185+0000","last_undegraded":"2024-05-08T20:27:30.121185+0000","last_fullsized":"2024-05-08T20:27:30.121185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974534+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:27:27.974534+0000","last_peered":"2024-05-08T20:27:27.974534+0000","last_clean":"2024-05-08T20:27:27.974534+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:27:27.974534+0000","last_undegraded":"2024-05-08T20:27:27.974534+0000","last_fullsized":"2024-05-08T20:27:27.974534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972192+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:27:27.972192+0000","last_peered":"2024-05-08T20:27:27.972192+0000","last_clean":"2024-05-08T20:27:27.972192+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:27:27.972192+0000","last_undegraded":"2024-05-08T20:27:27.972192+0000","last_fullsized":"2024-05-08T20:27:27.972192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974722+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:27:27.974722+0000","last_peered":"2024-05-08T20:27:27.974722+0000","last_clean":"2024-05-08T20:27:27.974722+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:27:27.974722+0000","last_undegraded":"2024-05-08T20:27:27.974722+0000","last_fullsized":"2024-05-08T20:27:27.974722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967785+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:27:28.967785+0000","last_peered":"2024-05-08T20:27:28.967785+0000","last_clean":"2024-05-08T20:27:28.967785+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:27:28.967785+0000","last_undegraded":"2024-05-08T20:27:28.967785+0000","last_fullsized":"2024-05-08T20:27:28.967785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.177055+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:27:28.177055+0000","last_peered":"2024-05-08T20:27:28.177055+0000","last_clean":"2024-05-08T20:27:28.177055+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:27:28.177055+0000","last_undegraded":"2024-05-08T20:27:28.177055+0000","last_fullsized":"2024-05-08T20:27:28.177055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966504+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:27:27.966504+0000","last_peered":"2024-05-08T20:27:27.966504+0000","last_clean":"2024-05-08T20:27:27.966504+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:27:27.966504+0000","last_undegraded":"2024-05-08T20:27:27.966504+0000","last_fullsized":"2024-05-08T20:27:27.966504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967083+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:27:27.967083+0000","last_peered":"2024-05-08T20:27:27.967083+0000","last_clean":"2024-05-08T20:27:27.967083+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:27:27.967083+0000","last_undegraded":"2024-05-08T20:27:27.967083+0000","last_fullsized":"2024-05-08T20:27:27.967083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.962475+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:27:28.962475+0000","last_peered":"2024-05-08T20:27:28.962475+0000","last_clean":"2024-05-08T20:27:28.962475+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:27:28.962475+0000","last_undegraded":"2024-05-08T20:27:28.962475+0000","last_fullsized":"2024-05-08T20:27:28.962475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.009055+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:27:28.009055+0000","last_peered":"2024-05-08T20:27:28.009055+0000","last_clean":"2024-05-08T20:27:28.009055+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:27:28.009055+0000","last_undegraded":"2024-05-08T20:27:28.009055+0000","last_fullsized":"2024-05-08T20:27:28.009055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975284+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:27:27.975284+0000","last_peered":"2024-05-08T20:27:27.975284+0000","last_clean":"2024-05-08T20:27:27.975284+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:27:27.975284+0000","last_undegraded":"2024-05-08T20:27:27.975284+0000","last_fullsized":"2024-05-08T20:27:27.975284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974924+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:27:27.974924+0000","last_peered":"2024-05-08T20:27:27.974924+0000","last_clean":"2024-05-08T20:27:27.974924+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:27:27.974924+0000","last_undegraded":"2024-05-08T20:27:27.974924+0000","last_fullsized":"2024-05-08T20:27:27.974924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118341+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:27:29.118341+0000","last_peered":"2024-05-08T20:27:29.118341+0000","last_clean":"2024-05-08T20:27:29.118341+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:27:29.118341+0000","last_undegraded":"2024-05-08T20:27:29.118341+0000","last_fullsized":"2024-05-08T20:27:29.118341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972949+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:27:27.972949+0000","last_peered":"2024-05-08T20:27:27.972949+0000","last_clean":"2024-05-08T20:27:27.972949+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:27:27.972949+0000","last_undegraded":"2024-05-08T20:27:27.972949+0000","last_fullsized":"2024-05-08T20:27:27.972949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968852+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:27:27.968852+0000","last_peered":"2024-05-08T20:27:27.968852+0000","last_clean":"2024-05-08T20:27:27.968852+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:27:27.968852+0000","last_undegraded":"2024-05-08T20:27:27.968852+0000","last_fullsized":"2024-05-08T20:27:27.968852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975921+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:27:27.975921+0000","last_peered":"2024-05-08T20:27:27.975921+0000","last_clean":"2024-05-08T20:27:27.975921+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:27:27.975921+0000","last_undegraded":"2024-05-08T20:27:27.975921+0000","last_fullsized":"2024-05-08T20:27:27.975921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122913+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:27:30.122913+0000","last_peered":"2024-05-08T20:27:30.122913+0000","last_clean":"2024-05-08T20:27:30.122913+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:27:30.122913+0000","last_undegraded":"2024-05-08T20:27:30.122913+0000","last_fullsized":"2024-05-08T20:27:30.122913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975381+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:27:27.975381+0000","last_peered":"2024-05-08T20:27:27.975381+0000","last_clean":"2024-05-08T20:27:27.975381+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:27:27.975381+0000","last_undegraded":"2024-05-08T20:27:27.975381+0000","last_fullsized":"2024-05-08T20:27:27.975381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.989724+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:27:27.989724+0000","last_peered":"2024-05-08T20:27:27.989724+0000","last_clean":"2024-05-08T20:27:27.989724+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:27:27.989724+0000","last_undegraded":"2024-05-08T20:27:27.989724+0000","last_fullsized":"2024-05-08T20:27:27.989724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.988998+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:27:27.988998+0000","last_peered":"2024-05-08T20:27:27.988998+0000","last_clean":"2024-05-08T20:27:27.988998+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:27:27.988998+0000","last_undegraded":"2024-05-08T20:27:27.988998+0000","last_fullsized":"2024-05-08T20:27:27.988998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120764+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:27:30.120764+0000","last_peered":"2024-05-08T20:27:30.120764+0000","last_clean":"2024-05-08T20:27:30.120764+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:27:30.120764+0000","last_undegraded":"2024-05-08T20:27:30.120764+0000","last_fullsized":"2024-05-08T20:27:30.120764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968887+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:27:27.968887+0000","last_peered":"2024-05-08T20:27:27.968887+0000","last_clean":"2024-05-08T20:27:27.968887+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:27:27.968887+0000","last_undegraded":"2024-05-08T20:27:27.968887+0000","last_fullsized":"2024-05-08T20:27:27.968887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117889+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:27:29.117889+0000","last_peered":"2024-05-08T20:27:29.117889+0000","last_clean":"2024-05-08T20:27:29.117889+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:27:29.117889+0000","last_undegraded":"2024-05-08T20:27:29.117889+0000","last_fullsized":"2024-05-08T20:27:29.117889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.959359+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:27:27.959359+0000","last_peered":"2024-05-08T20:27:27.959359+0000","last_clean":"2024-05-08T20:27:27.959359+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:27:27.959359+0000","last_undegraded":"2024-05-08T20:27:27.959359+0000","last_fullsized":"2024-05-08T20:27:27.959359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965892+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:27:28.965892+0000","last_peered":"2024-05-08T20:27:28.965892+0000","last_clean":"2024-05-08T20:27:28.965892+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:27:28.965892+0000","last_undegraded":"2024-05-08T20:27:28.965892+0000","last_fullsized":"2024-05-08T20:27:28.965892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966219+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:27:27.966219+0000","last_peered":"2024-05-08T20:27:27.966219+0000","last_clean":"2024-05-08T20:27:27.966219+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:27:27.966219+0000","last_undegraded":"2024-05-08T20:27:27.966219+0000","last_fullsized":"2024-05-08T20:27:27.966219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.118298+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:27:29.118298+0000","last_peered":"2024-05-08T20:27:29.118298+0000","last_clean":"2024-05-08T20:27:29.118298+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:27:29.118298+0000","last_undegraded":"2024-05-08T20:27:29.118298+0000","last_fullsized":"2024-05-08T20:27:29.118298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968770+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:27:27.968770+0000","last_peered":"2024-05-08T20:27:27.968770+0000","last_clean":"2024-05-08T20:27:27.968770+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:27:27.968770+0000","last_undegraded":"2024-05-08T20:27:27.968770+0000","last_fullsized":"2024-05-08T20:27:27.968770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124621+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:27:30.124621+0000","last_peered":"2024-05-08T20:27:30.124621+0000","last_clean":"2024-05-08T20:27:30.124621+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:27:30.124621+0000","last_undegraded":"2024-05-08T20:27:30.124621+0000","last_fullsized":"2024-05-08T20:27:30.124621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.976203+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:27:27.976203+0000","last_peered":"2024-05-08T20:27:27.976203+0000","last_clean":"2024-05-08T20:27:27.976203+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:27:27.976203+0000","last_undegraded":"2024-05-08T20:27:27.976203+0000","last_fullsized":"2024-05-08T20:27:27.976203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123076+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:27:30.123076+0000","last_peered":"2024-05-08T20:27:30.123076+0000","last_clean":"2024-05-08T20:27:30.123076+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:27:30.123076+0000","last_undegraded":"2024-05-08T20:27:30.123076+0000","last_fullsized":"2024-05-08T20:27:30.123076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967634+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:27:27.967634+0000","last_peered":"2024-05-08T20:27:27.967634+0000","last_clean":"2024-05-08T20:27:27.967634+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:27:27.967634+0000","last_undegraded":"2024-05-08T20:27:27.967634+0000","last_fullsized":"2024-05-08T20:27:27.967634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120906+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:27:30.120906+0000","last_peered":"2024-05-08T20:27:30.120906+0000","last_clean":"2024-05-08T20:27:30.120906+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:27:30.120906+0000","last_undegraded":"2024-05-08T20:27:30.120906+0000","last_fullsized":"2024-05-08T20:27:30.120906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972492+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:27:27.972492+0000","last_peered":"2024-05-08T20:27:27.972492+0000","last_clean":"2024-05-08T20:27:27.972492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:27:27.972492+0000","last_undegraded":"2024-05-08T20:27:27.972492+0000","last_fullsized":"2024-05-08T20:27:27.972492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965005+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:27:28.965005+0000","last_peered":"2024-05-08T20:27:28.965005+0000","last_clean":"2024-05-08T20:27:28.965005+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:27:28.965005+0000","last_undegraded":"2024-05-08T20:27:28.965005+0000","last_fullsized":"2024-05-08T20:27:28.965005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975549+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:27:27.975549+0000","last_peered":"2024-05-08T20:27:27.975549+0000","last_clean":"2024-05-08T20:27:27.975549+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:27:27.975549+0000","last_undegraded":"2024-05-08T20:27:27.975549+0000","last_fullsized":"2024-05-08T20:27:27.975549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120640+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:27:30.120640+0000","last_peered":"2024-05-08T20:27:30.120640+0000","last_clean":"2024-05-08T20:27:30.120640+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:27:30.120640+0000","last_undegraded":"2024-05-08T20:27:30.120640+0000","last_fullsized":"2024-05-08T20:27:30.120640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966857+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:27:27.966857+0000","last_peered":"2024-05-08T20:27:27.966857+0000","last_clean":"2024-05-08T20:27:27.966857+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:27:27.966857+0000","last_undegraded":"2024-05-08T20:27:27.966857+0000","last_fullsized":"2024-05-08T20:27:27.966857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.124089+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:27:30.124089+0000","last_peered":"2024-05-08T20:27:30.124089+0000","last_clean":"2024-05-08T20:27:30.124089+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:27:30.124089+0000","last_undegraded":"2024-05-08T20:27:30.124089+0000","last_fullsized":"2024-05-08T20:27:30.124089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.974866+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:27:27.974866+0000","last_peered":"2024-05-08T20:27:27.974866+0000","last_clean":"2024-05-08T20:27:27.974866+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:27:27.974866+0000","last_undegraded":"2024-05-08T20:27:27.974866+0000","last_fullsized":"2024-05-08T20:27:27.974866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.829137+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:27:29.829137+0000","last_peered":"2024-05-08T20:27:29.829137+0000","last_clean":"2024-05-08T20:27:29.829137+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:27:29.829137+0000","last_undegraded":"2024-05-08T20:27:29.829137+0000","last_fullsized":"2024-05-08T20:27:29.829137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966108+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:27:27.966108+0000","last_peered":"2024-05-08T20:27:27.966108+0000","last_clean":"2024-05-08T20:27:27.966108+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:27:27.966108+0000","last_undegraded":"2024-05-08T20:27:27.966108+0000","last_fullsized":"2024-05-08T20:27:27.966108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120628+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:27:30.120628+0000","last_peered":"2024-05-08T20:27:30.120628+0000","last_clean":"2024-05-08T20:27:30.120628+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:27:30.120628+0000","last_undegraded":"2024-05-08T20:27:30.120628+0000","last_fullsized":"2024-05-08T20:27:30.120628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.968267+0000","last_change":"2024-05-08T20:27:18.907574+0000","last_active":"2024-05-08T20:27:27.968267+0000","last_peered":"2024-05-08T20:27:27.968267+0000","last_clean":"2024-05-08T20:27:27.968267+0000","last_became_active":"2024-05-08T20:27:18.906964+0000","last_became_peered":"2024-05-08T20:27:18.906964+0000","last_unstale":"2024-05-08T20:27:27.968267+0000","last_undegraded":"2024-05-08T20:27:27.968267+0000","last_fullsized":"2024-05-08T20:27:27.968267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:34.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122806+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:27:30.122806+0000","last_peered":"2024-05-08T20:27:30.122806+0000","last_clean":"2024-05-08T20:27:30.122806+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:27:30.122806+0000","last_undegraded":"2024-05-08T20:27:30.122806+0000","last_fullsized":"2024-05-08T20:27:30.122806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971279+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:27:27.971279+0000","last_peered":"2024-05-08T20:27:27.971279+0000","last_clean":"2024-05-08T20:27:27.971279+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:27:27.971279+0000","last_undegraded":"2024-05-08T20:27:27.971279+0000","last_fullsized":"2024-05-08T20:27:27.971279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122811+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:27:30.122811+0000","last_peered":"2024-05-08T20:27:30.122811+0000","last_clean":"2024-05-08T20:27:30.122811+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:27:30.122811+0000","last_undegraded":"2024-05-08T20:27:30.122811+0000","last_fullsized":"2024-05-08T20:27:30.122811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983236+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:27:27.983236+0000","last_peered":"2024-05-08T20:27:27.983236+0000","last_clean":"2024-05-08T20:27:27.983236+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:27:27.983236+0000","last_undegraded":"2024-05-08T20:27:27.983236+0000","last_fullsized":"2024-05-08T20:27:27.983236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.963891+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:27:28.963891+0000","last_peered":"2024-05-08T20:27:28.963891+0000","last_clean":"2024-05-08T20:27:28.963891+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:27:28.963891+0000","last_undegraded":"2024-05-08T20:27:28.963891+0000","last_fullsized":"2024-05-08T20:27:28.963891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.960646+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:27:27.960646+0000","last_peered":"2024-05-08T20:27:27.960646+0000","last_clean":"2024-05-08T20:27:27.960646+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:27:27.960646+0000","last_undegraded":"2024-05-08T20:27:27.960646+0000","last_fullsized":"2024-05-08T20:27:27.960646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.961691+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:27:28.961691+0000","last_peered":"2024-05-08T20:27:28.961691+0000","last_clean":"2024-05-08T20:27:28.961691+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:27:28.961691+0000","last_undegraded":"2024-05-08T20:27:28.961691+0000","last_fullsized":"2024-05-08T20:27:28.961691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.981172+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:27:27.981172+0000","last_peered":"2024-05-08T20:27:27.981172+0000","last_clean":"2024-05-08T20:27:27.981172+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:27:27.981172+0000","last_undegraded":"2024-05-08T20:27:27.981172+0000","last_fullsized":"2024-05-08T20:27:27.981172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966606+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:27:27.966606+0000","last_peered":"2024-05-08T20:27:27.966606+0000","last_clean":"2024-05-08T20:27:27.966606+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:27:27.966606+0000","last_undegraded":"2024-05-08T20:27:27.966606+0000","last_fullsized":"2024-05-08T20:27:27.966606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.123999+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:27:30.123999+0000","last_peered":"2024-05-08T20:27:30.123999+0000","last_clean":"2024-05-08T20:27:30.123999+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:27:30.123999+0000","last_undegraded":"2024-05-08T20:27:30.123999+0000","last_fullsized":"2024-05-08T20:27:30.123999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966673+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:27:27.966673+0000","last_peered":"2024-05-08T20:27:27.966673+0000","last_clean":"2024-05-08T20:27:27.966673+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:27:27.966673+0000","last_undegraded":"2024-05-08T20:27:27.966673+0000","last_fullsized":"2024-05-08T20:27:27.966673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.965622+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:27:28.965622+0000","last_peered":"2024-05-08T20:27:28.965622+0000","last_clean":"2024-05-08T20:27:28.965622+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:27:28.965622+0000","last_undegraded":"2024-05-08T20:27:28.965622+0000","last_fullsized":"2024-05-08T20:27:28.965622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967975+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:27:27.967975+0000","last_peered":"2024-05-08T20:27:27.967975+0000","last_clean":"2024-05-08T20:27:27.967975+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:27:27.967975+0000","last_undegraded":"2024-05-08T20:27:27.967975+0000","last_fullsized":"2024-05-08T20:27:27.967975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.122259+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:27:30.122259+0000","last_peered":"2024-05-08T20:27:30.122259+0000","last_clean":"2024-05-08T20:27:30.122259+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:27:30.122259+0000","last_undegraded":"2024-05-08T20:27:30.122259+0000","last_fullsized":"2024-05-08T20:27:30.122259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975212+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:27:27.975212+0000","last_peered":"2024-05-08T20:27:27.975212+0000","last_clean":"2024-05-08T20:27:27.975212+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:27:27.975212+0000","last_undegraded":"2024-05-08T20:27:27.975212+0000","last_fullsized":"2024-05-08T20:27:27.975212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120565+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:27:30.120565+0000","last_peered":"2024-05-08T20:27:30.120565+0000","last_clean":"2024-05-08T20:27:30.120565+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:27:30.120565+0000","last_undegraded":"2024-05-08T20:27:30.120565+0000","last_fullsized":"2024-05-08T20:27:30.120565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.990649+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:27:27.990649+0000","last_peered":"2024-05-08T20:27:27.990649+0000","last_clean":"2024-05-08T20:27:27.990649+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:27:27.990649+0000","last_undegraded":"2024-05-08T20:27:27.990649+0000","last_fullsized":"2024-05-08T20:27:27.990649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828756+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:27:29.828756+0000","last_peered":"2024-05-08T20:27:29.828756+0000","last_clean":"2024-05-08T20:27:29.828756+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:27:29.828756+0000","last_undegraded":"2024-05-08T20:27:29.828756+0000","last_fullsized":"2024-05-08T20:27:29.828756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.971516+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:27:27.971516+0000","last_peered":"2024-05-08T20:27:27.971516+0000","last_clean":"2024-05-08T20:27:27.971516+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:27:27.971516+0000","last_undegraded":"2024-05-08T20:27:27.971516+0000","last_fullsized":"2024-05-08T20:27:27.971516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121704+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:27:30.121704+0000","last_peered":"2024-05-08T20:27:30.121704+0000","last_clean":"2024-05-08T20:27:30.121704+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:27:30.121704+0000","last_undegraded":"2024-05-08T20:27:30.121704+0000","last_fullsized":"2024-05-08T20:27:30.121704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.972248+0000","last_change":"2024-05-08T20:27:18.932988+0000","last_active":"2024-05-08T20:27:27.972248+0000","last_peered":"2024-05-08T20:27:27.972248+0000","last_clean":"2024-05-08T20:27:27.972248+0000","last_became_active":"2024-05-08T20:27:18.932423+0000","last_became_peered":"2024-05-08T20:27:18.932423+0000","last_unstale":"2024-05-08T20:27:27.972248+0000","last_undegraded":"2024-05-08T20:27:27.972248+0000","last_fullsized":"2024-05-08T20:27:27.972248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:31.312506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.969298+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:27:28.969298+0000","last_peered":"2024-05-08T20:27:28.969298+0000","last_clean":"2024-05-08T20:27:28.969298+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:27:28.969298+0000","last_undegraded":"2024-05-08T20:27:28.969298+0000","last_fullsized":"2024-05-08T20:27:28.969298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983356+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:27:27.983356+0000","last_peered":"2024-05-08T20:27:27.983356+0000","last_clean":"2024-05-08T20:27:27.983356+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:27:27.983356+0000","last_undegraded":"2024-05-08T20:27:27.983356+0000","last_fullsized":"2024-05-08T20:27:27.983356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121036+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:27:30.121036+0000","last_peered":"2024-05-08T20:27:30.121036+0000","last_clean":"2024-05-08T20:27:30.121036+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:27:30.121036+0000","last_undegraded":"2024-05-08T20:27:30.121036+0000","last_fullsized":"2024-05-08T20:27:30.121036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.975198+0000","last_change":"2024-05-08T20:27:18.933872+0000","last_active":"2024-05-08T20:27:27.975198+0000","last_peered":"2024-05-08T20:27:27.975198+0000","last_clean":"2024-05-08T20:27:27.975198+0000","last_became_active":"2024-05-08T20:27:18.933542+0000","last_became_peered":"2024-05-08T20:27:18.933542+0000","last_unstale":"2024-05-08T20:27:27.975198+0000","last_undegraded":"2024-05-08T20:27:27.975198+0000","last_fullsized":"2024-05-08T20:27:27.975198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:50.286511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.967166+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:27:28.967166+0000","last_peered":"2024-05-08T20:27:28.967166+0000","last_clean":"2024-05-08T20:27:28.967166+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:27:28.967166+0000","last_undegraded":"2024-05-08T20:27:28.967166+0000","last_fullsized":"2024-05-08T20:27:28.967166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.980500+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:27:27.980500+0000","last_peered":"2024-05-08T20:27:27.980500+0000","last_clean":"2024-05-08T20:27:27.980500+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:27:27.980500+0000","last_undegraded":"2024-05-08T20:27:27.980500+0000","last_fullsized":"2024-05-08T20:27:27.980500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.117734+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:27:29.117734+0000","last_peered":"2024-05-08T20:27:29.117734+0000","last_clean":"2024-05-08T20:27:29.117734+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:27:29.117734+0000","last_undegraded":"2024-05-08T20:27:29.117734+0000","last_fullsized":"2024-05-08T20:27:29.117734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.965966+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:27:27.965966+0000","last_peered":"2024-05-08T20:27:27.965966+0000","last_clean":"2024-05-08T20:27:27.965966+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:27:27.965966+0000","last_undegraded":"2024-05-08T20:27:27.965966+0000","last_fullsized":"2024-05-08T20:27:27.965966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:28.966181+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:27:28.966181+0000","last_peered":"2024-05-08T20:27:28.966181+0000","last_clean":"2024-05-08T20:27:28.966181+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:27:28.966181+0000","last_undegraded":"2024-05-08T20:27:28.966181+0000","last_fullsized":"2024-05-08T20:27:28.966181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.977945+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:27:27.977945+0000","last_peered":"2024-05-08T20:27:27.977945+0000","last_clean":"2024-05-08T20:27:27.977945+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:27:27.977945+0000","last_undegraded":"2024-05-08T20:27:27.977945+0000","last_fullsized":"2024-05-08T20:27:27.977945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120307+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:27:30.120307+0000","last_peered":"2024-05-08T20:27:30.120307+0000","last_clean":"2024-05-08T20:27:30.120307+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:27:30.120307+0000","last_undegraded":"2024-05-08T20:27:30.120307+0000","last_fullsized":"2024-05-08T20:27:30.120307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.986911+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:27:27.986911+0000","last_peered":"2024-05-08T20:27:27.986911+0000","last_clean":"2024-05-08T20:27:27.986911+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:27:27.986911+0000","last_undegraded":"2024-05-08T20:27:27.986911+0000","last_fullsized":"2024-05-08T20:27:27.986911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:29.828479+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:27:29.828479+0000","last_peered":"2024-05-08T20:27:29.828479+0000","last_clean":"2024-05-08T20:27:29.828479+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:27:29.828479+0000","last_undegraded":"2024-05-08T20:27:29.828479+0000","last_fullsized":"2024-05-08T20:27:29.828479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.966761+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:27:27.966761+0000","last_peered":"2024-05-08T20:27:27.966761+0000","last_clean":"2024-05-08T20:27:27.966761+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:27:27.966761+0000","last_undegraded":"2024-05-08T20:27:27.966761+0000","last_fullsized":"2024-05-08T20:27:27.966761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.120894+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:27:30.120894+0000","last_peered":"2024-05-08T20:27:30.120894+0000","last_clean":"2024-05-08T20:27:30.120894+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:27:30.120894+0000","last_undegraded":"2024-05-08T20:27:30.120894+0000","last_fullsized":"2024-05-08T20:27:30.120894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.967709+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:27:27.967709+0000","last_peered":"2024-05-08T20:27:27.967709+0000","last_clean":"2024-05-08T20:27:27.967709+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:27:27.967709+0000","last_undegraded":"2024-05-08T20:27:27.967709+0000","last_fullsized":"2024-05-08T20:27:27.967709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:27:30.121052+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:27:30.121052+0000","last_peered":"2024-05-08T20:27:30.121052+0000","last_clean":"2024-05-08T20:27:30.121052+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:27:30.121052+0000","last_undegraded":"2024-05-08T20:27:30.121052+0000","last_fullsized":"2024-05-08T20:27:30.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-08T20:27:27.983144+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:27:27.983144+0000","last_peered":"2024-05-08T20:27:27.983144+0000","last_clean":"2024-05-08T20:27:27.983144+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:27:27.983144+0000","last_undegraded":"2024-05-08T20:27:27.983144+0000","last_fullsized":"2024-05-08T20:27:27.983144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2805,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2805,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":103261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":101414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":856064,"data_stored":689212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:28:00.163 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-05-08T20:28:00.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:28:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.306+0000 7f8189d99640 1 Processor -- start 2024-05-08T20:28:00.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.306+0000 7f8189d99640 1 -- start start 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f818414f1a0 0x7f818406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81840c1940 0x7f81840c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81840c5e10 0x7f81840c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81841520a0 con 0x7f818414f1a0 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840c13e0 con 0x7f81840c5e10 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8189d99640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81841517d0 con 0x7f81840c1940 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f818414f1a0 0x7f818406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f818414f1a0 0x7f818406c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59054/0 (socket says 172.21.15.81:59054) 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 -- 172.21.15.81:0/2332195646 learned_addr learned my addr 172.21.15.81:0/2332195646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8183fff640 1 --2- 172.21.15.81:0/2332195646 >> v2:172.21.15.117:3300/0 conn(0x7f81840c5e10 0x7f81840c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f8182ffd640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81840c1940 0x7f81840c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 -- 172.21.15.81:0/2332195646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81840c1940 msgr2=0x7f81840c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:00.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81840c1940 0x7f81840c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 -- 172.21.15.81:0/2332195646 >> v2:172.21.15.117:3300/0 conn(0x7f81840c5e10 msgr2=0x7f81840c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:00.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 --2- 172.21.15.81:0/2332195646 >> v2:172.21.15.117:3300/0 conn(0x7f81840c5e10 0x7f81840c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 -- 172.21.15.81:0/2332195646 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840c1660 con 0x7f818414f1a0 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81837fe640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818414f1a0 0x7f818406c250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f818406f7a0 tx=0x7f817401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda22ba4ad3990f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81827fc640 1 -- 172.21.15.81:0/2332195646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab600 con 0x7f818414f1a0 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81827fc640 1 -- 172.21.15.81:0/2332195646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740a7050 con 0x7f818414f1a0 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.310+0000 7f81827fc640 1 -- 172.21.15.81:0/2332195646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ab980 con 0x7f818414f1a0 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2332195646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818414f1a0 msgr2=0x7f818406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818414f1a0 0x7f818406c250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f818406f7a0 tx=0x7f817401c490 comp rx=0 tx=0).stop 2024-05-08T20:28:00.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2332195646 shutdown_connections 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81840c1940 0x7f81840c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- 172.21.15.81:0/2332195646 >> v2:172.21.15.117:3300/0 conn(0x7f81840c5e10 0x7f81840c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- 172.21.15.81:0/2332195646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818414f1a0 0x7f818406c250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2332195646 >> 172.21.15.81:0/2332195646 conn(0x7f81840c68c0 msgr2=0x7f81840c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2332195646 shutdown_connections 2024-05-08T20:28:00.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2332195646 wait complete. 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 Processor -- start 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- start start 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81840c1940 0x7f8184152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818414f1a0 0x7f8184150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184072560 con 0x7f81840c5e10 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8184072260 con 0x7f81840c1940 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81841eac50 con 0x7f818414f1a0 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59056/0 (socket says 172.21.15.81:59056) 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 -- 172.21.15.81:0/2686217916 learned_addr learned my addr 172.21.15.81:0/2686217916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:00.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f81837fe640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81840c1940 0x7f8184152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8183fff640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818414f1a0 0x7f8184150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 -- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818414f1a0 msgr2=0x7f8184150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818414f1a0 0x7f8184150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 -- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81840c1940 msgr2=0x7f8184152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81840c1940 0x7f8184152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 -- 172.21.15.81:0/2686217916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740094d0 con 0x7f81840c5e10 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8182ffd640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f816c00fa60 tx=0x7f816c00ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c009c30 con 0x7f81840c5e10 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c009d90 con 0x7f81840c5e10 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840ab920 con 0x7f81840c5e10 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c011670 con 0x7f81840c5e10 2024-05-08T20:28:00.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.314+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81840729f0 con 0x7f81840c5e10 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8184152510 con 0x7f81840c5e10 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f816c0117d0 con 0x7f81840c5e10 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f817bfff640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 0x7f8164068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f816c086ab0 con 0x7f81840c5e10 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f81837fe640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 0x7f8164068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.318+0000 7f81837fe640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 0x7f8164068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.322+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8184152510 con 0x7f81840c5e10 2024-05-08T20:28:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.534+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81840723a0 con 0x7f81840c5e10 2024-05-08T20:28:00.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.534+0000 7f817bfff640 1 -- 172.21.15.81:0/2686217916 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7f81840723a0 con 0x7f81840c5e10 2024-05-08T20:28:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:28:00.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:28:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 msgr2=0x7f8164068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 0x7f8164068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f81740ad000 tx=0x7f8174008040 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 msgr2=0x7f81841ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f816c00fa60 tx=0x7f816c00ff20 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 shutdown_connections 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8164066690 0x7f8164068b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f818414f1a0 0x7f8184150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81840c5e10 0x7f81841ea1f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 --2- 172.21.15.81:0/2686217916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81840c1940 0x7f8184152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 >> 172.21.15.81:0/2686217916 conn(0x7f81840c68c0 msgr2=0x7f8184155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 shutdown_connections 2024-05-08T20:28:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.538+0000 7f8189d99640 1 -- 172.21.15.81:0/2686217916 wait complete. 2024-05-08T20:28:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:28:00.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:28:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.662+0000 7facb335e640 1 Processor -- start 2024-05-08T20:28:00.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.662+0000 7facb335e640 1 -- start start 2024-05-08T20:28:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facac1481c0 0x7facac0aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 0x7facac0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7facac151500 0x7facac151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0c1140 con 0x7facac1481c0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0c0bc0 con 0x7facac151500 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb335e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0c0e60 con 0x7facac0ab0f0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facac1481c0 0x7facac0aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facac1481c0 0x7facac0aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59062/0 (socket says 172.21.15.81:59062) 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 -- 172.21.15.81:0/3753904916 learned_addr learned my addr 172.21.15.81:0/3753904916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb18fb640 1 --2- 172.21.15.81:0/3753904916 >> v2:172.21.15.117:3300/0 conn(0x7facac151500 0x7facac151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb08f9640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 0x7facac0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 -- 172.21.15.81:0/3753904916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 msgr2=0x7facac0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 0x7facac0702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 -- 172.21.15.81:0/3753904916 >> v2:172.21.15.117:3300/0 conn(0x7facac151500 msgr2=0x7facac151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 --2- 172.21.15.81:0/3753904916 >> v2:172.21.15.117:3300/0 conn(0x7facac151500 0x7facac151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb10fa640 1 -- 172.21.15.81:0/3753904916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0aa060 con 0x7facac1481c0 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb18fb640 1 --2- 172.21.15.81:0/3753904916 >> v2:172.21.15.117:3300/0 conn(0x7facac151500 0x7facac151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:00.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.666+0000 7facb08f9640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 0x7facac0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:00.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb10fa640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac0aa860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7facac06f020 tx=0x7faca401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb6b8528b25de4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facabfff640 1 -- 172.21.15.81:0/3753904916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40a7b90 con 0x7facac1481c0 2024-05-08T20:28:00.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facabfff640 1 -- 172.21.15.81:0/3753904916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca40a7cf0 con 0x7facac1481c0 2024-05-08T20:28:00.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facabfff640 1 -- 172.21.15.81:0/3753904916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40af660 con 0x7facac1481c0 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/3753904916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 msgr2=0x7facac0aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac0aa860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7facac06f020 tx=0x7faca401ebf0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/3753904916 shutdown_connections 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac0ab0f0 0x7facac0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- 172.21.15.81:0/3753904916 >> v2:172.21.15.117:3300/0 conn(0x7facac151500 0x7facac151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- 172.21.15.81:0/3753904916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac0aa860 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/3753904916 >> 172.21.15.81:0/3753904916 conn(0x7facac0c6000 msgr2=0x7facac0c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/3753904916 shutdown_connections 2024-05-08T20:28:00.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/3753904916 wait complete. 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 Processor -- start 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- start start 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facac0ab0f0 0x7facac0bf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac151500 0x7facac145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac14d0d0 con 0x7facac1481c0 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac145560 con 0x7facac0ab0f0 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac1ee6f0 con 0x7facac151500 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59072/0 (socket says 172.21.15.81:59072) 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 -- 172.21.15.81:0/594602101 learned_addr learned my addr 172.21.15.81:0/594602101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb10fa640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facac0ab0f0 0x7facac0bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb18fb640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac151500 0x7facac145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 -- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac151500 msgr2=0x7facac145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac151500 0x7facac145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 -- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facac0ab0f0 msgr2=0x7facac0bf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facac0ab0f0 0x7facac0bf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 -- 172.21.15.81:0/594602101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca400b770 con 0x7facac1481c0 2024-05-08T20:28:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb08f9640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faca000cee0 tx=0x7faca000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000d840 con 0x7facac1481c0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000d9a0 con 0x7facac1481c0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac1ee9d0 con 0x7facac1481c0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000dd30 con 0x7facac1481c0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.670+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac14c830 con 0x7facac1481c0 2024-05-08T20:28:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac0748b0 con 0x7facac1481c0 2024-05-08T20:28:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faca0015440 con 0x7facac1481c0 2024-05-08T20:28:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7faca9ffb640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7faca00854c0 con 0x7facac1481c0 2024-05-08T20:28:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7facb10fa640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.674+0000 7facb10fa640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 0x7fac98068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faca40b1000 tx=0x7faca4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.678+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7faca00526b0 con 0x7facac1481c0 2024-05-08T20:28:00.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facac0aaed0 con 0x7facac1481c0 2024-05-08T20:28:00.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7faca9ffb640 1 -- 172.21.15.81:0/594602101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faca0024020 con 0x7facac1481c0 2024-05-08T20:28:00.840 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 msgr2=0x7fac98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 0x7fac98068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faca40b1000 tx=0x7faca4008040 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 msgr2=0x7facac144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faca000cee0 tx=0x7faca000a710 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 shutdown_connections 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facac151500 0x7facac145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facac1481c0 0x7facac144ae0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 --2- 172.21.15.81:0/594602101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facac0ab0f0 0x7facac0bf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 >> 172.21.15.81:0/594602101 conn(0x7facac0c6000 msgr2=0x7facac14f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 shutdown_connections 2024-05-08T20:28:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.834+0000 7facb335e640 1 -- 172.21.15.81:0/594602101 wait complete. 2024-05-08T20:28:00.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:28:00.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 Processor -- start 2024-05-08T20:28:00.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 -- start start 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd918158dd0 0x7fd91806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd918154ab0 0x7fd918154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9181580a0 con 0x7fd9180c6b30 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91806c590 con 0x7fd918154ab0 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91e376640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91806d4c0 con 0x7fd918158dd0 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd917fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd9180c6b30 0x7fd9180c0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50612/0 (socket says 172.21.15.81:50612) 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd917fff640 1 -- 172.21.15.81:0/3757444685 learned_addr learned my addr 172.21.15.81:0/3757444685 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91c913640 1 --2- 172.21.15.81:0/3757444685 >> v2:172.21.15.81:3300/0 conn(0x7fd918154ab0 0x7fd918154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd90f7fe640 1 --2- 172.21.15.81:0/3757444685 >> v2:172.21.15.117:3300/0 conn(0x7fd918158dd0 0x7fd91806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd9177fe640 1 -- 172.21.15.81:0/3757444685 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197821211 0 0) 0x7fd9181580a0 con 0x7fd9180c6b30 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd9177fe640 1 -- 172.21.15.81:0/3757444685 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd904003530 con 0x7fd9180c6b30 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91c913640 1 -- 172.21.15.81:0/3757444685 >> v2:172.21.15.117:3300/0 conn(0x7fd918158dd0 msgr2=0x7fd91806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91c913640 1 --2- 172.21.15.81:0/3757444685 >> v2:172.21.15.117:3300/0 conn(0x7fd918158dd0 0x7fd91806ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91c913640 1 -- 172.21.15.81:0/3757444685 >> v1:172.21.15.81:6789/0 conn(0x7fd9180c6b30 legacy=0x7fd9180c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.970+0000 7fd91c913640 1 -- 172.21.15.81:0/3757444685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9181582f0 con 0x7fd918154ab0 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91c913640 1 --2- 172.21.15.81:0/3757444685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd918154ab0 0x7fd918154f60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd91806d3b0 tx=0x7fd91001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffa3d2eaba5d393 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9177fe640 1 -- 172.21.15.81:0/3757444685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100a57c0 con 0x7fd918154ab0 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9177fe640 1 -- 172.21.15.81:0/3757444685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9100a5920 con 0x7fd918154ab0 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9177fe640 1 -- 172.21.15.81:0/3757444685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100a5c90 con 0x7fd918154ab0 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/3757444685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd918154ab0 msgr2=0x7fd918154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- 172.21.15.81:0/3757444685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd918154ab0 0x7fd918154f60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd91806d3b0 tx=0x7fd91001c810 comp rx=0 tx=0).stop 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/3757444685 shutdown_connections 2024-05-08T20:28:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- 172.21.15.81:0/3757444685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd918154ab0 0x7fd918154f60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- 172.21.15.81:0/3757444685 >> v2:172.21.15.117:3300/0 conn(0x7fd918158dd0 0x7fd91806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/3757444685 >> 172.21.15.81:0/3757444685 conn(0x7fd918066080 msgr2=0x7fd918069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/3757444685 shutdown_connections 2024-05-08T20:28:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/3757444685 wait complete. 2024-05-08T20:28:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 Processor -- start 2024-05-08T20:28:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- start start 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918154ab0 0x7fd918071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd918158dd0 0x7fd918071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918070040 con 0x7fd9180c6b30 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180aa180 con 0x7fd918158dd0 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9181f10f0 con 0x7fd918154ab0 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59096/0 (socket says 172.21.15.81:59096) 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 -- 172.21.15.81:0/2216659672 learned_addr learned my addr 172.21.15.81:0/2216659672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91c913640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd918158dd0 0x7fd918071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 -- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918154ab0 msgr2=0x7fd918071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd90f7fe640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918154ab0 0x7fd918071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918154ab0 0x7fd918071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 -- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd918158dd0 msgr2=0x7fd918071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd918158dd0 0x7fd918071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 -- 172.21.15.81:0/2216659672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009a70 con 0x7fd9180c6b30 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd917fff640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c450 tx=0x7fd90800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908005cf0 con 0x7fd9180c6b30 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908005e50 con 0x7fd9180c6b30 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908007290 con 0x7fd9180c6b30 2024-05-08T20:28:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91806fa80 con 0x7fd9180c6b30 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.974+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9180a8210 con 0x7fd9180c6b30 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91806adb0 con 0x7fd9180c6b30 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9080073f0 con 0x7fd9180c6b30 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd9157fa640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 0x7fd8f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd908083a50 con 0x7fd9180c6b30 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd90f7fe640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 0x7fd8f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.978+0000 7fd90f7fe640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 0x7fd8f8068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd918154490 tx=0x7fd900008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:00.982+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd908050ab0 con 0x7fd9180c6b30 2024-05-08T20:28:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd918074950 con 0x7fd9180c6b30 2024-05-08T20:28:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd9157fa640 1 -- 172.21.15.81:0/2216659672 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fd908017020 con 0x7fd9180c6b30 2024-05-08T20:28:01.136 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:28:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 msgr2=0x7fd8f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 0x7fd8f8068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd918154490 tx=0x7fd900008040 comp rx=0 tx=0).stop 2024-05-08T20:28:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 msgr2=0x7fd9181f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c450 tx=0x7fd90800c910 comp rx=0 tx=0).stop 2024-05-08T20:28:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 shutdown_connections 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd8f8066690 0x7fd8f8068b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd918158dd0 0x7fd918071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918154ab0 0x7fd918071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 --2- 172.21.15.81:0/2216659672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9180c6b30 0x7fd9181f0660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 >> 172.21.15.81:0/2216659672 conn(0x7fd918066080 msgr2=0x7fd918069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 shutdown_connections 2024-05-08T20:28:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.130+0000 7fd91e376640 1 -- 172.21.15.81:0/2216659672 wait complete. 2024-05-08T20:28:01.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:28:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 Processor -- start 2024-05-08T20:28:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 -- start start 2024-05-08T20:28:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e38154cf0 0x7f5e38155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e381522e0 con 0x7f5e38151f00 2024-05-08T20:28:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3806bb20 con 0x7f5e38154cf0 2024-05-08T20:28:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.266+0000 7f5e3e632640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381548e0 con 0x7f5e38155690 2024-05-08T20:28:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e2ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e38154cf0 0x7f5e38155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:32904/0 (socket says 172.21.15.81:32904) 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 -- 172.21.15.81:0/92037560 learned_addr learned my addr 172.21.15.81:0/92037560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 -- 172.21.15.81:0/92037560 >> v2:172.21.15.117:3300/0 conn(0x7f5e38154cf0 msgr2=0x7f5e38155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 --2- 172.21.15.81:0/92037560 >> v2:172.21.15.117:3300/0 conn(0x7f5e38154cf0 0x7f5e38155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 -- 172.21.15.81:0/92037560 >> v1:172.21.15.117:6789/0 conn(0x7f5e38151f00 legacy=0x7f5e381588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 -- 172.21.15.81:0/92037560 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380c5f80 con 0x7f5e38155690 2024-05-08T20:28:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e3cbcf640 1 --2- 172.21.15.81:0/92037560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009e50 tx=0x7f5e3001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99932d72b50166d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e377fe640 1 -- 172.21.15.81:0/92037560 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300a5770 con 0x7f5e38155690 2024-05-08T20:28:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e377fe640 1 -- 172.21.15.81:0/92037560 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300a58d0 con 0x7f5e38155690 2024-05-08T20:28:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.270+0000 7f5e377fe640 1 -- 172.21.15.81:0/92037560 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300a5c60 con 0x7f5e38155690 2024-05-08T20:28:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/92037560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 msgr2=0x7f5e380ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- 172.21.15.81:0/92037560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009e50 tx=0x7f5e3001c910 comp rx=0 tx=0).stop 2024-05-08T20:28:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/92037560 shutdown_connections 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- 172.21.15.81:0/92037560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38155690 0x7f5e380ca000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- 172.21.15.81:0/92037560 >> v2:172.21.15.117:3300/0 conn(0x7f5e38154cf0 0x7f5e38155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/92037560 >> 172.21.15.81:0/92037560 conn(0x7f5e380715f0 msgr2=0x7f5e38071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/92037560 shutdown_connections 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/92037560 wait complete. 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 Processor -- start 2024-05-08T20:28:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- start start 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38151f00 0x7f5e38153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e38156ed0 0x7f5e38151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380af570 con 0x7f5e38154cf0 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381ecd40 con 0x7f5e38156ed0 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381ed000 con 0x7f5e38151f00 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59098/0 (socket says 172.21.15.81:59098) 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 -- 172.21.15.81:0/1431585752 learned_addr learned my addr 172.21.15.81:0/1431585752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3cbcf640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e38156ed0 0x7f5e38151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e37fff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38151f00 0x7f5e38153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 -- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38151f00 msgr2=0x7f5e38153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38151f00 0x7f5e38153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 -- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e38156ed0 msgr2=0x7f5e38151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e38156ed0 0x7f5e38151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 -- 172.21.15.81:0/1431585752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009b30 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e2ffff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e870 tx=0x7f5e2000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009510 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000eec0 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e381ed2e0 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000cb40 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.274+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e381ed8a0 con 0x7f5e38154cf0 2024-05-08T20:28:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e38074950 con 0x7f5e38154cf0 2024-05-08T20:28:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e2000ccc0 con 0x7f5e38154cf0 2024-05-08T20:28:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e357fa640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 0x7f5e18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e37fff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 0x7f5e18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5e20084640 con 0x7f5e38154cf0 2024-05-08T20:28:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.278+0000 7f5e37fff640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 0x7f5e18068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e3815e760 tx=0x7f5e28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.282+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5e20051620 con 0x7f5e38154cf0 2024-05-08T20:28:01.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.430+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f5e3806ab10 con 0x7f5e38154cf0 2024-05-08T20:28:01.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.430+0000 7f5e357fa640 1 -- 172.21.15.81:0/1431585752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f5e20054c40 con 0x7f5e38154cf0 2024-05-08T20:28:01.438 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 msgr2=0x7f5e18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 0x7f5e18068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e3815e760 tx=0x7f5e28009040 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 msgr2=0x7f5e38150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e870 tx=0x7f5e2000ec70 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 shutdown_connections 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5e18066690 0x7f5e18068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e38156ed0 0x7f5e38151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e38154cf0 0x7f5e38150d30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 --2- 172.21.15.81:0/1431585752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e38151f00 0x7f5e38153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 >> 172.21.15.81:0/1431585752 conn(0x7f5e380715f0 msgr2=0x7f5e3806b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 shutdown_connections 2024-05-08T20:28:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.434+0000 7f5e3e632640 1 -- 172.21.15.81:0/1431585752 wait complete. 2024-05-08T20:28:01.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:28:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 Processor -- start 2024-05-08T20:28:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 -- start start 2024-05-08T20:28:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78d406afd0 0x7f78d406b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d40abc50 con 0x7f78d414e410 2024-05-08T20:28:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d40c2900 con 0x7f78d4159790 2024-05-08T20:28:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d98b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d40aa320 con 0x7f78d406afd0 2024-05-08T20:28:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78d414e410 0x7f78d40aa6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50614/0 (socket says 172.21.15.81:50614) 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d2ffd640 1 -- 172.21.15.81:0/4213348526 learned_addr learned my addr 172.21.15.81:0/4213348526 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d27fc640 1 --2- 172.21.15.81:0/4213348526 >> v2:172.21.15.81:3300/0 conn(0x7f78d406afd0 0x7f78d406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d1ffb640 1 -- 172.21.15.81:0/4213348526 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694742303 0 0) 0x7f78d40abc50 con 0x7f78d414e410 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d1ffb640 1 -- 172.21.15.81:0/4213348526 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78bc003530 con 0x7f78d414e410 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d27fc640 1 -- 172.21.15.81:0/4213348526 >> v1:172.21.15.117:6789/0 conn(0x7f78d4159790 legacy=0x7f78d415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d27fc640 1 -- 172.21.15.81:0/4213348526 >> v1:172.21.15.81:6789/0 conn(0x7f78d414e410 legacy=0x7f78d40aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.570+0000 7f78d27fc640 1 -- 172.21.15.81:0/4213348526 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40a9560 con 0x7f78d406afd0 2024-05-08T20:28:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d27fc640 1 --2- 172.21.15.81:0/4213348526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d406afd0 0x7f78d406b460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78c800a960 tx=0x7f78c801d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1a1117ec49ff74 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d1ffb640 1 -- 172.21.15.81:0/4213348526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80a67e0 con 0x7f78d406afd0 2024-05-08T20:28:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d1ffb640 1 -- 172.21.15.81:0/4213348526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c80a6940 con 0x7f78d406afd0 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d1ffb640 1 -- 172.21.15.81:0/4213348526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80a6cb0 con 0x7f78d406afd0 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- 172.21.15.81:0/4213348526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d406afd0 msgr2=0x7f78d406b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 --2- 172.21.15.81:0/4213348526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d406afd0 0x7f78d406b460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f78c800a960 tx=0x7f78c801d7b0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- 172.21.15.81:0/4213348526 shutdown_connections 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 --2- 172.21.15.81:0/4213348526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d406afd0 0x7f78d406b460 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- 172.21.15.81:0/4213348526 >> 172.21.15.81:0/4213348526 conn(0x7f78d40c2ca0 msgr2=0x7f78d40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- 172.21.15.81:0/4213348526 shutdown_connections 2024-05-08T20:28:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- 172.21.15.81:0/4213348526 wait complete. 2024-05-08T20:28:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 Processor -- start 2024-05-08T20:28:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.574+0000 7f78d98b3640 1 -- start start 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d406afd0 0x7f78d41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 0x7f78d41ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d41ef3b0 con 0x7f78d414e410 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d41ee4c0 con 0x7f78d4159790 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d41ee7a0 con 0x7f78d406afd0 2024-05-08T20:28:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59130/0 (socket says 172.21.15.81:59130) 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 -- 172.21.15.81:0/422065991 learned_addr learned my addr 172.21.15.81:0/422065991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d2ffd640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d406afd0 0x7f78d41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d37fe640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 0x7f78d41ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 -- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d406afd0 msgr2=0x7f78d41574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d406afd0 0x7f78d41574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 -- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 msgr2=0x7f78d41ecbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 0x7f78d41ecbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 -- 172.21.15.81:0/422065991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c800a5c0 con 0x7f78d414e410 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d37fe640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 0x7f78d41ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d27fc640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78c8000c10 tx=0x7f78c801bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004240 con 0x7f78d414e410 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c80043a0 con 0x7f78d414e410 2024-05-08T20:28:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d41eea80 con 0x7f78d414e410 2024-05-08T20:28:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8003820 con 0x7f78d414e410 2024-05-08T20:28:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41ef040 con 0x7f78d414e410 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d41ef200 con 0x7f78d414e410 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f78c8003980 con 0x7f78d414e410 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 0x7f78c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f78c811ef40 con 0x7f78d414e410 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d2ffd640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 0x7f78c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.578+0000 7f78d2ffd640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 0x7f78c0068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78c40011f0 tx=0x7f78c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.582+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f78c80ebf20 con 0x7f78d414e410 2024-05-08T20:28:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78d406f1e0 con 0x7f78d414e410 2024-05-08T20:28:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78bbfff640 1 -- 172.21.15.81:0/422065991 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f78d406f1e0 con 0x7f78d414e410 2024-05-08T20:28:01.736 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 msgr2=0x7f78c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 0x7f78c0068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78c40011f0 tx=0x7f78c4009040 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 msgr2=0x7f78d41ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f78c8000c10 tx=0x7f78c801bff0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 shutdown_connections 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78c00666c0 0x7f78c0068b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d4159790 0x7f78d41ecbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d414e410 0x7f78d41ec6a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 --2- 172.21.15.81:0/422065991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d406afd0 0x7f78d41574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 >> 172.21.15.81:0/422065991 conn(0x7f78d40c2ca0 msgr2=0x7f78d4151270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 shutdown_connections 2024-05-08T20:28:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.730+0000 7f78d98b3640 1 -- 172.21.15.81:0/422065991 wait complete. 2024-05-08T20:28:01.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 Processor -- start 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 -- start start 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 0x7f04c40bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04c40bfef0 0x7f04c415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c40aa830 con 0x7f04c41521f0 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c4072900 con 0x7f04c40bfef0 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04caa29640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40c0640 con 0x7f04c41554e0 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c8fc6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f04c40bfef0 0x7f04c415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f04c41521f0 0x7f04c40c1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50622/0 (socket says 172.21.15.81:50622) 2024-05-08T20:28:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c3fff640 1 -- 172.21.15.81:0/3363581306 learned_addr learned my addr 172.21.15.81:0/3363581306 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c37fe640 1 --2- 172.21.15.81:0/3363581306 >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 0x7f04c40bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c8fc6640 1 -- 172.21.15.81:0/3363581306 >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 msgr2=0x7f04c40bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c8fc6640 1 --2- 172.21.15.81:0/3363581306 >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 0x7f04c40bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c8fc6640 1 -- 172.21.15.81:0/3363581306 >> v1:172.21.15.81:6789/0 conn(0x7f04c41521f0 legacy=0x7f04c40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c8fc6640 1 -- 172.21.15.81:0/3363581306 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4155970 con 0x7f04c40bfef0 2024-05-08T20:28:01.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.862+0000 7f04c37fe640 1 --2- 172.21.15.81:0/3363581306 >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 0x7f04c40bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c8fc6640 1 --2- 172.21.15.81:0/3363581306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c415f380 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f04c4072b30 tx=0x7f04bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8376df2bd4929ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c2ffd640 1 -- 172.21.15.81:0/3363581306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0a58e0 con 0x7f04c40bfef0 2024-05-08T20:28:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c2ffd640 1 -- 172.21.15.81:0/3363581306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc0a5a40 con 0x7f04c40bfef0 2024-05-08T20:28:01.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c2ffd640 1 -- 172.21.15.81:0/3363581306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0a5dd0 con 0x7f04c40bfef0 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- 172.21.15.81:0/3363581306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 msgr2=0x7f04c415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- 172.21.15.81:0/3363581306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c415f380 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f04c4072b30 tx=0x7f04bc01c930 comp rx=0 tx=0).stop 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- 172.21.15.81:0/3363581306 shutdown_connections 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- 172.21.15.81:0/3363581306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c415f380 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- 172.21.15.81:0/3363581306 >> v2:172.21.15.117:3300/0 conn(0x7f04c41554e0 0x7f04c40bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- 172.21.15.81:0/3363581306 >> 172.21.15.81:0/3363581306 conn(0x7f04c40c2ca0 msgr2=0x7f04c40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- 172.21.15.81:0/3363581306 shutdown_connections 2024-05-08T20:28:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- 172.21.15.81:0/3363581306 wait complete. 2024-05-08T20:28:01.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 Processor -- start 2024-05-08T20:28:01.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- start start 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c41521f0 0x7f04c4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c41554e0 0x7f04c406fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c406f200 con 0x7f04c40bfef0 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41edc80 con 0x7f04c41554e0 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04caa29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41edf60 con 0x7f04c41521f0 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59136/0 (socket says 172.21.15.81:59136) 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.866+0000 7f04c3fff640 1 -- 172.21.15.81:0/1918277198 learned_addr learned my addr 172.21.15.81:0/1918277198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 -- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c41521f0 msgr2=0x7f04c4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c41521f0 0x7f04c4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 -- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c41554e0 msgr2=0x7f04c406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c41554e0 0x7f04c406fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 -- 172.21.15.81:0/1918277198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009a70 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c3fff640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c420 tx=0x7f04b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005cf0 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4005e50 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c406f450 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40072f0 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4070e20 con 0x7f04c40bfef0 2024-05-08T20:28:01.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4074950 con 0x7f04c40bfef0 2024-05-08T20:28:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04b4007450 con 0x7f04c40bfef0 2024-05-08T20:28:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 0x7f04b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f04b4083a80 con 0x7f04c40bfef0 2024-05-08T20:28:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c37fe640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 0x7f04b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:01.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.870+0000 7f04c37fe640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 0x7f04b0068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04c41eb010 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:01.874+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f04b4050ae0 con 0x7f04c40bfef0 2024-05-08T20:28:02.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.030+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f04c406f900 con 0x7f04c40bfef0 2024-05-08T20:28:02.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.030+0000 7f04c0ff9640 1 -- 172.21.15.81:0/1918277198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f04b4017070 con 0x7f04c40bfef0 2024-05-08T20:28:02.038 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:28:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 msgr2=0x7f04b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 0x7f04b0068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f04c41eb010 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 msgr2=0x7f04c4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c420 tx=0x7f04b400c8e0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 shutdown_connections 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f04b0066690 0x7f04b0068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04c41554e0 0x7f04c406fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04c41521f0 0x7f04c4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 --2- 172.21.15.81:0/1918277198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c40bfef0 0x7f04c4071ab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 >> 172.21.15.81:0/1918277198 conn(0x7f04c40c2ca0 msgr2=0x7f04c41538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 shutdown_connections 2024-05-08T20:28:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.034+0000 7f04caa29640 1 -- 172.21.15.81:0/1918277198 wait complete. 2024-05-08T20:28:02.056 DEBUG:tasks.mon_thrash:Yielding 2024-05-08T20:28:02.056 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T20:28:02.068 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:28:02.068 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T20:28:02.068 INFO:tasks.workunit:timeout=3h 2024-05-08T20:28:02.068 INFO:tasks.workunit:cleanup=True 2024-05-08T20:28:02.069 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:28:02.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:28:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T20:28:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T20:28:02.075 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-08T20:28:02.075 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:28:02.076 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T20:28:02.076 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 20:27:18.869594676 +0000 2024-05-08T20:28:02.076 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 20:27:57.513794914 +0000 2024-05-08T20:28:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T20:28:02.076 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T20:28:02.076 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T20:28:02.136 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-08T20:28:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-08 20:27:27.957621147 +0000 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-08 20:27:57.575447603 +0000 2024-05-08T20:28:02.145 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-05-08T20:28:02.145 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-08T20:28:02.145 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-08T20:28:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 Processor -- start 2024-05-08T20:28:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 -- start start 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb254155670 0x7fb2540a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2540c47c0 0x7fb2540c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540c1730 con 0x7fb25406d130 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540c1a10 con 0x7fb254155670 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb25b10c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb254154980 con 0x7fb2540c47c0 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb254155670 0x7fb2540a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb2596a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2540c47c0 0x7fb2540c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb254155670 0x7fb2540a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54590/0 (socket says 172.21.15.81:54590) 2024-05-08T20:28:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb258ea8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb25406d130 0x7fb2540bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:56174/0 (socket says 172.21.15.81:56174) 2024-05-08T20:28:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 -- 172.21.15.81:0/1088858714 learned_addr learned my addr 172.21.15.81:0/1088858714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 -- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2540c47c0 msgr2=0x7fb2540c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:02.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 --2- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2540c47c0 0x7fb2540c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 -- 172.21.15.81:0/1088858714 >> v1:172.21.15.117:6789/0 conn(0x7fb25406d130 legacy=0x7fb2540bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.182+0000 7fb253fff640 1 -- 172.21.15.81:0/1088858714 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254154b90 con 0x7fb254155670 2024-05-08T20:28:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb253fff640 1 --2- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb254155670 0x7fb2540a5e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2480098a0 tx=0x7fb24801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d769a9a35a11b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb2537fe640 1 -- 172.21.15.81:0/1088858714 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480ab600 con 0x7fb254155670 2024-05-08T20:28:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb2537fe640 1 -- 172.21.15.81:0/1088858714 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2480a7050 con 0x7fb254155670 2024-05-08T20:28:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb2537fe640 1 -- 172.21.15.81:0/1088858714 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480ab980 con 0x7fb254155670 2024-05-08T20:28:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb254155670 msgr2=0x7fb2540a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 --2- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb254155670 0x7fb2540a5e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2480098a0 tx=0x7fb24801c540 comp rx=0 tx=0).stop 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- 172.21.15.81:0/1088858714 shutdown_connections 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 --2- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2540c47c0 0x7fb2540c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 --2- 172.21.15.81:0/1088858714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb254155670 0x7fb2540a5e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- 172.21.15.81:0/1088858714 >> 172.21.15.81:0/1088858714 conn(0x7fb2540c68c0 msgr2=0x7fb2540c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- 172.21.15.81:0/1088858714 shutdown_connections 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- 172.21.15.81:0/1088858714 wait complete. 2024-05-08T20:28:02.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 Processor -- start 2024-05-08T20:28:02.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.186+0000 7fb25b10c640 1 -- start start 2024-05-08T20:28:02.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 0x7fb2541f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 0x7fb2541f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb254155670 0x7fb25414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb254150b60 con 0x7fb25406d130 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540a6710 con 0x7fb2540c47c0 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541efda0 con 0x7fb254155670 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 0x7fb2541f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb253fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 0x7fb2541f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb253fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 0x7fb2541f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54602/0 (socket says 172.21.15.81:54602) 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb253fff640 1 -- 172.21.15.81:0/3423025259 learned_addr learned my addr 172.21.15.81:0/3423025259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2596a9640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb254155670 0x7fb25414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 -- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb254155670 msgr2=0x7fb25414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb254155670 0x7fb25414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 -- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 msgr2=0x7fb2541f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 0x7fb2541f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 -- 172.21.15.81:0/3423025259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480094d0 con 0x7fb25406d130 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb258ea8640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 0x7fb2541f06a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c7a0 tx=0x7fb24400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400a640 con 0x7fb25406d130 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400a7a0 con 0x7fb25406d130 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541f0020 con 0x7fb25406d130 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ab10 con 0x7fb25406d130 2024-05-08T20:28:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb254151050 con 0x7fb25406d130 2024-05-08T20:28:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb254074950 con 0x7fb25406d130 2024-05-08T20:28:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb24400ac70 con 0x7fb25406d130 2024-05-08T20:28:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 0x7fb240068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb2440840e0 con 0x7fb25406d130 2024-05-08T20:28:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.190+0000 7fb253fff640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 0x7fb240068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.194+0000 7fb253fff640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 0x7fb240068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb24801c580 tx=0x7fb2480a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.194+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb244051250 con 0x7fb25406d130 2024-05-08T20:28:02.206 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:28:02.207 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:28:02.212 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T20:28:02.258 INFO:tasks.workunit.client.1.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-08T20:28:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.390+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb254065d50 con 0x7fb25406d130 2024-05-08T20:28:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.390+0000 7fb2517fa640 1 -- 172.21.15.81:0/3423025259 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7fb244054870 con 0x7fb25406d130 2024-05-08T20:28:02.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:28:02.398 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:28:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:28:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 msgr2=0x7fb240068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 0x7fb240068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb24801c580 tx=0x7fb2480a6000 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 msgr2=0x7fb2541f06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 0x7fb2541f06a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c7a0 tx=0x7fb24400cc60 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 shutdown_connections 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb2400666c0 0x7fb240068b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb254155670 0x7fb25414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2540c47c0 0x7fb2541f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 --2- 172.21.15.81:0/3423025259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25406d130 0x7fb2541f06a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 >> 172.21.15.81:0/3423025259 conn(0x7fb2540c68c0 msgr2=0x7fb2540bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 shutdown_connections 2024-05-08T20:28:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.394+0000 7fb25b10c640 1 -- 172.21.15.81:0/3423025259 wait complete. 2024-05-08T20:28:02.417 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-05-08T20:28:02.417 INFO:tasks.mon_thrash.mon_thrasher:seed: 1715200080, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-05-08T20:28:02.417 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:28:02.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:28:02.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 Processor -- start 2024-05-08T20:28:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 -- start start 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b1814fe70 0x7f4b1806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b18152ab0 con 0x7f4b1806d7d0 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b18152d90 con 0x7f4b18155e90 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1f375640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b181528a0 con 0x7f4b1814fe70 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1d912640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4b1806d7d0 0x7f4b1806a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50628/0 (socket says 172.21.15.81:50628) 2024-05-08T20:28:02.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.574+0000 7f4b1d912640 1 -- 172.21.15.81:0/2784443720 learned_addr learned my addr 172.21.15.81:0/2784443720 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d111640 1 --2- 172.21.15.81:0/2784443720 >> v2:172.21.15.117:3300/0 conn(0x7f4b1814fe70 0x7f4b1806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211817929 0 0) 0x7f4b18152ab0 con 0x7f4b1806d7d0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b04003530 con 0x7f4b1806d7d0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413307959 0 0) 0x7f4b04003530 con 0x7f4b1806d7d0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 >> v2:172.21.15.117:3300/0 conn(0x7f4b1814fe70 msgr2=0x7f4b1806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 --2- 172.21.15.81:0/2784443720 >> v2:172.21.15.117:3300/0 conn(0x7f4b1814fe70 0x7f4b1806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 >> v1:172.21.15.117:6789/0 conn(0x7f4b18155e90 legacy=0x7f4b18069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18153070 con 0x7f4b1806d7d0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4b10001680 con 0x7f4b1806d7d0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 >> v1:172.21.15.81:6789/0 conn(0x7f4b1806d7d0 legacy=0x7f4b1806a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b04003980 0x7f4b04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040047d0 0x7f4b04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 0x7f4b0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181528a0 con 0x7f4b040052b0 2024-05-08T20:28:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400c180 con 0x7f4b04003980 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400c340 con 0x7f4b040047d0 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 0x7f4b0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1c910640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040047d0 0x7f4b04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 -- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040047d0 msgr2=0x7f4b04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040047d0 0x7f4b04004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 -- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b04003980 msgr2=0x7f4b04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d111640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b04003980 0x7f4b04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b04003980 0x7f4b04003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 -- 172.21.15.81:0/2784443720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04003530 con 0x7f4b040052b0 2024-05-08T20:28:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 -- 172.21.15.81:0/2784443720 reap_dead start 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1d912640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 0x7f4b0400b990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c210 tx=0x7f4b1001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f90a342238f6e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100a5af0 con 0x7f4b040052b0 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b100a5c70 con 0x7f4b040052b0 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b0ffff640 1 -- 172.21.15.81:0/2784443720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100058e0 con 0x7f4b040052b0 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 -- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 msgr2=0x7f4b0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 0x7f4b0400b990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c210 tx=0x7f4b1001cc10 comp rx=0 tx=0).stop 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 -- 172.21.15.81:0/2784443720 shutdown_connections 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 --2- 172.21.15.81:0/2784443720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040052b0 0x7f4b0400b990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 -- 172.21.15.81:0/2784443720 >> 172.21.15.81:0/2784443720 conn(0x7f4b180c71b0 msgr2=0x7f4b180c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 -- 172.21.15.81:0/2784443720 shutdown_connections 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.578+0000 7f4b1f375640 1 -- 172.21.15.81:0/2784443720 wait complete. 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 Processor -- start 2024-05-08T20:28:02.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- start start 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040052b0 0x7f4b1813f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b18150710 0x7f4b18150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181eefe0 con 0x7f4b1813d950 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1806b4f0 con 0x7f4b18150710 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c4da0 con 0x7f4b040052b0 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59164/0 (socket says 172.21.15.81:59164) 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 -- 172.21.15.81:0/3545291402 learned_addr learned my addr 172.21.15.81:0/3545291402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1d912640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b18150710 0x7f4b18150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1d111640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040052b0 0x7f4b1813f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 -- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040052b0 msgr2=0x7f4b1813f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040052b0 0x7f4b1813f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 -- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b18150710 msgr2=0x7f4b18150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b18150710 0x7f4b18150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 -- 172.21.15.81:0/3545291402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b181eea40 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1c910640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d8e0 tx=0x7f4b1400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14003db0 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14005070 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1813e2f0 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14005400 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b180c4fb0 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b14005560 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.582+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180675e0 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.586+0000 7f4b0dffb640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 0x7f4afc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.586+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4b14084780 con 0x7f4b1813d950 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.586+0000 7f4b1d111640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 0x7f4afc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.586+0000 7f4b1d111640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 0x7f4afc068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009a30 tx=0x7f4b08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.590+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4b14051630 con 0x7f4b1813d950 2024-05-08T20:28:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4b18074950 con 0x7f4b1813d950 2024-05-08T20:28:02.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b0dffb640 1 -- 172.21.15.81:0/3545291402 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f4b14053560 con 0x7f4b1813d950 2024-05-08T20:28:02.804 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":68,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:28:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 msgr2=0x7f4afc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 0x7f4afc068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009a30 tx=0x7f4b08008040 comp rx=0 tx=0).stop 2024-05-08T20:28:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 msgr2=0x7f4b1813ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d8e0 tx=0x7f4b1400dda0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 shutdown_connections 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4afc066690 0x7f4afc068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b18150710 0x7f4b18150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b1813d950 0x7f4b1813ddb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 --2- 172.21.15.81:0/3545291402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b040052b0 0x7f4b1813f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 >> 172.21.15.81:0/3545291402 conn(0x7f4b180c71b0 msgr2=0x7f4b180c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 shutdown_connections 2024-05-08T20:28:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.798+0000 7f4b1f375640 1 -- 172.21.15.81:0/3545291402 wait complete. 2024-05-08T20:28:02.821 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:28:02.821 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:28:02.821 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:28:02.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:28:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 Processor -- start 2024-05-08T20:28:02.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 -- start start 2024-05-08T20:28:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 0x7f91480c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914814e830 con 0x7f91480c6410 2024-05-08T20:28:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914806d6a0 con 0x7f9148155070 2024-05-08T20:28:02.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f914d76a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148151900 con 0x7f914806b840 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f9146ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 0x7f91480c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:32998/0 (socket says 172.21.15.81:32998) 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f9146ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 0x7f91480c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54650/0 (socket says 172.21.15.81:54650) 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 -- 172.21.15.81:0/4011526177 learned_addr learned my addr 172.21.15.81:0/4011526177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91467fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f91480c6410 0x7f91480c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:56200/0 (socket says 172.21.15.81:56200) 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 -- 172.21.15.81:0/4011526177 >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 msgr2=0x7f91480c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 --2- 172.21.15.81:0/4011526177 >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 0x7f91480c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 -- 172.21.15.81:0/4011526177 >> v1:172.21.15.117:6789/0 conn(0x7f91480c6410 legacy=0x7f91480c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.930+0000 7f91477fe640 1 -- 172.21.15.81:0/4011526177 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148151be0 con 0x7f914806b840 2024-05-08T20:28:02.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f91477fe640 1 --2- 172.21.15.81:0/4011526177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f914000aa10 tx=0x7f914001d930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec64ba2de06a756 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f9145ffb640 1 -- 172.21.15.81:0/4011526177 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400a6860 con 0x7f914806b840 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f9145ffb640 1 -- 172.21.15.81:0/4011526177 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400a69c0 con 0x7f914806b840 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f9145ffb640 1 -- 172.21.15.81:0/4011526177 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400a6d50 con 0x7f914806b840 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- 172.21.15.81:0/4011526177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 msgr2=0x7f914815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 --2- 172.21.15.81:0/4011526177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f914000aa10 tx=0x7f914001d930 comp rx=0 tx=0).stop 2024-05-08T20:28:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- 172.21.15.81:0/4011526177 shutdown_connections 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 --2- 172.21.15.81:0/4011526177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f914815b6d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 --2- 172.21.15.81:0/4011526177 >> v2:172.21.15.117:3300/0 conn(0x7f9148155070 0x7f91480c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- 172.21.15.81:0/4011526177 >> 172.21.15.81:0/4011526177 conn(0x7f91480c68c0 msgr2=0x7f91480c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- 172.21.15.81:0/4011526177 shutdown_connections 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- 172.21.15.81:0/4011526177 wait complete. 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 Processor -- start 2024-05-08T20:28:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.934+0000 7f914d76a640 1 -- start start 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f91480a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91480c6410 0x7f91481e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 0x7f91481e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480701b0 con 0x7f9148155070 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480a7c40 con 0x7f91480c6410 2024-05-08T20:28:02.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91480a7f20 con 0x7f914806b840 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 0x7f91481e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 0x7f91481e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59170/0 (socket says 172.21.15.81:59170) 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 learned_addr learned my addr 172.21.15.81:0/3723057440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f9146ffd640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f91480a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91467fc640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91480c6410 0x7f91481e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 msgr2=0x7f91480a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f914806b840 0x7f91480a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91480c6410 msgr2=0x7f91481e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91480c6410 0x7f91481e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914000a670 con 0x7f9148155070 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91467fc640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91480c6410 0x7f91481e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91477fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 0x7f91481e94c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f914000a1c0 tx=0x7f914001a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400ae850 con 0x7f9148155070 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400ae9b0 con 0x7f9148155070 2024-05-08T20:28:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914806fb60 con 0x7f9148155070 2024-05-08T20:28:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400aed40 con 0x7f9148155070 2024-05-08T20:28:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91480a9ed0 con 0x7f9148155070 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 0x7f9148148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148069550 con 0x7f9148070620 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f9146ffd640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 0x7f9148148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f9146ffd640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f914815dc20 con 0x7f9148070620 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f9146ffd640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 0x7f9148148a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9138011510 tx=0x7f91380119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91400b63f0 con 0x7f9148155070 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9134066690 0x7f9134068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f914011e8c0 con 0x7f9148155070 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91467fc640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9134066690 0x7f9134068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138004230 con 0x7f9148070620 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9138004390 con 0x7f9148070620 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 msgr2=0x7f9148148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 0x7f9148148a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9138011510 tx=0x7f91380119d0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 msgr2=0x7f9148148a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f912f7fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148070620 0x7f9148148a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.938+0000 7f91467fc640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9134066690 0x7f9134068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f914815b8b0 tx=0x7f913c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 0x7f91481ec570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480a80b0 con 0x7f9148148f60 2024-05-08T20:28:02.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f9146ffd640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 0x7f91481ec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f9146ffd640 1 -- 172.21.15.81:0/3723057440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9148074950 con 0x7f9148148f60 2024-05-08T20:28:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f9146ffd640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 0x7f91481ec570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9138011510 tx=0x7f91380046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:02.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138024070 con 0x7f9148148f60 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f9138003830 con 0x7f9148148f60 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 msgr2=0x7f91481ec570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 0x7f91481ec570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9138011510 tx=0x7f91380046d0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 msgr2=0x7f91481ec570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f912f7fe640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148148f60 0x7f91481ec570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:28:02.954 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 4, 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 68, 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:02.955 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:02.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:28:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:28:02.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:02.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:02.961 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:02.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.966 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:02.967 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:28:02.968 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:28:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9134066690 msgr2=0x7f9134068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9134066690 0x7f9134068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f914815b8b0 tx=0x7f913c009040 comp rx=0 tx=0).stop 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 msgr2=0x7f91481e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 --2- 172.21.15.81:0/3723057440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9148155070 0x7f91481e94c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f914000a1c0 tx=0x7f914001a6d0 comp rx=0 tx=0).stop 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 reap_dead start 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f91477fe640 1 -- 172.21.15.81:0/3723057440 reap_dead start 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 shutdown_connections 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 >> 172.21.15.81:0/3723057440 conn(0x7f91480c68c0 msgr2=0x7f91480c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 shutdown_connections 2024-05-08T20:28:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:02.946+0000 7f914d76a640 1 -- 172.21.15.81:0/3723057440 wait complete. 2024-05-08T20:28:02.970 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:28:02.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:28:02.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:28:03.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.074+0000 7ff8b31cb640 1 Processor -- start 2024-05-08T20:28:03.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.074+0000 7ff8b31cb640 1 -- start start 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b31cb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8ac1501e0 0x7ff8ac06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b31cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac06f400 0x7ff8ac0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b31cb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0c0650 con 0x7ff8ac0725f0 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b31cb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac06fd60 con 0x7ff8ac1501e0 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b31cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac072180 con 0x7ff8ac06f400 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8ac1501e0 0x7ff8ac06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8ac1501e0 0x7ff8ac06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59212/0 (socket says 172.21.15.81:59212) 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 -- 172.21.15.81:0/3933711536 learned_addr learned my addr 172.21.15.81:0/3933711536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b1768640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac06f400 0x7ff8ac0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 -- 172.21.15.81:0/3933711536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac06f400 msgr2=0x7ff8ac0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac06f400 0x7ff8ac0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 -- 172.21.15.81:0/3933711536 >> v1:172.21.15.117:6789/0 conn(0x7ff8ac0725f0 legacy=0x7ff8ac0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.078+0000 7ff8b0f67640 1 -- 172.21.15.81:0/3933711536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac06fa80 con 0x7ff8ac1501e0 2024-05-08T20:28:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac1501e0 0x7ff8ac06c930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009870 tx=0x7ff8a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b242bf7c2f4a91e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8ab7fe640 1 -- 172.21.15.81:0/3933711536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a7070 con 0x7ff8ac1501e0 2024-05-08T20:28:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8ab7fe640 1 -- 172.21.15.81:0/3933711536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00ab430 con 0x7ff8ac1501e0 2024-05-08T20:28:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8ab7fe640 1 -- 172.21.15.81:0/3933711536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00ab7c0 con 0x7ff8ac1501e0 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- 172.21.15.81:0/3933711536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac1501e0 msgr2=0x7ff8ac06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac1501e0 0x7ff8ac06c930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009870 tx=0x7ff8a001c410 comp rx=0 tx=0).stop 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- 172.21.15.81:0/3933711536 shutdown_connections 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac06f400 0x7ff8ac0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/3933711536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac1501e0 0x7ff8ac06c930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- 172.21.15.81:0/3933711536 >> 172.21.15.81:0/3933711536 conn(0x7ff8ac0c2ca0 msgr2=0x7ff8ac0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- 172.21.15.81:0/3933711536 shutdown_connections 2024-05-08T20:28:03.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- 172.21.15.81:0/3933711536 wait complete. 2024-05-08T20:28:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 Processor -- start 2024-05-08T20:28:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.082+0000 7ff8b31cb640 1 -- start start 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac06f400 0x7ff8ac1ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 0x7ff8ac0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac1501e0 0x7ff8ac0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c3e00 con 0x7ff8ac0725f0 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0a9e60 con 0x7ff8ac06f400 2024-05-08T20:28:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac1ed830 con 0x7ff8ac1501e0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 0x7ff8ac0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 0x7ff8ac0bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59226/0 (socket says 172.21.15.81:59226) 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 -- 172.21.15.81:0/1104526392 learned_addr learned my addr 172.21.15.81:0/1104526392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac06f400 0x7ff8ac1ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b1768640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac1501e0 0x7ff8ac0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac1501e0 msgr2=0x7ff8ac0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac1501e0 0x7ff8ac0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac06f400 msgr2=0x7ff8ac1ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac06f400 0x7ff8ac1ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00094d0 con 0x7ff8ac0725f0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b1768640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8ac1501e0 0x7ff8ac0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8abfff640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 0x7ff8ac0bf830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c3c0 tx=0x7ff89c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0052d0 con 0x7ff8ac0725f0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c005430 con 0x7ff8ac0725f0 2024-05-08T20:28:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac150740 con 0x7ff8ac0725f0 2024-05-08T20:28:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c003840 con 0x7ff8ac0725f0 2024-05-08T20:28:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac0aa0a0 con 0x7ff8ac0725f0 2024-05-08T20:28:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 0x7ff8ac0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0696e0 con 0x7ff8ac0aadd0 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 0x7ff8ac0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff89c0039a0 con 0x7ff8ac0725f0 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff898066690 0x7ff898068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b0f67640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8ac1505c0 con 0x7ff8ac0aadd0 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b1768640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff898066690 0x7ff898068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff89c0839d0 con 0x7ff8ac0725f0 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 0x7ff8ac0aa3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac06f1b0 tx=0x7ff8a001ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8b1768640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff898066690 0x7ff898068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009ed0 tx=0x7ff8a400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.086+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00abe20 con 0x7ff8ac0aadd0 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.090+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff8a00b8070 con 0x7ff8ac0aadd0 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.090+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 msgr2=0x7ff8ac0aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.090+0000 7ff8a97fa640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 0x7ff8ac0aa3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac06f1b0 tx=0x7ff8a001ac50 comp rx=0 tx=0).stop 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.090+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 msgr2=0x7ff8ac0aa3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.090+0000 7ff8a97fa640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0aadd0 0x7ff8ac0aa3b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 0x7ff8ac14b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac15fb20 con 0x7ff8ac0c4760 2024-05-08T20:28:03.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 0x7ff8ac14b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8b0f67640 1 -- 172.21.15.81:0/1104526392 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff8ac0c55e0 con 0x7ff8ac0c4760 2024-05-08T20:28:03.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8b0f67640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 0x7ff8ac14b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009870 tx=0x7ff8a00191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.094+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0003d80 con 0x7ff8ac0c4760 2024-05-08T20:28:03.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7ff8a00c5680 con 0x7ff8ac0c4760 2024-05-08T20:28:03.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 msgr2=0x7ff8ac14b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8a97fa640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 0x7ff8ac14b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009870 tx=0x7ff8a00191b0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8a97fa640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 msgr2=0x7ff8ac14b410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8a97fa640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8ac0c4760 0x7ff8ac14b410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 4, 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:28:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 68, 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:28:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.115 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.116 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:28:03.117 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:28:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff898066690 msgr2=0x7ff898068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff898066690 0x7ff898068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009ed0 tx=0x7ff8a400b040 comp rx=0 tx=0).stop 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 msgr2=0x7ff8ac0bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 --2- 172.21.15.81:0/1104526392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac0725f0 0x7ff8ac0bf830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c3c0 tx=0x7ff89c00c880 comp rx=0 tx=0).stop 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b1768640 1 -- 172.21.15.81:0/1104526392 reap_dead start 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b1768640 1 -- 172.21.15.81:0/1104526392 reap_dead start 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 shutdown_connections 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 >> 172.21.15.81:0/1104526392 conn(0x7ff8ac0c2ca0 msgr2=0x7ff8ac151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 shutdown_connections 2024-05-08T20:28:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.098+0000 7ff8b31cb640 1 -- 172.21.15.81:0/1104526392 wait complete. 2024-05-08T20:28:03.120 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:28:03.120 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:28:03.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:28:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 Processor -- start 2024-05-08T20:28:03.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 -- start start 2024-05-08T20:28:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc0a9bc0 con 0x7f0efc14fdb0 2024-05-08T20:28:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc150190 con 0x7f0efc0c3190 2024-05-08T20:28:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f03556640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0c4730 con 0x7f0efc06f320 2024-05-08T20:28:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f012f2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0efc14fdb0 0x7f0efc0a94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50644/0 (socket says 172.21.15.81:50644) 2024-05-08T20:28:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f012f2640 1 -- 172.21.15.81:0/525447891 learned_addr learned my addr 172.21.15.81:0/525447891 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f00af1640 1 --2- 172.21.15.81:0/525447891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536467509 0 0) 0x7f0efc0a9bc0 con 0x7f0efc14fdb0 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee8003530 con 0x7f0efc14fdb0 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923225205 0 0) 0x7f0efc150190 con 0x7f0efc0c3190 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0efc0a9bc0 con 0x7f0efc0c3190 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f00af1640 1 -- 172.21.15.81:0/525447891 >> v1:172.21.15.117:6789/0 conn(0x7f0efc0c3190 legacy=0x7f0efc0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f00af1640 1 -- 172.21.15.81:0/525447891 >> v1:172.21.15.81:6789/0 conn(0x7f0efc14fdb0 legacy=0x7f0efc0a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.226+0000 7f0f00af1640 1 -- 172.21.15.81:0/525447891 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc152870 con 0x7f0efc06f320 2024-05-08T20:28:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f00af1640 1 --2- 172.21.15.81:0/525447891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc153350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097f0 tx=0x7f0ef001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de01d5539cb51a7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00a8050 con 0x7f0efc06f320 2024-05-08T20:28:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef00ac5f0 con 0x7f0efc06f320 2024-05-08T20:28:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0eeffff640 1 -- 172.21.15.81:0/525447891 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00ac960 con 0x7f0efc06f320 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 -- 172.21.15.81:0/525447891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 msgr2=0x7f0efc153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 --2- 172.21.15.81:0/525447891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc153350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097f0 tx=0x7f0ef001c390 comp rx=0 tx=0).stop 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 -- 172.21.15.81:0/525447891 shutdown_connections 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 --2- 172.21.15.81:0/525447891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc153350 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 -- 172.21.15.81:0/525447891 >> 172.21.15.81:0/525447891 conn(0x7f0efc0c4e30 msgr2=0x7f0efc0c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 -- 172.21.15.81:0/525447891 shutdown_connections 2024-05-08T20:28:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.230+0000 7f0f03556640 1 -- 172.21.15.81:0/525447891 wait complete. 2024-05-08T20:28:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 Processor -- start 2024-05-08T20:28:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- start start 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 0x7f0efc0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0efc14fdb0 0x7f0efc13d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13cc80 0x7f0efc13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc1eacb0 con 0x7f0efc0c3190 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0c7ff0 con 0x7f0efc14fdb0 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc1eb4d0 con 0x7f0efc13cc80 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 0x7f0efc0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 0x7f0efc0c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59238/0 (socket says 172.21.15.81:59238) 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 -- 172.21.15.81:0/1426137791 learned_addr learned my addr 172.21.15.81:0/1426137791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f01af3640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13cc80 0x7f0efc13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f00af1640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0efc14fdb0 0x7f0efc13d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13cc80 msgr2=0x7f0efc13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13cc80 0x7f0efc13e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0efc14fdb0 msgr2=0x7f0efc13d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0efc14fdb0 0x7f0efc13d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009420 con 0x7f0efc0c3190 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f01af3640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13cc80 0x7f0efc13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f012f2640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 0x7f0efc0c74b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c500 tx=0x7f0ef800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8005cf0 con 0x7f0efc0c3190 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8005e50 con 0x7f0efc0c3190 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc1eaec0 con 0x7f0efc0c3190 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8007310 con 0x7f0efc0c3190 2024-05-08T20:28:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc1eb160 con 0x7f0efc0c3190 2024-05-08T20:28:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc073f10 con 0x7f0efc06f320 2024-05-08T20:28:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0f00af1640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.234+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ef8007470 con 0x7f0efc0c3190 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ee0066690 0x7f0ee0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0f00af1640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0efc0a9a50 con 0x7f0efc06f320 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0ef8083b60 con 0x7f0efc0c3190 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0f01af3640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ee0066690 0x7f0ee0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0f00af1640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc14b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0c93d0 tx=0x7f0ef0019130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0f01af3640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ee0066690 0x7f0ee0068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001570 tx=0x7f0ef4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00a8040 con 0x7f0efc06f320 2024-05-08T20:28:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f0ef0006e20 con 0x7f0efc06f320 2024-05-08T20:28:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 msgr2=0x7f0efc14b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc14b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0c93d0 tx=0x7f0ef0019130 comp rx=0 tx=0).stop 2024-05-08T20:28:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 msgr2=0x7f0efc14b6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.238+0000 7f0eedffb640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc06f320 0x7f0efc14b6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.242+0000 7f0f03556640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 0x7f0efc14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:03.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.242+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc1eb640 con 0x7f0efc13d740 2024-05-08T20:28:03.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.242+0000 7f0f00af1640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 0x7f0efc14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f00af1640 1 -- 172.21.15.81:0/1426137791 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0efc0c4420 con 0x7f0efc13d740 2024-05-08T20:28:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f00af1640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 0x7f0efc14bc00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009740 tx=0x7f0ef00a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00039a0 con 0x7f0efc13d740 2024-05-08T20:28:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f0ef0003b00 con 0x7f0efc13d740 2024-05-08T20:28:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 msgr2=0x7f0efc14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 0x7f0efc14bc00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009740 tx=0x7f0ef00a9000 comp rx=0 tx=0).stop 2024-05-08T20:28:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 msgr2=0x7f0efc14bc00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0eedffb640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0efc13d740 0x7f0efc14bc00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 4, 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 68, 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:28:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:28:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:28:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:28:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:28:03.264 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ee0066690 msgr2=0x7f0ee0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ee0066690 0x7f0ee0068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001570 tx=0x7f0ef4009040 comp rx=0 tx=0).stop 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 msgr2=0x7f0efc0c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 --2- 172.21.15.81:0/1426137791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0efc0c3190 0x7f0efc0c74b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800c500 tx=0x7f0ef800c9c0 comp rx=0 tx=0).stop 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f01af3640 1 -- 172.21.15.81:0/1426137791 reap_dead start 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f01af3640 1 -- 172.21.15.81:0/1426137791 reap_dead start 2024-05-08T20:28:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 shutdown_connections 2024-05-08T20:28:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 >> 172.21.15.81:0/1426137791 conn(0x7f0efc0c4e30 msgr2=0x7f0efc0a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 shutdown_connections 2024-05-08T20:28:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:03.246+0000 7f0f03556640 1 -- 172.21.15.81:0/1426137791 wait complete. 2024-05-08T20:28:03.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:28:03.269 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:28:03.269 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-05-08T20:28:03.269 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:28:03.269 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:28:03.269 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:28:03.269 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:28:03.293 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:28:03.293 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:28:03.293 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:28:03.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:28:18.294 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:28:18.295 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:28:18.295 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:28:18.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:28:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 Processor -- start 2024-05-08T20:28:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 -- start start 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0c0650 con 0x7f799c0725f0 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c06fd60 con 0x7f799c06f400 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f79a1fdd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c072180 con 0x7f799c1501e0 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f799bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f799bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39926/0 (socket says 172.21.15.81:39926) 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.413+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 learned_addr learned my addr 172.21.15.81:0/3811844813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.417+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:28:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:18.621+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:28:18.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:28:18.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.025+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:19.829+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:28:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 msgr2=0x7f799c06c930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:28:21.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.117:3300/0 conn(0x7f799c1501e0 0x7f799c06c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 -- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 msgr2=0x7f799c0c2350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 --2- 172.21.15.81:0/3811844813 >> v2:172.21.15.81:3300/0 conn(0x7f799c06f400 0x7f799c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 -- 172.21.15.81:0/3811844813 >> v1:172.21.15.117:6789/0 conn(0x7f799c0725f0 legacy=0x7f799c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.413+0000 7f79997fa640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.417+0000 7f79997fa640 1 -- 172.21.15.81:0/3811844813 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c06fa80 con 0x7f7988006200 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.417+0000 7f79997fa640 1 -- 172.21.15.81:0/3811844813 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c06fd60 con 0x7f79880036c0 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.417+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 msgr2=0x7f7988005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.417+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.621+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 msgr2=0x7f7988005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:21.621+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:28:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:22.025+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 msgr2=0x7f7988005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:22.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:22.025+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:28:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:22.829+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 msgr2=0x7f7988005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:22.829+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:28:23.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397720394 0 0) 0x7f799c06fa80 con 0x7f7988006200 2024-05-08T20:28:23.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7984003530 con 0x7f7988006200 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157711302 0 0) 0x7f7984003530 con 0x7f7988006200 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 msgr2=0x7f7988005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79880036c0 0x7f7988005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798800b000 con 0x7f7988006200 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f798c0016c0 con 0x7f7988006200 2024-05-08T20:28:23.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.349+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 >> v1:172.21.15.81:6789/0 conn(0x7f7988006200 legacy=0x7f79880086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799bfff640 1 -- 172.21.15.81:0/3811844813 reap_dead start 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f7984003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f7984004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f798400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c06fd60 con 0x7f79840047d0 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798400c200 con 0x7f79840052b0 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798400c3c0 con 0x7f7984003980 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799b7fe640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 msgr2=0x7f7984003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f7984003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f7984004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799bfff640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f798400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 msgr2=0x7f7984003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:28:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f7984003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 msgr2=0x7f798400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f798400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.353+0000 7f799affd640 1 -- 172.21.15.81:0/3811844813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984003530 con 0x7f79840047d0 2024-05-08T20:28:23.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f799affd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f7984004c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f798c007e70 tx=0x7f798c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66170133c8456459 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a55b0 con 0x7f79840047d0 2024-05-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0a5730 con 0x7f79840047d0 2024-05-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f799a7fc640 1 -- 172.21.15.81:0/3811844813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a5ae0 con 0x7f79840047d0 2024-05-08T20:28:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 msgr2=0x7f7984004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f7984004c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f798c007e70 tx=0x7f798c01c9b0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3811844813 shutdown_connections 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f798400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f7984004c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3811844813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f7984003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3811844813 >> 172.21.15.81:0/3811844813 conn(0x7f799c0c2ca0 msgr2=0x7f799c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3811844813 shutdown_connections 2024-05-08T20:28:23.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.357+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3811844813 wait complete. 2024-05-08T20:28:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 Processor -- start 2024-05-08T20:28:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 -- start start 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f799c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f799c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c142de0 con 0x7f79840047d0 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1563c0 con 0x7f79840052b0 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f79a1fdd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c154390 con 0x7f7984003980 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f799b7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 msgr2=0x7f799c153cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f799b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f799c153cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f799affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f799affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55686/0 (socket says 172.21.15.81:55686) 2024-05-08T20:28:23.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.361+0000 7f799affd640 1 -- 172.21.15.81:0/3854934858 learned_addr learned my addr 172.21.15.81:0/3854934858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799bfff640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f799c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 -- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 msgr2=0x7f799c153cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f799c153cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 -- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 msgr2=0x7f799c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f799c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 -- 172.21.15.81:0/3854934858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c155d70 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799affd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f798c007e70 tx=0x7f798c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0bd070 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0a59e0 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0a5d70 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c156050 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c152020 con 0x7f79840047d0 2024-05-08T20:28:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c155bd0 con 0x7f79840047d0 2024-05-08T20:28:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f798c0b4070 con 0x7f79840047d0 2024-05-08T20:28:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 0x7f79880694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f798c11db80 con 0x7f79840047d0 2024-05-08T20:28:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.365+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 0x7f79880694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.369+0000 7f799b7fe640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 0x7f79880694f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f799000e1f0 tx=0x7f7990006de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.369+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f799c155bd0 con 0x7f79840047d0 2024-05-08T20:28:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f799c155bd0 con 0x7f79840047d0 2024-05-08T20:28:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f7983fff640 1 -- 172.21.15.81:0/3854934858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f799c155bd0 con 0x7f79840047d0 2024-05-08T20:28:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":6,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:28:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 msgr2=0x7f79880694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 0x7f79880694f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f799000e1f0 tx=0x7f7990006de0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 msgr2=0x7f799c1428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f798c007e70 tx=0x7f798c019750 comp rx=0 tx=0).stop 2024-05-08T20:28:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 shutdown_connections 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7988067030 0x7f79880694f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840052b0 0x7f799c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79840047d0 0x7f799c1428a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 --2- 172.21.15.81:0/3854934858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7984003980 0x7f799c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 >> 172.21.15.81:0/3854934858 conn(0x7f799c0c2ca0 msgr2=0x7f799c14cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 shutdown_connections 2024-05-08T20:28:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.585+0000 7f79a1fdd640 1 -- 172.21.15.81:0/3854934858 wait complete. 2024-05-08T20:28:23.611 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:28:23.611 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:28:23.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:28:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 Processor -- start 2024-05-08T20:28:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 -- start start 2024-05-08T20:28:23.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c080c1bb0 0x7f1c08151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 0x7f1c0815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c080c2420 con 0x7f1c080c1f90 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c08155060 con 0x7f1c080c1bb0 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0ed2b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c08155340 con 0x7f1c081535a0 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c080c1bb0 0x7f1c08151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c080c1bb0 0x7f1c08151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55702/0 (socket says 172.21.15.81:55702) 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 -- 172.21.15.81:0/451290245 learned_addr learned my addr 172.21.15.81:0/451290245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0d2c8640 1 --2- 172.21.15.81:0/451290245 >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 0x7f1c0815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 -- 172.21.15.81:0/451290245 >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 msgr2=0x7f1c0815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 --2- 172.21.15.81:0/451290245 >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 0x7f1c0815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 -- 172.21.15.81:0/451290245 >> v1:172.21.15.117:6789/0 conn(0x7f1c080c1f90 legacy=0x7f1c08152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0cac7640 1 -- 172.21.15.81:0/451290245 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08155620 con 0x7f1c080c1bb0 2024-05-08T20:28:23.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.717+0000 7f1c0d2c8640 1 --2- 172.21.15.81:0/451290245 >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 0x7f1c0815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:23.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0cac7640 1 --2- 172.21.15.81:0/451290245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c08151740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c0806f190 tx=0x7f1bfc01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c6a03d656a83b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c077fe640 1 -- 172.21.15.81:0/451290245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0a7aa0 con 0x7f1c080c1bb0 2024-05-08T20:28:23.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c077fe640 1 -- 172.21.15.81:0/451290245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0a7c00 con 0x7f1c080c1bb0 2024-05-08T20:28:23.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c077fe640 1 -- 172.21.15.81:0/451290245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0af440 con 0x7f1c080c1bb0 2024-05-08T20:28:23.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/451290245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 msgr2=0x7f1c08151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/451290245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c08151740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c0806f190 tx=0x7f1bfc01eaf0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/451290245 shutdown_connections 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/451290245 >> v2:172.21.15.117:3300/0 conn(0x7f1c081535a0 0x7f1c0815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/451290245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c08151740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/451290245 >> 172.21.15.81:0/451290245 conn(0x7f1c080c2ca0 msgr2=0x7f1c080c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/451290245 shutdown_connections 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/451290245 wait complete. 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 Processor -- start 2024-05-08T20:28:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- start start 2024-05-08T20:28:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c080bb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080c1f90 0x7f1c08148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c081535a0 0x7f1c080aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0814c710 con 0x7f1c080c1bb0 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0814c960 con 0x7f1c080c1f90 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.721+0000 7f1c0ed2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0814cc40 con 0x7f1c081535a0 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c080bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c080bb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55710/0 (socket says 172.21.15.81:55710) 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 -- 172.21.15.81:0/330350190 learned_addr learned my addr 172.21.15.81:0/330350190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0d2c8640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c081535a0 msgr2=0x7f1c080aaa30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0d2c8640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c081535a0 0x7f1c080aaa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c081535a0 msgr2=0x7f1c080aaa30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c081535a0 0x7f1c080aaa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080c1f90 msgr2=0x7f1c08148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c07fff640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080c1f90 0x7f1c08148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c080c1f90 0x7f1c08148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc00b770 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0cac7640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c080bb950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00b2c0 tx=0x7f1bfc01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0afea0 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0ba420 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0814cf20 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0ba7d0 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c08150650 con 0x7f1c080c1bb0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 0x7f1c08147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080c29a0 con 0x7f1c080c25c0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c07fff640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 0x7f1c08147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c07fff640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c0814cad0 con 0x7f1c080c25c0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c07fff640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 0x7f1c08147340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c08153d90 tx=0x7f1bf400d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4012800 con 0x7f1c080c25c0 2024-05-08T20:28:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bfc0b6040 con 0x7f1c080c1bb0 2024-05-08T20:28:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1bec066760 0x7f1bec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1bfc121710 con 0x7f1c080c1bb0 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0d2c8640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1bec066760 0x7f1bec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1bf4012960 con 0x7f1c080c25c0 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 msgr2=0x7f1c08147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 0x7f1c08147340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c08153d90 tx=0x7f1bf400d810 comp rx=0 tx=0).stop 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 msgr2=0x7f1c08147340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c057fa640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c25c0 0x7f1c08147340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.725+0000 7f1c0d2c8640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1bec066760 0x7f1bec068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c080bc0b0 tx=0x7f1c00007380 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 0x7f1c0814d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080696e0 con 0x7f1c08147880 2024-05-08T20:28:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c07fff640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 0x7f1c0814d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c07fff640 1 -- 172.21.15.81:0/330350190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1c0814d440 con 0x7f1c08147880 2024-05-08T20:28:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c07fff640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 0x7f1c0814d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c08153d90 tx=0x7f1bf4003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf401b830 con 0x7f1c08147880 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f1bf4027440 con 0x7f1c08147880 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 msgr2=0x7f1c0814d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 0x7f1c0814d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c08153d90 tx=0x7f1bf4003770 comp rx=0 tx=0).stop 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 msgr2=0x7f1c0814d720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c057fa640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c08147880 0x7f1c0814d720 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:28:23.741 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.742 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.743 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:23.744 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.747 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.748 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.749 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:28:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:28:23.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.752 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:28:23.753 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:28:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1bec066760 msgr2=0x7f1bec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1bec066760 0x7f1bec068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c080bc0b0 tx=0x7f1c00007380 comp rx=0 tx=0).stop 2024-05-08T20:28:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 msgr2=0x7f1c080bb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 --2- 172.21.15.81:0/330350190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c080c1bb0 0x7f1c080bb950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00b2c0 tx=0x7f1bfc01b890 comp rx=0 tx=0).stop 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0d2c8640 1 -- 172.21.15.81:0/330350190 reap_dead start 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0d2c8640 1 -- 172.21.15.81:0/330350190 reap_dead start 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 shutdown_connections 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 >> 172.21.15.81:0/330350190 conn(0x7f1c080c2ca0 msgr2=0x7f1c080c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 shutdown_connections 2024-05-08T20:28:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.733+0000 7f1c0ed2b640 1 -- 172.21.15.81:0/330350190 wait complete. 2024-05-08T20:28:23.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:28:23.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:28:23.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:28:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 Processor -- start 2024-05-08T20:28:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 -- start start 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8974151f00 0x7f89741588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89740ca000 0x7f89740ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8974158e20 con 0x7f8974154cf0 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897406bb20 con 0x7f89740ca000 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8979611640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89741548e0 con 0x7f8974151f00 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89740ca000 0x7f89740ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89740ca000 0x7f89740ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55742/0 (socket says 172.21.15.81:55742) 2024-05-08T20:28:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 -- 172.21.15.81:0/2243079236 learned_addr learned my addr 172.21.15.81:0/2243079236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f8972ffd640 1 --2- 172.21.15.81:0/2243079236 >> v2:172.21.15.117:3300/0 conn(0x7f8974151f00 0x7f89741588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 -- 172.21.15.81:0/2243079236 >> v2:172.21.15.117:3300/0 conn(0x7f8974151f00 msgr2=0x7f89741588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 --2- 172.21.15.81:0/2243079236 >> v2:172.21.15.117:3300/0 conn(0x7f8974151f00 0x7f89741588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 -- 172.21.15.81:0/2243079236 >> v1:172.21.15.117:6789/0 conn(0x7f8974154cf0 legacy=0x7f8974155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.861+0000 7f89737fe640 1 -- 172.21.15.81:0/2243079236 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974155860 con 0x7f89740ca000 2024-05-08T20:28:23.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f89737fe640 1 --2- 172.21.15.81:0/2243079236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f89740ca440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8974155a50 tx=0x7f896c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76be0a339256319 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8971ffb640 1 -- 172.21.15.81:0/2243079236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0a57b0 con 0x7f89740ca000 2024-05-08T20:28:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8971ffb640 1 -- 172.21.15.81:0/2243079236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c0a5910 con 0x7f89740ca000 2024-05-08T20:28:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8971ffb640 1 -- 172.21.15.81:0/2243079236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0a5ca0 con 0x7f89740ca000 2024-05-08T20:28:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- 172.21.15.81:0/2243079236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 msgr2=0x7f89740ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- 172.21.15.81:0/2243079236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f89740ca440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8974155a50 tx=0x7f896c01c8d0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- 172.21.15.81:0/2243079236 shutdown_connections 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- 172.21.15.81:0/2243079236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f89740ca440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- 172.21.15.81:0/2243079236 >> v2:172.21.15.117:3300/0 conn(0x7f8974151f00 0x7f89741588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- 172.21.15.81:0/2243079236 >> 172.21.15.81:0/2243079236 conn(0x7f89740715f0 msgr2=0x7f8974071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- 172.21.15.81:0/2243079236 shutdown_connections 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- 172.21.15.81:0/2243079236 wait complete. 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 Processor -- start 2024-05-08T20:28:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- start start 2024-05-08T20:28:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f8974148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974151f00 0x7f89741f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974154cf0 0x7f8974155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740aef30 con 0x7f89740ca000 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8974150510 con 0x7f8974154cf0 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8979611640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89741507f0 con 0x7f8974151f00 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8972ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f8974148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8972ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f8974148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55758/0 (socket says 172.21.15.81:55758) 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f8972ffd640 1 -- 172.21.15.81:0/1106191226 learned_addr learned my addr 172.21.15.81:0/1106191226 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f89727fc640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974151f00 msgr2=0x7f89741f0df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.865+0000 7f89727fc640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974151f00 0x7f89741f0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89737fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974154cf0 0x7f8974155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974151f00 msgr2=0x7f89741f0df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8974151f00 0x7f89741f0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974154cf0 msgr2=0x7f8974155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974154cf0 0x7f8974155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c009b30 con 0x7f89740ca000 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89737fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974154cf0 0x7f8974155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:28:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8972ffd640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f8974148a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f896400d5f0 tx=0x7f896400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89640125f0 con 0x7f89740ca000 2024-05-08T20:28:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964012750 con 0x7f89740ca000 2024-05-08T20:28:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964012ae0 con 0x7f89740ca000 2024-05-08T20:28:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89741f1640 con 0x7f89740ca000 2024-05-08T20:28:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740af180 con 0x7f89740ca000 2024-05-08T20:28:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8979611640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 0x7f8974152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8974069600 con 0x7f897414ea30 2024-05-08T20:28:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89727fc640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 0x7f8974152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8964012c40 con 0x7f89740ca000 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89727fc640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89740c48e0 con 0x7f897414ea30 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8960066640 0x7f8960068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8964084940 con 0x7f89740ca000 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89737fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8960066640 0x7f8960068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89727fc640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 0x7f8974152750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8968001040 tx=0x7f896800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89680074e0 con 0x7f897414ea30 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f89737fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8960066640 0x7f8960068b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f896c0ae000 tx=0x7f896c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8968007640 con 0x7f897414ea30 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 msgr2=0x7f8974152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 0x7f8974152750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8968001040 tx=0x7f896800c8e0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 msgr2=0x7f8974152750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.869+0000 7f895b7fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f897414ea30 0x7f8974152750 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8968001040 tx=0x7f896800c8e0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f8979611640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 0x7f8974152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89740af370 con 0x7f8974155fc0 2024-05-08T20:28:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f89727fc640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 0x7f8974152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f89727fc640 1 -- 172.21.15.81:0/1106191226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f89740c6820 con 0x7f8974155fc0 2024-05-08T20:28:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f89727fc640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 0x7f8974152c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8968007fd0 tx=0x7f8968001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896801f070 con 0x7f8974155fc0 2024-05-08T20:28:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4963 (secure 0 0 0) 0x7f8968005e20 con 0x7f8974155fc0 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 msgr2=0x7f8974152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 0x7f8974152c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8968007fd0 tx=0x7f8968001160 comp rx=0 tx=0).stop 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 msgr2=0x7f8974152c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.877+0000 7f895b7fe640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8974155fc0 0x7f8974152c90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-05-08T20:28:23.887 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.888 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.889 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:28:23.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:28:23.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:28:23.894 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:28:23.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:28:23.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:28:23.898 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:28:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8960066640 msgr2=0x7f8960068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8960066640 0x7f8960068b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f896c0ae000 tx=0x7f896c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 msgr2=0x7f8974148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 --2- 172.21.15.81:0/1106191226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89740ca000 0x7f8974148a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f896400d5f0 tx=0x7f896400dab0 comp rx=0 tx=0).stop 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f89737fe640 1 -- 172.21.15.81:0/1106191226 reap_dead start 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f89737fe640 1 -- 172.21.15.81:0/1106191226 reap_dead start 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 shutdown_connections 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 >> 172.21.15.81:0/1106191226 conn(0x7f89740715f0 msgr2=0x7f89740c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 shutdown_connections 2024-05-08T20:28:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:23.881+0000 7f8979611640 1 -- 172.21.15.81:0/1106191226 wait complete. 2024-05-08T20:28:23.902 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:28:23.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:28:43.904 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:28:43.904 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:28:43.904 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:28:43.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:28:43.907 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:28:43.907 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:28:43.908 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:28:43.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:28:48.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:28:48.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:28:58.908 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:28:58.909 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:28:58.909 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:28:58.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:28:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 Processor -- start 2024-05-08T20:28:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 -- start start 2024-05-08T20:28:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 0x7fbe54153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe5406f320 0x7fbe540a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54150190 con 0x7fbe540c3190 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe540c4730 con 0x7fbe5414fdb0 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe5ad73640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54152870 con 0x7fbe5406f320 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe59310640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe540c3190 0x7fbe540c38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57164/0 (socket says 172.21.15.81:57164) 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe59310640 1 -- 172.21.15.81:0/640110108 learned_addr learned my addr 172.21.15.81:0/640110108 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 0x7fbe54153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe5406f320 0x7fbe540a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798763201 0 0) 0x7fbe54150190 con 0x7fbe540c3190 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003530 con 0x7fbe540c3190 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 -- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 msgr2=0x7fbe54153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 -- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 msgr2=0x7fbe54153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:28:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 0x7fbe54153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 0x7fbe54153350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2988377475 0 0) 0x7fbe44003530 con 0x7fbe540c3190 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe5406f320 msgr2=0x7fbe540a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe5406f320 0x7fbe540a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 msgr2=0x7fbe54153350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 --2- 172.21.15.81:0/640110108 >> v2:172.21.15.117:3300/0 conn(0x7fbe5414fdb0 0x7fbe54153350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54152b50 con 0x7fbe540c3190 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fbe4c001a00 con 0x7fbe540c3190 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 >> v1:172.21.15.81:6789/0 conn(0x7fbe540c3190 legacy=0x7fbe540c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe44003980 0x7fbe44003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe44004f70 0x7fbe4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c4730 con 0x7fbe440042e0 2024-05-08T20:28:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54152870 con 0x7fbe44004f70 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4400bf00 con 0x7fbe44003980 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe44003980 0x7fbe44003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe59310640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe44004f70 0x7fbe4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 -- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe44003980 msgr2=0x7fbe44003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe44003980 0x7fbe44003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 -- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe44004f70 msgr2=0x7fbe4400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe44004f70 0x7fbe4400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe53fff640 1 -- 172.21.15.81:0/640110108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54152b50 con 0x7fbe440042e0 2024-05-08T20:28:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.041+0000 7fbe59310640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe44004f70 0x7fbe4400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:28:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe53fff640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe440047d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009ae0 tx=0x7fbe4001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f6ffbc1e45754d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400a5610 con 0x7fbe440042e0 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe400a5770 con 0x7fbe440042e0 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe537fe640 1 -- 172.21.15.81:0/640110108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400a5b20 con 0x7fbe440042e0 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 -- 172.21.15.81:0/640110108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 msgr2=0x7fbe440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/640110108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe440047d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009ae0 tx=0x7fbe4001ca40 comp rx=0 tx=0).stop 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe59310640 1 -- 172.21.15.81:0/640110108 reap_dead start 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 -- 172.21.15.81:0/640110108 shutdown_connections 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 -- 172.21.15.81:0/640110108 >> 172.21.15.81:0/640110108 conn(0x7fbe540c4e30 msgr2=0x7fbe540c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 -- 172.21.15.81:0/640110108 shutdown_connections 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.045+0000 7fbe5ad73640 1 -- 172.21.15.81:0/640110108 wait complete. 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 Processor -- start 2024-05-08T20:28:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- start start 2024-05-08T20:28:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe540c6f70 0x7fbe540c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c81e0 con 0x7fbe440042e0 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54142c00 con 0x7fbe54143c00 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe541eab70 con 0x7fbe540c6f70 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43298/0 (socket says 172.21.15.81:43298) 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 -- 172.21.15.81:0/1851142900 learned_addr learned my addr 172.21.15.81:0/1851142900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe53fff640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe59310640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe540c6f70 0x7fbe540c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe53fff640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 msgr2=0x7fbe54153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe53fff640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 msgr2=0x7fbe54153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe53fff640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe540c6f70 msgr2=0x7fbe540c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe540c6f70 0x7fbe540c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 msgr2=0x7fbe54153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe53fff640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 -- 172.21.15.81:0/1851142900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54142e40 con 0x7fbe440042e0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe58b0f640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbe480116b0 tx=0x7fbe48011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48004220 con 0x7fbe440042e0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48004380 con 0x7fbe440042e0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54143120 con 0x7fbe440042e0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800f9e0 con 0x7fbe440042e0 2024-05-08T20:28:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe541436e0 con 0x7fbe440042e0 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe540675e0 con 0x7fbe440042e0 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.049+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe4800fb40 con 0x7fbe440042e0 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.053+0000 7fbe517fa640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 0x7fbe38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.053+0000 7fbe53fff640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 0x7fbe38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.053+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbe48084590 con 0x7fbe440042e0 2024-05-08T20:28:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.053+0000 7fbe53fff640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 0x7fbe38068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe400af000 tx=0x7fbe400046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:28:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.061+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe480515f0 con 0x7fbe440042e0 2024-05-08T20:28:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.313+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbe54074950 con 0x7fbe440042e0 2024-05-08T20:28:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.313+0000 7fbe517fa640 1 -- 172.21.15.81:0/1851142900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fbe480044f0 con 0x7fbe440042e0 2024-05-08T20:28:59.318 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:28:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 msgr2=0x7fbe38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 0x7fbe38068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe400af000 tx=0x7fbe400046d0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 msgr2=0x7fbe541426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbe480116b0 tx=0x7fbe48011b70 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 shutdown_connections 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe38066690 0x7fbe38068b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe540c6f70 0x7fbe540c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe54143c00 0x7fbe54153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 --2- 172.21.15.81:0/1851142900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe440042e0 0x7fbe541426c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 >> 172.21.15.81:0/1851142900 conn(0x7fbe540c4e30 msgr2=0x7fbe54151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 shutdown_connections 2024-05-08T20:28:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:28:59.317+0000 7fbe5ad73640 1 -- 172.21.15.81:0/1851142900 wait complete. 2024-05-08T20:29:02.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 Processor -- start 2024-05-08T20:29:02.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 -- start start 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa38806b230 0x7fa3880c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa388070c00 0x7fa38814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3881519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa388072940 con 0x7fa388070c00 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880c3a50 con 0x7fa38806b230 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa390428640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880705e0 con 0x7fa38814edf0 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38e9c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3881519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa388070c00 0x7fa38814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38e9c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3881519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:47552/0 (socket says 172.21.15.81:47552) 2024-05-08T20:29:02.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38e9c5640 1 -- 172.21.15.81:0/1372845405 learned_addr learned my addr 172.21.15.81:0/1372845405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38e1c4640 1 --2- 172.21.15.81:0/1372845405 >> v2:172.21.15.117:3300/0 conn(0x7fa38806b230 0x7fa3880c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 -- 172.21.15.81:0/1372845405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 msgr2=0x7fa3881519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 --2- 172.21.15.81:0/1372845405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3881519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 -- 172.21.15.81:0/1372845405 >> v2:172.21.15.117:3300/0 conn(0x7fa38806b230 msgr2=0x7fa3880c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 --2- 172.21.15.81:0/1372845405 >> v2:172.21.15.117:3300/0 conn(0x7fa38806b230 0x7fa3880c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.493+0000 7fa38d9c3640 1 -- 172.21.15.81:0/1372845405 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880708c0 con 0x7fa388070c00 2024-05-08T20:29:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa38d9c3640 1 --2- 172.21.15.81:0/1372845405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa38814e8b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa3880c4d70 tx=0x7fa37801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcb57b576ab95e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa38d1c2640 1 -- 172.21.15.81:0/1372845405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388152720 con 0x7fa388070c00 2024-05-08T20:29:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa38d1c2640 1 -- 172.21.15.81:0/1372845405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780a7050 con 0x7fa388070c00 2024-05-08T20:29:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa38d1c2640 1 -- 172.21.15.81:0/1372845405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780ab820 con 0x7fa388070c00 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 -- 172.21.15.81:0/1372845405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 msgr2=0x7fa38814e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 --2- 172.21.15.81:0/1372845405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa38814e8b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa3880c4d70 tx=0x7fa37801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 -- 172.21.15.81:0/1372845405 shutdown_connections 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 --2- 172.21.15.81:0/1372845405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3881519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 --2- 172.21.15.81:0/1372845405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa38814e8b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 --2- 172.21.15.81:0/1372845405 >> v2:172.21.15.117:3300/0 conn(0x7fa38806b230 0x7fa3880c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 -- 172.21.15.81:0/1372845405 >> 172.21.15.81:0/1372845405 conn(0x7fa3880c71b0 msgr2=0x7fa3880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 -- 172.21.15.81:0/1372845405 shutdown_connections 2024-05-08T20:29:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.497+0000 7fa390428640 1 -- 172.21.15.81:0/1372845405 wait complete. 2024-05-08T20:29:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 Processor -- start 2024-05-08T20:29:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 -- start start 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3880c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881f0f80 con 0x7fa388070c00 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38d9c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881545b0 con 0x7fa38806b230 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38d9c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43318/0 (socket says 172.21.15.81:43318) 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38d9c3640 1 -- 172.21.15.81:0/504478378 learned_addr learned my addr 172.21.15.81:0/504478378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:41956/0 (socket says 172.21.15.81:41956) 2024-05-08T20:29:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3880c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa390428640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa388144ae0 con 0x7fa38814edf0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 msgr2=0x7fa388153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 msgr2=0x7fa388153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e1c4640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 msgr2=0x7fa388153b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 msgr2=0x7fa388154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 -- 172.21.15.81:0/504478378 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009420 con 0x7fa38814edf0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38d9c3640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.501+0000 7fa38e9c5640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3880c3f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa38000eba0 tx=0x7fa38000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000cb20 con 0x7fa38814edf0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38000f040 con 0x7fa38814edf0 2024-05-08T20:29:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000cea0 con 0x7fa38814edf0 2024-05-08T20:29:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3881f0650 con 0x7fa38814edf0 2024-05-08T20:29:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3881f0c10 con 0x7fa38814edf0 2024-05-08T20:29:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3880675e0 con 0x7fa38814edf0 2024-05-08T20:29:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3800039a0 con 0x7fa38814edf0 2024-05-08T20:29:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 0x7fa36c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa38e1c4640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 0x7fa36c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa380084a70 con 0x7fa38814edf0 2024-05-08T20:29:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.505+0000 7fa38e1c4640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 0x7fa36c068b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa38400b100 tx=0x7fa384008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.513+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa380051920 con 0x7fa38814edf0 2024-05-08T20:29:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.937+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa38806d210 con 0x7fa38814edf0 2024-05-08T20:29:02.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.937+0000 7fa37effd640 1 -- 172.21.15.81:0/504478378 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fa380054f40 con 0x7fa38814edf0 2024-05-08T20:29:02.942 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 msgr2=0x7fa36c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 0x7fa36c068b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa38400b100 tx=0x7fa384008040 comp rx=0 tx=0).stop 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 msgr2=0x7fa3880c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3880c3f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa38000eba0 tx=0x7fa38000c490 comp rx=0 tx=0).stop 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 shutdown_connections 2024-05-08T20:29:02.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa36c0666c0 0x7fa36c068b80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa38814edf0 0x7fa3880c3f10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388070c00 0x7fa388154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 --2- 172.21.15.81:0/504478378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa38806b230 0x7fa388153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 >> 172.21.15.81:0/504478378 conn(0x7fa3880c71b0 msgr2=0x7fa38806a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 shutdown_connections 2024-05-08T20:29:02.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:02.941+0000 7fa390428640 1 -- 172.21.15.81:0/504478378 wait complete. 2024-05-08T20:29:05.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 Processor -- start 2024-05-08T20:29:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 -- start start 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce40151f00 0x7fce401588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce45a16640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce45a16640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43320/0 (socket says 172.21.15.81:43320) 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce45a16640 1 -- 172.21.15.81:0/1480489118 learned_addr learned my addr 172.21.15.81:0/1480489118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce40158e20 con 0x7fce40155690 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce46217640 1 --2- 172.21.15.81:0/1480489118 >> v2:172.21.15.117:3300/0 conn(0x7fce40151f00 0x7fce401588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4006bb20 con 0x7fce40154cf0 2024-05-08T20:29:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce401548e0 con 0x7fce40151f00 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce45215640 1 -- 172.21.15.81:0/1480489118 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492412652 0 0) 0x7fce40158e20 con 0x7fce40155690 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce45215640 1 -- 172.21.15.81:0/1480489118 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2c003530 con 0x7fce40155690 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce46217640 1 -- 172.21.15.81:0/1480489118 >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 msgr2=0x7fce40155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce46217640 1 --2- 172.21.15.81:0/1480489118 >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce46217640 1 -- 172.21.15.81:0/1480489118 >> v1:172.21.15.81:6789/0 conn(0x7fce40155690 legacy=0x7fce400ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.117+0000 7fce46217640 1 -- 172.21.15.81:0/1480489118 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce401522e0 con 0x7fce40151f00 2024-05-08T20:29:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce45a16640 1 --2- 172.21.15.81:0/1480489118 >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce46217640 1 --2- 172.21.15.81:0/1480489118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce40151f00 0x7fce401588e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce400cb390 tx=0x7fce3c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a6f6010225ca03a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce45215640 1 -- 172.21.15.81:0/1480489118 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0ad680 con 0x7fce40151f00 2024-05-08T20:29:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce45215640 1 -- 172.21.15.81:0/1480489118 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0ad7e0 con 0x7fce40151f00 2024-05-08T20:29:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce45215640 1 -- 172.21.15.81:0/1480489118 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0adb70 con 0x7fce40151f00 2024-05-08T20:29:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce40151f00 msgr2=0x7fce401588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 --2- 172.21.15.81:0/1480489118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce40151f00 0x7fce401588e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fce400cb390 tx=0x7fce3c01c360 comp rx=0 tx=0).stop 2024-05-08T20:29:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 shutdown_connections 2024-05-08T20:29:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 --2- 172.21.15.81:0/1480489118 >> v2:172.21.15.81:3300/0 conn(0x7fce40154cf0 0x7fce40155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 --2- 172.21.15.81:0/1480489118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce40151f00 0x7fce401588e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 >> 172.21.15.81:0/1480489118 conn(0x7fce400715f0 msgr2=0x7fce40071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.121+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 shutdown_connections 2024-05-08T20:29:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 -- 172.21.15.81:0/1480489118 wait complete. 2024-05-08T20:29:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 Processor -- start 2024-05-08T20:29:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 -- start start 2024-05-08T20:29:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 0x7fce401edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce401f10f0 0x7fce400c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401ed860 con 0x7fce40154cf0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401ed1c0 con 0x7fce401f10f0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce4847b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400ae910 con 0x7fce40151f00 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:47574/0 (socket says 172.21.15.81:47574) 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 -- 172.21.15.81:0/3176125382 learned_addr learned my addr 172.21.15.81:0/3176125382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce45a16640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 0x7fce401edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46a18640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce401f10f0 0x7fce400c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 -- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce401f10f0 msgr2=0x7fce400c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce401f10f0 0x7fce400c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 -- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 msgr2=0x7fce401edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 0x7fce401edc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 -- 172.21.15.81:0/3176125382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce300094d0 con 0x7fce40151f00 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce45a16640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 0x7fce401edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.125+0000 7fce46217640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce3c019fb0 tx=0x7fce3c01abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0ade60 con 0x7fce40151f00 2024-05-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0b8420 con 0x7fce40151f00 2024-05-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce4847b640 1 -- 172.21.15.81:0/3176125382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c009420 con 0x7fce40151f00 2024-05-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0b87b0 con 0x7fce40151f00 2024-05-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce4847b640 1 -- 172.21.15.81:0/3176125382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce401ed480 con 0x7fce40151f00 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce3c0b4040 con 0x7fce40151f00 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c005260 con 0x7fce40151f00 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 0x7fce24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fce3c11dde0 con 0x7fce40151f00 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce45a16640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 0x7fce24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.129+0000 7fce45a16640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 0x7fce24068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce4015e5a0 tx=0x7fce30009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.137+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fce3c0eb050 con 0x7fce40151f00 2024-05-08T20:29:06.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.557+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fce1c0057e0 con 0x7fce40151f00 2024-05-08T20:29:06.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.557+0000 7fce36ffd640 1 -- 172.21.15.81:0/3176125382 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fce3c0ee670 con 0x7fce40151f00 2024-05-08T20:29:06.562 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 msgr2=0x7fce24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 0x7fce24068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce4015e5a0 tx=0x7fce30009240 comp rx=0 tx=0).stop 2024-05-08T20:29:06.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 msgr2=0x7fce400ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce3c019fb0 tx=0x7fce3c01abc0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 shutdown_connections 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce24066690 0x7fce24068b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce401f10f0 0x7fce400c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce40154cf0 0x7fce401edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 --2- 172.21.15.81:0/3176125382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce40151f00 0x7fce400ae330 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 >> 172.21.15.81:0/3176125382 conn(0x7fce400715f0 msgr2=0x7fce400719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 shutdown_connections 2024-05-08T20:29:06.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.561+0000 7fce34ff9640 1 -- 172.21.15.81:0/3176125382 wait complete. 2024-05-08T20:29:06.587 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:29:06.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:29:06.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:29:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.741+0000 7fe69079e640 1 Processor -- start 2024-05-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.741+0000 7fe69079e640 1 -- start start 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe69079e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6880c2570 0x7fe688154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe69079e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6880c34e0 0x7fe6881554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6880c34e0 0x7fe6881554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6880c34e0 0x7fe6881554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43342/0 (socket says 172.21.15.81:43342) 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 -- 172.21.15.81:0/3831001272 learned_addr learned my addr 172.21.15.81:0/3831001272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe688158080 con 0x7fe688152340 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68806ab70 con 0x7fe6880c34e0 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe688154b10 con 0x7fe6880c2570 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68dd39640 1 --2- 172.21.15.81:0/3831001272 >> v2:172.21.15.117:3300/0 conn(0x7fe6880c2570 0x7fe688154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 -- 172.21.15.81:0/3831001272 >> v2:172.21.15.117:3300/0 conn(0x7fe6880c2570 msgr2=0x7fe688154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/3831001272 >> v2:172.21.15.117:3300/0 conn(0x7fe6880c2570 0x7fe688154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 -- 172.21.15.81:0/3831001272 >> v1:172.21.15.117:6789/0 conn(0x7fe688152340 legacy=0x7fe68806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68ed3b640 1 -- 172.21.15.81:0/3831001272 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68806a890 con 0x7fe6880c34e0 2024-05-08T20:29:06.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.745+0000 7fe68d538640 1 -- 172.21.15.81:0/3831001272 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703317109 0 0) 0x7fe688158080 con 0x7fe688152340 2024-05-08T20:29:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/3831001272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c34e0 0x7fe6881554a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe68806fe70 tx=0x7fe68001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56f35c77aadfd2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe68d538640 1 -- 172.21.15.81:0/3831001272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a57f0 con 0x7fe6880c34e0 2024-05-08T20:29:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe68d538640 1 -- 172.21.15.81:0/3831001272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800a5950 con 0x7fe6880c34e0 2024-05-08T20:29:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe68d538640 1 -- 172.21.15.81:0/3831001272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5ce0 con 0x7fe6880c34e0 2024-05-08T20:29:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c34e0 msgr2=0x7fe6881554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 --2- 172.21.15.81:0/3831001272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c34e0 0x7fe6881554a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe68806fe70 tx=0x7fe68001c930 comp rx=0 tx=0).stop 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 shutdown_connections 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 --2- 172.21.15.81:0/3831001272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c34e0 0x7fe6881554a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 --2- 172.21.15.81:0/3831001272 >> v2:172.21.15.117:3300/0 conn(0x7fe6880c2570 0x7fe688154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 >> 172.21.15.81:0/3831001272 conn(0x7fe6880c71b0 msgr2=0x7fe6880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 shutdown_connections 2024-05-08T20:29:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.749+0000 7fe69079e640 1 -- 172.21.15.81:0/3831001272 wait complete. 2024-05-08T20:29:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 Processor -- start 2024-05-08T20:29:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 -- start start 2024-05-08T20:29:06.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 0x7fe6880aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 0x7fe6881438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe688152340 0x7fe6881efed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68e53a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 0x7fe6880aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68e53a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 0x7fe6880aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43356/0 (socket says 172.21.15.81:43356) 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68e53a640 1 -- 172.21.15.81:0/937850862 learned_addr learned my addr 172.21.15.81:0/937850862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 0x7fe6881438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe688152340 0x7fe6881efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880c6310 con 0x7fe6880c2570 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6881f07d0 con 0x7fe6880c34e0 2024-05-08T20:29:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6881f0ab0 con 0x7fe688152340 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe688152340 msgr2=0x7fe6881efed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe688152340 0x7fe6881efed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 msgr2=0x7fe6880aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 0x7fe6880aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680009b30 con 0x7fe6880c34e0 2024-05-08T20:29:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe688152340 0x7fe6881efed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68e53a640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c2570 0x7fe6880aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe68dd39640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 0x7fe6881438c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe67800e840 tx=0x7fe67800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67800c730 con 0x7fe6880c34e0 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.753+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67800c890 con 0x7fe6880c34e0 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67800cc20 con 0x7fe6880c34e0 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6881f0d90 con 0x7fe6880c34e0 2024-05-08T20:29:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688143e00 con 0x7fe6880c34e0 2024-05-08T20:29:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe69079e640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 0x7fe6880c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe688069550 con 0x7fe6880c4e10 2024-05-08T20:29:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe68e53a640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 0x7fe6880c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe68e53a640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6880677d0 con 0x7fe6880c4e10 2024-05-08T20:29:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe68e53a640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 0x7fe6880c67a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe684000f70 tx=0x7fe68400ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe678013470 con 0x7fe6880c34e0 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe66c066690 0x7fe66c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe6780843b0 con 0x7fe6880c34e0 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe66c066690 0x7fe66c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840052e0 con 0x7fe6880c4e10 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe684005440 con 0x7fe6880c4e10 2024-05-08T20:29:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 msgr2=0x7fe6880c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 0x7fe6880c67a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe684000f70 tx=0x7fe68400ff50 comp rx=0 tx=0).stop 2024-05-08T20:29:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 msgr2=0x7fe6880c67a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.757+0000 7fe67effd640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c4e10 0x7fe6880c67a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.761+0000 7fe68ed3b640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe66c066690 0x7fe66c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6800ae000 tx=0x7fe6800a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.769+0000 7fe69079e640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 0x7fe688151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.769+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880c6170 con 0x7fe6880c6ce0 2024-05-08T20:29:06.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.769+0000 7fe68e53a640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 0x7fe688151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe68e53a640 1 -- 172.21.15.81:0/937850862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe6881559e0 con 0x7fe6880c6ce0 2024-05-08T20:29:06.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe68e53a640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 0x7fe688151070 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe684017000 tx=0x7fe684001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684023070 con 0x7fe6880c6ce0 2024-05-08T20:29:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fe684003810 con 0x7fe6880c6ce0 2024-05-08T20:29:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 msgr2=0x7fe688151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 0x7fe688151070 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe684017000 tx=0x7fe684001090 comp rx=0 tx=0).stop 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.777 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:06.780 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.781 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.783 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.787 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.788 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:06.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:06.790 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:06.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 msgr2=0x7fe688151070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:06.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe67effd640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6880c6ce0 0x7fe688151070 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe66c066690 msgr2=0x7fe66c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe66c066690 0x7fe66c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6800ae000 tx=0x7fe6800a7070 comp rx=0 tx=0).stop 2024-05-08T20:29:06.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 msgr2=0x7fe6881438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 0x7fe6881438c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe67800e840 tx=0x7fe67800ed00 comp rx=0 tx=0).stop 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe68ed3b640 1 -- 172.21.15.81:0/937850862 reap_dead start 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 shutdown_connections 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 --2- 172.21.15.81:0/937850862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6880c34e0 0x7fe6881438c0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe67800e840 tx=0x7fe67800ed00 comp rx=0 tx=0).stop 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 >> 172.21.15.81:0/937850862 conn(0x7fe6880c71b0 msgr2=0x7fe68806d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 shutdown_connections 2024-05-08T20:29:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.773+0000 7fe69079e640 1 -- 172.21.15.81:0/937850862 wait complete. 2024-05-08T20:29:06.796 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:06.797 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:29:06.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:29:06.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 Processor -- start 2024-05-08T20:29:06.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 -- start start 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 0x7f3ff406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff4152ab0 con 0x7f3ff4155e90 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff4152d90 con 0x7f3ff406d7d0 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3febfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ff4155e90 0x7f3ff4069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57190/0 (socket says 172.21.15.81:57190) 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41528a0 con 0x7f3ff414fe70 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3febfff640 1 -- 172.21.15.81:0/1026071386 learned_addr learned my addr 172.21.15.81:0/1026071386 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff37fe640 1 --2- 172.21.15.81:0/1026071386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 0x7f3ff406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845350820 0 0) 0x7f3ff4152ab0 con 0x7f3ff4155e90 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe0003530 con 0x7f3ff4155e90 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862949911 0 0) 0x7f3ff4152d90 con 0x7f3ff406d7d0 2024-05-08T20:29:06.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff4152ab0 con 0x7f3ff406d7d0 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff37fe640 1 -- 172.21.15.81:0/1026071386 >> v1:172.21.15.117:6789/0 conn(0x7f3ff406d7d0 legacy=0x7f3ff406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff37fe640 1 -- 172.21.15.81:0/1026071386 >> v1:172.21.15.81:6789/0 conn(0x7f3ff4155e90 legacy=0x7f3ff4069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.953+0000 7f3ff37fe640 1 -- 172.21.15.81:0/1026071386 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4153070 con 0x7f3ff414fe70 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff37fe640 1 --2- 172.21.15.81:0/1026071386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 0x7f3ff406d290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097f0 tx=0x7f3fe401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf483db9427a9585 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a8050 con 0x7f3ff414fe70 2024-05-08T20:29:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe40ac5f0 con 0x7f3ff414fe70 2024-05-08T20:29:06.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff2ffd640 1 -- 172.21.15.81:0/1026071386 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40ac960 con 0x7f3ff414fe70 2024-05-08T20:29:06.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 msgr2=0x7f3ff406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/1026071386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 0x7f3ff406d290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097f0 tx=0x7f3fe401c390 comp rx=0 tx=0).stop 2024-05-08T20:29:06.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 shutdown_connections 2024-05-08T20:29:06.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/1026071386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff414fe70 0x7f3ff406d290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.957+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 >> 172.21.15.81:0/1026071386 conn(0x7f3ff40c71b0 msgr2=0x7f3ff40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 shutdown_connections 2024-05-08T20:29:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- 172.21.15.81:0/1026071386 wait complete. 2024-05-08T20:29:06.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 Processor -- start 2024-05-08T20:29:06.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- start start 2024-05-08T20:29:06.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff4155e90 0x7f3ff41ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff41ed5f0 0x7f3ff41f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41f0310 con 0x7f3ff4155e90 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40ab350 con 0x7f3ff406d7d0 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff9eef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40ab630 con 0x7f3ff41ed5f0 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff4155e90 0x7f3ff41ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:42004/0 (socket says 172.21.15.81:42004) 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 -- 172.21.15.81:0/3154538861 learned_addr learned my addr 172.21.15.81:0/3154538861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff3fff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff41ed5f0 0x7f3ff41f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff41ed5f0 msgr2=0x7f3ff41f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff41ed5f0 0x7f3ff41f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff4155e90 msgr2=0x7f3ff41ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff4155e90 0x7f3ff41ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009420 con 0x7f3ff406d7d0 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff37fe640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4019fc0 tx=0x7f3fe4019130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.961+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a8050 con 0x7f3ff406d7d0 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe40acb70 con 0x7f3ff406d7d0 2024-05-08T20:29:06.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff40ab910 con 0x7f3ff406d7d0 2024-05-08T20:29:06.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4003620 con 0x7f3ff406d7d0 2024-05-08T20:29:06.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4148390 con 0x7f3ff406d7d0 2024-05-08T20:29:06.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 0x7f3ff41506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4069550 con 0x7f3ff41f0fc0 2024-05-08T20:29:06.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3febfff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 0x7f3ff41506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fe40b3040 con 0x7f3ff406d7d0 2024-05-08T20:29:06.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3fd40666c0 0x7f3fd4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3fe411e100 con 0x7f3ff406d7d0 2024-05-08T20:29:06.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff3fff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3fd40666c0 0x7f3fd4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3febfff640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ff40675e0 con 0x7f3ff41f0fc0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3febfff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 0x7f3ff41506d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ff415d420 tx=0x7f3fdc001880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff3fff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3fd40666c0 0x7f3fd4068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fec007fd0 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc005860 con 0x7f3ff41f0fc0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f3fdc0059c0 con 0x7f3ff41f0fc0 2024-05-08T20:29:06.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 msgr2=0x7f3ff41506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 0x7f3ff41506d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ff415d420 tx=0x7f3fdc001880 comp rx=0 tx=0).stop 2024-05-08T20:29:06.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 msgr2=0x7f3ff41506d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:06.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.965+0000 7f3ff0ff9640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41f0fc0 0x7f3ff41506d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.977+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 0x7f3ff4150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:06.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.977+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40c1920 con 0x7f3ff41eda00 2024-05-08T20:29:06.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.977+0000 7f3febfff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 0x7f3ff4150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:06.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.977+0000 7f3febfff640 1 -- 172.21.15.81:0/3154538861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3ff4074950 con 0x7f3ff41eda00 2024-05-08T20:29:06.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3febfff640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 0x7f3ff4150c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40abe00 tx=0x7f3fdc001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:06.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc023070 con 0x7f3ff41eda00 2024-05-08T20:29:06.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f3fdc0066d0 con 0x7f3ff41eda00 2024-05-08T20:29:06.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 msgr2=0x7f3ff4150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 0x7f3ff4150c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40abe00 tx=0x7f3fdc001160 comp rx=0 tx=0).stop 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 msgr2=0x7f3ff4150c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff0ff9640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff41eda00 0x7f3ff4150c10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:06.984 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:06.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:06.988 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:06.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:06.993 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:06.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.995 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:06.996 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3fd40666c0 msgr2=0x7f3fd4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3fd40666c0 0x7f3fd4068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3fec007fd0 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 msgr2=0x7f3ff40c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4019fc0 tx=0x7f3fe4019130 comp rx=0 tx=0).stop 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff3fff640 1 -- 172.21.15.81:0/3154538861 reap_dead start 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 shutdown_connections 2024-05-08T20:29:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 --2- 172.21.15.81:0/3154538861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff406d7d0 0x7f3ff40c0ff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 >> 172.21.15.81:0/3154538861 conn(0x7f3ff40c71b0 msgr2=0x7f3ff406b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 shutdown_connections 2024-05-08T20:29:06.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:06.981+0000 7f3ff9eef640 1 -- 172.21.15.81:0/3154538861 wait complete. 2024-05-08T20:29:07.003 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:07.004 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:29:07.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:29:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 Processor -- start 2024-05-08T20:29:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 -- start start 2024-05-08T20:29:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6800c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6801519d0 0x7fd680151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800c3a50 con 0x7fd68006b230 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd680072940 con 0x7fd6801519d0 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd684854640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800705e0 con 0x7fd680070c00 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6801519d0 0x7fd680151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6801519d0 0x7fd680151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43388/0 (socket says 172.21.15.81:43388) 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67e59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd68006b230 0x7fd68014e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:39014/0 (socket says 172.21.15.81:39014) 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 -- 172.21.15.81:0/2478259725 learned_addr learned my addr 172.21.15.81:0/2478259725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:07.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd677fff640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6800c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67dd9b640 1 -- 172.21.15.81:0/2478259725 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820119524 0 0) 0x7fd6800c3a50 con 0x7fd68006b230 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67dd9b640 1 -- 172.21.15.81:0/2478259725 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c003530 con 0x7fd68006b230 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 -- 172.21.15.81:0/2478259725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 msgr2=0x7fd6800c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6800c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 -- 172.21.15.81:0/2478259725 >> v1:172.21.15.117:6789/0 conn(0x7fd68006b230 legacy=0x7fd68014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.157+0000 7fd67ed9d640 1 -- 172.21.15.81:0/2478259725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800708c0 con 0x7fd6801519d0 2024-05-08T20:29:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd67ed9d640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6801519d0 0x7fd680151e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e50 tx=0x7fd67801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a783d66ee42f9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd67dd9b640 1 -- 172.21.15.81:0/2478259725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780a5880 con 0x7fd6801519d0 2024-05-08T20:29:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd67dd9b640 1 -- 172.21.15.81:0/2478259725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6780a59e0 con 0x7fd6801519d0 2024-05-08T20:29:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd67dd9b640 1 -- 172.21.15.81:0/2478259725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780a5d50 con 0x7fd6801519d0 2024-05-08T20:29:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 -- 172.21.15.81:0/2478259725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6801519d0 msgr2=0x7fd680151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6801519d0 0x7fd680151e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e50 tx=0x7fd67801c9c0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 -- 172.21.15.81:0/2478259725 shutdown_connections 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6801519d0 0x7fd680151e60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 --2- 172.21.15.81:0/2478259725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6800c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.161+0000 7fd684854640 1 -- 172.21.15.81:0/2478259725 >> 172.21.15.81:0/2478259725 conn(0x7fd6800c71b0 msgr2=0x7fd6800c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- 172.21.15.81:0/2478259725 shutdown_connections 2024-05-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- 172.21.15.81:0/2478259725 wait complete. 2024-05-08T20:29:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 Processor -- start 2024-05-08T20:29:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- start start 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 0x7fd68015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6801edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6801519d0 0x7fd6801edff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800aa540 con 0x7fd68006b230 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 0x7fd68015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd677fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6801edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 0x7fd68015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43400/0 (socket says 172.21.15.81:43400) 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd67e59c640 1 -- 172.21.15.81:0/34261618 learned_addr learned my addr 172.21.15.81:0/34261618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd677fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6801edab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:47608/0 (socket says 172.21.15.81:47608) 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd67ed9d640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6801519d0 0x7fd6801edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800aa260 con 0x7fd6801519d0 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.165+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f1150 con 0x7fd680070c00 2024-05-08T20:29:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 msgr2=0x7fd6801edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6801edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6801519d0 msgr2=0x7fd6801edff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6801519d0 0x7fd6801edff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009b30 con 0x7fd68006b230 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd677fff640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680070c00 0x7fd6801edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67e59c640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 0x7fd68015a460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c420 tx=0x7fd67000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6700074e0 con 0x7fd68006b230 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801f1430 con 0x7fd68006b230 2024-05-08T20:29:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd680155270 con 0x7fd68006b230 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670007660 con 0x7fd68006b230 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004a30 con 0x7fd68006b230 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd684854640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 0x7fd6801541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd680069550 con 0x7fd680148160 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd677fff640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 0x7fd6801541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd677fff640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6800c7e30 con 0x7fd680148160 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd677fff640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 0x7fd6801541d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6801eebe0 tx=0x7fd66800f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668004020 con 0x7fd680148160 2024-05-08T20:29:07.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd670004b90 con 0x7fd68006b230 2024-05-08T20:29:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd660066730 0x7fd660068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd670083da0 con 0x7fd68006b230 2024-05-08T20:29:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd67ed9d640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd660066730 0x7fd660068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd668004180 con 0x7fd680148160 2024-05-08T20:29:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 msgr2=0x7fd6801541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 0x7fd6801541d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6801eebe0 tx=0x7fd66800f610 comp rx=0 tx=0).stop 2024-05-08T20:29:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 msgr2=0x7fd6801541d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.169+0000 7fd676ffd640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd680148160 0x7fd6801541d0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6801eebe0 tx=0x7fd66800f610 comp rx=0 tx=0).stop 2024-05-08T20:29:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.173+0000 7fd67ed9d640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd660066730 0x7fd660068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6780ae000 tx=0x7fd6780a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.181+0000 7fd684854640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 0x7fd680154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.181+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68014f1d0 con 0x7fd6801f1c30 2024-05-08T20:29:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.181+0000 7fd677fff640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 0x7fd680154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.181+0000 7fd677fff640 1 -- 172.21.15.81:0/34261618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6800675e0 con 0x7fd6801f1c30 2024-05-08T20:29:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.181+0000 7fd677fff640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 0x7fd680154710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd66801b000 tx=0x7fd6680046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668014850 con 0x7fd6801f1c30 2024-05-08T20:29:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4635 (secure 0 0 0) 0x7fd6680273a0 con 0x7fd6801f1c30 2024-05-08T20:29:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 msgr2=0x7fd680154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 0x7fd680154710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd66801b000 tx=0x7fd6680046d0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 msgr2=0x7fd680154710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd676ffd640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6801f1c30 0x7fd680154710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:07.201 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd660066730 msgr2=0x7fd660068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd660066730 0x7fd660068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6780ae000 tx=0x7fd6780a7070 comp rx=0 tx=0).stop 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 msgr2=0x7fd68015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 --2- 172.21.15.81:0/34261618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd68006b230 0x7fd68015a460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c420 tx=0x7fd67000c8e0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd67ed9d640 1 -- 172.21.15.81:0/34261618 reap_dead start 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd67ed9d640 1 -- 172.21.15.81:0/34261618 reap_dead start 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 shutdown_connections 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 >> 172.21.15.81:0/34261618 conn(0x7fd6800c71b0 msgr2=0x7fd6800c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:07.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 shutdown_connections 2024-05-08T20:29:07.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.185+0000 7fd684854640 1 -- 172.21.15.81:0/34261618 wait complete. 2024-05-08T20:29:07.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:07.208 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:29:07.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:29:07.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.357+0000 7f1ba49c2640 1 Processor -- start 2024-05-08T20:29:07.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.357+0000 7f1ba49c2640 1 -- start start 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1ba49c2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ba0152340 0x7f1ba006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1ba49c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 0x7f1ba0155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1ba49c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba0158080 con 0x7f1ba00c2570 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1ba49c2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba006ab70 con 0x7f1ba0152340 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1ba49c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0154b10 con 0x7f1ba006d7d0 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ba0152340 0x7f1ba006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ba0152340 0x7f1ba006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43406/0 (socket says 172.21.15.81:43406) 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 -- 172.21.15.81:0/3119494455 learned_addr learned my addr 172.21.15.81:0/3119494455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9ed9d640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 0x7f1ba0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 -- 172.21.15.81:0/3119494455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 msgr2=0x7f1ba0155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 0x7f1ba0155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 -- 172.21.15.81:0/3119494455 >> v1:172.21.15.117:6789/0 conn(0x7f1ba00c2570 legacy=0x7f1ba0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9e59c640 1 -- 172.21.15.81:0/3119494455 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba006a890 con 0x7f1ba0152340 2024-05-08T20:29:07.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.361+0000 7f1b9ed9d640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 0x7f1ba0155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:29:07.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1b9e59c640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba0152340 0x7f1ba006d290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b9001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f2c41fda8cd35c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1b9dd9b640 1 -- 172.21.15.81:0/3119494455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900a6040 con 0x7f1ba0152340 2024-05-08T20:29:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1b9dd9b640 1 -- 172.21.15.81:0/3119494455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900aa600 con 0x7f1ba0152340 2024-05-08T20:29:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1b9dd9b640 1 -- 172.21.15.81:0/3119494455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900aa990 con 0x7f1ba0152340 2024-05-08T20:29:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- 172.21.15.81:0/3119494455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba0152340 msgr2=0x7f1ba006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba0152340 0x7f1ba006d290 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b9001c4a0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- 172.21.15.81:0/3119494455 shutdown_connections 2024-05-08T20:29:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba006d7d0 0x7f1ba0155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/3119494455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba0152340 0x7f1ba006d290 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- 172.21.15.81:0/3119494455 >> 172.21.15.81:0/3119494455 conn(0x7f1ba00c71b0 msgr2=0x7f1ba00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- 172.21.15.81:0/3119494455 shutdown_connections 2024-05-08T20:29:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- 172.21.15.81:0/3119494455 wait complete. 2024-05-08T20:29:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 Processor -- start 2024-05-08T20:29:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.365+0000 7f1ba49c2640 1 -- start start 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba00c2570 0x7f1ba01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 0x7f1ba01ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba01f1750 con 0x7f1ba006d7d0 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0157950 con 0x7f1ba00c2570 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba01f12c0 con 0x7f1ba0152340 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43408/0 (socket says 172.21.15.81:43408) 2024-05-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 -- 172.21.15.81:0/905840284 learned_addr learned my addr 172.21.15.81:0/905840284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b97fff640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba00c2570 0x7f1ba01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9ed9d640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 0x7f1ba01ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 -- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 msgr2=0x7f1ba01ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 0x7f1ba01ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 -- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba00c2570 msgr2=0x7f1ba01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba00c2570 0x7f1ba01442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 -- 172.21.15.81:0/905840284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094d0 con 0x7f1ba006d7d0 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9ed9d640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 0x7f1ba01ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b9e59c640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b9001ab50 tx=0x7f1b9001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b3600 con 0x7f1ba006d7d0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900b3760 con 0x7f1ba006d7d0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba01f09d0 con 0x7f1ba006d7d0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b3b10 con 0x7f1ba006d7d0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba01f0f50 con 0x7f1ba006d7d0 2024-05-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.369+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba00675e0 con 0x7f1ba006d7d0 2024-05-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.373+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b900b3c70 con 0x7f1ba006d7d0 2024-05-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.373+0000 7f1b96ffd640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 0x7f1b80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.373+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1b9011eff0 con 0x7f1ba006d7d0 2024-05-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.377+0000 7f1b97fff640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 0x7f1b80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.377+0000 7f1b97fff640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 0x7f1b80068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0154020 tx=0x7f1b88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.381+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1b900ec100 con 0x7f1ba006d7d0 2024-05-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.801+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f1ba0074950 con 0x7f1ba006d7d0 2024-05-08T20:29:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.801+0000 7f1b96ffd640 1 -- 172.21.15.81:0/905840284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f1b900ef720 con 0x7f1ba006d7d0 2024-05-08T20:29:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 msgr2=0x7f1b80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 0x7f1b80068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0154020 tx=0x7f1b88009040 comp rx=0 tx=0).stop 2024-05-08T20:29:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 msgr2=0x7f1ba0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:07.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b9001ab50 tx=0x7f1b9001ace0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 shutdown_connections 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b80066690 0x7f1b80068b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ba0152340 0x7f1ba01ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ba00c2570 0x7f1ba01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 --2- 172.21.15.81:0/905840284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ba006d7d0 0x7f1ba0157100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 >> 172.21.15.81:0/905840284 conn(0x7f1ba00c71b0 msgr2=0x7f1ba00c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 shutdown_connections 2024-05-08T20:29:07.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:07.805+0000 7f1ba49c2640 1 -- 172.21.15.81:0/905840284 wait complete. 2024-05-08T20:29:07.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:29:17.831 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:29:17.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 Processor -- start 2024-05-08T20:29:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 -- start start 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b280c30d0 0x7f4b280c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b280c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b28155e10 con 0x7f4b280a94b0 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2806e790 con 0x7f4b280c30d0 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2f601640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2806f460 con 0x7f4b280c2bc0 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2d39d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b280c30d0 0x7f4b280c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2db9e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4b280a94b0 0x7f4b280a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38840/0 (socket says 172.21.15.81:38840) 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2cb9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b280c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.981+0000 7f4b2db9e640 1 -- 172.21.15.81:0/2091043949 learned_addr learned my addr 172.21.15.81:0/2091043949 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2d39d640 1 -- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 msgr2=0x7f4b280c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2d39d640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b280c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2d39d640 1 -- 172.21.15.81:0/2091043949 >> v1:172.21.15.117:6789/0 conn(0x7f4b280a94b0 legacy=0x7f4b280a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2d39d640 1 -- 172.21.15.81:0/2091043949 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28156080 con 0x7f4b280c30d0 2024-05-08T20:29:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2cb9c640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b280c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b2d39d640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280c30d0 0x7f4b280c34b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097f0 tx=0x7f4b2401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eccf71fc9b73daf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b1ffff640 1 -- 172.21.15.81:0/2091043949 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240ac640 con 0x7f4b280c30d0 2024-05-08T20:29:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b1ffff640 1 -- 172.21.15.81:0/2091043949 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b240ac7a0 con 0x7f4b280c30d0 2024-05-08T20:29:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.985+0000 7f4b1ffff640 1 -- 172.21.15.81:0/2091043949 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240acb30 con 0x7f4b280c30d0 2024-05-08T20:29:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280c30d0 msgr2=0x7f4b280c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280c30d0 0x7f4b280c34b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097f0 tx=0x7f4b2401c3e0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- 172.21.15.81:0/2091043949 shutdown_connections 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b280c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- 172.21.15.81:0/2091043949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280c30d0 0x7f4b280c34b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- 172.21.15.81:0/2091043949 >> 172.21.15.81:0/2091043949 conn(0x7f4b280c4cc0 msgr2=0x7f4b280c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- 172.21.15.81:0/2091043949 shutdown_connections 2024-05-08T20:29:17.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- 172.21.15.81:0/2091043949 wait complete. 2024-05-08T20:29:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 Processor -- start 2024-05-08T20:29:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- start start 2024-05-08T20:29:17.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b2815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b280c30d0 0x7f4b281eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28149be0 con 0x7f4b280c30d0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281ee1e0 con 0x7f4b280a94b0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2f601640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281ee4c0 con 0x7f4b280c2bc0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54244/0 (socket says 172.21.15.81:54244) 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2cb9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b2815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 -- 172.21.15.81:0/1162440773 learned_addr learned my addr 172.21.15.81:0/1162440773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2db9e640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b280c30d0 0x7f4b281eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 -- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 msgr2=0x7f4b2815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b2815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 -- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b280c30d0 msgr2=0x7f4b281eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b280c30d0 0x7f4b281eabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2d39d640 1 -- 172.21.15.81:0/1162440773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009420 con 0x7f4b280a94b0 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.989+0000 7f4b2cb9c640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b2815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b2d39d640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097f0 tx=0x7f4b2401ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240b8650 con 0x7f4b280a94b0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b240b87b0 con 0x7f4b280a94b0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240b8b60 con 0x7f4b280a94b0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b24009420 con 0x7f4b280a94b0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b281eea80 con 0x7f4b280a94b0 2024-05-08T20:29:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28074950 con 0x7f4b280a94b0 2024-05-08T20:29:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b240b8cc0 con 0x7f4b280a94b0 2024-05-08T20:29:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 0x7f4b0c06cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4b2411eff0 con 0x7f4b280a94b0 2024-05-08T20:29:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.993+0000 7f4b2cb9c640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 0x7f4b0c06cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:17.997+0000 7f4b2cb9c640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 0x7f4b0c06cf60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b2814a2f0 tx=0x7f4b18009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.005+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4b240ec1a0 con 0x7f4b280a94b0 2024-05-08T20:29:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.421+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4b280c29a0 con 0x7f4b280a94b0 2024-05-08T20:29:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.421+0000 7f4b1dffb640 1 -- 172.21.15.81:0/1162440773 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f4b240b1620 con 0x7f4b280a94b0 2024-05-08T20:29:18.426 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 msgr2=0x7f4b0c06cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 0x7f4b0c06cf60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b2814a2f0 tx=0x7f4b18009190 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 msgr2=0x7f4b280acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097f0 tx=0x7f4b2401ac20 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 shutdown_connections 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b0c06aaa0 0x7f4b0c06cf60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b280c30d0 0x7f4b281eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b280c2bc0 0x7f4b2815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 --2- 172.21.15.81:0/1162440773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280a94b0 0x7f4b280acb10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 >> 172.21.15.81:0/1162440773 conn(0x7f4b280c4cc0 msgr2=0x7f4b2814e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 shutdown_connections 2024-05-08T20:29:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.425+0000 7f4b2f601640 1 -- 172.21.15.81:0/1162440773 wait complete. 2024-05-08T20:29:18.448 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:29:18.448 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:29:18.448 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:29:18.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:29:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 Processor -- start 2024-05-08T20:29:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 -- start start 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d4155e10 con 0x7ff3d40c2bc0 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d4156080 con 0x7ff3d40a94b0 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dc7d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d406e790 con 0x7ff3d40c30d0 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dad6f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff3d40a94b0 0x7ff3d40a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38850/0 (socket says 172.21.15.81:38850) 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3da56e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3dad6f640 1 -- 172.21.15.81:0/2085682600 learned_addr learned my addr 172.21.15.81:0/2085682600 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3d9d6d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3d40c2bc0 0x7ff3d40c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35802/0 (socket says 172.21.15.81:35802) 2024-05-08T20:29:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3da56e640 1 -- 172.21.15.81:0/2085682600 >> v1:172.21.15.117:6789/0 conn(0x7ff3d40a94b0 legacy=0x7ff3d40a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3d956c640 1 -- 172.21.15.81:0/2085682600 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741440073 0 0) 0x7ff3d4156080 con 0x7ff3d40a94b0 2024-05-08T20:29:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3da56e640 1 -- 172.21.15.81:0/2085682600 >> v1:172.21.15.81:6789/0 conn(0x7ff3d40c2bc0 legacy=0x7ff3d40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.605+0000 7ff3da56e640 1 -- 172.21.15.81:0/2085682600 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4156360 con 0x7ff3d40c30d0 2024-05-08T20:29:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3da56e640 1 --2- 172.21.15.81:0/2085682600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d40c34b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00097f0 tx=0x7ff3d001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15862d97621e0c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3d956c640 1 -- 172.21.15.81:0/2085682600 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00ab400 con 0x7ff3d40c30d0 2024-05-08T20:29:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3d956c640 1 -- 172.21.15.81:0/2085682600 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d00a7050 con 0x7ff3d40c30d0 2024-05-08T20:29:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3d956c640 1 -- 172.21.15.81:0/2085682600 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00ab780 con 0x7ff3d40c30d0 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/2085682600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 msgr2=0x7ff3d40c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 --2- 172.21.15.81:0/2085682600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d40c34b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00097f0 tx=0x7ff3d001c2e0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/2085682600 shutdown_connections 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 --2- 172.21.15.81:0/2085682600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d40c34b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/2085682600 >> 172.21.15.81:0/2085682600 conn(0x7ff3d40c4cc0 msgr2=0x7ff3d40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/2085682600 shutdown_connections 2024-05-08T20:29:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.609+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/2085682600 wait complete. 2024-05-08T20:29:18.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 Processor -- start 2024-05-08T20:29:18.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- start start 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 0x7ff3d40c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d40c2bc0 0x7ff3d4155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d41ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d413f930 con 0x7ff3d40c2bc0 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d413fc10 con 0x7ff3d40a94b0 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d413fef0 con 0x7ff3d40c30d0 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 0x7ff3d40c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 0x7ff3d40c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54260/0 (socket says 172.21.15.81:54260) 2024-05-08T20:29:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 -- 172.21.15.81:0/1554836043 learned_addr learned my addr 172.21.15.81:0/1554836043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3d9d6d640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d40c2bc0 0x7ff3d4155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dad6f640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d41ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 msgr2=0x7ff3d41ee3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3d40c30d0 0x7ff3d41ee3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d40c2bc0 msgr2=0x7ff3d4155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d40c2bc0 0x7ff3d4155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0009420 con 0x7ff3d40a94b0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3da56e640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 0x7ff3d40c5ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0019f10 tx=0x7ff3d0019080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00abea0 con 0x7ff3d40a94b0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d00b5470 con 0x7ff3d40a94b0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00b5840 con 0x7ff3d40a94b0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d41401d0 con 0x7ff3d40a94b0 2024-05-08T20:29:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.613+0000 7ff3dc7d2640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d4155640 con 0x7ff3d40a94b0 2024-05-08T20:29:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3c8ff9640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 0x7ff3b0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0007e90 con 0x7ff3b0002a40 2024-05-08T20:29:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3d00b2040 con 0x7ff3d40a94b0 2024-05-08T20:29:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3b8066690 0x7ff3b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff3d011e860 con 0x7ff3d40a94b0 2024-05-08T20:29:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3d9d6d640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 0x7ff3b0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3dad6f640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3b8066690 0x7ff3b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3d9d6d640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3b0008050 con 0x7ff3b0002a40 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3d9d6d640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 0x7ff3b0004f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4153680 tx=0x7ff3c4013ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3dad6f640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3b8066690 0x7ff3b8068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4155be0 tx=0x7ff3cc0016c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c401c5f0 con 0x7ff3b0002a40 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff3c401c770 con 0x7ff3b0002a40 2024-05-08T20:29:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 msgr2=0x7ff3b0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 0x7ff3b0004f00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4153680 tx=0x7ff3c4013ca0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 msgr2=0x7ff3b0004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.617+0000 7ff3caffd640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0002a40 0x7ff3b0004f00 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4153680 tx=0x7ff3c4013ca0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.629+0000 7ff3c8ff9640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 0x7ff3b0007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.629+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b000a350 con 0x7ff3b0006ee0 2024-05-08T20:29:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.629+0000 7ff3d9d6d640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 0x7ff3b0007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.629+0000 7ff3d9d6d640 1 -- 172.21.15.81:0/1554836043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff3b000a510 con 0x7ff3b0006ee0 2024-05-08T20:29:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3d9d6d640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 0x7ff3b0007370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000c10 tx=0x7ff3c40012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c401be80 con 0x7ff3b0006ee0 2024-05-08T20:29:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7ff3c4001d10 con 0x7ff3b0006ee0 2024-05-08T20:29:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 msgr2=0x7ff3b0007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 0x7ff3b0007370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000c10 tx=0x7ff3c40012c0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 msgr2=0x7ff3b0007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3caffd640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3b0006ee0 0x7ff3b0007370 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000c10 tx=0x7ff3c40012c0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:29:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3b8066690 msgr2=0x7ff3b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3b8066690 0x7ff3b8068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4155be0 tx=0x7ff3cc0016c0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 msgr2=0x7ff3d40c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 --2- 172.21.15.81:0/1554836043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3d40a94b0 0x7ff3d40c5ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0019f10 tx=0x7ff3d0019080 comp rx=0 tx=0).stop 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3dad6f640 1 -- 172.21.15.81:0/1554836043 reap_dead start 2024-05-08T20:29:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3dad6f640 1 -- 172.21.15.81:0/1554836043 reap_dead start 2024-05-08T20:29:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 shutdown_connections 2024-05-08T20:29:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 >> 172.21.15.81:0/1554836043 conn(0x7ff3d40c4cc0 msgr2=0x7ff3d414d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 shutdown_connections 2024-05-08T20:29:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.633+0000 7ff3c8ff9640 1 -- 172.21.15.81:0/1554836043 wait complete. 2024-05-08T20:29:18.656 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:18.656 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:29:18.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:29:18.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 Processor -- start 2024-05-08T20:29:18.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 -- start start 2024-05-08T20:29:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b7406b230 0x7f6b740c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 0x7f6b7414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740c3a50 con 0x7f6b7414edf0 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b74072940 con 0x7f6b74070c00 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b7aee6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740705e0 con 0x7f6b7406b230 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b78c82640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b7406b230 0x7f6b740c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b73fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 0x7f6b7414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b79483640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6b7414edf0 0x7f6b741519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:51314/0 (socket says 172.21.15.81:51314) 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b79483640 1 -- 172.21.15.81:0/193710111 learned_addr learned my addr 172.21.15.81:0/193710111 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b78c82640 1 -- 172.21.15.81:0/193710111 >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 msgr2=0x7f6b7414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b78c82640 1 --2- 172.21.15.81:0/193710111 >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 0x7f6b7414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b78c82640 1 -- 172.21.15.81:0/193710111 >> v1:172.21.15.117:6789/0 conn(0x7f6b7414edf0 legacy=0x7f6b741519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b737fe640 1 -- 172.21.15.81:0/193710111 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364405907 0 0) 0x7f6b740c3a50 con 0x7f6b7414edf0 2024-05-08T20:29:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b78c82640 1 -- 172.21.15.81:0/193710111 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740708c0 con 0x7f6b7406b230 2024-05-08T20:29:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.813+0000 7f6b73fff640 1 --2- 172.21.15.81:0/193710111 >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 0x7f6b7414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b78c82640 1 --2- 172.21.15.81:0/193710111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b740c2800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b740c4d70 tx=0x7f6b6801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5021adbee5a64f01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b737fe640 1 -- 172.21.15.81:0/193710111 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a5760 con 0x7f6b7406b230 2024-05-08T20:29:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b737fe640 1 -- 172.21.15.81:0/193710111 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680a58c0 con 0x7f6b7406b230 2024-05-08T20:29:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b737fe640 1 -- 172.21.15.81:0/193710111 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a5c50 con 0x7f6b7406b230 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 -- 172.21.15.81:0/193710111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 msgr2=0x7f6b740c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 --2- 172.21.15.81:0/193710111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b740c2800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b740c4d70 tx=0x7f6b6801c890 comp rx=0 tx=0).stop 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 -- 172.21.15.81:0/193710111 shutdown_connections 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 --2- 172.21.15.81:0/193710111 >> v2:172.21.15.81:3300/0 conn(0x7f6b74070c00 0x7f6b7414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 --2- 172.21.15.81:0/193710111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b740c2800 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 -- 172.21.15.81:0/193710111 >> 172.21.15.81:0/193710111 conn(0x7f6b740c71b0 msgr2=0x7f6b740c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 -- 172.21.15.81:0/193710111 shutdown_connections 2024-05-08T20:29:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.817+0000 7f6b7aee6640 1 -- 172.21.15.81:0/193710111 wait complete. 2024-05-08T20:29:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 Processor -- start 2024-05-08T20:29:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- start start 2024-05-08T20:29:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b74141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b74070c00 0x7f6b7413f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7414edf0 0x7f6b7413fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741ec920 con 0x7f6b7414edf0 2024-05-08T20:29:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741e9010 con 0x7f6b7406b230 2024-05-08T20:29:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741e9fe0 con 0x7f6b74070c00 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b79483640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7414edf0 0x7f6b7413fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b74141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b73fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b74070c00 0x7f6b7413f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b74141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51056/0 (socket says 172.21.15.81:51056) 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 -- 172.21.15.81:0/1654207878 learned_addr learned my addr 172.21.15.81:0/1654207878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b74070c00 msgr2=0x7f6b7413f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b74070c00 0x7f6b7413f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7414edf0 msgr2=0x7f6b7413fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7414edf0 0x7f6b7413fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6000d8c0 con 0x7f6b7406b230 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b73fff640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b74070c00 0x7f6b7413f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b79483640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7414edf0 0x7f6b7413fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b78c82640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b74141bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b680194a0 tx=0x7f6b68019630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680ad850 con 0x7f6b7406b230 2024-05-08T20:29:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680ad9d0 con 0x7f6b7406b230 2024-05-08T20:29:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6800b4d0 con 0x7f6b7406b230 2024-05-08T20:29:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680add80 con 0x7f6b7406b230 2024-05-08T20:29:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.821+0000 7f6b7aee6640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b741e9500 con 0x7f6b7406b230 2024-05-08T20:29:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b680b4050 con 0x7f6b7406b230 2024-05-08T20:29:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b5effd640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 0x7f6b4c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c007e90 con 0x7f6b4c002a40 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b73fff640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 0x7f6b4c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b73fff640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b4c008050 con 0x7f6b4c002a40 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b58066690 0x7f6b58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b73fff640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 0x7f6b4c004f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b60003f30 tx=0x7f6b600128c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b79483640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b58066690 0x7f6b58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b79483640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b58066690 0x7f6b58068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b74145130 tx=0x7f6b6c001610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6b6811f0d0 con 0x7f6b7406b230 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60019650 con 0x7f6b4c002a40 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6b60013040 con 0x7f6b4c002a40 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 msgr2=0x7f6b4c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 0x7f6b4c004f00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b60003f30 tx=0x7f6b600128c0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 msgr2=0x7f6b4c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.825+0000 7f6b717fa640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c002a40 0x7f6b4c004f00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b5effd640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 0x7f6b4c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c00a350 con 0x7f6b4c006f70 2024-05-08T20:29:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b73fff640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 0x7f6b4c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b73fff640 1 -- 172.21.15.81:0/1654207878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b4c00a510 con 0x7f6b4c006f70 2024-05-08T20:29:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b73fff640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 0x7f6b4c0073e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001e000 tx=0x7f6b60004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600242d0 con 0x7f6b4c006f70 2024-05-08T20:29:18.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f6b6000b450 con 0x7f6b4c006f70 2024-05-08T20:29:18.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.837+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 msgr2=0x7f6b4c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b717fa640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 0x7f6b4c0073e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6b6001e000 tx=0x7f6b60004740 comp rx=0 tx=0).stop 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:18.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.844 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:18.846 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:18.847 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.849 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:18.851 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:18.852 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:18.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.854 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:18.855 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b717fa640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 msgr2=0x7f6b4c0073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b717fa640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b4c006f70 0x7f6b4c0073e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b58066690 msgr2=0x7f6b58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b58066690 0x7f6b58068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b74145130 tx=0x7f6b6c001610 comp rx=0 tx=0).stop 2024-05-08T20:29:18.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 msgr2=0x7f6b74141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 --2- 172.21.15.81:0/1654207878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b7406b230 0x7f6b74141bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b680194a0 tx=0x7f6b68019630 comp rx=0 tx=0).stop 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b79483640 1 -- 172.21.15.81:0/1654207878 reap_dead start 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b79483640 1 -- 172.21.15.81:0/1654207878 reap_dead start 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 shutdown_connections 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 >> 172.21.15.81:0/1654207878 conn(0x7f6b740c71b0 msgr2=0x7f6b7414fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 shutdown_connections 2024-05-08T20:29:18.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:18.841+0000 7f6b5effd640 1 -- 172.21.15.81:0/1654207878 wait complete. 2024-05-08T20:29:18.864 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:18.864 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:29:18.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:29:19.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 Processor -- start 2024-05-08T20:29:19.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 -- start start 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d18154cf0 0x7f6d18155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d18158e20 con 0x7f6d18155690 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1806bb20 con 0x7f6d18154cf0 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1cdf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181548e0 con 0x7f6d18151f00 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d0ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d18154cf0 0x7f6d18155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:44586/0 (socket says 172.21.15.81:44586) 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d16d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6d18155690 0x7f6d180ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:51330/0 (socket says 172.21.15.81:51330) 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 -- 172.21.15.81:0/2464320606 learned_addr learned my addr 172.21.15.81:0/2464320606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d15d9b640 1 -- 172.21.15.81:0/2464320606 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474776964 0 0) 0x7f6d18158e20 con 0x7f6d18155690 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 -- 172.21.15.81:0/2464320606 >> v2:172.21.15.117:3300/0 conn(0x7f6d18154cf0 msgr2=0x7f6d18155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 --2- 172.21.15.81:0/2464320606 >> v2:172.21.15.117:3300/0 conn(0x7f6d18154cf0 0x7f6d18155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 -- 172.21.15.81:0/2464320606 >> v1:172.21.15.117:6789/0 conn(0x7f6d18155690 legacy=0x7f6d180ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.021+0000 7f6d1659c640 1 -- 172.21.15.81:0/2464320606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d181522e0 con 0x7f6d18151f00 2024-05-08T20:29:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.025+0000 7f6d1659c640 1 --2- 172.21.15.81:0/2464320606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098a0 tx=0x7f6d0801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14791a38e36d1621 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.025+0000 7f6d15d9b640 1 -- 172.21.15.81:0/2464320606 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080ab640 con 0x7f6d18151f00 2024-05-08T20:29:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.025+0000 7f6d15d9b640 1 -- 172.21.15.81:0/2464320606 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080a7070 con 0x7f6d18151f00 2024-05-08T20:29:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.025+0000 7f6d15d9b640 1 -- 172.21.15.81:0/2464320606 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080ab9c0 con 0x7f6d18151f00 2024-05-08T20:29:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2464320606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 msgr2=0x7f6d181588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2464320606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098a0 tx=0x7f6d0801c440 comp rx=0 tx=0).stop 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2464320606 shutdown_connections 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2464320606 >> v2:172.21.15.117:3300/0 conn(0x7f6d18154cf0 0x7f6d18155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2464320606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18151f00 0x7f6d181588e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2464320606 >> 172.21.15.81:0/2464320606 conn(0x7f6d180715f0 msgr2=0x7f6d18071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2464320606 shutdown_connections 2024-05-08T20:29:19.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2464320606 wait complete. 2024-05-08T20:29:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 Processor -- start 2024-05-08T20:29:19.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- start start 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 0x7f6d180c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18154cf0 0x7f6d181ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d180acf60 0x7f6d181ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181f07d0 con 0x7f6d18151f00 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181f0ab0 con 0x7f6d180acf60 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.029+0000 7f6d1cdf5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181f0d90 con 0x7f6d18154cf0 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 0x7f6d180c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 0x7f6d180c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40370/0 (socket says 172.21.15.81:40370) 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 -- 172.21.15.81:0/2050541091 learned_addr learned my addr 172.21.15.81:0/2050541091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d16d9d640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d180acf60 0x7f6d181ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18154cf0 0x7f6d181ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18154cf0 msgr2=0x7f6d181ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18154cf0 0x7f6d181ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d180acf60 msgr2=0x7f6d181ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d180acf60 0x7f6d181ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080094d0 con 0x7f6d18151f00 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d16d9d640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d180acf60 0x7f6d181ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18154cf0 0x7f6d181ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1659c640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 0x7f6d180c8480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6d080ad040 tx=0x7f6d0801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080abe60 con 0x7f6d18151f00 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080be3f0 con 0x7f6d18151f00 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d181f1070 con 0x7f6d18151f00 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080be7a0 con 0x7f6d18151f00 2024-05-08T20:29:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d180ab570 con 0x7f6d18151f00 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 0x7f6d181496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18069600 con 0x7f6d181edd40 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d080c7440 con 0x7f6d18151f00 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 0x7f6d181496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.033+0000 7f6d0effd640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cf80666c0 0x7f6cf8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.037+0000 7f6d0ffff640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d181f0c20 con 0x7f6d181edd40 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.037+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6d0811ec60 con 0x7f6d18151f00 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.037+0000 7f6d16d9d640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cf80666c0 0x7f6cf8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.037+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 0x7f6d181496d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d18150b60 tx=0x7f6d00011c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.037+0000 7f6d16d9d640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cf80666c0 0x7f6cf8068b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ad3f0 tx=0x7f6d100016c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000fa30 con 0x7f6d181edd40 2024-05-08T20:29:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6d0000fb90 con 0x7f6d181edd40 2024-05-08T20:29:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 msgr2=0x7f6d181496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 0x7f6d181496d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d18150b60 tx=0x7f6d00011c90 comp rx=0 tx=0).stop 2024-05-08T20:29:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 msgr2=0x7f6d181496d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:19.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.041+0000 7f6d0effd640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d181edd40 0x7f6d181496d0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d18150b60 tx=0x7f6d00011c90 comp rx=0 tx=0).stop 2024-05-08T20:29:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.049+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 0x7f6d18149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.049+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180cab20 con 0x7f6d18155640 2024-05-08T20:29:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.049+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 0x7f6d18149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0ffff640 1 -- 172.21.15.81:0/2050541091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6d180c6820 con 0x7f6d18155640 2024-05-08T20:29:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 0x7f6d18149c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d18150b60 tx=0x7f6d000046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00022780 con 0x7f6d18155640 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7f6d00026070 con 0x7f6d18155640 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 msgr2=0x7f6d18149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 0x7f6d18149c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d18150b60 tx=0x7f6d000046d0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 msgr2=0x7f6d18149c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d0effd640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d18155640 0x7f6d18149c10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:19.068 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cf80666c0 msgr2=0x7f6cf8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cf80666c0 0x7f6cf8068b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ad3f0 tx=0x7f6d100016c0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 msgr2=0x7f6d180c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 --2- 172.21.15.81:0/2050541091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d18151f00 0x7f6d180c8480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6d080ad040 tx=0x7f6d0801ac80 comp rx=0 tx=0).stop 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d16d9d640 1 -- 172.21.15.81:0/2050541091 reap_dead start 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d16d9d640 1 -- 172.21.15.81:0/2050541091 reap_dead start 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 shutdown_connections 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 >> 172.21.15.81:0/2050541091 conn(0x7f6d180715f0 msgr2=0x7f6d18069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 shutdown_connections 2024-05-08T20:29:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.053+0000 7f6d1cdf5640 1 -- 172.21.15.81:0/2050541091 wait complete. 2024-05-08T20:29:19.076 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:19.077 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:29:19.077 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:29:19.077 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:29:19.077 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:29:19.077 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:29:19.077 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:29:19.090 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:29:19.090 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:29:19.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:19.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:29:19.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:29:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 Processor -- start 2024-05-08T20:29:19.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 -- start start 2024-05-08T20:29:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e280a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e28155670 0x7f1e280bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e280c1730 con 0x7f1e280c0230 2024-05-08T20:29:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280c1a10 con 0x7f1e28155670 2024-05-08T20:29:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2f9a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28154980 con 0x7f1e2806d130 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2d745640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 msgr2=0x7f1e280a5e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.241+0000 7f1e2d745640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e280a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e28155670 0x7f1e280bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e28155670 0x7f1e280bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51100/0 (socket says 172.21.15.81:51100) 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 -- 172.21.15.81:0/2661644388 learned_addr learned my addr 172.21.15.81:0/2661644388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2df46640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1e280c0230 0x7f1e280c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:51336/0 (socket says 172.21.15.81:51336) 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 -- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 msgr2=0x7f1e280a5e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 --2- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e280a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 -- 172.21.15.81:0/2661644388 >> v1:172.21.15.117:6789/0 conn(0x7f1e280c0230 legacy=0x7f1e280c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 -- 172.21.15.81:0/2661644388 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28154b90 con 0x7f1e28155670 2024-05-08T20:29:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e1ffff640 1 -- 172.21.15.81:0/2661644388 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898054267 0 0) 0x7f1e280c1730 con 0x7f1e280c0230 2024-05-08T20:29:19.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e2cf44640 1 --2- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e28155670 0x7f1e280bfcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1801c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f32e218ce68ea5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e1ffff640 1 -- 172.21.15.81:0/2661644388 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180ad680 con 0x7f1e28155670 2024-05-08T20:29:19.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e1ffff640 1 -- 172.21.15.81:0/2661644388 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180ad7e0 con 0x7f1e28155670 2024-05-08T20:29:19.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.245+0000 7f1e1ffff640 1 -- 172.21.15.81:0/2661644388 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180adb70 con 0x7f1e28155670 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e28155670 msgr2=0x7f1e280bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e28155670 0x7f1e280bfcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1801c580 comp rx=0 tx=0).stop 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/2661644388 shutdown_connections 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e28155670 0x7f1e280bfcf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/2661644388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e280a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/2661644388 >> 172.21.15.81:0/2661644388 conn(0x7f1e280c68c0 msgr2=0x7f1e280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/2661644388 shutdown_connections 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/2661644388 wait complete. 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 Processor -- start 2024-05-08T20:29:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 -- start start 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e281f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.249+0000 7f1e2f9a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2d745640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 msgr2=0x7f1e281f0740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2d745640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e281f0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2cf44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40394/0 (socket says 172.21.15.81:40394) 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2cf44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51102/0 (socket says 172.21.15.81:51102) 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 -- 172.21.15.81:0/4230676233 learned_addr learned my addr 172.21.15.81:0/4230676233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280a8d20 con 0x7f1e28155670 2024-05-08T20:29:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280a8510 con 0x7f1e280c0230 2024-05-08T20:29:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280c0930 con 0x7f1e2806d130 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 -- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 msgr2=0x7f1e281f0740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e281f0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 -- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 msgr2=0x7f1e281f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180094d0 con 0x7f1e28155670 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2cf44640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2df46640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1e20001570 tx=0x7f1e2000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000a640 con 0x7f1e28155670 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000a7a0 con 0x7f1e28155670 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e281f11c0 con 0x7f1e28155670 2024-05-08T20:29:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000ab90 con 0x7f1e28155670 2024-05-08T20:29:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280a8760 con 0x7f1e28155670 2024-05-08T20:29:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.253+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e28074950 con 0x7f1e28155670 2024-05-08T20:29:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.257+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e2000acf0 con 0x7f1e28155670 2024-05-08T20:29:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.257+0000 7f1e1dffb640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 0x7f1e0c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.257+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1e20083eb0 con 0x7f1e28155670 2024-05-08T20:29:19.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.261+0000 7f1e2d745640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 0x7f1e0c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:19.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.261+0000 7f1e2d745640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 0x7f1e0c068b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e24003940 tx=0x7f1e24006d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:19.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.261+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1e200510a0 con 0x7f1e28155670 2024-05-08T20:29:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1e28065d50 con 0x7f1e28155670 2024-05-08T20:29:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e1dffb640 1 -- 172.21.15.81:0/4230676233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1e20018020 con 0x7f1e28155670 2024-05-08T20:29:19.688 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 msgr2=0x7f1e0c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 0x7f1e0c068b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e24003940 tx=0x7f1e24006d90 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 msgr2=0x7f1e281ee800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.685+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1e20001570 tx=0x7f1e2000cc70 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 shutdown_connections 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e0c066640 0x7f1e0c068b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e28155670 0x7f1e281ee800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e280c0230 0x7f1e281f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 --2- 172.21.15.81:0/4230676233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806d130 0x7f1e281f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 >> 172.21.15.81:0/4230676233 conn(0x7f1e280c68c0 msgr2=0x7f1e280c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 shutdown_connections 2024-05-08T20:29:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:19.689+0000 7f1e2f9a9640 1 -- 172.21.15.81:0/4230676233 wait complete. 2024-05-08T20:29:22.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 Processor -- start 2024-05-08T20:29:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 -- start start 2024-05-08T20:29:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 0x7f9dc8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9dc80c34e0 0x7f9dc81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc8158080 con 0x7f9dc8152340 2024-05-08T20:29:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc806ab70 con 0x7f9dc80c34e0 2024-05-08T20:29:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dcd078640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8154b10 con 0x7f9dc80c2570 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dbffff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 msgr2=0x7f9dc8154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 0x7f9dc8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dc6d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9dc8152340 0x7f9dc806d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:51342/0 (socket says 172.21.15.81:51342) 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dc759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9dc80c34e0 0x7f9dc81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.829+0000 7f9dc6d9d640 1 -- 172.21.15.81:0/2027731045 learned_addr learned my addr 172.21.15.81:0/2027731045 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc759e640 1 -- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 msgr2=0x7f9dc8154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc759e640 1 --2- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 0x7f9dc8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc759e640 1 -- 172.21.15.81:0/2027731045 >> v1:172.21.15.117:6789/0 conn(0x7f9dc8152340 legacy=0x7f9dc806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc759e640 1 -- 172.21.15.81:0/2027731045 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc806a890 con 0x7f9dc80c34e0 2024-05-08T20:29:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc759e640 1 --2- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc80c34e0 0x7f9dc81554a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009d90 tx=0x7f9dc001c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d51830d6fa19331 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc659c640 1 -- 172.21.15.81:0/2027731045 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00a5990 con 0x7f9dc80c34e0 2024-05-08T20:29:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc659c640 1 -- 172.21.15.81:0/2027731045 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc00a5af0 con 0x7f9dc80c34e0 2024-05-08T20:29:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dc659c640 1 -- 172.21.15.81:0/2027731045 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00a5e80 con 0x7f9dc80c34e0 2024-05-08T20:29:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 -- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc80c34e0 msgr2=0x7f9dc81554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc80c34e0 0x7f9dc81554a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009d90 tx=0x7f9dc001c8d0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 -- 172.21.15.81:0/2027731045 shutdown_connections 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc80c34e0 0x7f9dc81554a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2027731045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c2570 0x7f9dc8154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 -- 172.21.15.81:0/2027731045 >> 172.21.15.81:0/2027731045 conn(0x7f9dc80c71b0 msgr2=0x7f9dc80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 -- 172.21.15.81:0/2027731045 shutdown_connections 2024-05-08T20:29:22.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.833+0000 7f9dcd078640 1 -- 172.21.15.81:0/2027731045 wait complete. 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 Processor -- start 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- start start 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 0x7f9dc8071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc8152340 0x7f9dc814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc81ecc70 con 0x7f9dc80c2570 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8070b60 con 0x7f9dc8152340 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc8070e40 con 0x7f9dc80c34e0 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbffff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 msgr2=0x7f9dc8071400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 0x7f9dc8071400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40408/0 (socket says 172.21.15.81:40408) 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 -- 172.21.15.81:0/2299709697 learned_addr learned my addr 172.21.15.81:0/2299709697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc759e640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc8152340 0x7f9dc814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 -- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 msgr2=0x7f9dc8071400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 0x7f9dc8071400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 -- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc8152340 msgr2=0x7f9dc814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc8152340 0x7f9dc814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 -- 172.21.15.81:0/2299709697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0009a70 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dc6d9d640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c400 tx=0x7f9db000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0005cf0 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db0005e50 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc8071120 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00072d0 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc814d8a0 con 0x7f9dc80c2570 2024-05-08T20:29:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc80675e0 con 0x7f9dc80c2570 2024-05-08T20:29:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.837+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9db0007430 con 0x7f9dc80c2570 2024-05-08T20:29:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.841+0000 7f9dbf7fe640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 0x7f9da8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.841+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9db00839d0 con 0x7f9dc80c2570 2024-05-08T20:29:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.841+0000 7f9dbffff640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 0x7f9da8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.841+0000 7f9dbffff640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 0x7f9da8068b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9db8003940 tx=0x7f9db8006d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:22.849+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9db0050a40 con 0x7f9dc80c2570 2024-05-08T20:29:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9dc8074950 con 0x7f9dc80c2570 2024-05-08T20:29:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dbf7fe640 1 -- 172.21.15.81:0/2299709697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f9db0017620 con 0x7f9dc80c2570 2024-05-08T20:29:23.071 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:23.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 msgr2=0x7f9da8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 0x7f9da8068b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9db8003940 tx=0x7f9db8006d90 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 msgr2=0x7f9dc814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c400 tx=0x7f9db000c8c0 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 shutdown_connections 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9da8066640 0x7f9da8068b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dc8152340 0x7f9dc814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9dc80c34e0 0x7f9dc8071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 --2- 172.21.15.81:0/2299709697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c2570 0x7f9dc814fb70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 >> 172.21.15.81:0/2299709697 conn(0x7f9dc80c71b0 msgr2=0x7f9dc80c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 shutdown_connections 2024-05-08T20:29:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:23.069+0000 7f9dcd078640 1 -- 172.21.15.81:0/2299709697 wait complete. 2024-05-08T20:29:23.881 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T20:29:23.881 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-05-08T20:29:23.882 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.883 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T20:29:23.883 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-08T20:29:23.883 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:29:23.889 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T20:29:23.898 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T20:29:23.898 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:29:23.898 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T20:29:24.377 INFO:tasks.workunit.client.1.smithi117.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T20:29:24.377 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: git switch -c 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:Or undo this operation with: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: git switch - 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.378 INFO:tasks.workunit.client.1.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T20:29:24.379 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-08T20:29:24.379 INFO:tasks.workunit.client.1.smithi117.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:29:24.384 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-08T20:29:24.391 INFO:tasks.workunit.client.1.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T20:29:24.394 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-08T20:29:24.394 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T20:29:24.621 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T20:29:24.700 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T20:29:24.762 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:29:24.763 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:29:24.763 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T20:29:24.806 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:29:24.809 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:29:24.810 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T20:29:24.855 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-05-08T20:29:24.857 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-08T20:29:24.857 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-08T20:29:24.921 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into 'ffsb'... 2024-05-08T20:29:25.361 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T20:29:25.452 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T20:29:25.505 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-08T20:29:25.506 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-08T20:29:25.506 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T20:29:25.556 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-08T20:29:25.559 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:29:25.559 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-08T20:29:25.610 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-05-08T20:29:25.611 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-08T20:29:25.611 DEBUG:teuthology.orchestra.run.smithi117:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-05-08T20:29:25.679 INFO:tasks.workunit.client.1.smithi117.stderr:Cloning into 'ffsb'... 2024-05-08T20:29:26.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 Processor -- start 2024-05-08T20:29:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 -- start start 2024-05-08T20:29:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd041501e0 0x7fcd0406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 0x7fcd040c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040c0650 con 0x7fcd0406f400 2024-05-08T20:29:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0406fd60 con 0x7fcd041501e0 2024-05-08T20:29:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd0c062640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04072180 con 0x7fcd040725f0 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd095fd640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 msgr2=0x7fcd040c1c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd095fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 0x7fcd040c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd041501e0 0x7fcd0406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd041501e0 0x7fcd0406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40414/0 (socket says 172.21.15.81:40414) 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 -- 172.21.15.81:0/4101944663 learned_addr learned my addr 172.21.15.81:0/4101944663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 -- 172.21.15.81:0/4101944663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 msgr2=0x7fcd040c1c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 --2- 172.21.15.81:0/4101944663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 0x7fcd040c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 -- 172.21.15.81:0/4101944663 >> v1:172.21.15.117:6789/0 conn(0x7fcd0406f400 legacy=0x7fcd040c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.217+0000 7fcd09dfe640 1 -- 172.21.15.81:0/4101944663 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0406fa80 con 0x7fcd041501e0 2024-05-08T20:29:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd09dfe640 1 --2- 172.21.15.81:0/4101944663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd041501e0 0x7fcd0406c930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd0001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5472ba629e8ba531 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd08dfc640 1 -- 172.21.15.81:0/4101944663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd000ab650 con 0x7fcd041501e0 2024-05-08T20:29:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd08dfc640 1 -- 172.21.15.81:0/4101944663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd000ab7b0 con 0x7fcd041501e0 2024-05-08T20:29:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd08dfc640 1 -- 172.21.15.81:0/4101944663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd000abb40 con 0x7fcd041501e0 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- 172.21.15.81:0/4101944663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd041501e0 msgr2=0x7fcd0406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 --2- 172.21.15.81:0/4101944663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd041501e0 0x7fcd0406c930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd0001c430 comp rx=0 tx=0).stop 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- 172.21.15.81:0/4101944663 shutdown_connections 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 --2- 172.21.15.81:0/4101944663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd040725f0 0x7fcd040c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 --2- 172.21.15.81:0/4101944663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd041501e0 0x7fcd0406c930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- 172.21.15.81:0/4101944663 >> 172.21.15.81:0/4101944663 conn(0x7fcd040c2ca0 msgr2=0x7fcd040c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- 172.21.15.81:0/4101944663 shutdown_connections 2024-05-08T20:29:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- 172.21.15.81:0/4101944663 wait complete. 2024-05-08T20:29:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 Processor -- start 2024-05-08T20:29:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.221+0000 7fcd0c062640 1 -- start start 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 0x7fcd04146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd041501e0 0x7fcd041eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd041eb1f0 con 0x7fcd040725f0 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04144650 con 0x7fcd041501e0 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04144930 con 0x7fcd0406f400 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd09dfe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 msgr2=0x7fcd04146700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd09dfe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 0x7fcd04146700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40428/0 (socket says 172.21.15.81:40428) 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 -- 172.21.15.81:0/3580863310 learned_addr learned my addr 172.21.15.81:0/3580863310 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0a5ff640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd041501e0 0x7fcd041eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 -- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 msgr2=0x7fcd04146700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:26.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 0x7fcd04146700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 -- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd041501e0 msgr2=0x7fcd041eeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd041501e0 0x7fcd041eeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 -- 172.21.15.81:0/3580863310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000094d0 con 0x7fcd040725f0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd095fd640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b530 tx=0x7fccf400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4003dd0 con 0x7fcd040725f0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4005070 con 0x7fcd040725f0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4005420 con 0x7fcd040725f0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd04150740 con 0x7fcd040725f0 2024-05-08T20:29:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd04144ef0 con 0x7fcd040725f0 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd04074950 con 0x7fcd040725f0 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccf4005580 con 0x7fcd040725f0 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 0x7fcce8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fccf4084230 con 0x7fcd040725f0 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd09dfe640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 0x7fcce8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.225+0000 7fcd09dfe640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 0x7fcce8068b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcd000af000 tx=0x7fcd00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.233+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fccf4051290 con 0x7fcd040725f0 2024-05-08T20:29:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.469+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcd04150b70 con 0x7fcd040725f0 2024-05-08T20:29:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.469+0000 7fccfa7fc640 1 -- 172.21.15.81:0/3580863310 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fccf40548b0 con 0x7fcd040725f0 2024-05-08T20:29:26.473 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 msgr2=0x7fcce8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 0x7fcce8068b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcd000af000 tx=0x7fcd00008040 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 msgr2=0x7fcd0414c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b530 tx=0x7fccf400b9f0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 shutdown_connections 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcce8066640 0x7fcce8068b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd041501e0 0x7fcd041eeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd040725f0 0x7fcd0414c200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 --2- 172.21.15.81:0/3580863310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd0406f400 0x7fcd04146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 >> 172.21.15.81:0/3580863310 conn(0x7fcd040c2ca0 msgr2=0x7fcd0406bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 shutdown_connections 2024-05-08T20:29:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:26.473+0000 7fcd0c062640 1 -- 172.21.15.81:0/3580863310 wait complete. 2024-05-08T20:29:29.472 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-05-08T20:29:29.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:29.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 Processor -- start 2024-05-08T20:29:29.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 -- start start 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb8155e10 con 0x7f4bb80c30d0 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb8156080 con 0x7f4bb80c2bc0 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bc0600640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb806e790 con 0x7f4bb80a9bc0 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbeb9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbe39c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4bb80c30d0 0x7f4bb80c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60430/0 (socket says 172.21.15.81:60430) 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 learned_addr learned my addr 172.21.15.81:0/2446861393 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.625+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.829+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.829+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:29:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.829+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.829+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:29.829+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:29:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:30.233+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:30.233+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:29:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:30.233+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:30.233+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:30.233+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:29:30.271 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T20:29:31.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:31.037+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:31.037+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:29:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:31.037+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:31.037+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:31.037+0000 7f4bbeb9d640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:29:31.556 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether build environment is sane... yes 2024-05-08T20:29:31.576 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-08T20:29:31.577 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gawk... gawk 2024-05-08T20:29:31.608 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T20:29:31.659 INFO:tasks.workunit.client.0.smithi081.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:31.659 INFO:tasks.workunit.client.0.smithi081.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:31.681 INFO:tasks.workunit.client.0.smithi081.stdout:checking for style of include used by make... GNU 2024-05-08T20:29:31.686 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... gcc 2024-05-08T20:29:31.741 INFO:tasks.workunit.client.1.smithi117.stderr:Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-05-08T20:29:31.784 INFO:tasks.workunit.client.0.smithi081.stdout:checking for C compiler default output file name... a.out 2024-05-08T20:29:31.787 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the C compiler works... yes 2024-05-08T20:29:31.790 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are cross compiling... no 2024-05-08T20:29:31.849 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of executables... 2024-05-08T20:29:31.893 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of object files... o 2024-05-08T20:29:31.933 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2024-05-08T20:29:31.973 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... yes 2024-05-08T20:29:32.045 INFO:tasks.workunit.client.1.smithi117.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T20:29:32.106 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-08T20:29:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 msgr2=0x7f4bb80c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.81:3300/0 conn(0x7f4bb80a9bc0 0x7f4bb80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 -- 172.21.15.81:0/2446861393 >> v1:172.21.15.117:6789/0 conn(0x7f4bb80c2bc0 legacy=0x7f4bb80a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 -- 172.21.15.81:0/2446861393 >> v1:172.21.15.81:6789/0 conn(0x7f4bb80c30d0 legacy=0x7f4bb80c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 -- 172.21.15.81:0/2446861393 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb806e790 con 0x7f4b9c0036f0 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4baffff640 1 -- 172.21.15.81:0/2446861393 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c008d40 con 0x7f4b9c006190 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 msgr2=0x7f4b9c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:32.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.625+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 msgr2=0x7f4b9c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:29:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:29:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:32.829+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:29:33.062 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether build environment is sane... yes 2024-05-08T20:29:33.084 INFO:tasks.workunit.client.1.smithi117.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-08T20:29:33.085 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gawk... gawk 2024-05-08T20:29:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 msgr2=0x7f4b9c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:29:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:29:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:33.233+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:29:33.731 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T20:29:33.802 INFO:tasks.workunit.client.1.smithi117.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:33.802 INFO:tasks.workunit.client.1.smithi117.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:33.834 INFO:tasks.workunit.client.1.smithi117.stdout:checking for style of include used by make... GNU 2024-05-08T20:29:33.843 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc... gcc 2024-05-08T20:29:33.889 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... gcc3 2024-05-08T20:29:33.957 INFO:tasks.workunit.client.1.smithi117.stdout:checking for C compiler default output file name... a.out 2024-05-08T20:29:33.960 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether the C compiler works... yes 2024-05-08T20:29:33.964 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether we are cross compiling... no 2024-05-08T20:29:34.025 INFO:tasks.workunit.client.1.smithi117.stdout:checking for suffix of executables... 2024-05-08T20:29:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 msgr2=0x7f4b9c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:29:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> v2:172.21.15.117:3300/0 conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 msgr2=0x7f4b9c008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9c006190 0x7f4b9c008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.037+0000 7f4bbe39c640 1 -- 172.21.15.81:0/2446861393 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8156360 con 0x7f4b9c0036f0 2024-05-08T20:29:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9c0036f0 0x7f4b9c005b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4007d30 tx=0x7f4bb401caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cac50a25713cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bbd39a640 1 -- 172.21.15.81:0/2446861393 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40a58c0 con 0x7f4b9c0036f0 2024-05-08T20:29:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bbd39a640 1 -- 172.21.15.81:0/2446861393 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40a9070 con 0x7f4b9c0036f0 2024-05-08T20:29:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bbd39a640 1 -- 172.21.15.81:0/2446861393 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40a5c20 con 0x7f4b9c0036f0 2024-05-08T20:29:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bc0600640 1 -- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9c0036f0 msgr2=0x7f4b9c005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bc0600640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9c0036f0 0x7f4b9c005b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4007d30 tx=0x7f4bb401caf0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.041+0000 7f4bbeb9d640 1 -- 172.21.15.81:0/2446861393 reap_dead start 2024-05-08T20:29:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/2446861393 shutdown_connections 2024-05-08T20:29:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 --2- 172.21.15.81:0/2446861393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b9c0036f0 0x7f4b9c005b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/2446861393 >> 172.21.15.81:0/2446861393 conn(0x7f4bb80c4cc0 msgr2=0x7f4bb80c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/2446861393 shutdown_connections 2024-05-08T20:29:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/2446861393 wait complete. 2024-05-08T20:29:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 Processor -- start 2024-05-08T20:29:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- start start 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 0x7f4bb81eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 0x7f4bb8148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80ae260 con 0x7f4b9c0036f0 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb81ef100 con 0x7f4bb815d3d0 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb815d940 con 0x7f4bb8143890 2024-05-08T20:29:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbeb9d640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 msgr2=0x7f4bb8148070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbeb9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 0x7f4bb8148070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbe39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 0x7f4bb81eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52206/0 (socket says 172.21.15.81:52206) 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/1531461162 learned_addr learned my addr 172.21.15.81:0/1531461162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 msgr2=0x7f4bb8148070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 0x7f4bb8148070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 msgr2=0x7f4bb81eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 0x7f4bb81eb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 -- 172.21.15.81:0/1531461162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb400f040 con 0x7f4bb815d3d0 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 0x7f4bb81eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:29:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bbdb9b640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c550 tx=0x7f4ba800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8007480 con 0x7f4bb815d3d0 2024-05-08T20:29:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba80075e0 con 0x7f4bb815d3d0 2024-05-08T20:29:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8005a10 con 0x7f4bb815d3d0 2024-05-08T20:29:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb815dc20 con 0x7f4bb815d3d0 2024-05-08T20:29:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.045+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb81eb2a0 con 0x7f4bb815d3d0 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb8074950 con 0x7f4bb815d3d0 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ba8005b70 con 0x7f4bb815d3d0 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4baeffd640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 0x7f4b9c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4ba8083690 con 0x7f4bb815d3d0 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 0x7f4b9c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.049+0000 7f4bbe39c640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 0x7f4b9c069930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40b0000 tx=0x7f4bb40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.057+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4ba8050680 con 0x7f4bb815d3d0 2024-05-08T20:29:34.074 INFO:tasks.workunit.client.1.smithi117.stdout:checking for suffix of object files... o 2024-05-08T20:29:34.117 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether we are using the GNU C compiler... yes 2024-05-08T20:29:34.173 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether gcc accepts -g... yes 2024-05-08T20:29:34.182 INFO:tasks.workunit.client.0.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2024-05-08T20:29:34.240 INFO:tasks.workunit.client.0.smithi081.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T20:29:34.242 INFO:tasks.workunit.client.0.smithi081.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T20:29:34.255 INFO:tasks.workunit.client.0.smithi081.stdout:checking for AIX... no 2024-05-08T20:29:34.267 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-08T20:29:34.283 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... (cached) gcc 2024-05-08T20:29:34.298 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-08T20:29:34.299 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T20:29:34.300 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-08T20:29:34.300 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T20:29:34.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4bb815ddb0 con 0x7f4bb815d3d0 2024-05-08T20:29:34.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4baeffd640 1 -- 172.21.15.81:0/1531461162 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f4ba8017620 con 0x7f4bb815d3d0 2024-05-08T20:29:34.319 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":16,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 msgr2=0x7f4b9c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 0x7f4b9c069930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40b0000 tx=0x7f4bb40a7070 comp rx=0 tx=0).stop 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 msgr2=0x7f4bb81eebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c550 tx=0x7f4ba800ca10 comp rx=0 tx=0).stop 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 shutdown_connections 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b9c067470 0x7f4b9c069930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4bb8143890 0x7f4bb8148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb815d3d0 0x7f4bb81eebc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 --2- 172.21.15.81:0/1531461162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b9c0036f0 0x7f4bb81eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 >> 172.21.15.81:0/1531461162 conn(0x7f4bb80c4cc0 msgr2=0x7f4bb80c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 shutdown_connections 2024-05-08T20:29:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.317+0000 7f4bc0600640 1 -- 172.21.15.81:0/1531461162 wait complete. 2024-05-08T20:29:34.342 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:29:34.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:29:34.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:29:34.414 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lm... yes 2024-05-08T20:29:34.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 Processor -- start 2024-05-08T20:29:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 -- start start 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20e4152340 0x7f20e406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20e4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e4158080 con 0x7f20e406d7d0 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e406ab70 con 0x7f20e4152340 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.465+0000 7f20e8cae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4154b10 con 0x7f20e40c2570 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20dbfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 msgr2=0x7f20e4154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f20e406d7d0 0x7f20e41554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60432/0 (socket says 172.21.15.81:60432) 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 -- 172.21.15.81:0/4059302145 learned_addr learned my addr 172.21.15.81:0/4059302145 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20dbfff640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20e4154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e259c640 1 --2- 172.21.15.81:0/4059302145 >> v2:172.21.15.117:3300/0 conn(0x7f20e4152340 0x7f20e406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757217731 0 0) 0x7f20e4158080 con 0x7f20e406d7d0 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d0003530 con 0x7f20e406d7d0 2024-05-08T20:29:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620047078 0 0) 0x7f20d0003530 con 0x7f20e406d7d0 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 msgr2=0x7f20e4154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20e4154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 >> v2:172.21.15.117:3300/0 conn(0x7f20e4152340 msgr2=0x7f20e406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 --2- 172.21.15.81:0/4059302145 >> v2:172.21.15.117:3300/0 conn(0x7f20e4152340 0x7f20e406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e406a890 con 0x7f20e406d7d0 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f20dc001a00 con 0x7f20e406d7d0 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 >> v1:172.21.15.81:6789/0 conn(0x7f20e406d7d0 legacy=0x7f20e41554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d0003980 0x7f20d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d0004d10 0x7f20d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e406ab70 con 0x7f20d0004d10 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4154b10 con 0x7f20d0003980 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000baf0 con 0x7f20e40c2570 2024-05-08T20:29:34.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20dbfff640 1 -- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 msgr2=0x7f20d00047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20dbfff640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20d00047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d0004d10 0x7f20d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e259c640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d0003980 0x7f20d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 -- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 msgr2=0x7f20d00047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e40c2570 0x7f20d00047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 -- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d0003980 msgr2=0x7f20d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d0003980 0x7f20d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 -- 172.21.15.81:0/4059302145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0003530 con 0x7f20d0004d10 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d0004d10 0x7f20d0005190 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a830 tx=0x7f20dc01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16899b2c6e2ef922 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0aa6f0 con 0x7f20d0004d10 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0aa850 con 0x7f20d0004d10 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.469+0000 7f20e1d9b640 1 -- 172.21.15.81:0/4059302145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0aac00 con 0x7f20d0004d10 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/4059302145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d0004d10 msgr2=0x7f20d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 --2- 172.21.15.81:0/4059302145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d0004d10 0x7f20d0005190 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a830 tx=0x7f20dc01fac0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 -- 172.21.15.81:0/4059302145 reap_dead start 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/4059302145 shutdown_connections 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/4059302145 >> 172.21.15.81:0/4059302145 conn(0x7f20e40c71b0 msgr2=0x7f20e40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/4059302145 shutdown_connections 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/4059302145 wait complete. 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 Processor -- start 2024-05-08T20:29:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- start start 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e40ac710 0x7f20e4139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e41483f0 0x7f20e4139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 0x7f20e414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e413a290 con 0x7f20e4147ea0 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e414ee40 con 0x7f20e40ac710 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41edb00 con 0x7f20e41483f0 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20dbfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e41483f0 msgr2=0x7f20e4139d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 0x7f20e414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20dbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e41483f0 0x7f20e4139d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 0x7f20e414cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53600/0 (socket says 172.21.15.81:53600) 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 learned_addr learned my addr 172.21.15.81:0/2619362940 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e259c640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e40ac710 0x7f20e4139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e41483f0 msgr2=0x7f20e4139d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:34.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e41483f0 0x7f20e4139d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e40ac710 msgr2=0x7f20e4139810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e40ac710 0x7f20e4139810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e41edda0 con 0x7f20e4147ea0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e2d9d640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 0x7f20e414cb90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a920 tx=0x7f20d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0b7070 con 0x7f20e4147ea0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0aa4f0 con 0x7f20e4147ea0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e41ee080 con 0x7f20e4147ea0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0aabc0 con 0x7f20e4147ea0 2024-05-08T20:29:34.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.473+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e41ee640 con 0x7f20e4147ea0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20e8cae640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 0x7f20e414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4069550 con 0x7f20e414d0d0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20e259c640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 0x7f20e414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20e259c640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20e4154440 con 0x7f20e414d0d0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20e259c640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 0x7f20e414d4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f20d4013680 tx=0x7f20d4013b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011ab0 con 0x7f20e414d0d0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20dc0ba070 con 0x7f20e4147ea0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f20c4066730 0x7f20c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f20dc121380 con 0x7f20e4147ea0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20dbfff640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f20c4066730 0x7f20c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f20d4011c10 con 0x7f20e414d0d0 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 msgr2=0x7f20e414d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 0x7f20e414d4b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f20d4013680 tx=0x7f20d4013b40 comp rx=0 tx=0).stop 2024-05-08T20:29:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 msgr2=0x7f20e414d4b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20daffd640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e414d0d0 0x7f20e414d4b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.477+0000 7f20dbfff640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f20c4066730 0x7f20c4068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20cc006fd0 tx=0x7f20cc006da0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 0x7f20e40aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41edf30 con 0x7f20e40aa3d0 2024-05-08T20:29:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e259c640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 0x7f20e40aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e259c640 1 -- 172.21.15.81:0/2619362940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f20e4152720 con 0x7f20e40aa3d0 2024-05-08T20:29:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e259c640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 0x7f20e40aa7e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f20d401e000 tx=0x7f20d4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4026070 con 0x7f20e40aa3d0 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f20d4005e90 con 0x7f20e40aa3d0 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 msgr2=0x7f20e40aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 0x7f20e40aa7e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f20d401e000 tx=0x7f20d4004740 comp rx=0 tx=0).stop 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 msgr2=0x7f20e40aa7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20daffd640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e40aa3d0 0x7f20e40aa7e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:29:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 16, 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:34.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f20c4066730 msgr2=0x7f20c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f20c4066730 0x7f20c4068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f20cc006fd0 tx=0x7f20cc006da0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 msgr2=0x7f20e414cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 --2- 172.21.15.81:0/2619362940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20e4147ea0 0x7f20e414cb90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a920 tx=0x7f20d0005800 comp rx=0 tx=0).stop 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 reap_dead start 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e2d9d640 1 -- 172.21.15.81:0/2619362940 reap_dead start 2024-05-08T20:29:34.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 shutdown_connections 2024-05-08T20:29:34.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 >> 172.21.15.81:0/2619362940 conn(0x7f20e40c71b0 msgr2=0x7f20e4070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 shutdown_connections 2024-05-08T20:29:34.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.485+0000 7f20e8cae640 1 -- 172.21.15.81:0/2619362940 wait complete. 2024-05-08T20:29:34.506 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lpthread... yes 2024-05-08T20:29:34.508 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:29:34.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:29:34.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:29:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.621+0000 7fb50c570640 1 Processor -- start 2024-05-08T20:29:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.621+0000 7fb50c570640 1 -- start start 2024-05-08T20:29:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50c570640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb504155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50c570640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5041522e0 con 0x7fb504151f00 2024-05-08T20:29:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50c570640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040c5f80 con 0x7fb504155690 2024-05-08T20:29:34.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50c570640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50406bb20 con 0x7fb504154cf0 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50a30c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb504151f00 0x7fb5041588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60446/0 (socket says 172.21.15.81:60446) 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50a30c640 1 -- 172.21.15.81:0/2730578958 learned_addr learned my addr 172.21.15.81:0/2730578958 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb509b0b640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 msgr2=0x7fb504155150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb504155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771172599 0 0) 0x7fb5041522e0 con 0x7fb504151f00 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f0003530 con 0x7fb504151f00 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1097042212 0 0) 0x7fb4f0003530 con 0x7fb504151f00 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 msgr2=0x7fb504155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb504155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 >> v1:172.21.15.117:6789/0 conn(0x7fb504155690 legacy=0x7fb5040ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040c6260 con 0x7fb504151f00 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb4f4001680 con 0x7fb504151f00 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 >> v1:172.21.15.81:6789/0 conn(0x7fb504151f00 legacy=0x7fb5041588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb4f00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f00040e0 0x7fb4f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb4f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00055f0 con 0x7fb4f0004e30 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000bed0 con 0x7fb4f00040e0 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000c010 con 0x7fb504154cf0 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50a30c640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 msgr2=0x7fb4f00039d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb4f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50a30c640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb4f00039d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f00040e0 0x7fb4f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 msgr2=0x7fb4f00039d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb504154cf0 0x7fb4f00039d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f00040e0 msgr2=0x7fb4f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4f00040e0 0x7fb4f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2730578958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0003530 con 0x7fb4f0004e30 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb4f000b990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc001e40 tx=0x7fb4fc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980dc596001946df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc003b80 con 0x7fb4f0004e30 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc003ce0 con 0x7fb4f0004e30 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.625+0000 7fb50930a640 1 -- 172.21.15.81:0/2730578958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0052c0 con 0x7fb4f0004e30 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2730578958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 msgr2=0x7fb4f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 --2- 172.21.15.81:0/2730578958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb4f000b990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc001e40 tx=0x7fb4fc01c760 comp rx=0 tx=0).stop 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2730578958 reap_dead start 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2730578958 shutdown_connections 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2730578958 >> 172.21.15.81:0/2730578958 conn(0x7fb5040715f0 msgr2=0x7fb504071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2730578958 shutdown_connections 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2730578958 wait complete. 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 Processor -- start 2024-05-08T20:29:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- start start 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb50414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5040ad420 0x7fb504154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb50414cd80 0x7fb504148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb504149700 con 0x7fb4f0004e30 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414c320 con 0x7fb50414cd80 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414ab80 con 0x7fb5040ad420 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb50414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb509b0b640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5040ad420 msgr2=0x7fb504154030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb509b0b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5040ad420 0x7fb504154030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb50414c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53632/0 (socket says 172.21.15.81:53632) 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 -- 172.21.15.81:0/2253420848 learned_addr learned my addr 172.21.15.81:0/2253420848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb50414cd80 0x7fb504148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5040ad420 msgr2=0x7fb504154030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5040ad420 0x7fb504154030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb50414cd80 msgr2=0x7fb504148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb50414cd80 0x7fb504148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5041539b0 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50a30c640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb50414c840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400c700 tx=0x7fb4f400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40072d0 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4007450 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5041491f0 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40047f0 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb504154740 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 0x7fb504148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.629+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb504069600 con 0x7fb504160a80 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 0x7fb504148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4f4004950 con 0x7fb4f0004e30 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb509b0b640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb504149870 con 0x7fb504160a80 2024-05-08T20:29:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4e8066670 0x7fb4e8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4e8066670 0x7fb4e8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb4f4083b10 con 0x7fb4f0004e30 2024-05-08T20:29:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 0x7fb504148ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb50414d490 tx=0x7fb50000d8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500003bd0 con 0x7fb504160a80 2024-05-08T20:29:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb50ab0d640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4e8066670 0x7fb4e8068b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc005000 tx=0x7fb4fc001520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb500003d30 con 0x7fb504160a80 2024-05-08T20:29:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 msgr2=0x7fb504148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 0x7fb504148ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb50414d490 tx=0x7fb50000d8b0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 msgr2=0x7fb504148ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.633+0000 7fb4faffd640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb504160a80 0x7fb504148ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.637+0000 7fb50c570640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 0x7fb504146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.637+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb504149010 con 0x7fb5041469f0 2024-05-08T20:29:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 0x7fb504146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:34.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb509b0b640 1 -- 172.21.15.81:0/2253420848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb5041549f0 con 0x7fb5041469f0 2024-05-08T20:29:34.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb509b0b640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 0x7fb504146df0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5040c6c70 tx=0x7fb500005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:34.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000058b0 con 0x7fb5041469f0 2024-05-08T20:29:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7fb500027420 con 0x7fb5041469f0 2024-05-08T20:29:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 msgr2=0x7fb504146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 0x7fb504146df0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5040c6c70 tx=0x7fb500005a90 comp rx=0 tx=0).stop 2024-05-08T20:29:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 msgr2=0x7fb504146df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb4faffd640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5041469f0 0x7fb504146df0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5040c6c70 tx=0x7fb500005a90 comp rx=0 tx=0).stop 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 16, 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:29:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:34.648 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:34.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:34.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.654 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:34.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:34.657 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4e8066670 msgr2=0x7fb4e8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4e8066670 0x7fb4e8068b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc005000 tx=0x7fb4fc001520 comp rx=0 tx=0).stop 2024-05-08T20:29:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 msgr2=0x7fb50414c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 --2- 172.21.15.81:0/2253420848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4f0004e30 0x7fb50414c840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400c700 tx=0x7fb4f400cbc0 comp rx=0 tx=0).stop 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2253420848 reap_dead start 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50ab0d640 1 -- 172.21.15.81:0/2253420848 reap_dead start 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 shutdown_connections 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 >> 172.21.15.81:0/2253420848 conn(0x7fb5040715f0 msgr2=0x7fb5040719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 shutdown_connections 2024-05-08T20:29:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:34.641+0000 7fb50c570640 1 -- 172.21.15.81:0/2253420848 wait complete. 2024-05-08T20:29:34.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:29:34.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:29:35.111 INFO:tasks.workunit.client.1.smithi117.stdout:checking dependency style of gcc... gcc3 2024-05-08T20:29:35.423 INFO:tasks.workunit.client.1.smithi117.stdout:checking how to run the C preprocessor... gcc -E 2024-05-08T20:29:35.517 INFO:tasks.workunit.client.1.smithi117.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T20:29:35.519 INFO:tasks.workunit.client.1.smithi117.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T20:29:35.535 INFO:tasks.workunit.client.1.smithi117.stdout:checking for AIX... no 2024-05-08T20:29:36.020 INFO:tasks.workunit.client.0.smithi081.stdout:checking for ANSI C header files... yes 2024-05-08T20:29:36.095 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc... (cached) gcc 2024-05-08T20:29:36.104 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T20:29:36.116 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-08T20:29:36.117 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T20:29:36.117 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-08T20:29:36.118 INFO:tasks.workunit.client.1.smithi117.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T20:29:36.165 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/types.h... yes 2024-05-08T20:29:36.231 INFO:tasks.workunit.client.1.smithi117.stdout:checking for main in -lm... yes 2024-05-08T20:29:36.232 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/stat.h... yes 2024-05-08T20:29:36.299 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdlib.h... yes 2024-05-08T20:29:36.331 INFO:tasks.workunit.client.1.smithi117.stdout:checking for main in -lpthread... yes 2024-05-08T20:29:36.366 INFO:tasks.workunit.client.0.smithi081.stdout:checking for string.h... yes 2024-05-08T20:29:36.445 INFO:tasks.workunit.client.0.smithi081.stdout:checking for memory.h... yes 2024-05-08T20:29:36.514 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strings.h... yes 2024-05-08T20:29:36.549 INFO:tasks.workunit.client.1.smithi117.stdout:checking for ANSI C header files... yes 2024-05-08T20:29:36.584 INFO:tasks.workunit.client.0.smithi081.stdout:checking for inttypes.h... yes 2024-05-08T20:29:36.612 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T20:29:36.659 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... yes 2024-05-08T20:29:36.684 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/types.h... yes 2024-05-08T20:29:36.733 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... yes 2024-05-08T20:29:36.808 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h usability... yes 2024-05-08T20:29:36.835 INFO:tasks.workunit.client.0.smithi081.stdout:checking pthread.h presence... yes 2024-05-08T20:29:36.835 INFO:tasks.workunit.client.0.smithi081.stdout:checking for pthread.h... yes 2024-05-08T20:29:36.906 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h usability... yes 2024-05-08T20:29:36.930 INFO:tasks.workunit.client.0.smithi081.stdout:checking fcntl.h presence... yes 2024-05-08T20:29:36.930 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fcntl.h... yes 2024-05-08T20:29:37.002 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h usability... yes 2024-05-08T20:29:37.026 INFO:tasks.workunit.client.0.smithi081.stdout:checking limits.h presence... yes 2024-05-08T20:29:37.026 INFO:tasks.workunit.client.0.smithi081.stdout:checking for limits.h... yes 2024-05-08T20:29:37.047 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... (cached) yes 2024-05-08T20:29:37.107 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h usability... yes 2024-05-08T20:29:37.131 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/time.h presence... yes 2024-05-08T20:29:37.131 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/time.h... yes 2024-05-08T20:29:37.152 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... (cached) yes 2024-05-08T20:29:37.215 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h usability... yes 2024-05-08T20:29:37.239 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/vfs.h presence... yes 2024-05-08T20:29:37.239 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/vfs.h... yes 2024-05-08T20:29:37.318 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h usability... no 2024-05-08T20:29:37.652 INFO:tasks.workunit.client.0.smithi081.stdout:checking sys/limits.h presence... no 2024-05-08T20:29:37.653 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/limits.h... no 2024-05-08T20:29:37.689 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/stat.h... yes 2024-05-08T20:29:37.700 INFO:tasks.workunit.client.0.smithi081.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T20:29:37.744 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-08T20:29:37.776 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdlib.h... yes 2024-05-08T20:29:37.792 INFO:tasks.workunit.client.0.smithi081.stdout:checking for function prototypes... yes 2024-05-08T20:29:38.160 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether setvbuf arguments are reversed... no 2024-05-08T20:29:38.257 INFO:tasks.workunit.client.0.smithi081.stdout:checking for system... yes 2024-05-08T20:29:38.342 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gettimeofday... yes 2024-05-08T20:29:38.425 INFO:tasks.workunit.client.0.smithi081.stdout:checking for mkdir... yes 2024-05-08T20:29:38.510 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strerror... yes 2024-05-08T20:29:38.593 INFO:tasks.workunit.client.0.smithi081.stdout:checking for open64... yes 2024-05-08T20:29:38.679 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stat64... yes 2024-05-08T20:29:38.688 INFO:tasks.workunit.client.1.smithi117.stdout:checking for string.h... yes 2024-05-08T20:29:38.766 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fseeko64... yes 2024-05-08T20:29:38.774 INFO:tasks.workunit.client.1.smithi117.stdout:checking for memory.h... yes 2024-05-08T20:29:38.856 INFO:tasks.workunit.client.1.smithi117.stdout:checking for strings.h... yes 2024-05-08T20:29:38.949 INFO:tasks.workunit.client.1.smithi117.stdout:checking for inttypes.h... yes 2024-05-08T20:29:39.058 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdint.h... yes 2024-05-08T20:29:39.154 INFO:tasks.workunit.client.1.smithi117.stdout:checking for unistd.h... yes 2024-05-08T20:29:39.233 INFO:tasks.workunit.client.0.smithi081.stdout:checking for lrand48_r... yes 2024-05-08T20:29:39.253 INFO:tasks.workunit.client.1.smithi117.stdout:checking pthread.h usability... yes 2024-05-08T20:29:39.286 INFO:tasks.workunit.client.1.smithi117.stdout:checking pthread.h presence... yes 2024-05-08T20:29:39.287 INFO:tasks.workunit.client.1.smithi117.stdout:checking for pthread.h... yes 2024-05-08T20:29:39.338 INFO:tasks.workunit.client.0.smithi081.stdout:checking for srand48_r... yes 2024-05-08T20:29:39.373 INFO:tasks.workunit.client.1.smithi117.stdout:checking fcntl.h usability... yes 2024-05-08T20:29:39.381 INFO:tasks.workunit.client.0.smithi081.stdout:configure: creating ./config.status 2024-05-08T20:29:39.404 INFO:tasks.workunit.client.1.smithi117.stdout:checking fcntl.h presence... yes 2024-05-08T20:29:39.405 INFO:tasks.workunit.client.1.smithi117.stdout:checking for fcntl.h... yes 2024-05-08T20:29:39.489 INFO:tasks.workunit.client.1.smithi117.stdout:checking limits.h usability... yes 2024-05-08T20:29:39.516 INFO:tasks.workunit.client.1.smithi117.stdout:checking limits.h presence... yes 2024-05-08T20:29:39.516 INFO:tasks.workunit.client.1.smithi117.stdout:checking for limits.h... yes 2024-05-08T20:29:39.556 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdint.h... (cached) yes 2024-05-08T20:29:39.629 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/time.h usability... yes 2024-05-08T20:29:39.663 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/time.h presence... yes 2024-05-08T20:29:39.664 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/time.h... yes 2024-05-08T20:29:39.702 INFO:tasks.workunit.client.1.smithi117.stdout:checking for unistd.h... (cached) yes 2024-05-08T20:29:39.804 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/vfs.h usability... yes 2024-05-08T20:29:39.830 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/vfs.h presence... yes 2024-05-08T20:29:39.831 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/vfs.h... yes 2024-05-08T20:29:39.921 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/limits.h usability... no 2024-05-08T20:29:39.959 INFO:tasks.workunit.client.1.smithi117.stdout:checking sys/limits.h presence... no 2024-05-08T20:29:39.960 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/limits.h... no 2024-05-08T20:29:40.021 INFO:tasks.workunit.client.1.smithi117.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T20:29:40.081 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-08T20:29:40.086 INFO:tasks.workunit.client.1.smithi117.stdout:checking for function prototypes... yes 2024-05-08T20:29:40.142 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether setvbuf arguments are reversed... no 2024-05-08T20:29:40.327 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating Makefile 2024-05-08T20:29:40.348 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-05-08T20:29:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing depfiles commands 2024-05-08T20:29:40.442 INFO:tasks.workunit.client.1.smithi117.stdout:checking for system... yes 2024-05-08T20:29:40.455 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing default commands 2024-05-08T20:29:40.540 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gettimeofday... yes 2024-05-08T20:29:40.638 INFO:tasks.workunit.client.1.smithi117.stdout:checking for mkdir... yes 2024-05-08T20:29:40.750 INFO:tasks.workunit.client.1.smithi117.stdout:checking for strerror... yes 2024-05-08T20:29:40.877 INFO:tasks.workunit.client.1.smithi117.stdout:checking for open64... yes 2024-05-08T20:29:41.000 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stat64... yes 2024-05-08T20:29:41.114 INFO:tasks.workunit.client.1.smithi117.stdout:checking for fseeko64... yes 2024-05-08T20:29:41.149 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-05-08T20:29:41.158 INFO:tasks.workunit.client.0.smithi081.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-08T20:29:41.159 INFO:tasks.workunit.client.0.smithi081.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-08T20:29:41.159 INFO:tasks.workunit.client.0.smithi081.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-08T20:29:41.159 INFO:tasks.workunit.client.0.smithi081.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-08T20:29:41.159 INFO:tasks.workunit.client.0.smithi081.stderr: any GNU archive site. 2024-05-08T20:29:41.164 INFO:tasks.workunit.client.0.smithi081.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-08T20:29:41.169 INFO:tasks.workunit.client.0.smithi081.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-08T20:29:41.170 INFO:tasks.workunit.client.0.smithi081.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-08T20:29:41.170 INFO:tasks.workunit.client.0.smithi081.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-08T20:29:41.170 INFO:tasks.workunit.client.0.smithi081.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-08T20:29:41.170 INFO:tasks.workunit.client.0.smithi081.stderr: Grab them from any GNU archive site. 2024-05-08T20:29:41.205 INFO:tasks.workunit.client.1.smithi117.stdout:checking for lrand48_r... yes 2024-05-08T20:29:41.288 INFO:tasks.workunit.client.1.smithi117.stdout:checking for srand48_r... yes 2024-05-08T20:29:41.326 INFO:tasks.workunit.client.1.smithi117.stdout:configure: creating ./config.status 2024-05-08T20:29:41.366 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-05-08T20:29:41.458 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: creating Makefile 2024-05-08T20:29:41.476 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: creating config.h 2024-05-08T20:29:41.500 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: executing depfiles commands 2024-05-08T20:29:41.526 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-08T20:29:41.526 INFO:tasks.workunit.client.0.smithi081.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-08T20:29:41.526 INFO:tasks.workunit.client.0.smithi081.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-08T20:29:41.527 INFO:tasks.workunit.client.0.smithi081.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-08T20:29:41.568 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: executing default commands 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:4: warning: The macro `AC_FOREACH' is obsolete. 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:4: You should run autoupdate. 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:./lib/autoconf/general.m4:191: AC_FOREACH is expanded from... 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:684: _AM_SET_OPTIONS is expanded from... 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:410: AM_INIT_AUTOMAKE is expanded from... 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:4: the top level 2024-05-08T20:29:41.642 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:6: warning: The macro `AM_CONFIG_HEADER' is obsolete. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:6: You should run autoupdate. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:383: AM_CONFIG_HEADER is expanded from... 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:6: the top level 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:10: warning: The macro `AC_AIX' is obsolete. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:10: You should run autoupdate. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:./lib/autoconf/specific.m4:540: AC_AIX is expanded from... 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:10: the top level 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:36: warning: The macro `AC_HEADER_STDC' is obsolete. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:36: You should run autoupdate. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from... 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:36: the top level 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:42: warning: The macro `AC_HEADER_TIME' is obsolete. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:42: You should run autoupdate. 2024-05-08T20:29:41.643 INFO:tasks.workunit.client.0.smithi081.stderr:./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from... 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:42: the top level 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:45: warning: The macro `AC_FUNC_SETVBUF_REVERSED' is obsolete. Remove it and all references to SETVBUF_REVERSED. 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:./lib/autoconf/functions.m4:1766: AC_FUNC_SETVBUF_REVERSED is expanded from... 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:45: the top level 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:50: warning: AC_OUTPUT should be used without arguments. 2024-05-08T20:29:41.644 INFO:tasks.workunit.client.0.smithi081.stderr:configure.in:50: You should run autoupdate. 2024-05-08T20:29:41.716 INFO:tasks.workunit.client.0.smithi081.stdout:/bin/bash ./config.status --recheck 2024-05-08T20:29:41.786 INFO:tasks.workunit.client.0.smithi081.stdout:running CONFIG_SHELL=/bin/bash /bin/bash ./configure --no-create --no-recursion 2024-05-08T20:29:41.944 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T20:29:42.066 INFO:tasks.workunit.client.1.smithi117.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-05-08T20:29:42.083 INFO:tasks.workunit.client.1.smithi117.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-08T20:29:42.085 INFO:tasks.workunit.client.1.smithi117.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-08T20:29:42.085 INFO:tasks.workunit.client.1.smithi117.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-08T20:29:42.085 INFO:tasks.workunit.client.1.smithi117.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-08T20:29:42.085 INFO:tasks.workunit.client.1.smithi117.stderr: any GNU archive site. 2024-05-08T20:29:42.098 INFO:tasks.workunit.client.1.smithi117.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-08T20:29:42.105 INFO:tasks.workunit.client.1.smithi117.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-08T20:29:42.106 INFO:tasks.workunit.client.1.smithi117.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-08T20:29:42.106 INFO:tasks.workunit.client.1.smithi117.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-08T20:29:42.106 INFO:tasks.workunit.client.1.smithi117.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-08T20:29:42.106 INFO:tasks.workunit.client.1.smithi117.stderr: Grab them from any GNU archive site. 2024-05-08T20:29:42.960 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether build environment is sane... yes 2024-05-08T20:29:42.973 INFO:tasks.workunit.client.0.smithi081.stdout:checking for a race-free mkdir -p... /usr/bin/mkdir -p 2024-05-08T20:29:42.974 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gawk... gawk 2024-05-08T20:29:43.000 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T20:29:43.048 INFO:tasks.workunit.client.0.smithi081.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:43.048 INFO:tasks.workunit.client.0.smithi081.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:43.679 INFO:tasks.workunit.client.1.smithi117.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-05-08T20:29:43.907 INFO:tasks.workunit.client.0.smithi081.stdout:checking for style of include used by make... GNU 2024-05-08T20:29:43.923 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... gcc 2024-05-08T20:29:43.933 INFO:tasks.workunit.client.1.smithi117.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-08T20:29:43.934 INFO:tasks.workunit.client.1.smithi117.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-08T20:29:43.934 INFO:tasks.workunit.client.1.smithi117.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-08T20:29:43.934 INFO:tasks.workunit.client.1.smithi117.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-08T20:29:44.058 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:4: warning: The macro `AC_FOREACH' is obsolete. 2024-05-08T20:29:44.058 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:4: You should run autoupdate. 2024-05-08T20:29:44.058 INFO:tasks.workunit.client.1.smithi117.stderr:./lib/autoconf/general.m4:191: AC_FOREACH is expanded from... 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:aclocal.m4:684: _AM_SET_OPTIONS is expanded from... 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:aclocal.m4:410: AM_INIT_AUTOMAKE is expanded from... 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:4: the top level 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:6: warning: The macro `AM_CONFIG_HEADER' is obsolete. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:6: You should run autoupdate. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:aclocal.m4:383: AM_CONFIG_HEADER is expanded from... 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:6: the top level 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:10: warning: The macro `AC_AIX' is obsolete. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:10: You should run autoupdate. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:./lib/autoconf/specific.m4:540: AC_AIX is expanded from... 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:10: the top level 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:36: warning: The macro `AC_HEADER_STDC' is obsolete. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:36: You should run autoupdate. 2024-05-08T20:29:44.059 INFO:tasks.workunit.client.1.smithi117.stderr:./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from... 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:36: the top level 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:42: warning: The macro `AC_HEADER_TIME' is obsolete. 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:42: You should run autoupdate. 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from... 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:42: the top level 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:45: warning: The macro `AC_FUNC_SETVBUF_REVERSED' is obsolete. Remove it and all references to SETVBUF_REVERSED. 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:./lib/autoconf/functions.m4:1766: AC_FUNC_SETVBUF_REVERSED is expanded from... 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:45: the top level 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:50: warning: AC_OUTPUT should be used without arguments. 2024-05-08T20:29:44.060 INFO:tasks.workunit.client.1.smithi117.stderr:configure.in:50: You should run autoupdate. 2024-05-08T20:29:44.101 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the C compiler works... yes 2024-05-08T20:29:44.101 INFO:tasks.workunit.client.0.smithi081.stdout:checking for C compiler default output file name... a.out 2024-05-08T20:29:44.133 INFO:tasks.workunit.client.1.smithi117.stdout:/bin/bash ./config.status --recheck 2024-05-08T20:29:44.162 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of executables... 2024-05-08T20:29:44.208 INFO:tasks.workunit.client.1.smithi117.stdout:running CONFIG_SHELL=/bin/bash /bin/bash ./configure --no-create --no-recursion 2024-05-08T20:29:44.221 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether we are cross compiling... no 2024-05-08T20:29:44.267 INFO:tasks.workunit.client.0.smithi081.stdout:checking for suffix of object files... o 2024-05-08T20:29:44.297 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the compiler supports GNU C... yes 2024-05-08T20:29:44.331 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... yes 2024-05-08T20:29:44.369 INFO:tasks.workunit.client.1.smithi117.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T20:29:44.407 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to enable C11 features... none needed 2024-05-08T20:29:44.550 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... gcc3 2024-05-08T20:29:44.582 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdio.h... yes 2024-05-08T20:29:44.627 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdlib.h... yes 2024-05-08T20:29:44.666 INFO:tasks.workunit.client.0.smithi081.stdout:checking for string.h... yes 2024-05-08T20:29:44.707 INFO:tasks.workunit.client.0.smithi081.stdout:checking for inttypes.h... yes 2024-05-08T20:29:44.746 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... yes 2024-05-08T20:29:44.786 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strings.h... yes 2024-05-08T20:29:44.827 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/stat.h... yes 2024-05-08T20:29:44.866 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/types.h... yes 2024-05-08T20:29:44.908 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... yes 2024-05-08T20:29:44.958 INFO:tasks.workunit.client.0.smithi081.stdout:checking for wchar.h... yes 2024-05-08T20:29:45.012 INFO:tasks.workunit.client.0.smithi081.stdout:checking for minix/config.h... no 2024-05-08T20:29:45.052 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/time.h... yes 2024-05-08T20:29:45.105 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-08T20:29:45.140 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether _XOPEN_SOURCE should be defined... no 2024-05-08T20:29:45.152 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc... (cached) gcc 2024-05-08T20:29:45.386 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether build environment is sane... yes 2024-05-08T20:29:45.400 INFO:tasks.workunit.client.1.smithi117.stdout:checking for a race-free mkdir -p... /usr/bin/mkdir -p 2024-05-08T20:29:45.402 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gawk... gawk 2024-05-08T20:29:45.442 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T20:29:45.502 INFO:tasks.workunit.client.1.smithi117.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:45.503 INFO:tasks.workunit.client.1.smithi117.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T20:29:45.540 INFO:tasks.workunit.client.1.smithi117.stdout:checking for style of include used by make... GNU 2024-05-08T20:29:45.550 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc... gcc 2024-05-08T20:29:45.589 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-05-08T20:29:45.590 INFO:tasks.workunit.client.0.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T20:29:45.591 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-05-08T20:29:45.594 INFO:tasks.workunit.client.0.smithi081.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T20:29:45.681 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lm... yes 2024-05-08T20:29:45.744 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether the C compiler works... yes 2024-05-08T20:29:45.744 INFO:tasks.workunit.client.1.smithi117.stdout:checking for C compiler default output file name... a.out 2024-05-08T20:29:45.748 INFO:tasks.workunit.client.0.smithi081.stdout:checking for main in -lpthread... yes 2024-05-08T20:29:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T20:29:45.756 INFO:tasks.workunit.client.0.smithi081.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T20:29:45.797 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T20:29:45.847 INFO:tasks.workunit.client.0.smithi081.stdout:checking for pthread.h... yes 2024-05-08T20:29:45.894 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fcntl.h... yes 2024-05-08T20:29:45.939 INFO:tasks.workunit.client.0.smithi081.stdout:checking for limits.h... yes 2024-05-08T20:29:45.940 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stdint.h... (cached) yes 2024-05-08T20:29:45.941 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/time.h... (cached) yes 2024-05-08T20:29:45.943 INFO:tasks.workunit.client.0.smithi081.stdout:checking for unistd.h... (cached) yes 2024-05-08T20:29:45.989 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/vfs.h... yes 2024-05-08T20:29:46.090 INFO:tasks.workunit.client.1.smithi117.stdout:checking for suffix of executables... 2024-05-08T20:29:46.171 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether we are cross compiling... no 2024-05-08T20:29:46.593 INFO:tasks.workunit.client.1.smithi117.stdout:checking for suffix of object files... o 2024-05-08T20:29:46.649 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether the compiler supports GNU C... yes 2024-05-08T20:29:46.696 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether gcc accepts -g... yes 2024-05-08T20:29:46.784 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc option to enable C11 features... none needed 2024-05-08T20:29:47.346 INFO:tasks.workunit.client.0.smithi081.stdout:checking for sys/limits.h... no 2024-05-08T20:29:47.354 INFO:tasks.workunit.client.1.smithi117.stdout:checking dependency style of gcc... gcc3 2024-05-08T20:29:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T20:29:47.421 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdio.h... yes 2024-05-08T20:29:47.474 INFO:tasks.workunit.client.0.smithi081.stdout:checking for system... yes 2024-05-08T20:29:47.483 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdlib.h... yes 2024-05-08T20:29:47.529 INFO:tasks.workunit.client.1.smithi117.stdout:checking for string.h... yes 2024-05-08T20:29:47.551 INFO:tasks.workunit.client.0.smithi081.stdout:checking for gettimeofday... yes 2024-05-08T20:29:47.578 INFO:tasks.workunit.client.1.smithi117.stdout:checking for inttypes.h... yes 2024-05-08T20:29:47.625 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdint.h... yes 2024-05-08T20:29:47.675 INFO:tasks.workunit.client.1.smithi117.stdout:checking for strings.h... yes 2024-05-08T20:29:47.738 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/stat.h... yes 2024-05-08T20:29:47.795 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/types.h... yes 2024-05-08T20:29:47.862 INFO:tasks.workunit.client.1.smithi117.stdout:checking for unistd.h... yes 2024-05-08T20:29:47.939 INFO:tasks.workunit.client.1.smithi117.stdout:checking for wchar.h... yes 2024-05-08T20:29:48.026 INFO:tasks.workunit.client.1.smithi117.stdout:checking for minix/config.h... no 2024-05-08T20:29:48.079 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/time.h... yes 2024-05-08T20:29:48.124 INFO:tasks.workunit.client.0.smithi081.stdout:checking for mkdir... yes 2024-05-08T20:29:48.149 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-08T20:29:48.193 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether _XOPEN_SOURCE should be defined... no 2024-05-08T20:29:48.204 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc... (cached) gcc 2024-05-08T20:29:48.208 INFO:tasks.workunit.client.0.smithi081.stdout:checking for strerror... yes 2024-05-08T20:29:48.278 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-05-08T20:29:48.279 INFO:tasks.workunit.client.1.smithi117.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T20:29:48.279 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-05-08T20:29:48.280 INFO:tasks.workunit.client.1.smithi117.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T20:29:48.285 INFO:tasks.workunit.client.0.smithi081.stdout:checking for open64... yes 2024-05-08T20:29:48.358 INFO:tasks.workunit.client.0.smithi081.stdout:checking for stat64... yes 2024-05-08T20:29:48.426 INFO:tasks.workunit.client.0.smithi081.stdout:checking for fseeko64... yes 2024-05-08T20:29:48.493 INFO:tasks.workunit.client.0.smithi081.stdout:checking for lrand48_r... yes 2024-05-08T20:29:48.563 INFO:tasks.workunit.client.0.smithi081.stdout:checking for srand48_r... yes 2024-05-08T20:29:48.580 INFO:tasks.workunit.client.1.smithi117.stdout:checking for main in -lm... yes 2024-05-08T20:29:48.583 INFO:tasks.workunit.client.0.smithi081.stdout:configure: creating ./config.status 2024-05-08T20:29:48.883 INFO:tasks.workunit.client.0.smithi081.stdout: /bin/bash ./config.status 2024-05-08T20:29:48.965 INFO:tasks.workunit.client.1.smithi117.stdout:checking for main in -lpthread... yes 2024-05-08T20:29:48.972 INFO:tasks.workunit.client.1.smithi117.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T20:29:48.974 INFO:tasks.workunit.client.1.smithi117.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T20:29:49.039 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T20:29:49.080 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating Makefile 2024-05-08T20:29:49.109 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-05-08T20:29:49.111 INFO:tasks.workunit.client.1.smithi117.stdout:checking for pthread.h... yes 2024-05-08T20:29:49.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:29:49.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:29:49.571 INFO:tasks.workunit.client.1.smithi117.stdout:checking for fcntl.h... yes 2024-05-08T20:29:49.650 INFO:tasks.workunit.client.1.smithi117.stdout:checking for limits.h... yes 2024-05-08T20:29:49.654 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stdint.h... (cached) yes 2024-05-08T20:29:49.656 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/time.h... (cached) yes 2024-05-08T20:29:49.657 INFO:tasks.workunit.client.1.smithi117.stdout:checking for unistd.h... (cached) yes 2024-05-08T20:29:49.734 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/vfs.h... yes 2024-05-08T20:29:49.737 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing depfiles commands 2024-05-08T20:29:49.766 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: executing default commands 2024-05-08T20:29:49.806 INFO:tasks.workunit.client.1.smithi117.stdout:checking for sys/limits.h... no 2024-05-08T20:29:49.832 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-05-08T20:29:49.845 INFO:tasks.workunit.client.1.smithi117.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T20:29:49.887 INFO:tasks.workunit.client.0.smithi081.stderr:autoheader: warning: autoconf input should be named 'configure.ac', not 'configure.in' 2024-05-08T20:29:49.930 INFO:tasks.workunit.client.1.smithi117.stdout:checking for system... yes 2024-05-08T20:29:49.973 INFO:tasks.workunit.client.0.smithi081.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-08T20:29:49.973 INFO:tasks.workunit.client.0.smithi081.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-08T20:29:49.973 INFO:tasks.workunit.client.0.smithi081.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-08T20:29:49.973 INFO:tasks.workunit.client.0.smithi081.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-08T20:29:50.008 INFO:tasks.workunit.client.1.smithi117.stdout:checking for gettimeofday... yes 2024-05-08T20:29:50.092 INFO:tasks.workunit.client.1.smithi117.stdout:checking for mkdir... yes 2024-05-08T20:29:50.135 INFO:tasks.workunit.client.0.smithi081.stdout:rm -f stamp-h1 2024-05-08T20:29:50.140 INFO:tasks.workunit.client.0.smithi081.stdout:touch config.h.in 2024-05-08T20:29:50.147 INFO:tasks.workunit.client.0.smithi081.stdout:cd . && /bin/bash ./config.status config.h 2024-05-08T20:29:50.205 INFO:tasks.workunit.client.0.smithi081.stdout:config.status: creating config.h 2024-05-08T20:29:50.836 INFO:tasks.workunit.client.1.smithi117.stdout:checking for strerror... yes 2024-05-08T20:29:50.952 INFO:tasks.workunit.client.1.smithi117.stdout:checking for open64... yes 2024-05-08T20:29:51.045 INFO:tasks.workunit.client.1.smithi117.stdout:checking for stat64... yes 2024-05-08T20:29:51.073 INFO:tasks.workunit.client.0.smithi081.stdout:make all-am 2024-05-08T20:29:51.120 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-08T20:29:51.120 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-08T20:29:51.127 INFO:tasks.workunit.client.1.smithi117.stdout:checking for fseeko64... yes 2024-05-08T20:29:51.202 INFO:tasks.workunit.client.1.smithi117.stdout:checking for lrand48_r... yes 2024-05-08T20:29:51.275 INFO:tasks.workunit.client.1.smithi117.stdout:checking for srand48_r... yes 2024-05-08T20:29:51.297 INFO:tasks.workunit.client.1.smithi117.stdout:configure: creating ./config.status 2024-05-08T20:29:51.372 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-08T20:29:51.381 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-08T20:29:51.496 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-08T20:29:51.510 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-08T20:29:51.658 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-08T20:29:51.667 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-08T20:29:51.832 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-08T20:29:51.841 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-08T20:29:52.019 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-08T20:29:52.028 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-08T20:29:52.124 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-08T20:29:52.131 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-08T20:29:52.193 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-08T20:29:52.201 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-08T20:29:52.272 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-08T20:29:52.279 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-08T20:29:52.535 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-08T20:29:52.548 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-08T20:29:52.749 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-08T20:29:52.750 INFO:tasks.workunit.client.1.smithi117.stdout: /bin/bash ./config.status 2024-05-08T20:29:52.759 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-08T20:29:52.844 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: creating Makefile 2024-05-08T20:29:52.863 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: creating config.h 2024-05-08T20:29:52.901 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: executing depfiles commands 2024-05-08T20:29:52.924 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: executing default commands 2024-05-08T20:29:53.003 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-08T20:29:53.014 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-08T20:29:53.136 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-08T20:29:53.145 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-08T20:29:53.174 INFO:tasks.workunit.client.1.smithi117.stdout:cd . && /bin/bash /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-05-08T20:29:53.203 INFO:tasks.workunit.client.0.smithi081.stderr:ffsb_op.c: In function 'print_op_results': 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~ 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr: 86 | sprintf(buf, "NA\0"); 2024-05-08T20:29:53.204 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~ 2024-05-08T20:29:53.219 INFO:tasks.workunit.client.0.smithi081.stderr:ffsb_op.c: In function 'print_results': 2024-05-08T20:29:53.219 INFO:tasks.workunit.client.0.smithi081.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-05-08T20:29:53.219 INFO:tasks.workunit.client.0.smithi081.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~ 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr:In file included from /usr/include/stdio.h:894, 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: from ffsb_op.c:20: 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: 40 | __va_arg_pack ()); 2024-05-08T20:29:53.220 INFO:tasks.workunit.client.0.smithi081.stderr: | ~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.239 INFO:tasks.workunit.client.1.smithi117.stderr:autoheader: warning: autoconf input should be named 'configure.ac', not 'configure.in' 2024-05-08T20:29:53.265 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-08T20:29:53.274 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-08T20:29:53.327 INFO:tasks.workunit.client.1.smithi117.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-08T20:29:53.327 INFO:tasks.workunit.client.1.smithi117.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-08T20:29:53.327 INFO:tasks.workunit.client.1.smithi117.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-08T20:29:53.327 INFO:tasks.workunit.client.1.smithi117.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-08T20:29:53.474 INFO:tasks.workunit.client.1.smithi117.stdout:rm -f stamp-h1 2024-05-08T20:29:53.478 INFO:tasks.workunit.client.1.smithi117.stdout:touch config.h.in 2024-05-08T20:29:53.485 INFO:tasks.workunit.client.1.smithi117.stdout:cd . && /bin/bash ./config.status config.h 2024-05-08T20:29:53.567 INFO:tasks.workunit.client.1.smithi117.stdout:config.status: creating config.h 2024-05-08T20:29:53.631 INFO:tasks.workunit.client.1.smithi117.stdout:make all-am 2024-05-08T20:29:53.670 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-05-08T20:29:53.670 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-08T20:29:53.839 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-08T20:29:53.851 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-08T20:29:53.898 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-08T20:29:53.908 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-08T20:29:53.931 INFO:tasks.workunit.client.0.smithi081.stderr:In file included from parser.h:22, 2024-05-08T20:29:53.932 INFO:tasks.workunit.client.0.smithi081.stderr: from parser.c:25: 2024-05-08T20:29:53.932 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function 'init_filesys': 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.935 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.936 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.937 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.938 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.939 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function 'init_tg_stats': 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.940 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.941 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:53.942 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.943 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.944 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: | ^ 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~ 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:53.945 INFO:tasks.workunit.client.0.smithi081.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:53.946 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:53.946 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:53.946 INFO:tasks.workunit.client.0.smithi081.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-08T20:29:53.946 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.993 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c: In function 'get_optstr': 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr:parser.c:200:14: note: source object declared here 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr: 200 | char temp[BUFSIZE]; 2024-05-08T20:29:53.994 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~ 2024-05-08T20:29:54.010 INFO:tasks.workunit.client.0.smithi081.stderr:In file included from /usr/include/string.h:535, 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: from parser.c:19: 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr:In function 'memcpy', 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: 30 | __glibc_objsize0 (__dest)); 2024-05-08T20:29:54.011 INFO:tasks.workunit.client.0.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:54.072 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-08T20:29:54.091 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-08T20:29:54.264 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-08T20:29:54.276 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-08T20:29:54.350 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-08T20:29:54.359 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-08T20:29:54.457 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-08T20:29:54.460 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-08T20:29:54.468 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-08T20:29:54.468 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-08T20:29:54.614 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-08T20:29:54.624 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-08T20:29:54.656 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-08T20:29:54.660 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:29:54.660 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:29:54.660 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:29:54.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:29:54.663 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:29:54.663 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:29:54.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:29:54.668 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-08T20:29:54.673 INFO:tasks.workunit.client.0.smithi081.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-08T20:29:54.684 INFO:tasks.workunit.client.0.smithi081.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-08T20:29:54.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.789+0000 7f93dcd7d640 1 Processor -- start 2024-05-08T20:29:54.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.789+0000 7f93dcd7d640 1 -- start start 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93dcd7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 0x7f93d80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93dcd7d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93d81519d0 0x7f93d8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93dcd7d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80c3a50 con 0x7f93d8070c00 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93dcd7d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d8072940 con 0x7f93d81519d0 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93dcd7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80705e0 con 0x7f93d806b230 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93d81519d0 0x7f93d8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93d8070c00 0x7f93d814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38482/0 (socket says 172.21.15.81:38482) 2024-05-08T20:29:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d5d9b640 1 -- 172.21.15.81:0/2822372721 learned_addr learned my addr 172.21.15.81:0/2822372721 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d659c640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 0x7f93d80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 -- 172.21.15.81:0/2822372721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 msgr2=0x7f93d80c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 0x7f93d80c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 -- 172.21.15.81:0/2822372721 >> v1:172.21.15.81:6789/0 conn(0x7f93d8070c00 legacy=0x7f93d814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 -- 172.21.15.81:0/2822372721 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80708c0 con 0x7f93d81519d0 2024-05-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d559a640 1 -- 172.21.15.81:0/2822372721 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248656746 0 0) 0x7f93d80c3a50 con 0x7f93d8070c00 2024-05-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d659c640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 0x7f93d80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:29:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.793+0000 7f93d6d9d640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d81519d0 0x7f93d8151e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009d90 tx=0x7f93d001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5845067cd6473846 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d559a640 1 -- 172.21.15.81:0/2822372721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00a59a0 con 0x7f93d81519d0 2024-05-08T20:29:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d559a640 1 -- 172.21.15.81:0/2822372721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00a5b00 con 0x7f93d81519d0 2024-05-08T20:29:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d559a640 1 -- 172.21.15.81:0/2822372721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00a5e90 con 0x7f93d81519d0 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2822372721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d81519d0 msgr2=0x7f93d8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d81519d0 0x7f93d8151e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009d90 tx=0x7f93d001c8e0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2822372721 shutdown_connections 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d81519d0 0x7f93d8151e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2822372721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d806b230 0x7f93d80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2822372721 >> 172.21.15.81:0/2822372721 conn(0x7f93d80c71b0 msgr2=0x7f93d80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2822372721 shutdown_connections 2024-05-08T20:29:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2822372721 wait complete. 2024-05-08T20:29:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 Processor -- start 2024-05-08T20:29:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- start start 2024-05-08T20:29:54.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93d8070c00 0x7f93d813fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d81519d0 0x7f93d8140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8141dc0 con 0x7f93d806b230 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8143ca0 con 0x7f93d8070c00 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81490d0 con 0x7f93d81519d0 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42780/0 (socket says 172.21.15.81:42780) 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 -- 172.21.15.81:0/2154428106 learned_addr learned my addr 172.21.15.81:0/2154428106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d5d9b640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93d8070c00 0x7f93d813fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d6d9d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d81519d0 0x7f93d8140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 -- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d81519d0 msgr2=0x7f93d8140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d81519d0 0x7f93d8140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 -- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93d8070c00 msgr2=0x7f93d813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93d8070c00 0x7f93d813fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 -- 172.21.15.81:0/2154428106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009a70 con 0x7f93d806b230 2024-05-08T20:29:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93d659c640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c7c0 tx=0x7f93c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8007a30 con 0x7f93d806b230 2024-05-08T20:29:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8007b90 con 0x7f93d806b230 2024-05-08T20:29:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d814ac20 con 0x7f93d806b230 2024-05-08T20:29:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.797+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800ce70 con 0x7f93d806b230 2024-05-08T20:29:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d814b1e0 con 0x7f93d806b230 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d80675e0 con 0x7f93d806b230 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93c80113f0 con 0x7f93d806b230 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93c6ffd640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 0x7f93b8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f93c8084900 con 0x7f93d806b230 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93d5d9b640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 0x7f93b8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:54.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.801+0000 7f93d5d9b640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 0x7f93b8068b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93d80c2a30 tx=0x7f93cc007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:54.805+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f93c8051960 con 0x7f93d806b230 2024-05-08T20:29:54.834 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-08T20:29:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.041+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f93d8074950 con 0x7f93d806b230 2024-05-08T20:29:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.041+0000 7f93c6ffd640 1 -- 172.21.15.81:0/2154428106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f93c8054f80 con 0x7f93d806b230 2024-05-08T20:29:55.044 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 msgr2=0x7f93b8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 0x7f93b8068b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93d80c2a30 tx=0x7f93cc007b60 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 msgr2=0x7f93d80c0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c7c0 tx=0x7f93c800cc80 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 shutdown_connections 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93b80666c0 0x7f93b8068b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93d81519d0 0x7f93d8140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93d8070c00 0x7f93d813fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 --2- 172.21.15.81:0/2154428106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d806b230 0x7f93d80c0840 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 >> 172.21.15.81:0/2154428106 conn(0x7f93d80c71b0 msgr2=0x7f93d8148580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 shutdown_connections 2024-05-08T20:29:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.045+0000 7f93dcd7d640 1 -- 172.21.15.81:0/2154428106 wait complete. 2024-05-08T20:29:55.063 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:29:55.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:29:55.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:29:55.108 INFO:tasks.workunit.client.0.smithi081.stdout:FFSB version 6.0-RC2 started 2024-05-08T20:29:55.109 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout:benchmark time = 300 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout:ThreadGroup 0 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout:================ 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: num_threads = 32 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: read_random = off 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: read_size = 0 (0B) 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: read_blocksize = 0 (0B) 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: read_skip = off 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: read_skipsize = 0 (0B) 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: write_random = on 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: write_size = 5242880 (5MB) 2024-05-08T20:29:55.113 INFO:tasks.workunit.client.0.smithi081.stdout: fsync_file = 0 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: write_blocksize = 4096 (4KB) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: wait time = 0 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: op weights 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: read = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: readall = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: write = 1 (100.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: create = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: append = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: delete = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: metaop = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: createdir = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: stat = 0 (0.00%) 2024-05-08T20:29:55.114 INFO:tasks.workunit.client.0.smithi081.stdout: writeall = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: writeall_fsync = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: open_close = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: write_fsync = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: create_fsync = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: append_fsync = 0 (0.00%) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout:FileSystem . 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout:========== 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: num_dirs = 0 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: starting files = 128 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: min file size = 104857600 (100MB) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: max file size = 104857600 (100MB) 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: directio = off 2024-05-08T20:29:55.115 INFO:tasks.workunit.client.0.smithi081.stdout: alignedio = on 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout: bufferedio = off 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout: aging is off 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout: current utilization = 0.00% 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:29:55.116 INFO:tasks.workunit.client.0.smithi081.stdout:checking existing fs: . 2024-05-08T20:29:55.117 INFO:tasks.workunit.client.0.smithi081.stdout:recreating new fileset 2024-05-08T20:29:55.117 INFO:tasks.workunit.client.0.smithi081.stderr:opendir: No such file or directory 2024-05-08T20:29:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.221+0000 7f338c83e640 1 Processor -- start 2024-05-08T20:29:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.221+0000 7f338c83e640 1 -- start start 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338c83e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33880ca710 0x7f3388158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338c83e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880c67e0 con 0x7f338806b7b0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338c83e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880c5ef0 con 0x7f33881563b0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338c83e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3388156790 con 0x7f33880ca710 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3386d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f338806b7b0 0x7f3388159310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38492/0 (socket says 172.21.15.81:38492) 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3386d9d640 1 -- 172.21.15.81:0/2472575518 learned_addr learned my addr 172.21.15.81:0/2472575518 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3385d9b640 1 --2- 172.21.15.81:0/2472575518 >> v2:172.21.15.117:3300/0 conn(0x7f33880ca710 0x7f3388158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075939033 0 0) 0x7f33880c67e0 con 0x7f338806b7b0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3370003530 con 0x7f338806b7b0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2538016374 0 0) 0x7f3370003530 con 0x7f338806b7b0 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 >> v2:172.21.15.117:3300/0 conn(0x7f33880ca710 msgr2=0x7f3388158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 --2- 172.21.15.81:0/2472575518 >> v2:172.21.15.117:3300/0 conn(0x7f33880ca710 0x7f3388158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 >> v1:172.21.15.117:6789/0 conn(0x7f33881563b0 legacy=0x7f33880ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388159a20 con 0x7f338806b7b0 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3380001a00 con 0x7f338806b7b0 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 >> v1:172.21.15.81:6789/0 conn(0x7f338806b7b0 legacy=0x7f3388159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f3370003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33700047d0 0x7f3370004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3370005190 0x7f337000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388156790 con 0x7f3370003980 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337000c090 con 0x7f33700047d0 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337000c250 con 0x7f3370005190 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f3370003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3385d9b640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33700047d0 0x7f3370004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 -- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3370005190 msgr2=0x7f337000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3386d9d640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3370005190 0x7f337000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3370005190 0x7f337000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 -- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33700047d0 msgr2=0x7f3370004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33700047d0 0x7f3370004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f338659c640 1 -- 172.21.15.81:0/2472575518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388159a20 con 0x7f3370003980 2024-05-08T20:29:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.225+0000 7f3386d9d640 1 -- 172.21.15.81:0/2472575518 reap_dead start 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f3385d9b640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33700047d0 0x7f3370004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338659c640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f3370003da0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3378001780 tx=0x7f337801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10694d7b2116a90a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780052d0 con 0x7f3370003980 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378005450 con 0x7f3370003980 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338559a640 1 -- 172.21.15.81:0/2472575518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378003840 con 0x7f3370003980 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 -- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 msgr2=0x7f3370003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f3370003da0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3378001780 tx=0x7f337801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 -- 172.21.15.81:0/2472575518 shutdown_connections 2024-05-08T20:29:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 --2- 172.21.15.81:0/2472575518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f3370003da0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 -- 172.21.15.81:0/2472575518 >> 172.21.15.81:0/2472575518 conn(0x7f33880715f0 msgr2=0x7f3388071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 -- 172.21.15.81:0/2472575518 shutdown_connections 2024-05-08T20:29:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 -- 172.21.15.81:0/2472575518 wait complete. 2024-05-08T20:29:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.229+0000 7f338c83e640 1 Processor -- start 2024-05-08T20:29:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- start start 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f338815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f338815a6a0 0x7f338815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3388146270 0x7f33881466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33881f2530 con 0x7f3370003980 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33881f2810 con 0x7f3388146270 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388149de0 con 0x7f338815a6a0 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f338815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f338815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42808/0 (socket says 172.21.15.81:42808) 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 -- 172.21.15.81:0/3475235509 learned_addr learned my addr 172.21.15.81:0/3475235509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3385d9b640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f338815a6a0 0x7f338815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3386d9d640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3388146270 0x7f33881466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f338815a6a0 msgr2=0x7f338815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f338815a6a0 0x7f338815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3388146270 msgr2=0x7f33881466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3388146270 0x7f33881466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338814a0c0 con 0x7f3370003980 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338659c640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f338815a0c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3378005040 tx=0x7f3370005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780ba070 con 0x7f3370003980 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780076a0 con 0x7f3370003980 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338815b390 con 0x7f3370003980 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780050d0 con 0x7f3370003980 2024-05-08T20:29:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338815b670 con 0x7f3370003980 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 0x7f338814b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388069600 con 0x7f338814aff0 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3385d9b640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 0x7f338814b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3385d9b640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3388149f50 con 0x7f338814aff0 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3385d9b640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 0x7f338814b450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33880681e0 tx=0x7f337c012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0109c0 con 0x7f338814aff0 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.233+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33780067e0 con 0x7f3370003980 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3368066760 0x7f3368068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f337811d680 con 0x7f3370003980 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3386d9d640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3368066760 0x7f3368068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f337c010b20 con 0x7f338814aff0 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 msgr2=0x7f338814b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 0x7f338814b450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33880681e0 tx=0x7f337c012ad0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 msgr2=0x7f338814b450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3376ffd640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814aff0 0x7f338814b450 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.237+0000 7f3386d9d640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3368066760 0x7f3368068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33880caf10 tx=0x7f3380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.241+0000 7f338c83e640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 0x7f33881f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.241+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880ca000 con 0x7f338814b990 2024-05-08T20:29:55.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.241+0000 7f3385d9b640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 0x7f33881f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.241+0000 7f3385d9b640 1 -- 172.21.15.81:0/3475235509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f33880675e0 con 0x7f338814b990 2024-05-08T20:29:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.241+0000 7f3385d9b640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 0x7f33881f4f80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f337c01d000 tx=0x7f337c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c022040 con 0x7f338814b990 2024-05-08T20:29:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f337c0232d0 con 0x7f338814b990 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 msgr2=0x7f33881f4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 0x7f33881f4f80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f337c01d000 tx=0x7f337c004740 comp rx=0 tx=0).stop 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 msgr2=0x7f33881f4f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3376ffd640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f338814b990 0x7f33881f4f80 secure :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f337c01d000 tx=0x7f337c004740 comp rx=0 tx=0).stop 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:29:55.247 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.248 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.249 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:55.250 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:55.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:55.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.255 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:55.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:55.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.258 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.259 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:55.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3368066760 msgr2=0x7f3368068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3368066760 0x7f3368068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33880caf10 tx=0x7f3380009040 comp rx=0 tx=0).stop 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 msgr2=0x7f338815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 --2- 172.21.15.81:0/3475235509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3370003980 0x7f338815a0c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3378005040 tx=0x7f3370005800 comp rx=0 tx=0).stop 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3386d9d640 1 -- 172.21.15.81:0/3475235509 reap_dead start 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f3386d9d640 1 -- 172.21.15.81:0/3475235509 reap_dead start 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 shutdown_connections 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 >> 172.21.15.81:0/3475235509 conn(0x7f33880715f0 msgr2=0x7f3388158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 shutdown_connections 2024-05-08T20:29:55.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.245+0000 7f338c83e640 1 -- 172.21.15.81:0/3475235509 wait complete. 2024-05-08T20:29:55.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:55.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:29:55.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:29:55.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 Processor -- start 2024-05-08T20:29:55.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 -- start start 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa4152340 0x7f1fa406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa4158080 con 0x7f1fa406d7d0 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa406a890 con 0x7f1fa40c2570 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1faa3cd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa406ab70 con 0x7f1fa4152340 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa4152340 0x7f1fa406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa4152340 0x7f1fa406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42846/0 (socket says 172.21.15.81:42846) 2024-05-08T20:29:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2772173585 learned_addr learned my addr 172.21.15.81:0/2772173585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2772173585 >> v1:172.21.15.117:6789/0 conn(0x7f1fa40c2570 legacy=0x7f1fa4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2772173585 >> v1:172.21.15.81:6789/0 conn(0x7f1fa406d7d0 legacy=0x7f1fa415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.429+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2772173585 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40c2d70 con 0x7f1fa4152340 2024-05-08T20:29:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1fa3fff640 1 --2- 172.21.15.81:0/2772173585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4152340 0x7f1fa406d290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009870 tx=0x7f1f9401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d84c0ecf71b78a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1fa2ffd640 1 -- 172.21.15.81:0/2772173585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940ac600 con 0x7f1fa4152340 2024-05-08T20:29:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1fa2ffd640 1 -- 172.21.15.81:0/2772173585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940a8050 con 0x7f1fa4152340 2024-05-08T20:29:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1fa2ffd640 1 -- 172.21.15.81:0/2772173585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940ac980 con 0x7f1fa4152340 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2772173585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4152340 msgr2=0x7f1fa406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2772173585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4152340 0x7f1fa406d290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009870 tx=0x7f1f9401c490 comp rx=0 tx=0).stop 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2772173585 shutdown_connections 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2772173585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4152340 0x7f1fa406d290 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2772173585 >> 172.21.15.81:0/2772173585 conn(0x7f1fa40c71b0 msgr2=0x7f1fa40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2772173585 shutdown_connections 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2772173585 wait complete. 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 Processor -- start 2024-05-08T20:29:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- start start 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 0x7f1fa4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa40c2570 0x7f1fa4144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4152340 0x7f1fa4144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41ed840 con 0x7f1fa406d7d0 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41453d0 con 0x7f1fa4152340 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.433+0000 7f1faa3cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41eda90 con 0x7f1fa40c2570 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 0x7f1fa4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 0x7f1fa4145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42856/0 (socket says 172.21.15.81:42856) 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2879460759 learned_addr learned my addr 172.21.15.81:0/2879460759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa37fe640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa40c2570 0x7f1fa4144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa896a640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4152340 0x7f1fa4144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa40c2570 msgr2=0x7f1fa4144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa40c2570 0x7f1fa4144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4152340 msgr2=0x7f1fa4144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4152340 0x7f1fa4144e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940094d0 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa3fff640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 0x7f1fa4145df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f9401a0c0 tx=0x7f1f9401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b7620 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940b77a0 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40aa3d0 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b7b50 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa40aa990 con 0x7f1fa406d7d0 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 0x7f1fa40aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4069550 con 0x7f1fa40ad130 2024-05-08T20:29:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa37fe640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 0x7f1fa40aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa37fe640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fa4155a80 con 0x7f1fa40ad130 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f940b3040 con 0x7f1fa406d7d0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa37fe640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 0x7f1fa40aab80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406bd40 tx=0x7f1f9800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f90066690 0x7f1f90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1f9411ea20 con 0x7f1fa406d7d0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa896a640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f90066690 0x7f1f90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011800 con 0x7f1fa40ad130 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa896a640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f90066690 0x7f1f90068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41ee970 tx=0x7f1f9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1f98011960 con 0x7f1fa40ad130 2024-05-08T20:29:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 msgr2=0x7f1fa40aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 0x7f1fa40aab80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406bd40 tx=0x7f1f9800c810 comp rx=0 tx=0).stop 2024-05-08T20:29:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 msgr2=0x7f1fa40aab80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.437+0000 7f1fa0ff9640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa40ad130 0x7f1fa40aab80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.445+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 0x7f1fa40ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.445+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40aa560 con 0x7f1fa4160630 2024-05-08T20:29:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa37fe640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 0x7f1fa40ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa37fe640 1 -- 172.21.15.81:0/2879460759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1fa40675e0 con 0x7f1fa4160630 2024-05-08T20:29:55.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa37fe640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 0x7f1fa40ab190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f98014000 tx=0x7f1f98004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98020070 con 0x7f1fa4160630 2024-05-08T20:29:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f1f98010350 con 0x7f1fa4160630 2024-05-08T20:29:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 msgr2=0x7f1fa40ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 0x7f1fa40ab190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f98014000 tx=0x7f1f98004700 comp rx=0 tx=0).stop 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 msgr2=0x7f1fa40ab190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa0ff9640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa4160630 0x7f1fa40ab190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:55.453 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.454 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:55.456 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:55.457 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:55.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:55.466 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:55.466 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f90066690 msgr2=0x7f1f90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f90066690 0x7f1f90068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41ee970 tx=0x7f1f9c009040 comp rx=0 tx=0).stop 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 msgr2=0x7f1fa4145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 --2- 172.21.15.81:0/2879460759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa406d7d0 0x7f1fa4145df0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f9401a0c0 tx=0x7f1f9401acd0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa896a640 1 -- 172.21.15.81:0/2879460759 reap_dead start 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1fa896a640 1 -- 172.21.15.81:0/2879460759 reap_dead start 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 shutdown_connections 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 >> 172.21.15.81:0/2879460759 conn(0x7f1fa40c71b0 msgr2=0x7f1fa4154320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 shutdown_connections 2024-05-08T20:29:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.449+0000 7f1faa3cd640 1 -- 172.21.15.81:0/2879460759 wait complete. 2024-05-08T20:29:55.467 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-08T20:29:55.472 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-08T20:29:55.474 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:55.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:29:55.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:29:55.543 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-08T20:29:55.553 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-08T20:29:55.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 Processor -- start 2024-05-08T20:29:55.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 -- start start 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41b80ca000 0x7f41b80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b8158e20 con 0x7f41b8154cf0 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b806bb20 con 0x7f41b80ca000 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41bd55d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b81548e0 con 0x7f41b8151f00 2024-05-08T20:29:55.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b67fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f41b8154cf0 0x7f41b8155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38504/0 (socket says 172.21.15.81:38504) 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b67fc640 1 -- 172.21.15.81:0/1675092766 learned_addr learned my addr 172.21.15.81:0/1675092766 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b77fe640 1 --2- 172.21.15.81:0/1675092766 >> v2:172.21.15.117:3300/0 conn(0x7f41b80ca000 0x7f41b80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b6ffd640 1 -- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 msgr2=0x7f41b81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b6ffd640 1 -- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 msgr2=0x7f41b81588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594540260 0 0) 0x7f41b8158e20 con 0x7f41b8154cf0 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a0003530 con 0x7f41b8154cf0 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544882210 0 0) 0x7f41a0003530 con 0x7f41b8154cf0 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b77fe640 1 -- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 msgr2=0x7f41b81588e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b77fe640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b77fe640 1 -- 172.21.15.81:0/1675092766 >> v1:172.21.15.81:6789/0 conn(0x7f41b8154cf0 legacy=0x7f41b8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.585+0000 7f41b77fe640 1 -- 172.21.15.81:0/1675092766 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8155860 con 0x7f41b80ca000 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41b77fe640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b80ca490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b001c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3236d38a9219bc57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac001680 con 0x7f41b80ca000 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b00a5590 con 0x7f41b80ca000 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41b5ffb640 1 -- 172.21.15.81:0/1675092766 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00a5900 con 0x7f41b80ca000 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 msgr2=0x7f41b80ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b80ca490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009d90 tx=0x7f41b001c770 comp rx=0 tx=0).stop 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- 172.21.15.81:0/1675092766 shutdown_connections 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b80ca490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- 172.21.15.81:0/1675092766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8151f00 0x7f41b81588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- 172.21.15.81:0/1675092766 >> 172.21.15.81:0/1675092766 conn(0x7f41b80715f0 msgr2=0x7f41b8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- 172.21.15.81:0/1675092766 shutdown_connections 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- 172.21.15.81:0/1675092766 wait complete. 2024-05-08T20:29:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 Processor -- start 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- start start 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b81ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8154cf0 0x7f41b8142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80adff0 con 0x7f41b8151f00 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.589+0000 7f41bd55d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80aee50 con 0x7f41b80ca000 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41bd55d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80ad970 con 0x7f41b8154cf0 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42858/0 (socket says 172.21.15.81:42858) 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 -- 172.21.15.81:0/3396298853 learned_addr learned my addr 172.21.15.81:0/3396298853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b81ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b77fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8154cf0 0x7f41b8142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8154cf0 msgr2=0x7f41b8142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8154cf0 0x7f41b8142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 msgr2=0x7f41b81ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41b80ca000 0x7f41b81ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009a70 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b67fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c750 tx=0x7f41ac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac005ae0 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac005c40 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b80af0a0 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac007070 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b80adc10 con 0x7f41b8151f00 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8069600 con 0x7f41b8155b10 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:29:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41ac0071f0 con 0x7f41b8151f00 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 0x7f41a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f41ac0842e0 con 0x7f41b8151f00 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b77fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 0x7f41a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.593+0000 7f41b77fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 0x7f41a4068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41b00af000 tx=0x7f41b00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.797+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.797+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:29:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.797+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.797+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:55.797+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:29:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:56.201+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:56.201+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:29:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:56.201+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:56.201+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:56.201+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:29:56.234 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-08T20:29:56.254 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-08T20:29:56.521 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-08T20:29:56.534 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-08T20:29:56.740 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-08T20:29:56.749 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-08T20:29:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:57.004+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:57.004+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:29:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:57.004+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:57.004+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:57.004+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:29:57.791 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-08T20:29:57.804 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-08T20:29:57.966 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-08T20:29:57.979 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr:ffsb_op.c: In function 'print_op_results': 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~ 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr: 86 | sprintf(buf, "NA\0"); 2024-05-08T20:29:58.053 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~ 2024-05-08T20:29:58.227 INFO:tasks.workunit.client.1.smithi117.stderr:ffsb_op.c: In function 'print_results': 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~ 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr:In file included from /usr/include/stdio.h:894, 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: from ffsb_op.c:20: 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: 40 | __va_arg_pack ()); 2024-05-08T20:29:58.228 INFO:tasks.workunit.client.1.smithi117.stderr: | ~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:58.322 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-08T20:29:58.340 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-08T20:29:58.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:58.608+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:58.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:58.608+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:29:58.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:58.608+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:58.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:58.608+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:58.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:58.608+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T20:29:59.064 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-08T20:29:59.083 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-08T20:29:59.156 INFO:tasks.workunit.client.1.smithi117.stderr:In file included from parser.h:22, 2024-05-08T20:29:59.157 INFO:tasks.workunit.client.1.smithi117.stderr: from parser.c:25: 2024-05-08T20:29:59.157 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c: In function 'init_filesys': 2024-05-08T20:29:59.162 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.162 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.162 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.163 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.164 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.165 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.166 INFO:tasks.workunit.client.1.smithi117.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c: In function 'init_tg_stats': 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.167 INFO:tasks.workunit.client.1.smithi117.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.168 INFO:tasks.workunit.client.1.smithi117.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: 971 | list_for_each_entry(tmp_list, 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.169 INFO:tasks.workunit.client.1.smithi117.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: | ^ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: 36 | container_of(ptr, type, member) 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~ 2024-05-08T20:29:59.170 INFO:tasks.workunit.client.1.smithi117.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-05-08T20:29:59.171 INFO:tasks.workunit.client.1.smithi117.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T20:29:59.171 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~ 2024-05-08T20:29:59.171 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-05-08T20:29:59.171 INFO:tasks.workunit.client.1.smithi117.stderr: 980 | list_for_each_entry(tmp_list, 2024-05-08T20:29:59.171 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c: In function 'get_optstr': 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr:parser.c:200:14: note: source object declared here 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr: 200 | char temp[BUFSIZE]; 2024-05-08T20:29:59.330 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~ 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 msgr2=0x7f41b8143170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b8155b10 0x7f41b8143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f419e7fc640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4190006090 con 0x7f4190003550 2024-05-08T20:29:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 msgr2=0x7f41900059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:29:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 msgr2=0x7f41900059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:29:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:29:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.592+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:29:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4190006200 con 0x7f4190003550 2024-05-08T20:29:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa10 tx=0x7f41a801aed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a801f070 con 0x7f4190003550 2024-05-08T20:29:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f41a800c040 con 0x7f4190003550 2024-05-08T20:29:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 msgr2=0x7f41900059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa10 tx=0x7f41a801aed0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 msgr2=0x7f41900059e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.796+0000 7f419f7fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4190003550 0x7f41900059e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.804+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 0x7f41b81f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.804+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80c6540 con 0x7f41b81f0420 2024-05-08T20:29:59.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 0x7f41b81f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41b6ffd640 1 -- 172.21.15.81:0/3396298853 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f41b80ca9d0 con 0x7f41b81f0420 2024-05-08T20:29:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41b6ffd640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 0x7f41b81f0830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa10 tx=0x7f41a80046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:59.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a802e070 con 0x7f41b81f0420 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f41a8003620 con 0x7f41b81f0420 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 msgr2=0x7f41b81f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 0x7f41b81f0830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa10 tx=0x7f41a80046d0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 msgr2=0x7f41b81f0830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41b77fe640 1 -- 172.21.15.81:0/3396298853 reap_dead start 2024-05-08T20:29:59.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f419f7fe640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41b81f0420 0x7f41b81f0830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:29:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:59.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:29:59.815 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:29:59.816 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:29:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:29:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:29:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:29:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:29:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 msgr2=0x7f41a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 0x7f41a4068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41b00af000 tx=0x7f41b00a7070 comp rx=0 tx=0).stop 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 msgr2=0x7f41b80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c750 tx=0x7f41ac00cc10 comp rx=0 tx=0).stop 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 shutdown_connections 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f41a4066690 0x7f41a4068b50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 --2- 172.21.15.81:0/3396298853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b8151f00 0x7f41b80ae410 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 >> 172.21.15.81:0/3396298853 conn(0x7f41b80715f0 msgr2=0x7f41b80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 shutdown_connections 2024-05-08T20:29:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.808+0000 7f41bd55d640 1 -- 172.21.15.81:0/3396298853 wait complete. 2024-05-08T20:29:59.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:29:59.834 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:29:59.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:29:59.883 INFO:tasks.workunit.client.1.smithi117.stderr:In file included from /usr/include/string.h:535, 2024-05-08T20:29:59.883 INFO:tasks.workunit.client.1.smithi117.stderr: from parser.c:19: 2024-05-08T20:29:59.883 INFO:tasks.workunit.client.1.smithi117.stderr:In function 'memcpy', 2024-05-08T20:29:59.883 INFO:tasks.workunit.client.1.smithi117.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-05-08T20:29:59.884 INFO:tasks.workunit.client.1.smithi117.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-05-08T20:29:59.884 INFO:tasks.workunit.client.1.smithi117.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-05-08T20:29:59.884 INFO:tasks.workunit.client.1.smithi117.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.884 INFO:tasks.workunit.client.1.smithi117.stderr: 30 | __glibc_objsize0 (__dest)); 2024-05-08T20:29:59.884 INFO:tasks.workunit.client.1.smithi117.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T20:29:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 Processor -- start 2024-05-08T20:29:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 -- start start 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45300c34e0 0x7f4530155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4530158080 con 0x7f45300c2570 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453006a890 con 0x7f4530152340 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f4534f55640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453006ab70 con 0x7f45300c34e0 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45300c2570 0x7f4530154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37462/0 (socket says 172.21.15.81:37462) 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452dd9b640 1 -- 172.21.15.81:0/1425323568 learned_addr learned my addr 172.21.15.81:0/1425323568 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:29:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452ed9d640 1 --2- 172.21.15.81:0/1425323568 >> v2:172.21.15.117:3300/0 conn(0x7f45300c34e0 0x7f4530155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030724488 0 0) 0x7f4530158080 con 0x7f45300c2570 2024-05-08T20:29:59.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4518003530 con 0x7f45300c2570 2024-05-08T20:29:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905845081 0 0) 0x7f4518003530 con 0x7f45300c2570 2024-05-08T20:29:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 >> v2:172.21.15.117:3300/0 conn(0x7f45300c34e0 msgr2=0x7f4530155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 --2- 172.21.15.81:0/1425323568 >> v2:172.21.15.117:3300/0 conn(0x7f45300c34e0 0x7f4530155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 >> v1:172.21.15.117:6789/0 conn(0x7f4530152340 legacy=0x7f453006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300c2d70 con 0x7f45300c2570 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4524001680 con 0x7f45300c2570 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 >> v1:172.21.15.81:6789/0 conn(0x7f45300c2570 legacy=0x7f4530154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518003980 0x7f4518003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45180047d0 0x7f4518004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 0x7f451800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453006ab70 con 0x7f4518005190 2024-05-08T20:29:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451800c130 con 0x7f4518003980 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451800c2f0 con 0x7f45180047d0 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.952+0000 7f452ed9d640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 0x7f451800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452dd9b640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45180047d0 0x7f4518004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452e59c640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518003980 0x7f4518003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 -- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45180047d0 msgr2=0x7f4518004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45180047d0 0x7f4518004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 -- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518003980 msgr2=0x7f4518003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518003980 0x7f4518003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 -- 172.21.15.81:0/1425323568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4518003530 con 0x7f4518005190 2024-05-08T20:29:59.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 -- 172.21.15.81:0/1425323568 reap_dead start 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452ed9d640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 0x7f451800b990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f452801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bce0311151f4625 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280a5bc0 con 0x7f4518005190 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452800f040 con 0x7f4518005190 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.956+0000 7f452d59a640 1 -- 172.21.15.81:0/1425323568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280039a0 con 0x7f4518005190 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 msgr2=0x7f451800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 0x7f451800b990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f452801ccc0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- 172.21.15.81:0/1425323568 shutdown_connections 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 --2- 172.21.15.81:0/1425323568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518005190 0x7f451800b990 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- 172.21.15.81:0/1425323568 >> 172.21.15.81:0/1425323568 conn(0x7f45300c71b0 msgr2=0x7f45300c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:29:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- 172.21.15.81:0/1425323568 shutdown_connections 2024-05-08T20:29:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- 172.21.15.81:0/1425323568 wait complete. 2024-05-08T20:29:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 Processor -- start 2024-05-08T20:29:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- start start 2024-05-08T20:29:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518005190 0x7f4530154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45300c69b0 0x7f45301ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45301e9a60 con 0x7f45300aa3d0 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45300aa940 con 0x7f4518005190 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f4534f55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45301e9d20 con 0x7f45300c69b0 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55088/0 (socket says 172.21.15.81:55088) 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 -- 172.21.15.81:0/2164545765 learned_addr learned my addr 172.21.15.81:0/2164545765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452e59c640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518005190 0x7f4530154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452ed9d640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45300c69b0 0x7f45301ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 -- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45300c69b0 msgr2=0x7f45301ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45300c69b0 0x7f45301ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 -- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518005190 msgr2=0x7f4530154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518005190 0x7f4530154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 -- 172.21.15.81:0/2164545765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45301ea000 con 0x7f45300aa3d0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.960+0000 7f452dd9b640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f45240019e0 tx=0x7f4524011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400fb60 con 0x7f45300aa3d0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524011e90 con 0x7f45300aa3d0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524015410 con 0x7f45300aa3d0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45301ea2e0 con 0x7f45300aa3d0 2024-05-08T20:29:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45300c5d20 con 0x7f45300aa3d0 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45300675e0 con 0x7f45300aa3d0 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4524015570 con 0x7f45300aa3d0 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 0x7f4510068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f45240876f0 con 0x7f45300aa3d0 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f452e59c640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 0x7f4510068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:29:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.964+0000 7f452e59c640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 0x7f4510068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4520005490 tx=0x7f4520009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:29:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:29:59.972+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4524054750 con 0x7f45300aa3d0 2024-05-08T20:30:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f4530074950 con 0x7f45300aa3d0 2024-05-08T20:30:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f451effd640 1 -- 172.21.15.81:0/2164545765 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f4524057d70 con 0x7f45300aa3d0 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 msgr2=0x7f4510068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 0x7f4510068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4520005490 tx=0x7f4520009040 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 msgr2=0x7f45301ed010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f45240019e0 tx=0x7f4524011ca0 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 shutdown_connections 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4510066690 0x7f4510068b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45300c69b0 0x7f45301ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300aa3d0 0x7f45301ed010 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 --2- 172.21.15.81:0/2164545765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4518005190 0x7f4530154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 >> 172.21.15.81:0/2164545765 conn(0x7f45300c71b0 msgr2=0x7f45300c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 shutdown_connections 2024-05-08T20:30:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:00.264+0000 7f4534f55640 1 -- 172.21.15.81:0/2164545765 wait complete. 2024-05-08T20:30:00.276 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-08T20:30:00.286 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-08T20:30:00.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:30:00.392 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-08T20:30:00.402 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-08T20:30:00.532 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-08T20:30:00.541 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-08T20:30:00.591 INFO:tasks.workunit.client.1.smithi117.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-08T20:30:00.603 INFO:tasks.workunit.client.1.smithi117.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-08T20:30:00.732 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-05-08T20:30:00.739 INFO:tasks.workunit.client.1.smithi117.stdout:FFSB version 6.0-RC2 started 2024-05-08T20:30:00.739 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout:benchmark time = 300 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout:ThreadGroup 0 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout:================ 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout: num_threads = 32 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout: read_random = off 2024-05-08T20:30:00.742 INFO:tasks.workunit.client.1.smithi117.stdout: read_size = 0 (0B) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: read_blocksize = 0 (0B) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: read_skip = off 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: read_skipsize = 0 (0B) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: write_random = on 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: write_size = 5242880 (5MB) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: fsync_file = 0 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: write_blocksize = 4096 (4KB) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: wait time = 0 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: op weights 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: read = 0 (0.00%) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: readall = 0 (0.00%) 2024-05-08T20:30:00.743 INFO:tasks.workunit.client.1.smithi117.stdout: write = 1 (100.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: create = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: append = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: delete = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: metaop = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: createdir = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: stat = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: writeall = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: writeall_fsync = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: open_close = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: write_fsync = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: create_fsync = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: append_fsync = 0 (0.00%) 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout:FileSystem . 2024-05-08T20:30:00.744 INFO:tasks.workunit.client.1.smithi117.stdout:========== 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: num_dirs = 0 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: starting files = 128 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: min file size = 104857600 (100MB) 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: max file size = 104857600 (100MB) 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: directio = off 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: alignedio = on 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: bufferedio = off 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.745 INFO:tasks.workunit.client.1.smithi117.stdout: aging is off 2024-05-08T20:30:00.746 INFO:tasks.workunit.client.1.smithi117.stdout: current utilization = 0.00% 2024-05-08T20:30:00.746 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:30:00.746 INFO:tasks.workunit.client.1.smithi117.stdout:checking existing fs: . 2024-05-08T20:30:00.746 INFO:tasks.workunit.client.1.smithi117.stdout:recreating new fileset 2024-05-08T20:30:00.746 INFO:tasks.workunit.client.1.smithi117.stderr:opendir: No such file or directory 2024-05-08T20:30:10.296 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:30:10.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:30:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 Processor -- start 2024-05-08T20:30:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 -- start start 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76600c30d0 0x7f76600c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76600a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7660155e10 con 0x7f76600c2bc0 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766006e790 con 0x7f76600c30d0 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f7664af6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766006f460 con 0x7f76600a94b0 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76600c30d0 0x7f76600c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76600c30d0 0x7f76600c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42930/0 (socket says 172.21.15.81:42930) 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 -- 172.21.15.81:0/2013851862 learned_addr learned my addr 172.21.15.81:0/2013851862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765ed9d640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76600a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 -- 172.21.15.81:0/2013851862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 msgr2=0x7f76600a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76600a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 -- 172.21.15.81:0/2013851862 >> v1:172.21.15.117:6789/0 conn(0x7f76600c2bc0 legacy=0x7f76600c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.440+0000 7f765e59c640 1 -- 172.21.15.81:0/2013851862 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600a9e20 con 0x7f76600c30d0 2024-05-08T20:30:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765e59c640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c30d0 0x7f76600c34b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97e3462f34d3d33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765d59a640 1 -- 172.21.15.81:0/2013851862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500ab620 con 0x7f76600c30d0 2024-05-08T20:30:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765d59a640 1 -- 172.21.15.81:0/2013851862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500ab780 con 0x7f76600c30d0 2024-05-08T20:30:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765d59a640 1 -- 172.21.15.81:0/2013851862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500abb10 con 0x7f76600c30d0 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- 172.21.15.81:0/2013851862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c30d0 msgr2=0x7f76600c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c30d0 0x7f76600c34b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c460 comp rx=0 tx=0).stop 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- 172.21.15.81:0/2013851862 shutdown_connections 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76600a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- 172.21.15.81:0/2013851862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c30d0 0x7f76600c34b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- 172.21.15.81:0/2013851862 >> 172.21.15.81:0/2013851862 conn(0x7f76600c4cc0 msgr2=0x7f76600c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- 172.21.15.81:0/2013851862 shutdown_connections 2024-05-08T20:30:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- 172.21.15.81:0/2013851862 wait complete. 2024-05-08T20:30:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 Processor -- start 2024-05-08T20:30:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- start start 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76601f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76600c30d0 0x7f766015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601489f0 con 0x7f76600c2bc0 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601ed540 con 0x7f76600c30d0 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f7664af6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766014a1d0 con 0x7f76600a94b0 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42934/0 (socket says 172.21.15.81:42934) 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765dd9b640 1 -- 172.21.15.81:0/1611343608 learned_addr learned my addr 172.21.15.81:0/1611343608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.444+0000 7f765e59c640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76601f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765ed9d640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76600c30d0 0x7f766015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 -- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 msgr2=0x7f76601f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76601f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 -- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76600c30d0 msgr2=0x7f766015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76600c30d0 0x7f766015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 -- 172.21.15.81:0/1611343608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094d0 con 0x7f76600c2bc0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765e59c640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76601f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765dd9b640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f765400c440 tx=0x7f765400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654012830 con 0x7f76600c2bc0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654012990 con 0x7f76600c2bc0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7660149c10 con 0x7f76600c2bc0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654012d40 con 0x7f76600c2bc0 2024-05-08T20:30:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76601ed1d0 con 0x7f76600c2bc0 2024-05-08T20:30:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660072600 con 0x7f76600c2bc0 2024-05-08T20:30:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f765401b400 con 0x7f76600c2bc0 2024-05-08T20:30:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 0x7f7640068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7654084780 con 0x7f76600c2bc0 2024-05-08T20:30:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765e59c640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 0x7f7640068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.448+0000 7f765e59c640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 0x7f7640068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f76500af000 tx=0x7f7650008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.452+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7654051740 con 0x7f76600c2bc0 2024-05-08T20:30:10.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.744+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7660074930 con 0x7f76600c2bc0 2024-05-08T20:30:10.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.744+0000 7f764effd640 1 -- 172.21.15.81:0/1611343608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f7654016620 con 0x7f76600c2bc0 2024-05-08T20:30:10.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:30:10.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 msgr2=0x7f7640068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 0x7f7640068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f76500af000 tx=0x7f7650008040 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 msgr2=0x7f76601ed9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f765400c440 tx=0x7f765400c900 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 shutdown_connections 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7640066690 0x7f7640068b50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76600c30d0 0x7f766015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76600c2bc0 0x7f76601ed9d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 --2- 172.21.15.81:0/1611343608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76600a94b0 0x7f76601f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 >> 172.21.15.81:0/1611343608 conn(0x7f76600c4cc0 msgr2=0x7f766015c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 shutdown_connections 2024-05-08T20:30:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.748+0000 7f7664af6640 1 -- 172.21.15.81:0/1611343608 wait complete. 2024-05-08T20:30:10.770 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:30:10.770 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:30:10.770 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:30:10.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:30:10.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.888+0000 7f6fd886c640 1 Processor -- start 2024-05-08T20:30:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.888+0000 7f6fd886c640 1 -- start start 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.888+0000 7f6fd886c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6fd40c2570 0x7f6fd4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd886c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd4158080 con 0x7f6fd4152340 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd886c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd406a890 con 0x7f6fd40c34e0 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd886c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd406ab70 con 0x7f6fd40c2570 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6fd4152340 0x7f6fd406d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57666/0 (socket says 172.21.15.81:57666) 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd259c640 1 -- 172.21.15.81:0/712354699 learned_addr learned my addr 172.21.15.81:0/712354699 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fcbfff640 1 --2- 172.21.15.81:0/712354699 >> v2:172.21.15.117:3300/0 conn(0x7f6fd40c2570 0x7f6fd4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663679129 0 0) 0x7f6fd4158080 con 0x7f6fd4152340 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc0003530 con 0x7f6fd4152340 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817341554 0 0) 0x7f6fc0003530 con 0x7f6fd4152340 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 >> v2:172.21.15.117:3300/0 conn(0x7f6fd40c2570 msgr2=0x7f6fd4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 --2- 172.21.15.81:0/712354699 >> v2:172.21.15.117:3300/0 conn(0x7f6fd40c2570 0x7f6fd4154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 >> v1:172.21.15.117:6789/0 conn(0x7f6fd40c34e0 legacy=0x7f6fd41554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40c2d70 con 0x7f6fd4152340 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f6fc4001680 con 0x7f6fd4152340 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 >> v1:172.21.15.81:6789/0 conn(0x7f6fd4152340 legacy=0x7f6fd406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0003980 0x7f6fc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc00047d0 0x7f6fc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 0x7f6fc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd406ab70 con 0x7f6fc0005190 2024-05-08T20:30:10.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc000c130 con 0x7f6fc00047d0 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc000c2f0 con 0x7f6fc0003980 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 0x7f6fc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd259c640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0003980 0x7f6fc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fcbfff640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc00047d0 0x7f6fc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0003980 msgr2=0x7f6fc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0003980 0x7f6fc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc00047d0 msgr2=0x7f6fc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fc00047d0 0x7f6fc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/712354699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0003530 con 0x7f6fc0005190 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.892+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/712354699 reap_dead start 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 0x7f6fc000b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc001e70 tx=0x7f6fcc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2d1e4d4f8ccb82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc003b80 con 0x7f6fc0005190 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc003d20 con 0x7f6fc0005190 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd1d9b640 1 -- 172.21.15.81:0/712354699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc005310 con 0x7f6fc0005190 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 msgr2=0x7f6fc000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 0x7f6fc000b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc001e70 tx=0x7f6fcc01c780 comp rx=0 tx=0).stop 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- 172.21.15.81:0/712354699 shutdown_connections 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 --2- 172.21.15.81:0/712354699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fc0005190 0x7f6fc000b990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- 172.21.15.81:0/712354699 >> 172.21.15.81:0/712354699 conn(0x7f6fd40c71b0 msgr2=0x7f6fd40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- 172.21.15.81:0/712354699 shutdown_connections 2024-05-08T20:30:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- 172.21.15.81:0/712354699 wait complete. 2024-05-08T20:30:10.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 Processor -- start 2024-05-08T20:30:10.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- start start 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0005190 0x7f6fd414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd4071e80 0x7f6fd4147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 0x7f6fd4148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40ab270 con 0x7f6fd4071a30 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd41488c0 con 0x7f6fd4071e80 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd886c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40c5090 con 0x7f6fc0005190 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 0x7f6fd4148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 0x7f6fd4148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42944/0 (socket says 172.21.15.81:42944) 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 learned_addr learned my addr 172.21.15.81:0/2741405486 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd259c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0005190 0x7f6fd414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fcbfff640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd4071e80 0x7f6fd4147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0005190 msgr2=0x7f6fd414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fc0005190 0x7f6fd414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd4071e80 msgr2=0x7f6fd4147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fd4071e80 0x7f6fd4147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.896+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40c4df0 con 0x7f6fd4071a30 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd2d9d640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 0x7f6fd4148380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc098080 tx=0x7f6fc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc006d60 con 0x7f6fd4071a30 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc003e90 con 0x7f6fd4071a30 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd40ad000 con 0x7f6fd4071a30 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a96b0 con 0x7f6fd4071a30 2024-05-08T20:30:10.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd40aa470 con 0x7f6fd4071a30 2024-05-08T20:30:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd886c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 0x7f6fd41e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4069550 con 0x7f6fd40ac7d0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd259c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 0x7f6fd41e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd259c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fd4152720 con 0x7f6fd40ac7d0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fd259c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 0x7f6fd41e9a90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4013820 tx=0x7f6fc4013ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4011bb0 con 0x7f6fd40ac7d0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fcc007030 con 0x7f6fd4071a30 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6fb4066730 0x7f6fb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6fcc11d620 con 0x7f6fd4071a30 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcbfff640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6fb4066730 0x7f6fb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6fc4011d10 con 0x7f6fd40ac7d0 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 msgr2=0x7f6fd41e9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 0x7f6fd41e9a90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4013820 tx=0x7f6fc4013ce0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 msgr2=0x7f6fd41e9a90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcaffd640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd40ac7d0 0x7f6fd41e9a90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.900+0000 7f6fcbfff640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6fb4066730 0x7f6fb4068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4150810 tx=0x7f6fbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 0x7f6fd41ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40675e0 con 0x7f6fd41e9fd0 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd259c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 0x7f6fd41ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd259c640 1 -- 172.21.15.81:0/2741405486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6fd40aa690 con 0x7f6fd41e9fd0 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd259c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 0x7f6fd41ea3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4013820 tx=0x7f6fc4001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4026070 con 0x7f6fd41e9fd0 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f6fc40212e0 con 0x7f6fd41e9fd0 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 msgr2=0x7f6fd41ea3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 0x7f6fd41ea3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4013820 tx=0x7f6fc4001e60 comp rx=0 tx=0).stop 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 msgr2=0x7f6fd41ea3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fcaffd640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd41e9fd0 0x7f6fd41ea3e0 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4013820 tx=0x7f6fc4001e60 comp rx=0 tx=0).stop 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:30:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:30:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:30:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:30:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:30:10.927 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6fb4066730 msgr2=0x7f6fb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6fb4066730 0x7f6fb4068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4150810 tx=0x7f6fbc008040 comp rx=0 tx=0).stop 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 msgr2=0x7f6fd4148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 --2- 172.21.15.81:0/2741405486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd4071a30 0x7f6fd4148380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc098080 tx=0x7f6fc0005800 comp rx=0 tx=0).stop 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 reap_dead start 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd2d9d640 1 -- 172.21.15.81:0/2741405486 reap_dead start 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 shutdown_connections 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 >> 172.21.15.81:0/2741405486 conn(0x7f6fd40c71b0 msgr2=0x7f6fd40c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 shutdown_connections 2024-05-08T20:30:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:10.908+0000 7f6fd886c640 1 -- 172.21.15.81:0/2741405486 wait complete. 2024-05-08T20:30:10.931 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:30:10.931 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:30:10.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:30:11.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 Processor -- start 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 -- start start 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ffc0c2570 0x7f8ffc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc158080 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc06a890 con 0x7f8ffc152340 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9003a25640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc06ab70 con 0x7f8ffc0c2570 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9001fc2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ffc0c34e0 0x7f8ffc1554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57676/0 (socket says 172.21.15.81:57676) 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9001fc2640 1 -- 172.21.15.81:0/3570828196 learned_addr learned my addr 172.21.15.81:0/3570828196 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 --2- 172.21.15.81:0/3570828196 >> v2:172.21.15.117:3300/0 conn(0x7f8ffc0c2570 0x7f8ffc154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814746928 0 0) 0x7f8ffc158080 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe8003530 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315501339 0 0) 0x7f8fe8003530 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 >> v2:172.21.15.117:3300/0 conn(0x7f8ffc0c2570 msgr2=0x7f8ffc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 --2- 172.21.15.81:0/3570828196 >> v2:172.21.15.117:3300/0 conn(0x7f8ffc0c2570 0x7f8ffc154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 >> v1:172.21.15.117:6789/0 conn(0x7f8ffc152340 legacy=0x7f8ffc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0c2d70 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8ff4001a00 con 0x7f8ffc0c34e0 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 >> v1:172.21.15.81:6789/0 conn(0x7f8ffc0c34e0 legacy=0x7f8ffc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fe8003980 0x7f8fe8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 0x7f8fe8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe8005190 0x7f8fe800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc06ab70 con 0x7f8fe80047d0 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800c130 con 0x7f8fe8003980 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe800c2f0 con 0x7f8fe8005190 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 0x7f8fe8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9001fc2640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe8005190 0x7f8fe800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 -- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe8005190 msgr2=0x7f8fe800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe8005190 0x7f8fe800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 -- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fe8003980 msgr2=0x7f8fe8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fe8003980 0x7f8fe8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9000fc0640 1 -- 172.21.15.81:0/3570828196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8003530 con 0x7f8fe80047d0 2024-05-08T20:30:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.052+0000 7f9001fc2640 1 -- 172.21.15.81:0/3570828196 reap_dead start 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9000fc0640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 0x7f8fe8004c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009ab0 tx=0x7f8fec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f9d6bc1b1c4d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a5530 con 0x7f8fe80047d0 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a5690 con 0x7f8fe80047d0 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f8ff3fff640 1 -- 172.21.15.81:0/3570828196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a5840 con 0x7f8fe80047d0 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 -- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 msgr2=0x7f8fe8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 0x7f8fe8004c50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009ab0 tx=0x7f8fec01ca50 comp rx=0 tx=0).stop 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 -- 172.21.15.81:0/3570828196 shutdown_connections 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 --2- 172.21.15.81:0/3570828196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe80047d0 0x7f8fe8004c50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 -- 172.21.15.81:0/3570828196 >> 172.21.15.81:0/3570828196 conn(0x7f8ffc0c71b0 msgr2=0x7f8ffc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 -- 172.21.15.81:0/3570828196 shutdown_connections 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.056+0000 7f9003a25640 1 -- 172.21.15.81:0/3570828196 wait complete. 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 Processor -- start 2024-05-08T20:30:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- start start 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe80047d0 0x7f8ffc0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 0x7f8ffc0c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14a5d0 0x7f8ffc14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0ac340 con 0x7f8ffc0c4080 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c5240 con 0x7f8ffc14a5d0 2024-05-08T20:30:11.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc14fa50 con 0x7f8fe80047d0 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 0x7f8ffc0c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 0x7f8ffc0c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42984/0 (socket says 172.21.15.81:42984) 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 -- 172.21.15.81:0/4215971570 learned_addr learned my addr 172.21.15.81:0/4215971570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f90017c1640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe80047d0 0x7f8ffc0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9001fc2640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14a5d0 0x7f8ffc14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe80047d0 msgr2=0x7f8ffc0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fe80047d0 0x7f8ffc0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14a5d0 msgr2=0x7f8ffc14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14a5d0 0x7f8ffc14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0ac530 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9001fc2640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14a5d0 0x7f8ffc14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9000fc0640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 0x7f8ffc0c4500 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b0040 tx=0x7f8fec0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a5530 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec004020 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc0ac810 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0043d0 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc0c5490 con 0x7f8ffc0c4080 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 0x7f8ffc0c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.060+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc069550 con 0x7f8ffc14afc0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f90017c1640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 0x7f8ffc0c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f90017c1640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ffc0675e0 con 0x7f8ffc14afc0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f90017c1640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 0x7f8ffc0c59b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc04fbc0 tx=0x7f8ff800e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fec0b4070 con 0x7f8ffc0c4080 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fe0066690 0x7f8fe0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8fec11e160 con 0x7f8ffc0c4080 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f9001fc2640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fe0066690 0x7f8fe0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80052e0 con 0x7f8ffc14afc0 2024-05-08T20:30:11.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8ff8005440 con 0x7f8ffc14afc0 2024-05-08T20:30:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 msgr2=0x7f8ffc0c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 0x7f8ffc0c59b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc04fbc0 tx=0x7f8ff800e8f0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 msgr2=0x7f8ffc0c59b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f8ff1ffb640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc14afc0 0x7f8ffc0c59b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.064+0000 7f9001fc2640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fe0066690 0x7f8fe0068b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0c38c0 tx=0x7f8ff40012e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.068+0000 7f9003a25640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 0x7f8ffc0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.068+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c5680 con 0x7f8ffc154f40 2024-05-08T20:30:11.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.068+0000 7f90017c1640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 0x7f8ffc0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f90017c1640 1 -- 172.21.15.81:0/4215971570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8ffc074950 con 0x7f8ffc154f40 2024-05-08T20:30:11.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f90017c1640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 0x7f8ffc0c5ef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8016000 tx=0x7f8ff8001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8021070 con 0x7f8ffc154f40 2024-05-08T20:30:11.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f8ff8003810 con 0x7f8ffc154f40 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 msgr2=0x7f8ffc0c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 0x7f8ffc0c5ef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8016000 tx=0x7f8ff8001130 comp rx=0 tx=0).stop 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 msgr2=0x7f8ffc0c5ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f8ff1ffb640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc154f40 0x7f8ffc0c5ef0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8016000 tx=0x7f8ff8001130 comp rx=0 tx=0).stop 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:30:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:30:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:30:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:30:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:30:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:30:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:30:11.095 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:30:11.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fe0066690 msgr2=0x7f8fe0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fe0066690 0x7f8fe0068b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0c38c0 tx=0x7f8ff40012e0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 msgr2=0x7f8ffc0c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 --2- 172.21.15.81:0/4215971570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ffc0c4080 0x7f8ffc0c4500 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b0040 tx=0x7f8fec0197f0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9001fc2640 1 -- 172.21.15.81:0/4215971570 reap_dead start 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9001fc2640 1 -- 172.21.15.81:0/4215971570 reap_dead start 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 shutdown_connections 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 >> 172.21.15.81:0/4215971570 conn(0x7f8ffc0c71b0 msgr2=0x7f8ffc153e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 shutdown_connections 2024-05-08T20:30:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.072+0000 7f9003a25640 1 -- 172.21.15.81:0/4215971570 wait complete. 2024-05-08T20:30:11.097 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:30:11.097 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:30:11.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:30:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 Processor -- start 2024-05-08T20:30:11.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 -- start start 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f8744155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8744158080 con 0x7f8744152340 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874406a890 con 0x7f87440c2570 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f874a71f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874406ab70 con 0x7f87440c34e0 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f8743fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8744152340 0x7f874406d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57682/0 (socket says 172.21.15.81:57682) 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.208+0000 7f8743fff640 1 -- 172.21.15.81:0/3520373478 learned_addr learned my addr 172.21.15.81:0/3520373478 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8748cbc640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f8744155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778714104 0 0) 0x7f8744158080 con 0x7f8744152340 2024-05-08T20:30:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f872c003530 con 0x7f8744152340 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047761910 0 0) 0x7f874406a890 con 0x7f87440c2570 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744158080 con 0x7f87440c2570 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188902232 0 0) 0x7f872c003530 con 0x7f8744152340 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 msgr2=0x7f8744155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f8744155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 >> v1:172.21.15.117:6789/0 conn(0x7f87440c2570 legacy=0x7f8744154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440c2d70 con 0x7f8744152340 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8734001680 con 0x7f8744152340 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 >> v1:172.21.15.81:6789/0 conn(0x7f8744152340 legacy=0x7f874406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c003b40 0x7f872c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0047d0 0x7f872c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f872c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874406ab70 con 0x7f872c0047d0 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c00bad0 con 0x7f872c003b40 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c00bc90 con 0x7f87440c34e0 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0047d0 0x7f872c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8743fff640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c003b40 0x7f872c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8748cbc640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f872c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 -- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 msgr2=0x7f872c0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87440c34e0 0x7f872c0051b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 -- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c003b40 msgr2=0x7f872c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c003b40 0x7f872c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 -- 172.21.15.81:0/3520373478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c003530 con 0x7f872c0047d0 2024-05-08T20:30:11.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f87437fe640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0047d0 0x7f872c004c50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f87440c2980 tx=0x7f873801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da35be5193f02860 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380052d0 con 0x7f872c0047d0 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380a7050 con 0x7f872c0047d0 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.212+0000 7f8742ffd640 1 -- 172.21.15.81:0/3520373478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738003600 con 0x7f872c0047d0 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- 172.21.15.81:0/3520373478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0047d0 msgr2=0x7f872c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 --2- 172.21.15.81:0/3520373478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872c0047d0 0x7f872c004c50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f87440c2980 tx=0x7f873801c560 comp rx=0 tx=0).stop 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f8748cbc640 1 -- 172.21.15.81:0/3520373478 reap_dead start 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- 172.21.15.81:0/3520373478 shutdown_connections 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- 172.21.15.81:0/3520373478 >> 172.21.15.81:0/3520373478 conn(0x7f87440c71b0 msgr2=0x7f87440c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- 172.21.15.81:0/3520373478 shutdown_connections 2024-05-08T20:30:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- 172.21.15.81:0/3520373478 wait complete. 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 Processor -- start 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- start start 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c0047d0 0x7f874413e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 0x7f8744144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ccc0 0x7f8744144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874413e980 con 0x7f8744150cb0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874414fc10 con 0x7f872c0047d0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f874a71f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874414fef0 con 0x7f874413ccc0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 0x7f8744144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 0x7f8744144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42998/0 (socket says 172.21.15.81:42998) 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 -- 172.21.15.81:0/2198541899 learned_addr learned my addr 172.21.15.81:0/2198541899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f8743fff640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c0047d0 0x7f874413e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f8748cbc640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ccc0 0x7f8744144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ccc0 msgr2=0x7f8744144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ccc0 0x7f8744144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c0047d0 msgr2=0x7f874413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c0047d0 0x7f874413e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87441501d0 con 0x7f8744150cb0 2024-05-08T20:30:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.216+0000 7f87437fe640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 0x7f8744144000 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f87380ad040 tx=0x7f872c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380069e0 con 0x7f8744150cb0 2024-05-08T20:30:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738006b40 con 0x7f8744150cb0 2024-05-08T20:30:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738007030 con 0x7f8744150cb0 2024-05-08T20:30:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87441504b0 con 0x7f8744150cb0 2024-05-08T20:30:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874413e680 con 0x7f8744150cb0 2024-05-08T20:30:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f874a71f640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 0x7f874413a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744069550 con 0x7f874413a540 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8743fff640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 0x7f874413a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8738007190 con 0x7f8744150cb0 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8743fff640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8744150060 con 0x7f874413a540 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8743fff640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 0x7f874413a920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f874414c0a0 tx=0x7f8734011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8730066690 0x7f8730068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8748cbc640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8730066690 0x7f8730068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f873811da50 con 0x7f8744150cb0 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734011e90 con 0x7f874413a540 2024-05-08T20:30:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.220+0000 7f8748cbc640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8730066690 0x7f8730068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8744072760 tx=0x7f873c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.224+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f873400f9e0 con 0x7f874413a540 2024-05-08T20:30:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.224+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 msgr2=0x7f874413a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.224+0000 7f8740ff9640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 0x7f874413a920 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f874414c0a0 tx=0x7f8734011ca0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.224+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 msgr2=0x7f874413a920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:11.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.224+0000 7f8740ff9640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413a540 0x7f874413a920 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 0x7f8744070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8744150360 con 0x7f874413ae60 2024-05-08T20:30:11.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8743fff640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 0x7f8744070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8743fff640 1 -- 172.21.15.81:0/2198541899 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8744160bf0 con 0x7f874413ae60 2024-05-08T20:30:11.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8743fff640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 0x7f8744070700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f874414c0a0 tx=0x7f8734001990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:11.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734015ae0 con 0x7f874413ae60 2024-05-08T20:30:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f8734015c40 con 0x7f874413ae60 2024-05-08T20:30:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 msgr2=0x7f8744070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 0x7f8744070700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f874414c0a0 tx=0x7f8734001990 comp rx=0 tx=0).stop 2024-05-08T20:30:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 msgr2=0x7f8744070700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8740ff9640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f874413ae60 0x7f8744070700 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f874414c0a0 tx=0x7f8734001990 comp rx=0 tx=0).stop 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 18, 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:30:11.238 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:30:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:30:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:30:11.250 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:30:11.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8730066690 msgr2=0x7f8730068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8730066690 0x7f8730068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8744072760 tx=0x7f873c00b040 comp rx=0 tx=0).stop 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 msgr2=0x7f8744144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 --2- 172.21.15.81:0/2198541899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8744150cb0 0x7f8744144000 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f87380ad040 tx=0x7f872c005800 comp rx=0 tx=0).stop 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8748cbc640 1 -- 172.21.15.81:0/2198541899 reap_dead start 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f8748cbc640 1 -- 172.21.15.81:0/2198541899 reap_dead start 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 shutdown_connections 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 >> 172.21.15.81:0/2198541899 conn(0x7f87440c71b0 msgr2=0x7f874406d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 shutdown_connections 2024-05-08T20:30:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:11.232+0000 7f874a71f640 1 -- 172.21.15.81:0/2198541899 wait complete. 2024-05-08T20:30:11.254 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:30:11.254 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:30:11.254 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-05-08T20:30:11.254 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:30:11.254 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:30:11.255 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:30:11.255 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:30:11.279 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:30:11.279 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-05-08T20:30:11.279 INFO:tasks.ceph.mon.a:Sent signal 19 2024-05-08T20:30:11.280 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:30:19.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:30:19.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:30:26.281 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-05-08T20:30:26.281 INFO:tasks.ceph.mon.a:Sent signal 18 2024-05-08T20:30:26.282 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:30:26.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:30:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 Processor -- start 2024-05-08T20:30:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 -- start start 2024-05-08T20:30:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e806c710 con 0x7f85e814ac10 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.408+0000 7f85ec87a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80a9b70 con 0x7f85e806dcf0 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85ec87a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e806c9f0 con 0x7f85e80bb620 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e6d9d640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f85e814ac10 legacy=0x7f85e81515f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e659c640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 msgr2=0x7f85e806d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55676/0 (socket says 172.21.15.81:55676) 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 learned_addr learned my addr 172.21.15.81:0/1760958036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.412+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:26.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e659c640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 msgr2=0x7f85e806d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> v1:172.21.15.117:6789/0 conn(0x7f85e814ac10 legacy=0x7f85e81515f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e659c640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:26.616+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> v1:172.21.15.117:6789/0 conn(0x7f85e814ac10 legacy=0x7f85e81515f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e659c640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 msgr2=0x7f85e806d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e659c640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.020+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e659c640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 msgr2=0x7f85e806d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> v1:172.21.15.117:6789/0 conn(0x7f85e814ac10 legacy=0x7f85e81515f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e659c640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:27.824+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:30:29.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 msgr2=0x7f85e806d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.117:3300/0 conn(0x7f85e80bb620 0x7f85e806d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 -- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 msgr2=0x7f85e80c2190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 --2- 172.21.15.81:0/1760958036 >> v2:172.21.15.81:3300/0 conn(0x7f85e806dcf0 0x7f85e80c2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 -- 172.21.15.81:0/1760958036 >> v1:172.21.15.117:6789/0 conn(0x7f85e814ac10 legacy=0x7f85e81515f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 -- 172.21.15.81:0/1760958036 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e806ccd0 con 0x7f85d4007220 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e4d99640 1 -- 172.21.15.81:0/1760958036 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806c9f0 con 0x7f85d40047b0 2024-05-08T20:30:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:29.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:29.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:29.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:29.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.412+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.616+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.616+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.616+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.616+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:29.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:29.616+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:30:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.020+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.020+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.020+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.020+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:30.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.020+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:30:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.824+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.824+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:30:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.824+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:30:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.824+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:30:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:30.824+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:30:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.364+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233542994 0 0) 0x7f85e806ccd0 con 0x7f85d4007220 2024-05-08T20:30:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.364+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d0005740 con 0x7f85d4007220 2024-05-08T20:30:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873246840 0 0) 0x7f85d0005740 con 0x7f85d4007220 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 msgr2=0x7f85d4006be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d40047b0 0x7f85d4006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e806c710 con 0x7f85d4007220 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f85dc004170 con 0x7f85d4007220 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 >> v1:172.21.15.81:6789/0 conn(0x7f85d4007220 legacy=0x7f85d40096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 reap_dead start 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 0x7f85d0005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d00069e0 0x7f85d0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85d000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806c9f0 con 0x7f85d0005b90 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d000e320 con 0x7f85d00073f0 2024-05-08T20:30:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d000e4e0 con 0x7f85d00069e0 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 0x7f85d0005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e759e640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 msgr2=0x7f85d000dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e759e640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85d000dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e659c640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d00069e0 0x7f85d0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d00069e0 msgr2=0x7f85d0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d00069e0 0x7f85d0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 msgr2=0x7f85d000dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85d000dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.368+0000 7f85e6d9d640 1 -- 172.21.15.81:0/1760958036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0005740 con 0x7f85d0005b90 2024-05-08T20:30:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 0x7f85d0005f90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003940 tx=0x7f85d801d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546a90ed6ef8ca57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a7450 con 0x7f85d0005b90 2024-05-08T20:30:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80a75b0 con 0x7f85d0005b90 2024-05-08T20:30:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85e5d9b640 1 -- 172.21.15.81:0/1760958036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a7960 con 0x7f85d0005b90 2024-05-08T20:30:31.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 -- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 msgr2=0x7f85d0005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 0x7f85d0005f90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003940 tx=0x7f85d801d950 comp rx=0 tx=0).stop 2024-05-08T20:30:31.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 -- 172.21.15.81:0/1760958036 shutdown_connections 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85d000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d00069e0 0x7f85d0006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 --2- 172.21.15.81:0/1760958036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d0005b90 0x7f85d0005f90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 -- 172.21.15.81:0/1760958036 >> 172.21.15.81:0/1760958036 conn(0x7f85e80c3100 msgr2=0x7f85e80c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 -- 172.21.15.81:0/1760958036 shutdown_connections 2024-05-08T20:30:31.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.376+0000 7f85ec87a640 1 -- 172.21.15.81:0/1760958036 wait complete. 2024-05-08T20:30:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 Processor -- start 2024-05-08T20:30:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 -- start start 2024-05-08T20:30:31.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d0005b90 0x7f85e81e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85e81ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.380+0000 7f85ec87a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806f660 con 0x7f85d00069e0 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85ec87a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e81e9060 con 0x7f85d00073f0 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85ec87a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806fb20 con 0x7f85d0005b90 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e759e640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 msgr2=0x7f85e81ec930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85e81ec930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59500/0 (socket says 172.21.15.81:59500) 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 -- 172.21.15.81:0/3023888056 learned_addr learned my addr 172.21.15.81:0/3023888056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d0005b90 0x7f85e81e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 -- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d0005b90 msgr2=0x7f85e81e8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d0005b90 0x7f85e81e8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 -- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 msgr2=0x7f85e81ec930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:30:31.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85e81ec930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 -- 172.21.15.81:0/3023888056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e806f840 con 0x7f85d00069e0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e659c640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f85dc000c10 tx=0x7f85dc00fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00d940 con 0x7f85d00069e0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc00dac0 con 0x7f85d00069e0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e81ec130 con 0x7f85d00069e0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00de70 con 0x7f85d00069e0 2024-05-08T20:30:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80bc210 con 0x7f85d00069e0 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80670c0 con 0x7f85d00069e0 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85dc01c400 con 0x7f85d00069e0 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 0x7f85d4069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f85dc084bc0 con 0x7f85d00069e0 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.384+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 0x7f85d4069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.388+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 0x7f85d4069140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85d80b0000 tx=0x7f85d80b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.392+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f85dc051c20 con 0x7f85d00069e0 2024-05-08T20:30:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.620+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f85e80c2a70 con 0x7f85d00069e0 2024-05-08T20:30:31.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.620+0000 7f85cf7fe640 1 -- 172.21.15.81:0/3023888056 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f85dc017020 con 0x7f85d00069e0 2024-05-08T20:30:31.625 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":22,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:30:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 msgr2=0x7f85d4069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 0x7f85d4069140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85d80b0000 tx=0x7f85d80b6040 comp rx=0 tx=0).stop 2024-05-08T20:30:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 msgr2=0x7f85e80bbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f85dc000c10 tx=0x7f85dc00fdc0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 shutdown_connections 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f85d4066c80 0x7f85d4069140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85d00073f0 0x7f85e81ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85d00069e0 0x7f85e80bbcd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 --2- 172.21.15.81:0/3023888056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85d0005b90 0x7f85e81e8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 >> 172.21.15.81:0/3023888056 conn(0x7f85e80c3100 msgr2=0x7f85e81de340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 shutdown_connections 2024-05-08T20:30:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.624+0000 7f85ec87a640 1 -- 172.21.15.81:0/3023888056 wait complete. 2024-05-08T20:30:31.644 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:30:31.644 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:30:31.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:30:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 Processor -- start 2024-05-08T20:30:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 -- start start 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1964151740 0x7f19640c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964155060 con 0x7f19640c1bb0 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964155340 con 0x7f19641535a0 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1969a75640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1964155620 con 0x7f1964151740 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19637fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19640c1bb0 0x7f1964152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56878/0 (socket says 172.21.15.81:56878) 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19637fe640 1 -- 172.21.15.81:0/772382251 learned_addr learned my addr 172.21.15.81:0/772382251 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1962ffd640 1 -- 172.21.15.81:0/772382251 >> v2:172.21.15.117:3300/0 conn(0x7f1964151740 msgr2=0x7f19640c1f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1963fff640 1 -- 172.21.15.81:0/772382251 >> v1:172.21.15.117:6789/0 conn(0x7f19641535a0 legacy=0x7f196415c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1962ffd640 1 --2- 172.21.15.81:0/772382251 >> v2:172.21.15.117:3300/0 conn(0x7f1964151740 0x7f19640c1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937045955 0 0) 0x7f1964155060 con 0x7f19640c1bb0 2024-05-08T20:30:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f194c003530 con 0x7f19640c1bb0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094236534 0 0) 0x7f194c003530 con 0x7f19640c1bb0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 >> v2:172.21.15.117:3300/0 conn(0x7f1964151740 msgr2=0x7f19640c1f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 --2- 172.21.15.81:0/772382251 >> v2:172.21.15.117:3300/0 conn(0x7f1964151740 0x7f19640c1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 >> v1:172.21.15.117:6789/0 conn(0x7f19641535a0 legacy=0x7f196415c080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964155900 con 0x7f19640c1bb0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1954001680 con 0x7f19640c1bb0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 >> v1:172.21.15.81:6789/0 conn(0x7f19640c1bb0 legacy=0x7f1964152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 0x7f194c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c0047d0 0x7f194c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194c0052b0 0x7f194c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964155620 con 0x7f194c003980 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c00c1b0 con 0x7f194c0052b0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c00c370 con 0x7f194c0047d0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f1963fff640 1 -- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194c0052b0 msgr2=0x7f194c00b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.760+0000 7f19637fe640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 0x7f194c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f1963fff640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194c0052b0 0x7f194c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f1962ffd640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c0047d0 0x7f194c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f19637fe640 1 -- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c0047d0 msgr2=0x7f194c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f19637fe640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c0047d0 0x7f194c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f19637fe640 1 -- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194c0052b0 msgr2=0x7f194c00b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f19637fe640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f194c0052b0 0x7f194c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f1963fff640 1 -- 172.21.15.81:0/772382251 reap_dead start 2024-05-08T20:30:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.764+0000 7f19637fe640 1 -- 172.21.15.81:0/772382251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c003530 con 0x7f194c003980 2024-05-08T20:30:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f19637fe640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 0x7f194c003d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1954007cb0 tx=0x7f195401edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc7a085b8d9ba61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540a7a00 con 0x7f194c003980 2024-05-08T20:30:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540a7b60 con 0x7f194c003980 2024-05-08T20:30:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f19627fc640 1 -- 172.21.15.81:0/772382251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540058e0 con 0x7f194c003980 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 msgr2=0x7f194c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 0x7f194c003d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1954007cb0 tx=0x7f195401edd0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- 172.21.15.81:0/772382251 shutdown_connections 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 --2- 172.21.15.81:0/772382251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194c003980 0x7f194c003d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- 172.21.15.81:0/772382251 >> 172.21.15.81:0/772382251 conn(0x7f19640c2ca0 msgr2=0x7f19640c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- 172.21.15.81:0/772382251 shutdown_connections 2024-05-08T20:30:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- 172.21.15.81:0/772382251 wait complete. 2024-05-08T20:30:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 Processor -- start 2024-05-08T20:30:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.768+0000 7f1969a75640 1 -- start start 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c003980 0x7f19641f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19640a8b30 0x7f19640c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 0x7f19640a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19641f1130 con 0x7f19641dc870 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196409aa50 con 0x7f19640a8b30 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19640c0220 con 0x7f194c003980 2024-05-08T20:30:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 0x7f19640a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 0x7f19640a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59518/0 (socket says 172.21.15.81:59518) 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 learned_addr learned my addr 172.21.15.81:0/195309554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1962ffd640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19640a8b30 msgr2=0x7f19640c4540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1962ffd640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19640a8b30 0x7f19640c4540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f19637fe640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c003980 0x7f19641f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c003980 msgr2=0x7f19641f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f194c003980 0x7f19641f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19640a8b30 msgr2=0x7f19640c4540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19640a8b30 0x7f19640c4540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196409ad10 con 0x7f19641dc870 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1963fff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 0x7f19640a7a80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f195c003cc0 tx=0x7f195c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c016430 con 0x7f19641dc870 2024-05-08T20:30:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c016590 con 0x7f19641dc870 2024-05-08T20:30:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196409aff0 con 0x7f19641dc870 2024-05-08T20:30:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c016940 con 0x7f19641dc870 2024-05-08T20:30:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19641f16b0 con 0x7f19641dc870 2024-05-08T20:30:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 0x7f19640a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19640696e0 con 0x7f19641dccf0 2024-05-08T20:30:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f19637fe640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 0x7f19640a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f19637fe640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1964066ab0 con 0x7f19641dccf0 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f19637fe640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 0x7f19640a7fc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f194c0057b0 tx=0x7f194c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f195c012020 con 0x7f19641dc870 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1950066640 0x7f1950068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1962ffd640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1950066640 0x7f1950068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f195c084520 con 0x7f19641dc870 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954001c20 con 0x7f19641dccf0 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1954004a00 con 0x7f19641dccf0 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 msgr2=0x7f19640a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 0x7f19640a7fc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f194c0057b0 tx=0x7f194c005800 comp rx=0 tx=0).stop 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 msgr2=0x7f19640a7fc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f194bfff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dccf0 0x7f19640a7fc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.772+0000 7f1962ffd640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1950066640 0x7f1950068b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1958006fd0 tx=0x7f1958008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 0x7f19641edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19641f1270 con 0x7f19641edb60 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f19637fe640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 0x7f19641edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f19637fe640 1 -- 172.21.15.81:0/195309554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f196409b230 con 0x7f19641edb60 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f19637fe640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 0x7f19641edf70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19540ad040 tx=0x7f19540a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540bc070 con 0x7f19641edb60 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f19540c1070 con 0x7f19641edb60 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 msgr2=0x7f19641edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 0x7f19641edf70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19540ad040 tx=0x7f19540a9070 comp rx=0 tx=0).stop 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 msgr2=0x7f19641edf70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f194bfff640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641edb60 0x7f19641edf70 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19540ad040 tx=0x7f19540a9070 comp rx=0 tx=0).stop 2024-05-08T20:30:31.785 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 22, 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.786 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.787 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:30:31.788 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.789 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:31.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.795 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:30:31.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.798 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:30:31.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1950066640 msgr2=0x7f1950068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1950066640 0x7f1950068b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1958006fd0 tx=0x7f1958008040 comp rx=0 tx=0).stop 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 msgr2=0x7f19640a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 --2- 172.21.15.81:0/195309554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19641dc870 0x7f19640a7a80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f195c003cc0 tx=0x7f195c00bf40 comp rx=0 tx=0).stop 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 reap_dead start 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1963fff640 1 -- 172.21.15.81:0/195309554 reap_dead start 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 shutdown_connections 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 >> 172.21.15.81:0/195309554 conn(0x7f19640c2ca0 msgr2=0x7f1964151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 shutdown_connections 2024-05-08T20:30:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.780+0000 7f1969a75640 1 -- 172.21.15.81:0/195309554 wait complete. 2024-05-08T20:30:31.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:30:31.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:30:31.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:30:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 Processor -- start 2024-05-08T20:30:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 -- start start 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe014e9f0 0x7fdbe00c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdbe00c20f0 0x7fdbe00bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00aa450 con 0x7fdbe00ab2b0 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00c0220 con 0x7fdbe00c20f0 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe6460640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0154a30 con 0x7fdbe014e9f0 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbdf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdbe00ab2b0 0x7fdbe00bf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56892/0 (socket says 172.21.15.81:56892) 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbdf7fe640 1 -- 172.21.15.81:0/2665424381 learned_addr learned my addr 172.21.15.81:0/2665424381 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe49fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdbe00c20f0 0x7fdbe00bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbdffff640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe014e9f0 0x7fdbe00c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe49fd640 1 -- 172.21.15.81:0/2665424381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe014e9f0 msgr2=0x7fdbe00c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:30:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe49fd640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe014e9f0 0x7fdbe00c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe49fd640 1 -- 172.21.15.81:0/2665424381 >> v1:172.21.15.81:6789/0 conn(0x7fdbe00ab2b0 legacy=0x7fdbe00bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbdeffd640 1 -- 172.21.15.81:0/2665424381 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405369356 0 0) 0x7fdbe00aa450 con 0x7fdbe00ab2b0 2024-05-08T20:30:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.908+0000 7fdbe49fd640 1 -- 172.21.15.81:0/2665424381 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0154c40 con 0x7fdbe00c20f0 2024-05-08T20:30:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe00c20f0 0x7fdbe00bfce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009d90 tx=0x7fdbd001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821889afa98eec38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdeffd640 1 -- 172.21.15.81:0/2665424381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00a5920 con 0x7fdbe00c20f0 2024-05-08T20:30:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdeffd640 1 -- 172.21.15.81:0/2665424381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd00a5a80 con 0x7fdbe00c20f0 2024-05-08T20:30:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdeffd640 1 -- 172.21.15.81:0/2665424381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00a5e10 con 0x7fdbe00c20f0 2024-05-08T20:30:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/2665424381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe00c20f0 msgr2=0x7fdbe00bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe00c20f0 0x7fdbe00bfce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009d90 tx=0x7fdbd001c970 comp rx=0 tx=0).stop 2024-05-08T20:30:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/2665424381 shutdown_connections 2024-05-08T20:30:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe00c20f0 0x7fdbe00bfce0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- 172.21.15.81:0/2665424381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe014e9f0 0x7fdbe00c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/2665424381 >> 172.21.15.81:0/2665424381 conn(0x7fdbe00c2ca0 msgr2=0x7fdbe00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/2665424381 shutdown_connections 2024-05-08T20:30:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/2665424381 wait complete. 2024-05-08T20:30:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 Processor -- start 2024-05-08T20:30:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- start start 2024-05-08T20:30:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbe00ab2b0 0x7fdbe0153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c20f0 0x7fdbe0070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 0x7fdbe0141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe01544e0 con 0x7fdbe014e9f0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0142f40 con 0x7fdbe00ab2b0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0071660 con 0x7fdbe00c20f0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdffff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbe00ab2b0 msgr2=0x7fdbe0153a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 0x7fdbe0141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbe00ab2b0 0x7fdbe0153a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 0x7fdbe0141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59566/0 (socket says 172.21.15.81:59566) 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 learned_addr learned my addr 172.21.15.81:0/1986821889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdf7fe640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c20f0 0x7fdbe0070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c20f0 msgr2=0x7fdbe0070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c20f0 0x7fdbe0070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbe00ab2b0 msgr2=0x7fdbe0153a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:30:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbe00ab2b0 0x7fdbe0153a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0009a70 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe49fd640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 0x7fdbe0141ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00b0040 tx=0x7fdbd0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00ad8d0 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd00ada30 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe0146a60 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00adde0 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.912+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe0146d20 con 0x7fdbe014e9f0 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbe6460640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 0x7fdbe01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00696e0 con 0x7fdbe0142400 2024-05-08T20:30:31.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdffff640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 0x7fdbe01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdbd00b4050 con 0x7fdbe014e9f0 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdffff640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbe014edd0 con 0x7fdbe0142400 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdbc0066640 0x7fdbc0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fdbd011f520 con 0x7fdbe014e9f0 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdf7fe640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdbc0066640 0x7fdbc0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdffff640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 0x7fdbe01427e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c4a0 tx=0x7fdbd800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004230 con 0x7fdbe0142400 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdf7fe640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdbc0066640 0x7fdbc0068b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00675b0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fdbd8004390 con 0x7fdbe0142400 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 msgr2=0x7fdbe01427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 0x7fdbe01427e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c4a0 tx=0x7fdbd800c960 comp rx=0 tx=0).stop 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 msgr2=0x7fdbe01427e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.916+0000 7fdbdcff9640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe0142400 0x7fdbe01427e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:30:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 0x7fdbe00c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:30:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0146eb0 con 0x7fdbe00c3d90 2024-05-08T20:30:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdffff640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 0x7fdbe00c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:30:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdffff640 1 -- 172.21.15.81:0/1986821889 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdbe0142d20 con 0x7fdbe00c3d90 2024-05-08T20:30:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdffff640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 0x7fdbe00c41a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c4a0 tx=0x7fdbd8004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:30:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8024400 con 0x7fdbe00c3d90 2024-05-08T20:30:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7fdbd80233a0 con 0x7fdbe00c3d90 2024-05-08T20:30:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 msgr2=0x7fdbe00c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 0x7fdbe00c41a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c4a0 tx=0x7fdbd8004740 comp rx=0 tx=0).stop 2024-05-08T20:30:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 msgr2=0x7fdbe00c41a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbdcff9640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdbe00c3d90 0x7fdbe00c41a0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c4a0 tx=0x7fdbd8004740 comp rx=0 tx=0).stop 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 22, 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:30:31.930 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:30:31.933 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:30:31.934 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:30:31.935 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:30:31.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:30:31.939 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:30:31.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:30:31.941 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdbc0066640 msgr2=0x7fdbc0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdbc0066640 0x7fdbc0068b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00675b0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 msgr2=0x7fdbe0141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 --2- 172.21.15.81:0/1986821889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe014e9f0 0x7fdbe0141ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00b0040 tx=0x7fdbd0019710 comp rx=0 tx=0).stop 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 reap_dead start 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe49fd640 1 -- 172.21.15.81:0/1986821889 reap_dead start 2024-05-08T20:30:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 shutdown_connections 2024-05-08T20:30:31.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 >> 172.21.15.81:0/1986821889 conn(0x7fdbe00c2ca0 msgr2=0x7fdbe0149460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:30:31.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.924+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 shutdown_connections 2024-05-08T20:30:31.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:30:31.928+0000 7fdbe6460640 1 -- 172.21.15.81:0/1986821889 wait complete. 2024-05-08T20:30:31.946 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:30:31.946 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:30:49.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:30:49.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:30:51.947 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:30:51.947 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:30:51.947 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:30:51.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:30:51.954 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:30:51.954 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-05-08T20:30:51.954 INFO:tasks.ceph.mon.a:Sent signal 19 2024-05-08T20:30:51.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:31:06.956 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-05-08T20:31:06.956 INFO:tasks.ceph.mon.a:Sent signal 18 2024-05-08T20:31:06.956 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:31:06.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:07.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.084+0000 7f983dc59640 1 Processor -- start 2024-05-08T20:31:07.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.084+0000 7f983dc59640 1 -- start start 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f983dc59640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f98380c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f983dc59640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98380c0650 con 0x7f98381501e0 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f983dc59640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983806fa80 con 0x7f98380725f0 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f983dc59640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983806fd60 con 0x7f983806f400 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98381501e0 0x7f983806c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43524/0 (socket says 172.21.15.81:43524) 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 -- 172.21.15.81:0/4237230279 learned_addr learned my addr 172.21.15.81:0/4237230279 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209412065 0 0) 0x7f98380c0650 con 0x7f98381501e0 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003530 con 0x7f98381501e0 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9837fff640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f98380c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3801841791 0 0) 0x7f9824003530 con 0x7f98381501e0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 msgr2=0x7f98380c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f98380c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 >> v1:172.21.15.117:6789/0 conn(0x7f98380725f0 legacy=0x7f98380c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838071ea0 con 0x7f98381501e0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9828001680 con 0x7f98381501e0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 >> v1:172.21.15.81:6789/0 conn(0x7f98381501e0 legacy=0x7f983806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98240039b0 0x7f9824003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240047d0 0x7f9824004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f982400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983806fd60 con 0x7f98240039b0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824005540 con 0x7f98240047d0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982400bed0 con 0x7f983806f400 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98240039b0 0x7f9824003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f982effd640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240047d0 0x7f9824004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f9837fff640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f982400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 -- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 msgr2=0x7f982400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f983806f400 0x7f982400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 -- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240047d0 msgr2=0x7f9824004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240047d0 0x7f9824004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 -- 172.21.15.81:0/4237230279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824003530 con 0x7f98240039b0 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.088+0000 7f98377fe640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98240039b0 0x7f9824003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f982800c240 tx=0x7f982801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5372c8cfdbf1d852 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828005ae0 con 0x7f98240039b0 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828005c40 con 0x7f98240039b0 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9836ffd640 1 -- 172.21.15.81:0/4237230279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280a5790 con 0x7f98240039b0 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- 172.21.15.81:0/4237230279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98240039b0 msgr2=0x7f9824003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 --2- 172.21.15.81:0/4237230279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98240039b0 0x7f9824003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f982800c240 tx=0x7f982801cc60 comp rx=0 tx=0).stop 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 -- 172.21.15.81:0/4237230279 reap_dead start 2024-05-08T20:31:07.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- 172.21.15.81:0/4237230279 shutdown_connections 2024-05-08T20:31:07.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- 172.21.15.81:0/4237230279 >> 172.21.15.81:0/4237230279 conn(0x7f98380c2ca0 msgr2=0x7f98380c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- 172.21.15.81:0/4237230279 shutdown_connections 2024-05-08T20:31:07.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- 172.21.15.81:0/4237230279 wait complete. 2024-05-08T20:31:07.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 Processor -- start 2024-05-08T20:31:07.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- start start 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240039b0 0x7f9838142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98381ecd50 0x7f98381ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838072180 con 0x7f98381ed710 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838147910 con 0x7f98240039b0 2024-05-08T20:31:07.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f983dc59640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9838154440 con 0x7f98381ecd50 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52418/0 (socket says 172.21.15.81:52418) 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 -- 172.21.15.81:0/3779328826 learned_addr learned my addr 172.21.15.81:0/3779328826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f98377fe640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240039b0 0x7f9838142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f982effd640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98381ecd50 0x7f98381ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 -- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98381ecd50 msgr2=0x7f98381ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98381ecd50 0x7f98381ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 -- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240039b0 msgr2=0x7f9838142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240039b0 0x7f9838142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 -- 172.21.15.81:0/3779328826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98381eede0 con 0x7f98381ed710 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.092+0000 7f9837fff640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f983804f380 tx=0x7f9830009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830007d50 con 0x7f98381ed710 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9830014400 con 0x7f98381ed710 2024-05-08T20:31:07.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98381ef0c0 con 0x7f98381ed710 2024-05-08T20:31:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300147b0 con 0x7f98381ed710 2024-05-08T20:31:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98381ef680 con 0x7f98381ed710 2024-05-08T20:31:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9838074950 con 0x7f98381ed710 2024-05-08T20:31:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9830014910 con 0x7f98381ed710 2024-05-08T20:31:07.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 0x7f9818068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9830084050 con 0x7f98381ed710 2024-05-08T20:31:07.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f98377fe640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 0x7f9818068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.096+0000 7f98377fe640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 0x7f9818068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98280ab000 tx=0x7f98280a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.100+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9830051160 con 0x7f98381ed710 2024-05-08T20:31:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.320+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f983814f140 con 0x7f98381ed710 2024-05-08T20:31:07.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.320+0000 7f9834ff9640 1 -- 172.21.15.81:0/3779328826 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f9830019620 con 0x7f98381ed710 2024-05-08T20:31:07.324 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 msgr2=0x7f9818068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 0x7f9818068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98280ab000 tx=0x7f98280a7070 comp rx=0 tx=0).stop 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 msgr2=0x7f983813c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f983804f380 tx=0x7f9830009dc0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 shutdown_connections 2024-05-08T20:31:07.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9818066690 0x7f9818068b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98381ed710 0x7f983813c800 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98381ecd50 0x7f98381ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 --2- 172.21.15.81:0/3779328826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98240039b0 0x7f9838142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 >> 172.21.15.81:0/3779328826 conn(0x7f98380c2ca0 msgr2=0x7f983814d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 shutdown_connections 2024-05-08T20:31:07.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.324+0000 7f983dc59640 1 -- 172.21.15.81:0/3779328826 wait complete. 2024-05-08T20:31:07.342 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:31:07.342 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:31:07.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:31:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 Processor -- start 2024-05-08T20:31:07.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 -- start start 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7dc151f00 0x7fb7dc1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7dc0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc158e20 con 0x7fb7dc154cf0 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc06bb20 con 0x7fb7dc151f00 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e254b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1548e0 con 0x7fb7dc0ca000 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7d37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb7dc154cf0 0x7fb7dc155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43526/0 (socket says 172.21.15.81:43526) 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7d37fe640 1 -- 172.21.15.81:0/1528411171 learned_addr learned my addr 172.21.15.81:0/1528411171 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883479778 0 0) 0x7fb7dc158e20 con 0x7fb7dc154cf0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7dbfff640 1 --2- 172.21.15.81:0/1528411171 >> v2:172.21.15.117:3300/0 conn(0x7fb7dc151f00 0x7fb7dc1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7dc0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c8003530 con 0x7fb7dc154cf0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.456+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479304042 0 0) 0x7fb7c8003530 con 0x7fb7dc154cf0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 msgr2=0x7fb7dc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7dc0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 >> v2:172.21.15.117:3300/0 conn(0x7fb7dc151f00 msgr2=0x7fb7dc1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 --2- 172.21.15.81:0/1528411171 >> v2:172.21.15.117:3300/0 conn(0x7fb7dc151f00 0x7fb7dc1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc155860 con 0x7fb7dc154cf0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb7c40016a0 con 0x7fb7dc154cf0 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 >> v1:172.21.15.81:6789/0 conn(0x7fb7dc154cf0 legacy=0x7fb7dc155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7c8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7c8003f00 0x7fb7c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800b9c0 con 0x7fb7c8004d10 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800bb30 con 0x7fb7c8003f00 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800bcf0 con 0x7fb7dc0ca000 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7dbfff640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7c8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7c8003f00 0x7fb7c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 msgr2=0x7fb7c8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ca000 0x7fb7c8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7c8003f00 msgr2=0x7fb7c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7c8003f00 0x7fb7c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/1528411171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8003530 con 0x7fb7c8004d10 2024-05-08T20:31:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7c8003f00 0x7fb7c80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009fc0 tx=0x7fb7d401caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39af0acb3f5e506 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5aa0 con 0x7fb7c8004d10 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400f040 con 0x7fb7c8004d10 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7db7fe640 1 -- 172.21.15.81:0/1528411171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5e40 con 0x7fb7c8004d10 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 -- 172.21.15.81:0/1528411171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 msgr2=0x7fb7c8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 --2- 172.21.15.81:0/1528411171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009fc0 tx=0x7fb7d401caa0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/1528411171 reap_dead start 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 -- 172.21.15.81:0/1528411171 shutdown_connections 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 -- 172.21.15.81:0/1528411171 >> 172.21.15.81:0/1528411171 conn(0x7fb7dc0715f0 msgr2=0x7fb7dc071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 -- 172.21.15.81:0/1528411171 shutdown_connections 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.460+0000 7fb7e254b640 1 -- 172.21.15.81:0/1528411171 wait complete. 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 Processor -- start 2024-05-08T20:31:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- start start 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7dc159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc159230 0x7fb7dc0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ae710 0x7fb7dc141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc15ba30 con 0x7fb7c8004d10 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc150820 con 0x7fb7dc159230 2024-05-08T20:31:07.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0af5e0 con 0x7fb7dc0ae710 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7dc159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7dc159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52430/0 (socket says 172.21.15.81:52430) 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 -- 172.21.15.81:0/2602879052 learned_addr learned my addr 172.21.15.81:0/2602879052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc159230 0x7fb7dc0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ae710 0x7fb7dc141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ae710 msgr2=0x7fb7dc141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ae710 0x7fb7dc141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc159230 msgr2=0x7fb7dc0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7dc159230 0x7fb7dc0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0af020 con 0x7fb7c8004d10 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7dc0ae710 0x7fb7dc141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7dbfff640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7dc159d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc011aa0 tx=0x7fb7cc011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00fb80 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00fce0 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc0af300 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc014680 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc0adcb0 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 0x7fb7dc1f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc069600 con 0x7fb7dc141e50 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 0x7fb7dc1f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d37fe640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7dc0c6820 con 0x7fb7dc141e50 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 0x7fb7dc1f04a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0caf10 tx=0x7fb7c4010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.464+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400e960 con 0x7fb7dc141e50 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7cc0147e0 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7bc066730 0x7fb7bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb7cc084e10 con 0x7fb7c8004d10 2024-05-08T20:31:07.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7bc066730 0x7fb7bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb7c400eac0 con 0x7fb7dc141e50 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 msgr2=0x7fb7dc1f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 0x7fb7dc1f04a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0caf10 tx=0x7fb7c4010c10 comp rx=0 tx=0).stop 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 msgr2=0x7fb7dc1f04a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7d97fa640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc141e50 0x7fb7dc1f04a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.468+0000 7fb7e0ae8640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7bc066730 0x7fb7bc068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40af000 tx=0x7fb7d4004ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7e254b640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 0x7fb7dc1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0c6540 con 0x7fb7dc1f09e0 2024-05-08T20:31:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 0x7fb7dc1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d37fe640 1 -- 172.21.15.81:0/2602879052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb7dc15f260 con 0x7fb7dc1f09e0 2024-05-08T20:31:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d37fe640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 0x7fb7dc1f0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0caf10 tx=0x7fb7c4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4014960 con 0x7fb7dc1f09e0 2024-05-08T20:31:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fb7c4014ac0 con 0x7fb7dc1f09e0 2024-05-08T20:31:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 msgr2=0x7fb7dc1f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 0x7fb7dc1f0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0caf10 tx=0x7fb7c4001a30 comp rx=0 tx=0).stop 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 msgr2=0x7fb7dc1f0df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.472+0000 7fb7d97fa640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7dc1f09e0 0x7fb7dc1f0df0 secure :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0caf10 tx=0x7fb7c4001a30 comp rx=0 tx=0).stop 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:07.478 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:07.481 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.482 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:07.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:07.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.488 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.489 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7bc066730 msgr2=0x7fb7bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb7bc066730 0x7fb7bc068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40af000 tx=0x7fb7d4004ac0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 msgr2=0x7fb7dc159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 --2- 172.21.15.81:0/2602879052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c8004d10 0x7fb7dc159d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc011aa0 tx=0x7fb7cc011f60 comp rx=0 tx=0).stop 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/2602879052 reap_dead start 2024-05-08T20:31:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e0ae8640 1 -- 172.21.15.81:0/2602879052 reap_dead start 2024-05-08T20:31:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 shutdown_connections 2024-05-08T20:31:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 >> 172.21.15.81:0/2602879052 conn(0x7fb7dc0715f0 msgr2=0x7fb7dc0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 shutdown_connections 2024-05-08T20:31:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.476+0000 7fb7e254b640 1 -- 172.21.15.81:0/2602879052 wait complete. 2024-05-08T20:31:07.493 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:07.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:31:07.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:31:07.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 Processor -- start 2024-05-08T20:31:07.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 -- start start 2024-05-08T20:31:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75e80aac20 0x7f75e806afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e80abc50 con 0x7f75e806b510 2024-05-08T20:31:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80c2900 con 0x7f75e80aac20 2024-05-08T20:31:07.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75f06b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80aa320 con 0x7f75e814e410 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75ee451640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75edc50640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75e80aac20 0x7f75e806afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75ee451640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:55714/0 (socket says 172.21.15.81:55714) 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.604+0000 7f75ee451640 1 -- 172.21.15.81:0/1906207703 learned_addr learned my addr 172.21.15.81:0/1906207703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ee451640 1 -- 172.21.15.81:0/1906207703 >> v2:172.21.15.117:3300/0 conn(0x7f75e80aac20 msgr2=0x7f75e806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ee451640 1 --2- 172.21.15.81:0/1906207703 >> v2:172.21.15.117:3300/0 conn(0x7f75e80aac20 0x7f75e806afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ee451640 1 -- 172.21.15.81:0/1906207703 >> v1:172.21.15.117:6789/0 conn(0x7f75e806b510 legacy=0x7f75e8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ee451640 1 -- 172.21.15.81:0/1906207703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80a9560 con 0x7f75e814e410 2024-05-08T20:31:07.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ee451640 1 --2- 172.21.15.81:0/1906207703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009e50 tx=0x7f75e401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30373f76b572b082 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ed44f640 1 -- 172.21.15.81:0/1906207703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40a57b0 con 0x7f75e814e410 2024-05-08T20:31:07.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ed44f640 1 -- 172.21.15.81:0/1906207703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e40a5910 con 0x7f75e814e410 2024-05-08T20:31:07.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75ed44f640 1 -- 172.21.15.81:0/1906207703 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40a5ca0 con 0x7f75e814e410 2024-05-08T20:31:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 -- 172.21.15.81:0/1906207703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 msgr2=0x7f75e80aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 --2- 172.21.15.81:0/1906207703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009e50 tx=0x7f75e401c970 comp rx=0 tx=0).stop 2024-05-08T20:31:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 -- 172.21.15.81:0/1906207703 shutdown_connections 2024-05-08T20:31:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 --2- 172.21.15.81:0/1906207703 >> v2:172.21.15.117:3300/0 conn(0x7f75e80aac20 0x7f75e806afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 --2- 172.21.15.81:0/1906207703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e814e410 0x7f75e80aa6e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 -- 172.21.15.81:0/1906207703 >> 172.21.15.81:0/1906207703 conn(0x7f75e80c2ca0 msgr2=0x7f75e80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 -- 172.21.15.81:0/1906207703 shutdown_connections 2024-05-08T20:31:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.608+0000 7f75f06b5640 1 -- 172.21.15.81:0/1906207703 wait complete. 2024-05-08T20:31:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 Processor -- start 2024-05-08T20:31:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- start start 2024-05-08T20:31:07.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e806b510 0x7f75e8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e80aac20 0x7f75e80bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 0x7f75e81f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81edb40 con 0x7f75e814e410 2024-05-08T20:31:07.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81552e0 con 0x7f75e806b510 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81ecf30 con 0x7f75e80aac20 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 0x7f75e81f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 0x7f75e81f0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52460/0 (socket says 172.21.15.81:52460) 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 learned_addr learned my addr 172.21.15.81:0/182017635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75ee451640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e806b510 0x7f75e8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75edc50640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e80aac20 0x7f75e80bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e80aac20 msgr2=0x7f75e80bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75e80aac20 0x7f75e80bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e806b510 msgr2=0x7f75e8154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e806b510 0x7f75e8154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009b30 con 0x7f75e814e410 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75eec52640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 0x7f75e81f0420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c430 tx=0x7f75e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0005220 con 0x7f75e814e410 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0005380 con 0x7f75e814e410 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e81ed210 con 0x7f75e814e410 2024-05-08T20:31:07.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0007270 con 0x7f75e814e410 2024-05-08T20:31:07.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e81ed7d0 con 0x7f75e814e410 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 0x7f75e814f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80696e0 con 0x7f75e80bfb10 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.612+0000 7f75ee451640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 0x7f75e814f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75e00073d0 con 0x7f75e814e410 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75ee451640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75e806f200 con 0x7f75e80bfb10 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75cc066690 0x7f75cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f75e0083940 con 0x7f75e814e410 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75ee451640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 0x7f75e814f690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75e8072c40 tx=0x7f75e4019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75edc50640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75cc066690 0x7f75cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40092b0 con 0x7f75e80bfb10 2024-05-08T20:31:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75edc50640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75cc066690 0x7f75cc068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75e80c0830 tx=0x7f75d800a2a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f75e40ba070 con 0x7f75e80bfb10 2024-05-08T20:31:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 msgr2=0x7f75e814f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 0x7f75e814f690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75e8072c40 tx=0x7f75e4019710 comp rx=0 tx=0).stop 2024-05-08T20:31:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 msgr2=0x7f75e814f690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.616+0000 7f75deffd640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e80bfb10 0x7f75e814f690 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75e8072c40 tx=0x7f75e4019710 comp rx=0 tx=0).stop 2024-05-08T20:31:07.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.620+0000 7f75f06b5640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 0x7f75e80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.620+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8073d20 con 0x7f75e81f0960 2024-05-08T20:31:07.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75ee451640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 0x7f75e80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75ee451640 1 -- 172.21.15.81:0/182017635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f75e814e7f0 con 0x7f75e81f0960 2024-05-08T20:31:07.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75ee451640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 0x7f75e80c3d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75e401d210 tx=0x7f75e40a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40c5580 con 0x7f75e81f0960 2024-05-08T20:31:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f75e40c0450 con 0x7f75e81f0960 2024-05-08T20:31:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 msgr2=0x7f75e80c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 0x7f75e80c3d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75e401d210 tx=0x7f75e40a7000 comp rx=0 tx=0).stop 2024-05-08T20:31:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 msgr2=0x7f75e80c3d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75deffd640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75e81f0960 0x7f75e80c3d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:07.639 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75cc066690 msgr2=0x7f75cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75cc066690 0x7f75cc068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75e80c0830 tx=0x7f75d800a2a0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 msgr2=0x7f75e81f0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 --2- 172.21.15.81:0/182017635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75e814e410 0x7f75e81f0420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c430 tx=0x7f75e000c8f0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 reap_dead start 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75eec52640 1 -- 172.21.15.81:0/182017635 reap_dead start 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 shutdown_connections 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 >> 172.21.15.81:0/182017635 conn(0x7f75e80c2ca0 msgr2=0x7f75e806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 shutdown_connections 2024-05-08T20:31:07.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.624+0000 7f75f06b5640 1 -- 172.21.15.81:0/182017635 wait complete. 2024-05-08T20:31:07.643 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:07.644 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:31:07.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:31:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 Processor -- start 2024-05-08T20:31:07.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 -- start start 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a10151f00 0x7f4a101588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a100ca000 0x7f4a100ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a10158e20 con 0x7f4a10154cf0 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1006bb20 con 0x7f4a100ca000 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a16035640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101548e0 con 0x7f4a10151f00 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a07fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a10154cf0 0x7f4a10155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43536/0 (socket says 172.21.15.81:43536) 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a07fff640 1 -- 172.21.15.81:0/1862594009 learned_addr learned my addr 172.21.15.81:0/1862594009 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/1862594009 >> v2:172.21.15.81:3300/0 conn(0x7f4a100ca000 0x7f4a100ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.752+0000 7f4a0f7fe640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a10151f00 0x7f4a101588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0ffff640 1 -- 172.21.15.81:0/1862594009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a10151f00 msgr2=0x7f4a101588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a10151f00 0x7f4a101588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0ffff640 1 -- 172.21.15.81:0/1862594009 >> v1:172.21.15.81:6789/0 conn(0x7f4a10154cf0 legacy=0x7f4a10155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0ffff640 1 -- 172.21.15.81:0/1862594009 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10155860 con 0x7f4a100ca000 2024-05-08T20:31:07.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0effd640 1 -- 172.21.15.81:0/1862594009 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336198525 0 0) 0x7f4a10158e20 con 0x7f4a10154cf0 2024-05-08T20:31:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a100ca000 0x7f4a100ca490 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009d90 tx=0x7f4a0801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cd325b4c18e03c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0effd640 1 -- 172.21.15.81:0/1862594009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080a5930 con 0x7f4a100ca000 2024-05-08T20:31:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0effd640 1 -- 172.21.15.81:0/1862594009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a080a5a90 con 0x7f4a100ca000 2024-05-08T20:31:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a0effd640 1 -- 172.21.15.81:0/1862594009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080a5e20 con 0x7f4a100ca000 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 -- 172.21.15.81:0/1862594009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a100ca000 msgr2=0x7f4a100ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a100ca000 0x7f4a100ca490 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009d90 tx=0x7f4a0801c850 comp rx=0 tx=0).stop 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 -- 172.21.15.81:0/1862594009 shutdown_connections 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a100ca000 0x7f4a100ca490 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 --2- 172.21.15.81:0/1862594009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a10151f00 0x7f4a101588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 -- 172.21.15.81:0/1862594009 >> 172.21.15.81:0/1862594009 conn(0x7f4a100715f0 msgr2=0x7f4a10071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 -- 172.21.15.81:0/1862594009 shutdown_connections 2024-05-08T20:31:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.756+0000 7f4a16035640 1 -- 172.21.15.81:0/1862594009 wait complete. 2024-05-08T20:31:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 Processor -- start 2024-05-08T20:31:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- start start 2024-05-08T20:31:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a100ca000 0x7f4a10157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a10151f00 0x7f4a101f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 0x7f4a100aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f0a80 con 0x7f4a10154cf0 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101ecfd0 con 0x7f4a10151f00 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f0cb0 con 0x7f4a100ca000 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 0x7f4a100aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 0x7f4a100aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52488/0 (socket says 172.21.15.81:52488) 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 learned_addr learned my addr 172.21.15.81:0/2195088319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a07fff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a10151f00 0x7f4a101f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a100ca000 msgr2=0x7f4a10157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a100ca000 0x7f4a10157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a10151f00 msgr2=0x7f4a101f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a10151f00 0x7f4a101f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009a70 con 0x7f4a10154cf0 2024-05-08T20:31:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a07fff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a10151f00 0x7f4a101f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0ffff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 0x7f4a100aa590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4a0801af00 tx=0x7f4a080195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080addc0 con 0x7f4a10154cf0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08009450 con 0x7f4a10154cf0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a101f0f90 con 0x7f4a10154cf0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080b7610 con 0x7f4a10154cf0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a101ed290 con 0x7f4a10154cf0 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 0x7f4a101ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10069600 con 0x7f4a1014de70 2024-05-08T20:31:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0f7fe640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 0x7f4a101ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a080b4050 con 0x7f4a10154cf0 2024-05-08T20:31:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.760+0000 7f4a0f7fe640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a100c6820 con 0x7f4a1014de70 2024-05-08T20:31:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49f0066690 0x7f49f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0f7fe640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 0x7f4a101ed7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d4b0 tx=0x7f4a0000d970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4a0811f970 con 0x7f4a10154cf0 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a07fff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49f0066690 0x7f49f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00018070 con 0x7f4a1014de70 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a07fff640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49f0066690 0x7f49f0068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49f8000f70 tx=0x7f49f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4a00004020 con 0x7f4a1014de70 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 msgr2=0x7f4a101ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 0x7f4a101ed7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d4b0 tx=0x7f4a0000d970 comp rx=0 tx=0).stop 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 msgr2=0x7f4a101ed7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.764+0000 7f4a0cff9640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a1014de70 0x7f4a101ed7b0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d4b0 tx=0x7f4a0000d970 comp rx=0 tx=0).stop 2024-05-08T20:31:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a16035640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 0x7f4a10139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c6540 con 0x7f4a101edcf0 2024-05-08T20:31:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a0f7fe640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 0x7f4a10139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a0f7fe640 1 -- 172.21.15.81:0/2195088319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a100ca9d0 con 0x7f4a101edcf0 2024-05-08T20:31:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a0f7fe640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 0x7f4a10139b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a00017000 tx=0x7f4a000046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.772+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000036e0 con 0x7f4a101edcf0 2024-05-08T20:31:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f4a00003840 con 0x7f4a101edcf0 2024-05-08T20:31:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 msgr2=0x7f4a10139b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0cff9640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 0x7f4a10139b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a00017000 tx=0x7f4a000046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0cff9640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 msgr2=0x7f4a10139b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0cff9640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a101edcf0 0x7f4a10139b50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.779 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:07.780 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:07.781 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:07.782 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:07.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.788 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49f0066690 msgr2=0x7f49f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49f0066690 0x7f49f0068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f49f8000f70 tx=0x7f49f8009040 comp rx=0 tx=0).stop 2024-05-08T20:31:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 msgr2=0x7f4a100aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 --2- 172.21.15.81:0/2195088319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10154cf0 0x7f4a100aa590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4a0801af00 tx=0x7f4a080195f0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 reap_dead start 2024-05-08T20:31:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a0ffff640 1 -- 172.21.15.81:0/2195088319 reap_dead start 2024-05-08T20:31:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 shutdown_connections 2024-05-08T20:31:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 >> 172.21.15.81:0/2195088319 conn(0x7f4a100715f0 msgr2=0x7f4a100c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 shutdown_connections 2024-05-08T20:31:07.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.776+0000 7f4a16035640 1 -- 172.21.15.81:0/2195088319 wait complete. 2024-05-08T20:31:07.796 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:07.797 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:31:07.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:31:07.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 Processor -- start 2024-05-08T20:31:07.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 -- start start 2024-05-08T20:31:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2406b230 0x7fef240c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef24070c00 0x7fef2414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef2414edf0 0x7fef241519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef24072940 con 0x7fef24070c00 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240c3a50 con 0x7fef2414edf0 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef292fe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240705e0 con 0x7fef2406b230 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef24070c00 0x7fef2414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef24070c00 0x7fef2414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52496/0 (socket says 172.21.15.81:52496) 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 -- 172.21.15.81:0/3933738126 learned_addr learned my addr 172.21.15.81:0/3933738126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 -- 172.21.15.81:0/3933738126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2406b230 msgr2=0x7fef240c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 --2- 172.21.15.81:0/3933738126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2406b230 0x7fef240c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef237fe640 1 --2- 172.21.15.81:0/3933738126 >> v2:172.21.15.117:3300/0 conn(0x7fef2414edf0 0x7fef241519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 -- 172.21.15.81:0/3933738126 >> v2:172.21.15.117:3300/0 conn(0x7fef2414edf0 msgr2=0x7fef241519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 --2- 172.21.15.81:0/3933738126 >> v2:172.21.15.117:3300/0 conn(0x7fef2414edf0 0x7fef241519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.920+0000 7fef1bfff640 1 -- 172.21.15.81:0/3933738126 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240708c0 con 0x7fef24070c00 2024-05-08T20:31:07.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef1bfff640 1 --2- 172.21.15.81:0/3933738126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef24070c00 0x7fef2414e8b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fef2406bd60 tx=0x7fef0c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d58b46e0030461 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef227fc640 1 -- 172.21.15.81:0/3933738126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24152720 con 0x7fef24070c00 2024-05-08T20:31:07.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef227fc640 1 -- 172.21.15.81:0/3933738126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c0ad660 con 0x7fef24070c00 2024-05-08T20:31:07.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef227fc640 1 -- 172.21.15.81:0/3933738126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0ad9f0 con 0x7fef24070c00 2024-05-08T20:31:07.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- 172.21.15.81:0/3933738126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef24070c00 msgr2=0x7fef2414e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- 172.21.15.81:0/3933738126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef24070c00 0x7fef2414e8b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fef2406bd60 tx=0x7fef0c01c490 comp rx=0 tx=0).stop 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- 172.21.15.81:0/3933738126 shutdown_connections 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- 172.21.15.81:0/3933738126 >> v2:172.21.15.117:3300/0 conn(0x7fef2414edf0 0x7fef241519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- 172.21.15.81:0/3933738126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef24070c00 0x7fef2414e8b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- 172.21.15.81:0/3933738126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2406b230 0x7fef240c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- 172.21.15.81:0/3933738126 >> 172.21.15.81:0/3933738126 conn(0x7fef240c71b0 msgr2=0x7fef240c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- 172.21.15.81:0/3933738126 shutdown_connections 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- 172.21.15.81:0/3933738126 wait complete. 2024-05-08T20:31:07.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 Processor -- start 2024-05-08T20:31:07.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- start start 2024-05-08T20:31:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef24070c00 0x7fef241f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2414edf0 0x7fef241f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240ab170 con 0x7fef2406b230 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24154c40 con 0x7fef2414edf0 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef292fe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef241ee100 con 0x7fef24070c00 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef22ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef22ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52512/0 (socket says 172.21.15.81:52512) 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.924+0000 7fef22ffd640 1 -- 172.21.15.81:0/4070212132 learned_addr learned my addr 172.21.15.81:0/4070212132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef237fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2414edf0 0x7fef241f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1bfff640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef24070c00 0x7fef241f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 -- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef24070c00 msgr2=0x7fef241f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef24070c00 0x7fef241f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 -- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2414edf0 msgr2=0x7fef241f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:07.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2414edf0 0x7fef241f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 -- 172.21.15.81:0/4070212132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0094d0 con 0x7fef2406b230 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef22ffd640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef1400b550 tx=0x7fef1400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14010870 con 0x7fef2406b230 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef140109f0 con 0x7fef2406b230 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef24154680 con 0x7fef2406b230 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14010da0 con 0x7fef2406b230 2024-05-08T20:31:07.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef241f08d0 con 0x7fef2406b230 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef240675e0 con 0x7fef2406b230 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef1400f3c0 con 0x7fef2406b230 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 0x7fef04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1bfff640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 0x7fef04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fef140844b0 con 0x7fef2406b230 2024-05-08T20:31:07.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.928+0000 7fef1bfff640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 0x7fef04068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0af000 tx=0x7fef0c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:07.936+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fef14051510 con 0x7fef2406b230 2024-05-08T20:31:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.180+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fef24074950 con 0x7fef2406b230 2024-05-08T20:31:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef1b7fe640 1 -- 172.21.15.81:0/4070212132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fef14054b30 con 0x7fef2406b230 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 msgr2=0x7fef04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 0x7fef04068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0af000 tx=0x7fef0c0a7000 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 msgr2=0x7fef240c0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef1400b550 tx=0x7fef1400ba10 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 shutdown_connections 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef04066690 0x7fef04068b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef2414edf0 0x7fef241f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef24070c00 0x7fef241f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 --2- 172.21.15.81:0/4070212132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef2406b230 0x7fef240c0840 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 >> 172.21.15.81:0/4070212132 conn(0x7fef240c71b0 msgr2=0x7fef24154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:08.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 shutdown_connections 2024-05-08T20:31:08.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:08.184+0000 7fef292fe640 1 -- 172.21.15.81:0/4070212132 wait complete. 2024-05-08T20:31:08.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:31:18.207 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:31:18.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 Processor -- start 2024-05-08T20:31:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 -- start start 2024-05-08T20:31:18.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f7c155690 0x7f4f7c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c1522e0 con 0x7f4f7c151f00 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c06bb20 con 0x7f4f7c155690 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f81031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1548e0 con 0x7f4f7c154cf0 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f7c155690 0x7f4f7c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f7c151f00 0x7f4f7c1588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46550/0 (socket says 172.21.15.81:46550) 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7ad9d640 1 -- 172.21.15.81:0/3518637071 learned_addr learned my addr 172.21.15.81:0/3518637071 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7a59c640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7b59e640 1 -- 172.21.15.81:0/3518637071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 msgr2=0x7f4f7c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7b59e640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7b59e640 1 -- 172.21.15.81:0/3518637071 >> v1:172.21.15.81:6789/0 conn(0x7f4f7c151f00 legacy=0x7f4f7c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f7b59e640 1 -- 172.21.15.81:0/3518637071 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0c5f80 con 0x7f4f7c155690 2024-05-08T20:31:18.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.340+0000 7f4f79d9b640 1 -- 172.21.15.81:0/3518637071 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330133653 0 0) 0x7f4f7c1522e0 con 0x7f4f7c151f00 2024-05-08T20:31:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f7b59e640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c155690 0x7f4f7c0ca000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009dc0 tx=0x7f4f7401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81e1e0802157ff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f79d9b640 1 -- 172.21.15.81:0/3518637071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a5890 con 0x7f4f7c155690 2024-05-08T20:31:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f79d9b640 1 -- 172.21.15.81:0/3518637071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740a59f0 con 0x7f4f7c155690 2024-05-08T20:31:18.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f79d9b640 1 -- 172.21.15.81:0/3518637071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a5d80 con 0x7f4f7c155690 2024-05-08T20:31:18.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 -- 172.21.15.81:0/3518637071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c155690 msgr2=0x7f4f7c0ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c155690 0x7f4f7c0ca000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009dc0 tx=0x7f4f7401c830 comp rx=0 tx=0).stop 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 -- 172.21.15.81:0/3518637071 shutdown_connections 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c155690 0x7f4f7c0ca000 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 --2- 172.21.15.81:0/3518637071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 -- 172.21.15.81:0/3518637071 >> 172.21.15.81:0/3518637071 conn(0x7f4f7c0715f0 msgr2=0x7f4f7c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 -- 172.21.15.81:0/3518637071 shutdown_connections 2024-05-08T20:31:18.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.344+0000 7f4f81031640 1 -- 172.21.15.81:0/3518637071 wait complete. 2024-05-08T20:31:18.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 Processor -- start 2024-05-08T20:31:18.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- start start 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c0ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 0x7f4f7c1f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1517c0 con 0x7f4f7c151f00 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c150f60 con 0x7f4f7c0af470 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c151200 con 0x7f4f7c154cf0 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40836/0 (socket says 172.21.15.81:40836) 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 -- 172.21.15.81:0/955725470 learned_addr learned my addr 172.21.15.81:0/955725470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7a59c640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c0ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7b59e640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 0x7f4f7c1f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 -- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 msgr2=0x7f4f7c0ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c0ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 -- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 msgr2=0x7f4f7c1f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 0x7f4f7c1f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 -- 172.21.15.81:0/955725470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009a70 con 0x7f4f7c151f00 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7b59e640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 0x7f4f7c1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f7ad9d640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c480 tx=0x7f4f6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0074e0 con 0x7f4f7c151f00 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c007660 con 0x7f4f7c151f00 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c004a30 con 0x7f4f7c151f00 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c1514e0 con 0x7f4f7c151f00 2024-05-08T20:31:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c15efc0 con 0x7f4f7c151f00 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f6c004b90 con 0x7f4f7c151f00 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.348+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c0675e0 con 0x7f4f7c151f00 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.352+0000 7f4f637fe640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 0x7f4f68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.352+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4f6c0836b0 con 0x7f4f7c151f00 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.352+0000 7f4f7a59c640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 0x7f4f68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.352+0000 7f4f7a59c640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 0x7f4f68068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c92a0 tx=0x7f4f70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.356+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4f6c0541a0 con 0x7f4f7c151f00 2024-05-08T20:31:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.636+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4f7c1f0320 con 0x7f4f7c151f00 2024-05-08T20:31:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.636+0000 7f4f637fe640 1 -- 172.21.15.81:0/955725470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f4f6c018620 con 0x7f4f7c151f00 2024-05-08T20:31:18.641 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 msgr2=0x7f4f68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 0x7f4f68068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c92a0 tx=0x7f4f70008040 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 msgr2=0x7f4f7c1ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c480 tx=0x7f4f6c00c940 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 shutdown_connections 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f68066690 0x7f4f68068b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f7c0af470 0x7f4f7c1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f7c154cf0 0x7f4f7c0ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 --2- 172.21.15.81:0/955725470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c151f00 0x7f4f7c1ecdb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 >> 172.21.15.81:0/955725470 conn(0x7f4f7c0715f0 msgr2=0x7f4f7c0aa060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 shutdown_connections 2024-05-08T20:31:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.640+0000 7f4f81031640 1 -- 172.21.15.81:0/955725470 wait complete. 2024-05-08T20:31:18.666 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:31:18.666 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:31:18.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:31:18.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:31:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 Processor -- start 2024-05-08T20:31:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 -- start start 2024-05-08T20:31:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5a4152340 0x7fa5a406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5a406d7d0 0x7fa5a4155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a4158080 con 0x7fa5a40c2570 2024-05-08T20:31:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a406ab70 con 0x7fa5a406d7d0 2024-05-08T20:31:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a8c99640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a4154b10 con 0x7fa5a4152340 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5a406d7d0 0x7fa5a4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5a406d7d0 0x7fa5a4155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42784/0 (socket says 172.21.15.81:42784) 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1041873527 learned_addr learned my addr 172.21.15.81:0/1041873527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1041873527 >> v2:172.21.15.117:3300/0 conn(0x7fa5a4152340 0x7fa5a406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1041873527 >> v2:172.21.15.117:3300/0 conn(0x7fa5a4152340 msgr2=0x7fa5a406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 --2- 172.21.15.81:0/1041873527 >> v2:172.21.15.117:3300/0 conn(0x7fa5a4152340 0x7fa5a406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1041873527 >> v1:172.21.15.81:6789/0 conn(0x7fa5a40c2570 legacy=0x7fa5a4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.780+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1041873527 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a406a890 con 0x7fa5a406d7d0 2024-05-08T20:31:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a2d9d640 1 --2- 172.21.15.81:0/1041873527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a406d7d0 0x7fa5a4155670 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406fd50 tx=0x7fa59c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fea985ec606133 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a1d9b640 1 -- 172.21.15.81:0/1041873527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0a57f0 con 0x7fa5a406d7d0 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a1d9b640 1 -- 172.21.15.81:0/1041873527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0a5950 con 0x7fa5a406d7d0 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a1d9b640 1 -- 172.21.15.81:0/1041873527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0a5ce0 con 0x7fa5a406d7d0 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1041873527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a406d7d0 msgr2=0x7fa5a4155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1041873527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a406d7d0 0x7fa5a4155670 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406fd50 tx=0x7fa59c01c930 comp rx=0 tx=0).stop 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1041873527 shutdown_connections 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1041873527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a406d7d0 0x7fa5a4155670 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1041873527 >> v2:172.21.15.117:3300/0 conn(0x7fa5a4152340 0x7fa5a406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1041873527 >> 172.21.15.81:0/1041873527 conn(0x7fa5a40c71b0 msgr2=0x7fa5a40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1041873527 shutdown_connections 2024-05-08T20:31:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1041873527 wait complete. 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 Processor -- start 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.784+0000 7fa5a8c99640 1 -- start start 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a406d7d0 0x7fa5a4071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a40c2570 0x7fa5a4144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 0x7fa5a4146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41429f0 con 0x7fa5a4152340 2024-05-08T20:31:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4072200 con 0x7fa5a40c2570 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4151260 con 0x7fa5a406d7d0 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 0x7fa5a4146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 0x7fa5a4146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42790/0 (socket says 172.21.15.81:42790) 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 learned_addr learned my addr 172.21.15.81:0/1072147174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa599d9b640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a40c2570 0x7fa5a4144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a406d7d0 0x7fa5a4071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a406d7d0 msgr2=0x7fa5a4071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a406d7d0 0x7fa5a4071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a40c2570 msgr2=0x7fa5a4144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a40c2570 0x7fa5a4144040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009b30 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a2d9d640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 0x7fa5a4146cf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa59c01a560 tx=0x7fa59c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0b8670 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0b87f0 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4142780 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0b8ba0 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a4071640 con 0x7fa5a4152340 2024-05-08T20:31:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 0x7fa5a4147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4069550 con 0x7fa5a4147230 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 0x7fa5a4147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a259c640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5a40711f0 con 0x7fa5a4147230 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa59c0b8d00 con 0x7fa5a4152340 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 0x7fa5a4147610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e7a0 tx=0x7fa59400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa584066690 0x7fa584068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa59c11fb30 con 0x7fa5a4152340 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa599d9b640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa584066690 0x7fa584068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.788+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400ee50 con 0x7fa5a4147230 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa59400a990 con 0x7fa5a4147230 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 msgr2=0x7fa5a4147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa59b7fe640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 0x7fa5a4147610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e7a0 tx=0x7fa59400ec60 comp rx=0 tx=0).stop 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 msgr2=0x7fa5a4147610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa59b7fe640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4147230 0x7fa5a4147610 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.792+0000 7fa599d9b640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa584066690 0x7fa584068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4145370 tx=0x7fa58c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 0x7fa5a41f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4161bf0 con 0x7fa5a41f0b20 2024-05-08T20:31:18.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 0x7fa5a41f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa5a259c640 1 -- 172.21.15.81:0/1072147174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa5a40675e0 con 0x7fa5a41f0b20 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa5a259c640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 0x7fa5a41f0f30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e7a0 tx=0x7fa5940046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594004550 con 0x7fa5a41f0b20 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fa594003ba0 con 0x7fa5a41f0b20 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 msgr2=0x7fa5a41f0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 0x7fa5a41f0f30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e7a0 tx=0x7fa5940046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 msgr2=0x7fa5a41f0f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:18.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.796+0000 7fa59b7fe640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a41f0b20 0x7fa5a41f0f30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.803 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 11, 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.804 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.805 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:18.806 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.807 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.809 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:18.811 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:18.812 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.816 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:18.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa584066690 msgr2=0x7fa584068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa584066690 0x7fa584068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4145370 tx=0x7fa58c009040 comp rx=0 tx=0).stop 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 msgr2=0x7fa5a4146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 --2- 172.21.15.81:0/1072147174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5a4152340 0x7fa5a4146cf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa59c01a560 tx=0x7fa59c0196d0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 reap_dead start 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a2d9d640 1 -- 172.21.15.81:0/1072147174 reap_dead start 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 shutdown_connections 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 >> 172.21.15.81:0/1072147174 conn(0x7fa5a40c71b0 msgr2=0x7fa5a414be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 shutdown_connections 2024-05-08T20:31:18.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.800+0000 7fa5a8c99640 1 -- 172.21.15.81:0/1072147174 wait complete. 2024-05-08T20:31:18.820 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:18.821 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:31:18.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:31:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 Processor -- start 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 -- start start 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f585c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c155e10 con 0x7f585c0a94b0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c156080 con 0x7f585c0c2bc0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f58608d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c06e790 con 0x7f585c0c30d0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f585ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f585c0a94b0 0x7f585c0a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50136/0 (socket says 172.21.15.81:50136) 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f585ad9d640 1 -- 172.21.15.81:0/3913311857 learned_addr learned my addr 172.21.15.81:0/3913311857 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.944+0000 7f585a59c640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f585c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346524598 0 0) 0x7f585c155e10 con 0x7f585c0a94b0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5848003530 con 0x7f585c0a94b0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318876817 0 0) 0x7f5848003530 con 0x7f585c0a94b0 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 msgr2=0x7f585c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f585c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 >> v1:172.21.15.117:6789/0 conn(0x7f585c0c2bc0 legacy=0x7f585c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c156360 con 0x7f585c0a94b0 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f5854001a00 con 0x7f585c0a94b0 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 >> v1:172.21.15.81:6789/0 conn(0x7f585c0a94b0 legacy=0x7f585c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58480039b0 0x7f5848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f58480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5848004d10 0x7f5848005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c06e790 con 0x7f5848004d10 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584800ba40 con 0x7f58480039b0 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584800bc00 con 0x7f585c0c30d0 2024-05-08T20:31:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5848004d10 0x7f5848005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5853fff640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f58480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585a59c640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58480039b0 0x7f5848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 -- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 msgr2=0x7f58480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0c30d0 0x7f58480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 -- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58480039b0 msgr2=0x7f5848003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58480039b0 0x7f5848003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 -- 172.21.15.81:0/3913311857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848003530 con 0x7f5848004d10 2024-05-08T20:31:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585a59c640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58480039b0 0x7f5848003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5848004d10 0x7f5848005190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f585400a7a0 tx=0x7f585401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67373d3b1a4e962c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58540ad630 con 0x7f5848004d10 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58540a8070 con 0x7f5848004d10 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.948+0000 7f5859d9b640 1 -- 172.21.15.81:0/3913311857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58540ad9f0 con 0x7f5848004d10 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- 172.21.15.81:0/3913311857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5848004d10 msgr2=0x7f5848005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 --2- 172.21.15.81:0/3913311857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5848004d10 0x7f5848005190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f585400a7a0 tx=0x7f585401d2c0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 -- 172.21.15.81:0/3913311857 reap_dead start 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- 172.21.15.81:0/3913311857 shutdown_connections 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- 172.21.15.81:0/3913311857 >> 172.21.15.81:0/3913311857 conn(0x7f585c0c4cc0 msgr2=0x7f585c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- 172.21.15.81:0/3913311857 shutdown_connections 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- 172.21.15.81:0/3913311857 wait complete. 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 Processor -- start 2024-05-08T20:31:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- start start 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5848004d10 0x7f585c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0ad330 0x7f585c143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 0x7f585c1ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0aba20 con 0x7f585c143aa0 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0c7620 con 0x7f5848004d10 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f58608d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ab480 con 0x7f585c0ad330 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 0x7f585c1ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 0x7f585c1ec9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42816/0 (socket says 172.21.15.81:42816) 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 learned_addr learned my addr 172.21.15.81:0/3153458709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f5853fff640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0ad330 0x7f585c143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585a59c640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5848004d10 0x7f585c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0ad330 msgr2=0x7f585c143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f585c0ad330 0x7f585c143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5848004d10 msgr2=0x7f585c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5848004d10 0x7f585c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.952+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0ab1a0 con 0x7f585c143aa0 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f585ad9d640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 0x7f585c1ec9d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f585400a7a0 tx=0x7f5848005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58540019c0 con 0x7f585c143aa0 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58540011d0 con 0x7f585c143aa0 2024-05-08T20:31:18.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c0c6860 con 0x7f585c143aa0 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58540b96a0 con 0x7f585c143aa0 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c0c6e20 con 0x7f585c143aa0 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f58608d4640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 0x7f585c14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c073ea0 con 0x7f585c0c7010 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f585a59c640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 0x7f585c14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f585a59c640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f585c150070 con 0x7f585c0c7010 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58540aa030 con 0x7f585c143aa0 2024-05-08T20:31:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f585a59c640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 0x7f585c14c800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f584c0138b0 tx=0x7f584c013d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f583c066690 0x7f583c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f585411e890 con 0x7f585c143aa0 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5853fff640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f583c066690 0x7f583c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c011cc0 con 0x7f585c0c7010 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f584c009e50 con 0x7f585c0c7010 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 msgr2=0x7f585c14c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 0x7f585c14c800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f584c0138b0 tx=0x7f584c013d70 comp rx=0 tx=0).stop 2024-05-08T20:31:18.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 msgr2=0x7f585c14c800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:18.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5852ffd640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c0c7010 0x7f585c14c800 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f584c0138b0 tx=0x7f584c013d70 comp rx=0 tx=0).stop 2024-05-08T20:31:18.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.956+0000 7f5853fff640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f583c066690 0x7f583c068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f585c0c8000 tx=0x7f5844001330 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f58608d4640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 0x7f585c1eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:18.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0c69f0 con 0x7f585c1eea60 2024-05-08T20:31:18.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f585a59c640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 0x7f585c1eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:18.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f585a59c640 1 -- 172.21.15.81:0/3153458709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f585c0c73f0 con 0x7f585c1eea60 2024-05-08T20:31:18.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f585a59c640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 0x7f585c1eee70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f584c0138b0 tx=0x7f584c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:18.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c025040 con 0x7f585c1eea60 2024-05-08T20:31:18.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f584c0153c0 con 0x7f585c1eea60 2024-05-08T20:31:18.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 msgr2=0x7f585c1eee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 0x7f585c1eee70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f584c0138b0 tx=0x7f584c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 msgr2=0x7f585c1eee70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:18.971 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:18.972 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 11, 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:18.973 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:18.976 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:18.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:18.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:18.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.984 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:18.985 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.964+0000 7f5852ffd640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585c1eea60 0x7f585c1eee70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f583c066690 msgr2=0x7f583c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f583c066690 0x7f583c068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f585c0c8000 tx=0x7f5844001330 comp rx=0 tx=0).stop 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 msgr2=0x7f585c1ec9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 --2- 172.21.15.81:0/3153458709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f585c143aa0 0x7f585c1ec9d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f585400a7a0 tx=0x7f5848005800 comp rx=0 tx=0).stop 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 reap_dead start 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f585ad9d640 1 -- 172.21.15.81:0/3153458709 reap_dead start 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 shutdown_connections 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 >> 172.21.15.81:0/3153458709 conn(0x7f585c0c4cc0 msgr2=0x7f585c147c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 shutdown_connections 2024-05-08T20:31:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:18.968+0000 7f58608d4640 1 -- 172.21.15.81:0/3153458709 wait complete. 2024-05-08T20:31:18.990 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:18.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:31:18.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:31:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 Processor -- start 2024-05-08T20:31:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 -- start start 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c2570 0x7fd410154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4100c34e0 0x7fd4101554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd410158080 con 0x7fd410152340 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41006ab70 con 0x7fd4100c34e0 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd417122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd410154b10 con 0x7fd4100c2570 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4100c34e0 0x7fd4101554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4100c34e0 0x7fd4101554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42824/0 (socket says 172.21.15.81:42824) 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 -- 172.21.15.81:0/2568875890 learned_addr learned my addr 172.21.15.81:0/2568875890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd40ffff640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c2570 0x7fd410154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 -- 172.21.15.81:0/2568875890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c2570 msgr2=0x7fd410154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c2570 0x7fd410154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 -- 172.21.15.81:0/2568875890 >> v1:172.21.15.117:6789/0 conn(0x7fd410152340 legacy=0x7fd41006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.104+0000 7fd4156bf640 1 -- 172.21.15.81:0/2568875890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41006a890 con 0x7fd4100c34e0 2024-05-08T20:31:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd4156bf640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c34e0 0x7fd4101554a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd408009e50 tx=0x7fd40801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8ec4254da6a49c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd40f7fe640 1 -- 172.21.15.81:0/2568875890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4080a5830 con 0x7fd4100c34e0 2024-05-08T20:31:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd40f7fe640 1 -- 172.21.15.81:0/2568875890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4080a5990 con 0x7fd4100c34e0 2024-05-08T20:31:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd40f7fe640 1 -- 172.21.15.81:0/2568875890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4080a5d20 con 0x7fd4100c34e0 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 -- 172.21.15.81:0/2568875890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c34e0 msgr2=0x7fd4101554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c34e0 0x7fd4101554a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd408009e50 tx=0x7fd40801c970 comp rx=0 tx=0).stop 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 -- 172.21.15.81:0/2568875890 shutdown_connections 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c34e0 0x7fd4101554a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 --2- 172.21.15.81:0/2568875890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c2570 0x7fd410154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 -- 172.21.15.81:0/2568875890 >> 172.21.15.81:0/2568875890 conn(0x7fd4100c71b0 msgr2=0x7fd4100c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 -- 172.21.15.81:0/2568875890 shutdown_connections 2024-05-08T20:31:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.108+0000 7fd417122640 1 -- 172.21.15.81:0/2568875890 wait complete. 2024-05-08T20:31:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 Processor -- start 2024-05-08T20:31:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- start start 2024-05-08T20:31:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 0x7fd410150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c34e0 0x7fd4100c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd410152340 0x7fd41013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd410151410 con 0x7fd4100c2570 2024-05-08T20:31:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd410151170 con 0x7fd410152340 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101571a0 con 0x7fd4100c34e0 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 0x7fd410150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 0x7fd410150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42836/0 (socket says 172.21.15.81:42836) 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 -- 172.21.15.81:0/19049915 learned_addr learned my addr 172.21.15.81:0/19049915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c34e0 0x7fd4100c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd4156bf640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd410152340 0x7fd41013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c34e0 msgr2=0x7fd4100c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c34e0 0x7fd4100c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd410152340 msgr2=0x7fd41013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd410152340 0x7fd41013fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd408009b30 con 0x7fd4100c2570 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd4156bf640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd410152340 0x7fd41013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4100c34e0 0x7fd4100c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:31:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd414ebe640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 0x7fd410150c30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c500 tx=0x7fd40400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404005220 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404005380 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404007270 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd410157480 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.112+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd410157a40 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd417122640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 0x7fd4101f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd410069550 con 0x7fd410140100 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4040073d0 con 0x7fd4100c2570 2024-05-08T20:31:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 0x7fd4101f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40d7fa640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd3f4066690 0x7fd3f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd404083e20 con 0x7fd4100c2570 2024-05-08T20:31:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd4156bf640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd3f4066690 0x7fd3f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd4156bf640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd3f4066690 0x7fd3f4068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd4080ae000 tx=0x7fd4080a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40ffff640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd410157310 con 0x7fd410140100 2024-05-08T20:31:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.116+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 0x7fd4101f0330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4101405f0 tx=0x7fd3fc00f930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc014870 con 0x7fd410140100 2024-05-08T20:31:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd3fc0149d0 con 0x7fd410140100 2024-05-08T20:31:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 msgr2=0x7fd4101f0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 0x7fd4101f0330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4101405f0 tx=0x7fd3fc00f930 comp rx=0 tx=0).stop 2024-05-08T20:31:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 msgr2=0x7fd4101f0330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.120+0000 7fd40d7fa640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd410140100 0x7fd4101f0330 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 0x7fd4101f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4101559e0 con 0x7fd4101517f0 2024-05-08T20:31:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 0x7fd4101f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40ffff640 1 -- 172.21.15.81:0/19049915 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd4100675e0 con 0x7fd4101517f0 2024-05-08T20:31:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40ffff640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 0x7fd4101f0870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd41006d260 tx=0x7fd3fc0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc020230 con 0x7fd4101517f0 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fd3fc003620 con 0x7fd4101517f0 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 msgr2=0x7fd4101f0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 0x7fd4101f0870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd41006d260 tx=0x7fd3fc0046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 msgr2=0x7fd4101f0870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd40d7fa640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4101517f0 0x7fd4101f0870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 30, 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:19.145 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd3f4066690 msgr2=0x7fd3f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd3f4066690 0x7fd3f4068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd4080ae000 tx=0x7fd4080a7070 comp rx=0 tx=0).stop 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 msgr2=0x7fd410150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 --2- 172.21.15.81:0/19049915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4100c2570 0x7fd410150c30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c500 tx=0x7fd40400c9c0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd4156bf640 1 -- 172.21.15.81:0/19049915 reap_dead start 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd4156bf640 1 -- 172.21.15.81:0/19049915 reap_dead start 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 shutdown_connections 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.128+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 >> 172.21.15.81:0/19049915 conn(0x7fd4100c71b0 msgr2=0x7fd41014ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.132+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 shutdown_connections 2024-05-08T20:31:19.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.132+0000 7fd417122640 1 -- 172.21.15.81:0/19049915 wait complete. 2024-05-08T20:31:19.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:31:19.151 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:31:19.151 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:31:19.151 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:31:19.151 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:31:19.152 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:31:19.152 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:31:19.167 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:31:19.167 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:31:19.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 Processor -- start 2024-05-08T20:31:19.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 -- start start 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 0x7f33d80a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d8155e10 con 0x7f33d80c30d0 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d806e790 con 0x7f33d80a94b0 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33de5ef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d806f460 con 0x7f33d80c2bc0 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33d7fff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f33d80c30d0 legacy=0x7f33d80c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33dcb8c640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 msgr2=0x7f33d80a9920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33dcb8c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 0x7f33d80a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:19.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33cffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33cffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58518/0 (socket says 172.21.15.81:58518) 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.272+0000 7f33cffff640 1 -- 172.21.15.81:0/4097116882 learned_addr learned my addr 172.21.15.81:0/4097116882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33cffff640 1 -- 172.21.15.81:0/4097116882 >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 msgr2=0x7f33d80a9920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33cffff640 1 --2- 172.21.15.81:0/4097116882 >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 0x7f33d80a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33cffff640 1 -- 172.21.15.81:0/4097116882 >> v1:172.21.15.117:6789/0 conn(0x7f33d80c30d0 legacy=0x7f33d80c4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:19.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33cffff640 1 -- 172.21.15.81:0/4097116882 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80a9e60 con 0x7f33d80c2bc0 2024-05-08T20:31:19.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33cffff640 1 --2- 172.21.15.81:0/4097116882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009870 tx=0x7f33c001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf5d3d10074e466 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33d77fe640 1 -- 172.21.15.81:0/4097116882 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00ab640 con 0x7f33d80c2bc0 2024-05-08T20:31:19.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33d77fe640 1 -- 172.21.15.81:0/4097116882 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c00a7070 con 0x7f33d80c2bc0 2024-05-08T20:31:19.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33d77fe640 1 -- 172.21.15.81:0/4097116882 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00ab9c0 con 0x7f33d80c2bc0 2024-05-08T20:31:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 -- 172.21.15.81:0/4097116882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 msgr2=0x7f33d80c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 --2- 172.21.15.81:0/4097116882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009870 tx=0x7f33c001c480 comp rx=0 tx=0).stop 2024-05-08T20:31:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 -- 172.21.15.81:0/4097116882 shutdown_connections 2024-05-08T20:31:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 --2- 172.21.15.81:0/4097116882 >> v2:172.21.15.117:3300/0 conn(0x7f33d80a94b0 0x7f33d80a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 --2- 172.21.15.81:0/4097116882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c2bc0 0x7f33d80c34b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 -- 172.21.15.81:0/4097116882 >> 172.21.15.81:0/4097116882 conn(0x7f33d80c4cc0 msgr2=0x7f33d80c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:19.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 -- 172.21.15.81:0/4097116882 shutdown_connections 2024-05-08T20:31:19.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.276+0000 7f33de5ef640 1 -- 172.21.15.81:0/4097116882 wait complete. 2024-05-08T20:31:19.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 Processor -- start 2024-05-08T20:31:19.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- start start 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 0x7f33d813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c30d0 0x7f33d813e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81467d0 con 0x7f33d80a94b0 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81550e0 con 0x7f33d80c2bc0 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8154d40 con 0x7f33d80c30d0 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33cffff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 msgr2=0x7f33d813db10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:19.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33cffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 0x7f33d813db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42846/0 (socket says 172.21.15.81:42846) 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 -- 172.21.15.81:0/773609731 learned_addr learned my addr 172.21.15.81:0/773609731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33dcb8c640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c30d0 0x7f33d813e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 -- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c30d0 msgr2=0x7f33d813e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c30d0 0x7f33d813e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 -- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 msgr2=0x7f33d813db10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 0x7f33d813db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 -- 172.21.15.81:0/773609731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00094d0 con 0x7f33d80a94b0 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d7fff640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b560 tx=0x7f33c800ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8003dd0 con 0x7f33d80a94b0 2024-05-08T20:31:19.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8005070 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d8154530 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8005420 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d813f740 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d8074950 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.280+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33c8005580 con 0x7f33d80a94b0 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.284+0000 7f33d57fa640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 0x7f33b8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:19.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.284+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f33c8084430 con 0x7f33d80a94b0 2024-05-08T20:31:19.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.284+0000 7f33cffff640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 0x7f33b8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:19.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.284+0000 7f33cffff640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 0x7f33b8068b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009870 tx=0x7f33c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:19.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.288+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f33c8051490 con 0x7f33d80a94b0 2024-05-08T20:31:19.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:31:19.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:31:19.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.532+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f33d8072600 con 0x7f33d80a94b0 2024-05-08T20:31:19.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33d57fa640 1 -- 172.21.15.81:0/773609731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f33c8054ab0 con 0x7f33d80a94b0 2024-05-08T20:31:19.538 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 msgr2=0x7f33b8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 0x7f33b8068b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009870 tx=0x7f33c0008040 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 msgr2=0x7f33d813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b560 tx=0x7f33c800ba20 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 shutdown_connections 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33b8066670 0x7f33b8068b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d80c30d0 0x7f33d813e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d80c2bc0 0x7f33d813db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 --2- 172.21.15.81:0/773609731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d80a94b0 0x7f33d813f200 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 >> 172.21.15.81:0/773609731 conn(0x7f33d80c4cc0 msgr2=0x7f33d815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 shutdown_connections 2024-05-08T20:31:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:19.536+0000 7f33de5ef640 1 -- 172.21.15.81:0/773609731 wait complete. 2024-05-08T20:31:22.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.700+0000 7f53a0843640 1 Processor -- start 2024-05-08T20:31:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.700+0000 7f53a0843640 1 -- start start 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c151f00 0x7f539c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f539c0ca000 0x7f539c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c158e20 con 0x7f539c154cf0 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c06bb20 con 0x7f539c0ca000 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1548e0 con 0x7f539c151f00 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f539c0ca000 0x7f539c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f5399d9b640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f539c154cf0 legacy=0x7f539c155150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f539c0ca000 0x7f539c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42862/0 (socket says 172.21.15.81:42862) 2024-05-08T20:31:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 -- 172.21.15.81:0/2910057328 learned_addr learned my addr 172.21.15.81:0/2910057328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539a59c640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c151f00 0x7f539c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 -- 172.21.15.81:0/2910057328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c151f00 msgr2=0x7f539c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c151f00 0x7f539c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 -- 172.21.15.81:0/2910057328 >> v1:172.21.15.117:6789/0 conn(0x7f539c154cf0 legacy=0x7f539c155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 -- 172.21.15.81:0/2910057328 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c155860 con 0x7f539c0ca000 2024-05-08T20:31:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539ad9d640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c0ca000 0x7f539c0ca490 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5394009e50 tx=0x7f539401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4425aafcf96430a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539959a640 1 -- 172.21.15.81:0/2910057328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940a5770 con 0x7f539c0ca000 2024-05-08T20:31:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539959a640 1 -- 172.21.15.81:0/2910057328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940a58d0 con 0x7f539c0ca000 2024-05-08T20:31:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f539959a640 1 -- 172.21.15.81:0/2910057328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940a5c60 con 0x7f539c0ca000 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- 172.21.15.81:0/2910057328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c0ca000 msgr2=0x7f539c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c0ca000 0x7f539c0ca490 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5394009e50 tx=0x7f539401c8d0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- 172.21.15.81:0/2910057328 shutdown_connections 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c0ca000 0x7f539c0ca490 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 --2- 172.21.15.81:0/2910057328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c151f00 0x7f539c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.704+0000 7f53a0843640 1 -- 172.21.15.81:0/2910057328 >> 172.21.15.81:0/2910057328 conn(0x7f539c0715f0 msgr2=0x7f539c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:22.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- 172.21.15.81:0/2910057328 shutdown_connections 2024-05-08T20:31:22.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- 172.21.15.81:0/2910057328 wait complete. 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 Processor -- start 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- start start 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c0ca000 0x7f539c149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 0x7f539c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1f18d0 con 0x7f539c154cf0 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c151340 con 0x7f539c151f00 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c151620 con 0x7f539c0ca000 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f5399d9b640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 msgr2=0x7f539c149e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f5399d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 0x7f539c149e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42872/0 (socket says 172.21.15.81:42872) 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 -- 172.21.15.81:0/1423011832 learned_addr learned my addr 172.21.15.81:0/1423011832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539a59c640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c0ca000 0x7f539c149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 -- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c0ca000 msgr2=0x7f539c149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c0ca000 0x7f539c149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 -- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 msgr2=0x7f539c149e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 0x7f539c149e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 -- 172.21.15.81:0/1423011832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394009b30 con 0x7f539c154cf0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f539ad9d640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f53940af040 tx=0x7f5394019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b8670 con 0x7f539c154cf0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940b87f0 con 0x7f539c154cf0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c150c60 con 0x7f539c154cf0 2024-05-08T20:31:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c0af2c0 con 0x7f539c154cf0 2024-05-08T20:31:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b8ba0 con 0x7f539c154cf0 2024-05-08T20:31:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.708+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c0675e0 con 0x7f539c154cf0 2024-05-08T20:31:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.712+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f53940b8d00 con 0x7f539c154cf0 2024-05-08T20:31:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.712+0000 7f538affd640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 0x7f537c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.712+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f539411f8e0 con 0x7f539c154cf0 2024-05-08T20:31:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.712+0000 7f539a59c640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 0x7f537c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:22.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.712+0000 7f539a59c640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 0x7f537c068b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f539c0c7980 tx=0x7f538c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:22.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:22.716+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f53940eca90 con 0x7f539c154cf0 2024-05-08T20:31:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.024+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f539c06b950 con 0x7f539c154cf0 2024-05-08T20:31:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.024+0000 7f538affd640 1 -- 172.21.15.81:0/1423011832 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f53940f00b0 con 0x7f539c154cf0 2024-05-08T20:31:23.029 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 msgr2=0x7f537c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 0x7f537c068b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f539c0c7980 tx=0x7f538c008040 comp rx=0 tx=0).stop 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 msgr2=0x7f539c1f09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f53940af040 tx=0x7f5394019670 comp rx=0 tx=0).stop 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 shutdown_connections 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f537c066670 0x7f537c068b30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f539c154cf0 0x7f539c1f09a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f539c151f00 0x7f539c149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 --2- 172.21.15.81:0/1423011832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f539c0ca000 0x7f539c149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 >> 172.21.15.81:0/1423011832 conn(0x7f539c0715f0 msgr2=0x7f539c1530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 shutdown_connections 2024-05-08T20:31:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:23.028+0000 7f53a0843640 1 -- 172.21.15.81:0/1423011832 wait complete. 2024-05-08T20:31:26.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.176+0000 7fc5985e3640 1 Processor -- start 2024-05-08T20:31:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.176+0000 7fc5985e3640 1 -- start start 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc5985e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900c30d0 0x7fc5900c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc5985e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5900a94b0 0x7fc5900a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc5985e3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc590155e10 con 0x7fc5900c2bc0 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc5985e3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59006e790 con 0x7fc5900a94b0 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc5985e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59006f460 con 0x7fc5900c30d0 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5900a94b0 0x7fc5900a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc595b7e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc5900c2bc0 0x7fc5900c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50148/0 (socket says 172.21.15.81:50148) 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc595b7e640 1 -- 172.21.15.81:0/18381647 learned_addr learned my addr 172.21.15.81:0/18381647 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc59637f640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900c30d0 0x7fc5900c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 -- 172.21.15.81:0/18381647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900c30d0 msgr2=0x7fc5900c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900c30d0 0x7fc5900c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 -- 172.21.15.81:0/18381647 >> v1:172.21.15.81:6789/0 conn(0x7fc5900c2bc0 legacy=0x7fc5900c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:26.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 -- 172.21.15.81:0/18381647 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900a9e60 con 0x7fc5900a94b0 2024-05-08T20:31:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.180+0000 7fc596b80640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900a94b0 0x7fc5900a9920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc588009dc0 tx=0x7fc58801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c837db0875e476 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc59537d640 1 -- 172.21.15.81:0/18381647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880a5950 con 0x7fc5900a94b0 2024-05-08T20:31:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc59537d640 1 -- 172.21.15.81:0/18381647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5880a5ab0 con 0x7fc5900a94b0 2024-05-08T20:31:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc59537d640 1 -- 172.21.15.81:0/18381647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880a5e40 con 0x7fc5900a94b0 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- 172.21.15.81:0/18381647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900a94b0 msgr2=0x7fc5900a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900a94b0 0x7fc5900a9920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc588009dc0 tx=0x7fc58801c890 comp rx=0 tx=0).stop 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- 172.21.15.81:0/18381647 shutdown_connections 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900a94b0 0x7fc5900a9920 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- 172.21.15.81:0/18381647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900c30d0 0x7fc5900c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- 172.21.15.81:0/18381647 >> 172.21.15.81:0/18381647 conn(0x7fc5900c4cc0 msgr2=0x7fc5900c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- 172.21.15.81:0/18381647 shutdown_connections 2024-05-08T20:31:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- 172.21.15.81:0/18381647 wait complete. 2024-05-08T20:31:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 Processor -- start 2024-05-08T20:31:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- start start 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 0x7fc59014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 0x7fc590149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590150610 con 0x7fc5900c30d0 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590150860 con 0x7fc5900c2bc0 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc5985e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc590150b40 con 0x7fc5900a94b0 2024-05-08T20:31:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc595b7e640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 msgr2=0x7fc590149070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc595b7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 0x7fc590149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42900/0 (socket says 172.21.15.81:42900) 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 -- 172.21.15.81:0/1654160345 learned_addr learned my addr 172.21.15.81:0/1654160345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc59637f640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 0x7fc59014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 -- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 msgr2=0x7fc59014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 0x7fc59014cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 -- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 msgr2=0x7fc590149070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 0x7fc590149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc596b80640 1 -- 172.21.15.81:0/1654160345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009a70 con 0x7fc5900c30d0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.184+0000 7fc59637f640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 0x7fc59014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc596b80640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc58801af40 tx=0x7fc588019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880ade40 con 0x7fc5900c30d0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588009450 con 0x7fc5900c30d0 2024-05-08T20:31:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc590148870 con 0x7fc5900c30d0 2024-05-08T20:31:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880b9670 con 0x7fc5900c30d0 2024-05-08T20:31:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5900ae500 con 0x7fc5900c30d0 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc590148d90 con 0x7fc5900c30d0 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5880039a0 con 0x7fc5900c30d0 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 0x7fc574068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc58811fd80 con 0x7fc5900c30d0 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc59637f640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 0x7fc574068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.188+0000 7fc59637f640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 0x7fc574068b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5901465f0 tx=0x7fc58c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.192+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc590148d90 con 0x7fc5900c30d0 2024-05-08T20:31:26.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.492+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc590148d90 con 0x7fc5900c30d0 2024-05-08T20:31:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.492+0000 7fc586ffd640 1 -- 172.21.15.81:0/1654160345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fc5880b2620 con 0x7fc5900c30d0 2024-05-08T20:31:26.497 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 msgr2=0x7fc574068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 0x7fc574068b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5901465f0 tx=0x7fc58c008040 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 msgr2=0x7fc5901495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc58801af40 tx=0x7fc588019630 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 shutdown_connections 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc574066640 0x7fc574068b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5900c30d0 0x7fc5901495b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5900c2bc0 0x7fc590149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 --2- 172.21.15.81:0/1654160345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5900a94b0 0x7fc59014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 >> 172.21.15.81:0/1654160345 conn(0x7fc5900c4cc0 msgr2=0x7fc590155650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:26.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 shutdown_connections 2024-05-08T20:31:26.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:26.496+0000 7fc5985e3640 1 -- 172.21.15.81:0/1654160345 wait complete. 2024-05-08T20:31:29.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 Processor -- start 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 -- start start 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b80155e10 con 0x7f9b800c30d0 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b80156080 con 0x7f9b800c2bc0 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b8633f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8006e790 con 0x7f9b800a9bc0 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b7ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9b800c30d0 0x7f9b800c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43588/0 (socket says 172.21.15.81:43588) 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b848dc640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 msgr2=0x7f9b800c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 learned_addr learned my addr 172.21.15.81:0/2747469564 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.117:6789/0 conn(0x7f9b800c2bc0 legacy=0x7f9b800a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.656+0000 7f9b848dc640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:29.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.860+0000 7f9b848dc640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 msgr2=0x7f9b800c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:29.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.860+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.117:6789/0 conn(0x7f9b800c2bc0 legacy=0x7f9b800a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:29.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:29.860+0000 7f9b848dc640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:31:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:30.264+0000 7f9b848dc640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 msgr2=0x7f9b800c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:30.264+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.117:6789/0 conn(0x7f9b800c2bc0 legacy=0x7f9b800a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:30.264+0000 7f9b848dc640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:31:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:31.068+0000 7f9b848dc640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 msgr2=0x7f9b800c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:31.068+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.117:6789/0 conn(0x7f9b800c2bc0 legacy=0x7f9b800a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:31.068+0000 7f9b848dc640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 msgr2=0x7f9b800c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.117:3300/0 conn(0x7f9b800a9bc0 0x7f9b800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.117:6789/0 conn(0x7f9b800c2bc0 legacy=0x7f9b800a94b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 -- 172.21.15.81:0/2747469564 >> v1:172.21.15.81:6789/0 conn(0x7f9b800c30d0 legacy=0x7f9b800c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 -- 172.21.15.81:0/2747469564 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8006e790 con 0x7f9b6c0036d0 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.656+0000 7f9b7dffb640 1 -- 172.21.15.81:0/2747469564 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c008d10 con 0x7f9b6c006140 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.660+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:32.864+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7f7fe640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:33.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:33.268+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:31:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> v2:172.21.15.81:3300/0 conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 msgr2=0x7f9b6c0085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:34.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7ffff640 1 -- 172.21.15.81:0/2747469564 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80156360 con 0x7f9b6c0036d0 2024-05-08T20:31:34.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.072+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b6c006140 0x7f9b6c0085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:31:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.076+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b6c0036d0 0x7f9b6c005b50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9b70007d30 tx=0x7f9b7001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f7efa7b14fa9a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b7effd640 1 -- 172.21.15.81:0/2747469564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a58c0 con 0x7f9b6c0036d0 2024-05-08T20:31:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b7effd640 1 -- 172.21.15.81:0/2747469564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b700a9070 con 0x7f9b6c0036d0 2024-05-08T20:31:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b7effd640 1 -- 172.21.15.81:0/2747469564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a5c40 con 0x7f9b6c0036d0 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 -- 172.21.15.81:0/2747469564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b6c0036d0 msgr2=0x7f9b6c005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b6c0036d0 0x7f9b6c005b50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9b70007d30 tx=0x7f9b7001caf0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b848dc640 1 -- 172.21.15.81:0/2747469564 reap_dead start 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 -- 172.21.15.81:0/2747469564 shutdown_connections 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 --2- 172.21.15.81:0/2747469564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b6c0036d0 0x7f9b6c005b50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 -- 172.21.15.81:0/2747469564 >> 172.21.15.81:0/2747469564 conn(0x7f9b800c4cc0 msgr2=0x7f9b800c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 -- 172.21.15.81:0/2747469564 shutdown_connections 2024-05-08T20:31:34.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.080+0000 7f9b8633f640 1 -- 172.21.15.81:0/2747469564 wait complete. 2024-05-08T20:31:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 Processor -- start 2024-05-08T20:31:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 -- start start 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 0x7f9b8013fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b80154580 0x7f9b801eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c6e00 con 0x7f9b80154a00 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c5ec0 con 0x7f9b6c0036d0 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b8633f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c6160 con 0x7f9b80154580 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b7ffff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 msgr2=0x7f9b8013fbd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b7ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 0x7f9b8013fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51920/0 (socket says 172.21.15.81:51920) 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 -- 172.21.15.81:0/1322971959 learned_addr learned my addr 172.21.15.81:0/1322971959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b7f7fe640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b80154580 0x7f9b801eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 -- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b80154580 msgr2=0x7f9b801eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b80154580 0x7f9b801eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 -- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 msgr2=0x7f9b8013fbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 0x7f9b8013fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 -- 172.21.15.81:0/1322971959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7000f040 con 0x7f9b80154a00 2024-05-08T20:31:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b848dc640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9b80070d70 tx=0x7f9b7800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800cd60 con 0x7f9b80154a00 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.084+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78016430 con 0x7f9b80154a00 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800c6440 con 0x7f9b80154a00 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780167e0 con 0x7f9b80154a00 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8013f440 con 0x7f9b80154a00 2024-05-08T20:31:34.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b801ee8c0 con 0x7f9b80154a00 2024-05-08T20:31:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b78012020 con 0x7f9b80154a00 2024-05-08T20:31:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7cff9640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 0x7f9b6c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9b780843e0 con 0x7f9b80154a00 2024-05-08T20:31:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 0x7f9b6c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.088+0000 7f9b7ffff640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 0x7f9b6c0698e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b700b0000 tx=0x7f9b700a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.096+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9b78051440 con 0x7f9b80154a00 2024-05-08T20:31:34.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.352+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9b80074930 con 0x7f9b80154a00 2024-05-08T20:31:34.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.352+0000 7f9b7cff9640 1 -- 172.21.15.81:0/1322971959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f9b7801b620 con 0x7f9b80154a00 2024-05-08T20:31:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":34,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:31:34.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 msgr2=0x7f9b6c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 0x7f9b6c0698e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b700b0000 tx=0x7f9b700a7070 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 msgr2=0x7f9b801ef1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9b80070d70 tx=0x7f9b7800bd80 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 shutdown_connections 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b6c067420 0x7f9b6c0698e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b80154a00 0x7f9b801ef1c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b80154580 0x7f9b801eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 --2- 172.21.15.81:0/1322971959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b6c0036d0 0x7f9b8013fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 >> 172.21.15.81:0/1322971959 conn(0x7f9b800c4cc0 msgr2=0x7f9b8014d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 shutdown_connections 2024-05-08T20:31:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.356+0000 7f9b8633f640 1 -- 172.21.15.81:0/1322971959 wait complete. 2024-05-08T20:31:34.377 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:31:34.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:31:34.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:31:34.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.500+0000 7f7e8617f640 1 Processor -- start 2024-05-08T20:31:34.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.500+0000 7f7e8617f640 1 -- start start 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e8014e9e0 0x7f7e800c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 0x7f7e800a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e800a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8006b5a0 con 0x7f7e8014e9e0 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800c4a10 con 0x7f7e800c1ca0 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e8617f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80155900 con 0x7f7e80157f60 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7effd640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 msgr2=0x7f7e800a9820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e8014e9e0 0x7f7e800c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 0x7f7e800a9820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e8014e9e0 0x7f7e800c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51934/0 (socket says 172.21.15.81:51934) 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/3983581275 learned_addr learned my addr 172.21.15.81:0/3983581275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:34.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7ffff640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e800a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/3983581275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 msgr2=0x7f7e800a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e800a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/3983581275 >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 msgr2=0x7f7e800a9820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/3983581275 >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 0x7f7e800a9820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/3983581275 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80154d80 con 0x7f7e8014e9e0 2024-05-08T20:31:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014e9e0 0x7f7e800c1760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e80070f90 tx=0x7f7e7001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ea33e4b04238c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7e7fc640 1 -- 172.21.15.81:0/3983581275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700ab670 con 0x7f7e8014e9e0 2024-05-08T20:31:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7e7fc640 1 -- 172.21.15.81:0/3983581275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700ab7d0 con 0x7f7e8014e9e0 2024-05-08T20:31:34.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.504+0000 7f7e7e7fc640 1 -- 172.21.15.81:0/3983581275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700abb60 con 0x7f7e8014e9e0 2024-05-08T20:31:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/3983581275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014e9e0 msgr2=0x7f7e800c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014e9e0 0x7f7e800c1760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e80070f90 tx=0x7f7e7001c4b0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/3983581275 shutdown_connections 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e800a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- 172.21.15.81:0/3983581275 >> v2:172.21.15.117:3300/0 conn(0x7f7e800c1ca0 0x7f7e800a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- 172.21.15.81:0/3983581275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014e9e0 0x7f7e800c1760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/3983581275 >> 172.21.15.81:0/3983581275 conn(0x7f7e800c4e30 msgr2=0x7f7e800c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/3983581275 shutdown_connections 2024-05-08T20:31:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/3983581275 wait complete. 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 Processor -- start 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- start start 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 0x7f7e801f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8014e9e0 0x7f7e8014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e8014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800aba70 con 0x7f7e800c1ca0 2024-05-08T20:31:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8014f930 con 0x7f7e8014e9e0 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8014fbf0 con 0x7f7e80157f60 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7effd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8014e9e0 msgr2=0x7f7e8014dc70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 0x7f7e801f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8014e9e0 0x7f7e8014dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 0x7f7e801f1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51948/0 (socket says 172.21.15.81:51948) 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/971513943 learned_addr learned my addr 172.21.15.81:0/971513943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7ffff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e8014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 msgr2=0x7f7e8014c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e80157f60 0x7f7e8014c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8014e9e0 msgr2=0x7f7e8014dc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8014e9e0 0x7f7e8014dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700094d0 con 0x7f7e800c1ca0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e7f7fe640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 0x7f7e801f1070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e700ad040 tx=0x7f7e70019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b4800 con 0x7f7e800c1ca0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700b4960 con 0x7f7e800c1ca0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b4d10 con 0x7f7e800c1ca0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8014e5b0 con 0x7f7e800c1ca0 2024-05-08T20:31:34.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.508+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e800ab4b0 con 0x7f7e800c1ca0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e8617f640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 0x7f7e8014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80073f10 con 0x7f7e8014cf40 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e7effd640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 0x7f7e8014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e700c7440 con 0x7f7e800c1ca0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e7effd640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e8014edc0 con 0x7f7e8014cf40 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e7effd640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 0x7f7e8014c8f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e80153b00 tx=0x7f7e7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e6c066640 0x7f7e6c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7e7011f1e0 con 0x7f7e800c1ca0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e7ffff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e6c066640 0x7f7e6c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003e20 con 0x7f7e8014cf40 2024-05-08T20:31:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7e74005070 con 0x7f7e8014cf40 2024-05-08T20:31:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 msgr2=0x7f7e8014c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 0x7f7e8014c8f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e80153b00 tx=0x7f7e7400b8e0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 msgr2=0x7f7e8014c8f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e67fff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e8014cf40 0x7f7e8014c8f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.512+0000 7f7e7ffff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e6c066640 0x7f7e6c068b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7e80153f10 tx=0x7f7e78007410 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 0x7f7e801ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8014fd60 con 0x7f7e801ed0f0 2024-05-08T20:31:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e7effd640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 0x7f7e801ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e7effd640 1 -- 172.21.15.81:0/971513943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7e80074950 con 0x7f7e801ed0f0 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e7effd640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 0x7f7e801ed500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bfd0 tx=0x7f7e74005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7401f070 con 0x7f7e801ed0f0 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f7e74010610 con 0x7f7e801ed0f0 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 msgr2=0x7f7e801ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 0x7f7e801ed500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bfd0 tx=0x7f7e74005a30 comp rx=0 tx=0).stop 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 msgr2=0x7f7e801ed500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e67fff640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e801ed0f0 0x7f7e801ed500 secure :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bfd0 tx=0x7f7e74005a30 comp rx=0 tx=0).stop 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 34, 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:34.526 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:34.530 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:34.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:34.541 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e6c066640 msgr2=0x7f7e6c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e6c066640 0x7f7e6c068b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7e80153f10 tx=0x7f7e78007410 comp rx=0 tx=0).stop 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 msgr2=0x7f7e801f1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 --2- 172.21.15.81:0/971513943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e800c1ca0 0x7f7e801f1070 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7e700ad040 tx=0x7f7e70019250 comp rx=0 tx=0).stop 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e7ffff640 1 -- 172.21.15.81:0/971513943 reap_dead start 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e7ffff640 1 -- 172.21.15.81:0/971513943 reap_dead start 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 shutdown_connections 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 >> 172.21.15.81:0/971513943 conn(0x7f7e800c4e30 msgr2=0x7f7e800a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.520+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 shutdown_connections 2024-05-08T20:31:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.524+0000 7f7e8617f640 1 -- 172.21.15.81:0/971513943 wait complete. 2024-05-08T20:31:34.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:31:34.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:31:34.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:31:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 Processor -- start 2024-05-08T20:31:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 -- start start 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd48c069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c152ab0 con 0x7fd48c06a500 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c152d90 con 0x7fd48c14fe70 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd49440f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1528a0 con 0x7fd48c155e90 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fd48c14fe70 legacy=0x7fd48c06d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:31:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4929ac640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd48c06a500 0x7fd48c15d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43596/0 (socket says 172.21.15.81:43596) 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4929ac640 1 -- 172.21.15.81:0/3019170609 learned_addr learned my addr 172.21.15.81:0/3019170609 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4919aa640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd48c069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988110846 0 0) 0x7fd48c152ab0 con 0x7fd48c06a500 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd478003530 con 0x7fd48c06a500 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926331072 0 0) 0x7fd478003530 con 0x7fd48c06a500 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 msgr2=0x7fd48c069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd48c069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 >> v1:172.21.15.117:6789/0 conn(0x7fd48c14fe70 legacy=0x7fd48c06d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c153070 con 0x7fd48c06a500 2024-05-08T20:31:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fd484001a00 con 0x7fd48c06a500 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 >> v1:172.21.15.81:6789/0 conn(0x7fd48c06a500 legacy=0x7fd48c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd478003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4780047d0 0x7fd478004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd4780051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1528a0 con 0x7fd4780039b0 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47800bb20 con 0x7fd4780047d0 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47800bcb0 con 0x7fd48c155e90 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4919aa640 1 -- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4780047d0 msgr2=0x7fd478004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd478003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4919aa640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4780047d0 0x7fd478004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4929ac640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd4780051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 -- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 msgr2=0x7fd4780051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd4780051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 -- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4780047d0 msgr2=0x7fd478004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:31:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4780047d0 0x7fd478004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4921ab640 1 -- 172.21.15.81:0/3019170609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478003530 con 0x7fd4780039b0 2024-05-08T20:31:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.668+0000 7fd4929ac640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c155e90 0x7fd4780051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd4921ab640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd478003db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd488009920 tx=0x7fd48801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a606d04d7aae8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488003bc0 con 0x7fd4780039b0 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880a7070 con 0x7fd4780039b0 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd4911a9640 1 -- 172.21.15.81:0/3019170609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488005070 con 0x7fd4780039b0 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 -- 172.21.15.81:0/3019170609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 msgr2=0x7fd478003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 --2- 172.21.15.81:0/3019170609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd478003db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd488009920 tx=0x7fd48801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd4929ac640 1 -- 172.21.15.81:0/3019170609 reap_dead start 2024-05-08T20:31:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 -- 172.21.15.81:0/3019170609 shutdown_connections 2024-05-08T20:31:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 -- 172.21.15.81:0/3019170609 >> 172.21.15.81:0/3019170609 conn(0x7fd48c0c71b0 msgr2=0x7fd48c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 -- 172.21.15.81:0/3019170609 shutdown_connections 2024-05-08T20:31:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.672+0000 7fd49440f640 1 -- 172.21.15.81:0/3019170609 wait complete. 2024-05-08T20:31:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 Processor -- start 2024-05-08T20:31:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- start start 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c15e410 0x7fd48c14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48c14f440 0x7fd48c1eb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0c5ba0 con 0x7fd4780039b0 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1eef80 con 0x7fd48c14f440 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0c5de0 con 0x7fd48c15e410 2024-05-08T20:31:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4929ac640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48c14f440 msgr2=0x7fd48c1eb040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51982/0 (socket says 172.21.15.81:51982) 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 -- 172.21.15.81:0/1472174207 learned_addr learned my addr 172.21.15.81:0/1472174207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4929ac640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48c14f440 0x7fd48c1eb040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4919aa640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c15e410 0x7fd48c14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c15e410 msgr2=0x7fd48c14ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c15e410 0x7fd48c14ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48c14f440 msgr2=0x7fd48c1eb040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48c14f440 0x7fd48c1eb040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c1ee650 con 0x7fd4780039b0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4921ab640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd48801c220 tx=0x7fd478005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880b2070 con 0x7fd4780039b0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880050c0 con 0x7fd4780039b0 2024-05-08T20:31:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c1ee930 con 0x7fd4780039b0 2024-05-08T20:31:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488005450 con 0x7fd4780039b0 2024-05-08T20:31:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c1ef410 con 0x7fd4780039b0 2024-05-08T20:31:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 0x7fd48c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1ee7e0 con 0x7fd48c1eb580 2024-05-08T20:31:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.676+0000 7fd4919aa640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 0x7fd48c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd4919aa640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd48c06dd10 con 0x7fd48c1eb580 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4880a9020 con 0x7fd4780039b0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd4919aa640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 0x7fd48c150710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0094c0 tx=0x7fd47c011970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd470066640 0x7fd470068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd48811d3b0 con 0x7fd4780039b0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd4929ac640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd470066640 0x7fd470068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c015870 con 0x7fd48c1eb580 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd4929ac640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd470066640 0x7fd470068b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd48c072920 tx=0x7fd484009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd47c0159d0 con 0x7fd48c1eb580 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 msgr2=0x7fd48c150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 0x7fd48c150710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0094c0 tx=0x7fd47c011970 comp rx=0 tx=0).stop 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 msgr2=0x7fd48c150710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:34.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.680+0000 7fd482ffd640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c1eb580 0x7fd48c150710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.684+0000 7fd49440f640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 0x7fd48c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.684+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c069550 con 0x7fd48c150c50 2024-05-08T20:31:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd4919aa640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 0x7fd48c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd4919aa640 1 -- 172.21.15.81:0/1472174207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd48c0675e0 con 0x7fd48c150c50 2024-05-08T20:31:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd4919aa640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 0x7fd48c151060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd48c14f890 tx=0x7fd47c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:34.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c006840 con 0x7fd48c150c50 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7fd47c022580 con 0x7fd48c150c50 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 msgr2=0x7fd48c151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 0x7fd48c151060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd48c14f890 tx=0x7fd47c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 msgr2=0x7fd48c151060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd482ffd640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd48c150c50 0x7fd48c151060 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd48c14f890 tx=0x7fd47c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:31:34.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 34, 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.693 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.694 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:31:34.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:31:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:31:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:31:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:31:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:31:34.703 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd470066640 msgr2=0x7fd470068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd470066640 0x7fd470068b00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd48c072920 tx=0x7fd484009040 comp rx=0 tx=0).stop 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 msgr2=0x7fd48c0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd48801c220 tx=0x7fd478005800 comp rx=0 tx=0).stop 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd4929ac640 1 -- 172.21.15.81:0/1472174207 reap_dead start 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 shutdown_connections 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 --2- 172.21.15.81:0/1472174207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4780039b0 0x7fd48c0c5660 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 >> 172.21.15.81:0/1472174207 conn(0x7fd48c0c71b0 msgr2=0x7fd48c0c2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 shutdown_connections 2024-05-08T20:31:34.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:34.688+0000 7fd49440f640 1 -- 172.21.15.81:0/1472174207 wait complete. 2024-05-08T20:31:34.715 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:31:34.715 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:31:49.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:31:49.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:31:54.716 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:31:54.716 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:31:54.717 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:31:54.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:31:54.720 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:31:54.720 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:31:54.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:31:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 Processor -- start 2024-05-08T20:31:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 -- start start 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc4154cf0 0x7f6bc4155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bc4155690 0x7f6bc40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc41522e0 con 0x7f6bc4151f00 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc406bb20 con 0x7f6bc4155690 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc91e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41548e0 con 0x7f6bc4154cf0 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc359e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bc4155690 0x7f6bc40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6bc4151f00 0x7f6bc41588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60152/0 (socket says 172.21.15.81:60152) 2024-05-08T20:31:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bc2d9d640 1 -- 172.21.15.81:0/2906453115 learned_addr learned my addr 172.21.15.81:0/2906453115 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.855+0000 7f6bba59c640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc4154cf0 0x7f6bc4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc259c640 1 -- 172.21.15.81:0/2906453115 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003615597 0 0) 0x7f6bc41522e0 con 0x7f6bc4151f00 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc259c640 1 -- 172.21.15.81:0/2906453115 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0003530 con 0x7f6bc4151f00 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc359e640 1 -- 172.21.15.81:0/2906453115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc4154cf0 msgr2=0x7f6bc4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc359e640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc4154cf0 0x7f6bc4155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc359e640 1 -- 172.21.15.81:0/2906453115 >> v1:172.21.15.81:6789/0 conn(0x7f6bc4151f00 legacy=0x7f6bc41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc359e640 1 -- 172.21.15.81:0/2906453115 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40c5f80 con 0x7f6bc4155690 2024-05-08T20:31:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc359e640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4155690 0x7f6bc40ca000 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009dc0 tx=0x7f6bbc01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd734a17e241162b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc259c640 1 -- 172.21.15.81:0/2906453115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a5890 con 0x7f6bc4155690 2024-05-08T20:31:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc259c640 1 -- 172.21.15.81:0/2906453115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0a59f0 con 0x7f6bc4155690 2024-05-08T20:31:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc259c640 1 -- 172.21.15.81:0/2906453115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0a5d80 con 0x7f6bc4155690 2024-05-08T20:31:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 -- 172.21.15.81:0/2906453115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4155690 msgr2=0x7f6bc40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4155690 0x7f6bc40ca000 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009dc0 tx=0x7f6bbc01c830 comp rx=0 tx=0).stop 2024-05-08T20:31:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 -- 172.21.15.81:0/2906453115 shutdown_connections 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4155690 0x7f6bc40ca000 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/2906453115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc4154cf0 0x7f6bc4155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 -- 172.21.15.81:0/2906453115 >> 172.21.15.81:0/2906453115 conn(0x7f6bc40715f0 msgr2=0x7f6bc4071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 -- 172.21.15.81:0/2906453115 shutdown_connections 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.859+0000 7f6bc91e9640 1 -- 172.21.15.81:0/2906453115 wait complete. 2024-05-08T20:31:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 Processor -- start 2024-05-08T20:31:54.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- start start 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc414a280 0x7f6bc41ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4156350 con 0x7f6bc4151f00 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4156630 con 0x7f6bc4154cf0 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41eca60 con 0x7f6bc414a280 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57130/0 (socket says 172.21.15.81:57130) 2024-05-08T20:31:54.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 -- 172.21.15.81:0/1821666873 learned_addr learned my addr 172.21.15.81:0/1821666873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc359e640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc414a280 0x7f6bc41ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bba59c640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bba59c640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 msgr2=0x7f6bc40c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bba59c640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 msgr2=0x7f6bc40c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bba59c640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bba59c640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc414a280 msgr2=0x7f6bc41ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc414a280 0x7f6bc41ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 msgr2=0x7f6bc40c8510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 -- 172.21.15.81:0/1821666873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009a70 con 0x7f6bc4151f00 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc2d9d640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c420 tx=0x7f6bb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:54.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4005cf0 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4005e50 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc40c8a50 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40072d0 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc414de00 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.863+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc40675e0 con 0x7f6bc4151f00 2024-05-08T20:31:54.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.867+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6bb4007430 con 0x7f6bc4151f00 2024-05-08T20:31:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.867+0000 7f6bbbfff640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 0x7f6ba4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:31:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.867+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6bb4083aa0 con 0x7f6bc4151f00 2024-05-08T20:31:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.867+0000 7f6bba59c640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 0x7f6ba4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:31:54.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.867+0000 7f6bba59c640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 0x7f6ba4068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4154350 tx=0x7f6bac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:31:54.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:54.871+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6bb4050b20 con 0x7f6bc4151f00 2024-05-08T20:31:55.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:31:55.179+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6bc4156490 con 0x7f6bc4151f00 2024-05-08T20:32:00.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.047+0000 7f6bbbfff640 1 -- 172.21.15.81:0/1821666873 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f6bc4156490 con 0x7f6bc4151f00 2024-05-08T20:32:00.052 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":38,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 msgr2=0x7f6ba4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 0x7f6ba4068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4154350 tx=0x7f6bac008040 comp rx=0 tx=0).stop 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 msgr2=0x7f6bc41f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c420 tx=0x7f6bb400c8e0 comp rx=0 tx=0).stop 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 shutdown_connections 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba4066690 0x7f6ba4068b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc414a280 0x7f6bc41ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc4154cf0 0x7f6bc40c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 --2- 172.21.15.81:0/1821666873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc4151f00 0x7f6bc41f08d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 >> 172.21.15.81:0/1821666873 conn(0x7f6bc40715f0 msgr2=0x7f6bc40c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 shutdown_connections 2024-05-08T20:32:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:00.051+0000 7f6bc91e9640 1 -- 172.21.15.81:0/1821666873 wait complete. 2024-05-08T20:32:03.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 Processor -- start 2024-05-08T20:32:03.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 -- start start 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47b41501e0 0x7f47b406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b40725f0 0x7f47b40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47b406f400 0x7f47b40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b406fd60 con 0x7f47b406f400 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b4072180 con 0x7f47b41501e0 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b8d86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c0650 con 0x7f47b40725f0 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47b406f400 0x7f47b40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47b406f400 0x7f47b40c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36548/0 (socket says 172.21.15.81:36548) 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 -- 172.21.15.81:0/2911393867 learned_addr learned my addr 172.21.15.81:0/2911393867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b1d9b640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b40725f0 0x7f47b40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b259c640 1 --2- 172.21.15.81:0/2911393867 >> v2:172.21.15.117:3300/0 conn(0x7f47b41501e0 0x7f47b406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 -- 172.21.15.81:0/2911393867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b40725f0 msgr2=0x7f47b40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b40725f0 0x7f47b40c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 -- 172.21.15.81:0/2911393867 >> v2:172.21.15.117:3300/0 conn(0x7f47b41501e0 msgr2=0x7f47b406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 --2- 172.21.15.81:0/2911393867 >> v2:172.21.15.117:3300/0 conn(0x7f47b41501e0 0x7f47b406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.207+0000 7f47b2d9d640 1 -- 172.21.15.81:0/2911393867 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b406fa80 con 0x7f47b406f400 2024-05-08T20:32:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b2d9d640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b406f400 0x7f47b40c2180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f47b406ae70 tx=0x7f47a401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f93a7342f3e94b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b159a640 1 -- 172.21.15.81:0/2911393867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40a5650 con 0x7f47b406f400 2024-05-08T20:32:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b159a640 1 -- 172.21.15.81:0/2911393867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a40a57b0 con 0x7f47b406f400 2024-05-08T20:32:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b159a640 1 -- 172.21.15.81:0/2911393867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40a5b40 con 0x7f47b406f400 2024-05-08T20:32:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- 172.21.15.81:0/2911393867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b406f400 msgr2=0x7f47b40c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b406f400 0x7f47b40c2180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f47b406ae70 tx=0x7f47a401c8a0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- 172.21.15.81:0/2911393867 shutdown_connections 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b40725f0 0x7f47b40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- 172.21.15.81:0/2911393867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b406f400 0x7f47b40c2180 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- 172.21.15.81:0/2911393867 >> v2:172.21.15.117:3300/0 conn(0x7f47b41501e0 0x7f47b406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- 172.21.15.81:0/2911393867 >> 172.21.15.81:0/2911393867 conn(0x7f47b40c2ca0 msgr2=0x7f47b40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- 172.21.15.81:0/2911393867 shutdown_connections 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- 172.21.15.81:0/2911393867 wait complete. 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 Processor -- start 2024-05-08T20:32:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- start start 2024-05-08T20:32:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47b406f400 0x7f47b41ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b41501e0 0x7f47b40c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c3d90 con 0x7f47b40725f0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4148060 con 0x7f47b406f400 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.211+0000 7f47b8d86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4148340 con 0x7f47b41501e0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36560/0 (socket says 172.21.15.81:36560) 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 -- 172.21.15.81:0/1335609130 learned_addr learned my addr 172.21.15.81:0/1335609130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b259c640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47b406f400 0x7f47b41ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b2d9d640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b41501e0 0x7f47b40c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 -- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b41501e0 msgr2=0x7f47b40c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b41501e0 0x7f47b40c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 -- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47b406f400 msgr2=0x7f47b41ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47b406f400 0x7f47b41ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 -- 172.21.15.81:0/1335609130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009b30 con 0x7f47b40725f0 2024-05-08T20:32:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b1d9b640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f479c00d800 tx=0x7f479c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0096a0 con 0x7f47b40725f0 2024-05-08T20:32:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c009800 con 0x7f47b40725f0 2024-05-08T20:32:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40c3fa0 con 0x7f47b40725f0 2024-05-08T20:32:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c009b70 con 0x7f47b40725f0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b4148710 con 0x7f47b40725f0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b41481a0 con 0x7f47b40725f0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f479c009cd0 con 0x7f47b40725f0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 0x7f4794068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f479c084c50 con 0x7f47b40725f0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b259c640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 0x7f4794068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.215+0000 7f47b259c640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 0x7f4794068b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b930 tx=0x7f47ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.223+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f47b41481a0 con 0x7f47b40725f0 2024-05-08T20:32:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.479+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f47b41481a0 con 0x7f47b40725f0 2024-05-08T20:32:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.479+0000 7f47aaffd640 1 -- 172.21.15.81:0/1335609130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f47b41481a0 con 0x7f47b40725f0 2024-05-08T20:32:03.485 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:03.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 msgr2=0x7f4794068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 0x7f4794068b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b930 tx=0x7f47ac008040 comp rx=0 tx=0).stop 2024-05-08T20:32:03.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 msgr2=0x7f47b414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f479c00d800 tx=0x7f479c00dcc0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 shutdown_connections 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4794066690 0x7f4794068b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47b41501e0 0x7f47b40c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b40725f0 0x7f47b414f300 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 --2- 172.21.15.81:0/1335609130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47b406f400 0x7f47b41ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 >> 172.21.15.81:0/1335609130 conn(0x7f47b40c2ca0 msgr2=0x7f47b41435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 shutdown_connections 2024-05-08T20:32:03.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.483+0000 7f47b8d86640 1 -- 172.21.15.81:0/1335609130 wait complete. 2024-05-08T20:32:03.508 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:32:03.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:32:03.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:32:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.623+0000 7fc24353c640 1 Processor -- start 2024-05-08T20:32:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.623+0000 7fc24353c640 1 -- start start 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24353c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc23c0c2d80 0x7fc23c0aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24353c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c151b00 con 0x7fc23c070e40 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24353c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0712d0 con 0x7fc23c151f90 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24353c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c071d70 con 0x7fc23c0c2d80 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241d39640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc23c070e40 0x7fc23c0ac0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36584/0 (socket says 172.21.15.81:36584) 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241d39640 1 -- 172.21.15.81:0/648073747 learned_addr learned my addr 172.21.15.81:0/648073747 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 --2- 172.21.15.81:0/648073747 >> v2:172.21.15.117:3300/0 conn(0x7fc23c0c2d80 0x7fc23c0aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910607292 0 0) 0x7fc23c151b00 con 0x7fc23c070e40 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc228003530 con 0x7fc23c070e40 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539344515 0 0) 0x7fc228003530 con 0x7fc23c070e40 2024-05-08T20:32:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 >> v2:172.21.15.117:3300/0 conn(0x7fc23c0c2d80 msgr2=0x7fc23c0aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 --2- 172.21.15.81:0/648073747 >> v2:172.21.15.117:3300/0 conn(0x7fc23c0c2d80 0x7fc23c0aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 >> v1:172.21.15.117:6789/0 conn(0x7fc23c151f90 legacy=0x7fc23c14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0715b0 con 0x7fc23c070e40 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc22c001680 con 0x7fc23c070e40 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 >> v1:172.21.15.81:6789/0 conn(0x7fc23c070e40 legacy=0x7fc23c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 0x7fc228003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2280047d0 0x7fc228004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2280052b0 0x7fc22800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c071d70 con 0x7fc228003980 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22800c180 con 0x7fc2280052b0 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22800c340 con 0x7fc2280047d0 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 0x7fc228003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc242d3b640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2280052b0 0x7fc22800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 -- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2280047d0 msgr2=0x7fc228004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2280047d0 0x7fc228004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 -- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2280052b0 msgr2=0x7fc22800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2280052b0 0x7fc22800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc24253a640 1 -- 172.21.15.81:0/648073747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228003530 con 0x7fc228003980 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc242d3b640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2280052b0 0x7fc22800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.627+0000 7fc242d3b640 1 -- 172.21.15.81:0/648073747 reap_dead start 2024-05-08T20:32:03.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24253a640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 0x7fc228003da0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc23800ba00 tx=0x7fc23801c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf967ee4049e579 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380ae440 con 0x7fc228003980 2024-05-08T20:32:03.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2380ae5a0 con 0x7fc228003980 2024-05-08T20:32:03.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc241538640 1 -- 172.21.15.81:0/648073747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380ae950 con 0x7fc228003980 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 msgr2=0x7fc228003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 0x7fc228003da0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc23800ba00 tx=0x7fc23801c660 comp rx=0 tx=0).stop 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- 172.21.15.81:0/648073747 shutdown_connections 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 --2- 172.21.15.81:0/648073747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc228003980 0x7fc228003da0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- 172.21.15.81:0/648073747 >> 172.21.15.81:0/648073747 conn(0x7fc23c0c3c10 msgr2=0x7fc23c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- 172.21.15.81:0/648073747 shutdown_connections 2024-05-08T20:32:03.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- 172.21.15.81:0/648073747 wait complete. 2024-05-08T20:32:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 Processor -- start 2024-05-08T20:32:03.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.631+0000 7fc24353c640 1 -- start start 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc228003980 0x7fc23c1edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 0x7fc23c0c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c140950 0x7fc23c140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1485b0 con 0x7fc23c06e460 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1458c0 con 0x7fc23c140950 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c06cb40 con 0x7fc228003980 2024-05-08T20:32:03.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 0x7fc23c0c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 0x7fc23c0c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36586/0 (socket says 172.21.15.81:36586) 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 -- 172.21.15.81:0/3404208818 learned_addr learned my addr 172.21.15.81:0/3404208818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24253a640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc228003980 0x7fc23c1edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc242d3b640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c140950 0x7fc23c140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc228003980 msgr2=0x7fc23c1edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc228003980 0x7fc23c1edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c140950 msgr2=0x7fc23c140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c140950 0x7fc23c140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0c1570 con 0x7fc23c06e460 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc241d39640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 0x7fc23c0c07a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c7c0 tx=0x7fc22c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0074e0 con 0x7fc23c06e460 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c007640 con 0x7fc23c06e460 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c146520 con 0x7fc23c06e460 2024-05-08T20:32:03.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c004a10 con 0x7fc23c06e460 2024-05-08T20:32:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c145db0 con 0x7fc23c06e460 2024-05-08T20:32:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 0x7fc23c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c069550 con 0x7fc23c06cfb0 2024-05-08T20:32:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24253a640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 0x7fc23c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24253a640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc23c0c3160 con 0x7fc23c06cfb0 2024-05-08T20:32:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc24253a640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 0x7fc23c06d390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc228004750 tx=0x7fc228005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380ae440 con 0x7fc23c06cfb0 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc22c004b70 con 0x7fc23c06e460 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc220066760 0x7fc220068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc22c083c80 con 0x7fc23c06e460 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc242d3b640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc220066760 0x7fc220068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc2380aed30 con 0x7fc23c06cfb0 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 msgr2=0x7fc23c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 0x7fc23c06d390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc228004750 tx=0x7fc228005800 comp rx=0 tx=0).stop 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 msgr2=0x7fc23c06d390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.635+0000 7fc232ffd640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06cfb0 0x7fc23c06d390 secure :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc228004750 tx=0x7fc228005800 comp rx=0 tx=0).stop 2024-05-08T20:32:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.639+0000 7fc242d3b640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc220066760 0x7fc220068c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc23c06f4d0 tx=0x7fc234009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.643+0000 7fc24353c640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 0x7fc23c1f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.643+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0670c0 con 0x7fc23c06d8d0 2024-05-08T20:32:03.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.643+0000 7fc24253a640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 0x7fc23c1f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24253a640 1 -- 172.21.15.81:0/3404208818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc23c06cc80 con 0x7fc23c06d8d0 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24253a640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 0x7fc23c1f0ae0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc23800ba00 tx=0x7fc2380a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380aeea0 con 0x7fc23c06d8d0 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fc2380c6070 con 0x7fc23c06d8d0 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 msgr2=0x7fc23c1f0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 0x7fc23c1f0ae0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc23800ba00 tx=0x7fc2380a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 msgr2=0x7fc23c1f0ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc232ffd640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06d8d0 0x7fc23c1f0ae0 secure :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc23800ba00 tx=0x7fc2380a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:03.651 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:03.654 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.655 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:03.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:03.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:03.658 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:03.660 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.662 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.663 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:03.664 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc220066760 msgr2=0x7fc220068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc220066760 0x7fc220068c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc23c06f4d0 tx=0x7fc234009040 comp rx=0 tx=0).stop 2024-05-08T20:32:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 msgr2=0x7fc23c0c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 --2- 172.21.15.81:0/3404208818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c06e460 0x7fc23c0c07a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c7c0 tx=0x7fc22c00cc80 comp rx=0 tx=0).stop 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc242d3b640 1 -- 172.21.15.81:0/3404208818 reap_dead start 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc242d3b640 1 -- 172.21.15.81:0/3404208818 reap_dead start 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 shutdown_connections 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 >> 172.21.15.81:0/3404208818 conn(0x7fc23c0c3c10 msgr2=0x7fc23c0ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 shutdown_connections 2024-05-08T20:32:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.647+0000 7fc24353c640 1 -- 172.21.15.81:0/3404208818 wait complete. 2024-05-08T20:32:03.670 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:03.670 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:32:03.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:32:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.787+0000 7fe8a328f640 1 Processor -- start 2024-05-08T20:32:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.787+0000 7fe8a328f640 1 -- start start 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a328f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 0x7fe89c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a328f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe89c155690 0x7fe89c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a328f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c1522e0 con 0x7fe89c151f00 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a328f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c06bb20 con 0x7fe89c155690 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a328f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1548e0 con 0x7fe89c154cf0 2024-05-08T20:32:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe89c151f00 0x7fe89c1588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36600/0 (socket says 172.21.15.81:36600) 2024-05-08T20:32:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 -- 172.21.15.81:0/2633483106 learned_addr learned my addr 172.21.15.81:0/2633483106 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a082a640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 0x7fe89c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383209841 0 0) 0x7fe89c1522e0 con 0x7fe89c151f00 2024-05-08T20:32:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a182c640 1 --2- 172.21.15.81:0/2633483106 >> v2:172.21.15.117:3300/0 conn(0x7fe89c155690 0x7fe89c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe888003530 con 0x7fe89c151f00 2024-05-08T20:32:03.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3854232982 0 0) 0x7fe888003530 con 0x7fe89c151f00 2024-05-08T20:32:03.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 msgr2=0x7fe89c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 0x7fe89c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 >> v2:172.21.15.117:3300/0 conn(0x7fe89c155690 msgr2=0x7fe89c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 --2- 172.21.15.81:0/2633483106 >> v2:172.21.15.117:3300/0 conn(0x7fe89c155690 0x7fe89c0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0c5f80 con 0x7fe89c151f00 2024-05-08T20:32:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe898001680 con 0x7fe89c151f00 2024-05-08T20:32:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 >> v1:172.21.15.81:6789/0 conn(0x7fe89c151f00 legacy=0x7fe89c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe888003980 0x7fe888003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 0x7fe8880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe888004d10 0x7fe888005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88800b990 con 0x7fe888003980 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88800bad0 con 0x7fe888004d10 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88800bc90 con 0x7fe89c154cf0 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe888003980 0x7fe888003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 -- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 msgr2=0x7fe8880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe89c154cf0 0x7fe8880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 -- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe888004d10 msgr2=0x7fe888005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe888004d10 0x7fe888005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 -- 172.21.15.81:0/2633483106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888003530 con 0x7fe888003980 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.791+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe888003980 0x7fe888003da0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c1c0 tx=0x7fe89801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febdd8dbc8dd1b08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898005ae0 con 0x7fe888003980 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898005c60 con 0x7fe888003980 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe893fff640 1 -- 172.21.15.81:0/2633483106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8980a58c0 con 0x7fe888003980 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- 172.21.15.81:0/2633483106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe888003980 msgr2=0x7fe888003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 --2- 172.21.15.81:0/2633483106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe888003980 0x7fe888003da0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c1c0 tx=0x7fe89801cc40 comp rx=0 tx=0).stop 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a182c640 1 -- 172.21.15.81:0/2633483106 reap_dead start 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- 172.21.15.81:0/2633483106 shutdown_connections 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- 172.21.15.81:0/2633483106 >> 172.21.15.81:0/2633483106 conn(0x7fe89c0715f0 msgr2=0x7fe89c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- 172.21.15.81:0/2633483106 shutdown_connections 2024-05-08T20:32:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- 172.21.15.81:0/2633483106 wait complete. 2024-05-08T20:32:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 Processor -- start 2024-05-08T20:32:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- start start 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe888003980 0x7fe89c1f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 0x7fe89c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ece50 0x7fe89c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f0440 con 0x7fe89c1544e0 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f09e0 con 0x7fe89c1ece50 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a328f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f13b0 con 0x7fe888003980 2024-05-08T20:32:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 0x7fe89c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 0x7fe89c14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36616/0 (socket says 172.21.15.81:36616) 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 -- 172.21.15.81:0/2632454894 learned_addr learned my addr 172.21.15.81:0/2632454894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a182c640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ece50 0x7fe89c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe888003980 0x7fe89c1f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe888003980 msgr2=0x7fe89c1f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe888003980 0x7fe89c1f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ece50 msgr2=0x7fe89c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ece50 0x7fe89c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0ab9f0 con 0x7fe89c1544e0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe8a082a640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 0x7fe89c14a160 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e7f0 tx=0x7fe88c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00c940 con 0x7fe89c1544e0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00caa0 con 0x7fe89c1544e0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.795+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ce50 con 0x7fe89c1544e0 2024-05-08T20:32:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c1f0670 con 0x7fe89c1544e0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c0ab160 con 0x7fe89c1544e0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a328f640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 0x7fe89c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c069600 con 0x7fe89c1ed260 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 0x7fe89c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe88c013470 con 0x7fe89c1544e0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a102b640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe89c1554e0 con 0x7fe89c1ed260 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe880066690 0x7fe880068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe88c084550 con 0x7fe89c1544e0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 0x7fe89c151350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c190 tx=0x7fe888005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a182c640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe880066690 0x7fe880068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898001440 con 0x7fe89c1ed260 2024-05-08T20:32:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe8a182c640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe880066690 0x7fe880068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe89c08c580 tx=0x7fe89400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe8980b5040 con 0x7fe89c1ed260 2024-05-08T20:32:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 msgr2=0x7fe89c151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 0x7fe89c151350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c190 tx=0x7fe888005800 comp rx=0 tx=0).stop 2024-05-08T20:32:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 msgr2=0x7fe89c151350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.799+0000 7fe891ffb640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c1ed260 0x7fe89c151350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe8a328f640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 0x7fe89c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f0800 con 0x7fe89c0a9cf0 2024-05-08T20:32:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 0x7fe89c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe8a102b640 1 -- 172.21.15.81:0/2632454894 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe89c1f0b50 con 0x7fe89c0a9cf0 2024-05-08T20:32:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe8a102b640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 0x7fe89c0aa100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe89801cc80 tx=0x7fe8980a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898007680 con 0x7fe89c0a9cf0 2024-05-08T20:32:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7fe8980c16d0 con 0x7fe89c0a9cf0 2024-05-08T20:32:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 msgr2=0x7fe89c0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 0x7fe89c0aa100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe89801cc80 tx=0x7fe8980a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 msgr2=0x7fe89c0aa100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.807+0000 7fe891ffb640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe89c0a9cf0 0x7fe89c0aa100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:03.814 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.815 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:03.817 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.818 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:03.825 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe880066690 msgr2=0x7fe880068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe880066690 0x7fe880068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe89c08c580 tx=0x7fe89400d040 comp rx=0 tx=0).stop 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 msgr2=0x7fe89c14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 --2- 172.21.15.81:0/2632454894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89c1544e0 0x7fe89c14a160 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00e7f0 tx=0x7fe88c00ecb0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a182c640 1 -- 172.21.15.81:0/2632454894 reap_dead start 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a182c640 1 -- 172.21.15.81:0/2632454894 reap_dead start 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 shutdown_connections 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 >> 172.21.15.81:0/2632454894 conn(0x7fe89c0715f0 msgr2=0x7fe89c0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 shutdown_connections 2024-05-08T20:32:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.811+0000 7fe8a328f640 1 -- 172.21.15.81:0/2632454894 wait complete. 2024-05-08T20:32:03.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:03.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:32:03.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:32:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 Processor -- start 2024-05-08T20:32:03.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 -- start start 2024-05-08T20:32:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98d8150110 0x7f98d80aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c47c0 con 0x7f98d80a9970 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c6220 con 0x7f98d80c3510 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98dcc75640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80c6500 con 0x7f98d8150110 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98cffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98d80a9970 0x7f98d814fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36616/0 (socket says 172.21.15.81:36616) 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98cffff640 1 -- 172.21.15.81:0/2659415771 learned_addr learned my addr 172.21.15.81:0/2659415771 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/2659415771 >> v2:172.21.15.117:3300/0 conn(0x7f98d8150110 0x7f98d80aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630602466 0 0) 0x7f98d80c47c0 con 0x7f98d80a9970 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c4003530 con 0x7f98d80a9970 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908151708 0 0) 0x7f98c4003530 con 0x7f98d80a9970 2024-05-08T20:32:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 >> v2:172.21.15.117:3300/0 conn(0x7f98d8150110 msgr2=0x7f98d80aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 --2- 172.21.15.81:0/2659415771 >> v2:172.21.15.117:3300/0 conn(0x7f98d8150110 0x7f98d80aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 >> v1:172.21.15.117:6789/0 conn(0x7f98d80c3510 legacy=0x7f98d80c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80c4a10 con 0x7f98d80a9970 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f98c0001680 con 0x7f98d80a9970 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 >> v1:172.21.15.81:6789/0 conn(0x7f98d80a9970 legacy=0x7f98d814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4003980 0x7f98c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98c40047d0 0x7f98c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 0x7f98c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c6500 con 0x7f98c4005190 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c400c130 con 0x7f98c4003980 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c400c2f0 con 0x7f98c40047d0 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 0x7f98c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98cffff640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98c40047d0 0x7f98c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 -- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98c40047d0 msgr2=0x7f98c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98c40047d0 0x7f98c4004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 -- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4003980 msgr2=0x7f98c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d659c640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4003980 0x7f98c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4003980 0x7f98c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d6d9d640 1 -- 172.21.15.81:0/2659415771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4003530 con 0x7f98c4005190 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.955+0000 7f98d659c640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4003980 0x7f98c4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98d6d9d640 1 -- 172.21.15.81:0/2659415771 reap_dead start 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 0x7f98c400b990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009f90 tx=0x7f98d001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a041d54e034bef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00a5c90 con 0x7f98c4005190 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000f040 con 0x7f98c4005190 2024-05-08T20:32:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98d5d9b640 1 -- 172.21.15.81:0/2659415771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00ad440 con 0x7f98c4005190 2024-05-08T20:32:03.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 msgr2=0x7f98c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 0x7f98c400b990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009f90 tx=0x7f98d001cc80 comp rx=0 tx=0).stop 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- 172.21.15.81:0/2659415771 shutdown_connections 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 --2- 172.21.15.81:0/2659415771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c4005190 0x7f98c400b990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- 172.21.15.81:0/2659415771 >> 172.21.15.81:0/2659415771 conn(0x7f98d80c68c0 msgr2=0x7f98d80c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- 172.21.15.81:0/2659415771 shutdown_connections 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- 172.21.15.81:0/2659415771 wait complete. 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 Processor -- start 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 -- start start 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.959+0000 7f98dcc75640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4005190 0x7f98d8150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80bb8e0 0x7f98d81e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80bc360 con 0x7f98d81ebf80 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81ec4f0 con 0x7f98c4005190 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81e81a0 con 0x7f98d80bb8e0 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36620/0 (socket says 172.21.15.81:36620) 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 -- 172.21.15.81:0/3118500873 learned_addr learned my addr 172.21.15.81:0/3118500873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d659c640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4005190 0x7f98d8150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80bb8e0 0x7f98d81e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80bb8e0 msgr2=0x7f98d81e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80bb8e0 0x7f98d81e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4005190 msgr2=0x7f98d8150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c4005190 0x7f98d8150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8070290 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80bb8e0 0x7f98d81e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98cffff640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98c00058b0 tx=0x7f98c000e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000ec80 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c000ede0 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d8070570 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00145e0 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d8150ed0 con 0x7f98d81ebf80 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 0x7f98d814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8069550 con 0x7f98d814bd60 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d659c640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 0x7f98d814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d659c640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98d80c38f0 con 0x7f98d814bd60 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98c0014740 con 0x7f98d81ebf80 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98b8066690 0x7f98b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d659c640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 0x7f98d814c140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000f70 tx=0x7f98c800f9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f98c0086fa0 con 0x7f98d81ebf80 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98b8066690 0x7f98b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80052e0 con 0x7f98d814bd60 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.963+0000 7f98d6d9d640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98b8066690 0x7f98b8068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98c400c100 tx=0x7f98d00a7040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.967+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f98c8005440 con 0x7f98d814bd60 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.967+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 msgr2=0x7f98d814c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.967+0000 7f98ceffd640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 0x7f98d814c140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000f70 tx=0x7f98c800f9f0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.967+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 msgr2=0x7f98d814c140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.967+0000 7f98ceffd640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d814bd60 0x7f98d814c140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 0x7f98d80c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81e8000 con 0x7f98d80c11c0 2024-05-08T20:32:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98d659c640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 0x7f98d80c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98d659c640 1 -- 172.21.15.81:0/3118500873 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f98d8074950 con 0x7f98d80c11c0 2024-05-08T20:32:03.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98d659c640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 0x7f98d80c15d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000f70 tx=0x7f98c8001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:03.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8006ab0 con 0x7f98d80c11c0 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f98c8006c10 con 0x7f98d80c11c0 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 msgr2=0x7f98d80c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 0x7f98d80c15d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000f70 tx=0x7f98c8001130 comp rx=0 tx=0).stop 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 msgr2=0x7f98d80c15d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98ceffd640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d80c11c0 0x7f98d80c15d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:03.991 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98b8066690 msgr2=0x7f98b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98b8066690 0x7f98b8068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98c400c100 tx=0x7f98d00a7040 comp rx=0 tx=0).stop 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 msgr2=0x7f98d81e8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98c00058b0 tx=0x7f98c000e100 comp rx=0 tx=0).stop 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98d6d9d640 1 -- 172.21.15.81:0/3118500873 reap_dead start 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 shutdown_connections 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 --2- 172.21.15.81:0/3118500873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d81ebf80 0x7f98d81e8630 secure :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f98c00058b0 tx=0x7f98c000e100 comp rx=0 tx=0).stop 2024-05-08T20:32:03.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 >> 172.21.15.81:0/3118500873 conn(0x7f98d80c68c0 msgr2=0x7f98d81512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:03.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 shutdown_connections 2024-05-08T20:32:03.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:03.975+0000 7f98dcc75640 1 -- 172.21.15.81:0/3118500873 wait complete. 2024-05-08T20:32:03.997 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:03.997 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:32:03.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:32:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.123+0000 7fad8af21640 1 Processor -- start 2024-05-08T20:32:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.123+0000 7fad8af21640 1 -- start start 2024-05-08T20:32:04.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.123+0000 7fad8af21640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad840c2bc0 0x7fad840c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.123+0000 7fad8af21640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84155e10 con 0x7fad840c30d0 2024-05-08T20:32:04.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad8af21640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad84156080 con 0x7fad840a94b0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad8af21640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8406e790 con 0x7fad840c2bc0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad88cbd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad840c30d0 0x7fad840c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36618/0 (socket says 172.21.15.81:36618) 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad88cbd640 1 -- 172.21.15.81:0/1453663276 learned_addr learned my addr 172.21.15.81:0/1453663276 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad83fff640 1 --2- 172.21.15.81:0/1453663276 >> v2:172.21.15.117:3300/0 conn(0x7fad840c2bc0 0x7fad840c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582935256 0 0) 0x7fad84155e10 con 0x7fad840c30d0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad74003530 con 0x7fad840c30d0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225208565 0 0) 0x7fad74003530 con 0x7fad840c30d0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 >> v2:172.21.15.117:3300/0 conn(0x7fad840c2bc0 msgr2=0x7fad840c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 --2- 172.21.15.81:0/1453663276 >> v2:172.21.15.117:3300/0 conn(0x7fad840c2bc0 0x7fad840c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 >> v1:172.21.15.117:6789/0 conn(0x7fad840a94b0 legacy=0x7fad840a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84156360 con 0x7fad840c30d0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fad78001680 con 0x7fad840c30d0 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 >> v1:172.21.15.81:6789/0 conn(0x7fad840c30d0 legacy=0x7fad840c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad74003980 0x7fad74003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740047d0 0x7fad74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 0x7fad7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8406e790 con 0x7fad74005190 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7400c130 con 0x7fad740047d0 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7400c2f0 con 0x7fad74003980 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 0x7fad7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad88cbd640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad74003980 0x7fad74003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 -- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad74003980 msgr2=0x7fad74003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad74003980 0x7fad74003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 -- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740047d0 msgr2=0x7fad74004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740047d0 0x7fad74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 -- 172.21.15.81:0/1453663276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74003530 con 0x7fad74005190 2024-05-08T20:32:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 -- 172.21.15.81:0/1453663276 reap_dead start 2024-05-08T20:32:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.127+0000 7fad894be640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 0x7fad7400b990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad7c001e70 tx=0x7fad7c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb347090f2c58a21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003b80 con 0x7fad74005190 2024-05-08T20:32:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c003d20 con 0x7fad74005190 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad837fe640 1 -- 172.21.15.81:0/1453663276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c005310 con 0x7fad74005190 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 msgr2=0x7fad7400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 0x7fad7400b990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad7c001e70 tx=0x7fad7c01c780 comp rx=0 tx=0).stop 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/1453663276 shutdown_connections 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 --2- 172.21.15.81:0/1453663276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74005190 0x7fad7400b990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/1453663276 >> 172.21.15.81:0/1453663276 conn(0x7fad840c4cc0 msgr2=0x7fad840c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/1453663276 shutdown_connections 2024-05-08T20:32:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/1453663276 wait complete. 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 Processor -- start 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- start start 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 0x7fad841e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad84151680 0x7fad841481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84152870 con 0x7fad84152c90 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84151bf0 con 0x7fad74005190 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84151ed0 con 0x7fad84151680 2024-05-08T20:32:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36644/0 (socket says 172.21.15.81:36644) 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 -- 172.21.15.81:0/3106534829 learned_addr learned my addr 172.21.15.81:0/3106534829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad88cbd640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 0x7fad841e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad894be640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad84151680 0x7fad841481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 -- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad84151680 msgr2=0x7fad841481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad84151680 0x7fad841481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 -- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 msgr2=0x7fad841e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 0x7fad841e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 -- 172.21.15.81:0/3106534829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad841521b0 con 0x7fad84152c90 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad88cbd640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 0x7fad841e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad83fff640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad70009160 tx=0x7fad7000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7000ee40 con 0x7fad84152c90 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7000c940 con 0x7fad84152c90 2024-05-08T20:32:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7000ccd0 con 0x7fad84152c90 2024-05-08T20:32:04.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad84152490 con 0x7fad84152c90 2024-05-08T20:32:04.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.131+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad841474a0 con 0x7fad84152c90 2024-05-08T20:32:04.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84074950 con 0x7fad84152c90 2024-05-08T20:32:04.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad70013470 con 0x7fad84152c90 2024-05-08T20:32:04.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad817fa640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 0x7fad68068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:04.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fad700844b0 con 0x7fad84152c90 2024-05-08T20:32:04.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad88cbd640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 0x7fad68068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:04.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.135+0000 7fad88cbd640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 0x7fad68068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad780053a0 tx=0x7fad78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.139+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fad70051510 con 0x7fad84152c90 2024-05-08T20:32:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.395+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fad8414eee0 con 0x7fad84152c90 2024-05-08T20:32:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.395+0000 7fad817fa640 1 -- 172.21.15.81:0/3106534829 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fad70054b30 con 0x7fad84152c90 2024-05-08T20:32:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 msgr2=0x7fad68068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 0x7fad68068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fad780053a0 tx=0x7fad78009040 comp rx=0 tx=0).stop 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 msgr2=0x7fad84146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad70009160 tx=0x7fad7000ec50 comp rx=0 tx=0).stop 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 shutdown_connections 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad680666c0 0x7fad68068b80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad84151680 0x7fad841481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad84152c90 0x7fad84146f60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 --2- 172.21.15.81:0/3106534829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad74005190 0x7fad841e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:04.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 >> 172.21.15.81:0/3106534829 conn(0x7fad840c4cc0 msgr2=0x7fad8414df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:04.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 shutdown_connections 2024-05-08T20:32:04.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:04.399+0000 7fad8af21640 1 -- 172.21.15.81:0/3106534829 wait complete. 2024-05-08T20:32:04.420 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:32:14.422 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:32:14.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 Processor -- start 2024-05-08T20:32:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 -- start start 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f657c14c9e0 0x7f657c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f657c0c6020 0x7f657c152730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c156490 0x7f657c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0c35b0 con 0x7f657c0c6020 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c155d20 con 0x7f657c14c9e0 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f6581e58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c156000 con 0x7f657c156490 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.555+0000 7f657bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f657c0c6020 0x7f657c152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f657c0c6020 0x7f657c152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34508/0 (socket says 172.21.15.81:34508) 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 -- 172.21.15.81:0/1102707014 learned_addr learned my addr 172.21.15.81:0/1102707014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:14.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f6580e56640 1 --2- 172.21.15.81:0/1102707014 >> v2:172.21.15.117:3300/0 conn(0x7f657c14c9e0 0x7f657c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f6581657640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c156490 0x7f657c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 -- 172.21.15.81:0/1102707014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c156490 msgr2=0x7f657c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c156490 0x7f657c0c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 -- 172.21.15.81:0/1102707014 >> v2:172.21.15.117:3300/0 conn(0x7f657c14c9e0 msgr2=0x7f657c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 --2- 172.21.15.81:0/1102707014 >> v2:172.21.15.117:3300/0 conn(0x7f657c14c9e0 0x7f657c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 -- 172.21.15.81:0/1102707014 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c152fb0 con 0x7f657c0c6020 2024-05-08T20:32:14.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657bfff640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c0c6020 0x7f657c152730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f657c0721a0 tx=0x7f656801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f807518f7231dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:14.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657b7fe640 1 -- 172.21.15.81:0/1102707014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680ac640 con 0x7f657c0c6020 2024-05-08T20:32:14.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657b7fe640 1 -- 172.21.15.81:0/1102707014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680ac7a0 con 0x7f657c0c6020 2024-05-08T20:32:14.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.559+0000 7f657b7fe640 1 -- 172.21.15.81:0/1102707014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680acb70 con 0x7f657c0c6020 2024-05-08T20:32:14.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 -- 172.21.15.81:0/1102707014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c0c6020 msgr2=0x7f657c152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:14.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c0c6020 0x7f657c152730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f657c0721a0 tx=0x7f656801c510 comp rx=0 tx=0).stop 2024-05-08T20:32:14.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 -- 172.21.15.81:0/1102707014 shutdown_connections 2024-05-08T20:32:14.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c156490 0x7f657c0c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 --2- 172.21.15.81:0/1102707014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c0c6020 0x7f657c152730 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 --2- 172.21.15.81:0/1102707014 >> v2:172.21.15.117:3300/0 conn(0x7f657c14c9e0 0x7f657c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.563+0000 7f6581e58640 1 -- 172.21.15.81:0/1102707014 >> 172.21.15.81:0/1102707014 conn(0x7f657c066080 msgr2=0x7f657c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:14.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- 172.21.15.81:0/1102707014 shutdown_connections 2024-05-08T20:32:14.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- 172.21.15.81:0/1102707014 wait complete. 2024-05-08T20:32:14.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 Processor -- start 2024-05-08T20:32:14.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- start start 2024-05-08T20:32:14.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f657c0c6020 0x7f657c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c1f1bb0 0x7f657c1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c14fc10 con 0x7f657c156490 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c14ed40 con 0x7f657c0c6020 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c14f320 con 0x7f657c1f1bb0 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34516/0 (socket says 172.21.15.81:34516) 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 -- 172.21.15.81:0/142938837 learned_addr learned my addr 172.21.15.81:0/142938837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6580e56640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f657c0c6020 0x7f657c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581657640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c1f1bb0 0x7f657c1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 -- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c1f1bb0 msgr2=0x7f657c1f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c1f1bb0 0x7f657c1f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 -- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f657c0c6020 msgr2=0x7f657c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f657c0c6020 0x7f657c14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 -- 172.21.15.81:0/142938837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680094d0 con 0x7f657c156490 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f657bfff640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f656801cdb0 tx=0x7f656801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680b7830 con 0x7f657c156490 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680b7990 con 0x7f657c156490 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680b7d40 con 0x7f657c156490 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.567+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c14f5c0 con 0x7f657c156490 2024-05-08T20:32:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c155590 con 0x7f657c156490 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c14fd80 con 0x7f657c156490 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65680b3040 con 0x7f657c156490 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f65797fa640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 0x7f6560068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f656811ea50 con 0x7f657c156490 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f6580e56640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 0x7f6560068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.571+0000 7f6580e56640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 0x7f6560068b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f657c0c2520 tx=0x7f6570009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.575+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f65680ebab0 con 0x7f657c156490 2024-05-08T20:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.851+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f657c0670c0 con 0x7f657c156490 2024-05-08T20:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f65797fa640 1 -- 172.21.15.81:0/142938837 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f65680b1620 con 0x7f657c156490 2024-05-08T20:32:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 msgr2=0x7f6560068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 0x7f6560068b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f657c0c2520 tx=0x7f6570009190 comp rx=0 tx=0).stop 2024-05-08T20:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 msgr2=0x7f657c155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f656801cdb0 tx=0x7f656801ad50 comp rx=0 tx=0).stop 2024-05-08T20:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 shutdown_connections 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f65600666c0 0x7f6560068b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f657c1f1bb0 0x7f657c1f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c156490 0x7f657c155050 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 --2- 172.21.15.81:0/142938837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f657c0c6020 0x7f657c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 >> 172.21.15.81:0/142938837 conn(0x7f657c066080 msgr2=0x7f657c06ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 shutdown_connections 2024-05-08T20:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:14.855+0000 7f6581e58640 1 -- 172.21.15.81:0/142938837 wait complete. 2024-05-08T20:32:14.878 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:32:14.878 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:32:14.878 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:32:14.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:32:15.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 Processor -- start 2024-05-08T20:32:15.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 -- start start 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc14c5a0 0x7f60bc0c4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60bc072270 0x7f60bc0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc06f3a0 con 0x7f60bc06da40 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc0c2bc0 con 0x7f60bc072270 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.003+0000 7f60c143d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc06d560 con 0x7f60bc14c5a0 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60bb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f60bc06da40 0x7f60bc155c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53696/0 (socket says 172.21.15.81:53696) 2024-05-08T20:32:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60bb7fe640 1 -- 172.21.15.81:0/897262279 learned_addr learned my addr 172.21.15.81:0/897262279 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 --2- 172.21.15.81:0/897262279 >> v2:172.21.15.117:3300/0 conn(0x7f60bc072270 0x7f60bc0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60baffd640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc14c5a0 0x7f60bc0c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997011226 0 0) 0x7f60bc06f3a0 con 0x7f60bc06da40 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a8003530 con 0x7f60bc06da40 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 -- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc14c5a0 msgr2=0x7f60bc0c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc14c5a0 0x7f60bc0c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 -- 172.21.15.81:0/897262279 >> v1:172.21.15.81:6789/0 conn(0x7f60bc06da40 legacy=0x7f60bc155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1448776059 0 0) 0x7f60a8003530 con 0x7f60bc06da40 2024-05-08T20:32:15.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 -- 172.21.15.81:0/897262279 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc1569a0 con 0x7f60bc072270 2024-05-08T20:32:15.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.007+0000 7f60b3fff640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc0c46b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f60a40097c0 tx=0x7f60a401c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bbc7b6d57a71108 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4001a00 con 0x7f60bc072270 2024-05-08T20:32:15.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a40a7050 con 0x7f60bc072270 2024-05-08T20:32:15.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60ba7fc640 1 -- 172.21.15.81:0/897262279 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a40ab600 con 0x7f60bc072270 2024-05-08T20:32:15.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 msgr2=0x7f60bc0c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc0c46b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f60a40097c0 tx=0x7f60a401c270 comp rx=0 tx=0).stop 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/897262279 shutdown_connections 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc0c46b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- 172.21.15.81:0/897262279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc14c5a0 0x7f60bc0c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/897262279 >> 172.21.15.81:0/897262279 conn(0x7f60bc0c4cc0 msgr2=0x7f60bc0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/897262279 shutdown_connections 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/897262279 wait complete. 2024-05-08T20:32:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 Processor -- start 2024-05-08T20:32:15.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- start start 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc06da40 0x7f60bc151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 0x7f60bc1eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc152780 con 0x7f60bc14c5a0 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc142610 con 0x7f60bc072270 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc142e20 con 0x7f60bc06da40 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 0x7f60bc1eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 0x7f60bc1eefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34520/0 (socket says 172.21.15.81:34520) 2024-05-08T20:32:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 learned_addr learned my addr 172.21.15.81:0/4045027835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60baffd640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc06da40 0x7f60bc151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60b3fff640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc06da40 msgr2=0x7f60bc151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60bc06da40 0x7f60bc151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 msgr2=0x7f60bc150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60bc072270 0x7f60bc150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009420 con 0x7f60bc14c5a0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60bb7fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 0x7f60bc1eefc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60b400cc00 tx=0x7f60b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400ce10 con 0x7f60bc14c5a0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4012400 con 0x7f60bc14c5a0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b40127b0 con 0x7f60bc14c5a0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.011+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc1520a0 con 0x7f60bc14c5a0 2024-05-08T20:32:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc142860 con 0x7f60bc14c5a0 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60c143d640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 0x7f60bc1ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc073e30 con 0x7f60bc143480 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60baffd640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 0x7f60bc1ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60baffd640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60bc15f7f0 con 0x7f60bc143480 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60baffd640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 0x7f60bc1ef500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac004230 con 0x7f60bc143480 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60b4012910 con 0x7f60bc14c5a0 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f609c066730 0x7f609c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f60b4084b80 con 0x7f60bc14c5a0 2024-05-08T20:32:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b3fff640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f609c066730 0x7f609c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f60ac004390 con 0x7f60bc143480 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 msgr2=0x7f60bc1ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 0x7f60bc1ef500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0119d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 msgr2=0x7f60bc1ef500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b37fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc143480 0x7f60bc1ef500 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0119d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.015+0000 7f60b3fff640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f609c066730 0x7f609c068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ad000 tx=0x7f60a40a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 0x7f60bc13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc06eb70 con 0x7f60bc13fd00 2024-05-08T20:32:15.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60baffd640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 0x7f60bc13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60baffd640 1 -- 172.21.15.81:0/4045027835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f60bc0748b0 con 0x7f60bc13fd00 2024-05-08T20:32:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60baffd640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 0x7f60bc13da50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac024070 con 0x7f60bc13fd00 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f60ac003620 con 0x7f60bc13fd00 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 msgr2=0x7f60bc13da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 0x7f60bc13da50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0046d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 msgr2=0x7f60bc13da50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60b37fe640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc13fd00 0x7f60bc13da50 secure :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011510 tx=0x7f60ac0046d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:32:15.032 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.034 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.036 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:15.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.041 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:15.044 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f609c066730 msgr2=0x7f609c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f609c066730 0x7f609c068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ad000 tx=0x7f60a40a6000 comp rx=0 tx=0).stop 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 msgr2=0x7f60bc1eefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 --2- 172.21.15.81:0/4045027835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc14c5a0 0x7f60bc1eefc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60b400cc00 tx=0x7f60b400a430 comp rx=0 tx=0).stop 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 reap_dead start 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60bb7fe640 1 -- 172.21.15.81:0/4045027835 reap_dead start 2024-05-08T20:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 shutdown_connections 2024-05-08T20:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 >> 172.21.15.81:0/4045027835 conn(0x7f60bc0c4cc0 msgr2=0x7f60bc145ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 shutdown_connections 2024-05-08T20:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.027+0000 7f60c143d640 1 -- 172.21.15.81:0/4045027835 wait complete. 2024-05-08T20:32:15.050 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:15.050 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:32:15.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:32:15.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 Processor -- start 2024-05-08T20:32:15.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 -- start start 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4984151f00 0x7f49841588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49840ca000 0x7f49840ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4984158e20 con 0x7f4984154cf0 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498406bb20 con 0x7f4984151f00 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498c79e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49841548e0 con 0x7f49840ca000 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4984151f00 0x7f49841588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4984151f00 0x7f49841588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34542/0 (socket says 172.21.15.81:34542) 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 -- 172.21.15.81:0/1109912153 learned_addr learned my addr 172.21.15.81:0/1109912153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f4989d39640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4984154cf0 0x7f4984155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53700/0 (socket says 172.21.15.81:53700) 2024-05-08T20:32:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498ad3b640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49840ca000 0x7f49840ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 -- 172.21.15.81:0/1109912153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49840ca000 msgr2=0x7f49840ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49840ca000 0x7f49840ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 -- 172.21.15.81:0/1109912153 >> v1:172.21.15.81:6789/0 conn(0x7f4984154cf0 legacy=0x7f4984155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.171+0000 7f498a53a640 1 -- 172.21.15.81:0/1109912153 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984155860 con 0x7f4984151f00 2024-05-08T20:32:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498a53a640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4984151f00 0x7f49841588e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4980009870 tx=0x7f498001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0f44dfcaaaf773 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f4989538640 1 -- 172.21.15.81:0/1109912153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800ab660 con 0x7f4984151f00 2024-05-08T20:32:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f4989538640 1 -- 172.21.15.81:0/1109912153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800ab7c0 con 0x7f4984151f00 2024-05-08T20:32:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f4989538640 1 -- 172.21.15.81:0/1109912153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800abb50 con 0x7f4984151f00 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- 172.21.15.81:0/1109912153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4984151f00 msgr2=0x7f49841588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4984151f00 0x7f49841588e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4980009870 tx=0x7f498001c440 comp rx=0 tx=0).stop 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- 172.21.15.81:0/1109912153 shutdown_connections 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49840ca000 0x7f49840ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- 172.21.15.81:0/1109912153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4984151f00 0x7f49841588e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- 172.21.15.81:0/1109912153 >> 172.21.15.81:0/1109912153 conn(0x7f49840715f0 msgr2=0x7f4984071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- 172.21.15.81:0/1109912153 shutdown_connections 2024-05-08T20:32:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- 172.21.15.81:0/1109912153 wait complete. 2024-05-08T20:32:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 Processor -- start 2024-05-08T20:32:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- start start 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 0x7f49840ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984151f00 0x7f4984156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4984154cf0 0x7f4984156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840adfb0 con 0x7f49840ca000 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ae290 con 0x7f4984151f00 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.175+0000 7f498c79e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ae570 con 0x7f4984154cf0 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 0x7f49840ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 0x7f49840ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34552/0 (socket says 172.21.15.81:34552) 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 -- 172.21.15.81:0/1522419991 learned_addr learned my addr 172.21.15.81:0/1522419991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f4989d39640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984151f00 0x7f4984156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498ad3b640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4984154cf0 0x7f4984156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4984154cf0 msgr2=0x7f4984156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4984154cf0 0x7f4984156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984151f00 msgr2=0x7f4984156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984151f00 0x7f4984156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49800094d0 con 0x7f49840ca000 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498ad3b640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4984154cf0 0x7f4984156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498a53a640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 0x7f49840ab0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f49800ad040 tx=0x7f498001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800b4800 con 0x7f49840ca000 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800b4980 con 0x7f49840ca000 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49840ae850 con 0x7f49840ca000 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49800b4d30 con 0x7f49840ca000 2024-05-08T20:32:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49840aee10 con 0x7f49840ca000 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498c79e640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 0x7f49841f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4984069600 con 0x7f4984156f90 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f4989d39640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 0x7f49841f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f4989d39640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f498406ae00 con 0x7f4984156f90 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49800a9070 con 0x7f49840ca000 2024-05-08T20:32:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f4989d39640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 0x7f49841f0910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4974000f70 tx=0x7f49740018c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49680666e0 0x7f4968068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f498ad3b640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49680666e0 0x7f4968068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f498011edc0 con 0x7f49840ca000 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.179+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974010510 con 0x7f4984156f90 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f498ad3b640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49680666e0 0x7f4968068ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f497c009ed0 tx=0x7f497c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4974010670 con 0x7f4984156f90 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 msgr2=0x7f49841f0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f497affd640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 0x7f49841f0910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4974000f70 tx=0x7f49740018c0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 msgr2=0x7f49841f0910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.183+0000 7f497affd640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984156f90 0x7f49841f0910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 0x7f49841f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ae9e0 con 0x7f4984158880 2024-05-08T20:32:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f4989d39640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 0x7f49841f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f4989d39640 1 -- 172.21.15.81:0/1522419991 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f498406a140 con 0x7f4984158880 2024-05-08T20:32:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f4989d39640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 0x7f49841f0e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4974000f70 tx=0x7f4974001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974022070 con 0x7f4984158880 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7f497401dbf0 con 0x7f4984158880 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 msgr2=0x7f49841f0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 0x7f49841f0e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4974000f70 tx=0x7f4974001130 comp rx=0 tx=0).stop 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 msgr2=0x7f49841f0e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f497affd640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4984158880 0x7f49841f0e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:15.196 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.200 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.205 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.206 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.207 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:15.208 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49680666e0 msgr2=0x7f4968068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f49680666e0 0x7f4968068ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f497c009ed0 tx=0x7f497c00b040 comp rx=0 tx=0).stop 2024-05-08T20:32:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 msgr2=0x7f49840ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 --2- 172.21.15.81:0/1522419991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49840ca000 0x7f49840ab0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f49800ad040 tx=0x7f498001ac80 comp rx=0 tx=0).stop 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498ad3b640 1 -- 172.21.15.81:0/1522419991 reap_dead start 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498ad3b640 1 -- 172.21.15.81:0/1522419991 reap_dead start 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 shutdown_connections 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 >> 172.21.15.81:0/1522419991 conn(0x7f49840715f0 msgr2=0x7f49840719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 shutdown_connections 2024-05-08T20:32:15.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.191+0000 7f498c79e640 1 -- 172.21.15.81:0/1522419991 wait complete. 2024-05-08T20:32:15.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:15.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:32:15.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:32:15.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 Processor -- start 2024-05-08T20:32:15.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 -- start start 2024-05-08T20:32:15.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f800014fe70 0x7f800006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800006d7d0 0x7f800006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8000152ab0 con 0x7f8000155e90 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80001528a0 con 0x7f800014fe70 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8008788640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000152d90 con 0x7f800006d7d0 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006524640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f800014fe70 0x7f800006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8005d23640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8000155e90 0x7f8000069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53710/0 (socket says 172.21.15.81:53710) 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8005d23640 1 -- 172.21.15.81:0/1408463573 learned_addr learned my addr 172.21.15.81:0/1408463573 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006d25640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800006d7d0 0x7f800006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006524640 1 -- 172.21.15.81:0/1408463573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800006d7d0 msgr2=0x7f800006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006524640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800006d7d0 0x7f800006a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006524640 1 -- 172.21.15.81:0/1408463573 >> v1:172.21.15.81:6789/0 conn(0x7f8000155e90 legacy=0x7f8000069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8006524640 1 -- 172.21.15.81:0/1408463573 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000153070 con 0x7f800014fe70 2024-05-08T20:32:15.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.335+0000 7f8005522640 1 -- 172.21.15.81:0/1408463573 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902783763 0 0) 0x7f8000152ab0 con 0x7f8000155e90 2024-05-08T20:32:15.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800014fe70 0x7f800006d290 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0097c0 tx=0x7f7ffc01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75500e48e0753cae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8005522640 1 -- 172.21.15.81:0/1408463573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc004230 con 0x7f800014fe70 2024-05-08T20:32:15.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8005522640 1 -- 172.21.15.81:0/1408463573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0a7050 con 0x7f800014fe70 2024-05-08T20:32:15.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8005522640 1 -- 172.21.15.81:0/1408463573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc003620 con 0x7f800014fe70 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- 172.21.15.81:0/1408463573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800014fe70 msgr2=0x7f800006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800014fe70 0x7f800006d290 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0097c0 tx=0x7f7ffc01c350 comp rx=0 tx=0).stop 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- 172.21.15.81:0/1408463573 shutdown_connections 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800006d7d0 0x7f800006a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- 172.21.15.81:0/1408463573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800014fe70 0x7f800006d290 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- 172.21.15.81:0/1408463573 >> 172.21.15.81:0/1408463573 conn(0x7f80000c71b0 msgr2=0x7f80000c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- 172.21.15.81:0/1408463573 shutdown_connections 2024-05-08T20:32:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- 172.21.15.81:0/1408463573 wait complete. 2024-05-08T20:32:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 Processor -- start 2024-05-08T20:32:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- start start 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 0x7f80000c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f800014fe70 0x7f800014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8000155e90 0x7f80001f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c6100 con 0x7f800006d7d0 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c62e0 con 0x7f800014fe70 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8008788640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80001ed350 con 0x7f8000155e90 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 0x7f80000c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 0x7f80000c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34564/0 (socket says 172.21.15.81:34564) 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 -- 172.21.15.81:0/163605630 learned_addr learned my addr 172.21.15.81:0/163605630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8005d23640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f800014fe70 0x7f800014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006d25640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8000155e90 0x7f80001f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8000155e90 msgr2=0x7f80001f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8000155e90 0x7f80001f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f800014fe70 msgr2=0x7f800014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f800014fe70 0x7f800014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009420 con 0x7f800006d7d0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006d25640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8000155e90 0x7f80001f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.339+0000 7f8006524640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 0x7f80000c5bc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc019f80 tx=0x7f7ffc0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc003c70 con 0x7f800006d7d0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc003df0 con 0x7f800006d7d0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80001ed630 con 0x7f800006d7d0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0ab680 con 0x7f800006d7d0 2024-05-08T20:32:15.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800014a530 con 0x7f800006d7d0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8008788640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 0x7f80001f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000069550 con 0x7f80000c5700 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8005d23640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 0x7f80001f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ffc0b2040 con 0x7f800006d7d0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8005d23640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8000150250 con 0x7f80000c5700 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8005d23640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 0x7f80001f0ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000f70 tx=0x7f7ff0001980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fe4066690 0x7f7fe4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8006d25640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fe4066690 0x7f7fe4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7ffc11e630 con 0x7f800006d7d0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0012590 con 0x7f80000c5700 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f8006d25640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fe4066690 0x7f7fe4068b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f800015c6d0 tx=0x7f7ff800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7ff00126f0 con 0x7f80000c5700 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 msgr2=0x7f80001f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 0x7f80001f0ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000f70 tx=0x7f7ff0001980 comp rx=0 tx=0).stop 2024-05-08T20:32:15.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 msgr2=0x7f80001f0ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.343+0000 7f7ff6ffd640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80000c5700 0x7f80001f0ad0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000f70 tx=0x7f7ff0001980 comp rx=0 tx=0).stop 2024-05-08T20:32:15.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.351+0000 7f8008788640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 0x7f800014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.351+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80001ed4e0 con 0x7f800014e400 2024-05-08T20:32:15.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.351+0000 7f8005d23640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 0x7f800014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8005d23640 1 -- 172.21.15.81:0/163605630 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f80000675e0 con 0x7f800014e400 2024-05-08T20:32:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8005d23640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 0x7f800014e810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0017000 tx=0x7f7ff0001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff001ed90 con 0x7f800014e400 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f7ff0028470 con 0x7f800014e400 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 msgr2=0x7f800014e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 0x7f800014e810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0017000 tx=0x7f7ff0001090 comp rx=0 tx=0).stop 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 msgr2=0x7f800014e810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f7ff6ffd640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f800014e400 0x7f800014e810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:15.359 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 42, 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.361 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.362 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:15.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.365 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:15.367 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.368 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:15.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:15.370 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fe4066690 msgr2=0x7f7fe4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fe4066690 0x7f7fe4068b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f800015c6d0 tx=0x7f7ff800b040 comp rx=0 tx=0).stop 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 msgr2=0x7f80000c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 --2- 172.21.15.81:0/163605630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f800006d7d0 0x7f80000c5bc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc019f80 tx=0x7f7ffc0190f0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8006d25640 1 -- 172.21.15.81:0/163605630 reap_dead start 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8006d25640 1 -- 172.21.15.81:0/163605630 reap_dead start 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 shutdown_connections 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 >> 172.21.15.81:0/163605630 conn(0x7f80000c71b0 msgr2=0x7f80000ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 shutdown_connections 2024-05-08T20:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.355+0000 7f8008788640 1 -- 172.21.15.81:0/163605630 wait complete. 2024-05-08T20:32:15.375 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:15.375 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:32:15.376 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:32:15.376 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:32:15.376 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:32:15.376 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:32:15.376 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:32:15.393 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:32:15.393 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:32:15.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 Processor -- start 2024-05-08T20:32:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 -- start start 2024-05-08T20:32:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47cc14fe70 0x7f47cc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc152ab0 con 0x7f47cc06d7d0 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc152d90 con 0x7f47cc155e90 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d3643640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc1528a0 con 0x7f47cc14fe70 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d0bde640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f47cc155e90 legacy=0x7f47cc069fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47cc14fe70 0x7f47cc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47cc14fe70 0x7f47cc06d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34578/0 (socket says 172.21.15.81:34578) 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 -- 172.21.15.81:0/163527207 learned_addr learned my addr 172.21.15.81:0/163527207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d1be0640 1 --1- 172.21.15.81:0/163527207 >> v1:172.21.15.81:6789/0 conn(0x7f47cc06d7d0 0x7f47cc06a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53726/0 (socket says 172.21.15.81:53726) 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 -- 172.21.15.81:0/163527207 >> v1:172.21.15.117:6789/0 conn(0x7f47cc155e90 legacy=0x7f47cc069fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 -- 172.21.15.81:0/163527207 >> v1:172.21.15.81:6789/0 conn(0x7f47cc06d7d0 legacy=0x7f47cc06a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47c3fff640 1 -- 172.21.15.81:0/163527207 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709519476 0 0) 0x7f47cc152ab0 con 0x7f47cc06d7d0 2024-05-08T20:32:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 -- 172.21.15.81:0/163527207 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc153070 con 0x7f47cc14fe70 2024-05-08T20:32:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.499+0000 7f47d13df640 1 --2- 172.21.15.81:0/163527207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc06d290 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95962df216ee82ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c3fff640 1 -- 172.21.15.81:0/163527207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ac630 con 0x7f47cc14fe70 2024-05-08T20:32:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c3fff640 1 -- 172.21.15.81:0/163527207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80ac790 con 0x7f47cc14fe70 2024-05-08T20:32:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c3fff640 1 -- 172.21.15.81:0/163527207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80acb20 con 0x7f47cc14fe70 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/163527207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 msgr2=0x7f47cc06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 --2- 172.21.15.81:0/163527207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc06d290 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/163527207 shutdown_connections 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 --2- 172.21.15.81:0/163527207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc06d290 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/163527207 >> 172.21.15.81:0/163527207 conn(0x7f47cc0c71b0 msgr2=0x7f47cc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/163527207 shutdown_connections 2024-05-08T20:32:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/163527207 wait complete. 2024-05-08T20:32:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 Processor -- start 2024-05-08T20:32:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- start start 2024-05-08T20:32:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 0x7f47cc14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47cc155e90 0x7f47cc146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc071580 con 0x7f47cc14fe70 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc072090 con 0x7f47cc06d7d0 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc14b290 con 0x7f47cc155e90 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d13df640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 msgr2=0x7f47cc14ad50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d13df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 0x7f47cc14ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34592/0 (socket says 172.21.15.81:34592) 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 -- 172.21.15.81:0/857397799 learned_addr learned my addr 172.21.15.81:0/857397799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d1be0640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47cc155e90 0x7f47cc146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 -- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47cc155e90 msgr2=0x7f47cc146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47cc155e90 0x7f47cc146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 -- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 msgr2=0x7f47cc14ad50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 0x7f47cc14ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 -- 172.21.15.81:0/857397799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80094d0 con 0x7f47cc14fe70 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d0bde640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b510 tx=0x7f47bc00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc003d80 con 0x7f47cc14fe70 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc005070 con 0x7f47cc14fe70 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc148440 con 0x7f47cc14fe70 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc005420 con 0x7f47cc14fe70 2024-05-08T20:32:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.503+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc071a40 con 0x7f47cc14fe70 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0675e0 con 0x7f47cc14fe70 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f47bc005580 con 0x7f47cc14fe70 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47c1ffb640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 0x7f47b0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f47bc0843a0 con 0x7f47cc14fe70 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47d13df640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 0x7f47b0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.507+0000 7f47d13df640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 0x7f47b0068b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae000 tx=0x7f47c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:15.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.511+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f47bc051400 con 0x7f47cc14fe70 2024-05-08T20:32:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.735+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f47cc074950 con 0x7f47cc14fe70 2024-05-08T20:32:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.735+0000 7f47c1ffb640 1 -- 172.21.15.81:0/857397799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f47bc054a20 con 0x7f47cc14fe70 2024-05-08T20:32:15.742 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:15.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 msgr2=0x7f47b0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 0x7f47b0068b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae000 tx=0x7f47c8008040 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 msgr2=0x7f47cc0c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b510 tx=0x7f47bc00b9d0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 shutdown_connections 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f47b0066640 0x7f47b0068b00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47cc155e90 0x7f47cc146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47cc14fe70 0x7f47cc0c6050 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 --2- 172.21.15.81:0/857397799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47cc06d7d0 0x7f47cc14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 >> 172.21.15.81:0/857397799 conn(0x7f47cc0c71b0 msgr2=0x7f47cc0aba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:15.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 shutdown_connections 2024-05-08T20:32:15.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:15.739+0000 7f47d3643640 1 -- 172.21.15.81:0/857397799 wait complete. 2024-05-08T20:32:18.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 Processor -- start 2024-05-08T20:32:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 -- start start 2024-05-08T20:32:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9d4152c60 0x7ff9d40ab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c65b0 con 0x7ff9d4152800 2024-05-08T20:32:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d4156300 con 0x7ff9d414cb10 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9da40f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d4153810 con 0x7ff9d4152c60 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d3fff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7ff9d414cb10 legacy=0x7ff9d4156790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9cbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9d4152800 0x7ff9d40c31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40092/0 (socket says 172.21.15.81:40092) 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d89ac640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7ff9d4152c60 msgr2=0x7ff9d40ab970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9cbfff640 1 -- 172.21.15.81:0/2877872361 learned_addr learned my addr 172.21.15.81:0/2877872361 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d89ac640 1 --2- 172.21.15.81:0/2877872361 >> v2:172.21.15.117:3300/0 conn(0x7ff9d4152c60 0x7ff9d40ab970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330195203 0 0) 0x7ff9bc001120 con 0x7ff9d4152800 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c0003530 con 0x7ff9d4152800 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128194589 0 0) 0x7ff9c0003530 con 0x7ff9d4152800 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 >> v2:172.21.15.117:3300/0 conn(0x7ff9d4152c60 msgr2=0x7ff9d40ab970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 --2- 172.21.15.81:0/2877872361 >> v2:172.21.15.117:3300/0 conn(0x7ff9d4152c60 0x7ff9d40ab970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 >> v1:172.21.15.117:6789/0 conn(0x7ff9d414cb10 legacy=0x7ff9d4156790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4153250 con 0x7ff9d4152800 2024-05-08T20:32:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff9bc001810 con 0x7ff9d4152800 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 >> v1:172.21.15.81:6789/0 conn(0x7ff9d4152800 legacy=0x7ff9d40c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c0003980 0x7ff9c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c00051e0 0x7ff9c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4153810 con 0x7ff9c00047d0 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000c110 con 0x7ff9c00051e0 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.879+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c000c2d0 con 0x7ff9c0003980 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d89ac640 1 -- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c00051e0 msgr2=0x7ff9c000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d89ac640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c00051e0 0x7ff9c000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d3fff640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c0003980 0x7ff9c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 -- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c0003980 msgr2=0x7ff9c0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c0003980 0x7ff9c0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 -- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c00051e0 msgr2=0x7ff9c000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c00051e0 0x7ff9c000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 -- 172.21.15.81:0/2877872361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0003530 con 0x7ff9c00047d0 2024-05-08T20:32:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d89ac640 1 -- 172.21.15.81:0/2877872361 reap_dead start 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9c0004c50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c190 tx=0x7ff9bc01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d5449093bf2c05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc005ae0 con 0x7ff9c00047d0 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0ab070 con 0x7ff9c00047d0 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9d37fe640 1 -- 172.21.15.81:0/2877872361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc005e80 con 0x7ff9c00047d0 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 -- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 msgr2=0x7ff9c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9c0004c50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c190 tx=0x7ff9bc01f350 comp rx=0 tx=0).stop 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 -- 172.21.15.81:0/2877872361 shutdown_connections 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 --2- 172.21.15.81:0/2877872361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9c0004c50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 -- 172.21.15.81:0/2877872361 >> 172.21.15.81:0/2877872361 conn(0x7ff9d40c68c0 msgr2=0x7ff9d40c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 -- 172.21.15.81:0/2877872361 shutdown_connections 2024-05-08T20:32:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.883+0000 7ff9da40f640 1 -- 172.21.15.81:0/2877872361 wait complete. 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 Processor -- start 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- start start 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 0x7ff9d41553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 0x7ff9d4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d414a490 con 0x7ff9c00047d0 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41db6b0 con 0x7ff9d4072340 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d41db990 con 0x7ff9d4149aa0 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9cbfff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 msgr2=0x7ff9d41553b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9cbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 0x7ff9d41553b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33438/0 (socket says 172.21.15.81:33438) 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 -- 172.21.15.81:0/29061373 learned_addr learned my addr 172.21.15.81:0/29061373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d89ac640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 0x7ff9d4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 -- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 msgr2=0x7ff9d4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 0x7ff9d4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 -- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 msgr2=0x7ff9d41553b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 0x7ff9d41553b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 -- 172.21.15.81:0/29061373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d41dbc70 con 0x7ff9c00047d0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d89ac640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 0x7ff9d4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d3fff640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400d7d0 tx=0x7ff9c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40039c0 con 0x7ff9c00047d0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c4003b20 con 0x7ff9c00047d0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d41dbf50 con 0x7ff9c00047d0 2024-05-08T20:32:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4003cd0 con 0x7ff9c00047d0 2024-05-08T20:32:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d41dc510 con 0x7ff9c00047d0 2024-05-08T20:32:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.887+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d40c57d0 con 0x7ff9c00047d0 2024-05-08T20:32:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.891+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9c40096a0 con 0x7ff9c00047d0 2024-05-08T20:32:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.891+0000 7ff9d17fa640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 0x7ff9b4068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.891+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff9c40841f0 con 0x7ff9c00047d0 2024-05-08T20:32:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.891+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 0x7ff9b4068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.891+0000 7ff9cbfff640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 0x7ff9b4068b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0ae000 tx=0x7ff9bc001bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:18.895+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff9c4051250 con 0x7ff9c00047d0 2024-05-08T20:32:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff9d40c0fa0 con 0x7ff9c00047d0 2024-05-08T20:32:19.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9d17fa640 1 -- 172.21.15.81:0/29061373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7ff9c4054870 con 0x7ff9c00047d0 2024-05-08T20:32:19.175 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 msgr2=0x7ff9b4068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 0x7ff9b4068b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0ae000 tx=0x7ff9bc001bd0 comp rx=0 tx=0).stop 2024-05-08T20:32:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 msgr2=0x7ff9d41e83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400d7d0 tx=0x7ff9c400dc90 comp rx=0 tx=0).stop 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 shutdown_connections 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9b4066670 0x7ff9b4068b30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9d4149aa0 0x7ff9d4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9d4072340 0x7ff9d41553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 --2- 172.21.15.81:0/29061373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c00047d0 0x7ff9d41e83b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 >> 172.21.15.81:0/29061373 conn(0x7ff9d40c68c0 msgr2=0x7ff9d414bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 shutdown_connections 2024-05-08T20:32:19.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:19.171+0000 7ff9da40f640 1 -- 172.21.15.81:0/29061373 wait complete. 2024-05-08T20:32:19.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:32:19.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:32:22.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 Processor -- start 2024-05-08T20:32:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 -- start start 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 0x7f57fc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc158080 con 0x7f57fc06d7d0 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc06ab70 con 0x7f57fc0c2570 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f58013d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc154b10 con 0x7f57fc152340 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57fb7fe640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f57fc06d7d0 legacy=0x7f57fc1554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57f3fff640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 msgr2=0x7f57fc154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:22.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57f3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 0x7f57fc154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57faffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57faffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:52326/0 (socket says 172.21.15.81:52326) 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.331+0000 7f57faffd640 1 -- 172.21.15.81:0/3699939305 learned_addr learned my addr 172.21.15.81:0/3699939305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57faffd640 1 -- 172.21.15.81:0/3699939305 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 msgr2=0x7f57fc154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57faffd640 1 --2- 172.21.15.81:0/3699939305 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 0x7f57fc154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57faffd640 1 -- 172.21.15.81:0/3699939305 >> v1:172.21.15.117:6789/0 conn(0x7f57fc06d7d0 legacy=0x7f57fc1554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57faffd640 1 -- 172.21.15.81:0/3699939305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc06a890 con 0x7f57fc152340 2024-05-08T20:32:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57faffd640 1 --2- 172.21.15.81:0/3699939305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009870 tx=0x7f57ec01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4147de16a5a4220 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57fa7fc640 1 -- 172.21.15.81:0/3699939305 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0ab640 con 0x7f57fc152340 2024-05-08T20:32:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57fa7fc640 1 -- 172.21.15.81:0/3699939305 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec0a7070 con 0x7f57fc152340 2024-05-08T20:32:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f57fa7fc640 1 -- 172.21.15.81:0/3699939305 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0ab9c0 con 0x7f57fc152340 2024-05-08T20:32:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 -- 172.21.15.81:0/3699939305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 msgr2=0x7f57fc06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 --2- 172.21.15.81:0/3699939305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009870 tx=0x7f57ec01c480 comp rx=0 tx=0).stop 2024-05-08T20:32:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 -- 172.21.15.81:0/3699939305 shutdown_connections 2024-05-08T20:32:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 --2- 172.21.15.81:0/3699939305 >> v2:172.21.15.117:3300/0 conn(0x7f57fc0c2570 0x7f57fc154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 --2- 172.21.15.81:0/3699939305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc06d290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 -- 172.21.15.81:0/3699939305 >> 172.21.15.81:0/3699939305 conn(0x7f57fc0c71b0 msgr2=0x7f57fc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 -- 172.21.15.81:0/3699939305 shutdown_connections 2024-05-08T20:32:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.335+0000 7f58013d9640 1 -- 172.21.15.81:0/3699939305 wait complete. 2024-05-08T20:32:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 Processor -- start 2024-05-08T20:32:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- start start 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 0x7f57fc1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc1505e0 con 0x7f57fc0c2570 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc14e150 con 0x7f57fc06d7d0 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc14e430 con 0x7f57fc152340 2024-05-08T20:32:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57faffd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 msgr2=0x7f57fc1462e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 0x7f57fc1462e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33450/0 (socket says 172.21.15.81:33450) 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 -- 172.21.15.81:0/3364907501 learned_addr learned my addr 172.21.15.81:0/3364907501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57fb7fe640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 -- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 msgr2=0x7f57fc14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 -- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 msgr2=0x7f57fc1462e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 0x7f57fc1462e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 -- 172.21.15.81:0/3364907501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0094d0 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f3fff640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f57e400b550 tx=0x7f57e400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4003d00 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e4003e80 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc14e710 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4005330 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.339+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc14c970 con 0x7f57fc0c2570 2024-05-08T20:32:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc0675e0 con 0x7f57fc0c2570 2024-05-08T20:32:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f57e4005490 con 0x7f57fc0c2570 2024-05-08T20:32:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f57f37fe640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 0x7f57dc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f57e4084330 con 0x7f57fc0c2570 2024-05-08T20:32:22.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f57faffd640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 0x7f57dc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.343+0000 7f57faffd640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 0x7f57dc068b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0af000 tx=0x7f57ec0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:22.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.351+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f57e4051390 con 0x7f57fc0c2570 2024-05-08T20:32:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.631+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f57fc14cb60 con 0x7f57fc0c2570 2024-05-08T20:32:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.631+0000 7f57f37fe640 1 -- 172.21.15.81:0/3364907501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f57e40549b0 con 0x7f57fc0c2570 2024-05-08T20:32:22.637 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 msgr2=0x7f57dc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 0x7f57dc068b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0af000 tx=0x7f57ec0a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 msgr2=0x7f57fc1516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f57e400b550 tx=0x7f57e400ba10 comp rx=0 tx=0).stop 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 shutdown_connections 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57dc066640 0x7f57dc068b00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57fc152340 0x7f57fc14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57fc0c2570 0x7f57fc1516c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 --2- 172.21.15.81:0/3364907501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57fc06d7d0 0x7f57fc1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 >> 172.21.15.81:0/3364907501 conn(0x7f57fc0c71b0 msgr2=0x7f57fc14bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 shutdown_connections 2024-05-08T20:32:22.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:22.635+0000 7f58013d9640 1 -- 172.21.15.81:0/3364907501 wait complete. 2024-05-08T20:32:25.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 Processor -- start 2024-05-08T20:32:25.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 -- start start 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788155e10 con 0x7f97880a94b0 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806e790 con 0x7f97880c2bc0 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978f683640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806f460 con 0x7f97880c30d0 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978cc1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978dc20640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f97880a94b0 0x7f97880a98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40104/0 (socket says 172.21.15.81:40104) 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978dc20640 1 -- 172.21.15.81:0/77422491 learned_addr learned my addr 172.21.15.81:0/77422491 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 msgr2=0x7f97880c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:32:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:25.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.783+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 msgr2=0x7f97880c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:25.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:25.987+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 msgr2=0x7f97880c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:26.391+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:32:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 msgr2=0x7f97880c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:32:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:32:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:27.195+0000 7f978cc1e640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 msgr2=0x7f97880c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.117:3300/0 conn(0x7f97880c30d0 0x7f97880c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 -- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 msgr2=0x7f97880c4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 --2- 172.21.15.81:0/77422491 >> v2:172.21.15.81:3300/0 conn(0x7f97880c2bc0 0x7f97880c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.81:6789/0 conn(0x7f97880a94b0 legacy=0x7f97880a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 -- 172.21.15.81:0/77422491 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788156080 con 0x7f976c006180 2024-05-08T20:32:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f977effd640 1 -- 172.21.15.81:0/77422491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978806e790 con 0x7f976c0036a0 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.117:6789/0 conn(0x7f976c006180 legacy=0x7f976c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:28.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.783+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.117:6789/0 conn(0x7f976c006180 legacy=0x7f976c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:32:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:28.987+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:32:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.117:6789/0 conn(0x7f976c006180 legacy=0x7f976c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:32:29.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:29.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:29.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:29.391+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:32:30.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.195+0000 7f978cc1e640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.117:6789/0 conn(0x7f976c006180 legacy=0x7f976c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:30.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.195+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.195+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 >> v1:172.21.15.117:6789/0 conn(0x7f976c006180 legacy=0x7f976c008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:30.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.195+0000 7f978d41f640 1 -- 172.21.15.81:0/77422491 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c00af80 con 0x7f976c0036a0 2024-05-08T20:32:30.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978d41f640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d60 tx=0x7f978401d1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a2034c9e88e6ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f977ffff640 1 -- 172.21.15.81:0/77422491 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784006ea0 con 0x7f976c0036a0 2024-05-08T20:32:30.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f977ffff640 1 -- 172.21.15.81:0/77422491 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840a8030 con 0x7f976c0036a0 2024-05-08T20:32:30.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f977ffff640 1 -- 172.21.15.81:0/77422491 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ae650 con 0x7f976c0036a0 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 -- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 msgr2=0x7f976c005af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 --2- 172.21.15.81:0/77422491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f976c0036a0 0x7f976c005af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d60 tx=0x7f978401d1b0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978dc20640 1 -- 172.21.15.81:0/77422491 reap_dead start 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 -- 172.21.15.81:0/77422491 shutdown_connections 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 -- 172.21.15.81:0/77422491 >> 172.21.15.81:0/77422491 conn(0x7f97880c4cc0 msgr2=0x7f97880c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 -- 172.21.15.81:0/77422491 shutdown_connections 2024-05-08T20:32:30.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.203+0000 7f978f683640 1 -- 172.21.15.81:0/77422491 wait complete. 2024-05-08T20:32:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 Processor -- start 2024-05-08T20:32:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 -- start start 2024-05-08T20:32:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97880c7060 0x7f97881ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 0x7f9788154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880ac5d0 con 0x7f97881f05f0 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880ace30 con 0x7f9788154890 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978f683640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880ac870 con 0x7f97880c7060 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978cc1e640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 msgr2=0x7f9788154cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978cc1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 0x7f9788154cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978dc20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978dc20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49314/0 (socket says 172.21.15.81:49314) 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978d41f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97880c7060 0x7f97881ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.207+0000 7f978dc20640 1 -- 172.21.15.81:0/3176494358 learned_addr learned my addr 172.21.15.81:0/3176494358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 -- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97880c7060 msgr2=0x7f97881ec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97880c7060 0x7f97881ec9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 -- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 msgr2=0x7f9788154cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 0x7f9788154cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 -- 172.21.15.81:0/3176494358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009a40 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978dc20640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9788070d70 tx=0x7f978000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000ab40 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978000aca0 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780012400 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880acb50 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97880aa790 con 0x7f97881f05f0 2024-05-08T20:32:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97881eff30 con 0x7f97881f05f0 2024-05-08T20:32:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9780007070 con 0x7f97881f05f0 2024-05-08T20:32:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 0x7f976c069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.211+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9780084150 con 0x7f97881f05f0 2024-05-08T20:32:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.215+0000 7f978d41f640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 0x7f976c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.215+0000 7f978d41f640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 0x7f976c069900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f97840b0000 tx=0x7f97840a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.219+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f97881eff30 con 0x7f97881f05f0 2024-05-08T20:32:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.495+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f97881eff30 con 0x7f97881f05f0 2024-05-08T20:32:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.495+0000 7f977dffb640 1 -- 172.21.15.81:0/3176494358 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f9780017620 con 0x7f97881f05f0 2024-05-08T20:32:30.501 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":46,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:30.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 msgr2=0x7f976c069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 0x7f976c069900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f97840b0000 tx=0x7f97840a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:30.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 msgr2=0x7f97881f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9788070d70 tx=0x7f978000ce90 comp rx=0 tx=0).stop 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 shutdown_connections 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f976c067440 0x7f976c069900 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97881f05f0 0x7f97881f0a70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9788154890 0x7f9788154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 --2- 172.21.15.81:0/3176494358 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97880c7060 0x7f97881ec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 >> 172.21.15.81:0/3176494358 conn(0x7f97880c4cc0 msgr2=0x7f97880c2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 shutdown_connections 2024-05-08T20:32:30.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.499+0000 7f978f683640 1 -- 172.21.15.81:0/3176494358 wait complete. 2024-05-08T20:32:30.524 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:32:30.524 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:32:30.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:32:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 Processor -- start 2024-05-08T20:32:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 -- start start 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 0x7f771806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7718158080 con 0x7f771806d7d0 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771806ab70 con 0x7f7718152340 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771f0ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7718154b10 con 0x7f77180c2570 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771ce86640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 msgr2=0x7f771806d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771d687640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f771806d7d0 legacy=0x7f77181554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f771ce86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 0x7f771806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:48468/0 (socket says 172.21.15.81:48468) 2024-05-08T20:32:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 -- 172.21.15.81:0/4262410811 learned_addr learned my addr 172.21.15.81:0/4262410811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 -- 172.21.15.81:0/4262410811 >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 msgr2=0x7f771806d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 --2- 172.21.15.81:0/4262410811 >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 0x7f771806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 -- 172.21.15.81:0/4262410811 >> v1:172.21.15.117:6789/0 conn(0x7f771806d7d0 legacy=0x7f77181554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.659+0000 7f7717fff640 1 -- 172.21.15.81:0/4262410811 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771806a890 con 0x7f77180c2570 2024-05-08T20:32:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f7717fff640 1 --2- 172.21.15.81:0/4262410811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2e33e2ddeb9d02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f77177fe640 1 -- 172.21.15.81:0/4262410811 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0ab640 con 0x7f77180c2570 2024-05-08T20:32:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f77177fe640 1 -- 172.21.15.81:0/4262410811 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0a7070 con 0x7f77180c2570 2024-05-08T20:32:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f77177fe640 1 -- 172.21.15.81:0/4262410811 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0ab9c0 con 0x7f77180c2570 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 -- 172.21.15.81:0/4262410811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 msgr2=0x7f7718154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 --2- 172.21.15.81:0/4262410811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01c480 comp rx=0 tx=0).stop 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 -- 172.21.15.81:0/4262410811 shutdown_connections 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 --2- 172.21.15.81:0/4262410811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77180c2570 0x7f7718154f60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 --2- 172.21.15.81:0/4262410811 >> v2:172.21.15.117:3300/0 conn(0x7f7718152340 0x7f771806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 -- 172.21.15.81:0/4262410811 >> 172.21.15.81:0/4262410811 conn(0x7f77180c71b0 msgr2=0x7f77180c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 -- 172.21.15.81:0/4262410811 shutdown_connections 2024-05-08T20:32:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.663+0000 7f771f0ea640 1 -- 172.21.15.81:0/4262410811 wait complete. 2024-05-08T20:32:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 Processor -- start 2024-05-08T20:32:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- start start 2024-05-08T20:32:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 0x7f77180c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77180c2570 0x7f7718155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718152340 0x7f771813d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771813ec70 con 0x7f771806d7d0 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7718157ae0 con 0x7f77180c2570 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7718070ba0 con 0x7f7718152340 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f7717fff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77180c2570 msgr2=0x7f7718155e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 0x7f77180c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f7717fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77180c2570 0x7f7718155e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 0x7f77180c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49330/0 (socket says 172.21.15.81:49330) 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 -- 172.21.15.81:0/1638236007 learned_addr learned my addr 172.21.15.81:0/1638236007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771d687640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718152340 0x7f771813d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718152340 msgr2=0x7f771813d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7718152340 0x7f771813d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77180c2570 msgr2=0x7f7718155e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77180c2570 0x7f7718155e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0094d0 con 0x7f771806d7d0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771ce86640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 0x7f77180c5b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f771000b9e0 tx=0x7f771000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000cba0 con 0x7f771806d7d0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000cd20 con 0x7f771806d7d0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771813e990 con 0x7f771806d7d0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100156b0 con 0x7f771806d7d0 2024-05-08T20:32:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7718070e30 con 0x7f771806d7d0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 0x7f77181563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7718069550 con 0x7f771814fb30 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f7717fff640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 0x7f77181563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f7717fff640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77180c2370 con 0x7f771814fb30 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f7717fff640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 0x7f77181563c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f77180701a0 tx=0x7f770c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.667+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7710012070 con 0x7f771806d7d0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7704066670 0x7f7704068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f771d687640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7704066670 0x7f7704068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0aba80 con 0x7f771814fb30 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7710006e40 con 0x7f771806d7d0 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f770c0b8070 con 0x7f771814fb30 2024-05-08T20:32:30.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 msgr2=0x7f77181563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 0x7f77181563c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f77180701a0 tx=0x7f770c01acc0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 msgr2=0x7f77181563c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f77157fa640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771814fb30 0x7f77181563c0 secure :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f77180701a0 tx=0x7f770c01acc0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.671+0000 7f771d687640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7704066670 0x7f7704068b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7708003870 tx=0x7f7708008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.675+0000 7f771f0ea640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 0x7f771813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.675+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c1480 con 0x7f771813dcb0 2024-05-08T20:32:30.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f7717fff640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 0x7f771813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f7717fff640 1 -- 172.21.15.81:0/1638236007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7718161bf0 con 0x7f771813dcb0 2024-05-08T20:32:30.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f7717fff640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 0x7f771813e0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c003de0 con 0x7f771813dcb0 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f770c0c5680 con 0x7f771813dcb0 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 msgr2=0x7f771813e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 0x7f771813e0c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c019220 comp rx=0 tx=0).stop 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 msgr2=0x7f771813e0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f77157fa640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771813dcb0 0x7f771813e0c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 46, 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:30.691 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:32:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:30.695 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7704066670 msgr2=0x7f7704068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7704066670 0x7f7704068b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7708003870 tx=0x7f7708008040 comp rx=0 tx=0).stop 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 msgr2=0x7f77180c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 --2- 172.21.15.81:0/1638236007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771806d7d0 0x7f77180c5b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f771000b9e0 tx=0x7f771000bea0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771d687640 1 -- 172.21.15.81:0/1638236007 reap_dead start 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771d687640 1 -- 172.21.15.81:0/1638236007 reap_dead start 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 shutdown_connections 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 >> 172.21.15.81:0/1638236007 conn(0x7f77180c71b0 msgr2=0x7f771814bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 shutdown_connections 2024-05-08T20:32:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.679+0000 7f771f0ea640 1 -- 172.21.15.81:0/1638236007 wait complete. 2024-05-08T20:32:30.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:32:30.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:32:30.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:32:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 Processor -- start 2024-05-08T20:32:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 -- start start 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a440c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a44155e10 con 0x7f1a440c30d0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a44156080 con 0x7f1a440a94b0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a49c2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4406e790 con 0x7f1a440c2bc0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a440c30d0 0x7f1a440c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51064/0 (socket says 172.21.15.81:51064) 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 -- 172.21.15.81:0/3122192414 learned_addr learned my addr 172.21.15.81:0/3122192414 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a43fff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f1a440a94b0 legacy=0x7f1a440a9920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a42ffd640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a440c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915142217 0 0) 0x7f1a44155e10 con 0x7f1a440c30d0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2c003530 con 0x7f1a440c30d0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2642700842 0 0) 0x7f1a2c003530 con 0x7f1a440c30d0 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 msgr2=0x7f1a440c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:30.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a440c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 >> v1:172.21.15.117:6789/0 conn(0x7f1a440a94b0 legacy=0x7f1a440a9920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:30.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44156360 con 0x7f1a440c30d0 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1a34001680 con 0x7f1a440c30d0 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 >> v1:172.21.15.81:6789/0 conn(0x7f1a440c30d0 legacy=0x7f1a440c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0039b0 0x7f1a2c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a2c004d10 0x7f1a2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4406e790 con 0x7f1a2c0039b0 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c00ba70 con 0x7f1a2c004d10 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c00bc30 con 0x7f1a440c2bc0 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0039b0 0x7f1a2c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a43fff640 1 -- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a2c004d10 msgr2=0x7f1a2c005190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a43fff640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a2c004d10 0x7f1a2c005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a42ffd640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 -- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 msgr2=0x7f1a2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c2bc0 0x7f1a2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 -- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a2c004d10 msgr2=0x7f1a2c005190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a2c004d10 0x7f1a2c005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.811+0000 7f1a437fe640 1 -- 172.21.15.81:0/3122192414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c003530 con 0x7f1a2c0039b0 2024-05-08T20:32:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a437fe640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0039b0 0x7f1a2c003db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c1e0 tx=0x7f1a3401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1638edfd8e3ddc39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34005ae0 con 0x7f1a2c0039b0 2024-05-08T20:32:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34005c40 con 0x7f1a2c0039b0 2024-05-08T20:32:30.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a427fc640 1 -- 172.21.15.81:0/3122192414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340a5830 con 0x7f1a2c0039b0 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 -- 172.21.15.81:0/3122192414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0039b0 msgr2=0x7f1a2c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 --2- 172.21.15.81:0/3122192414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c0039b0 0x7f1a2c003db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c1e0 tx=0x7f1a3401cc40 comp rx=0 tx=0).stop 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a43fff640 1 -- 172.21.15.81:0/3122192414 reap_dead start 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 -- 172.21.15.81:0/3122192414 shutdown_connections 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 -- 172.21.15.81:0/3122192414 >> 172.21.15.81:0/3122192414 conn(0x7f1a440c4cc0 msgr2=0x7f1a440c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 -- 172.21.15.81:0/3122192414 shutdown_connections 2024-05-08T20:32:30.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.815+0000 7f1a49c2c640 1 -- 172.21.15.81:0/3122192414 wait complete. 2024-05-08T20:32:30.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 Processor -- start 2024-05-08T20:32:30.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- start start 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a2c0039b0 0x7f1a44140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a441403f0 0x7f1a44154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 0x7f1a440ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414f0a0 con 0x7f1a440ad220 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a441415c0 con 0x7f1a441403f0 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414ea50 con 0x7f1a2c0039b0 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a42ffd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a441403f0 msgr2=0x7f1a44154f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a42ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a441403f0 0x7f1a44154f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:30.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 0x7f1a440ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a2c0039b0 0x7f1a44140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 0x7f1a440ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49364/0 (socket says 172.21.15.81:49364) 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 learned_addr learned my addr 172.21.15.81:0/1466312334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a2c0039b0 msgr2=0x7f1a44140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a2c0039b0 0x7f1a44140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a441403f0 msgr2=0x7f1a44154f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a441403f0 0x7f1a44154f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4414ed30 con 0x7f1a440ad220 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a43fff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 0x7f1a440ad6a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a44071220 tx=0x7f1a3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c015470 con 0x7f1a440ad220 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0155d0 con 0x7f1a440ad220 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a441412b0 con 0x7f1a440ad220 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c015980 con 0x7f1a440ad220 2024-05-08T20:32:30.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4414f530 con 0x7f1a440ad220 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 0x7f1a441ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414eec0 con 0x7f1a441ee5b0 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.819+0000 7f1a437fe640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 0x7f1a441ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a437fe640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4414e8d0 con 0x7f1a441ee5b0 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a3c012070 con 0x7f1a440ad220 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a437fe640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 0x7f1a441ee990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c1b0 tx=0x7f1a2c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a30066670 0x7f1a30068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1a3c006e40 con 0x7f1a440ad220 2024-05-08T20:32:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a42ffd640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a30066670 0x7f1a30068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340b4070 con 0x7f1a441ee5b0 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1a340b5040 con 0x7f1a441ee5b0 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 msgr2=0x7f1a441ee990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 0x7f1a441ee990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c1b0 tx=0x7f1a2c005800 comp rx=0 tx=0).stop 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 msgr2=0x7f1a441ee990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a2bfff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a441ee5b0 0x7f1a441ee990 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c1b0 tx=0x7f1a2c005800 comp rx=0 tx=0).stop 2024-05-08T20:32:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.823+0000 7f1a42ffd640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a30066670 0x7f1a30068b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006d50 tx=0x7f1a38009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.831+0000 7f1a49c2c640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 0x7f1a440c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.831+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44073ea0 con 0x7f1a440c5d30 2024-05-08T20:32:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.831+0000 7f1a437fe640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 0x7f1a440c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a437fe640 1 -- 172.21.15.81:0/1466312334 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1a44150070 con 0x7f1a440c5d30 2024-05-08T20:32:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a437fe640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 0x7f1a440c6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a3401ca70 tx=0x7f1a340a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34001650 con 0x7f1a440c5d30 2024-05-08T20:32:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4624 (secure 0 0 0) 0x7f1a34007600 con 0x7f1a440c5d30 2024-05-08T20:32:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 msgr2=0x7f1a440c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 0x7f1a440c6140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a3401ca70 tx=0x7f1a340a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 msgr2=0x7f1a440c6140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a2bfff640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a440c5d30 0x7f1a440c6140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 46, 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:30.840 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.841 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.842 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:30.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:30.844 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.846 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:30.849 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:30.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:30.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a30066670 msgr2=0x7f1a30068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a30066670 0x7f1a30068b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006d50 tx=0x7f1a38009190 comp rx=0 tx=0).stop 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 msgr2=0x7f1a440ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 --2- 172.21.15.81:0/1466312334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a440ad220 0x7f1a440ad6a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a44071220 tx=0x7f1a3c009e30 comp rx=0 tx=0).stop 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 reap_dead start 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a43fff640 1 -- 172.21.15.81:0/1466312334 reap_dead start 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 shutdown_connections 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 >> 172.21.15.81:0/1466312334 conn(0x7f1a440c4cc0 msgr2=0x7f1a4414dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 shutdown_connections 2024-05-08T20:32:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:30.835+0000 7f1a49c2c640 1 -- 172.21.15.81:0/1466312334 wait complete. 2024-05-08T20:32:30.859 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:32:30.859 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:32:50.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:32:50.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:32:50.860 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:32:50.861 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:32:50.861 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:32:50.861 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:32:50.863 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:32:50.863 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:32:50.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 Processor -- start 2024-05-08T20:32:51.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 -- start start 2024-05-08T20:32:51.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 0x7eff1c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:51.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c158080 con 0x7eff1c0c34e0 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c06a890 con 0x7eff1c152340 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff23aeb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c06ab70 con 0x7eff1c0c2570 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff22088640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff1c0c34e0 0x7eff1c1554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60722/0 (socket says 172.21.15.81:60722) 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff22088640 1 -- 172.21.15.81:0/1160520165 learned_addr learned my addr 172.21.15.81:0/1160520165 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff21086640 1 --2- 172.21.15.81:0/1160520165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 0x7eff1c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff20885640 1 -- 172.21.15.81:0/1160520165 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174797512 0 0) 0x7eff1c158080 con 0x7eff1c0c34e0 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff20885640 1 -- 172.21.15.81:0/1160520165 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff08003530 con 0x7eff1c0c34e0 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff21086640 1 -- 172.21.15.81:0/1160520165 >> v1:172.21.15.117:6789/0 conn(0x7eff1c152340 legacy=0x7eff1c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff21086640 1 -- 172.21.15.81:0/1160520165 >> v1:172.21.15.81:6789/0 conn(0x7eff1c0c34e0 legacy=0x7eff1c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:51.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.006+0000 7eff21086640 1 -- 172.21.15.81:0/1160520165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0c2d70 con 0x7eff1c0c2570 2024-05-08T20:32:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff21086640 1 --2- 172.21.15.81:0/1160520165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 0x7eff1c154f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097f0 tx=0x7eff0c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e571f685a41b5094 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff20885640 1 -- 172.21.15.81:0/1160520165 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ad660 con 0x7eff1c0c2570 2024-05-08T20:32:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff20885640 1 -- 172.21.15.81:0/1160520165 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0ad7c0 con 0x7eff1c0c2570 2024-05-08T20:32:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff20885640 1 -- 172.21.15.81:0/1160520165 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0adb50 con 0x7eff1c0c2570 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- 172.21.15.81:0/1160520165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 msgr2=0x7eff1c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1160520165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 0x7eff1c154f60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097f0 tx=0x7eff0c01c450 comp rx=0 tx=0).stop 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- 172.21.15.81:0/1160520165 shutdown_connections 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1160520165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c0c2570 0x7eff1c154f60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- 172.21.15.81:0/1160520165 >> 172.21.15.81:0/1160520165 conn(0x7eff1c0c71b0 msgr2=0x7eff1c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- 172.21.15.81:0/1160520165 shutdown_connections 2024-05-08T20:32:51.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- 172.21.15.81:0/1160520165 wait complete. 2024-05-08T20:32:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 Processor -- start 2024-05-08T20:32:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.010+0000 7eff23aeb640 1 -- start start 2024-05-08T20:32:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c152340 0x7eff1c0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1f0f60 con 0x7eff1c0c2570 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c5f40 con 0x7eff1c0c34e0 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c6220 con 0x7eff1c152340 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45084/0 (socket says 172.21.15.81:45084) 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 -- 172.21.15.81:0/1310359330 learned_addr learned my addr 172.21.15.81:0/1310359330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff22088640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c152340 0x7eff1c0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 msgr2=0x7eff1c0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 msgr2=0x7eff1c0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c152340 msgr2=0x7eff1c0aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c152340 0x7eff1c0aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 msgr2=0x7eff1c0aa3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 -- 172.21.15.81:0/1310359330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009420 con 0x7eff1c0c2570 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21887640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c500 tx=0x7eff1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18005220 con 0x7eff1c0c2570 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18005380 con 0x7eff1c0c2570 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0c6500 con 0x7eff1c0c2570 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18007270 con 0x7eff1c0c2570 2024-05-08T20:32:51.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c147b10 con 0x7eff1c0c2570 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0c6a20 con 0x7eff1c0c2570 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff180073d0 con 0x7eff1c0c2570 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 0x7eff00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7eff18083d70 con 0x7eff1c0c2570 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.014+0000 7eff21086640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 0x7eff00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:51.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.018+0000 7eff21086640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 0x7eff00068b80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0af000 tx=0x7eff0c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:51.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.022+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7eff1c0c6a20 con 0x7eff1c0c2570 2024-05-08T20:32:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:51.306+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7eff1c0c6a20 con 0x7eff1c0c2570 2024-05-08T20:32:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.194+0000 7eff127fc640 1 -- 172.21.15.81:0/1310359330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7eff1c0c6a20 con 0x7eff1c0c2570 2024-05-08T20:32:56.200 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":50,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 msgr2=0x7eff00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 0x7eff00068b80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0af000 tx=0x7eff0c0a7000 comp rx=0 tx=0).stop 2024-05-08T20:32:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 msgr2=0x7eff1c142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c500 tx=0x7eff1800c9c0 comp rx=0 tx=0).stop 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 shutdown_connections 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff000666c0 0x7eff00068b80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff1c152340 0x7eff1c0aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff1c0c34e0 0x7eff1c0aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 --2- 172.21.15.81:0/1310359330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff1c0c2570 0x7eff1c142c90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 >> 172.21.15.81:0/1310359330 conn(0x7eff1c0c71b0 msgr2=0x7eff1c153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 shutdown_connections 2024-05-08T20:32:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:56.198+0000 7eff23aeb640 1 -- 172.21.15.81:0/1310359330 wait complete. 2024-05-08T20:32:59.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:32:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.350+0000 7f845ec97640 1 Processor -- start 2024-05-08T20:32:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.350+0000 7f845ec97640 1 -- start start 2024-05-08T20:32:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845ec97640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 0x7f8458154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845ec97640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8458158080 con 0x7f84580c34e0 2024-05-08T20:32:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845ec97640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845806a890 con 0x7f8458152340 2024-05-08T20:32:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845ec97640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845806ab70 con 0x7f84580c2570 2024-05-08T20:32:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845d234640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f84580c34e0 0x7f84581554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37814/0 (socket says 172.21.15.81:37814) 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845d234640 1 -- 172.21.15.81:0/3298724453 learned_addr learned my addr 172.21.15.81:0/3298724453 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 0x7f8458154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204180529 0 0) 0x7f8458158080 con 0x7f84580c34e0 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8448003530 con 0x7f84580c34e0 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 -- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 msgr2=0x7f8458154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 -- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 msgr2=0x7f8458154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 0x7f8458154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 0x7f8458154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:32:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346673152 0 0) 0x7f8448003530 con 0x7f84580c34e0 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 msgr2=0x7f8458154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 --2- 172.21.15.81:0/3298724453 >> v2:172.21.15.117:3300/0 conn(0x7f84580c2570 0x7f8458154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 >> v1:172.21.15.117:6789/0 conn(0x7f8458152340 legacy=0x7f845806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580c2d70 con 0x7f84580c34e0 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8450001a00 con 0x7f84580c34e0 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 >> v1:172.21.15.81:6789/0 conn(0x7f84580c34e0 legacy=0x7f84581554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8448003980 0x7f8448003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 0x7f8448004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480052b0 0x7f844800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845806ab70 con 0x7f84480047d0 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844800c180 con 0x7f84480052b0 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844800c340 con 0x7f8448003980 2024-05-08T20:32:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 0x7f8448004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845d234640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480052b0 0x7f844800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845ca33640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8448003980 0x7f8448003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 -- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8448003980 msgr2=0x7f8448003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8448003980 0x7f8448003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 -- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480052b0 msgr2=0x7f844800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480052b0 0x7f844800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f8457fff640 1 -- 172.21.15.81:0/3298724453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448003530 con 0x7f84480047d0 2024-05-08T20:32:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.354+0000 7f845d234640 1 -- 172.21.15.81:0/3298724453 reap_dead start 2024-05-08T20:32:59.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f8457fff640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 0x7f8448004c50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f84580c2980 tx=0x7f844401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6b03b94fd874e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab3f0 con 0x7f84480047d0 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440ab550 con 0x7f84480047d0 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f84577fe640 1 -- 172.21.15.81:0/3298724453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab900 con 0x7f84480047d0 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 msgr2=0x7f8448004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 0x7f8448004c50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f84580c2980 tx=0x7f844401c4b0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- 172.21.15.81:0/3298724453 shutdown_connections 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 --2- 172.21.15.81:0/3298724453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84480047d0 0x7f8448004c50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- 172.21.15.81:0/3298724453 >> 172.21.15.81:0/3298724453 conn(0x7f84580c71b0 msgr2=0x7f84580c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- 172.21.15.81:0/3298724453 shutdown_connections 2024-05-08T20:32:59.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- 172.21.15.81:0/3298724453 wait complete. 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 Processor -- start 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.358+0000 7f845ec97640 1 -- start start 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480047d0 0x7f845814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845814c1e0 0x7f84580ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580ac050 con 0x7f8458144950 2024-05-08T20:32:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84580ac900 con 0x7f84480047d0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845814fad0 con 0x7f845814c1e0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36792/0 (socket says 172.21.15.81:36792) 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 -- 172.21.15.81:0/1755075006 learned_addr learned my addr 172.21.15.81:0/1755075006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ca33640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480047d0 0x7f845814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845d234640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845814c1e0 0x7f84580ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 -- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845814c1e0 msgr2=0x7f84580ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845814c1e0 0x7f84580ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 -- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480047d0 msgr2=0x7f845814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480047d0 0x7f845814e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 -- 172.21.15.81:0/1755075006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84580ad0c0 con 0x7f8458144950 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f8457fff640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f84440ad040 tx=0x7f8448005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab980 con 0x7f8458144950 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440abae0 con 0x7f8458144950 2024-05-08T20:32:59.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84580ac620 con 0x7f8458144950 2024-05-08T20:32:59.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440abe90 con 0x7f8458144950 2024-05-08T20:32:59.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845814c660 con 0x7f8458144950 2024-05-08T20:32:59.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84580675e0 con 0x7f8458144950 2024-05-08T20:32:59.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84440b43f0 con 0x7f8458144950 2024-05-08T20:32:59.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 0x7f843c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f84440a8050 con 0x7f8458144950 2024-05-08T20:32:59.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.362+0000 7f845ca33640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 0x7f843c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.366+0000 7f845ca33640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 0x7f843c068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f844c005510 tx=0x7f844c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.370+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f84440eb430 con 0x7f8458144950 2024-05-08T20:32:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f84580ac480 con 0x7f8458144950 2024-05-08T20:32:59.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f84557fa640 1 -- 172.21.15.81:0/1755075006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f84580ac480 con 0x7f8458144950 2024-05-08T20:32:59.631 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 msgr2=0x7f843c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 0x7f843c068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f844c005510 tx=0x7f844c009040 comp rx=0 tx=0).stop 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 msgr2=0x7f845814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f84440ad040 tx=0x7f8448005800 comp rx=0 tx=0).stop 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 shutdown_connections 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f843c066690 0x7f843c068b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f845814c1e0 0x7f84580ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8458144950 0x7f845814f590 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 --2- 172.21.15.81:0/1755075006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84480047d0 0x7f845814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 >> 172.21.15.81:0/1755075006 conn(0x7f84580c71b0 msgr2=0x7f8458151240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 shutdown_connections 2024-05-08T20:32:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.626+0000 7f845ec97640 1 -- 172.21.15.81:0/1755075006 wait complete. 2024-05-08T20:32:59.650 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:32:59.651 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:32:59.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:32:59.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 Processor -- start 2024-05-08T20:32:59.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 -- start start 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2ffc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2ffc06d7d0 0x7f2ffc155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc158080 con 0x7f2ffc0c2570 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc06ab70 con 0x7f2ffc06d7d0 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f3001d87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc154b10 con 0x7f2ffc152340 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffaffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2ffc0c2570 0x7f2ffc154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37824/0 (socket says 172.21.15.81:37824) 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffaffd640 1 -- 172.21.15.81:0/2480862291 learned_addr learned my addr 172.21.15.81:0/2480862291 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/2480862291 >> v2:172.21.15.117:3300/0 conn(0x7f2ffc06d7d0 0x7f2ffc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2ffc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348348551 0 0) 0x7f2ffc158080 con 0x7f2ffc0c2570 2024-05-08T20:32:59.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe4003530 con 0x7f2ffc0c2570 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244011171 0 0) 0x7f2fe4003530 con 0x7f2ffc0c2570 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 msgr2=0x7f2ffc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2ffc06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 >> v2:172.21.15.117:3300/0 conn(0x7f2ffc06d7d0 msgr2=0x7f2ffc155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 --2- 172.21.15.81:0/2480862291 >> v2:172.21.15.117:3300/0 conn(0x7f2ffc06d7d0 0x7f2ffc155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc06a890 con 0x7f2ffc0c2570 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2ff0001680 con 0x7f2ffc0c2570 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 >> v1:172.21.15.81:6789/0 conn(0x7f2ffc0c2570 legacy=0x7f2ffc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2fe4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fe4003f00 0x7f2fe40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4004d10 0x7f2fe4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc06ab70 con 0x7f2fe4003f00 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc154b10 con 0x7f2fe4004d10 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe400b9e0 con 0x7f2ffc152340 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.758+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fe4003f00 0x7f2fe40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2fe4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4004d10 0x7f2fe4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 -- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 msgr2=0x7f2fe4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc152340 0x7f2fe4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 -- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4004d10 msgr2=0x7f2fe4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4004d10 0x7f2fe4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 -- 172.21.15.81:0/2480862291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4003530 con 0x7f2fe4003f00 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fe4003f00 0x7f2fe40047d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000c2c0 tx=0x7f2ff001ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2989432e3f0ea333 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00a5900 con 0x7f2fe4003f00 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00a5a60 con 0x7f2fe4003f00 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffa7fc640 1 -- 172.21.15.81:0/2480862291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00a5e10 con 0x7f2fe4003f00 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f3001d87640 1 -- 172.21.15.81:0/2480862291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fe4003f00 msgr2=0x7f2fe40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f3001d87640 1 --2- 172.21.15.81:0/2480862291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fe4003f00 0x7f2fe40047d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000c2c0 tx=0x7f2ff001ccb0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f2ffbfff640 1 -- 172.21.15.81:0/2480862291 reap_dead start 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f3001d87640 1 -- 172.21.15.81:0/2480862291 shutdown_connections 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f3001d87640 1 -- 172.21.15.81:0/2480862291 >> 172.21.15.81:0/2480862291 conn(0x7f2ffc0c71b0 msgr2=0x7f2ffc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.762+0000 7f3001d87640 1 -- 172.21.15.81:0/2480862291 shutdown_connections 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- 172.21.15.81:0/2480862291 wait complete. 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 Processor -- start 2024-05-08T20:32:59.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- start start 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4003f00 0x7f2ffc14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 0x7f2ffc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc0aa3d0 0x7f2ffc148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0aaa20 con 0x7f2ffc150320 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1f06a0 con 0x7f2fe4003f00 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1f0980 con 0x7f2ffc0aa3d0 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 0x7f2ffc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 0x7f2ffc1487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36810/0 (socket says 172.21.15.81:36810) 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 -- 172.21.15.81:0/237427023 learned_addr learned my addr 172.21.15.81:0/237427023 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4003f00 0x7f2ffc14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc0aa3d0 0x7f2ffc148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc0aa3d0 msgr2=0x7f2ffc148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc0aa3d0 0x7f2ffc148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4003f00 msgr2=0x7f2ffc14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4003f00 0x7f2ffc14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc1f0c60 con 0x7f2ffc150320 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ffc0aa3d0 0x7f2ffc148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe4003f00 0x7f2ffc14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2ffaffd640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 0x7f2ffc1487e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000c2c0 tx=0x7f2fe4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00a5e90 con 0x7f2ffc150320 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00047f0 con 0x7f2ffc150320 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0004ba0 con 0x7f2ffc150320 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc1f0f40 con 0x7f2ffc150320 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.766+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc14c2b0 con 0x7f2ffc150320 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f3001d87640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 0x7f2ffc1ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc069550 con 0x7f2ffc0ac570 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 0x7f2ffc1ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2ffb7fe640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ffc15fbe0 con 0x7f2ffc0ac570 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 0x7f2ffc1ed130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0135b0 tx=0x7f2fec013a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec015930 con 0x7f2ffc0ac570 2024-05-08T20:32:59.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ff00b5070 con 0x7f2ffc150320 2024-05-08T20:32:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2fe8066730 0x7f2fe8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2ff011e130 con 0x7f2ffc150320 2024-05-08T20:32:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2fe8066730 0x7f2fe8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2fec015a90 con 0x7f2ffc0ac570 2024-05-08T20:32:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 msgr2=0x7f2ffc1ed130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 0x7f2ffc1ed130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0135b0 tx=0x7f2fec013a70 comp rx=0 tx=0).stop 2024-05-08T20:32:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 msgr2=0x7f2ffc1ed130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2fe3fff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc0ac570 0x7f2ffc1ed130 secure :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0135b0 tx=0x7f2fec013a70 comp rx=0 tx=0).stop 2024-05-08T20:32:59.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.770+0000 7f2ffbfff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2fe8066730 0x7f2fe8068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc072760 tx=0x7f2ff400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 0x7f2ffc1eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1f13f0 con 0x7f2ffc1ed670 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 0x7f2ffc1eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2ffb7fe640 1 -- 172.21.15.81:0/237427023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2ffc0675e0 con 0x7f2ffc1ed670 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2ffb7fe640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 0x7f2ffc1eda80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0135b0 tx=0x7f2fec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec02f070 con 0x7f2ffc1ed670 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f2fec015e10 con 0x7f2ffc1ed670 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 msgr2=0x7f2ffc1eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 0x7f2ffc1eda80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0135b0 tx=0x7f2fec0046d0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 msgr2=0x7f2ffc1eda80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:59.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2fe3fff640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc1ed670 0x7f2ffc1eda80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.785 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.786 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:59.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.788 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.790 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:59.797 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2fe8066730 msgr2=0x7f2fe8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2fe8066730 0x7f2fe8068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc072760 tx=0x7f2ff400b040 comp rx=0 tx=0).stop 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 msgr2=0x7f2ffc1487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 --2- 172.21.15.81:0/237427023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ffc150320 0x7f2ffc1487e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000c2c0 tx=0x7f2fe4005800 comp rx=0 tx=0).stop 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2ffbfff640 1 -- 172.21.15.81:0/237427023 reap_dead start 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f2ffbfff640 1 -- 172.21.15.81:0/237427023 reap_dead start 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 shutdown_connections 2024-05-08T20:32:59.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 >> 172.21.15.81:0/237427023 conn(0x7f2ffc0c71b0 msgr2=0x7f2ffc152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 shutdown_connections 2024-05-08T20:32:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.778+0000 7f3001d87640 1 -- 172.21.15.81:0/237427023 wait complete. 2024-05-08T20:32:59.799 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:59.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:32:59.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:32:59.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 Processor -- start 2024-05-08T20:32:59.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 -- start start 2024-05-08T20:32:59.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3068156640 0x7f30680c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3068156a20 con 0x7f30680c7280 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306815cfa0 con 0x7f30680bd960 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f306e9c4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680c8d30 con 0x7f3068156640 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3068156640 0x7f30680c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3068156640 0x7f30680c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36834/0 (socket says 172.21.15.81:36834) 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 -- 172.21.15.81:0/2010162670 learned_addr learned my addr 172.21.15.81:0/2010162670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 -- 172.21.15.81:0/2010162670 >> v1:172.21.15.117:6789/0 conn(0x7f30680bd960 legacy=0x7f3068069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 -- 172.21.15.81:0/2010162670 >> v1:172.21.15.81:6789/0 conn(0x7f30680c7280 legacy=0x7f3068163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.922+0000 7f3067fff640 1 -- 172.21.15.81:0/2010162670 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306815d430 con 0x7f3068156640 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f3067fff640 1 --2- 172.21.15.81:0/2010162670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3068156640 0x7f30680c6d40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7256082f144d60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f30677fe640 1 -- 172.21.15.81:0/2010162670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580ad680 con 0x7f3068156640 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f30677fe640 1 -- 172.21.15.81:0/2010162670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30580ad7e0 con 0x7f3068156640 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f30677fe640 1 -- 172.21.15.81:0/2010162670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580adb70 con 0x7f3068156640 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 -- 172.21.15.81:0/2010162670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3068156640 msgr2=0x7f30680c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 --2- 172.21.15.81:0/2010162670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3068156640 0x7f30680c6d40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305801c490 comp rx=0 tx=0).stop 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 -- 172.21.15.81:0/2010162670 shutdown_connections 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 --2- 172.21.15.81:0/2010162670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3068156640 0x7f30680c6d40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 -- 172.21.15.81:0/2010162670 >> 172.21.15.81:0/2010162670 conn(0x7f30680ca330 msgr2=0x7f30680ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 -- 172.21.15.81:0/2010162670 shutdown_connections 2024-05-08T20:32:59.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.926+0000 7f306e9c4640 1 -- 172.21.15.81:0/2010162670 wait complete. 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 Processor -- start 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- start start 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30680bd960 0x7f30681f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 0x7f3068158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068156640 0x7f3068155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c1400 con 0x7f30680c7280 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680bd510 con 0x7f3068156640 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30681f2d80 con 0x7f30680bd960 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 0x7f3068158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 0x7f3068158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36840/0 (socket says 172.21.15.81:36840) 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 -- 172.21.15.81:0/3046350744 learned_addr learned my addr 172.21.15.81:0/3046350744 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:32:59.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30680bd960 0x7f30681f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306cf61640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068156640 0x7f3068155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30680bd960 msgr2=0x7f30681f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30680bd960 0x7f30681f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068156640 msgr2=0x7f3068155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068156640 0x7f3068155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580094d0 con 0x7f30680c7280 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30680bd960 0x7f30681f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306cf61640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3068156640 0x7f3068155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f305f7fe640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 0x7f3068158660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f305000c400 tx=0x7f305000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011790 con 0x7f30680c7280 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30500118f0 con 0x7f30680c7280 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011ca0 con 0x7f30680c7280 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680c0c50 con 0x7f30680c7280 2024-05-08T20:32:59.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680bfe70 con 0x7f30680c7280 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 0x7f3068155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681562a0 con 0x7f30680c0770 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 0x7f3068155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3050012420 con 0x7f30680c7280 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.930+0000 7f3067fff640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f306806a9e0 con 0x7f30680c0770 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 0x7f3068155d60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30680ca2e0 tx=0x7f3058019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3048066690 0x7f3048068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3050083fd0 con 0x7f30680c7280 2024-05-08T20:32:59.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f306cf61640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3048066690 0x7f3048068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580adea0 con 0x7f30680c0770 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f306cf61640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3048066690 0x7f3048068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30680c0f60 tx=0x7f3060009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f30580b7470 con 0x7f30680c0770 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 msgr2=0x7f3068155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 0x7f3068155d60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f30680ca2e0 tx=0x7f3058019230 comp rx=0 tx=0).stop 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 msgr2=0x7f3068155d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.934+0000 7f30657fa640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0770 0x7f3068155d60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.938+0000 7f306e9c4640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 0x7f30681f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:32:59.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.938+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068069550 con 0x7f30680c0090 2024-05-08T20:32:59.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 0x7f30681f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:32:59.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f3067fff640 1 -- 172.21.15.81:0/3046350744 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f30680675e0 con 0x7f30680c0090 2024-05-08T20:32:59.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f3067fff640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 0x7f30681f5750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f3058009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:32:59.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580c3a00 con 0x7f30680c0090 2024-05-08T20:32:59.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f30580c3300 con 0x7f30680c0090 2024-05-08T20:32:59.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 msgr2=0x7f30681f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 0x7f30681f5750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f3058009240 comp rx=0 tx=0).stop 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 msgr2=0x7f30681f5750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f30657fa640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30680c0090 0x7f30681f5750 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:32:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:32:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:32:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:32:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:32:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:32:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:32:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:32:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:32:59.959 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:32:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3048066690 msgr2=0x7f3048068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3048066690 0x7f3048068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30680c0f60 tx=0x7f3060009040 comp rx=0 tx=0).stop 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 msgr2=0x7f3068158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 --2- 172.21.15.81:0/3046350744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30680c7280 0x7f3068158660 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f305000c400 tx=0x7f305000c8c0 comp rx=0 tx=0).stop 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306cf61640 1 -- 172.21.15.81:0/3046350744 reap_dead start 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306cf61640 1 -- 172.21.15.81:0/3046350744 reap_dead start 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 shutdown_connections 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 >> 172.21.15.81:0/3046350744 conn(0x7f30680ca330 msgr2=0x7f3068069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 shutdown_connections 2024-05-08T20:32:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:32:59.942+0000 7f306e9c4640 1 -- 172.21.15.81:0/3046350744 wait complete. 2024-05-08T20:32:59.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:32:59.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:32:59.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:33:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 Processor -- start 2024-05-08T20:33:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 -- start start 2024-05-08T20:33:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef9c0c47c0 0x7fef9c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0c1730 con 0x7fef9c155670 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0c1a10 con 0x7fef9c0c47c0 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fefa0c25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c154980 con 0x7fef9c06d130 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef9c0c47c0 0x7fef9c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef9c0c47c0 0x7fef9c0c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 -- 172.21.15.81:0/334390779 learned_addr learned my addr 172.21.15.81:0/334390779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9a59c640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 -- 172.21.15.81:0/334390779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 msgr2=0x7fef9c0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 -- 172.21.15.81:0/334390779 >> v1:172.21.15.117:6789/0 conn(0x7fef9c155670 legacy=0x7fef9c0bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.090+0000 7fef9ad9d640 1 -- 172.21.15.81:0/334390779 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c154b90 con 0x7fef9c0c47c0 2024-05-08T20:33:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fef9ad9d640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c0c47c0 0x7fef9c0c4c50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f521e094b1baf7a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fef9959a640 1 -- 172.21.15.81:0/334390779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5700 con 0x7fef9c0c47c0 2024-05-08T20:33:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fef9959a640 1 -- 172.21.15.81:0/334390779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940a5860 con 0x7fef9c0c47c0 2024-05-08T20:33:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fef9959a640 1 -- 172.21.15.81:0/334390779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940a5bf0 con 0x7fef9c0c47c0 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- 172.21.15.81:0/334390779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c0c47c0 msgr2=0x7fef9c0c4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c0c47c0 0x7fef9c0c4c50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fef94009e50 tx=0x7fef9401ca50 comp rx=0 tx=0).stop 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- 172.21.15.81:0/334390779 shutdown_connections 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c0c47c0 0x7fef9c0c4c50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 --2- 172.21.15.81:0/334390779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c0a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- 172.21.15.81:0/334390779 >> 172.21.15.81:0/334390779 conn(0x7fef9c0c68c0 msgr2=0x7fef9c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- 172.21.15.81:0/334390779 shutdown_connections 2024-05-08T20:33:00.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- 172.21.15.81:0/334390779 wait complete. 2024-05-08T20:33:00.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 Processor -- start 2024-05-08T20:33:00.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.094+0000 7fefa0c25640 1 -- start start 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c1f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c0c47c0 0x7fef9c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 0x7fef9c1eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1ee990 con 0x7fef9c155670 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1f1180 con 0x7fef9c0c47c0 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c14b7a0 con 0x7fef9c06d130 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 0x7fef9c1eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 0x7fef9c1eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36862/0 (socket says 172.21.15.81:36862) 2024-05-08T20:33:00.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 learned_addr learned my addr 172.21.15.81:0/1036104954 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9a59c640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c1f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef99d9b640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c0c47c0 0x7fef9c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 msgr2=0x7fef9c1f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c06d130 0x7fef9c1f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c0c47c0 msgr2=0x7fef9c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef9c0c47c0 0x7fef9c1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009b30 con 0x7fef9c155670 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9ad9d640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 0x7fef9c1eedb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fef940af040 tx=0x7fef940197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940b8670 con 0x7fef9c155670 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940b87f0 con 0x7fef9c155670 2024-05-08T20:33:00.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c14a7c0 con 0x7fef9c155670 2024-05-08T20:33:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940b8ba0 con 0x7fef9c155670 2024-05-08T20:33:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c1ee2d0 con 0x7fef9c155670 2024-05-08T20:33:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 0x7fef9c1ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c069550 con 0x7fef9c14a050 2024-05-08T20:33:00.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9a59c640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 0x7fef9c1ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef940b8d00 con 0x7fef9c155670 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.098+0000 7fef9a59c640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef9c0c0400 con 0x7fef9c14a050 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef9a59c640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 0x7fef9c1ef2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0119d0 tx=0x7fef8c011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef7c066690 0x7fef7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fef9411ed70 con 0x7fef9c155670 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef99d9b640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef7c066690 0x7fef7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c004300 con 0x7fef9c14a050 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fef8c004460 con 0x7fef9c14a050 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 msgr2=0x7fef9c1ef2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 0x7fef9c1ef2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0119d0 tx=0x7fef8c011e90 comp rx=0 tx=0).stop 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 msgr2=0x7fef9c1ef2f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef8affd640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c14a050 0x7fef9c1ef2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.102+0000 7fef99d9b640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef7c066690 0x7fef7c068b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef9c15f8f0 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.106+0000 7fefa0c25640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 0x7fef9c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c066170 con 0x7fef9c1ef830 2024-05-08T20:33:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef9a59c640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 0x7fef9c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef9a59c640 1 -- 172.21.15.81:0/1036104954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fef9c0c12c0 con 0x7fef9c1ef830 2024-05-08T20:33:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef9a59c640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 0x7fef9c148d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0119d0 tx=0x7fef8c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c01e650 con 0x7fef9c1ef830 2024-05-08T20:33:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4635 (secure 0 0 0) 0x7fef8c0283a0 con 0x7fef9c1ef830 2024-05-08T20:33:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 msgr2=0x7fef9c148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 0x7fef9c148d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0119d0 tx=0x7fef8c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 msgr2=0x7fef9c148d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:00.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef8affd640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef9c1ef830 0x7fef9c148d30 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0119d0 tx=0x7fef8c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:00.117 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:00.118 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:00.119 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:00.120 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:00.121 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:00.122 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:00.123 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:00.125 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:00.126 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:00.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:00.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:00.129 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef7c066690 msgr2=0x7fef7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fef7c066690 0x7fef7c068b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef9c15f8f0 tx=0x7fef90009040 comp rx=0 tx=0).stop 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 msgr2=0x7fef9c1eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 --2- 172.21.15.81:0/1036104954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef9c155670 0x7fef9c1eedb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fef940af040 tx=0x7fef940197f0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 reap_dead start 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fef9ad9d640 1 -- 172.21.15.81:0/1036104954 reap_dead start 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 shutdown_connections 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 >> 172.21.15.81:0/1036104954 conn(0x7fef9c0c68c0 msgr2=0x7fef9c15fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:00.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 shutdown_connections 2024-05-08T20:33:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.110+0000 7fefa0c25640 1 -- 172.21.15.81:0/1036104954 wait complete. 2024-05-08T20:33:00.133 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:00.133 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:33:00.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:33:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.254+0000 7f27f38b1640 1 Processor -- start 2024-05-08T20:33:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.254+0000 7f27f38b1640 1 -- start start 2024-05-08T20:33:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec154cf0 0x7f27ec155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec155690 0x7f27ec0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec1522e0 con 0x7f27ec151f00 2024-05-08T20:33:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec06bb20 con 0x7f27ec155690 2024-05-08T20:33:00.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1548e0 con 0x7f27ec154cf0 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec155690 0x7f27ec0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec155690 0x7f27ec0ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36868/0 (socket says 172.21.15.81:36868) 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 -- 172.21.15.81:0/2604885024 learned_addr learned my addr 172.21.15.81:0/2604885024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f0e4c640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec154cf0 0x7f27ec155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 -- 172.21.15.81:0/2604885024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec154cf0 msgr2=0x7f27ec155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec154cf0 0x7f27ec155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 -- 172.21.15.81:0/2604885024 >> v1:172.21.15.117:6789/0 conn(0x7f27ec151f00 legacy=0x7f27ec1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 -- 172.21.15.81:0/2604885024 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0c5f80 con 0x7f27ec155690 2024-05-08T20:33:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f1e4e640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec155690 0x7f27ec0ca000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009e80 tx=0x7f27e401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea56fd3440c5132 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27e3fff640 1 -- 172.21.15.81:0/2604885024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40a5750 con 0x7f27ec155690 2024-05-08T20:33:00.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27e3fff640 1 -- 172.21.15.81:0/2604885024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e40a58b0 con 0x7f27ec155690 2024-05-08T20:33:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27e3fff640 1 -- 172.21.15.81:0/2604885024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40a5c40 con 0x7f27ec155690 2024-05-08T20:33:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- 172.21.15.81:0/2604885024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec155690 msgr2=0x7f27ec0ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec155690 0x7f27ec0ca000 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009e80 tx=0x7f27e401c8f0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- 172.21.15.81:0/2604885024 shutdown_connections 2024-05-08T20:33:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec155690 0x7f27ec0ca000 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2604885024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec154cf0 0x7f27ec155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- 172.21.15.81:0/2604885024 >> 172.21.15.81:0/2604885024 conn(0x7f27ec0715f0 msgr2=0x7f27ec071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- 172.21.15.81:0/2604885024 shutdown_connections 2024-05-08T20:33:00.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.258+0000 7f27f38b1640 1 -- 172.21.15.81:0/2604885024 wait complete. 2024-05-08T20:33:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 Processor -- start 2024-05-08T20:33:00.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- start start 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec154cf0 0x7f27ec0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0af3e0 0x7f27ec14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec14eee0 con 0x7f27ec151f00 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1516d0 con 0x7f27ec154cf0 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1f1150 con 0x7f27ec0af3e0 2024-05-08T20:33:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36870/0 (socket says 172.21.15.81:36870) 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 -- 172.21.15.81:0/2854706326 learned_addr learned my addr 172.21.15.81:0/2854706326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f1e4e640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0af3e0 0x7f27ec14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f0e4c640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec154cf0 0x7f27ec0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 -- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0af3e0 msgr2=0x7f27ec14e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0af3e0 0x7f27ec14e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 -- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec154cf0 msgr2=0x7f27ec0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec154cf0 0x7f27ec0ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 -- 172.21.15.81:0/2854706326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009b30 con 0x7f27ec151f00 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f164d640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c3c0 tx=0x7f27e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80052d0 con 0x7f27ec151f00 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8005430 con 0x7f27ec151f00 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8003840 con 0x7f27ec151f00 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec1f1430 con 0x7f27ec151f00 2024-05-08T20:33:00.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.262+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec151360 con 0x7f27ec151f00 2024-05-08T20:33:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec151520 con 0x7f27ec151f00 2024-05-08T20:33:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27e80039a0 con 0x7f27ec151f00 2024-05-08T20:33:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27e1ffb640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 0x7f27d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f27e8083920 con 0x7f27ec151f00 2024-05-08T20:33:00.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27f0e4c640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 0x7f27d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.266+0000 7f27f0e4c640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 0x7f27d0068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27dc007a60 tx=0x7f27dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.270+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f27e8050a30 con 0x7f27ec151f00 2024-05-08T20:33:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.518+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f27ec0675e0 con 0x7f27ec151f00 2024-05-08T20:33:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.518+0000 7f27e1ffb640 1 -- 172.21.15.81:0/2854706326 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f27e8054050 con 0x7f27ec151f00 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 msgr2=0x7f27d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 0x7f27d0068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27dc007a60 tx=0x7f27dc008040 comp rx=0 tx=0).stop 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 msgr2=0x7f27ec157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c3c0 tx=0x7f27e800c880 comp rx=0 tx=0).stop 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 shutdown_connections 2024-05-08T20:33:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f27d0066690 0x7f27d0068b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0af3e0 0x7f27ec14e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec154cf0 0x7f27ec0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 --2- 172.21.15.81:0/2854706326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec151f00 0x7f27ec157ba0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 >> 172.21.15.81:0/2854706326 conn(0x7f27ec0715f0 msgr2=0x7f27ec152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 shutdown_connections 2024-05-08T20:33:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:00.522+0000 7f27f38b1640 1 -- 172.21.15.81:0/2854706326 wait complete. 2024-05-08T20:33:00.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:33:10.544 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:33:10.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:33:10.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 Processor -- start 2024-05-08T20:33:10.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 -- start start 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bb406b230 0x7f6bb40c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb41519d0 0x7f6bb4151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40c3a50 con 0x7f6bb4070c00 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb4072940 con 0x7f6bb406b230 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb9161640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40705e0 con 0x7f6bb41519d0 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bb406b230 0x7f6bb40c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6bb406b230 0x7f6bb40c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48804/0 (socket says 172.21.15.81:48804) 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 -- 172.21.15.81:0/972803073 learned_addr learned my addr 172.21.15.81:0/972803073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb359e640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb41519d0 0x7f6bb4151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 -- 172.21.15.81:0/972803073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb41519d0 msgr2=0x7f6bb4151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb41519d0 0x7f6bb4151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 -- 172.21.15.81:0/972803073 >> v1:172.21.15.81:6789/0 conn(0x7f6bb4070c00 legacy=0x7f6bb414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.674+0000 7f6bb2d9d640 1 -- 172.21.15.81:0/972803073 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40708c0 con 0x7f6bb406b230 2024-05-08T20:33:10.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb2d9d640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb406b230 0x7f6bb40c2800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009870 tx=0x7f6ba401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3b09f2d529ffe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:10.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb1d9b640 1 -- 172.21.15.81:0/972803073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40aa430 con 0x7f6bb406b230 2024-05-08T20:33:10.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb1d9b640 1 -- 172.21.15.81:0/972803073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba40aa590 con 0x7f6bb406b230 2024-05-08T20:33:10.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb1d9b640 1 -- 172.21.15.81:0/972803073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40aa920 con 0x7f6bb406b230 2024-05-08T20:33:10.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 -- 172.21.15.81:0/972803073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb406b230 msgr2=0x7f6bb40c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb406b230 0x7f6bb40c2800 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009870 tx=0x7f6ba401c4d0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 -- 172.21.15.81:0/972803073 shutdown_connections 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb41519d0 0x7f6bb4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 --2- 172.21.15.81:0/972803073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb406b230 0x7f6bb40c2800 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 -- 172.21.15.81:0/972803073 >> 172.21.15.81:0/972803073 conn(0x7f6bb40c71b0 msgr2=0x7f6bb40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 -- 172.21.15.81:0/972803073 shutdown_connections 2024-05-08T20:33:10.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.678+0000 7f6bb9161640 1 -- 172.21.15.81:0/972803073 wait complete. 2024-05-08T20:33:10.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 Processor -- start 2024-05-08T20:33:10.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- start start 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb406b230 0x7f6bb41eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 0x7f6bb415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40bd320 con 0x7f6bb4070c00 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40c47c0 con 0x7f6bb41519d0 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40aae50 con 0x7f6bb406b230 2024-05-08T20:33:10.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48810/0 (socket says 172.21.15.81:48810) 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 -- 172.21.15.81:0/2399267893 learned_addr learned my addr 172.21.15.81:0/2399267893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb359e640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 0x7f6bb415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb2d9d640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb406b230 0x7f6bb41eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 -- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb406b230 msgr2=0x7f6bb41eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb406b230 0x7f6bb41eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 -- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 msgr2=0x7f6bb415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 0x7f6bb415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 -- 172.21.15.81:0/2399267893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40094d0 con 0x7f6bb4070c00 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb359e640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 0x7f6bb415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb259c640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c3c0 tx=0x7f6ba800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:10.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80052d0 con 0x7f6bb4070c00 2024-05-08T20:33:10.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8005430 con 0x7f6bb4070c00 2024-05-08T20:33:10.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb41ef480 con 0x7f6bb4070c00 2024-05-08T20:33:10.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8003840 con 0x7f6bb4070c00 2024-05-08T20:33:10.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.682+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40aa890 con 0x7f6bb4070c00 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40675e0 con 0x7f6bb4070c00 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ba80039a0 con 0x7f6bb4070c00 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6b9b7fe640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 0x7f6ba0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6ba8083a00 con 0x7f6bb4070c00 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6bb2d9d640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 0x7f6ba0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.686+0000 7f6bb2d9d640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 0x7f6ba0068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40ae000 tx=0x7f6ba40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:10.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.690+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6ba80509e0 con 0x7f6bb4070c00 2024-05-08T20:33:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.942+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6bb40c4930 con 0x7f6bb4070c00 2024-05-08T20:33:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.942+0000 7f6b9b7fe640 1 -- 172.21.15.81:0/2399267893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f6ba8054000 con 0x7f6bb4070c00 2024-05-08T20:33:10.949 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 msgr2=0x7f6ba0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 0x7f6ba0068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40ae000 tx=0x7f6ba40a7000 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 msgr2=0x7f6bb40c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c3c0 tx=0x7f6ba800c880 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 shutdown_connections 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6ba0066690 0x7f6ba0068b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bb41519d0 0x7f6bb415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb4070c00 0x7f6bb40c0c30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 --2- 172.21.15.81:0/2399267893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bb406b230 0x7f6bb41eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 >> 172.21.15.81:0/2399267893 conn(0x7f6bb40c71b0 msgr2=0x7f6bb40c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 shutdown_connections 2024-05-08T20:33:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:10.946+0000 7f6bb9161640 1 -- 172.21.15.81:0/2399267893 wait complete. 2024-05-08T20:33:10.971 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:33:10.971 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:33:10.971 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:33:10.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:33:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.110+0000 7efc393b6640 1 Processor -- start 2024-05-08T20:33:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.110+0000 7efc393b6640 1 -- start start 2024-05-08T20:33:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc393b6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc34152220 0x7efc341555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc393b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 0x7efc340c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc393b6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc34155140 con 0x7efc340aac30 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc393b6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc340c4780 con 0x7efc34152220 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc393b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34072650 con 0x7efc340c26e0 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efc340aac30 0x7efc340c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36260/0 (socket says 172.21.15.81:36260) 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 -- 172.21.15.81:0/4155057715 learned_addr learned my addr 172.21.15.81:0/4155057715 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc32ffd640 1 --2- 172.21.15.81:0/4155057715 >> v2:172.21.15.117:3300/0 conn(0x7efc34152220 0x7efc341555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc2bfff640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 0x7efc340c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179514219 0 0) 0x7efc34155140 con 0x7efc340aac30 2024-05-08T20:33:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc20003530 con 0x7efc340aac30 2024-05-08T20:33:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4127747018 0 0) 0x7efc20003530 con 0x7efc340aac30 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 msgr2=0x7efc340c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 0x7efc340c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 >> v2:172.21.15.117:3300/0 conn(0x7efc34152220 msgr2=0x7efc341555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 --2- 172.21.15.81:0/4155057715 >> v2:172.21.15.117:3300/0 conn(0x7efc34152220 0x7efc341555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34158b80 con 0x7efc340aac30 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7efc2c001a00 con 0x7efc340aac30 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 >> v1:172.21.15.81:6789/0 conn(0x7efc340aac30 legacy=0x7efc340c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc20003980 0x7efc20003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 0x7efc200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20004d10 0x7efc20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34072650 con 0x7efc20004d10 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000b990 con 0x7efc20003980 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000bad0 con 0x7efc340c26e0 2024-05-08T20:33:11.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20004d10 0x7efc20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc32ffd640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc20003980 0x7efc20003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 -- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 msgr2=0x7efc200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc340c26e0 0x7efc200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 -- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc20003980 msgr2=0x7efc20003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc20003980 0x7efc20003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.114+0000 7efc337fe640 1 -- 172.21.15.81:0/4155057715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20003530 con 0x7efc20004d10 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20004d10 0x7efc20005190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a830 tx=0x7efc2c01fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78e2d7cd063ed33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0aa710 con 0x7efc20004d10 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c0aa870 con 0x7efc20004d10 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc327fc640 1 -- 172.21.15.81:0/4155057715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0aac40 con 0x7efc20004d10 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- 172.21.15.81:0/4155057715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20004d10 msgr2=0x7efc20005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 --2- 172.21.15.81:0/4155057715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc20004d10 0x7efc20005190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a830 tx=0x7efc2c01fae0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 -- 172.21.15.81:0/4155057715 reap_dead start 2024-05-08T20:33:11.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- 172.21.15.81:0/4155057715 shutdown_connections 2024-05-08T20:33:11.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- 172.21.15.81:0/4155057715 >> 172.21.15.81:0/4155057715 conn(0x7efc340c4cc0 msgr2=0x7efc340c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- 172.21.15.81:0/4155057715 shutdown_connections 2024-05-08T20:33:11.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- 172.21.15.81:0/4155057715 wait complete. 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 Processor -- start 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- start start 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc341ed2d0 0x7efc3414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc341530c0 0x7efc34153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 0x7efc34149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34151090 con 0x7efc341499f0 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34151440 con 0x7efc341ed2d0 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc393b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34153520 con 0x7efc341530c0 2024-05-08T20:33:11.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 0x7efc34149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 0x7efc34149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48828/0 (socket says 172.21.15.81:48828) 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 learned_addr learned my addr 172.21.15.81:0/2560436796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc32ffd640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc341ed2d0 0x7efc3414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc2bfff640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc341530c0 0x7efc34153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc341530c0 msgr2=0x7efc34153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc341530c0 0x7efc34153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc341ed2d0 msgr2=0x7efc3414fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc341ed2d0 0x7efc3414fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.118+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34154420 con 0x7efc341499f0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc337fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 0x7efc34149ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a920 tx=0x7efc20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0aa710 con 0x7efc341499f0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c001fd0 con 0x7efc341499f0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3414a3e0 con 0x7efc341499f0 2024-05-08T20:33:11.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0019e0 con 0x7efc341499f0 2024-05-08T20:33:11.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc341ede00 con 0x7efc341499f0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc393b6640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 0x7efc341e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34073ea0 con 0x7efc341515b0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc32ffd640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 0x7efc341e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc32ffd640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc341edff0 con 0x7efc341515b0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc32ffd640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 0x7efc341e9b00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efc24013680 tx=0x7efc24013b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24011ab0 con 0x7efc341515b0 2024-05-08T20:33:11.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc2c0a9440 con 0x7efc341499f0 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efc14066760 0x7efc14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2bfff640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efc14066760 0x7efc14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7efc2c121ca0 con 0x7efc341499f0 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7efc24011c10 con 0x7efc341515b0 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 msgr2=0x7efc341e9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 0x7efc341e9b00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efc24013680 tx=0x7efc24013b40 comp rx=0 tx=0).stop 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 msgr2=0x7efc341e9b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2b7fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341515b0 0x7efc341e9b00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.122+0000 7efc2bfff640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efc14066760 0x7efc14068c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0047c0 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 0x7efc341ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34151090 con 0x7efc341ea040 2024-05-08T20:33:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc32ffd640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 0x7efc341ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc32ffd640 1 -- 172.21.15.81:0/2560436796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efc34158e60 con 0x7efc341ea040 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc32ffd640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 0x7efc341ea450 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc2401e000 tx=0x7efc24004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24026070 con 0x7efc341ea040 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7efc24005e90 con 0x7efc341ea040 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 msgr2=0x7efc341ea450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 0x7efc341ea450 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc2401e000 tx=0x7efc24004740 comp rx=0 tx=0).stop 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:11.153 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:11.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 msgr2=0x7efc341ea450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc2b7fe640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341ea040 0x7efc341ea450 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efc14066760 msgr2=0x7efc14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efc14066760 0x7efc14068c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0047c0 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 msgr2=0x7efc34149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 --2- 172.21.15.81:0/2560436796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc341499f0 0x7efc34149ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00a920 tx=0x7efc20005800 comp rx=0 tx=0).stop 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 reap_dead start 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc337fe640 1 -- 172.21.15.81:0/2560436796 reap_dead start 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 shutdown_connections 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 >> 172.21.15.81:0/2560436796 conn(0x7efc340c4cc0 msgr2=0x7efc340c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 shutdown_connections 2024-05-08T20:33:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.134+0000 7efc393b6640 1 -- 172.21.15.81:0/2560436796 wait complete. 2024-05-08T20:33:11.158 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:11.158 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:33:11.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:33:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 Processor -- start 2024-05-08T20:33:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 -- start start 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe600154cf0 0x7fe600155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600155690 0x7fe6000ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6001522e0 con 0x7fe600151f00 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60006bb20 con 0x7fe600154cf0 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe6082e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6001548e0 con 0x7fe600155690 2024-05-08T20:33:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe600154cf0 0x7fe600155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe600154cf0 0x7fe600155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48850/0 (socket says 172.21.15.81:48850) 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 -- 172.21.15.81:0/1959730376 learned_addr learned my addr 172.21.15.81:0/1959730376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe606884640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600155690 0x7fe6000ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 -- 172.21.15.81:0/1959730376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600155690 msgr2=0x7fe6000ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600155690 0x7fe6000ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 -- 172.21.15.81:0/1959730376 >> v1:172.21.15.81:6789/0 conn(0x7fe600151f00 legacy=0x7fe6001588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.278+0000 7fe605882640 1 -- 172.21.15.81:0/1959730376 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000c5f80 con 0x7fe600154cf0 2024-05-08T20:33:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe605882640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600154cf0 0x7fe600155150 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29ad3085ac11e5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe605081640 1 -- 172.21.15.81:0/1959730376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00ac640 con 0x7fe600154cf0 2024-05-08T20:33:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe605081640 1 -- 172.21.15.81:0/1959730376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00ac7a0 con 0x7fe600154cf0 2024-05-08T20:33:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe605081640 1 -- 172.21.15.81:0/1959730376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00acb30 con 0x7fe600154cf0 2024-05-08T20:33:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 -- 172.21.15.81:0/1959730376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600154cf0 msgr2=0x7fe600155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600154cf0 0x7fe600155150 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f001c440 comp rx=0 tx=0).stop 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 -- 172.21.15.81:0/1959730376 shutdown_connections 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600155690 0x7fe6000ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 --2- 172.21.15.81:0/1959730376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600154cf0 0x7fe600155150 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 -- 172.21.15.81:0/1959730376 >> 172.21.15.81:0/1959730376 conn(0x7fe6000715f0 msgr2=0x7fe600071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 -- 172.21.15.81:0/1959730376 shutdown_connections 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.282+0000 7fe6082e7640 1 -- 172.21.15.81:0/1959730376 wait complete. 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 Processor -- start 2024-05-08T20:33:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- start start 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600151f00 0x7fe600155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600154cf0 0x7fe600143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000ac550 con 0x7fe600143bb0 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000aefa0 con 0x7fe600154cf0 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000af240 con 0x7fe600151f00 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48856/0 (socket says 172.21.15.81:48856) 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 -- 172.21.15.81:0/3423946003 learned_addr learned my addr 172.21.15.81:0/3423946003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe605882640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600154cf0 0x7fe600143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606083640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600151f00 0x7fe600155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600151f00 msgr2=0x7fe600155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe600151f00 0x7fe600155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600154cf0 msgr2=0x7fe600143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600154cf0 0x7fe600143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00094d0 con 0x7fe600143bb0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe605882640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600154cf0 0x7fe600143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606884640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8007e40 tx=0x7fe5f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8014620 con 0x7fe600143bb0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800ee90 con 0x7fe600143bb0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600151130 con 0x7fe600143bb0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80149e0 con 0x7fe600143bb0 2024-05-08T20:33:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6000af520 con 0x7fe600143bb0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 0x7fe6000adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600069600 con 0x7fe600155690 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606083640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 0x7fe6000adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5f8014b40 con 0x7fe600143bb0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.286+0000 7fe606083640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6000675e0 con 0x7fe600155690 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5e40666c0 0x7fe5e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe5f8084ee0 con 0x7fe600143bb0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe606083640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 0x7fe6000adf20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc001ec0 tx=0x7fe5fc00e890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe605882640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5e40666c0 0x7fe5e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0052e0 con 0x7fe600155690 2024-05-08T20:33:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe605882640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5e40666c0 0x7fe5e4068b80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00ae000 tx=0x7fe5f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe5fc005440 con 0x7fe600155690 2024-05-08T20:33:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 msgr2=0x7fe6000adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 0x7fe6000adf20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc001ec0 tx=0x7fe5fc00e890 comp rx=0 tx=0).stop 2024-05-08T20:33:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 msgr2=0x7fe6000adf20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.290+0000 7fe5f6ffd640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe600155690 0x7fe6000adf20 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc001ec0 tx=0x7fe5fc00e890 comp rx=0 tx=0).stop 2024-05-08T20:33:11.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 0x7fe60014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000af3b0 con 0x7fe6000ae460 2024-05-08T20:33:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe606083640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 0x7fe60014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe606083640 1 -- 172.21.15.81:0/3423946003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe600151650 con 0x7fe6000ae460 2024-05-08T20:33:11.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe606083640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 0x7fe60014fd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc001ec0 tx=0x7fe5fc001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc021070 con 0x7fe6000ae460 2024-05-08T20:33:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fe5fc0069f0 con 0x7fe6000ae460 2024-05-08T20:33:11.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 msgr2=0x7fe60014fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 0x7fe60014fd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc001ec0 tx=0x7fe5fc001090 comp rx=0 tx=0).stop 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 msgr2=0x7fe60014fd20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe5f6ffd640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6000ae460 0x7fe60014fd20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:11.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:11.319 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5e40666c0 msgr2=0x7fe5e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5e40666c0 0x7fe5e4068b80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00ae000 tx=0x7fe5f0008040 comp rx=0 tx=0).stop 2024-05-08T20:33:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 msgr2=0x7fe6000ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe606884640 1 -- 172.21.15.81:0/3423946003 reap_dead start 2024-05-08T20:33:11.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8007e40 tx=0x7fe5f800e4b0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 shutdown_connections 2024-05-08T20:33:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 --2- 172.21.15.81:0/3423946003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe600143bb0 0x7fe6000ad9e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 >> 172.21.15.81:0/3423946003 conn(0x7fe6000715f0 msgr2=0x7fe600153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 shutdown_connections 2024-05-08T20:33:11.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.298+0000 7fe6082e7640 1 -- 172.21.15.81:0/3423946003 wait complete. 2024-05-08T20:33:11.327 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:11.327 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:33:11.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:33:11.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 Processor -- start 2024-05-08T20:33:11.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 -- start start 2024-05-08T20:33:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800c2bc0 0x7fb4800c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4800a94b0 0x7fb4800a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb480155e10 con 0x7fb4800c30d0 2024-05-08T20:33:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48006e790 con 0x7fb4800a94b0 2024-05-08T20:33:11.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb48785f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006f460 con 0x7fb4800c2bc0 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4800a94b0 0x7fb4800a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4800a94b0 0x7fb4800a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48866/0 (socket says 172.21.15.81:48866) 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 -- 172.21.15.81:0/759303013 learned_addr learned my addr 172.21.15.81:0/759303013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 -- 172.21.15.81:0/759303013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800c2bc0 msgr2=0x7fb4800c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 --2- 172.21.15.81:0/759303013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800c2bc0 0x7fb4800c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 -- 172.21.15.81:0/759303013 >> v1:172.21.15.117:6789/0 conn(0x7fb4800c30d0 legacy=0x7fb4800c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.462+0000 7fb485dfc640 1 -- 172.21.15.81:0/759303013 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800a9e60 con 0x7fb4800a94b0 2024-05-08T20:33:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb485dfc640 1 --2- 172.21.15.81:0/759303013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800a94b0 0x7fb4800a9920 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb478009e80 tx=0x7fb47801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f4acc6ef41bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb477fff640 1 -- 172.21.15.81:0/759303013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780a5830 con 0x7fb4800a94b0 2024-05-08T20:33:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb477fff640 1 -- 172.21.15.81:0/759303013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780a5990 con 0x7fb4800a94b0 2024-05-08T20:33:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb477fff640 1 -- 172.21.15.81:0/759303013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780a5d20 con 0x7fb4800a94b0 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 -- 172.21.15.81:0/759303013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800a94b0 msgr2=0x7fb4800a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 --2- 172.21.15.81:0/759303013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800a94b0 0x7fb4800a9920 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb478009e80 tx=0x7fb47801c970 comp rx=0 tx=0).stop 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 -- 172.21.15.81:0/759303013 shutdown_connections 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 --2- 172.21.15.81:0/759303013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800a94b0 0x7fb4800a9920 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 --2- 172.21.15.81:0/759303013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800c2bc0 0x7fb4800c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 -- 172.21.15.81:0/759303013 >> 172.21.15.81:0/759303013 conn(0x7fb4800c4cc0 msgr2=0x7fb4800c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 -- 172.21.15.81:0/759303013 shutdown_connections 2024-05-08T20:33:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 -- 172.21.15.81:0/759303013 wait complete. 2024-05-08T20:33:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.466+0000 7fb48785f640 1 Processor -- start 2024-05-08T20:33:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- start start 2024-05-08T20:33:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800a94b0 0x7fb480154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4800c2bc0 0x7fb480142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 0x7fb48006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480154b60 con 0x7fb4800c30d0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006cf20 con 0x7fb4800c2bc0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48015be90 con 0x7fb4800a94b0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 0x7fb48006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 0x7fb48006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48876/0 (socket says 172.21.15.81:48876) 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 learned_addr learned my addr 172.21.15.81:0/2439552361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb4855fb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800a94b0 0x7fb480154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb484dfa640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4800c2bc0 0x7fb480142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800a94b0 msgr2=0x7fb480154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4800a94b0 0x7fb480154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4800c2bc0 msgr2=0x7fb480142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4800c2bc0 0x7fb480142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009b30 con 0x7fb4800c30d0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb485dfc640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 0x7fb48006afd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb4780af040 tx=0x7fb478019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780b8670 con 0x7fb4800c30d0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780b87f0 con 0x7fb4800c30d0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48006ccb0 con 0x7fb4800c30d0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780b8ba0 con 0x7fb4800c30d0 2024-05-08T20:33:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480143160 con 0x7fb4800c30d0 2024-05-08T20:33:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 0x7fb4801f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480073ea0 con 0x7fb4801558b0 2024-05-08T20:33:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4780b8d00 con 0x7fb4800c30d0 2024-05-08T20:33:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.470+0000 7fb4855fb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 0x7fb4801f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4640666c0 0x7fb464068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb4855fb640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb48006e310 con 0x7fb4801558b0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb47811faa0 con 0x7fb4800c30d0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb484dfa640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4640666c0 0x7fb464068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb4855fb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 0x7fb4801f0f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f70 tx=0x7fb47c00fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0050d0 con 0x7fb4801558b0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb484dfa640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4640666c0 0x7fb464068b80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb480153860 tx=0x7fb4700090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb47c005230 con 0x7fb4801558b0 2024-05-08T20:33:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 msgr2=0x7fb4801f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 0x7fb4801f0f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f70 tx=0x7fb47c00fc00 comp rx=0 tx=0).stop 2024-05-08T20:33:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 msgr2=0x7fb4801f0f90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.474+0000 7fb475ffb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4801558b0 0x7fb4801f0f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 0x7fb48014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480154420 con 0x7fb48014a540 2024-05-08T20:33:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb4855fb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 0x7fb48014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb4855fb640 1 -- 172.21.15.81:0/2439552361 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb4800c4970 con 0x7fb48014a540 2024-05-08T20:33:11.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb4855fb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 0x7fb48014a950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f70 tx=0x7fb47c001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c023070 con 0x7fb48014a540 2024-05-08T20:33:11.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7fb47c00dd70 con 0x7fb48014a540 2024-05-08T20:33:11.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 msgr2=0x7fb48014a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 0x7fb48014a950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f70 tx=0x7fb47c001130 comp rx=0 tx=0).stop 2024-05-08T20:33:11.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 msgr2=0x7fb48014a950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:11.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb475ffb640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb48014a540 0x7fb48014a950 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 54, 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.489 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:11.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:11.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:11.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:11.500 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4640666c0 msgr2=0x7fb464068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb4640666c0 0x7fb464068b80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb480153860 tx=0x7fb4700090e0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 msgr2=0x7fb48006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 --2- 172.21.15.81:0/2439552361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4800c30d0 0x7fb48006afd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb4780af040 tx=0x7fb478019710 comp rx=0 tx=0).stop 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 reap_dead start 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb485dfc640 1 -- 172.21.15.81:0/2439552361 reap_dead start 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 shutdown_connections 2024-05-08T20:33:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 >> 172.21.15.81:0/2439552361 conn(0x7fb4800c4cc0 msgr2=0x7fb48006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 shutdown_connections 2024-05-08T20:33:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.482+0000 7fb48785f640 1 -- 172.21.15.81:0/2439552361 wait complete. 2024-05-08T20:33:11.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:11.507 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:33:11.507 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:33:11.507 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:33:11.507 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:33:11.507 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:33:11.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:33:11.527 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:33:11.527 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:33:11.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:33:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 Processor -- start 2024-05-08T20:33:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 -- start start 2024-05-08T20:33:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21280c2800 0x7f21281520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280c3a50 con 0x7f212806b230 2024-05-08T20:33:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280705e0 con 0x7f2128070c00 2024-05-08T20:33:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212f740640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280c2c70 con 0x7f21280c2800 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212d4dc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f212806b230 0x7f212814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36280/0 (socket says 172.21.15.81:36280) 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212d4dc640 1 -- 172.21.15.81:0/3262052173 learned_addr learned my addr 172.21.15.81:0/3262052173 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212dcdd640 1 --2- 172.21.15.81:0/3262052173 >> v2:172.21.15.117:3300/0 conn(0x7f21280c2800 0x7f21281520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534339074 0 0) 0x7f21280c3a50 con 0x7f212806b230 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2114003530 con 0x7f212806b230 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212dcdd640 1 -- 172.21.15.81:0/3262052173 >> v1:172.21.15.117:6789/0 conn(0x7f2128070c00 legacy=0x7f21281519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392012688 0 0) 0x7f2114003530 con 0x7f212806b230 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212dcdd640 1 -- 172.21.15.81:0/3262052173 >> v1:172.21.15.81:6789/0 conn(0x7f212806b230 legacy=0x7f212814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.638+0000 7f212dcdd640 1 -- 172.21.15.81:0/3262052173 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280708c0 con 0x7f21280c2800 2024-05-08T20:33:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212dcdd640 1 --2- 172.21.15.81:0/3262052173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f21281520e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1081c938af7c666a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124001680 con 0x7f21280c2800 2024-05-08T20:33:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200a5550 con 0x7f21280c2800 2024-05-08T20:33:11.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f211ffff640 1 -- 172.21.15.81:0/3262052173 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200a58c0 con 0x7f21280c2800 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- 172.21.15.81:0/3262052173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 msgr2=0x7f21281520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 --2- 172.21.15.81:0/3262052173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f21281520e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212001c800 comp rx=0 tx=0).stop 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- 172.21.15.81:0/3262052173 shutdown_connections 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 --2- 172.21.15.81:0/3262052173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f21281520e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- 172.21.15.81:0/3262052173 >> 172.21.15.81:0/3262052173 conn(0x7f21280c71b0 msgr2=0x7f21280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- 172.21.15.81:0/3262052173 shutdown_connections 2024-05-08T20:33:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- 172.21.15.81:0/3262052173 wait complete. 2024-05-08T20:33:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 Processor -- start 2024-05-08T20:33:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- start start 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 0x7f21280c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f212814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c6e40 con 0x7f2128070c00 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c5d80 con 0x7f21280c2800 2024-05-08T20:33:11.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212f740640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212814d2b0 con 0x7f212806b230 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212d4dc640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 msgr2=0x7f21280c5840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212d4dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 0x7f21280c5840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212ccdb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212ccdb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48882/0 (socket says 172.21.15.81:48882) 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212ccdb640 1 -- 172.21.15.81:0/2473537579 learned_addr learned my addr 172.21.15.81:0/2473537579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.642+0000 7f212dcdd640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f212814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 -- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 msgr2=0x7f21280c5840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 0x7f21280c5840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 -- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 msgr2=0x7f212814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f212814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 -- 172.21.15.81:0/2473537579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009a70 con 0x7f2128070c00 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212ccdb640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f211800c530 tx=0x7f211800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118005220 con 0x7f2128070c00 2024-05-08T20:33:11.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118005380 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118007270 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c5fb0 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212814d7e0 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280675e0 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21180073d0 con 0x7f2128070c00 2024-05-08T20:33:11.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 0x7f210c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2118083dc0 con 0x7f2128070c00 2024-05-08T20:33:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212d4dc640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 0x7f210c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:11.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.646+0000 7f212d4dc640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 0x7f210c068b00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2124004820 tx=0x7f2124001480 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.654+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2118050d80 con 0x7f2128070c00 2024-05-08T20:33:11.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.902+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2128074950 con 0x7f2128070c00 2024-05-08T20:33:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.902+0000 7f211dffb640 1 -- 172.21.15.81:0/2473537579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f21180543a0 con 0x7f2128070c00 2024-05-08T20:33:11.909 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:33:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 msgr2=0x7f210c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 0x7f210c068b00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2124004820 tx=0x7f2124001480 comp rx=0 tx=0).stop 2024-05-08T20:33:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 msgr2=0x7f21280c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f211800c530 tx=0x7f211800c9f0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 shutdown_connections 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f210c066640 0x7f210c068b00 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2124004820 tx=0x7f2124001480 comp rx=0 tx=0).stop 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21280c2800 0x7f212814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2128070c00 0x7f21280c5000 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 --2- 172.21.15.81:0/2473537579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212806b230 0x7f21280c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 >> 172.21.15.81:0/2473537579 conn(0x7f21280c71b0 msgr2=0x7f2128069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 shutdown_connections 2024-05-08T20:33:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:11.906+0000 7f212f740640 1 -- 172.21.15.81:0/2473537579 wait complete. 2024-05-08T20:33:14.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:33:15.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 Processor -- start 2024-05-08T20:33:15.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 -- start start 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97e80c25b0 0x7f97e806e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 0x7f97e80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e8155a30 con 0x7f97e814e7f0 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e8155610 con 0x7f97e80c25b0 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.066+0000 7f97f0017640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8154aa0 con 0x7f97e814ebd0 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97e80c25b0 0x7f97e806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:15.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ee5b4640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 msgr2=0x7f97e80713d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ee5b4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 0x7f97e80713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97e80c25b0 0x7f97e806e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48892/0 (socket says 172.21.15.81:48892) 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 -- 172.21.15.81:0/1076676103 learned_addr learned my addr 172.21.15.81:0/1076676103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 -- 172.21.15.81:0/1076676103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 msgr2=0x7f97e80713d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 --2- 172.21.15.81:0/1076676103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 0x7f97e80713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 -- 172.21.15.81:0/1076676103 >> v1:172.21.15.81:6789/0 conn(0x7f97e814e7f0 legacy=0x7f97e80c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:15.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 -- 172.21.15.81:0/1076676103 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80aded0 con 0x7f97e80c25b0 2024-05-08T20:33:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ed5b2640 1 --2- 172.21.15.81:0/1076676103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e80c25b0 0x7f97e806e280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009870 tx=0x7f97d801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228dac17fc04adae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ecdb1640 1 -- 172.21.15.81:0/1076676103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80ad680 con 0x7f97e80c25b0 2024-05-08T20:33:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ecdb1640 1 -- 172.21.15.81:0/1076676103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80ad7e0 con 0x7f97e80c25b0 2024-05-08T20:33:15.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97ecdb1640 1 -- 172.21.15.81:0/1076676103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80adb70 con 0x7f97e80c25b0 2024-05-08T20:33:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 -- 172.21.15.81:0/1076676103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e80c25b0 msgr2=0x7f97e806e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 --2- 172.21.15.81:0/1076676103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e80c25b0 0x7f97e806e280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009870 tx=0x7f97d801c580 comp rx=0 tx=0).stop 2024-05-08T20:33:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 -- 172.21.15.81:0/1076676103 shutdown_connections 2024-05-08T20:33:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 --2- 172.21.15.81:0/1076676103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814ebd0 0x7f97e80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 --2- 172.21.15.81:0/1076676103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e80c25b0 0x7f97e806e280 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 -- 172.21.15.81:0/1076676103 >> 172.21.15.81:0/1076676103 conn(0x7f97e80c83a0 msgr2=0x7f97e80c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 -- 172.21.15.81:0/1076676103 shutdown_connections 2024-05-08T20:33:15.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.070+0000 7f97f0017640 1 -- 172.21.15.81:0/1076676103 wait complete. 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 Processor -- start 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- start start 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 0x7f97e814bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 0x7f97e814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e806b040 con 0x7f97e814ebd0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80c5f90 con 0x7f97e80c25b0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e814c2a0 con 0x7f97e814e7f0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ed5b2640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 msgr2=0x7f97e814cdb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ed5b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 0x7f97e814cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48896/0 (socket says 172.21.15.81:48896) 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 -- 172.21.15.81:0/849006031 learned_addr learned my addr 172.21.15.81:0/849006031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97eddb3640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 0x7f97e814bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 -- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 msgr2=0x7f97e814cdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 0x7f97e814cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 -- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 msgr2=0x7f97e814bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 0x7f97e814bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 -- 172.21.15.81:0/849006031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80094d0 con 0x7f97e814ebd0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97eddb3640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 0x7f97e814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97ee5b4640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f97e000b760 tx=0x7f97e000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000c960 con 0x7f97e814ebd0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000cac0 con 0x7f97e814ebd0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e814c540 con 0x7f97e814ebd0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0015470 con 0x7f97e814ebd0 2024-05-08T20:33:15.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e806bce0 con 0x7f97e814ebd0 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.074+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e8066e40 con 0x7f97e814ebd0 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.078+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97e0012070 con 0x7f97e814ebd0 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.078+0000 7f97de7fc640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 0x7f97cc068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.078+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f97e0084230 con 0x7f97e814ebd0 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.078+0000 7f97eddb3640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 0x7f97cc068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.078+0000 7f97eddb3640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 0x7f97cc068b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f97e80c8080 tx=0x7f97e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:15.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.082+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f97e0051290 con 0x7f97e814ebd0 2024-05-08T20:33:15.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.350+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f97e80675e0 con 0x7f97e814ebd0 2024-05-08T20:33:15.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.350+0000 7f97de7fc640 1 -- 172.21.15.81:0/849006031 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f97e00548b0 con 0x7f97e814ebd0 2024-05-08T20:33:15.357 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:33:15.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 msgr2=0x7f97cc068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 0x7f97cc068b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f97e80c8080 tx=0x7f97e4009040 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 msgr2=0x7f97e80c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f97e000b760 tx=0x7f97e000bc20 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 shutdown_connections 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97cc066670 0x7f97cc068b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e814ebd0 0x7f97e80c6750 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97e814e7f0 0x7f97e814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 --2- 172.21.15.81:0/849006031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97e80c25b0 0x7f97e814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 >> 172.21.15.81:0/849006031 conn(0x7f97e80c83a0 msgr2=0x7f97e80c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 shutdown_connections 2024-05-08T20:33:15.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:15.354+0000 7f97f0017640 1 -- 172.21.15.81:0/849006031 wait complete. 2024-05-08T20:33:18.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:33:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 Processor -- start 2024-05-08T20:33:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 -- start start 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c158080 con 0x7f9b4c0c34e0 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c06a890 con 0x7f9b4c152340 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b51972640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c06ab70 con 0x7f9b4c0c2570 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b43fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 msgr2=0x7f9b4c154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b4b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9b4c0c34e0 0x7f9b4c1554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36296/0 (socket says 172.21.15.81:36296) 2024-05-08T20:33:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.526+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/42392008 learned_addr learned my addr 172.21.15.81:0/42392008 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.730+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 msgr2=0x7f9b4c154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:18.730+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:33:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:19.134+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 msgr2=0x7f9b4c154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:19.134+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:33:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:19.938+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 msgr2=0x7f9b4c154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:19.938+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:33:20.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:33:20.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 msgr2=0x7f9b4c154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c0c2570 0x7f9b4c154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 >> v1:172.21.15.117:6789/0 conn(0x7f9b4c152340 legacy=0x7f9b4c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 >> v1:172.21.15.81:6789/0 conn(0x7f9b4c0c34e0 legacy=0x7f9b4c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c06ab70 con 0x7f9b2c0061f0 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c008d30 con 0x7f9b2c003720 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:21.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:21.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:21.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:33:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:33:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b43fff640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:22.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:22.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:33:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 msgr2=0x7f9b2c005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.117:3300/0 conn(0x7f9b2c003720 0x7f9b2c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 msgr2=0x7f9b2c008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c0061f0 0x7f9b2c008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/42392008 reap_dead start 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0c2d70 con 0x7f9b2c0086a0 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c00fa20 con 0x7f9b2c006b10 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b497fa640 1 -- 172.21.15.81:0/42392008 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c06ab70 con 0x7f9b2c003b90 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:24.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:24.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.730+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.730+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:24.730+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:33:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.134+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.134+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:25.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.134+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:33:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.938+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:33:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.938+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:25.938+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:33:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.506+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698852849 0 0) 0x7f9b2c00fa20 con 0x7f9b2c006b10 2024-05-08T20:33:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.506+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b38003530 con 0x7f9b2c006b10 2024-05-08T20:33:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734091295 0 0) 0x7f9b4c0c2d70 con 0x7f9b2c0086a0 2024-05-08T20:33:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b2c00fa20 con 0x7f9b2c0086a0 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636669938 0 0) 0x7f9b2c00fa20 con 0x7f9b2c0086a0 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 msgr2=0x7f9b2c0065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 --2- 172.21.15.81:0/42392008 >> v2:172.21.15.81:3300/0 conn(0x7f9b2c003b90 0x7f9b2c0065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 >> v1:172.21.15.117:6789/0 conn(0x7f9b2c006b10 legacy=0x7f9b2c006f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c010c70 con 0x7f9b2c0086a0 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9b44001880 con 0x7f9b2c0086a0 2024-05-08T20:33:26.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 >> v1:172.21.15.81:6789/0 conn(0x7f9b2c0086a0 legacy=0x7f9b2c00d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 0x7f9b38003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b380047d0 0x7f9b38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b38005190 0x7f9b3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c06ab70 con 0x7f9b38003b10 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3800c0c0 con 0x7f9b380047d0 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.518+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3800c280 con 0x7f9b38005190 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b38005190 msgr2=0x7f9b3800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4b7fe640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b38005190 0x7f9b3800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 0x7f9b38003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b380047d0 0x7f9b38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b38005190 msgr2=0x7f9b3800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b38005190 0x7f9b3800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b380047d0 msgr2=0x7f9b38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b380047d0 0x7f9b38004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/42392008 reap_dead start 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b4affd640 1 -- 172.21.15.81:0/42392008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c010c70 con 0x7f9b38003b10 2024-05-08T20:33:26.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.522+0000 7f9b43fff640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b380047d0 0x7f9b38004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:33:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b4affd640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 0x7f9b38003f10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c01d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf25fe7132327292 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ab420 con 0x7f9b38003b10 2024-05-08T20:33:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0ab580 con 0x7f9b38003b10 2024-05-08T20:33:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b4a7fc640 1 -- 172.21.15.81:0/42392008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ab930 con 0x7f9b38003b10 2024-05-08T20:33:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 -- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 msgr2=0x7f9b38003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 0x7f9b38003f10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c01d8b0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 -- 172.21.15.81:0/42392008 shutdown_connections 2024-05-08T20:33:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 --2- 172.21.15.81:0/42392008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b38003b10 0x7f9b38003f10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 -- 172.21.15.81:0/42392008 >> 172.21.15.81:0/42392008 conn(0x7f9b4c0c71b0 msgr2=0x7f9b4c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 -- 172.21.15.81:0/42392008 shutdown_connections 2024-05-08T20:33:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.526+0000 7f9b51972640 1 -- 172.21.15.81:0/42392008 wait complete. 2024-05-08T20:33:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 Processor -- start 2024-05-08T20:33:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- start start 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b38003b10 0x7f9b4c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 0x7f9b4c140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1ea5c0 con 0x7f9b4c154540 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c152a10 con 0x7f9b38003b10 2024-05-08T20:33:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c141350 con 0x7f9b4c1ee1a0 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b43fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 msgr2=0x7f9b4c140e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 0x7f9b4c140e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b38003b10 0x7f9b4c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38844/0 (socket says 172.21.15.81:38844) 2024-05-08T20:33:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/2855514374 learned_addr learned my addr 172.21.15.81:0/2855514374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 msgr2=0x7f9b4c140e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 0x7f9b4c140e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b38003b10 msgr2=0x7f9b4c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b38003b10 0x7f9b4c14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 -- 172.21.15.81:0/2855514374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c1ee680 con 0x7f9b4c154540 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b4b7fe640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c006160 tx=0x7f9b4400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400a610 con 0x7f9b4c154540 2024-05-08T20:33:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400a770 con 0x7f9b4c154540 2024-05-08T20:33:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c1ea270 con 0x7f9b4c154540 2024-05-08T20:33:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400ab00 con 0x7f9b4c154540 2024-05-08T20:33:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.530+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c153bf0 con 0x7f9b4c154540 2024-05-08T20:33:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b4400ac60 con 0x7f9b4c154540 2024-05-08T20:33:26.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c0675e0 con 0x7f9b4c154540 2024-05-08T20:33:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b48ff9640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 0x7f9b2c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9b44082d40 con 0x7f9b4c154540 2024-05-08T20:33:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b4affd640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 0x7f9b2c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.534+0000 7f9b4affd640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 0x7f9b2c06c540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b0000 tx=0x7f9b3c0b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:26.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.538+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9b4404fd00 con 0x7f9b4c154540 2024-05-08T20:33:26.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.870+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9b4c074950 con 0x7f9b4c154540 2024-05-08T20:33:26.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b48ff9640 1 -- 172.21.15.81:0/2855514374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f9b44053320 con 0x7f9b4c154540 2024-05-08T20:33:26.878 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":58,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:33:26.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 msgr2=0x7f9b2c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 0x7f9b2c06c540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b0000 tx=0x7f9b3c0b5040 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 msgr2=0x7f9b4c1eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c006160 tx=0x7f9b4400ccd0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 shutdown_connections 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b2c06a080 0x7f9b2c06c540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b4c154540 0x7f9b4c1eaa50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1ee1a0 0x7f9b4c140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 --2- 172.21.15.81:0/2855514374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b38003b10 0x7f9b4c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 >> 172.21.15.81:0/2855514374 conn(0x7f9b4c0c71b0 msgr2=0x7f9b4c149f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 shutdown_connections 2024-05-08T20:33:26.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:26.874+0000 7f9b51972640 1 -- 172.21.15.81:0/2855514374 wait complete. 2024-05-08T20:33:26.898 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:33:26.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:33:26.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:33:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 Processor -- start 2024-05-08T20:33:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 -- start start 2024-05-08T20:33:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 0x7f423c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f423c155690 0x7f423c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c1522e0 con 0x7f423c151f00 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c06bb20 con 0x7f423c155690 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f4242be2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1548e0 con 0x7f423c154cf0 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f423bfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 msgr2=0x7f423c155150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f423c155690 0x7f423c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f423bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 0x7f423c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f423c155690 0x7f423c0ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38854/0 (socket says 172.21.15.81:38854) 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 -- 172.21.15.81:0/1329359683 learned_addr learned my addr 172.21.15.81:0/1329359683 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 -- 172.21.15.81:0/1329359683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 msgr2=0x7f423c155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 --2- 172.21.15.81:0/1329359683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 0x7f423c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 -- 172.21.15.81:0/1329359683 >> v1:172.21.15.117:6789/0 conn(0x7f423c151f00 legacy=0x7f423c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.014+0000 7f424117f640 1 -- 172.21.15.81:0/1329359683 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0c5f80 con 0x7f423c155690 2024-05-08T20:33:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f424117f640 1 --2- 172.21.15.81:0/1329359683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c0ca000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e80 tx=0x7f423401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e883772e7d88d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f423b7fe640 1 -- 172.21.15.81:0/1329359683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340a5770 con 0x7f423c155690 2024-05-08T20:33:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f423b7fe640 1 -- 172.21.15.81:0/1329359683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340a58d0 con 0x7f423c155690 2024-05-08T20:33:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f423b7fe640 1 -- 172.21.15.81:0/1329359683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340a5c60 con 0x7f423c155690 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- 172.21.15.81:0/1329359683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 msgr2=0x7f423c0ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- 172.21.15.81:0/1329359683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c0ca000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e80 tx=0x7f423401c910 comp rx=0 tx=0).stop 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- 172.21.15.81:0/1329359683 shutdown_connections 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- 172.21.15.81:0/1329359683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c0ca000 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- 172.21.15.81:0/1329359683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c154cf0 0x7f423c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- 172.21.15.81:0/1329359683 >> 172.21.15.81:0/1329359683 conn(0x7f423c0715f0 msgr2=0x7f423c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- 172.21.15.81:0/1329359683 shutdown_connections 2024-05-08T20:33:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- 172.21.15.81:0/1329359683 wait complete. 2024-05-08T20:33:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 Processor -- start 2024-05-08T20:33:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- start start 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c151f00 0x7f423c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 0x7f423c146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423c0acf60 0x7f423c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1f1390 con 0x7f423c154cf0 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1f0e10 con 0x7f423c0acf60 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.018+0000 7f4242be2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1f10b0 con 0x7f423c151f00 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424097e640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c151f00 msgr2=0x7f423c149ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424097e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c151f00 0x7f423c149ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 0x7f423c146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 0x7f423c146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38862/0 (socket says 172.21.15.81:38862) 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 -- 172.21.15.81:0/2785425836 learned_addr learned my addr 172.21.15.81:0/2785425836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424117f640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423c0acf60 0x7f423c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c151f00 msgr2=0x7f423c149ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f423c151f00 0x7f423c149ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423c0acf60 msgr2=0x7f423c1470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f423c0acf60 0x7f423c1470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009b30 con 0x7f423c154cf0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f423bfff640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 0x7f423c146b60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f422800b530 tx=0x7f422800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228003dd0 con 0x7f423c154cf0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228005070 con 0x7f423c154cf0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c155e50 con 0x7f423c154cf0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228005420 con 0x7f423c154cf0 2024-05-08T20:33:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c1571a0 con 0x7f423c154cf0 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f4242be2640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c1ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c069600 con 0x7f423c155690 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424097e640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c1ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424097e640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f423c155cb0 con 0x7f423c155690 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424097e640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c1ed0b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f423000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300074e0 con 0x7f423c155690 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4228005580 con 0x7f423c154cf0 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4220066730 0x7f4220068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4228084250 con 0x7f423c154cf0 2024-05-08T20:33:27.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424117f640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4220066730 0x7f4220068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4230007640 con 0x7f423c155690 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 msgr2=0x7f423c1ed0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c1ed0b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f423000c8e0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 msgr2=0x7f423c1ed0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f42397fa640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c155690 0x7f423c1ed0b0 secure :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f423000c8e0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.022+0000 7f424117f640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4220066730 0x7f4220068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42340ae000 tx=0x7f42340a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.030+0000 7f4242be2640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 0x7f423c1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.030+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c074950 con 0x7f423c149310 2024-05-08T20:33:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.030+0000 7f424097e640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 0x7f423c1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.030+0000 7f424097e640 1 -- 172.21.15.81:0/2785425836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f423c06ab10 con 0x7f423c149310 2024-05-08T20:33:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.030+0000 7f424097e640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 0x7f423c1ed5f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f4230001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423001f070 con 0x7f423c149310 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f4230004020 con 0x7f423c149310 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 msgr2=0x7f423c1ed5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 0x7f423c1ed5f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f4230001160 comp rx=0 tx=0).stop 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 msgr2=0x7f423c1ed5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f42397fa640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c149310 0x7f423c1ed5f0 secure :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4230001040 tx=0x7f4230001160 comp rx=0 tx=0).stop 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 58, 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:33:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.043 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.045 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:27.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.048 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.049 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.050 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4220066730 msgr2=0x7f4220068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4220066730 0x7f4220068bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42340ae000 tx=0x7f42340a7070 comp rx=0 tx=0).stop 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 msgr2=0x7f423c146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 --2- 172.21.15.81:0/2785425836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f423c154cf0 0x7f423c146b60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f422800b530 tx=0x7f422800b9f0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f424117f640 1 -- 172.21.15.81:0/2785425836 reap_dead start 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f424117f640 1 -- 172.21.15.81:0/2785425836 reap_dead start 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 shutdown_connections 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 >> 172.21.15.81:0/2785425836 conn(0x7f423c0715f0 msgr2=0x7f423c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 shutdown_connections 2024-05-08T20:33:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.034+0000 7f4242be2640 1 -- 172.21.15.81:0/2785425836 wait complete. 2024-05-08T20:33:27.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:33:27.058 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:33:27.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:33:27.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.174+0000 7f1685c23640 1 Processor -- start 2024-05-08T20:33:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.174+0000 7f1685c23640 1 -- start start 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1685c23640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16800ca000 0x7f16800ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1685c23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1680155860 con 0x7f1680154cf0 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1685c23640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16801522e0 con 0x7f1680151f00 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1685c23640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168006bb20 con 0x7f16800ca000 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1677fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1680154cf0 0x7f1680155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52576/0 (socket says 172.21.15.81:52576) 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1677fff640 1 -- 172.21.15.81:0/270803506 learned_addr learned my addr 172.21.15.81:0/270803506 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167ffff640 1 --2- 172.21.15.81:0/270803506 >> v2:172.21.15.117:3300/0 conn(0x7f16800ca000 0x7f16800ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260455759 0 0) 0x7f1680155860 con 0x7f1680154cf0 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f166c003530 con 0x7f1680154cf0 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273430118 0 0) 0x7f166c003530 con 0x7f1680154cf0 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 >> v2:172.21.15.117:3300/0 conn(0x7f16800ca000 msgr2=0x7f16800ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 --2- 172.21.15.81:0/270803506 >> v2:172.21.15.117:3300/0 conn(0x7f16800ca000 0x7f16800ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 >> v1:172.21.15.117:6789/0 conn(0x7f1680151f00 legacy=0x7f16801588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800c5f80 con 0x7f1680154cf0 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1668001680 con 0x7f1680154cf0 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 >> v1:172.21.15.81:6789/0 conn(0x7f1680154cf0 legacy=0x7f1680155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 0x7f166c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f166c0047d0 0x7f166c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c005390 0x7f166c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c00c200 con 0x7f166c003980 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c00c370 con 0x7f166c005390 2024-05-08T20:33:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c00c530 con 0x7f166c0047d0 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1677fff640 1 -- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f166c0047d0 msgr2=0x7f166c004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f1677fff640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f166c0047d0 0x7f166c004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 0x7f166c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167ffff640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c005390 0x7f166c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 -- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f166c0047d0 msgr2=0x7f166c004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f166c0047d0 0x7f166c004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 -- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c005390 msgr2=0x7f166c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c005390 0x7f166c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167ffff640 1 -- 172.21.15.81:0/270803506 reap_dead start 2024-05-08T20:33:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.178+0000 7f167f7fe640 1 -- 172.21.15.81:0/270803506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c003530 con 0x7f166c003980 2024-05-08T20:33:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167f7fe640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 0x7f166c003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1670001780 tx=0x7f167001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d2500145be460e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700052d0 con 0x7f166c003980 2024-05-08T20:33:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16700a7050 con 0x7f166c003980 2024-05-08T20:33:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167effd640 1 -- 172.21.15.81:0/270803506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670003600 con 0x7f166c003980 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 msgr2=0x7f166c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 0x7f166c003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1670001780 tx=0x7f167001c400 comp rx=0 tx=0).stop 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- 172.21.15.81:0/270803506 shutdown_connections 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 --2- 172.21.15.81:0/270803506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f166c003980 0x7f166c003dc0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- 172.21.15.81:0/270803506 >> 172.21.15.81:0/270803506 conn(0x7f16800715f0 msgr2=0x7f1680071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- 172.21.15.81:0/270803506 shutdown_connections 2024-05-08T20:33:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- 172.21.15.81:0/270803506 wait complete. 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 Processor -- start 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- start start 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c003980 0x7f16801f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 0x7f16800acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f168014f700 0x7f16800acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680141650 con 0x7f16801e0330 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800aedd0 con 0x7f166c003980 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1685c23640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16801f1560 con 0x7f168014f700 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167ffff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f168014f700 msgr2=0x7f16800acff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 0x7f16800acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f168014f700 0x7f16800acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 0x7f16800acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38898/0 (socket says 172.21.15.81:38898) 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 -- 172.21.15.81:0/4061887958 learned_addr learned my addr 172.21.15.81:0/4061887958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f167f7fe640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c003980 0x7f16801f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f168014f700 msgr2=0x7f16800acff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f168014f700 0x7f16800acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c003980 msgr2=0x7f16801f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f166c003980 0x7f16801f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.182+0000 7f1677fff640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680158e70 con 0x7f16801e0330 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f1677fff640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 0x7f16800acab0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f166800c730 tx=0x7f166800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680072d0 con 0x7f16801e0330 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668007450 con 0x7f16801e0330 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16801f1840 con 0x7f16801e0330 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680047f0 con 0x7f16801e0330 2024-05-08T20:33:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16800af0b0 con 0x7f16801e0330 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f1685c23640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 0x7f16800c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16801f1420 con 0x7f168014f1b0 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167f7fe640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 0x7f16800c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1668004950 con 0x7f16801e0330 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167f7fe640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1680158cf0 con 0x7f168014f1b0 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1660066640 0x7f1660068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1668083840 con 0x7f16801e0330 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167ffff640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1660066640 0x7f1660068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167f7fe640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 0x7f16800c3410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c340 tx=0x7f166c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670007240 con 0x7f168014f1b0 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167ffff640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1660066640 0x7f1660068b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16800caee0 tx=0x7f1678007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f16700073a0 con 0x7f168014f1b0 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 msgr2=0x7f16800c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 0x7f16800c3410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c340 tx=0x7f166c005800 comp rx=0 tx=0).stop 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 msgr2=0x7f16800c3410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.186+0000 7f167cff9640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f168014f1b0 0x7f16800c3410 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c340 tx=0x7f166c005800 comp rx=0 tx=0).stop 2024-05-08T20:33:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.194+0000 7f1685c23640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 0x7f16801ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.194+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680069600 con 0x7f16800c3950 2024-05-08T20:33:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.194+0000 7f167f7fe640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 0x7f16801ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.194+0000 7f167f7fe640 1 -- 172.21.15.81:0/4061887958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f16800cabf0 con 0x7f16800c3950 2024-05-08T20:33:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.194+0000 7f167f7fe640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 0x7f16801ed540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f167001c440 tx=0x7f16700a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700c4070 con 0x7f16800c3950 2024-05-08T20:33:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7f16700bf320 con 0x7f16800c3950 2024-05-08T20:33:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 msgr2=0x7f16801ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 0x7f16801ed540 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f167001c440 tx=0x7f16700a6000 comp rx=0 tx=0).stop 2024-05-08T20:33:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 msgr2=0x7f16801ed540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167cff9640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16800c3950 0x7f16801ed540 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 58, 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:27.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:27.214 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:27.214 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1660066640 msgr2=0x7f1660068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1660066640 0x7f1660068b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16800caee0 tx=0x7f1678007040 comp rx=0 tx=0).stop 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 msgr2=0x7f16800acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 --2- 172.21.15.81:0/4061887958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16801e0330 0x7f16800acab0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f166800c730 tx=0x7f166800cbf0 comp rx=0 tx=0).stop 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167ffff640 1 -- 172.21.15.81:0/4061887958 reap_dead start 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f167ffff640 1 -- 172.21.15.81:0/4061887958 reap_dead start 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 shutdown_connections 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 >> 172.21.15.81:0/4061887958 conn(0x7f16800715f0 msgr2=0x7f16800719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 shutdown_connections 2024-05-08T20:33:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:27.198+0000 7f1685c23640 1 -- 172.21.15.81:0/4061887958 wait complete. 2024-05-08T20:33:27.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:33:27.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:33:47.226 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:33:47.226 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:33:47.226 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:33:47.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:33:47.230 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:33:47.230 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:33:47.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:33:47.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 Processor -- start 2024-05-08T20:33:47.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 -- start start 2024-05-08T20:33:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f5c0ca000 0x7f1f5c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c155860 con 0x7f1f5c154cf0 2024-05-08T20:33:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c1522e0 con 0x7f1f5c151f00 2024-05-08T20:33:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f647d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c06bb20 con 0x7f1f5c0ca000 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f61d6f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1f5c154cf0 0x7f1f5c155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40564/0 (socket says 172.21.15.81:40564) 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f61d6f640 1 -- 172.21.15.81:0/3978251368 learned_addr learned my addr 172.21.15.81:0/3978251368 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f62d71640 1 --2- 172.21.15.81:0/3978251368 >> v2:172.21.15.117:3300/0 conn(0x7f1f5c0ca000 0x7f1f5c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f6156e640 1 -- 172.21.15.81:0/3978251368 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693664193 0 0) 0x7f1f5c155860 con 0x7f1f5c154cf0 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f6156e640 1 -- 172.21.15.81:0/3978251368 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003530 con 0x7f1f5c154cf0 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f62d71640 1 -- 172.21.15.81:0/3978251368 >> v1:172.21.15.117:6789/0 conn(0x7f1f5c151f00 legacy=0x7f1f5c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f62d71640 1 -- 172.21.15.81:0/3978251368 >> v1:172.21.15.81:6789/0 conn(0x7f1f5c154cf0 legacy=0x7f1f5c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.369+0000 7f1f62d71640 1 -- 172.21.15.81:0/3978251368 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0c5f80 con 0x7f1f5c0ca000 2024-05-08T20:33:47.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f62d71640 1 --2- 172.21.15.81:0/3978251368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c0ca000 0x7f1f5c0ca440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c155a50 tx=0x7f1f4c01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8711728278a63750 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f6156e640 1 -- 172.21.15.81:0/3978251368 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a5910 con 0x7f1f5c0ca000 2024-05-08T20:33:47.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f6156e640 1 -- 172.21.15.81:0/3978251368 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0a5a70 con 0x7f1f5c0ca000 2024-05-08T20:33:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f6156e640 1 -- 172.21.15.81:0/3978251368 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a5de0 con 0x7f1f5c0ca000 2024-05-08T20:33:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 -- 172.21.15.81:0/3978251368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c0ca000 msgr2=0x7f1f5c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 --2- 172.21.15.81:0/3978251368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c0ca000 0x7f1f5c0ca440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c155a50 tx=0x7f1f4c01c830 comp rx=0 tx=0).stop 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 -- 172.21.15.81:0/3978251368 shutdown_connections 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 --2- 172.21.15.81:0/3978251368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c0ca000 0x7f1f5c0ca440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 -- 172.21.15.81:0/3978251368 >> 172.21.15.81:0/3978251368 conn(0x7f1f5c0715f0 msgr2=0x7f1f5c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 -- 172.21.15.81:0/3978251368 shutdown_connections 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.373+0000 7f1f647d4640 1 -- 172.21.15.81:0/3978251368 wait complete. 2024-05-08T20:33:47.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 Processor -- start 2024-05-08T20:33:47.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- start start 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c151f00 0x7f1f5c0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1494f0 con 0x7f1f5c154cf0 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c155da0 con 0x7f1f5c151f00 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1f1120 con 0x7f1f5c0ca000 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43332/0 (socket says 172.21.15.81:43332) 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 -- 172.21.15.81:0/3485812291 learned_addr learned my addr 172.21.15.81:0/3485812291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:47.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f61d6f640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c151f00 0x7f1f5c0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62570640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62570640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 msgr2=0x7f1f5c0adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62570640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 msgr2=0x7f1f5c0adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62570640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62570640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 msgr2=0x7f1f5c0adf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c151f00 msgr2=0x7f1f5c0ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c151f00 0x7f1f5c0ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 -- 172.21.15.81:0/3485812291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009a70 con 0x7f1f5c154cf0 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f62d71640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c01cd10 tx=0x7f1f4c0195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c003ba0 con 0x7f1f5c154cf0 2024-05-08T20:33:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c003d00 con 0x7f1f5c154cf0 2024-05-08T20:33:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- 172.21.15.81:0/3485812291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c156040 con 0x7f1f5c154cf0 2024-05-08T20:33:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0ad850 con 0x7f1f5c154cf0 2024-05-08T20:33:47.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.377+0000 7f1f647d4640 1 -- 172.21.15.81:0/3485812291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0ada40 con 0x7f1f5c154cf0 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0adc30 con 0x7f1f5c154cf0 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f4c0b4070 con 0x7f1f5c154cf0 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f5affd640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 0x7f1f48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1f4c11ed70 con 0x7f1f5c154cf0 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f62570640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 0x7f1f48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.381+0000 7f1f62570640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 0x7f1f48068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c14dad0 tx=0x7f1f54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.385+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1f4c0ebef0 con 0x7f1f5c154cf0 2024-05-08T20:33:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.677+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f5c074950 con 0x7f1f5c154cf0 2024-05-08T20:33:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.677+0000 7f1f5affd640 1 -- 172.21.15.81:0/3485812291 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f1f4c0b2020 con 0x7f1f5c154cf0 2024-05-08T20:33:47.683 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 msgr2=0x7f1f48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 0x7f1f48068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c14dad0 tx=0x7f1f54009040 comp rx=0 tx=0).stop 2024-05-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 msgr2=0x7f1f5c1f05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c01cd10 tx=0x7f1f4c0195d0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 shutdown_connections 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f48066690 0x7f1f48068b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c154cf0 0x7f1f5c1f05b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f5c151f00 0x7f1f5c0ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/3485812291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f5c0ca000 0x7f1f5c0adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 >> 172.21.15.81:0/3485812291 conn(0x7f1f5c0715f0 msgr2=0x7f1f5c0ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 shutdown_connections 2024-05-08T20:33:47.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.681+0000 7f1f58ff9640 1 -- 172.21.15.81:0/3485812291 wait complete. 2024-05-08T20:33:47.704 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:33:47.704 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:33:47.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:33:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.821+0000 7eff5b9a5640 1 Processor -- start 2024-05-08T20:33:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.821+0000 7eff5b9a5640 1 -- start start 2024-05-08T20:33:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.821+0000 7eff5b9a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff5406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff5b9a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff54158080 con 0x7eff5406d7d0 2024-05-08T20:33:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff5b9a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5406a890 con 0x7eff540c2570 2024-05-08T20:33:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff5b9a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5406ab70 con 0x7eff54152340 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59f42640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff5406d7d0 0x7eff5415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40566/0 (socket says 172.21.15.81:40566) 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59f42640 1 -- 172.21.15.81:0/420109627 learned_addr learned my addr 172.21.15.81:0/420109627 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff5406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 msgr2=0x7eff5406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 msgr2=0x7eff5406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff5406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff5406d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134765854 0 0) 0x7eff54158080 con 0x7eff5406d7d0 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff40003530 con 0x7eff5406d7d0 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937836424 0 0) 0x7eff5406a890 con 0x7eff540c2570 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff54158080 con 0x7eff540c2570 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2552379031 0 0) 0x7eff40003530 con 0x7eff5406d7d0 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 msgr2=0x7eff5406d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff5406d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 >> v1:172.21.15.117:6789/0 conn(0x7eff540c2570 legacy=0x7eff54154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540c2d70 con 0x7eff5406d7d0 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7eff4c001a00 con 0x7eff5406d7d0 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 >> v1:172.21.15.81:6789/0 conn(0x7eff5406d7d0 legacy=0x7eff5415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff40004ba0 0x7eff40004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40003770 0x7eff40003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff40004200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5406ab70 con 0x7eff40004ba0 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000bb50 con 0x7eff40003770 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4000bd10 con 0x7eff54152340 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff40004ba0 0x7eff40004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff58f40640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40003770 0x7eff40003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59f42640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff40004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 msgr2=0x7eff40004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff54152340 0x7eff40004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40003770 msgr2=0x7eff40003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40003770 0x7eff40003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 -- 172.21.15.81:0/420109627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40003530 con 0x7eff40004ba0 2024-05-08T20:33:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.825+0000 7eff59741640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff40004ba0 0x7eff40004fa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c820 tx=0x7eff5001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827c47d550b113f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500ad640 con 0x7eff40004ba0 2024-05-08T20:33:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff500ad7a0 con 0x7eff40004ba0 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff4bfff640 1 -- 172.21.15.81:0/420109627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500adb50 con 0x7eff40004ba0 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- 172.21.15.81:0/420109627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff40004ba0 msgr2=0x7eff40004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 --2- 172.21.15.81:0/420109627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff40004ba0 0x7eff40004fa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c820 tx=0x7eff5001c450 comp rx=0 tx=0).stop 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 -- 172.21.15.81:0/420109627 reap_dead start 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- 172.21.15.81:0/420109627 shutdown_connections 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- 172.21.15.81:0/420109627 >> 172.21.15.81:0/420109627 conn(0x7eff540c71b0 msgr2=0x7eff540c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- 172.21.15.81:0/420109627 shutdown_connections 2024-05-08T20:33:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- 172.21.15.81:0/420109627 wait complete. 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 Processor -- start 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- start start 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40004ba0 0x7eff54147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 0x7eff541f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 0x7eff541f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff541514b0 con 0x7eff541518e0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5414fb70 con 0x7eff40004ba0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff5b9a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54140390 con 0x7eff541606a0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 0x7eff541f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 0x7eff541f1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43356/0 (socket says 172.21.15.81:43356) 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 learned_addr learned my addr 172.21.15.81:0/2670827655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59741640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40004ba0 0x7eff54147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff58f40640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 0x7eff541f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff58f40640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 msgr2=0x7eff541f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff58f40640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 msgr2=0x7eff541f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff58f40640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 0x7eff541f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff58f40640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 0x7eff541f1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 msgr2=0x7eff541f1340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff541606a0 0x7eff541f1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40004ba0 msgr2=0x7eff54147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff40004ba0 0x7eff54147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.829+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54140670 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff59f42640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 0x7eff541f1880 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001c40 tx=0x7eff4c007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00ab30 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00acd0 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff541477d0 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c013630 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff54148e90 con 0x7eff541518e0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff5b9a5640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 0x7eff54147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54069550 con 0x7eff54155670 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff59741640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 0x7eff54147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff59741640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff54151620 con 0x7eff54155670 2024-05-08T20:33:47.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff59741640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 0x7eff54147ac0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7eff50000ee0 tx=0x7eff40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500b83f0 con 0x7eff54155670 2024-05-08T20:33:47.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff4c013790 con 0x7eff541518e0 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff38066730 0x7eff38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7eff4c084a20 con 0x7eff541518e0 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff58f40640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff38066730 0x7eff38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7eff500a6040 con 0x7eff54155670 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 msgr2=0x7eff54147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 0x7eff54147ac0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7eff50000ee0 tx=0x7eff40005800 comp rx=0 tx=0).stop 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 msgr2=0x7eff54147ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff49ffb640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54155670 0x7eff54147ac0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.833+0000 7eff58f40640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff38066730 0x7eff38068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff54158050 tx=0x7eff44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 0x7eff54148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54148950 con 0x7eff54148000 2024-05-08T20:33:47.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff59741640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 0x7eff54148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff59741640 1 -- 172.21.15.81:0/2670827655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7eff540675e0 con 0x7eff54148000 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff59741640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 0x7eff54148410 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c820 tx=0x7eff500a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500c8070 con 0x7eff54148000 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7eff500c2660 con 0x7eff54148000 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 msgr2=0x7eff54148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 0x7eff54148410 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c820 tx=0x7eff500a7070 comp rx=0 tx=0).stop 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 msgr2=0x7eff54148410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:47.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff49ffb640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff54148000 0x7eff54148410 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:47.862 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff38066730 msgr2=0x7eff38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff38066730 0x7eff38068bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff54158050 tx=0x7eff44009040 comp rx=0 tx=0).stop 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 msgr2=0x7eff541f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 --2- 172.21.15.81:0/2670827655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff541518e0 0x7eff541f1880 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001c40 tx=0x7eff4c007b20 comp rx=0 tx=0).stop 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 reap_dead start 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff59f42640 1 -- 172.21.15.81:0/2670827655 reap_dead start 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 shutdown_connections 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 >> 172.21.15.81:0/2670827655 conn(0x7eff540c71b0 msgr2=0x7eff540c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 shutdown_connections 2024-05-08T20:33:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.841+0000 7eff5b9a5640 1 -- 172.21.15.81:0/2670827655 wait complete. 2024-05-08T20:33:47.867 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:47.867 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:33:47.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:33:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 Processor -- start 2024-05-08T20:33:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 -- start start 2024-05-08T20:33:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7f40c1bb0 0x7ff7f4151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40c2420 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f4155060 con 0x7ff7f41535a0 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7fbc32640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f4155340 con 0x7ff7f40c1bb0 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f91cd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7f40c1f90 0x7ff7f4152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40568/0 (socket says 172.21.15.81:40568) 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f91cd640 1 -- 172.21.15.81:0/61770307 learned_addr learned my addr 172.21.15.81:0/61770307 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/61770307 >> v2:172.21.15.117:3300/0 conn(0x7ff7f40c1bb0 0x7ff7f4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094879670 0 0) 0x7ff7e4001120 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e0003530 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4163706534 0 0) 0x7ff7e0003530 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 >> v2:172.21.15.117:3300/0 conn(0x7ff7f40c1bb0 msgr2=0x7ff7f4151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 --2- 172.21.15.81:0/61770307 >> v2:172.21.15.117:3300/0 conn(0x7ff7f40c1bb0 0x7ff7f4151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 >> v1:172.21.15.117:6789/0 conn(0x7ff7f41535a0 legacy=0x7ff7f415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4155620 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff7e4001810 con 0x7ff7f40c1f90 2024-05-08T20:33:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.989+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 >> v1:172.21.15.81:6789/0 conn(0x7ff7f40c1f90 legacy=0x7ff7f4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0003980 0x7ff7e0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 0x7ff7e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7e00050f0 0x7ff7e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4155340 con 0x7ff7e0004380 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e000c030 con 0x7ff7e0003980 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e000c1f0 con 0x7ff7e00050f0 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 0x7ff7e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0003980 0x7ff7e0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7e00050f0 0x7ff7e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 -- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7e00050f0 msgr2=0x7ff7e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7e00050f0 0x7ff7e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 -- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0003980 msgr2=0x7ff7e0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0003980 0x7ff7e0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 -- 172.21.15.81:0/61770307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0003530 con 0x7ff7e0004380 2024-05-08T20:33:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7e00050f0 0x7ff7e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:33:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0003980 0x7ff7e0003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:33:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7fa1cf640 1 -- 172.21.15.81:0/61770307 reap_dead start 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 0x7ff7e0004850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c1c0 tx=0x7ff7e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2776849d8e1f99ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40a5b40 con 0x7ff7e0004380 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a5cc0 con 0x7ff7e0004380 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.993+0000 7ff7f89cc640 1 -- 172.21.15.81:0/61770307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4005b20 con 0x7ff7e0004380 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 msgr2=0x7ff7e0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 0x7ff7e0004850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c1c0 tx=0x7ff7e401cc40 comp rx=0 tx=0).stop 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/61770307 shutdown_connections 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/61770307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e0004380 0x7ff7e0004850 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/61770307 >> 172.21.15.81:0/61770307 conn(0x7ff7f40c2ca0 msgr2=0x7ff7f40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/61770307 shutdown_connections 2024-05-08T20:33:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/61770307 wait complete. 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 Processor -- start 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- start start 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0004380 0x7ff7f41519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 0x7ff7f41ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 0x7ff7f41edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40aa5d0 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f409b2b0 con 0x7ff7e0004380 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f409ab60 con 0x7ff7f40aae70 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 0x7ff7f41ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 0x7ff7f41ed840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43400/0 (socket says 172.21.15.81:43400) 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 -- 172.21.15.81:0/2457465636 learned_addr learned my addr 172.21.15.81:0/2457465636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0004380 0x7ff7f41519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 0x7ff7f41edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fa1cf640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 msgr2=0x7ff7f41edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fa1cf640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 msgr2=0x7ff7f41edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 0x7ff7f41edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 0x7ff7f41edd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 msgr2=0x7ff7f41edd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f40aae70 0x7ff7f41edd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0004380 msgr2=0x7ff7f41519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e0004380 0x7ff7f41519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f409ae40 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7f91cd640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 0x7ff7f41ed840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff7e401ca70 tx=0x7ff7e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40b3070 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a5b50 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f409b570 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004a10 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:47.997+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40a9340 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 0x7ff7f40bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f409afd0 con 0x7ff7f41ee2c0 2024-05-08T20:33:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 0x7ff7f40bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7f99ce640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7f40a9530 con 0x7ff7f41ee2c0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7e4004b70 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 0x7ff7f40bf5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00138b0 tx=0x7ff7f0013d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7d80666c0 0x7ff7d8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff7e411de40 con 0x7ff7f40aa0d0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7d80666c0 0x7ff7d8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004440 con 0x7ff7f41ee2c0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7fa1cf640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7d80666c0 0x7ff7d8068b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4073fc0 tx=0x7ff7ec0075c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff7f00118b0 con 0x7ff7f41ee2c0 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 msgr2=0x7ff7f40bf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 0x7ff7f40bf5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00138b0 tx=0x7ff7f0013d70 comp rx=0 tx=0).stop 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 msgr2=0x7ff7f40bf5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.001+0000 7ff7ea7fc640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f41ee2c0 0x7ff7f40bf5d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 0x7ff7f40bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40696e0 con 0x7ff7f40bfb10 2024-05-08T20:33:48.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 0x7ff7f40bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7f99ce640 1 -- 172.21.15.81:0/2457465636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff7f406ad10 con 0x7ff7f40bfb10 2024-05-08T20:33:48.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7f99ce640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 0x7ff7f40bff20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00138b0 tx=0x7ff7f00046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0003c10 con 0x7ff7f40bfb10 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7ff7f0022e70 con 0x7ff7f40bfb10 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 msgr2=0x7ff7f40bff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 0x7ff7f40bff20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00138b0 tx=0x7ff7f00046d0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 msgr2=0x7ff7f40bff20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:48.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.009+0000 7ff7ea7fc640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f40bfb10 0x7ff7f40bff20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:48.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:48.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:48.029 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:48.029 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7d80666c0 msgr2=0x7ff7d8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7d80666c0 0x7ff7d8068b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4073fc0 tx=0x7ff7ec0075c0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 msgr2=0x7ff7f41ed840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 --2- 172.21.15.81:0/2457465636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f40aa0d0 0x7ff7f41ed840 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff7e401ca70 tx=0x7ff7e0005800 comp rx=0 tx=0).stop 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fa1cf640 1 -- 172.21.15.81:0/2457465636 reap_dead start 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fa1cf640 1 -- 172.21.15.81:0/2457465636 reap_dead start 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 shutdown_connections 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 >> 172.21.15.81:0/2457465636 conn(0x7ff7f40c2ca0 msgr2=0x7ff7f4070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 shutdown_connections 2024-05-08T20:33:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.013+0000 7ff7fbc32640 1 -- 172.21.15.81:0/2457465636 wait complete. 2024-05-08T20:33:48.034 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:48.034 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:33:48.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.149+0000 7f2a6881b640 1 Processor -- start 2024-05-08T20:33:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6881b640 1 -- start start 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6881b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a640c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6881b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a64155e10 con 0x7f2a640a94b0 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6881b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a64156080 con 0x7f2a640c2bc0 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6881b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6406e790 con 0x7f2a640c30d0 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a62d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a640a94b0 0x7f2a640a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40572/0 (socket says 172.21.15.81:40572) 2024-05-08T20:33:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2825970987 learned_addr learned my addr 172.21.15.81:0/2825970987 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a640c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53070347 0 0) 0x7f2a64155e10 con 0x7f2a640a94b0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a4c003530 con 0x7f2a640a94b0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 msgr2=0x7f2a640c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 msgr2=0x7f2a640c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a640c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a640c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684220069 0 0) 0x7f2a4c003530 con 0x7f2a640a94b0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 msgr2=0x7f2a640c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a640c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 >> v1:172.21.15.117:6789/0 conn(0x7f2a640c2bc0 legacy=0x7f2a640c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64156360 con 0x7f2a640a94b0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2a5c001a00 con 0x7f2a640a94b0 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 >> v1:172.21.15.81:6789/0 conn(0x7f2a640a94b0 legacy=0x7f2a640a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c0039b0 0x7f2a4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c004d10 0x7f2a4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6406e790 con 0x7f2a4c0039b0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c00bb20 con 0x7f2a4c004d10 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c00bcb0 con 0x7f2a640c30d0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c0039b0 0x7f2a4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c004d10 0x7f2a4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 msgr2=0x7f2a4c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a4c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c004d10 msgr2=0x7f2a4c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c004d10 0x7f2a4c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a6259c640 1 -- 172.21.15.81:0/2825970987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c003530 con 0x7f2a4c0039b0 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c004d10 0x7f2a4c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:33:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.153+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640c30d0 0x7f2a4c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:33:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c0039b0 0x7f2a4c003d90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c820 tx=0x7f2a5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dd27d907555f15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540ab610 con 0x7f2a4c0039b0 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a540ab770 con 0x7f2a4c0039b0 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6159a640 1 -- 172.21.15.81:0/2825970987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540abb20 con 0x7f2a4c0039b0 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- 172.21.15.81:0/2825970987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c0039b0 msgr2=0x7f2a4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2825970987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c0039b0 0x7f2a4c003d90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c820 tx=0x7f2a5401c4d0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2825970987 reap_dead start 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- 172.21.15.81:0/2825970987 shutdown_connections 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- 172.21.15.81:0/2825970987 >> 172.21.15.81:0/2825970987 conn(0x7f2a640c4cc0 msgr2=0x7f2a640c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- 172.21.15.81:0/2825970987 shutdown_connections 2024-05-08T20:33:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- 172.21.15.81:0/2825970987 wait complete. 2024-05-08T20:33:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 Processor -- start 2024-05-08T20:33:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- start start 2024-05-08T20:33:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0039b0 0x7f2a640c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 0x7f2a64150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64151f50 con 0x7f2a64150e80 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64151b90 con 0x7f2a4c0039b0 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6881b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a641535f0 con 0x7f2a641503e0 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a62d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a62d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43418/0 (socket says 172.21.15.81:43418) 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2364612457 learned_addr learned my addr 172.21.15.81:0/2364612457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 0x7f2a64150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0039b0 0x7f2a640c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a61d9b640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 msgr2=0x7f2a64150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.157+0000 7f2a61d9b640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 msgr2=0x7f2a64150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 0x7f2a64150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 0x7f2a64150940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 msgr2=0x7f2a64150940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641503e0 0x7f2a64150940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0039b0 msgr2=0x7f2a640c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a4c0039b0 0x7f2a640c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a641ed850 con 0x7f2a64150e80 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001470 tx=0x7f2a5c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c007ae0 con 0x7f2a64150e80 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00eca0 con 0x7f2a64150e80 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a64153030 con 0x7f2a64150e80 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c013420 con 0x7f2a64150e80 2024-05-08T20:33:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a641ed200 con 0x7f2a64150e80 2024-05-08T20:33:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64073ea0 con 0x7f2a641ed3c0 2024-05-08T20:33:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a5c013580 con 0x7f2a64150e80 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 0x7f2a44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2a5c0846a0 con 0x7f2a64150e80 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 0x7f2a44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.161+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 0x7f2a44068b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a64155ed0 tx=0x7f2a58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.365+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.365+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:33:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.365+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.365+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.365+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:33:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.769+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.769+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:33:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.769+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.769+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:48.769+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:33:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:49.573+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:49.573+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:33:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:49.573+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:49.573+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:49.573+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:33:50.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:33:50.730 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:33:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:51.177+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:51.177+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:33:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:51.177+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:51.177+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:51.177+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T20:33:52.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 msgr2=0x7f2a64155370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641ed3c0 0x7f2a64155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.157+0000 7f2a51ffb640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c006090 con 0x7f2a3c003550 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.161+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 msgr2=0x7f2a3c0059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.161+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 msgr2=0x7f2a3c0059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:33:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.161+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:33:52.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a3c006200 con 0x7f2a3c003550 2024-05-08T20:33:52.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004750 tx=0x7f2a4c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:52.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540abcf0 con 0x7f2a3c003550 2024-05-08T20:33:52.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2a540abe50 con 0x7f2a3c003550 2024-05-08T20:33:52.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 msgr2=0x7f2a3c0059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004750 tx=0x7f2a4c005800 comp rx=0 tx=0).stop 2024-05-08T20:33:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 msgr2=0x7f2a3c0059e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.365+0000 7f2a52ffd640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a3c003550 0x7f2a3c0059e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.373+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 0x7f2a641558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.373+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a641ed060 con 0x7f2a641edcc0 2024-05-08T20:33:52.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.373+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 0x7f2a641558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.373+0000 7f2a6259c640 1 -- 172.21.15.81:0/2364612457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2a641ed9e0 con 0x7f2a641edcc0 2024-05-08T20:33:52.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6259c640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 0x7f2a641558b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401c300 tx=0x7f2a540b7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:52.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540cc2e0 con 0x7f2a641edcc0 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f2a540c0b10 con 0x7f2a641edcc0 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 msgr2=0x7f2a641558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 0x7f2a641558b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401c300 tx=0x7f2a540b7040 comp rx=0 tx=0).stop 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 msgr2=0x7f2a641558b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a62d9d640 1 -- 172.21.15.81:0/2364612457 reap_dead start 2024-05-08T20:33:52.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a52ffd640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a641edcc0 0x7f2a641558b0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401c300 tx=0x7f2a540b7040 comp rx=0 tx=0).stop 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:52.384 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:52.385 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.386 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:33:52.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:33:52.388 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:33:52.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:33:52.392 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:33:52.394 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:33:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:33:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:33:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:33:52.395 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:33:52.395 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 msgr2=0x7f2a44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 0x7f2a44068b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a64155ed0 tx=0x7f2a58009040 comp rx=0 tx=0).stop 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 msgr2=0x7f2a64154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001470 tx=0x7f2a5c00e530 comp rx=0 tx=0).stop 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 shutdown_connections 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a440666c0 0x7f2a44068b80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 --2- 172.21.15.81:0/2364612457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a64150e80 0x7f2a64154e30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 >> 172.21.15.81:0/2364612457 conn(0x7f2a640c4cc0 msgr2=0x7f2a6406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 shutdown_connections 2024-05-08T20:33:52.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.377+0000 7f2a6881b640 1 -- 172.21.15.81:0/2364612457 wait complete. 2024-05-08T20:33:52.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:33:52.406 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:33:52.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:33:52.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 Processor -- start 2024-05-08T20:33:52.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 -- start start 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2834152220 0x7f28341555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28340aac30 0x7f28340c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2834155140 con 0x7f28340c26e0 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28340c4780 con 0x7f2834152220 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f283b74e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c32d0 con 0x7f28340aac30 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f28394ea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2834152220 0x7f28341555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f2838ce9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28340c26e0 0x7f28340c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38826/0 (socket says 172.21.15.81:38826) 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f2838ce9640 1 -- 172.21.15.81:0/2636140571 learned_addr learned my addr 172.21.15.81:0/2636140571 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f2839ceb640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28340aac30 0x7f28340c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f28394ea640 1 -- 172.21.15.81:0/2636140571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28340aac30 msgr2=0x7f28340c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:33:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f28394ea640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28340aac30 0x7f28340c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f28394ea640 1 -- 172.21.15.81:0/2636140571 >> v1:172.21.15.81:6789/0 conn(0x7f28340c26e0 legacy=0x7f28340c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f28394ea640 1 -- 172.21.15.81:0/2636140571 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834072650 con 0x7f2834152220 2024-05-08T20:33:52.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.537+0000 7f282bfff640 1 -- 172.21.15.81:0/2636140571 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435996954 0 0) 0x7f2834155140 con 0x7f28340c26e0 2024-05-08T20:33:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f28394ea640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834152220 0x7f28341555d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f28300097c0 tx=0x7f283001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b377c68a2e8908 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f282bfff640 1 -- 172.21.15.81:0/2636140571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300ac640 con 0x7f2834152220 2024-05-08T20:33:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f282bfff640 1 -- 172.21.15.81:0/2636140571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300ac7a0 con 0x7f2834152220 2024-05-08T20:33:52.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f282bfff640 1 -- 172.21.15.81:0/2636140571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300acb30 con 0x7f2834152220 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 -- 172.21.15.81:0/2636140571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834152220 msgr2=0x7f28341555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834152220 0x7f28341555d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f28300097c0 tx=0x7f283001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 -- 172.21.15.81:0/2636140571 shutdown_connections 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28340aac30 0x7f28340c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 --2- 172.21.15.81:0/2636140571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2834152220 0x7f28341555d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 -- 172.21.15.81:0/2636140571 >> 172.21.15.81:0/2636140571 conn(0x7f28340c4cc0 msgr2=0x7f28340c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 -- 172.21.15.81:0/2636140571 shutdown_connections 2024-05-08T20:33:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.541+0000 7f283b74e640 1 -- 172.21.15.81:0/2636140571 wait complete. 2024-05-08T20:33:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 Processor -- start 2024-05-08T20:33:52.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- start start 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 0x7f28340ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2834152220 0x7f28340c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28341f1550 con 0x7f28340aac30 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c7f90 con 0x7f28340c26e0 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c79d0 con 0x7f2834152220 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45918/0 (socket says 172.21.15.81:45918) 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 -- 172.21.15.81:0/2111120325 learned_addr learned my addr 172.21.15.81:0/2111120325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2838ce9640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 0x7f28340ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2839ceb640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2834152220 0x7f28340c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 -- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2834152220 msgr2=0x7f28340c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2834152220 0x7f28340c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 -- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 msgr2=0x7f28340ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 0x7f28340ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 -- 172.21.15.81:0/2111120325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830009420 con 0x7f28340aac30 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2838ce9640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 0x7f28340ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f28394ea640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f283001aa90 tx=0x7f283001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300b7830 con 0x7f28340aac30 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300b7990 con 0x7f28340aac30 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28340c7cb0 con 0x7f28340aac30 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28300b7d40 con 0x7f28340aac30 2024-05-08T20:33:52.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28340c6990 con 0x7f28340aac30 2024-05-08T20:33:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2834074950 con 0x7f28340aac30 2024-05-08T20:33:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.545+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28300b3040 con 0x7f28340aac30 2024-05-08T20:33:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.549+0000 7f2829ffb640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 0x7f2818068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:33:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.549+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f283011ede0 con 0x7f28340aac30 2024-05-08T20:33:52.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.549+0000 7f2838ce9640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 0x7f2818068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:33:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.549+0000 7f2838ce9640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 0x7f2818068b80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2824007fd0 tx=0x7f2824007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:33:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.553+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f28300ebe40 con 0x7f28340aac30 2024-05-08T20:33:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.801+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f28340c2ac0 con 0x7f28340aac30 2024-05-08T20:33:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.801+0000 7f2829ffb640 1 -- 172.21.15.81:0/2111120325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f28300bb080 con 0x7f28340aac30 2024-05-08T20:33:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 msgr2=0x7f2818068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 0x7f2818068b80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2824007fd0 tx=0x7f2824007c20 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 msgr2=0x7f28341f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f283001aa90 tx=0x7f283001ac20 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 shutdown_connections 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f28180666c0 0x7f2818068b80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2834152220 0x7f28340c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28340c26e0 0x7f28340ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 --2- 172.21.15.81:0/2111120325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28340aac30 0x7f28341f1010 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 >> 172.21.15.81:0/2111120325 conn(0x7f28340c4cc0 msgr2=0x7f2834153ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 shutdown_connections 2024-05-08T20:33:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:33:52.805+0000 7f283b74e640 1 -- 172.21.15.81:0/2111120325 wait complete. 2024-05-08T20:33:52.834 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:34:02.835 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:34:02.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:34:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.961+0000 7fa1b9f59640 1 Processor -- start 2024-05-08T20:34:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.961+0000 7fa1b9f59640 1 -- start start 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.961+0000 7fa1b9f59640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1b414fe70 0x7fa1b406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b9f59640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa1b406a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b9f59640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b4152ab0 con 0x7fa1b4155e90 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b9f59640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b41528a0 con 0x7fa1b414fe70 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b9f59640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4152d90 con 0x7fa1b406d7d0 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa1b4155e90 0x7fa1b4069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34488/0 (socket says 172.21.15.81:34488) 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 -- 172.21.15.81:0/1099996170 learned_addr learned my addr 172.21.15.81:0/1099996170 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b37fe640 1 --2- 172.21.15.81:0/1099996170 >> v2:172.21.15.117:3300/0 conn(0x7fa1b414fe70 0x7fa1b406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b3fff640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa1b406a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360295348 0 0) 0x7fa1b4152ab0 con 0x7fa1b4155e90 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa19c003530 con 0x7fa1b4155e90 2024-05-08T20:34:02.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657401083 0 0) 0x7fa19c003530 con 0x7fa1b4155e90 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 msgr2=0x7fa1b406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa1b406a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 >> v2:172.21.15.117:3300/0 conn(0x7fa1b414fe70 msgr2=0x7fa1b406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 --2- 172.21.15.81:0/1099996170 >> v2:172.21.15.117:3300/0 conn(0x7fa1b414fe70 0x7fa1b406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4153070 con 0x7fa1b4155e90 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa1a8001680 con 0x7fa1b4155e90 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 >> v1:172.21.15.81:6789/0 conn(0x7fa1b4155e90 legacy=0x7fa1b4069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa19c003980 0x7fa19c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19c0047d0 0x7fa19c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa19c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41528a0 con 0x7fa19c0047d0 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4152d90 con 0x7fa19c003980 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c00ba10 con 0x7fa1b406d7d0 2024-05-08T20:34:02.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19c0047d0 0x7fa19c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b3fff640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa19c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b37fe640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa19c003980 0x7fa19c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 -- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 msgr2=0x7fa19c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b406d7d0 0x7fa19c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 -- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa19c003980 msgr2=0x7fa19c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa19c003980 0x7fa19c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 -- 172.21.15.81:0/1099996170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c003530 con 0x7fa19c0047d0 2024-05-08T20:34:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19c0047d0 0x7fa19c004c50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800c290 tx=0x7fa1a801ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983e9ac18b4c2824 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80a5920 con 0x7fa19c0047d0 2024-05-08T20:34:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a80a5a80 con 0x7fa19c0047d0 2024-05-08T20:34:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.965+0000 7fa1b27fc640 1 -- 172.21.15.81:0/1099996170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80a5e30 con 0x7fa19c0047d0 2024-05-08T20:34:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/1099996170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19c0047d0 msgr2=0x7fa19c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/1099996170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19c0047d0 0x7fa19c004c50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800c290 tx=0x7fa1a801ccd0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 -- 172.21.15.81:0/1099996170 reap_dead start 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/1099996170 shutdown_connections 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/1099996170 >> 172.21.15.81:0/1099996170 conn(0x7fa1b40c71b0 msgr2=0x7fa1b40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/1099996170 shutdown_connections 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/1099996170 wait complete. 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 Processor -- start 2024-05-08T20:34:02.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- start start 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa19c0047d0 0x7fa1b40c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 0x7fa1b414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4071ec0 con 0x7fa1b40c5410 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b41518e0 con 0x7fa1b40c6c70 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b4151320 con 0x7fa19c0047d0 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44758/0 (socket says 172.21.15.81:44758) 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 -- 172.21.15.81:0/240674314 learned_addr learned my addr 172.21.15.81:0/240674314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:02.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b37fe640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa19c0047d0 0x7fa1b40c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 0x7fa1b414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 -- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa19c0047d0 msgr2=0x7fa1b40c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa19c0047d0 0x7fa1b40c0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 -- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 msgr2=0x7fa1b414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 0x7fa1b414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 -- 172.21.15.81:0/240674314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4151600 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b2ffd640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 0x7fa1b414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b3fff640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa1b406ffd0 tx=0x7fa1ac0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00e070 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac011e10 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b4071b50 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0039a0 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.969+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40c0d80 con 0x7fa1b40c5410 2024-05-08T20:34:02.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b40675e0 con 0x7fa1b40c5410 2024-05-08T20:34:02.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1ac003b00 con 0x7fa1b40c5410 2024-05-08T20:34:02.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa19bfff640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 0x7fa1a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:02.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa1b37fe640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 0x7fa1a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:02.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa1ac084a70 con 0x7fa1b40c5410 2024-05-08T20:34:02.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.973+0000 7fa1b37fe640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 0x7fa1a0068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009a30 tx=0x7fa1a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:02.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:02.981+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa1ac051ad0 con 0x7fa1b40c5410 2024-05-08T20:34:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.281+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa1b4074950 con 0x7fa1b40c5410 2024-05-08T20:34:03.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.281+0000 7fa19bfff640 1 -- 172.21.15.81:0/240674314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fa1ac0550f0 con 0x7fa1b40c5410 2024-05-08T20:34:03.289 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:34:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 msgr2=0x7fa1a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 0x7fa1a0068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009a30 tx=0x7fa1a4008040 comp rx=0 tx=0).stop 2024-05-08T20:34:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 msgr2=0x7fa1b414afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa1b406ffd0 tx=0x7fa1ac0115a0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 shutdown_connections 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1a0066690 0x7fa1a0068b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b40c5410 0x7fa1b414afd0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b40c6c70 0x7fa1b414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 --2- 172.21.15.81:0/240674314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa19c0047d0 0x7fa1b40c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 >> 172.21.15.81:0/240674314 conn(0x7fa1b40c71b0 msgr2=0x7fa1b414dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 shutdown_connections 2024-05-08T20:34:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.285+0000 7fa1b9f59640 1 -- 172.21.15.81:0/240674314 wait complete. 2024-05-08T20:34:03.310 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:34:03.310 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:34:03.310 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:34:03.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:34:03.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 Processor -- start 2024-05-08T20:34:03.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 -- start start 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcda4152340 0x7fcda406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcda406d7d0 0x7fcda4155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda4158080 con 0x7fcda40c2570 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda406ab70 con 0x7fcda4152340 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcdab163640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4154b10 con 0x7fcda406d7d0 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda8eff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcda4152340 0x7fcda406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcda40c2570 0x7fcda4154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34502/0 (socket says 172.21.15.81:34502) 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda3fff640 1 -- 172.21.15.81:0/918353416 learned_addr learned my addr 172.21.15.81:0/918353416 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda9700640 1 --2- 172.21.15.81:0/918353416 >> v2:172.21.15.117:3300/0 conn(0x7fcda406d7d0 0x7fcda4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda8eff640 1 -- 172.21.15.81:0/918353416 >> v2:172.21.15.117:3300/0 conn(0x7fcda406d7d0 msgr2=0x7fcda4155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda8eff640 1 --2- 172.21.15.81:0/918353416 >> v2:172.21.15.117:3300/0 conn(0x7fcda406d7d0 0x7fcda4155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda8eff640 1 -- 172.21.15.81:0/918353416 >> v1:172.21.15.81:6789/0 conn(0x7fcda40c2570 legacy=0x7fcda4154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda37fe640 1 -- 172.21.15.81:0/918353416 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707886984 0 0) 0x7fcda4158080 con 0x7fcda40c2570 2024-05-08T20:34:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.421+0000 7fcda8eff640 1 -- 172.21.15.81:0/918353416 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda406a890 con 0x7fcda4152340 2024-05-08T20:34:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcda8eff640 1 --2- 172.21.15.81:0/918353416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4152340 0x7fcda406d290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcda40c1780 tx=0x7fcd9001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483359372583d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcda37fe640 1 -- 172.21.15.81:0/918353416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900ac620 con 0x7fcda4152340 2024-05-08T20:34:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcda37fe640 1 -- 172.21.15.81:0/918353416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd900ac780 con 0x7fcda4152340 2024-05-08T20:34:03.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcda37fe640 1 -- 172.21.15.81:0/918353416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900acb10 con 0x7fcda4152340 2024-05-08T20:34:03.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- 172.21.15.81:0/918353416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4152340 msgr2=0x7fcda406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 --2- 172.21.15.81:0/918353416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4152340 0x7fcda406d290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcda40c1780 tx=0x7fcd9001c3c0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- 172.21.15.81:0/918353416 shutdown_connections 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 --2- 172.21.15.81:0/918353416 >> v2:172.21.15.117:3300/0 conn(0x7fcda406d7d0 0x7fcda4155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 --2- 172.21.15.81:0/918353416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4152340 0x7fcda406d290 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- 172.21.15.81:0/918353416 >> 172.21.15.81:0/918353416 conn(0x7fcda40c71b0 msgr2=0x7fcda40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- 172.21.15.81:0/918353416 shutdown_connections 2024-05-08T20:34:03.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- 172.21.15.81:0/918353416 wait complete. 2024-05-08T20:34:03.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 Processor -- start 2024-05-08T20:34:03.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.425+0000 7fcdab163640 1 -- start start 2024-05-08T20:34:03.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcda406d7d0 0x7fcda40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda4152340 0x7fcda4071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40c67e0 con 0x7fcda40c2570 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40c5210 con 0x7fcda406d7d0 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda414e2c0 con 0x7fcda4152340 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44776/0 (socket says 172.21.15.81:44776) 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 -- 172.21.15.81:0/4214909528 learned_addr learned my addr 172.21.15.81:0/4214909528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda9700640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda4152340 0x7fcda4071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcda406d7d0 0x7fcda40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda4152340 msgr2=0x7fcda4071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcda4152340 0x7fcda4071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcda406d7d0 msgr2=0x7fcda40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcda406d7d0 0x7fcda40c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90009420 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcda406d7d0 0x7fcda40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda3fff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c4b0 tx=0x7fcd9800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd980074e0 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98007660 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda414d140 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98004a30 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda414dfe0 con 0x7fcda40c2570 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 0x7fcda41f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4069550 con 0x7fcda4142770 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 0x7fcda41f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda8eff640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcda4161bf0 con 0x7fcda4142770 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 0x7fcda41f0c90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcda406fe70 tx=0x7fcd9001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900ac620 con 0x7fcda4142770 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd98004b90 con 0x7fcda40c2570 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.429+0000 7fcda17fa640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd88066730 0x7fcd88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcd98083910 con 0x7fcda40c2570 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda9700640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd88066730 0x7fcd88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fcd900b6410 con 0x7fcda4142770 2024-05-08T20:34:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 msgr2=0x7fcda41f0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 0x7fcda41f0c90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcda406fe70 tx=0x7fcd9001ac00 comp rx=0 tx=0).stop 2024-05-08T20:34:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 msgr2=0x7fcda41f0c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda17fa640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda4142770 0x7fcda41f0c90 secure :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcda406fe70 tx=0x7fcd9001ac00 comp rx=0 tx=0).stop 2024-05-08T20:34:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.433+0000 7fcda9700640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd88066730 0x7fcd88068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c011340 tx=0x7fcd9c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 0x7fcda41f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40675e0 con 0x7fcda414c5f0 2024-05-08T20:34:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 0x7fcda41f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda8eff640 1 -- 172.21.15.81:0/4214909528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcda414d2d0 con 0x7fcda414c5f0 2024-05-08T20:34:03.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda8eff640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 0x7fcda41f11d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd90019ff0 tx=0x7fcd90019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900b6c60 con 0x7fcda414c5f0 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fcd900b6dc0 con 0x7fcda414c5f0 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 msgr2=0x7fcda41f11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 0x7fcda41f11d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd90019ff0 tx=0x7fcd90019160 comp rx=0 tx=0).stop 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 msgr2=0x7fcda41f11d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda17fa640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda414c5f0 0x7fcda41f11d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:34:03.446 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.447 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.452 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:34:03.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:34:03.459 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd88066730 msgr2=0x7fcd88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcd88066730 0x7fcd88068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c011340 tx=0x7fcd9c00b040 comp rx=0 tx=0).stop 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 msgr2=0x7fcda4070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcdab163640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c4b0 tx=0x7fcd9800c970 comp rx=0 tx=0).stop 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.437+0000 7fcda9700640 1 -- 172.21.15.81:0/4214909528 reap_dead start 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.441+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 shutdown_connections 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.441+0000 7fcdab163640 1 --2- 172.21.15.81:0/4214909528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda40c2570 0x7fcda4070c00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.441+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 >> 172.21.15.81:0/4214909528 conn(0x7fcda40c71b0 msgr2=0x7fcda4145790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.441+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 shutdown_connections 2024-05-08T20:34:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.441+0000 7fcdab163640 1 -- 172.21.15.81:0/4214909528 wait complete. 2024-05-08T20:34:03.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:34:03.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:34:03.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:34:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 Processor -- start 2024-05-08T20:34:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 -- start start 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c152220 0x7f801c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f801c0aac30 0x7f801c0c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c155140 con 0x7f801c0c26e0 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c0c4780 con 0x7f801c0aac30 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f8022106640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0c32d0 con 0x7f801c152220 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f801c0aac30 0x7f801c0c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f801c0c26e0 0x7f801c0c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34506/0 (socket says 172.21.15.81:34506) 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801affd640 1 -- 172.21.15.81:0/1334295141 learned_addr learned my addr 172.21.15.81:0/1334295141 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801b7fe640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c152220 0x7f801c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801bfff640 1 -- 172.21.15.81:0/1334295141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c152220 msgr2=0x7f801c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801bfff640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c152220 0x7f801c1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801bfff640 1 -- 172.21.15.81:0/1334295141 >> v1:172.21.15.81:6789/0 conn(0x7f801c0c26e0 legacy=0x7f801c0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.581+0000 7f801bfff640 1 -- 172.21.15.81:0/1334295141 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c072650 con 0x7f801c0aac30 2024-05-08T20:34:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f801bfff640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0aac30 0x7f801c0c15f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130951d3c5917876 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f801a7fc640 1 -- 172.21.15.81:0/1334295141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140a5970 con 0x7f801c0aac30 2024-05-08T20:34:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f801a7fc640 1 -- 172.21.15.81:0/1334295141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140a5ad0 con 0x7f801c0aac30 2024-05-08T20:34:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f801a7fc640 1 -- 172.21.15.81:0/1334295141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140a5e60 con 0x7f801c0aac30 2024-05-08T20:34:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 -- 172.21.15.81:0/1334295141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0aac30 msgr2=0x7f801c0c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0aac30 0x7f801c0c15f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801401c8b0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 -- 172.21.15.81:0/1334295141 shutdown_connections 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0aac30 0x7f801c0c15f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 --2- 172.21.15.81:0/1334295141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c152220 0x7f801c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 -- 172.21.15.81:0/1334295141 >> 172.21.15.81:0/1334295141 conn(0x7f801c0c4cc0 msgr2=0x7f801c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 -- 172.21.15.81:0/1334295141 shutdown_connections 2024-05-08T20:34:03.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.585+0000 7f8022106640 1 -- 172.21.15.81:0/1334295141 wait complete. 2024-05-08T20:34:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 Processor -- start 2024-05-08T20:34:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- start start 2024-05-08T20:34:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c0aac30 0x7f801c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c152220 0x7f801c1ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0c7b60 con 0x7f801c0c26e0 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1f11e0 con 0x7f801c152220 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c14c930 con 0x7f801c0aac30 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44814/0 (socket says 172.21.15.81:44814) 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 -- 172.21.15.81:0/826653123 learned_addr learned my addr 172.21.15.81:0/826653123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801bfff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c152220 0x7f801c1ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801b7fe640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c0aac30 0x7f801c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c0aac30 msgr2=0x7f801c14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f801c0aac30 0x7f801c14f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c152220 msgr2=0x7f801c1ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c152220 0x7f801c1ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014009a70 con 0x7f801c0c26e0 2024-05-08T20:34:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f801affd640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f801000c500 tx=0x7f801000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010005cf0 con 0x7f801c0c26e0 2024-05-08T20:34:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010005e50 con 0x7f801c0c26e0 2024-05-08T20:34:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c0c7db0 con 0x7f801c0c26e0 2024-05-08T20:34:03.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80100072f0 con 0x7f801c0c26e0 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.589+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c0ae0f0 con 0x7f801c0c26e0 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8022106640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 0x7f801c1ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1f1650 con 0x7f801c0ad740 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f801b7fe640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 0x7f801c1ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8010007450 con 0x7f801c0c26e0 2024-05-08T20:34:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f801b7fe640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f801c14c4d0 con 0x7f801c0ad740 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f801b7fe640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 0x7f801c1ed670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f800c00f7e0 tx=0x7f800c00fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8008066690 0x7f8008068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8010083920 con 0x7f801c0c26e0 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f801bfff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8008066690 0x7f8008068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00dc20 con 0x7f801c0ad740 2024-05-08T20:34:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f801bfff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8008066690 0x7f8008068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f80140af000 tx=0x7f80140a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f800c00c040 con 0x7f801c0ad740 2024-05-08T20:34:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 msgr2=0x7f801c1ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 0x7f801c1ed670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f800c00f7e0 tx=0x7f800c00fca0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 msgr2=0x7f801c1ed670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.593+0000 7f8003fff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c0ad740 0x7f801c1ed670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 0x7f801c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c073ea0 con 0x7f801c155dd0 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f801b7fe640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 0x7f801c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f801b7fe640 1 -- 172.21.15.81:0/826653123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f801c158e60 con 0x7f801c155dd0 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f801b7fe640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 0x7f801c0c5d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f800c00afd0 tx=0x7f800c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c029070 con 0x7f801c155dd0 2024-05-08T20:34:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f800c021040 con 0x7f801c155dd0 2024-05-08T20:34:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 msgr2=0x7f801c0c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 0x7f801c0c5d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f800c00afd0 tx=0x7f800c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 msgr2=0x7f801c0c5d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8003fff640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f801c155dd0 0x7f801c0c5d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.613 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:34:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:34:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:34:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.616 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:34:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:34:03.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.620 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.622 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.624 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:34:03.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.628 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:34:03.628 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:34:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8008066690 msgr2=0x7f8008068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8008066690 0x7f8008068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f80140af000 tx=0x7f80140a7070 comp rx=0 tx=0).stop 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 msgr2=0x7f801c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f801000c500 tx=0x7f801000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f801bfff640 1 -- 172.21.15.81:0/826653123 reap_dead start 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 shutdown_connections 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 --2- 172.21.15.81:0/826653123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801c0c26e0 0x7f801c0ad200 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 >> 172.21.15.81:0/826653123 conn(0x7f801c0c4cc0 msgr2=0x7f801c14bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 shutdown_connections 2024-05-08T20:34:03.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.601+0000 7f8022106640 1 -- 172.21.15.81:0/826653123 wait complete. 2024-05-08T20:34:03.631 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:34:03.631 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:34:03.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:34:03.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 Processor -- start 2024-05-08T20:34:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 -- start start 2024-05-08T20:34:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88c414e9f0 0x7f88c40c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c40ab2b0 0x7f88c40bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c40bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c4154a30 con 0x7f88c40ab2b0 2024-05-08T20:34:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c40aa450 con 0x7f88c414e9f0 2024-05-08T20:34:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88ca462640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4154c40 con 0x7f88c40c20f0 2024-05-08T20:34:03.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c40ab2b0 0x7f88c40bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88c40ab2b0 0x7f88c40bf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44820/0 (socket says 172.21.15.81:44820) 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 -- 172.21.15.81:0/748763127 learned_addr learned my addr 172.21.15.81:0/748763127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88c3fff640 1 --2- 172.21.15.81:0/748763127 >> v2:172.21.15.117:3300/0 conn(0x7f88c414e9f0 0x7f88c40c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88c89ff640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c40bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 -- 172.21.15.81:0/748763127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 msgr2=0x7f88c40bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c40bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 -- 172.21.15.81:0/748763127 >> v2:172.21.15.117:3300/0 conn(0x7f88c414e9f0 msgr2=0x7f88c40c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 --2- 172.21.15.81:0/748763127 >> v2:172.21.15.117:3300/0 conn(0x7f88c414e9f0 0x7f88c40c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.741+0000 7f88bbfff640 1 -- 172.21.15.81:0/748763127 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4154f20 con 0x7f88c40ab2b0 2024-05-08T20:34:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88bbfff640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c40ab2b0 0x7f88c40bf5d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f88c4072b20 tx=0x7f88ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93db5eedfeff9e01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88c37fe640 1 -- 172.21.15.81:0/748763127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0ac630 con 0x7f88c40ab2b0 2024-05-08T20:34:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88c37fe640 1 -- 172.21.15.81:0/748763127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac0ac790 con 0x7f88c40ab2b0 2024-05-08T20:34:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88c37fe640 1 -- 172.21.15.81:0/748763127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac0acb20 con 0x7f88c40ab2b0 2024-05-08T20:34:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88ca462640 1 -- 172.21.15.81:0/748763127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c40ab2b0 msgr2=0x7f88c40bf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88ca462640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c40ab2b0 0x7f88c40bf5d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f88c4072b20 tx=0x7f88ac01c520 comp rx=0 tx=0).stop 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.745+0000 7f88ca462640 1 -- 172.21.15.81:0/748763127 shutdown_connections 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c40bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- 172.21.15.81:0/748763127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c40ab2b0 0x7f88c40bf5d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- 172.21.15.81:0/748763127 >> v2:172.21.15.117:3300/0 conn(0x7f88c414e9f0 0x7f88c40c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- 172.21.15.81:0/748763127 >> 172.21.15.81:0/748763127 conn(0x7f88c40c2ca0 msgr2=0x7f88c40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- 172.21.15.81:0/748763127 shutdown_connections 2024-05-08T20:34:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- 172.21.15.81:0/748763127 wait complete. 2024-05-08T20:34:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 Processor -- start 2024-05-08T20:34:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- start start 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c40ab2b0 0x7f88c40c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c41ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41eede0 con 0x7f88c414e9f0 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41578f0 con 0x7f88c40ab2b0 2024-05-08T20:34:03.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4147120 con 0x7f88c40c20f0 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44834/0 (socket says 172.21.15.81:44834) 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 -- 172.21.15.81:0/1149673269 learned_addr learned my addr 172.21.15.81:0/1149673269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88bbfff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c41ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c40ab2b0 0x7f88c40c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 msgr2=0x7f88c41ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c41ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c40ab2b0 msgr2=0x7f88c40c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c40ab2b0 0x7f88c40c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0094d0 con 0x7f88c414e9f0 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88bbfff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c20f0 0x7f88c41ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c40ab2b0 0x7f88c40c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:34:03.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c89ff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007d10 tx=0x7f88bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014420 con 0x7f88c414e9f0 2024-05-08T20:34:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc0145a0 con 0x7f88c414e9f0 2024-05-08T20:34:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4143a30 con 0x7f88c414e9f0 2024-05-08T20:34:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc014950 con 0x7f88c414e9f0 2024-05-08T20:34:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.749+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c4157580 con 0x7f88c414e9f0 2024-05-08T20:34:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88ca462640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 0x7f88c4142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c5fa0 con 0x7f88c40c5bc0 2024-05-08T20:34:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 0x7f88c4142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c3fff640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88c40c37c0 con 0x7f88c40c5bc0 2024-05-08T20:34:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 0x7f88c4142b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f88b4011830 tx=0x7f88b4011cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400fa30 con 0x7f88c40c5bc0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88bc014ab0 con 0x7f88c414e9f0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88a4066760 0x7f88a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f88bc084d20 con 0x7f88c414e9f0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88bbfff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88a4066760 0x7f88a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f88b400fb90 con 0x7f88c40c5bc0 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 msgr2=0x7f88c4142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 0x7f88c4142b90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f88b4011830 tx=0x7f88b4011cf0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 msgr2=0x7f88c4142b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88c17fa640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c40c5bc0 0x7f88c4142b90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.753+0000 7f88bbfff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88a4066760 0x7f88a4068c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0ae000 tx=0x7f88ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.761+0000 7f88ca462640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 0x7f88c41f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.761+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40696e0 con 0x7f88c41430d0 2024-05-08T20:34:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.761+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 0x7f88c41f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.761+0000 7f88c3fff640 1 -- 172.21.15.81:0/1149673269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f88c4074950 con 0x7f88c41430d0 2024-05-08T20:34:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c3fff640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 0x7f88c41f0460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88b4011830 tx=0x7f88b40046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4021040 con 0x7f88c41430d0 2024-05-08T20:34:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f88b4026070 con 0x7f88c41430d0 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 msgr2=0x7f88c41f0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 0x7f88c41f0460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88b4011830 tx=0x7f88b40046d0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 msgr2=0x7f88c41f0460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c17fa640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c41430d0 0x7f88c41f0460 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:34:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 60, 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:34:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:34:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.782 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:03.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:34:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:34:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88a4066760 msgr2=0x7f88a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88a4066760 0x7f88a4068c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0ae000 tx=0x7f88ac008040 comp rx=0 tx=0).stop 2024-05-08T20:34:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88c89ff640 1 -- 172.21.15.81:0/1149673269 reap_dead start 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 msgr2=0x7f88c41ee8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007d10 tx=0x7f88bc00e4b0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 shutdown_connections 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 --2- 172.21.15.81:0/1149673269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88c414e9f0 0x7f88c41ee8a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 >> 172.21.15.81:0/1149673269 conn(0x7f88c40c2ca0 msgr2=0x7f88c40c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 shutdown_connections 2024-05-08T20:34:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:03.765+0000 7f88ca462640 1 -- 172.21.15.81:0/1149673269 wait complete. 2024-05-08T20:34:03.790 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:34:03.790 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:34:03.790 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-05-08T20:34:03.790 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:34:03.790 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:34:03.791 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:34:03.791 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:34:03.813 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:34:03.813 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:34:03.813 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:34:03.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:34:18.814 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:34:18.814 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:34:18.814 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:34:18.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:34:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 Processor -- start 2024-05-08T20:34:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 -- start start 2024-05-08T20:34:18.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:18.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:18.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c156e30 con 0x7f0a9c0abee0 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c1569a0 con 0x7f0a9c0c47c0 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0aa210c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06ded0 con 0x7f0a9c0c3dd0 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9bfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 msgr2=0x7f0a9c151f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41602/0 (socket says 172.21.15.81:41602) 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 learned_addr learned my addr 172.21.15.81:0/3459532925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:18.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:18.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:18.953+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9bfff640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 msgr2=0x7f0a9c151f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9bfff640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.157+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:34:19.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:19.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9bfff640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 msgr2=0x7f0a9c151f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9bfff640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:19.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:19.561+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:34:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9bfff640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 msgr2=0x7f0a9c151f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9bfff640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:34:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:20.365+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:34:20.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:34:20.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 msgr2=0x7f0a9c151f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a9c0c3dd0 0x7f0a9c151f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 msgr2=0x7f0a9c0c3890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.117:3300/0 conn(0x7f0a9c0c47c0 0x7f0a9c0c3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 -- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 msgr2=0x7f0a9c0c3350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 --2- 172.21.15.81:0/3459532925 >> v2:172.21.15.81:3300/0 conn(0x7f0a9c0abee0 0x7f0a9c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 -- 172.21.15.81:0/3459532925 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c156070 con 0x7f0a88007330 2024-05-08T20:34:21.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:21.953+0000 7f0a997fa640 1 -- 172.21.15.81:0/3459532925 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8800c0a0 con 0x7f0a880036a0 2024-05-08T20:34:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.873+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619390550 0 0) 0x7f0a8800c0a0 con 0x7f0a880036a0 2024-05-08T20:34:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.873+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a84003530 con 0x7f0a880036a0 2024-05-08T20:34:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139645822 0 0) 0x7f0a9c156070 con 0x7f0a88007330 2024-05-08T20:34:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8800c0a0 con 0x7f0a88007330 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1436459546 0 0) 0x7f0a8800c0a0 con 0x7f0a88007330 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 >> v1:172.21.15.117:6789/0 conn(0x7f0a880036a0 legacy=0x7f0a88005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8800d2a0 con 0x7f0a88007330 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f0a9000e510 con 0x7f0a88007330 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 >> v1:172.21.15.81:6789/0 conn(0x7f0a88007330 legacy=0x7f0a880097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9bfff640 1 -- 172.21.15.81:0/3459532925 reap_dead start 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 0x7f0a84003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c1a0 con 0x7f0a840047d0 2024-05-08T20:34:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c310 con 0x7f0a84003b40 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8400c4d0 con 0x7f0a840052b0 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9bfff640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 msgr2=0x7f0a8400b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9bfff640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.885+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 0x7f0a84003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 msgr2=0x7f0a8400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:34:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 msgr2=0x7f0a84003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 0x7f0a84003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9affd640 1 -- 172.21.15.81:0/3459532925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8800c0a0 con 0x7f0a840047d0 2024-05-08T20:34:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.889+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 0x7f0a84003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:34:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.893+0000 7f0a9affd640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ef60 tx=0x7f0a9001d730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36de4c9c9d76f651 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.893+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ab620 con 0x7f0a840047d0 2024-05-08T20:34:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.893+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000c040 con 0x7f0a840047d0 2024-05-08T20:34:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.893+0000 7f0a9a7fc640 1 -- 172.21.15.81:0/3459532925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ab980 con 0x7f0a840047d0 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 -- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 msgr2=0x7f0a84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000ef60 tx=0x7f0a9001d730 comp rx=0 tx=0).stop 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 -- 172.21.15.81:0/3459532925 shutdown_connections 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a8400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a840047d0 0x7f0a84004c50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 --2- 172.21.15.81:0/3459532925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a84003b40 0x7f0a84003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 -- 172.21.15.81:0/3459532925 >> 172.21.15.81:0/3459532925 conn(0x7f0a9c0c68c0 msgr2=0x7f0a9c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 -- 172.21.15.81:0/3459532925 shutdown_connections 2024-05-08T20:34:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.897+0000 7f0aa210c640 1 -- 172.21.15.81:0/3459532925 wait complete. 2024-05-08T20:34:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 Processor -- start 2024-05-08T20:34:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- start start 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a840047d0 0x7f0a9c145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a9c145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c1eb520 con 0x7f0a84003b40 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c143780 con 0x7f0a840047d0 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c06f8c0 con 0x7f0a840052b0 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9bfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 msgr2=0x7f0a9c145e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a9c145e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41634/0 (socket says 172.21.15.81:41634) 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/1849023892 learned_addr learned my addr 172.21.15.81:0/1849023892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9affd640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a840047d0 0x7f0a9c145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 msgr2=0x7f0a9c145e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a9c145e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a840047d0 msgr2=0x7f0a9c145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a840047d0 0x7f0a9c145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 -- 172.21.15.81:0/1849023892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c06fb80 con 0x7f0a84003b40 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a9b7fe640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c012e80 tx=0x7f0a8c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c017910 con 0x7f0a84003b40 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00c040 con 0x7f0a84003b40 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c017c70 con 0x7f0a84003b40 2024-05-08T20:34:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c072070 con 0x7f0a84003b40 2024-05-08T20:34:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.901+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c071c60 con 0x7f0a84003b40 2024-05-08T20:34:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c153cd0 con 0x7f0a84003b40 2024-05-08T20:34:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a8c020460 con 0x7f0a84003b40 2024-05-08T20:34:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0a83fff640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 0x7f0a88069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0a8c085180 con 0x7f0a84003b40 2024-05-08T20:34:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0a9affd640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 0x7f0a88069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.905+0000 7f0a9affd640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 0x7f0a88069430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0a900b0000 tx=0x7f0a900b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:23.909+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0a8c052160 con 0x7f0a84003b40 2024-05-08T20:34:24.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.137+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0a9c1eafa0 con 0x7f0a84003b40 2024-05-08T20:34:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.137+0000 7f0a83fff640 1 -- 172.21.15.81:0/1849023892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f0a9c1eafa0 con 0x7f0a84003b40 2024-05-08T20:34:24.141 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:34:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 msgr2=0x7f0a88069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 0x7f0a88069430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0a900b0000 tx=0x7f0a900b5040 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 msgr2=0x7f0a9c071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c012e80 tx=0x7f0a8c0039f0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 shutdown_connections 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0a88066f70 0x7f0a88069430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a840052b0 0x7f0a9c145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a840047d0 0x7f0a9c145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 --2- 172.21.15.81:0/1849023892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a84003b40 0x7f0a9c071720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 >> 172.21.15.81:0/1849023892 conn(0x7f0a9c0c68c0 msgr2=0x7f0a9c14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 shutdown_connections 2024-05-08T20:34:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.141+0000 7f0aa210c640 1 -- 172.21.15.81:0/1849023892 wait complete. 2024-05-08T20:34:24.160 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:34:24.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:34:24.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:34:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.285+0000 7f9a95614640 1 Processor -- start 2024-05-08T20:34:24.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.285+0000 7f9a95614640 1 -- start start 2024-05-08T20:34:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a95614640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a90151740 0x7f9a900c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a95614640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a9015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a95614640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a90155060 con 0x7f9a900c1bb0 2024-05-08T20:34:24.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a95614640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a90155340 con 0x7f9a90151740 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a95614640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90155620 con 0x7f9a901535a0 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a8f7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 msgr2=0x7f9a9015c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a8f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a9015c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a90151740 0x7f9a900c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a8effd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9a900c1bb0 0x7f9a90152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:60366/0 (socket says 172.21.15.81:60366) 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a90151740 0x7f9a900c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:42456/0 (socket says 172.21.15.81:42456) 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a8effd640 1 -- 172.21.15.81:0/1652490305 learned_addr learned my addr 172.21.15.81:0/1652490305 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 -- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 msgr2=0x7f9a9015c080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 --2- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a9015c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 -- 172.21.15.81:0/1652490305 >> v1:172.21.15.117:6789/0 conn(0x7f9a900c1bb0 legacy=0x7f9a90152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.289+0000 7f9a87fff640 1 -- 172.21.15.81:0/1652490305 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90155900 con 0x7f9a90151740 2024-05-08T20:34:24.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 --2- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a90151740 0x7f9a900c1f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a7801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb41d40ed0c8c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8e7fc640 1 -- 172.21.15.81:0/1652490305 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780ab650 con 0x7f9a90151740 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8e7fc640 1 -- 172.21.15.81:0/1652490305 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a780ab7b0 con 0x7f9a90151740 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8e7fc640 1 -- 172.21.15.81:0/1652490305 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780abb40 con 0x7f9a90151740 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a90151740 msgr2=0x7f9a900c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a90151740 0x7f9a900c1f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a7801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- 172.21.15.81:0/1652490305 shutdown_connections 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a9015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- 172.21.15.81:0/1652490305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a90151740 0x7f9a900c1f90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- 172.21.15.81:0/1652490305 >> 172.21.15.81:0/1652490305 conn(0x7f9a900c2ca0 msgr2=0x7f9a900c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- 172.21.15.81:0/1652490305 shutdown_connections 2024-05-08T20:34:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- 172.21.15.81:0/1652490305 wait complete. 2024-05-08T20:34:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 Processor -- start 2024-05-08T20:34:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- start start 2024-05-08T20:34:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a900c1bb0 0x7f9a900aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 0x7f9a90070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a900712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9006c180 con 0x7f9a90151740 2024-05-08T20:34:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9006c460 con 0x7f9a900c1bb0 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a95614640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900a9d30 con 0x7f9a901535a0 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8f7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 msgr2=0x7f9a900712d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a900712d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 0x7f9a90070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 0x7f9a90070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41640/0 (socket says 172.21.15.81:41640) 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 -- 172.21.15.81:0/1718119622 learned_addr learned my addr 172.21.15.81:0/1718119622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a8effd640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a900c1bb0 0x7f9a900aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 msgr2=0x7f9a900712d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a901535a0 0x7f9a900712d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a900c1bb0 msgr2=0x7f9a900aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a900c1bb0 0x7f9a900aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.293+0000 7f9a87fff640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78009420 con 0x7f9a90151740 2024-05-08T20:34:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a87fff640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 0x7f9a90070d90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9a780ad040 tx=0x7f9a7801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780b5810 con 0x7f9a90151740 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a780b5990 con 0x7f9a90151740 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a900aa010 con 0x7f9a90151740 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780b5d40 con 0x7f9a90151740 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a90151010 con 0x7f9a90151740 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a95614640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 0x7f9a901484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900696e0 con 0x7f9a90156150 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a8effd640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 0x7f9a901484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a8effd640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a90067460 con 0x7f9a90156150 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a8effd640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 0x7f9a901484e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a8000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800058c0 con 0x7f9a90156150 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a780bf410 con 0x7f9a90151740 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a70066730 0x7f9a70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9a7811f5a0 con 0x7f9a90151740 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a8f7fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a70066730 0x7f9a70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9a80005a20 con 0x7f9a90156150 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 msgr2=0x7f9a901484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 0x7f9a901484e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a8000fc00 comp rx=0 tx=0).stop 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 msgr2=0x7f9a901484e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a877fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90156150 0x7f9a901484e0 secure :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a8000fc00 comp rx=0 tx=0).stop 2024-05-08T20:34:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.297+0000 7f9a8f7fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a70066730 0x7f9a70068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a900a96d0 tx=0x7f9a88009270 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 0x7f9a90148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90074950 con 0x7f9a90071810 2024-05-08T20:34:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a8effd640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 0x7f9a90148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a8effd640 1 -- 172.21.15.81:0/1718119622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a900c39a0 con 0x7f9a90071810 2024-05-08T20:34:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a8effd640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 0x7f9a90148a20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a80005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80023070 con 0x7f9a90071810 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f9a800070d0 con 0x7f9a90071810 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 msgr2=0x7f9a90148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 0x7f9a90148a20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a80005800 comp rx=0 tx=0).stop 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 msgr2=0x7f9a90148a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a877fe640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90071810 0x7f9a90148a20 secure :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f70 tx=0x7f9a80005800 comp rx=0 tx=0).stop 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 62, 2024-05-08T20:34:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:34:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:34:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:34:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:34:24.322 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a70066730 msgr2=0x7f9a70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a70066730 0x7f9a70068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a900a96d0 tx=0x7f9a88009270 comp rx=0 tx=0).stop 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 msgr2=0x7f9a90070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 --2- 172.21.15.81:0/1718119622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a90151740 0x7f9a90070d90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9a780ad040 tx=0x7f9a7801ac30 comp rx=0 tx=0).stop 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a8f7fe640 1 -- 172.21.15.81:0/1718119622 reap_dead start 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a8f7fe640 1 -- 172.21.15.81:0/1718119622 reap_dead start 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 shutdown_connections 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 >> 172.21.15.81:0/1718119622 conn(0x7f9a900c2ca0 msgr2=0x7f9a90152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 shutdown_connections 2024-05-08T20:34:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.305+0000 7f9a95614640 1 -- 172.21.15.81:0/1718119622 wait complete. 2024-05-08T20:34:24.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:34:24.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:34:24.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:34:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 Processor -- start 2024-05-08T20:34:24.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 -- start start 2024-05-08T20:34:24.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6a80aa9b0 0x7fc6a8152730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80abaa0 con 0x7fc6a80c5fe0 2024-05-08T20:34:24.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80a9ac0 con 0x7fc6a814fd60 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6ae077640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80c6430 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a6ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6a80aa9b0 0x7fc6a8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6a80c5fe0 0x7fc6a80c31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45902/0 (socket says 172.21.15.81:45902) 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a7fff640 1 -- 172.21.15.81:0/2225398650 learned_addr learned my addr 172.21.15.81:0/2225398650 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a6ffd640 1 -- 172.21.15.81:0/2225398650 >> v1:172.21.15.117:6789/0 conn(0x7fc6a814fd60 legacy=0x7fc6a80c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a6ffd640 1 -- 172.21.15.81:0/2225398650 >> v1:172.21.15.81:6789/0 conn(0x7fc6a80c5fe0 legacy=0x7fc6a80c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a67fc640 1 -- 172.21.15.81:0/2225398650 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943173440 0 0) 0x7fc6a80abaa0 con 0x7fc6a80c5fe0 2024-05-08T20:34:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.441+0000 7fc6a6ffd640 1 -- 172.21.15.81:0/2225398650 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8150140 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a6ffd640 1 --2- 172.21.15.81:0/2225398650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8152730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097c0 tx=0x7fc69001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5dea7f8228dc5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a67fc640 1 -- 172.21.15.81:0/2225398650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900ac640 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a67fc640 1 -- 172.21.15.81:0/2225398650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900ac7a0 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a67fc640 1 -- 172.21.15.81:0/2225398650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900acb30 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- 172.21.15.81:0/2225398650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a80aa9b0 msgr2=0x7fc6a8152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 --2- 172.21.15.81:0/2225398650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8152730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097c0 tx=0x7fc69001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- 172.21.15.81:0/2225398650 shutdown_connections 2024-05-08T20:34:24.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 --2- 172.21.15.81:0/2225398650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8152730 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- 172.21.15.81:0/2225398650 >> 172.21.15.81:0/2225398650 conn(0x7fc6a80c68c0 msgr2=0x7fc6a80c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:24.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- 172.21.15.81:0/2225398650 shutdown_connections 2024-05-08T20:34:24.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- 172.21.15.81:0/2225398650 wait complete. 2024-05-08T20:34:24.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 Processor -- start 2024-05-08T20:34:24.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- start start 2024-05-08T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a80c5fe0 0x7fc6a8154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 0x7fc6a8148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8072970 con 0x7fc6a814fd60 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8071da0 con 0x7fc6a80aa9b0 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6ae077640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80722d0 con 0x7fc6a80c5fe0 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 0x7fc6a8148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a6ffd640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a80c5fe0 msgr2=0x7fc6a8154160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a80c5fe0 0x7fc6a8154160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 0x7fc6a8148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41678/0 (socket says 172.21.15.81:41678) 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 learned_addr learned my addr 172.21.15.81:0/3032268489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a77fe640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a80c5fe0 msgr2=0x7fc6a8154160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a80c5fe0 0x7fc6a8154160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a80aa9b0 msgr2=0x7fc6a8153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a80aa9b0 0x7fc6a8153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:24.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690009420 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.445+0000 7fc6a7fff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 0x7fc6a8148970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c480 tx=0x7fc69800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6980074e0 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698007640 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698004a10 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a8071ff0 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8071060 con 0x7fc6a814fd60 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6ae077640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 0x7fc6a8148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8069550 con 0x7fc6a8071640 2024-05-08T20:34:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6a77fe640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 0x7fc6a8148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6a77fe640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6a80c3cd0 con 0x7fc6a8071640 2024-05-08T20:34:24.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc698004b70 con 0x7fc6a814fd60 2024-05-08T20:34:24.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6a77fe640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 0x7fc6a8148eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc688066670 0x7fc688068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc698083630 con 0x7fc6a814fd60 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6a6ffd640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc688066670 0x7fc688068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000ee60 con 0x7fc6a8071640 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc6a6ffd640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc688066670 0x7fc688068b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc6900ae000 tx=0x7fc690008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc6a0003b90 con 0x7fc6a8071640 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 msgr2=0x7fc6a8148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 0x7fc6a8148eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a000ec10 comp rx=0 tx=0).stop 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 msgr2=0x7fc6a8148eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:24.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.449+0000 7fc69ffff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a8071640 0x7fc6a8148eb0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a000ec10 comp rx=0 tx=0).stop 2024-05-08T20:34:24.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 0x7fc6a81ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:24.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80ab730 con 0x7fc6a81eeed0 2024-05-08T20:34:24.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6a77fe640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 0x7fc6a81ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:24.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6a77fe640 1 -- 172.21.15.81:0/3032268489 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc6a80c1c60 con 0x7fc6a81eeed0 2024-05-08T20:34:24.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6a77fe640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 0x7fc6a81ef2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a0001410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:24.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0021070 con 0x7fc6a81eeed0 2024-05-08T20:34:24.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7fc6a00050d0 con 0x7fc6a81eeed0 2024-05-08T20:34:24.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 msgr2=0x7fc6a81ef2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 0x7fc6a81ef2e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a0001410 comp rx=0 tx=0).stop 2024-05-08T20:34:24.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 msgr2=0x7fc6a81ef2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:34:24.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc69ffff640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a81eeed0 0x7fc6a81ef2e0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e750 tx=0x7fc6a0001410 comp rx=0 tx=0).stop 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 62, 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:34:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:34:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:34:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:34:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:34:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:34:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:34:24.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc688066670 msgr2=0x7fc688068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc688066670 0x7fc688068b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc6900ae000 tx=0x7fc690008040 comp rx=0 tx=0).stop 2024-05-08T20:34:24.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 msgr2=0x7fc6a8148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:24.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 --2- 172.21.15.81:0/3032268489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a814fd60 0x7fc6a8148970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c480 tx=0x7fc69800c940 comp rx=0 tx=0).stop 2024-05-08T20:34:24.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 reap_dead start 2024-05-08T20:34:24.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6a7fff640 1 -- 172.21.15.81:0/3032268489 reap_dead start 2024-05-08T20:34:24.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 shutdown_connections 2024-05-08T20:34:24.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 >> 172.21.15.81:0/3032268489 conn(0x7fc6a80c68c0 msgr2=0x7fc6a80c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:24.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 shutdown_connections 2024-05-08T20:34:24.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:24.457+0000 7fc6ae077640 1 -- 172.21.15.81:0/3032268489 wait complete. 2024-05-08T20:34:24.477 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:34:24.477 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:34:44.478 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:34:44.478 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:34:44.478 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:34:44.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:34:44.482 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:34:44.482 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:34:44.483 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:34:44.483 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:34:50.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:34:50.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:34:59.483 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:34:59.484 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:34:59.484 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:34:59.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:34:59.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 Processor -- start 2024-05-08T20:34:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 -- start start 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f212c0c30d0 0x7f212c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f212c0a94b0 0x7f212c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c155e10 con 0x7f212c0c2bc0 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c06e790 con 0x7f212c0a94b0 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f21341fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c06f460 con 0x7f212c0c30d0 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f212c0a94b0 0x7f212c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f212c0a94b0 0x7f212c0a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59480/0 (socket says 172.21.15.81:59480) 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 -- 172.21.15.81:0/3829807682 learned_addr learned my addr 172.21.15.81:0/3829807682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2131f98640 1 --2- 172.21.15.81:0/3829807682 >> v2:172.21.15.117:3300/0 conn(0x7f212c0c30d0 0x7f212c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 -- 172.21.15.81:0/3829807682 >> v2:172.21.15.117:3300/0 conn(0x7f212c0c30d0 msgr2=0x7f212c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 --2- 172.21.15.81:0/3829807682 >> v2:172.21.15.117:3300/0 conn(0x7f212c0c30d0 0x7f212c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 -- 172.21.15.81:0/3829807682 >> v1:172.21.15.117:6789/0 conn(0x7f212c0c2bc0 legacy=0x7f212c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.620+0000 7f2132799640 1 -- 172.21.15.81:0/3829807682 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c156080 con 0x7f212c0a94b0 2024-05-08T20:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f2132799640 1 --2- 172.21.15.81:0/3829807682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0a94b0 0x7f212c0a98c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f212c0c59e0 tx=0x7f212401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae4640465370a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f2130f96640 1 -- 172.21.15.81:0/3829807682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240a57f0 con 0x7f212c0a94b0 2024-05-08T20:34:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f2130f96640 1 -- 172.21.15.81:0/3829807682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21240a5950 con 0x7f212c0a94b0 2024-05-08T20:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f2130f96640 1 -- 172.21.15.81:0/3829807682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240a5ce0 con 0x7f212c0a94b0 2024-05-08T20:34:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- 172.21.15.81:0/3829807682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0a94b0 msgr2=0x7f212c0a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 --2- 172.21.15.81:0/3829807682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0a94b0 0x7f212c0a98c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f212c0c59e0 tx=0x7f212401c930 comp rx=0 tx=0).stop 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- 172.21.15.81:0/3829807682 shutdown_connections 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 --2- 172.21.15.81:0/3829807682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0a94b0 0x7f212c0a98c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 --2- 172.21.15.81:0/3829807682 >> v2:172.21.15.117:3300/0 conn(0x7f212c0c30d0 0x7f212c0c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- 172.21.15.81:0/3829807682 >> 172.21.15.81:0/3829807682 conn(0x7f212c0c4cc0 msgr2=0x7f212c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- 172.21.15.81:0/3829807682 shutdown_connections 2024-05-08T20:34:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- 172.21.15.81:0/3829807682 wait complete. 2024-05-08T20:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 Processor -- start 2024-05-08T20:34:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.624+0000 7f21341fc640 1 -- start start 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212c0a94b0 0x7f212c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212c0c30d0 0x7f212c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0abfc0 con 0x7f212c0c2bc0 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0ae410 con 0x7f212c0a94b0 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0ade50 con 0x7f212c0c30d0 2024-05-08T20:34:59.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59490/0 (socket says 172.21.15.81:59490) 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 -- 172.21.15.81:0/361944464 learned_addr learned my addr 172.21.15.81:0/361944464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131f98640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212c0a94b0 0x7f212c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2132799640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212c0c30d0 0x7f212c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 -- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212c0c30d0 msgr2=0x7f212c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212c0c30d0 0x7f212c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 -- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212c0a94b0 msgr2=0x7f212c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212c0a94b0 0x7f212c151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 -- 172.21.15.81:0/361944464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009b30 con 0x7f212c0c2bc0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131797640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c500 tx=0x7f211c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0052d0 con 0x7f212c0c2bc0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c005430 con 0x7f212c0c2bc0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c0ae130 con 0x7f212c0c2bc0 2024-05-08T20:34:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c012830 con 0x7f212c0c2bc0 2024-05-08T20:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c14b980 con 0x7f212c0c2bc0 2024-05-08T20:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c0aba40 con 0x7f212c0c2bc0 2024-05-08T20:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f211c012990 con 0x7f212c0c2bc0 2024-05-08T20:34:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 0x7f2110068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f211c084010 con 0x7f212c0c2bc0 2024-05-08T20:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.628+0000 7f2131f98640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 0x7f2110068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:34:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.632+0000 7f2131f98640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 0x7f2110068b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2128009ac0 tx=0x7f2128009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:34:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.636+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f212c0aba40 con 0x7f212c0c2bc0 2024-05-08T20:34:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f212c0ac100 con 0x7f212c0c2bc0 2024-05-08T20:34:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21227fc640 1 -- 172.21.15.81:0/361944464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f212c0ac100 con 0x7f212c0c2bc0 2024-05-08T20:34:59.911 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:34:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 msgr2=0x7f2110068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 0x7f2110068b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2128009ac0 tx=0x7f2128009190 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 msgr2=0x7f212c0ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c500 tx=0x7f211c00c9c0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 shutdown_connections 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21100666c0 0x7f2110068b80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f212c0c30d0 0x7f212c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f212c0c2bc0 0x7f212c0ab1a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 --2- 172.21.15.81:0/361944464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f212c0a94b0 0x7f212c151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 >> 172.21.15.81:0/361944464 conn(0x7f212c0c4cc0 msgr2=0x7f212c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 shutdown_connections 2024-05-08T20:34:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:34:59.908+0000 7f21341fc640 1 -- 172.21.15.81:0/361944464 wait complete. 2024-05-08T20:34:59.937 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:34:59.937 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:34:59.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:35:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.060+0000 7f6b64b4e640 1 Processor -- start 2024-05-08T20:35:00.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.060+0000 7f6b64b4e640 1 -- start start 2024-05-08T20:35:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b64b4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b6006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b64b4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b60155e90 0x7f6b60069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b64b4e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60152ab0 con 0x7f6b6006d7d0 2024-05-08T20:35:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b64b4e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b601528a0 con 0x7f6b60155e90 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b64b4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60152d90 con 0x7f6b6014fe70 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b60155e90 0x7f6b60069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b60155e90 0x7f6b60069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59502/0 (socket says 172.21.15.81:59502) 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 -- 172.21.15.81:0/2362200378 learned_addr learned my addr 172.21.15.81:0/2362200378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b6006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 -- 172.21.15.81:0/2362200378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 msgr2=0x7f6b6006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b6006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 -- 172.21.15.81:0/2362200378 >> v1:172.21.15.117:6789/0 conn(0x7f6b6006d7d0 legacy=0x7f6b6006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 -- 172.21.15.81:0/2362200378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60153070 con 0x7f6b60155e90 2024-05-08T20:35:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b55d9b640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60155e90 0x7f6b60069fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009870 tx=0x7f6b5001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10af16426b2a549 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b5dd9b640 1 -- 172.21.15.81:0/2362200378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500ab610 con 0x7f6b60155e90 2024-05-08T20:35:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b5dd9b640 1 -- 172.21.15.81:0/2362200378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500ab770 con 0x7f6b60155e90 2024-05-08T20:35:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.064+0000 7f6b5dd9b640 1 -- 172.21.15.81:0/2362200378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500abb00 con 0x7f6b60155e90 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2362200378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60155e90 msgr2=0x7f6b60069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60155e90 0x7f6b60069fc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009870 tx=0x7f6b5001c410 comp rx=0 tx=0).stop 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2362200378 shutdown_connections 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60155e90 0x7f6b60069fc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2362200378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b6006d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2362200378 >> 172.21.15.81:0/2362200378 conn(0x7f6b600c71b0 msgr2=0x7f6b600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2362200378 shutdown_connections 2024-05-08T20:35:00.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2362200378 wait complete. 2024-05-08T20:35:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 Processor -- start 2024-05-08T20:35:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- start start 2024-05-08T20:35:00.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6006d7d0 0x7f6b600c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b600c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 0x7f6b60146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c4f30 con 0x7f6b600c5be0 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60154b80 con 0x7f6b6006d7d0 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c6090 con 0x7f6b6014fe70 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 0x7f6b60146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 0x7f6b60146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59504/0 (socket says 172.21.15.81:59504) 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 learned_addr learned my addr 172.21.15.81:0/2473613527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b55d9b640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b600c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6006d7d0 0x7f6b600c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 msgr2=0x7f6b600c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6014fe70 0x7f6b600c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6006d7d0 msgr2=0x7f6b600c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6006d7d0 0x7f6b600c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500094d0 con 0x7f6b600c5be0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b5ed9d640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 0x7f6b60146590 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c770 tx=0x7f6b5800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58003b80 con 0x7f6b600c5be0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58003ce0 con 0x7f6b600c5be0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5800aa90 con 0x7f6b600c5be0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.068+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60154e20 con 0x7f6b600c5be0 2024-05-08T20:35:00.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b601eba10 con 0x7f6b600c5be0 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 0x7f6b60146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60069550 con 0x7f6b600c5070 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 0x7f6b60146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b5e59c640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b601ebc00 con 0x7f6b600c5070 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 0x7f6b60146ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6b480107f0 tx=0x7f6b48010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b5800abf0 con 0x7f6b600c5be0 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b40066690 0x7f6b40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6b580841a0 con 0x7f6b600c5be0 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b55d9b640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b40066690 0x7f6b40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48010ea0 con 0x7f6b600c5070 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6b4800ea30 con 0x7f6b600c5070 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 msgr2=0x7f6b60146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 0x7f6b60146ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6b480107f0 tx=0x7f6b48010cb0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 msgr2=0x7f6b60146ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b577fe640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5070 0x7f6b60146ad0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.072+0000 7f6b55d9b640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b40066690 0x7f6b40068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6b500af000 tx=0x7f6b500b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 0x7f6b601ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60150250 con 0x7f6b60147010 2024-05-08T20:35:00.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 0x7f6b601ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b5e59c640 1 -- 172.21.15.81:0/2473613527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b60147420 con 0x7f6b60147010 2024-05-08T20:35:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b5e59c640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 0x7f6b601ee180 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b480107f0 tx=0x7f6b480046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48024070 con 0x7f6b60147010 2024-05-08T20:35:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f6b48004550 con 0x7f6b60147010 2024-05-08T20:35:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 msgr2=0x7f6b601ee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 0x7f6b601ee180 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b480107f0 tx=0x7f6b480046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 msgr2=0x7f6b601ee180 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b577fe640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b60147010 0x7f6b601ee180 secure :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b480107f0 tx=0x7f6b480046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.090 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.091 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:00.093 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:00.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.096 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:00.097 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b40066690 msgr2=0x7f6b40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b40066690 0x7f6b40068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6b500af000 tx=0x7f6b500b6040 comp rx=0 tx=0).stop 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 msgr2=0x7f6b60146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 --2- 172.21.15.81:0/2473613527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b600c5be0 0x7f6b60146590 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c770 tx=0x7f6b5800cc30 comp rx=0 tx=0).stop 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 reap_dead start 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b5ed9d640 1 -- 172.21.15.81:0/2473613527 reap_dead start 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 shutdown_connections 2024-05-08T20:35:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 >> 172.21.15.81:0/2473613527 conn(0x7f6b600c71b0 msgr2=0x7f6b600ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 shutdown_connections 2024-05-08T20:35:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.080+0000 7f6b64b4e640 1 -- 172.21.15.81:0/2473613527 wait complete. 2024-05-08T20:35:00.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:00.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:35:00.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:35:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.224+0000 7f4a255b5640 1 Processor -- start 2024-05-08T20:35:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.224+0000 7f4a255b5640 1 -- start start 2024-05-08T20:35:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a255b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a20156890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a255b5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a20153580 0x7f4a200c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a255b5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a20156dd0 con 0x7f4a200c2880 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a255b5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200c6720 con 0x7f4a20153580 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a255b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20152890 con 0x7f4a200c5ef0 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a20153580 0x7f4a200c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a20153580 0x7f4a200c3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59542/0 (socket says 172.21.15.81:59542) 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/3479346253 learned_addr learned my addr 172.21.15.81:0/3479346253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a17fff640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a20156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/3479346253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 msgr2=0x7f4a20156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a20156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/3479346253 >> v1:172.21.15.117:6789/0 conn(0x7f4a200c2880 legacy=0x7f4a200aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/3479346253 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200c6440 con 0x7f4a20153580 2024-05-08T20:35:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1f7fe640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153580 0x7f4a200c3240 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31349e02264c638 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1e7fc640 1 -- 172.21.15.81:0/3479346253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180a5700 con 0x7f4a20153580 2024-05-08T20:35:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1e7fc640 1 -- 172.21.15.81:0/3479346253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180a5860 con 0x7f4a20153580 2024-05-08T20:35:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.228+0000 7f4a1e7fc640 1 -- 172.21.15.81:0/3479346253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180a5bf0 con 0x7f4a20153580 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/3479346253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153580 msgr2=0x7f4a200c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153580 0x7f4a200c3240 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1801ca30 comp rx=0 tx=0).stop 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/3479346253 shutdown_connections 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a20153580 0x7f4a200c3240 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- 172.21.15.81:0/3479346253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a20156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/3479346253 >> 172.21.15.81:0/3479346253 conn(0x7f4a200c68c0 msgr2=0x7f4a200c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/3479346253 shutdown_connections 2024-05-08T20:35:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/3479346253 wait complete. 2024-05-08T20:35:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 Processor -- start 2024-05-08T20:35:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- start start 2024-05-08T20:35:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 0x7f4a2014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a200bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a20153580 0x7f4a2014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20072850 con 0x7f4a200c2880 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200a6860 con 0x7f4a20153580 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a201eddf0 con 0x7f4a200c5ef0 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 0x7f4a2014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 0x7f4a2014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59554/0 (socket says 172.21.15.81:59554) 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 -- 172.21.15.81:0/1033592511 learned_addr learned my addr 172.21.15.81:0/1033592511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1f7fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a20153580 0x7f4a2014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a17fff640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a200bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 msgr2=0x7f4a200bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a200c5ef0 0x7f4a200bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a20153580 msgr2=0x7f4a2014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a20153580 0x7f4a2014dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a200c2880 2024-05-08T20:35:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a1effd640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 0x7f4a2014f080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c3c0 tx=0x7f4a1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100052d0 con 0x7f4a200c2880 2024-05-08T20:35:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10005430 con 0x7f4a200c2880 2024-05-08T20:35:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a201ee0d0 con 0x7f4a200c2880 2024-05-08T20:35:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10003840 con 0x7f4a200c2880 2024-05-08T20:35:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.232+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200a64f0 con 0x7f4a200c2880 2024-05-08T20:35:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a255b5640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 0x7f4a2014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20069550 con 0x7f4a2014e120 2024-05-08T20:35:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a17fff640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 0x7f4a2014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a17fff640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a200aa280 con 0x7f4a2014e120 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a17fff640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 0x7f4a2014e500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a200c0790 tx=0x7f4a0800f910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a100039a0 con 0x7f4a200c2880 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a00066690 0x7f4a00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a1f7fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a00066690 0x7f4a00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4a10083750 con 0x7f4a200c2880 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08014870 con 0x7f4a2014e120 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4a080149d0 con 0x7f4a2014e120 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 msgr2=0x7f4a2014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 0x7f4a2014e500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a200c0790 tx=0x7f4a0800f910 comp rx=0 tx=0).stop 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 msgr2=0x7f4a2014e500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a177fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a2014e120 0x7f4a2014e500 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a200c0790 tx=0x7f4a0800f910 comp rx=0 tx=0).stop 2024-05-08T20:35:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.236+0000 7f4a1f7fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a00066690 0x7f4a00068b50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a180ae000 tx=0x7f4a180a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 0x7f4a201f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20073d20 con 0x7f4a201f07b0 2024-05-08T20:35:00.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a17fff640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 0x7f4a201f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a17fff640 1 -- 172.21.15.81:0/1033592511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a200c2c60 con 0x7f4a201f07b0 2024-05-08T20:35:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a17fff640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 0x7f4a201f0bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a200c0790 tx=0x7f4a080046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0802a620 con 0x7f4a201f07b0 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f4a0802a780 con 0x7f4a201f07b0 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 msgr2=0x7f4a201f0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 0x7f4a201f0bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a200c0790 tx=0x7f4a080046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 msgr2=0x7f4a201f0bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a177fe640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a201f07b0 0x7f4a201f0bc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:00.248 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:00.251 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.252 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:00.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.256 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:00.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:00.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a00066690 msgr2=0x7f4a00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a00066690 0x7f4a00068b50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a180ae000 tx=0x7f4a180a7070 comp rx=0 tx=0).stop 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 msgr2=0x7f4a2014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 --2- 172.21.15.81:0/1033592511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200c2880 0x7f4a2014f080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c3c0 tx=0x7f4a1000c880 comp rx=0 tx=0).stop 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/1033592511 reap_dead start 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a1f7fe640 1 -- 172.21.15.81:0/1033592511 reap_dead start 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 shutdown_connections 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 >> 172.21.15.81:0/1033592511 conn(0x7f4a200c68c0 msgr2=0x7f4a200c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 shutdown_connections 2024-05-08T20:35:00.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.244+0000 7f4a255b5640 1 -- 172.21.15.81:0/1033592511 wait complete. 2024-05-08T20:35:00.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:00.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:35:00.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.376+0000 7f0cb969b640 1 Processor -- start 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.376+0000 7f0cb969b640 1 -- start start 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb969b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb40c30d0 0x7f0cb40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb969b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0cb40c2bc0 0x7f0cb40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb969b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb4155e10 con 0x7f0cb40a94b0 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb969b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb406e790 con 0x7f0cb40c30d0 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb969b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb406f460 con 0x7f0cb40c2bc0 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb40c30d0 0x7f0cb40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cb40c30d0 0x7f0cb40c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59556/0 (socket says 172.21.15.81:59556) 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2318257753 learned_addr learned my addr 172.21.15.81:0/2318257753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2318257753 >> v2:172.21.15.117:3300/0 conn(0x7f0cb40c2bc0 0x7f0cb40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2318257753 >> v2:172.21.15.117:3300/0 conn(0x7f0cb40c2bc0 msgr2=0x7f0cb40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:00.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 --2- 172.21.15.81:0/2318257753 >> v2:172.21.15.117:3300/0 conn(0x7f0cb40c2bc0 0x7f0cb40c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2318257753 >> v1:172.21.15.81:6789/0 conn(0x7f0cb40a94b0 legacy=0x7f0cb40a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2318257753 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4156080 con 0x7f0cb40c30d0 2024-05-08T20:35:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb2ffd640 1 --2- 172.21.15.81:0/2318257753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40c30d0 0x7f0cb40c34b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4071050 tx=0x7f0ca401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e94bb1ef2f0d33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb1ffb640 1 -- 172.21.15.81:0/2318257753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40ab660 con 0x7f0cb40c30d0 2024-05-08T20:35:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb1ffb640 1 -- 172.21.15.81:0/2318257753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca40ab7c0 con 0x7f0cb40c30d0 2024-05-08T20:35:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.380+0000 7f0cb1ffb640 1 -- 172.21.15.81:0/2318257753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40abb50 con 0x7f0cb40c30d0 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2318257753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40c30d0 msgr2=0x7f0cb40c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2318257753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40c30d0 0x7f0cb40c34b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4071050 tx=0x7f0ca401c460 comp rx=0 tx=0).stop 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2318257753 shutdown_connections 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2318257753 >> v2:172.21.15.117:3300/0 conn(0x7f0cb40c2bc0 0x7f0cb40c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2318257753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40c30d0 0x7f0cb40c34b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2318257753 >> 172.21.15.81:0/2318257753 conn(0x7f0cb40c4cc0 msgr2=0x7f0cb40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2318257753 shutdown_connections 2024-05-08T20:35:00.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2318257753 wait complete. 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 Processor -- start 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- start start 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 0x7f0cb4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c2bc0 0x7f0cb4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c30d0 0x7f0cb4146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40aca50 con 0x7f0cb40a94b0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40abeb0 con 0x7f0cb40c30d0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40ae280 con 0x7f0cb40c2bc0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 0x7f0cb4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 0x7f0cb4154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59568/0 (socket says 172.21.15.81:59568) 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2134328755 learned_addr learned my addr 172.21.15.81:0/2134328755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c2bc0 0x7f0cb4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb37fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c30d0 0x7f0cb4146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c2bc0 msgr2=0x7f0cb4145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40c2bc0 0x7f0cb4145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c30d0 msgr2=0x7f0cb4146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cb40c30d0 0x7f0cb4146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40094d0 con 0x7f0cb40a94b0 2024-05-08T20:35:00.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb2ffd640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 0x7f0cb4154ca0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ca401c940 tx=0x7f0ca401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b4800 con 0x7f0cb40a94b0 2024-05-08T20:35:00.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca40b4980 con 0x7f0cb40a94b0 2024-05-08T20:35:00.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb40ad570 con 0x7f0cb40a94b0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b4d30 con 0x7f0cb40a94b0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.384+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40addf0 con 0x7f0cb40a94b0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 0x7f0cb40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4073ea0 con 0x7f0cb40ab730 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 0x7f0cb40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ca40a9070 con 0x7f0cb40a94b0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb27fc640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cb40c4970 con 0x7f0cb40ab730 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ca0066710 0x7f0ca0068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb37fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ca0066710 0x7f0ca0068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0ca411ede0 con 0x7f0cb40a94b0 2024-05-08T20:35:00.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 0x7f0cb40ad800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4149d70 tx=0x7f0ca800f910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8014870 con 0x7f0cb40ab730 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0cb37fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ca0066710 0x7f0ca0068bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40acdd0 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f0ca80149d0 con 0x7f0cb40ab730 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 msgr2=0x7f0cb40ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 0x7f0cb40ad800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4149d70 tx=0x7f0ca800f910 comp rx=0 tx=0).stop 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 msgr2=0x7f0cb40ad800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.388+0000 7f0c9b7fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb40ab730 0x7f0cb40ad800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.396+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 0x7f0cb41ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.396+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4074950 con 0x7f0cb41ecc80 2024-05-08T20:35:00.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.396+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 0x7f0cb41ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb27fc640 1 -- 172.21.15.81:0/2134328755 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0cb4072600 con 0x7f0cb41ecc80 2024-05-08T20:35:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb27fc640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 0x7f0cb41ed090 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0cb406ae10 tx=0x7f0ca80046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8020230 con 0x7f0cb41ecc80 2024-05-08T20:35:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f0ca8003620 con 0x7f0cb41ecc80 2024-05-08T20:35:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 msgr2=0x7f0cb41ed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 0x7f0cb41ed090 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0cb406ae10 tx=0x7f0ca80046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 msgr2=0x7f0cb41ed090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:00.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0c9b7fe640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cb41ecc80 0x7f0cb41ed090 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:35:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.414 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:00.415 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ca0066710 msgr2=0x7f0ca0068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ca0066710 0x7f0ca0068bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40acdd0 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2024-05-08T20:35:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 msgr2=0x7f0cb4154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 --2- 172.21.15.81:0/2134328755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb40a94b0 0x7f0cb4154ca0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ca401c940 tx=0x7f0ca401aca0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb37fe640 1 -- 172.21.15.81:0/2134328755 reap_dead start 2024-05-08T20:35:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb37fe640 1 -- 172.21.15.81:0/2134328755 reap_dead start 2024-05-08T20:35:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 shutdown_connections 2024-05-08T20:35:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 >> 172.21.15.81:0/2134328755 conn(0x7f0cb40c4cc0 msgr2=0x7f0cb40c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 shutdown_connections 2024-05-08T20:35:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.400+0000 7f0cb969b640 1 -- 172.21.15.81:0/2134328755 wait complete. 2024-05-08T20:35:00.425 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:00.425 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:35:00.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:35:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 Processor -- start 2024-05-08T20:35:00.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 -- start start 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a0155e10 con 0x7fd4a00c30d0 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a0156080 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a8028640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a006e790 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59574/0 (socket says 172.21.15.81:59574) 2024-05-08T20:35:00.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 -- 172.21.15.81:0/1878286055 learned_addr learned my addr 172.21.15.81:0/1878286055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 -- 172.21.15.81:0/1878286055 >> v1:172.21.15.117:6789/0 conn(0x7fd4a00c2bc0 legacy=0x7fd4a00a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 -- 172.21.15.81:0/1878286055 >> v1:172.21.15.81:6789/0 conn(0x7fd4a00c30d0 legacy=0x7fd4a00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.540+0000 7fd4a65c5640 1 -- 172.21.15.81:0/1878286055 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0156360 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a65c5640 1 --2- 172.21.15.81:0/1878286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389651d04752151d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a4dc2640 1 -- 172.21.15.81:0/1878286055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980a5770 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a4dc2640 1 -- 172.21.15.81:0/1878286055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980a58d0 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a4dc2640 1 -- 172.21.15.81:0/1878286055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980a5c60 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 -- 172.21.15.81:0/1878286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00a9bc0 msgr2=0x7fd4a00c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 --2- 172.21.15.81:0/1878286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49801c9a0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 -- 172.21.15.81:0/1878286055 shutdown_connections 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 --2- 172.21.15.81:0/1878286055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00a9bc0 0x7fd4a00c34b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 -- 172.21.15.81:0/1878286055 >> 172.21.15.81:0/1878286055 conn(0x7fd4a00c4cc0 msgr2=0x7fd4a00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 -- 172.21.15.81:0/1878286055 shutdown_connections 2024-05-08T20:35:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.544+0000 7fd4a8028640 1 -- 172.21.15.81:0/1878286055 wait complete. 2024-05-08T20:35:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 Processor -- start 2024-05-08T20:35:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- start start 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a00a9bc0 0x7fd4a00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a00c30d0 0x7fd4a01f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a013eff0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a013c9d0 con 0x7fd4a00c30d0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c7ee0 con 0x7fd4a00a9bc0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59576/0 (socket says 172.21.15.81:59576) 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 -- 172.21.15.81:0/3067966161 learned_addr learned my addr 172.21.15.81:0/3067966161 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a65c5640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a00c30d0 0x7fd4a01f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a5dc4640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a00a9bc0 0x7fd4a00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 -- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a00a9bc0 msgr2=0x7fd4a00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a00a9bc0 0x7fd4a00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 -- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a00c30d0 msgr2=0x7fd4a01f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a00c30d0 0x7fd4a01f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 -- 172.21.15.81:0/3067966161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498009b30 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a55c3640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c340 tx=0x7fd49000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900052d0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490005430 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a013f2f0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490007260 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.548+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a013f5d0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a0074950 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4900073c0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4967fc640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 0x7fd484068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd4900838c0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4a5dc4640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 0x7fd484068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.552+0000 7fd4a5dc4640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 0x7fd484068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0071d50 tx=0x7fd49c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.556+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd490050890 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fd4a01f09e0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4967fc640 1 -- 172.21.15.81:0/3067966161 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fd490053eb0 con 0x7fd4a00c2bc0 2024-05-08T20:35:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 msgr2=0x7fd484068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 0x7fd484068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0071d50 tx=0x7fd49c009040 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 msgr2=0x7fd4a01f0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c340 tx=0x7fd49000c800 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 shutdown_connections 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd484066690 0x7fd484068b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4a00c30d0 0x7fd4a01f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4a00c2bc0 0x7fd4a01f0c80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 --2- 172.21.15.81:0/3067966161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4a00a9bc0 0x7fd4a00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 >> 172.21.15.81:0/3067966161 conn(0x7fd4a00c4cc0 msgr2=0x7fd4a00c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 shutdown_connections 2024-05-08T20:35:00.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:00.820+0000 7fd4a8028640 1 -- 172.21.15.81:0/3067966161 wait complete. 2024-05-08T20:35:00.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:35:10.841 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:35:10.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.972+0000 7f6ac4b81640 1 Processor -- start 2024-05-08T20:35:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.972+0000 7f6ac4b81640 1 -- start start 2024-05-08T20:35:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac0152220 0x7f6ac01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ac00c26e0 0x7f6ac00c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ac00aac30 0x7f6ac00c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00c4780 con 0x7f6ac00aac30 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac0155140 con 0x7f6ac00c26e0 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ac4b81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0072650 con 0x7f6ac0152220 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ac00aac30 0x7f6ac00c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ac00aac30 0x7f6ac00c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60336/0 (socket says 172.21.15.81:60336) 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 -- 172.21.15.81:0/4214638266 learned_addr learned my addr 172.21.15.81:0/4214638266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abe59c640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac0152220 0x7f6ac01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6ab7fff640 1 --2- 172.21.15.81:0/4214638266 >> v2:172.21.15.117:3300/0 conn(0x7f6ac00c26e0 0x7f6ac00c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 -- 172.21.15.81:0/4214638266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac0152220 msgr2=0x7f6ac01555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac0152220 0x7f6ac01555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 -- 172.21.15.81:0/4214638266 >> v2:172.21.15.117:3300/0 conn(0x7f6ac00c26e0 msgr2=0x7f6ac00c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 --2- 172.21.15.81:0/4214638266 >> v2:172.21.15.117:3300/0 conn(0x7f6ac00c26e0 0x7f6ac00c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.976+0000 7f6abed9d640 1 -- 172.21.15.81:0/4214638266 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac0158b80 con 0x7f6ac00aac30 2024-05-08T20:35:10.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac00aac30 0x7f6ac00c15f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6ac006fe40 tx=0x7f6ab801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e4d7520655ea2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abdd9b640 1 -- 172.21.15.81:0/4214638266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80a57b0 con 0x7f6ac00aac30 2024-05-08T20:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abdd9b640 1 -- 172.21.15.81:0/4214638266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80a5910 con 0x7f6ac00aac30 2024-05-08T20:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abdd9b640 1 -- 172.21.15.81:0/4214638266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80a5ca0 con 0x7f6ac00aac30 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- 172.21.15.81:0/4214638266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac00aac30 msgr2=0x7f6ac00c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac00aac30 0x7f6ac00c15f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6ac006fe40 tx=0x7f6ab801c930 comp rx=0 tx=0).stop 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- 172.21.15.81:0/4214638266 shutdown_connections 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac00aac30 0x7f6ac00c15f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/4214638266 >> v2:172.21.15.117:3300/0 conn(0x7f6ac00c26e0 0x7f6ac00c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/4214638266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac0152220 0x7f6ac01555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- 172.21.15.81:0/4214638266 >> 172.21.15.81:0/4214638266 conn(0x7f6ac00c4cc0 msgr2=0x7f6ac00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- 172.21.15.81:0/4214638266 shutdown_connections 2024-05-08T20:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- 172.21.15.81:0/4214638266 wait complete. 2024-05-08T20:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 Processor -- start 2024-05-08T20:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- start start 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac00aac30 0x7f6ac01edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac00c26e0 0x7f6ac006b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01edb20 con 0x7f6ac0152220 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01ed510 con 0x7f6ac00aac30 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ac4b81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac014f5f0 con 0x7f6ac00c26e0 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60340/0 (socket says 172.21.15.81:60340) 2024-05-08T20:35:10.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 -- 172.21.15.81:0/1346920864 learned_addr learned my addr 172.21.15.81:0/1346920864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abe59c640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac00aac30 0x7f6ac01edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6ab7fff640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac00c26e0 0x7f6ac006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 -- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac00c26e0 msgr2=0x7f6ac006b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac00c26e0 0x7f6ac006b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 -- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac00aac30 msgr2=0x7f6ac01edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac00aac30 0x7f6ac01edfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.980+0000 7f6abed9d640 1 -- 172.21.15.81:0/1346920864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009b30 con 0x7f6ac0152220 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6abed9d640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80af040 tx=0x7f6ab80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80b8670 con 0x7f6ac0152220 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80b87d0 con 0x7f6ac0152220 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac01ed7b0 con 0x7f6ac0152220 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80b8b60 con 0x7f6ac0152220 2024-05-08T20:35:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac006b980 con 0x7f6ac0152220 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac01edc90 con 0x7f6ac0152220 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6ab80b8cc0 con 0x7f6ac0152220 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 0x7f6aa0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6ab811fb50 con 0x7f6ac0152220 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6abe59c640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 0x7f6aa0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.984+0000 7f6abe59c640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 0x7f6aa0068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0151bc0 tx=0x7f6ab0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:10.988+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6ab80ece40 con 0x7f6ac0152220 2024-05-08T20:35:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.276+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6ac0074950 con 0x7f6ac0152220 2024-05-08T20:35:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.276+0000 7f6ab6ffd640 1 -- 172.21.15.81:0/1346920864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f6ab80bc620 con 0x7f6ac0152220 2024-05-08T20:35:11.281 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 msgr2=0x7f6aa0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 0x7f6aa0068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0151bc0 tx=0x7f6ab0008040 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 msgr2=0x7f6ac01eb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80af040 tx=0x7f6ab80196d0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 shutdown_connections 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6aa0066690 0x7f6aa0068b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac0152220 0x7f6ac01eb3e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac00c26e0 0x7f6ac006b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 --2- 172.21.15.81:0/1346920864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac00aac30 0x7f6ac01edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 >> 172.21.15.81:0/1346920864 conn(0x7f6ac00c4cc0 msgr2=0x7f6ac0071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 shutdown_connections 2024-05-08T20:35:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.280+0000 7f6ac4b81640 1 -- 172.21.15.81:0/1346920864 wait complete. 2024-05-08T20:35:11.299 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:35:11.299 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:35:11.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:35:11.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:35:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 Processor -- start 2024-05-08T20:35:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 -- start start 2024-05-08T20:35:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c00711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16c006f0f0 0x7f16c0152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c0156c50 con 0x7f16c00aad40 2024-05-08T20:35:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c0072170 con 0x7f16c006f0f0 2024-05-08T20:35:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c614d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c00c2870 con 0x7f16c014fcb0 2024-05-08T20:35:11.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c514b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c00711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c594c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f16c00aad40 0x7f16c0152c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:35206/0 (socket says 172.21.15.81:35206) 2024-05-08T20:35:11.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c494a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16c006f0f0 0x7f16c0152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c594c640 1 -- 172.21.15.81:0/1846429342 learned_addr learned my addr 172.21.15.81:0/1846429342 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:11.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16b7fff640 1 -- 172.21.15.81:0/1846429342 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174081406 0 0) 0x7f16c0156c50 con 0x7f16c00aad40 2024-05-08T20:35:11.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16b7fff640 1 -- 172.21.15.81:0/1846429342 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ac003530 con 0x7f16c00aad40 2024-05-08T20:35:11.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c514b640 1 -- 172.21.15.81:0/1846429342 >> v2:172.21.15.117:3300/0 conn(0x7f16c006f0f0 msgr2=0x7f16c0152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:11.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c514b640 1 --2- 172.21.15.81:0/1846429342 >> v2:172.21.15.117:3300/0 conn(0x7f16c006f0f0 0x7f16c0152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c514b640 1 -- 172.21.15.81:0/1846429342 >> v1:172.21.15.117:6789/0 conn(0x7f16c00aad40 legacy=0x7f16c0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.416+0000 7f16c514b640 1 -- 172.21.15.81:0/1846429342 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0155e90 con 0x7f16c014fcb0 2024-05-08T20:35:11.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c514b640 1 --2- 172.21.15.81:0/1846429342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c00711d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5e7ce2a1384d41a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16b7fff640 1 -- 172.21.15.81:0/1846429342 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ac640 con 0x7f16c014fcb0 2024-05-08T20:35:11.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16b7fff640 1 -- 172.21.15.81:0/1846429342 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0ac7a0 con 0x7f16c014fcb0 2024-05-08T20:35:11.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16b7fff640 1 -- 172.21.15.81:0/1846429342 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0acb10 con 0x7f16c014fcb0 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- 172.21.15.81:0/1846429342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 msgr2=0x7f16c00711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 --2- 172.21.15.81:0/1846429342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c00711d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c3e0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- 172.21.15.81:0/1846429342 shutdown_connections 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 --2- 172.21.15.81:0/1846429342 >> v2:172.21.15.117:3300/0 conn(0x7f16c006f0f0 0x7f16c0152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 --2- 172.21.15.81:0/1846429342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c00711d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- 172.21.15.81:0/1846429342 >> 172.21.15.81:0/1846429342 conn(0x7f16c00c81c0 msgr2=0x7f16c00c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- 172.21.15.81:0/1846429342 shutdown_connections 2024-05-08T20:35:11.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- 172.21.15.81:0/1846429342 wait complete. 2024-05-08T20:35:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 Processor -- start 2024-05-08T20:35:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.420+0000 7f16c614d640 1 -- start start 2024-05-08T20:35:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 0x7f16c01eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00aad40 0x7f16c0151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c0141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01ef470 con 0x7f16c006f0f0 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01ebd00 con 0x7f16c00aad40 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01eb0f0 con 0x7f16c014fcb0 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 0x7f16c01eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 0x7f16c01eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60344/0 (socket says 172.21.15.81:60344) 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 -- 172.21.15.81:0/3325539336 learned_addr learned my addr 172.21.15.81:0/3325539336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c494a640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00aad40 0x7f16c0151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c594c640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c0141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 msgr2=0x7f16c0141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16c014fcb0 0x7f16c0141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00aad40 msgr2=0x7f16c0151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00aad40 0x7f16c0151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc009420 con 0x7f16c006f0f0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c514b640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 0x7f16c01eef30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c10 tx=0x7f16bc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ba070 con 0x7f16c006f0f0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0ac910 con 0x7f16c006f0f0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c01eb3d0 con 0x7f16c006f0f0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0acc80 con 0x7f16c006f0f0 2024-05-08T20:35:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01eb990 con 0x7f16c006f0f0 2024-05-08T20:35:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 0x7f16c0141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0073df0 con 0x7f16c01499f0 2024-05-08T20:35:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c494a640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 0x7f16c0141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c494a640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16c0150090 con 0x7f16c01499f0 2024-05-08T20:35:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16c494a640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 0x7f16c0141a80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f16c014a2d0 tx=0x7f16b0011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0004230 con 0x7f16c01499f0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.424+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16bc0b3040 con 0x7f16c006f0f0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16a4066730 0x7f16a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f16bc11e0c0 con 0x7f16c006f0f0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16c594c640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16a4066730 0x7f16a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f16b0004390 con 0x7f16c01499f0 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 msgr2=0x7f16c0141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 0x7f16c0141a80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f16c014a2d0 tx=0x7f16b0011970 comp rx=0 tx=0).stop 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 msgr2=0x7f16c0141a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01499f0 0x7f16c0141a80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.428+0000 7f16c594c640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16a4066730 0x7f16a4068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001570 tx=0x7f16b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 0x7f16c00ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015f8a0 con 0x7f16c01517a0 2024-05-08T20:35:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c494a640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 0x7f16c00ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c494a640 1 -- 172.21.15.81:0/3325539336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f16c01535e0 con 0x7f16c01517a0 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c494a640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 0x7f16c00ab210 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f16b001b000 tx=0x7f16b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0024070 con 0x7f16c01517a0 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f16b0003830 con 0x7f16c01517a0 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 msgr2=0x7f16c00ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 0x7f16c00ab210 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f16b001b000 tx=0x7f16b00046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 msgr2=0x7f16c00ab210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c01517a0 0x7f16c00ab210 secure :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f16b001b000 tx=0x7f16b00046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.439 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 11, 2024-05-08T20:35:11.440 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:11.441 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.442 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.443 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.444 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:11.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.450 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16a4066730 msgr2=0x7f16a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16a4066730 0x7f16a4068bf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001570 tx=0x7f16b8009040 comp rx=0 tx=0).stop 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 msgr2=0x7f16c01eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 --2- 172.21.15.81:0/3325539336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c006f0f0 0x7f16c01eef30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c10 tx=0x7f16bc019180 comp rx=0 tx=0).stop 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c594c640 1 -- 172.21.15.81:0/3325539336 reap_dead start 2024-05-08T20:35:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c594c640 1 -- 172.21.15.81:0/3325539336 reap_dead start 2024-05-08T20:35:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 shutdown_connections 2024-05-08T20:35:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 >> 172.21.15.81:0/3325539336 conn(0x7f16c00c81c0 msgr2=0x7f16c014bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 shutdown_connections 2024-05-08T20:35:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.436+0000 7f16c614d640 1 -- 172.21.15.81:0/3325539336 wait complete. 2024-05-08T20:35:11.458 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:11.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:35:11.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:35:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 Processor -- start 2024-05-08T20:35:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 -- start start 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c2bc0 0x7f09e40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09e40a94b0 0x7f09e40a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e4155e10 con 0x7f09e40c30d0 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e406e790 con 0x7f09e40a94b0 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e9ebc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e406f460 con 0x7f09e40c2bc0 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09e40a94b0 0x7f09e40a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09e40a94b0 0x7f09e40a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60360/0 (socket says 172.21.15.81:60360) 2024-05-08T20:35:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 -- 172.21.15.81:0/515246962 learned_addr learned my addr 172.21.15.81:0/515246962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e2ffd640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c2bc0 0x7f09e40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 -- 172.21.15.81:0/515246962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c2bc0 msgr2=0x7f09e40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c2bc0 0x7f09e40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 -- 172.21.15.81:0/515246962 >> v1:172.21.15.81:6789/0 conn(0x7f09e40c30d0 legacy=0x7f09e40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.604+0000 7f09e3fff640 1 -- 172.21.15.81:0/515246962 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40a9e60 con 0x7f09e40a94b0 2024-05-08T20:35:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e3fff640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40a94b0 0x7f09e40a9920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009e80 tx=0x7f09dc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d18969afe4595f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e27fc640 1 -- 172.21.15.81:0/515246962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0a5810 con 0x7f09e40a94b0 2024-05-08T20:35:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e27fc640 1 -- 172.21.15.81:0/515246962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc0a5970 con 0x7f09e40a94b0 2024-05-08T20:35:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e27fc640 1 -- 172.21.15.81:0/515246962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0a5d00 con 0x7f09e40a94b0 2024-05-08T20:35:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- 172.21.15.81:0/515246962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40a94b0 msgr2=0x7f09e40a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40a94b0 0x7f09e40a9920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009e80 tx=0x7f09dc01c950 comp rx=0 tx=0).stop 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- 172.21.15.81:0/515246962 shutdown_connections 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40a94b0 0x7f09e40a9920 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/515246962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c2bc0 0x7f09e40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- 172.21.15.81:0/515246962 >> 172.21.15.81:0/515246962 conn(0x7f09e40c4cc0 msgr2=0x7f09e40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- 172.21.15.81:0/515246962 shutdown_connections 2024-05-08T20:35:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- 172.21.15.81:0/515246962 wait complete. 2024-05-08T20:35:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 Processor -- start 2024-05-08T20:35:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- start start 2024-05-08T20:35:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40a94b0 0x7f09e41ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 0x7f09e41458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c30d0 0x7f09e4145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4149f90 con 0x7f09e40c2bc0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e41eedc0 con 0x7f09e40a94b0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.608+0000 7f09e9ebc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40ac9f0 con 0x7f09e40c30d0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 0x7f09e41458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 0x7f09e41458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60370/0 (socket says 172.21.15.81:60370) 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 -- 172.21.15.81:0/2573523168 learned_addr learned my addr 172.21.15.81:0/2573523168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e3fff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c30d0 0x7f09e4145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40a94b0 0x7f09e41ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c30d0 msgr2=0x7f09e4145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e40c30d0 0x7f09e4145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40a94b0 msgr2=0x7f09e41ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40a94b0 0x7f09e41ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009b30 con 0x7f09e40c2bc0 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40a94b0 0x7f09e41ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e2ffd640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 0x7f09e41458d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d800 tx=0x7f09d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800b6c0 con 0x7f09e40c2bc0 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d800b820 con 0x7f09e40c2bc0 2024-05-08T20:35:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e41eeae0 con 0x7f09e40c2bc0 2024-05-08T20:35:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d800bb90 con 0x7f09e40c2bc0 2024-05-08T20:35:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4147750 con 0x7f09e40c2bc0 2024-05-08T20:35:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 0x7f09e4142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4073ea0 con 0x7f09e41ee620 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 0x7f09e4142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09d800bcf0 con 0x7f09e40c2bc0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f09d0066690 0x7f09d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f09d8084aa0 con 0x7f09e40c2bc0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e3fff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f09d0066690 0x7f09d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.612+0000 7f09e37fe640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09e40c4970 con 0x7f09e41ee620 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 0x7f09e4142550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d400e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09e3fff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f09d0066690 0x7f09d0068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0ae000 tx=0x7f09dc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4017070 con 0x7f09e41ee620 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f09d40052e0 con 0x7f09e41ee620 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 msgr2=0x7f09e4142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 0x7f09e4142550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d400e960 comp rx=0 tx=0).stop 2024-05-08T20:35:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 msgr2=0x7f09e4142550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.616+0000 7f09cbfff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e41ee620 0x7f09e4142550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 0x7f09e4142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e41455a0 con 0x7f09e40ab1a0 2024-05-08T20:35:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 0x7f09e4142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e37fe640 1 -- 172.21.15.81:0/2573523168 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09e4074950 con 0x7f09e40ab1a0 2024-05-08T20:35:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e37fe640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 0x7f09e4142a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d4001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4021070 con 0x7f09e40ab1a0 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f09d4007370 con 0x7f09e40ab1a0 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 msgr2=0x7f09e4142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 0x7f09e4142a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d4001090 comp rx=0 tx=0).stop 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 msgr2=0x7f09e4142a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09cbfff640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e40ab1a0 0x7f09e4142a90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:11.641 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f09d0066690 msgr2=0x7f09d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f09d0066690 0x7f09d0068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0ae000 tx=0x7f09dc0a7070 comp rx=0 tx=0).stop 2024-05-08T20:35:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 msgr2=0x7f09e41458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e9ebc640 1 --2- 172.21.15.81:0/2573523168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09e40c2bc0 0x7f09e41458d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d800 tx=0x7f09d800dcc0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e3fff640 1 -- 172.21.15.81:0/2573523168 reap_dead start 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.624+0000 7f09e3fff640 1 -- 172.21.15.81:0/2573523168 reap_dead start 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.628+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 shutdown_connections 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.628+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 >> 172.21.15.81:0/2573523168 conn(0x7f09e40c4cc0 msgr2=0x7f09e415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.628+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 shutdown_connections 2024-05-08T20:35:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.628+0000 7f09e9ebc640 1 -- 172.21.15.81:0/2573523168 wait complete. 2024-05-08T20:35:11.647 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:11.647 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:35:11.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:35:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 Processor -- start 2024-05-08T20:35:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 -- start start 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14c8070c00 0x7f14c80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c81519d0 0x7f14c8151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80c3a50 con 0x7f14c806b230 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c8072940 con 0x7f14c8070c00 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14cdfc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80705e0 con 0x7f14c81519d0 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14c8070c00 0x7f14c80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14c8070c00 0x7f14c80c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60382/0 (socket says 172.21.15.81:60382) 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 -- 172.21.15.81:0/3451050887 learned_addr learned my addr 172.21.15.81:0/3451050887 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14c7fff640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c81519d0 0x7f14c8151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 -- 172.21.15.81:0/3451050887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c81519d0 msgr2=0x7f14c8151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c81519d0 0x7f14c8151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 -- 172.21.15.81:0/3451050887 >> v1:172.21.15.117:6789/0 conn(0x7f14c806b230 legacy=0x7f14c814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 -- 172.21.15.81:0/3451050887 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80708c0 con 0x7f14c8070c00 2024-05-08T20:35:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14bffff640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c8070c00 0x7f14c80c2800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009870 tx=0x7f14b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12d8366c16b251 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14c6ffd640 1 -- 172.21.15.81:0/3451050887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00ab650 con 0x7f14c8070c00 2024-05-08T20:35:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14c6ffd640 1 -- 172.21.15.81:0/3451050887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b00ab7b0 con 0x7f14c8070c00 2024-05-08T20:35:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.772+0000 7f14c6ffd640 1 -- 172.21.15.81:0/3451050887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00abb40 con 0x7f14c8070c00 2024-05-08T20:35:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/3451050887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c8070c00 msgr2=0x7f14c80c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c8070c00 0x7f14c80c2800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14b0009870 tx=0x7f14b001c490 comp rx=0 tx=0).stop 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/3451050887 shutdown_connections 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c81519d0 0x7f14c8151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/3451050887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c8070c00 0x7f14c80c2800 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/3451050887 >> 172.21.15.81:0/3451050887 conn(0x7f14c80c71b0 msgr2=0x7f14c80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/3451050887 shutdown_connections 2024-05-08T20:35:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/3451050887 wait complete. 2024-05-08T20:35:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 Processor -- start 2024-05-08T20:35:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- start start 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 0x7f14c81ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8070c00 0x7f14c8149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c81519d0 0x7f14c8149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8148dc0 con 0x7f14c806b230 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81edf10 con 0x7f14c81519d0 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81ee1f0 con 0x7f14c8070c00 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 0x7f14c81ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 0x7f14c81ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60396/0 (socket says 172.21.15.81:60396) 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 -- 172.21.15.81:0/105248983 learned_addr learned my addr 172.21.15.81:0/105248983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14bffff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8070c00 0x7f14c8149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c7fff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c81519d0 0x7f14c8149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8070c00 msgr2=0x7f14c8149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8070c00 0x7f14c8149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c81519d0 msgr2=0x7f14c8149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c81519d0 0x7f14c8149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00094d0 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c7fff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c81519d0 0x7f14c8149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c77fe640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 0x7f14c81ed6c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14b800b410 tx=0x7f14b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8004020 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8004180 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c81ee4d0 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8011630 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.776+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c81edc00 con 0x7f14c806b230 2024-05-08T20:35:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 0x7f14c814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8069550 con 0x7f14c8152e20 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14bffff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 0x7f14c814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14bffff640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14c8151590 con 0x7f14c8152e20 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14b8011790 con 0x7f14c806b230 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14bffff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 0x7f14c814d3d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14c80c4d70 tx=0x7f14b0019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14a8066690 0x7f14a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f14b8084210 con 0x7f14c806b230 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c7fff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14a8066690 0x7f14a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00be5f0 con 0x7f14c8152e20 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c7fff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14a8066690 0x7f14a8068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14c8155210 tx=0x7f14c0007420 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f14b00abe50 con 0x7f14c8152e20 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 msgr2=0x7f14c814d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 0x7f14c814d3d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14c80c4d70 tx=0x7f14b0019230 comp rx=0 tx=0).stop 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 msgr2=0x7f14c814d3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.780+0000 7f14c4ff9640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c8152e20 0x7f14c814d3d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 0x7f14c81f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c814f1d0 con 0x7f14c814d910 2024-05-08T20:35:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14bffff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 0x7f14c81f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14bffff640 1 -- 172.21.15.81:0/105248983 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f14c80675e0 con 0x7f14c814d910 2024-05-08T20:35:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14bffff640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 0x7f14c81f0c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14b001c4d0 tx=0x7f14b0009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00bfe70 con 0x7f14c814d910 2024-05-08T20:35:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f14b00c5680 con 0x7f14c814d910 2024-05-08T20:35:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 msgr2=0x7f14c81f0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 0x7f14c81f0c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f14b001c4d0 tx=0x7f14b0009240 comp rx=0 tx=0).stop 2024-05-08T20:35:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 msgr2=0x7f14c81f0c30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c4ff9640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14c814d910 0x7f14c81f0c30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.794 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:11.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 70, 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:11.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.796 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:11.798 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:11.799 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:11.801 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:11.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:11.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:11.805 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:11.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14a8066690 msgr2=0x7f14a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14a8066690 0x7f14a8068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f14c8155210 tx=0x7f14c0007420 comp rx=0 tx=0).stop 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 msgr2=0x7f14c81ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 --2- 172.21.15.81:0/105248983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c806b230 0x7f14c81ed6c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14b800b410 tx=0x7f14b800b8d0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c7fff640 1 -- 172.21.15.81:0/105248983 reap_dead start 2024-05-08T20:35:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14c7fff640 1 -- 172.21.15.81:0/105248983 reap_dead start 2024-05-08T20:35:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 shutdown_connections 2024-05-08T20:35:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 >> 172.21.15.81:0/105248983 conn(0x7f14c80c71b0 msgr2=0x7f14c80c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 shutdown_connections 2024-05-08T20:35:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.788+0000 7f14cdfc1640 1 -- 172.21.15.81:0/105248983 wait complete. 2024-05-08T20:35:11.810 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:11.813 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-05-08T20:35:11.813 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:35:11.813 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-05-08T20:35:11.813 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:35:11.813 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:35:11.814 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:35:11.827 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:35:11.828 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:35:11.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 Processor -- start 2024-05-08T20:35:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 -- start start 2024-05-08T20:35:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 0x7fc290154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc2900c34e0 0x7fc2901554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc290158080 con 0x7fc290152340 2024-05-08T20:35:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29006ab70 con 0x7fc2900c2570 2024-05-08T20:35:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc29707b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc290154b10 con 0x7fc2900c34e0 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc28ffff640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 msgr2=0x7fc290154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.980+0000 7fc28ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 0x7fc290154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc294e17640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc290152340 0x7fc29006d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:35220/0 (socket says 172.21.15.81:35220) 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc294e17640 1 -- 172.21.15.81:0/2872997724 learned_addr learned my addr 172.21.15.81:0/2872997724 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 --2- 172.21.15.81:0/2872997724 >> v2:172.21.15.117:3300/0 conn(0x7fc2900c34e0 0x7fc2901554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 -- 172.21.15.81:0/2872997724 >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 msgr2=0x7fc290154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 --2- 172.21.15.81:0/2872997724 >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 0x7fc290154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 -- 172.21.15.81:0/2872997724 >> v1:172.21.15.117:6789/0 conn(0x7fc290152340 legacy=0x7fc29006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 -- 172.21.15.81:0/2872997724 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29006a890 con 0x7fc2900c34e0 2024-05-08T20:35:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc295618640 1 --2- 172.21.15.81:0/2872997724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2900c34e0 0x7fc2901554a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2900c1780 tx=0x7fc28801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ebeec0c5623e94 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc28f7fe640 1 -- 172.21.15.81:0/2872997724 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880a5950 con 0x7fc2900c34e0 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc28f7fe640 1 -- 172.21.15.81:0/2872997724 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2880a5ab0 con 0x7fc2900c34e0 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.984+0000 7fc28f7fe640 1 -- 172.21.15.81:0/2872997724 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880a5e40 con 0x7fc2900c34e0 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- 172.21.15.81:0/2872997724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2900c34e0 msgr2=0x7fc2901554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- 172.21.15.81:0/2872997724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2900c34e0 0x7fc2901554a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2900c1780 tx=0x7fc28801c890 comp rx=0 tx=0).stop 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- 172.21.15.81:0/2872997724 shutdown_connections 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- 172.21.15.81:0/2872997724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2900c34e0 0x7fc2901554a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- 172.21.15.81:0/2872997724 >> v2:172.21.15.81:3300/0 conn(0x7fc2900c2570 0x7fc290154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- 172.21.15.81:0/2872997724 >> 172.21.15.81:0/2872997724 conn(0x7fc2900c71b0 msgr2=0x7fc2900c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- 172.21.15.81:0/2872997724 shutdown_connections 2024-05-08T20:35:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- 172.21.15.81:0/2872997724 wait complete. 2024-05-08T20:35:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 Processor -- start 2024-05-08T20:35:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- start start 2024-05-08T20:35:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 0x7fc29013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc290152340 0x7fc2901f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900acc70 con 0x7fc2900c2570 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29013b610 con 0x7fc290152340 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc29707b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc290155b60 con 0x7fc2900c34e0 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc294e17640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 msgr2=0x7fc29013b0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc294e17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 0x7fc29013b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:56350/0 (socket says 172.21.15.81:56350) 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 -- 172.21.15.81:0/2904608922 learned_addr learned my addr 172.21.15.81:0/2904608922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc295618640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc290152340 0x7fc2901f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 -- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc290152340 msgr2=0x7fc2901f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc290152340 0x7fc2901f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 -- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 msgr2=0x7fc29013b0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 0x7fc29013b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.988+0000 7fc28ffff640 1 -- 172.21.15.81:0/2904608922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288009a70 con 0x7fc2900c34e0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28ffff640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b550 tx=0x7fc27c00ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c003dd0 con 0x7fc2900c34e0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2901f11d0 con 0x7fc2900c34e0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c005070 con 0x7fc2900c34e0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c005420 con 0x7fc2900c34e0 2024-05-08T20:35:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2900ad130 con 0x7fc2900c34e0 2024-05-08T20:35:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2900675e0 con 0x7fc2900c34e0 2024-05-08T20:35:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc27c005580 con 0x7fc2900c34e0 2024-05-08T20:35:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 0x7fc274068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc27c084a80 con 0x7fc2900c34e0 2024-05-08T20:35:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.992+0000 7fc294e17640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 0x7fc274068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:11.996+0000 7fc294e17640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 0x7fc274068b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc284004820 tx=0x7fc284007b10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.008+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc27c051a50 con 0x7fc2900c34e0 2024-05-08T20:35:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.284+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc290074950 con 0x7fc2900c34e0 2024-05-08T20:35:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.284+0000 7fc28d7fa640 1 -- 172.21.15.81:0/2904608922 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fc27c055070 con 0x7fc2900c34e0 2024-05-08T20:35:12.288 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 msgr2=0x7fc274068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 0x7fc274068b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc284004820 tx=0x7fc284007b10 comp rx=0 tx=0).stop 2024-05-08T20:35:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 msgr2=0x7fc2901f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b550 tx=0x7fc27c00ba10 comp rx=0 tx=0).stop 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 shutdown_connections 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc274066640 0x7fc274068b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc290152340 0x7fc2901f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2900c34e0 0x7fc2901f02c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 --2- 172.21.15.81:0/2904608922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900c2570 0x7fc29013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 >> 172.21.15.81:0/2904608922 conn(0x7fc2900c71b0 msgr2=0x7fc290071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 shutdown_connections 2024-05-08T20:35:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:12.288+0000 7fc29707b640 1 -- 172.21.15.81:0/2904608922 wait complete. 2024-05-08T20:35:15.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 Processor -- start 2024-05-08T20:35:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 -- start start 2024-05-08T20:35:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f44340a9970 0x7f44340aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340c47c0 con 0x7f44340c38f0 2024-05-08T20:35:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340c6220 con 0x7f44340c3510 2024-05-08T20:35:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4439af8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44340c6500 con 0x7f44340a9970 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4433fff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f44340c38f0 legacy=0x7f443414fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f44340a9970 0x7f44340aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f44340a9970 0x7f44340aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:45518/0 (socket says 172.21.15.81:45518) 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 -- 172.21.15.81:0/652435206 learned_addr learned my addr 172.21.15.81:0/652435206 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 -- 172.21.15.81:0/652435206 >> v1:172.21.15.117:6789/0 conn(0x7f44340c3510 legacy=0x7f44340c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 -- 172.21.15.81:0/652435206 >> v1:172.21.15.81:6789/0 conn(0x7f44340c38f0 legacy=0x7f443414fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.464+0000 7f4432ffd640 1 -- 172.21.15.81:0/652435206 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340c4a10 con 0x7f44340a9970 2024-05-08T20:35:15.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4432ffd640 1 --2- 172.21.15.81:0/652435206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340a9970 0x7f44340aaa80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f442801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313e90b44022e77d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f44327fc640 1 -- 172.21.15.81:0/652435206 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280ab600 con 0x7f44340a9970 2024-05-08T20:35:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f44327fc640 1 -- 172.21.15.81:0/652435206 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44280ab760 con 0x7f44340a9970 2024-05-08T20:35:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f44327fc640 1 -- 172.21.15.81:0/652435206 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280abaf0 con 0x7f44340a9970 2024-05-08T20:35:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- 172.21.15.81:0/652435206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340a9970 msgr2=0x7f44340aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 --2- 172.21.15.81:0/652435206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340a9970 0x7f44340aaa80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f442801c460 comp rx=0 tx=0).stop 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- 172.21.15.81:0/652435206 shutdown_connections 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 --2- 172.21.15.81:0/652435206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340a9970 0x7f44340aaa80 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f442801c460 comp rx=0 tx=0).stop 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- 172.21.15.81:0/652435206 >> 172.21.15.81:0/652435206 conn(0x7f44340c68c0 msgr2=0x7f44340c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- 172.21.15.81:0/652435206 shutdown_connections 2024-05-08T20:35:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- 172.21.15.81:0/652435206 wait complete. 2024-05-08T20:35:15.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 Processor -- start 2024-05-08T20:35:15.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.468+0000 7f4439af8640 1 -- start start 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 0x7f44341edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44341562d0 con 0x7f44341f1df0 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434142c00 con 0x7f44340c38f0 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44341f1960 con 0x7f44340c3510 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4433fff640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 msgr2=0x7f44341edc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4433fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 0x7f44341edc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4432ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4432ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:45526/0 (socket says 172.21.15.81:45526) 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:56366/0 (socket says 172.21.15.81:56366) 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4432ffd640 1 -- 172.21.15.81:0/516609355 learned_addr learned my addr 172.21.15.81:0/516609355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 -- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 msgr2=0x7f44340bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 -- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 msgr2=0x7f44341edc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 0x7f44341edc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 -- 172.21.15.81:0/516609355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094d0 con 0x7f44340c3510 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4432ffd640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f44337fe640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4424001ec0 tx=0x7f442400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240052d0 con 0x7f44340c3510 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424005430 con 0x7f44340c3510 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443406d620 con 0x7f44340c3510 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424003840 con 0x7f44340c3510 2024-05-08T20:35:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44341f15f0 con 0x7f44340c3510 2024-05-08T20:35:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.472+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4434074950 con 0x7f44340c3510 2024-05-08T20:35:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.476+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44240039a0 con 0x7f44340c3510 2024-05-08T20:35:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.476+0000 7f441bfff640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 0x7f4420068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.476+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4424083aa0 con 0x7f44340c3510 2024-05-08T20:35:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.476+0000 7f4432ffd640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 0x7f4420068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:15.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.476+0000 7f4432ffd640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 0x7f4420068b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f44280a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.484+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4424050c90 con 0x7f44340c3510 2024-05-08T20:35:15.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.740+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f44341f1780 con 0x7f44340c3510 2024-05-08T20:35:15.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.740+0000 7f441bfff640 1 -- 172.21.15.81:0/516609355 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f4424017620 con 0x7f44340c3510 2024-05-08T20:35:15.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:15.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 msgr2=0x7f4420068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:15.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 0x7f4420068b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f44280a7000 comp rx=0 tx=0).stop 2024-05-08T20:35:15.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 msgr2=0x7f443414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:15.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4424001ec0 tx=0x7f442400c890 comp rx=0 tx=0).stop 2024-05-08T20:35:15.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 shutdown_connections 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4420066640 0x7f4420068b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44341f1df0 0x7f44341edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44340c38f0 0x7f44340bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 --2- 172.21.15.81:0/516609355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44340c3510 0x7f443414e930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 >> 172.21.15.81:0/516609355 conn(0x7f44340c68c0 msgr2=0x7f44340ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 shutdown_connections 2024-05-08T20:35:15.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:15.744+0000 7f4439af8640 1 -- 172.21.15.81:0/516609355 wait complete. 2024-05-08T20:35:18.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.892+0000 7f46bfebb640 1 Processor -- start 2024-05-08T20:35:18.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.892+0000 7f46bfebb640 1 -- start start 2024-05-08T20:35:18.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bfebb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 0x7f46b8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bfebb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 0x7f46b81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bfebb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b8158080 con 0x7f46b8152340 2024-05-08T20:35:18.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bfebb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b806ab70 con 0x7f46b80c34e0 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bfebb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8154b10 con 0x7f46b80c2570 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46be458640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 msgr2=0x7f46b81554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46be458640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 0x7f46b81554a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bdc57640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f46b8152340 0x7f46b806d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:57864/0 (socket says 172.21.15.81:57864) 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bdc57640 1 -- 172.21.15.81:0/787387453 learned_addr learned my addr 172.21.15.81:0/787387453 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bd456640 1 --2- 172.21.15.81:0/787387453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 0x7f46b8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bd456640 1 -- 172.21.15.81:0/787387453 >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 msgr2=0x7f46b81554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bd456640 1 --2- 172.21.15.81:0/787387453 >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 0x7f46b81554a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bd456640 1 -- 172.21.15.81:0/787387453 >> v1:172.21.15.117:6789/0 conn(0x7f46b8152340 legacy=0x7f46b806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.896+0000 7f46bd456640 1 -- 172.21.15.81:0/787387453 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b806a890 con 0x7f46b80c2570 2024-05-08T20:35:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bd456640 1 --2- 172.21.15.81:0/787387453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 0x7f46b8154f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46a80097c0 tx=0x7f46a801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e85e92c210737291 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bcc55640 1 -- 172.21.15.81:0/787387453 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80ab600 con 0x7f46b80c2570 2024-05-08T20:35:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bcc55640 1 -- 172.21.15.81:0/787387453 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80ab760 con 0x7f46b80c2570 2024-05-08T20:35:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bcc55640 1 -- 172.21.15.81:0/787387453 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a80abaf0 con 0x7f46b80c2570 2024-05-08T20:35:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- 172.21.15.81:0/787387453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 msgr2=0x7f46b8154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 --2- 172.21.15.81:0/787387453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 0x7f46b8154f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46a80097c0 tx=0x7f46a801c400 comp rx=0 tx=0).stop 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- 172.21.15.81:0/787387453 shutdown_connections 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 --2- 172.21.15.81:0/787387453 >> v2:172.21.15.81:3300/0 conn(0x7f46b80c34e0 0x7f46b81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 --2- 172.21.15.81:0/787387453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b80c2570 0x7f46b8154f60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- 172.21.15.81:0/787387453 >> 172.21.15.81:0/787387453 conn(0x7f46b80c71b0 msgr2=0x7f46b80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- 172.21.15.81:0/787387453 shutdown_connections 2024-05-08T20:35:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- 172.21.15.81:0/787387453 wait complete. 2024-05-08T20:35:18.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 Processor -- start 2024-05-08T20:35:18.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.900+0000 7f46bfebb640 1 -- start start 2024-05-08T20:35:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 0x7f46b8143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 0x7f46b81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 0x7f46b813ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b813f1c0 con 0x7f46b80c34e0 2024-05-08T20:35:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b813e9b0 con 0x7f46b80c2570 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b813ec00 con 0x7f46b8152340 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bd456640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 msgr2=0x7f46b81513e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bd456640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 0x7f46b81513e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bdc57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 0x7f46b8143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 0x7f46b813ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bdc57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 0x7f46b8143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43336/0 (socket says 172.21.15.81:43336) 2024-05-08T20:35:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bdc57640 1 -- 172.21.15.81:0/2819450826 learned_addr learned my addr 172.21.15.81:0/2819450826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 -- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 msgr2=0x7f46b8143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 0x7f46b8143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 -- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 msgr2=0x7f46b81513e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 0x7f46b81513e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 -- 172.21.15.81:0/2819450826 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009420 con 0x7f46b8152340 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46be458640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 0x7f46b813ded0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46b000bdc0 tx=0x7f46b0009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00064e0 con 0x7f46b8152340 2024-05-08T20:35:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000f070 con 0x7f46b8152340 2024-05-08T20:35:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b813eee0 con 0x7f46b8152340 2024-05-08T20:35:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0006860 con 0x7f46b8152340 2024-05-08T20:35:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b8144290 con 0x7f46b8152340 2024-05-08T20:35:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.904+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b813d810 con 0x7f46b8152340 2024-05-08T20:35:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.908+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46b00069c0 con 0x7f46b8152340 2024-05-08T20:35:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.908+0000 7f46ae7fc640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 0x7f469c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.908+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f46b0085190 con 0x7f46b8152340 2024-05-08T20:35:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.908+0000 7f46bdc57640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 0x7f469c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.908+0000 7f46bdc57640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 0x7f469c068b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005890 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:18.920+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f46b00521f0 con 0x7f46b8152340 2024-05-08T20:35:19.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f46b813dbf0 con 0x7f46b8152340 2024-05-08T20:35:19.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46ae7fc640 1 -- 172.21.15.81:0/2819450826 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f46b813dbf0 con 0x7f46b8152340 2024-05-08T20:35:19.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 msgr2=0x7f469c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 0x7f469c068b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005890 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2024-05-08T20:35:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 msgr2=0x7f46b813ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 0x7f46b813ded0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46b000bdc0 tx=0x7f46b0009eb0 comp rx=0 tx=0).stop 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 shutdown_connections 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066640 0x7f469c068b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46b8152340 0x7f46b813ded0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80c34e0 0x7f46b81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 --2- 172.21.15.81:0/2819450826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46b80c2570 0x7f46b8143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.208+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 >> 172.21.15.81:0/2819450826 conn(0x7f46b80c71b0 msgr2=0x7f46b8153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.212+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 shutdown_connections 2024-05-08T20:35:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:19.212+0000 7f46bfebb640 1 -- 172.21.15.81:0/2819450826 wait complete. 2024-05-08T20:35:20.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:35:20.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:35:22.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 Processor -- start 2024-05-08T20:35:22.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 -- start start 2024-05-08T20:35:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60980c1730 con 0x7f60980c47c0 2024-05-08T20:35:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6098154b90 con 0x7f609806d130 2024-05-08T20:35:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f609e22f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980c1a10 con 0x7f6098155670 2024-05-08T20:35:22.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f6097fff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f60980c47c0 legacy=0x7f60981516d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f60977fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f609806d130 0x7f60980bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:57874/0 (socket says 172.21.15.81:57874) 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f60977fe640 1 -- 172.21.15.81:0/1840316837 learned_addr learned my addr 172.21.15.81:0/1840316837 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:22.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f6097fff640 1 -- 172.21.15.81:0/1840316837 >> v1:172.21.15.81:6789/0 conn(0x7f60980c47c0 legacy=0x7f60981516d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:35:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:35:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:22.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:35:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f6097fff640 1 -- 172.21.15.81:0/1840316837 >> v1:172.21.15.81:6789/0 conn(0x7f60980c47c0 legacy=0x7f60981516d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:35:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:35:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:22.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f6097fff640 1 -- 172.21.15.81:0/1840316837 >> v1:172.21.15.81:6789/0 conn(0x7f60980c47c0 legacy=0x7f60981516d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:23.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:23.784+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 msgr2=0x7f60980a5e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6098155670 0x7f60980a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 -- 172.21.15.81:0/1840316837 >> v1:172.21.15.117:6789/0 conn(0x7f609806d130 legacy=0x7f60980bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 -- 172.21.15.81:0/1840316837 >> v1:172.21.15.81:6789/0 conn(0x7f60980c47c0 legacy=0x7f60981516d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 -- 172.21.15.81:0/1840316837 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60980c1a10 con 0x7f6078003700 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f6095ffb640 1 -- 172.21.15.81:0/1840316837 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6078008d00 con 0x7f60780061b0 2024-05-08T20:35:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f60977fe640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 msgr2=0x7f6078005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f60977fe640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.372+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f60977fe640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 msgr2=0x7f6078005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f60977fe640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:25.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.576+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f60977fe640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 msgr2=0x7f6078005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f60977fe640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 msgr2=0x7f6078008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:25.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:25.980+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:35:26.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f60977fe640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 msgr2=0x7f6078005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:26.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f60977fe640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:35:26.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.117:3300/0 conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 msgr2=0x7f6078005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> v2:172.21.15.81:3300/0 conn(0x7f6078003700 0x7f6078005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.784+0000 7f608effd640 1 -- 172.21.15.81:0/1840316837 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098154e70 con 0x7f60780061b0 2024-05-08T20:35:26.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f608effd640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60780061b0 0x7f6078008650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6078006180 tx=0x7f608001da70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd3d0660ee23385 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:26.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f6096ffd640 1 -- 172.21.15.81:0/1840316837 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800a67d0 con 0x7f60780061b0 2024-05-08T20:35:26.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f6096ffd640 1 -- 172.21.15.81:0/1840316837 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60800aa070 con 0x7f60780061b0 2024-05-08T20:35:26.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f6096ffd640 1 -- 172.21.15.81:0/1840316837 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800a6b50 con 0x7f60780061b0 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 -- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60780061b0 msgr2=0x7f6078008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60780061b0 0x7f6078008650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6078006180 tx=0x7f608001da70 comp rx=0 tx=0).stop 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f6097fff640 1 -- 172.21.15.81:0/1840316837 reap_dead start 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 -- 172.21.15.81:0/1840316837 shutdown_connections 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 --2- 172.21.15.81:0/1840316837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60780061b0 0x7f6078008650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 -- 172.21.15.81:0/1840316837 >> 172.21.15.81:0/1840316837 conn(0x7f60980c68c0 msgr2=0x7f60980c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 -- 172.21.15.81:0/1840316837 shutdown_connections 2024-05-08T20:35:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.792+0000 7f609e22f640 1 -- 172.21.15.81:0/1840316837 wait complete. 2024-05-08T20:35:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.796+0000 7f609e22f640 1 Processor -- start 2024-05-08T20:35:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.796+0000 7f609e22f640 1 -- start start 2024-05-08T20:35:26.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 0x7f6098145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60981f1450 0x7f60981f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f60977fe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 msgr2=0x7f6098145020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f60977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 0x7f6098145020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609806fd20 con 0x7f60780061b0 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098143780 con 0x7f6098146a40 2024-05-08T20:35:26.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60981ef350 con 0x7f60981f1450 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43368/0 (socket says 172.21.15.81:43368) 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 -- 172.21.15.81:0/2901576217 learned_addr learned my addr 172.21.15.81:0/2901576217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f6097fff640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60981f1450 0x7f60981f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 -- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60981f1450 msgr2=0x7f60981f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60981f1450 0x7f60981f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:26.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 -- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 msgr2=0x7f6098145020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 0x7f6098145020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 -- 172.21.15.81:0/2901576217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608000e040 con 0x7f6098146a40 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f608effd640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6080008590 tx=0x7f6080008720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800c1070 con 0x7f6098146a40 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000c040 con 0x7f6098146a40 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6098070a00 con 0x7f6098146a40 2024-05-08T20:35:26.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800bb680 con 0x7f6098146a40 2024-05-08T20:35:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6098070fc0 con 0x7f6098146a40 2024-05-08T20:35:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.800+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60980c3a30 con 0x7f6098146a40 2024-05-08T20:35:26.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.804+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60800bb7e0 con 0x7f6098146a40 2024-05-08T20:35:26.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.804+0000 7f6094ff9640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 0x7f6078069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:26.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.804+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f608011f3e0 con 0x7f6098146a40 2024-05-08T20:35:26.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.804+0000 7f60977fe640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 0x7f6078069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:26.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.804+0000 7f60977fe640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 0x7f6078069740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6088005890 tx=0x7f6088007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:26.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:26.816+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f60800ec440 con 0x7f6098146a40 2024-05-08T20:35:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.088+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f60980c24b0 con 0x7f6098146a40 2024-05-08T20:35:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.088+0000 7f6094ff9640 1 -- 172.21.15.81:0/2901576217 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f60800ac080 con 0x7f6098146a40 2024-05-08T20:35:27.091 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 msgr2=0x7f6078069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 0x7f6078069740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6088005890 tx=0x7f6088007a20 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 msgr2=0x7f60981f08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6080008590 tx=0x7f6080008720 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 shutdown_connections 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6078067280 0x7f6078069740 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60981f1450 0x7f60981f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6098146a40 0x7f60981f08b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 --2- 172.21.15.81:0/2901576217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780061b0 0x7f6098145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 >> 172.21.15.81:0/2901576217 conn(0x7f60980c68c0 msgr2=0x7f60981527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 shutdown_connections 2024-05-08T20:35:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.092+0000 7f609e22f640 1 -- 172.21.15.81:0/2901576217 wait complete. 2024-05-08T20:35:27.111 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:35:27.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:35:27.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:35:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 Processor -- start 2024-05-08T20:35:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 -- start start 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46c014c8e0 0x7f46c0152790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 0x7f46c00c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00c2e20 con 0x7f46c00c31e0 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00a9a50 con 0x7f46c014c8e0 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c7be4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00aada0 con 0x7f46c00c3b70 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c517f640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 msgr2=0x7f46c00c3630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c517f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 0x7f46c00c3630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46c014c8e0 0x7f46c0152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46c014c8e0 0x7f46c0152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43384/0 (socket says 172.21.15.81:43384) 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 -- 172.21.15.81:0/1380262946 learned_addr learned my addr 172.21.15.81:0/1380262946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c6181640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 -- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 msgr2=0x7f46c00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 -- 172.21.15.81:0/1380262946 >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 msgr2=0x7f46c00c3630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 --2- 172.21.15.81:0/1380262946 >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 0x7f46c00c3630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.232+0000 7f46c5980640 1 -- 172.21.15.81:0/1380262946 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00ab080 con 0x7f46c014c8e0 2024-05-08T20:35:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c5980640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014c8e0 0x7f46c0152790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46c0073f90 tx=0x7f46bc01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed571eaa30120c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c497e640 1 -- 172.21.15.81:0/1380262946 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0ab600 con 0x7f46c014c8e0 2024-05-08T20:35:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c497e640 1 -- 172.21.15.81:0/1380262946 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc0a7050 con 0x7f46c014c8e0 2024-05-08T20:35:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c497e640 1 -- 172.21.15.81:0/1380262946 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0ab980 con 0x7f46c014c8e0 2024-05-08T20:35:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 -- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014c8e0 msgr2=0x7f46c0152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014c8e0 0x7f46c0152790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46c0073f90 tx=0x7f46bc01c540 comp rx=0 tx=0).stop 2024-05-08T20:35:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 -- 172.21.15.81:0/1380262946 shutdown_connections 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1380262946 >> v2:172.21.15.81:3300/0 conn(0x7f46c00c31e0 0x7f46c00c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1380262946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014c8e0 0x7f46c0152790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 -- 172.21.15.81:0/1380262946 >> 172.21.15.81:0/1380262946 conn(0x7f46c00c68c0 msgr2=0x7f46c00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 -- 172.21.15.81:0/1380262946 shutdown_connections 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.236+0000 7f46c7be4640 1 -- 172.21.15.81:0/1380262946 wait complete. 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 Processor -- start 2024-05-08T20:35:27.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- start start 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 0x7f46c015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c01f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c014c8e0 0x7f46c01f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c0a30 con 0x7f46c014c8e0 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00a6c30 con 0x7f46c00c31e0 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c0400 con 0x7f46c00c3b70 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c6181640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c014c8e0 msgr2=0x7f46c01f0eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c6181640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c014c8e0 0x7f46c01f0eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 0x7f46c015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 0x7f46c015d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43388/0 (socket says 172.21.15.81:43388) 2024-05-08T20:35:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 -- 172.21.15.81:0/1630755670 learned_addr learned my addr 172.21.15.81:0/1630755670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c517f640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c01f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 msgr2=0x7f46c01f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c00c3b70 0x7f46c01f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c014c8e0 msgr2=0x7f46c01f0eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46c014c8e0 0x7f46c01f0eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0094d0 con 0x7f46c00c31e0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c5980640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 0x7f46c015d5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46bc01cde0 tx=0x7f46bc0192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc006ea0 con 0x7f46c00c31e0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc0b4430 con 0x7f46c00c31e0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01edb50 con 0x7f46c00c31e0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0b47c0 con 0x7f46c00c31e0 2024-05-08T20:35:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c00c06c0 con 0x7f46c00c31e0 2024-05-08T20:35:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 0x7f46c014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.240+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014d0a0 con 0x7f46c014ccc0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46c517f640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 0x7f46c014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46c517f640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46c00c0280 con 0x7f46c014ccc0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46bc0b2040 con 0x7f46c00c31e0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46c517f640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 0x7f46c014b4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46c00a7fe0 tx=0x7f46b0009aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f46a4066640 0x7f46a4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46c6181640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f46a4066640 0x7f46a4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f46bc11e090 con 0x7f46c00c31e0 2024-05-08T20:35:27.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005a50 con 0x7f46c014ccc0 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46c6181640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f46a4066640 0x7f46a4068b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f46c00aa0f0 tx=0x7f46b800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f46b0005bb0 con 0x7f46c014ccc0 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 msgr2=0x7f46c014b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 0x7f46c014b4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46c00a7fe0 tx=0x7f46b0009aa0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 msgr2=0x7f46c014b4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.244+0000 7f46b67fc640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ccc0 0x7f46c014b4c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 0x7f46c014be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0069550 con 0x7f46c014ba00 2024-05-08T20:35:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c517f640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 0x7f46c014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c517f640 1 -- 172.21.15.81:0/1630755670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f46c00c13c0 con 0x7f46c014ba00 2024-05-08T20:35:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c517f640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 0x7f46c014be10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46c0150bc0 tx=0x7f46b00059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0006780 con 0x7f46c014ba00 2024-05-08T20:35:27.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f46b00068e0 con 0x7f46c014ba00 2024-05-08T20:35:27.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 msgr2=0x7f46c014be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 0x7f46c014be10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46c0150bc0 tx=0x7f46b00059e0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 msgr2=0x7f46c014be10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46b67fc640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c014ba00 0x7f46c014be10 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46c0150bc0 tx=0x7f46b00059e0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 72, 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:27.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.257 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:27.259 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:27.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.263 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:27.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.265 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.266 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.267 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.268 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:27.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f46a4066640 msgr2=0x7f46a4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f46a4066640 0x7f46a4068b00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f46c00aa0f0 tx=0x7f46b800b040 comp rx=0 tx=0).stop 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 msgr2=0x7f46c015d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 --2- 172.21.15.81:0/1630755670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c00c31e0 0x7f46c015d5b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46bc01cde0 tx=0x7f46bc0192e0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c6181640 1 -- 172.21.15.81:0/1630755670 reap_dead start 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c6181640 1 -- 172.21.15.81:0/1630755670 reap_dead start 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 shutdown_connections 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 >> 172.21.15.81:0/1630755670 conn(0x7f46c00c68c0 msgr2=0x7f46c00c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 shutdown_connections 2024-05-08T20:35:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.252+0000 7f46c7be4640 1 -- 172.21.15.81:0/1630755670 wait complete. 2024-05-08T20:35:27.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:35:27.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:35:27.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:35:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 Processor -- start 2024-05-08T20:35:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 -- start start 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd84006a500 0x7fd84015d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd840152ab0 con 0x7fd84014fe70 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8401528a0 con 0x7fd84006a500 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd846f34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd840152d90 con 0x7fd840155e90 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd8454d1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd84006a500 0x7fd84015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:34732/0 (socket says 172.21.15.81:34732) 2024-05-08T20:35:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd83ffff640 1 -- 172.21.15.81:0/1400728908 learned_addr learned my addr 172.21.15.81:0/1400728908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd8454d1640 1 -- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 msgr2=0x7fd840069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd8454d1640 1 --2- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd8454d1640 1 -- 172.21.15.81:0/1400728908 >> v1:172.21.15.117:6789/0 conn(0x7fd84014fe70 legacy=0x7fd84006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.396+0000 7fd8454d1640 1 -- 172.21.15.81:0/1400728908 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840153070 con 0x7fd84006a500 2024-05-08T20:35:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd8454d1640 1 --2- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84006a500 0x7fd84015d220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd838009d90 tx=0x7fd83801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce7969d7d05d9fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd83f7fe640 1 -- 172.21.15.81:0/1400728908 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380a58e0 con 0x7fd84006a500 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd83f7fe640 1 -- 172.21.15.81:0/1400728908 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8380a5a40 con 0x7fd84006a500 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd83f7fe640 1 -- 172.21.15.81:0/1400728908 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380a5dd0 con 0x7fd84006a500 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84006a500 msgr2=0x7fd84015d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84006a500 0x7fd84015d220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd838009d90 tx=0x7fd83801c820 comp rx=0 tx=0).stop 2024-05-08T20:35:27.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- 172.21.15.81:0/1400728908 shutdown_connections 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84006a500 0x7fd84015d220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- 172.21.15.81:0/1400728908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- 172.21.15.81:0/1400728908 >> 172.21.15.81:0/1400728908 conn(0x7fd8400c71b0 msgr2=0x7fd8400c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- 172.21.15.81:0/1400728908 shutdown_connections 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- 172.21.15.81:0/1400728908 wait complete. 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 Processor -- start 2024-05-08T20:35:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- start start 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84006a500 0x7fd8400c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840153b50 con 0x7fd84006a500 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840071270 con 0x7fd84014fe70 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.400+0000 7fd846f34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8401f1b00 con 0x7fd840155e90 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd844cd0640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84006a500 msgr2=0x7fd8400c5b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd844cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84006a500 0x7fd8400c5b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43410/0 (socket says 172.21.15.81:43410) 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 -- 172.21.15.81:0/1224969961 learned_addr learned my addr 172.21.15.81:0/1224969961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd8454d1640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 msgr2=0x7fd840144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840155e90 0x7fd840144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84006a500 msgr2=0x7fd8400c5b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84006a500 0x7fd8400c5b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838009a70 con 0x7fd84014fe70 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83ffff640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00e8c0 tx=0x7fd82c00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c009620 con 0x7fd84014fe70 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00c940 con 0x7fd84014fe70 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8400c6140 con 0x7fd84014fe70 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00ccf0 con 0x7fd84014fe70 2024-05-08T20:35:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8400c6700 con 0x7fd84014fe70 2024-05-08T20:35:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd846f34640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 0x7fd840071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd840069550 con 0x7fd840071700 2024-05-08T20:35:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd844cd0640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 0x7fd840071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd844cd0640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd84006dd10 con 0x7fd840071700 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd82c013470 con 0x7fd84014fe70 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.404+0000 7fd844cd0640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 0x7fd840071ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd834000c10 tx=0x7fd83400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd824066640 0x7fd824068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd82c084580 con 0x7fd84014fe70 2024-05-08T20:35:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd8454d1640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd824066640 0x7fd824068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340074e0 con 0x7fd840071700 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd834007640 con 0x7fd840071700 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 msgr2=0x7fd840071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 0x7fd840071ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd834000c10 tx=0x7fd83400c830 comp rx=0 tx=0).stop 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 msgr2=0x7fd840071ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd83d7fa640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840071700 0x7fd840071ae0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.408+0000 7fd8454d1640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd824066640 0x7fd824068b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8380af000 tx=0x7fd8380a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.416+0000 7fd846f34640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 0x7fd84013f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.416+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400675e0 con 0x7fd840072020 2024-05-08T20:35:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.416+0000 7fd844cd0640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 0x7fd84013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.416+0000 7fd844cd0640 1 -- 172.21.15.81:0/1224969961 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd840071420 con 0x7fd840072020 2024-05-08T20:35:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd844cd0640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 0x7fd84013f520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd834007fd0 tx=0x7fd834000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83401f070 con 0x7fd840072020 2024-05-08T20:35:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4794 (secure 0 0 0) 0x7fd834024470 con 0x7fd840072020 2024-05-08T20:35:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 msgr2=0x7fd84013f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 0x7fd84013f520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd834007fd0 tx=0x7fd834000ee0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 msgr2=0x7fd84013f520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd83d7fa640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd840072020 0x7fd84013f520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 72, 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.424 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:27.430 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.432 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:27.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:27.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:27.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:27.435 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:27.435 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd824066640 msgr2=0x7fd824068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd824066640 0x7fd824068b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8380af000 tx=0x7fd8380a7070 comp rx=0 tx=0).stop 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 msgr2=0x7fd8401f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00e8c0 tx=0x7fd82c00ed80 comp rx=0 tx=0).stop 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd8454d1640 1 -- 172.21.15.81:0/1224969961 reap_dead start 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 shutdown_connections 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 --2- 172.21.15.81:0/1224969961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd84014fe70 0x7fd8401f15c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 >> 172.21.15.81:0/1224969961 conn(0x7fd8400c71b0 msgr2=0x7fd8400ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 shutdown_connections 2024-05-08T20:35:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:27.420+0000 7fd846f34640 1 -- 172.21.15.81:0/1224969961 wait complete. 2024-05-08T20:35:27.444 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:35:27.444 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:35:47.445 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:35:47.445 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-05-08T20:35:47.445 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:35:47.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:35:47.449 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:35:47.449 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:35:47.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.580+0000 7ffb2b7d7640 1 Processor -- start 2024-05-08T20:35:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb2b7d7640 1 -- start start 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb2b7d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 0x7ffb2415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb2b7d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb24066000 con 0x7ffb240c3730 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb2b7d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb240c3ba0 con 0x7ffb240c3350 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb2b7d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2406d8a0 con 0x7ffb240c6000 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb29d74640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffb240c3730 0x7ffb241636e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37716/0 (socket says 172.21.15.81:37716) 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb29d74640 1 -- 172.21.15.81:0/2438261113 learned_addr learned my addr 172.21.15.81:0/2438261113 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb28d72640 1 --2- 172.21.15.81:0/2438261113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 0x7ffb2415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb28d72640 1 -- 172.21.15.81:0/2438261113 >> v1:172.21.15.117:6789/0 conn(0x7ffb240c3350 legacy=0x7ffb2415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb28d72640 1 -- 172.21.15.81:0/2438261113 >> v1:172.21.15.81:6789/0 conn(0x7ffb240c3730 legacy=0x7ffb241636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb1bfff640 1 -- 172.21.15.81:0/2438261113 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49251579 0 0) 0x7ffb240c3ba0 con 0x7ffb240c3350 2024-05-08T20:35:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.584+0000 7ffb28d72640 1 -- 172.21.15.81:0/2438261113 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb241567d0 con 0x7ffb240c6000 2024-05-08T20:35:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb28d72640 1 --2- 172.21.15.81:0/2438261113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 0x7ffb2415ca60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097f0 tx=0x7ffb1401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664d14d203f12be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb1bfff640 1 -- 172.21.15.81:0/2438261113 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140ab600 con 0x7ffb240c6000 2024-05-08T20:35:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb1bfff640 1 -- 172.21.15.81:0/2438261113 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140a7050 con 0x7ffb240c6000 2024-05-08T20:35:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb1bfff640 1 -- 172.21.15.81:0/2438261113 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140ab980 con 0x7ffb240c6000 2024-05-08T20:35:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/2438261113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 msgr2=0x7ffb2415ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/2438261113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 0x7ffb2415ca60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097f0 tx=0x7ffb1401c450 comp rx=0 tx=0).stop 2024-05-08T20:35:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/2438261113 shutdown_connections 2024-05-08T20:35:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/2438261113 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c6000 0x7ffb2415ca60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/2438261113 >> 172.21.15.81:0/2438261113 conn(0x7ffb240c68c0 msgr2=0x7ffb240c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/2438261113 shutdown_connections 2024-05-08T20:35:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/2438261113 wait complete. 2024-05-08T20:35:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 Processor -- start 2024-05-08T20:35:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- start start 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 0x7ffb241f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240c3730 0x7ffb24146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24154b30 con 0x7ffb240c6000 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241f5e30 con 0x7ffb240c3730 2024-05-08T20:35:47.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.588+0000 7ffb2b7d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241455f0 con 0x7ffb240c3350 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37750/0 (socket says 172.21.15.81:37750) 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 -- 172.21.15.81:0/1359713992 learned_addr learned my addr 172.21.15.81:0/1359713992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 msgr2=0x7ffb2413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 msgr2=0x7ffb2413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 0x7ffb241f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29d74640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb28d72640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240c3730 0x7ffb24146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240c3730 msgr2=0x7ffb24146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240c3730 0x7ffb24146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 msgr2=0x7ffb2413ea60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:47.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 -- 172.21.15.81:0/1359713992 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009420 con 0x7ffb240c3350 2024-05-08T20:35:47.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb29573640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 0x7ffb241f58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb20000f70 tx=0x7ffb2000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:47.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200054e0 con 0x7ffb240c3350 2024-05-08T20:35:47.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb24155dd0 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb24154350 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20003600 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200039f0 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.592+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb04005260 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.596+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb20003b50 con 0x7ffb240c3350 2024-05-08T20:35:47.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.596+0000 7ffb19ffb640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.596+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ffb20083e30 con 0x7ffb240c3350 2024-05-08T20:35:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.596+0000 7ffb28d72640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.596+0000 7ffb28d72640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 0x7ffb08068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb140ad000 tx=0x7ffb140a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.604+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ffb20050eb0 con 0x7ffb240c3350 2024-05-08T20:35:47.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.876+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffb040057e0 con 0x7ffb240c3350 2024-05-08T20:35:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb19ffb640 1 -- 172.21.15.81:0/1359713992 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7ffb20017070 con 0x7ffb240c3350 2024-05-08T20:35:47.991 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 msgr2=0x7ffb08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 0x7ffb08068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb140ad000 tx=0x7ffb140a6000 comp rx=0 tx=0).stop 2024-05-08T20:35:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 msgr2=0x7ffb241f58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 0x7ffb241f58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffb20000f70 tx=0x7ffb2000c870 comp rx=0 tx=0).stop 2024-05-08T20:35:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 shutdown_connections 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffb08066690 0x7ffb08068b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb240c6000 0x7ffb2413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb240c3730 0x7ffb24146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 --2- 172.21.15.81:0/1359713992 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb240c3350 0x7ffb241f58f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 >> 172.21.15.81:0/1359713992 conn(0x7ffb240c68c0 msgr2=0x7ffb240a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 shutdown_connections 2024-05-08T20:35:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:47.880+0000 7ffb2b7d7640 1 -- 172.21.15.81:0/1359713992 wait complete. 2024-05-08T20:35:50.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:51.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:35:51.059 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:35:51.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 Processor -- start 2024-05-08T20:35:51.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 -- start start 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7dac152220 0x7f7dac1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac0c26e0 0x7f7dac0c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac155140 con 0x7f7dac0aac30 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac0c4780 con 0x7f7dac152220 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7db0e87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac072650 con 0x7f7dac0c26e0 2024-05-08T20:35:51.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daa59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7dac152220 0x7f7dac1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7dac0aac30 0x7f7dac0c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:47910/0 (socket says 172.21.15.81:47910) 2024-05-08T20:35:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daad9d640 1 -- 172.21.15.81:0/3574680884 learned_addr learned my addr 172.21.15.81:0/3574680884 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7da3fff640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac0c26e0 0x7f7dac0c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daa59c640 1 -- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac0c26e0 msgr2=0x7f7dac0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac0c26e0 0x7f7dac0c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daa59c640 1 -- 172.21.15.81:0/3574680884 >> v1:172.21.15.117:6789/0 conn(0x7f7dac0aac30 legacy=0x7f7dac0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.128+0000 7f7daa59c640 1 -- 172.21.15.81:0/3574680884 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac158b80 con 0x7f7dac152220 2024-05-08T20:35:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac152220 0x7f7dac1555d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0097c0 tx=0x7f7d9c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd0c91e4b44d7c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7da9d9b640 1 -- 172.21.15.81:0/3574680884 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0ab600 con 0x7f7dac152220 2024-05-08T20:35:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7da9d9b640 1 -- 172.21.15.81:0/3574680884 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c0a7050 con 0x7f7dac152220 2024-05-08T20:35:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7da9d9b640 1 -- 172.21.15.81:0/3574680884 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0ab980 con 0x7f7dac152220 2024-05-08T20:35:51.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 -- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac152220 msgr2=0x7f7dac1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac152220 0x7f7dac1555d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0097c0 tx=0x7f7d9c01c3e0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 -- 172.21.15.81:0/3574680884 shutdown_connections 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac0c26e0 0x7f7dac0c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3574680884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac152220 0x7f7dac1555d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 -- 172.21.15.81:0/3574680884 >> 172.21.15.81:0/3574680884 conn(0x7f7dac0c4cc0 msgr2=0x7f7dac0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:51.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 -- 172.21.15.81:0/3574680884 shutdown_connections 2024-05-08T20:35:51.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.132+0000 7f7db0e87640 1 -- 172.21.15.81:0/3574680884 wait complete. 2024-05-08T20:35:51.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 Processor -- start 2024-05-08T20:35:51.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- start start 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 0x7f7dac156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 0x7f7dac0a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac14c4d0 con 0x7f7dac0aac30 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac14c820 con 0x7f7dac0c26e0 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac156ab0 con 0x7f7dac152220 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53666/0 (socket says 172.21.15.81:53666) 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 -- 172.21.15.81:0/3886964607 learned_addr learned my addr 172.21.15.81:0/3886964607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 0x7f7dac156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 msgr2=0x7f7dac156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 msgr2=0x7f7dac156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daad9d640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 0x7f7dac0a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 msgr2=0x7f7dac0a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 0x7f7dac0a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 msgr2=0x7f7dac156570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:35:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 -- 172.21.15.81:0/3886964607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c009420 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7daad9d640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 0x7f7dac0a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da3fff640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 0x7f7dac156c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400e850 tx=0x7f7d9400ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940095b0 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac14ab40 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac14e9d0 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400c940 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400ccb0 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.136+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d90005260 con 0x7f7dac0c26e0 2024-05-08T20:35:51.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.140+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d94013470 con 0x7f7dac0c26e0 2024-05-08T20:35:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.140+0000 7f7da2ffd640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 0x7f7d8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.140+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7d94084f80 con 0x7f7dac0c26e0 2024-05-08T20:35:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.140+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 0x7f7d8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.140+0000 7f7daa59c640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 0x7f7d8c068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0097c0 tx=0x7f7d9c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.152+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7d94051fe0 con 0x7f7dac0c26e0 2024-05-08T20:35:51.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7d900057e0 con 0x7f7dac0c26e0 2024-05-08T20:35:51.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7da2ffd640 1 -- 172.21.15.81:0/3886964607 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f7d94021620 con 0x7f7dac0c26e0 2024-05-08T20:35:51.402 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 msgr2=0x7f7d8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 0x7f7d8c068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0097c0 tx=0x7f7d9c0a6000 comp rx=0 tx=0).stop 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 msgr2=0x7f7dac156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 0x7f7dac156c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400e850 tx=0x7f7d9400ed10 comp rx=0 tx=0).stop 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 shutdown_connections 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d8c066690 0x7f7d8c068b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dac152220 0x7f7dac0a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dac0c26e0 0x7f7dac156c90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 --2- 172.21.15.81:0/3886964607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dac0aac30 0x7f7dac156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 >> 172.21.15.81:0/3886964607 conn(0x7f7dac0c4cc0 msgr2=0x7f7dac0c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 shutdown_connections 2024-05-08T20:35:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:51.400+0000 7f7db0e87640 1 -- 172.21.15.81:0/3886964607 wait complete. 2024-05-08T20:35:54.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:35:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 Processor -- start 2024-05-08T20:35:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 -- start start 2024-05-08T20:35:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5cbc0c8230 0x7f5cbc06a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc0c8b10 con 0x7f5cbc1522b0 2024-05-08T20:35:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc152690 con 0x7f5cbc0c8230 2024-05-08T20:35:54.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.560+0000 7f5cc1e6f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc069ec0 con 0x7f5cbc154970 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:38180/0 (socket says 172.21.15.81:38180) 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 -- 172.21.15.81:0/2794467279 learned_addr learned my addr 172.21.15.81:0/2794467279 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbb7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5cbc1522b0 0x7f5cbc0c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:47914/0 (socket says 172.21.15.81:47914) 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbbfff640 1 --2- 172.21.15.81:0/2794467279 >> v2:172.21.15.117:3300/0 conn(0x7f5cbc0c8230 0x7f5cbc06a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 -- 172.21.15.81:0/2794467279 >> v2:172.21.15.117:3300/0 conn(0x7f5cbc0c8230 msgr2=0x7f5cbc06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 --2- 172.21.15.81:0/2794467279 >> v2:172.21.15.117:3300/0 conn(0x7f5cbc0c8230 0x7f5cbc06a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 -- 172.21.15.81:0/2794467279 >> v1:172.21.15.117:6789/0 conn(0x7f5cbc1522b0 legacy=0x7f5cbc0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 -- 172.21.15.81:0/2794467279 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc154ee0 con 0x7f5cbc154970 2024-05-08T20:35:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cbaffd640 1 --2- 172.21.15.81:0/2794467279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006fd0 tx=0x7f5cb001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf821fe6522d239 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cba7fc640 1 -- 172.21.15.81:0/2794467279 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00ab680 con 0x7f5cbc154970 2024-05-08T20:35:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cba7fc640 1 -- 172.21.15.81:0/2794467279 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb00ab7e0 con 0x7f5cbc154970 2024-05-08T20:35:54.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.564+0000 7f5cba7fc640 1 -- 172.21.15.81:0/2794467279 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00abb70 con 0x7f5cbc154970 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/2794467279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 msgr2=0x7f5cbc06a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/2794467279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0006fd0 tx=0x7f5cb001c480 comp rx=0 tx=0).stop 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/2794467279 shutdown_connections 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/2794467279 >> v2:172.21.15.117:3300/0 conn(0x7f5cbc0c8230 0x7f5cbc06a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/2794467279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc154970 0x7f5cbc06a310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/2794467279 >> 172.21.15.81:0/2794467279 conn(0x7f5cbc0ca330 msgr2=0x7f5cbc0ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/2794467279 shutdown_connections 2024-05-08T20:35:54.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/2794467279 wait complete. 2024-05-08T20:35:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 Processor -- start 2024-05-08T20:35:54.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- start start 2024-05-08T20:35:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc0c8230 0x7f5cbc1edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 0x7f5cbc1ee540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc1ee090 con 0x7f5cbc1522b0 2024-05-08T20:35:54.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0ac580 con 0x7f5cbc154970 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0acab0 con 0x7f5cbc0c8230 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53674/0 (socket says 172.21.15.81:53674) 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 -- 172.21.15.81:0/431777715 learned_addr learned my addr 172.21.15.81:0/431777715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbb7fe640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc0c8230 0x7f5cbc1edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbbfff640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 0x7f5cbc1ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 -- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc0c8230 msgr2=0x7f5cbc1edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc0c8230 0x7f5cbc1edb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 -- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 msgr2=0x7f5cbc1ee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 0x7f5cbc1ee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 -- 172.21.15.81:0/431777715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009480 con 0x7f5cbc1522b0 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbbfff640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 0x7f5cbc1ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:35:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cbaffd640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5cb001cd20 tx=0x7f5cb0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0005ba0 con 0x7f5cbc1522b0 2024-05-08T20:35:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0005d00 con 0x7f5cbc1522b0 2024-05-08T20:35:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc0ac7d0 con 0x7f5cbc1522b0 2024-05-08T20:35:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00abb70 con 0x7f5cbc1522b0 2024-05-08T20:35:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.568+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc1f0a50 con 0x7f5cbc1522b0 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc0675e0 con 0x7f5cbc1522b0 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5cb00abcd0 con 0x7f5cbc1522b0 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5ca3fff640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 0x7f5ca8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5cb011eb20 con 0x7f5cbc1522b0 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5cbb7fe640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 0x7f5ca8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.572+0000 7f5cbb7fe640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 0x7f5ca8068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc158ea0 tx=0x7f5cac007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.576+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5cb00ebc30 con 0x7f5cbc1522b0 2024-05-08T20:35:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5cbc074950 con 0x7f5cbc1522b0 2024-05-08T20:35:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5ca3fff640 1 -- 172.21.15.81:0/431777715 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f5cb00c3080 con 0x7f5cbc1522b0 2024-05-08T20:35:54.819 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:35:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 msgr2=0x7f5ca8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 0x7f5ca8068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc158ea0 tx=0x7f5cac007e90 comp rx=0 tx=0).stop 2024-05-08T20:35:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 msgr2=0x7f5cbc150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5cb001cd20 tx=0x7f5cb0019220 comp rx=0 tx=0).stop 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 shutdown_connections 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5ca8066690 0x7f5ca8068b50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cbc154970 0x7f5cbc1ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc1522b0 0x7f5cbc150f60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 --2- 172.21.15.81:0/431777715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cbc0c8230 0x7f5cbc1edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 >> 172.21.15.81:0/431777715 conn(0x7f5cbc0ca330 msgr2=0x7f5cbc06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 shutdown_connections 2024-05-08T20:35:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.816+0000 7f5cc1e6f640 1 -- 172.21.15.81:0/431777715 wait complete. 2024-05-08T20:35:54.839 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:35:54.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:35:54.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:35:54.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 Processor -- start 2024-05-08T20:35:54.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 -- start start 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7face80c2800 0x7face81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80c3a50 con 0x7face8070c00 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80705e0 con 0x7face806b230 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7faced8e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80c2c70 con 0x7face80c2800 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7facdffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7face8070c00 0x7face81519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45668/0 (socket says 172.21.15.81:45668) 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7facdffff640 1 -- 172.21.15.81:0/2695604618 learned_addr learned my addr 172.21.15.81:0/2695604618 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face77fe640 1 --2- 172.21.15.81:0/2695604618 >> v2:172.21.15.117:3300/0 conn(0x7face80c2800 0x7face81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521294505 0 0) 0x7face80c3a50 con 0x7face8070c00 2024-05-08T20:35:54.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd4003530 con 0x7face8070c00 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2313426194 0 0) 0x7facd4003530 con 0x7face8070c00 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 >> v2:172.21.15.117:3300/0 conn(0x7face80c2800 msgr2=0x7face81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 --2- 172.21.15.81:0/2695604618 >> v2:172.21.15.117:3300/0 conn(0x7face80c2800 0x7face81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 >> v1:172.21.15.117:6789/0 conn(0x7face806b230 legacy=0x7face814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80708c0 con 0x7face8070c00 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7facd0001680 con 0x7face8070c00 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 >> v1:172.21.15.81:6789/0 conn(0x7face8070c00 legacy=0x7face81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7facd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd40047d0 0x7facd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd4005190 0x7facd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80c2c70 con 0x7facd4003980 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd400c130 con 0x7facd4005190 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd400c2f0 con 0x7facd40047d0 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7facdffff640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd40047d0 0x7facd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7facd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face77fe640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd4005190 0x7facd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 -- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd40047d0 msgr2=0x7facd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7facd40047d0 0x7facd4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 -- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd4005190 msgr2=0x7facd400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:54.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd4005190 0x7facd400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face77fe640 1 -- 172.21.15.81:0/2695604618 reap_dead start 2024-05-08T20:35:54.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.960+0000 7face6ffd640 1 -- 172.21.15.81:0/2695604618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4003530 con 0x7facd4003980 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7face6ffd640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7facd4003da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7facd8001780 tx=0x7facd801c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b018d97d1e7c96f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80052d0 con 0x7facd4003980 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd80a7050 con 0x7facd4003980 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7face67fc640 1 -- 172.21.15.81:0/2695604618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8003600 con 0x7facd4003980 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 -- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 msgr2=0x7facd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7facd4003da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7facd8001780 tx=0x7facd801c140 comp rx=0 tx=0).stop 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 -- 172.21.15.81:0/2695604618 shutdown_connections 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 --2- 172.21.15.81:0/2695604618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7facd4003da0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 -- 172.21.15.81:0/2695604618 >> 172.21.15.81:0/2695604618 conn(0x7face80c71b0 msgr2=0x7face80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:54.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 -- 172.21.15.81:0/2695604618 shutdown_connections 2024-05-08T20:35:54.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.964+0000 7faced8e6640 1 -- 172.21.15.81:0/2695604618 wait complete. 2024-05-08T20:35:54.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 Processor -- start 2024-05-08T20:35:54.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- start start 2024-05-08T20:35:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7face80c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7face8152bf0 0x7face80c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7face80c5b50 0x7face81f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8148090 con 0x7facd4003980 2024-05-08T20:35:54.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81ed5f0 con 0x7face8152bf0 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face81ed890 con 0x7face80c5b50 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7face80c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7face80c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53692/0 (socket says 172.21.15.81:53692) 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 -- 172.21.15.81:0/774549114 learned_addr learned my addr 172.21.15.81:0/774549114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7facdffff640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7face8152bf0 0x7face80c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face77fe640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7face80c5b50 0x7face81f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7face80c5b50 msgr2=0x7face81f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7face80c5b50 0x7face81f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7face8152bf0 msgr2=0x7face80c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7face8152bf0 0x7face80c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face81edb70 con 0x7facd4003980 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face6ffd640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7face80c0840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facd801bf70 tx=0x7facd4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80072f0 con 0x7facd4003980 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8007450 con 0x7facd4003980 2024-05-08T20:35:54.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face81ede50 con 0x7facd4003980 2024-05-08T20:35:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80067e0 con 0x7facd4003980 2024-05-08T20:35:54.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80c0d80 con 0x7facd4003980 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 0x7face81f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8152fd0 con 0x7face81f0f90 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.968+0000 7facdffff640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 0x7face81f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7facdffff640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face806b820 con 0x7face81f0f90 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7facdffff640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 0x7face81f1370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7face80c1340 tx=0x7facd0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0004a00 con 0x7face81f0f90 2024-05-08T20:35:54.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7facd8006940 con 0x7facd4003980 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7facc8066760 0x7facc8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7facd811e280 con 0x7facd4003980 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face77fe640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7facc8066760 0x7facc8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7facd0004b60 con 0x7face81f0f90 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 msgr2=0x7face81f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 0x7face81f1370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7face80c1340 tx=0x7facd0011cf0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 msgr2=0x7face81f1370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face4ff9640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81f0f90 0x7face81f1370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.972+0000 7face77fe640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7facc8066760 0x7facc8068c20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7face8070fe0 tx=0x7face000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 0x7face8145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8069550 con 0x7face8145580 2024-05-08T20:35:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7facdffff640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 0x7face8145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7facdffff640 1 -- 172.21.15.81:0/774549114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7face80675e0 con 0x7face8145580 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7facdffff640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 0x7face8145990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7facd0017000 tx=0x7facd0001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0022070 con 0x7face8145580 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7facd001d300 con 0x7face8145580 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 msgr2=0x7face8145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 0x7face8145990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7facd0017000 tx=0x7facd0001160 comp rx=0 tx=0).stop 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 msgr2=0x7face8145990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face4ff9640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face8145580 0x7face8145990 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:54.984 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:35:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:54.998 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7facc8066760 msgr2=0x7facc8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7facc8066760 0x7facc8068c20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7face8070fe0 tx=0x7face000b040 comp rx=0 tx=0).stop 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 msgr2=0x7face80c0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 --2- 172.21.15.81:0/774549114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facd4003980 0x7face80c0840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facd801bf70 tx=0x7facd4005800 comp rx=0 tx=0).stop 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face77fe640 1 -- 172.21.15.81:0/774549114 reap_dead start 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7face77fe640 1 -- 172.21.15.81:0/774549114 reap_dead start 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 shutdown_connections 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 >> 172.21.15.81:0/774549114 conn(0x7face80c71b0 msgr2=0x7face806a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 shutdown_connections 2024-05-08T20:35:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:54.980+0000 7faced8e6640 1 -- 172.21.15.81:0/774549114 wait complete. 2024-05-08T20:35:55.000 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:55.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:35:55.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:35:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 Processor -- start 2024-05-08T20:35:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 -- start start 2024-05-08T20:35:55.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8406b230 0x7f2d840c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d84070c00 0x7f2d8414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840c3a50 con 0x7f2d8414edf0 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d84072940 con 0x7f2d84070c00 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8c5b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840705e0 con 0x7f2d8406b230 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d89b4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d84070c00 0x7f2d8414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8ab4d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d8414edf0 0x7f2d841519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45684/0 (socket says 172.21.15.81:45684) 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8ab4d640 1 -- 172.21.15.81:0/3520994548 learned_addr learned my addr 172.21.15.81:0/3520994548 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8406b230 0x7f2d840c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d89b4b640 1 -- 172.21.15.81:0/3520994548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8406b230 msgr2=0x7f2d840c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d89b4b640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8406b230 0x7f2d840c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d89b4b640 1 -- 172.21.15.81:0/3520994548 >> v1:172.21.15.81:6789/0 conn(0x7f2d8414edf0 legacy=0x7f2d841519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d8934a640 1 -- 172.21.15.81:0/3520994548 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142460566 0 0) 0x7f2d840c3a50 con 0x7f2d8414edf0 2024-05-08T20:35:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.112+0000 7f2d89b4b640 1 -- 172.21.15.81:0/3520994548 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840708c0 con 0x7f2d84070c00 2024-05-08T20:35:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d89b4b640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414e8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d7401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68858d450de6d867 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8934a640 1 -- 172.21.15.81:0/3520994548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740ab600 con 0x7f2d84070c00 2024-05-08T20:35:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8934a640 1 -- 172.21.15.81:0/3520994548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740a7050 con 0x7f2d84070c00 2024-05-08T20:35:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8934a640 1 -- 172.21.15.81:0/3520994548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740ab980 con 0x7f2d84070c00 2024-05-08T20:35:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/3520994548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 msgr2=0x7f2d8414e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414e8b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d7401c410 comp rx=0 tx=0).stop 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/3520994548 shutdown_connections 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414e8b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/3520994548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8406b230 0x7f2d840c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/3520994548 >> 172.21.15.81:0/3520994548 conn(0x7f2d840c71b0 msgr2=0x7f2d840c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/3520994548 shutdown_connections 2024-05-08T20:35:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/3520994548 wait complete. 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.116+0000 7f2d8c5b0640 1 Processor -- start 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- start start 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d8406b230 0x7f2d840c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8414edf0 0x7f2d8414d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414cac0 con 0x7f2d84070c00 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841ee4c0 con 0x7f2d8406b230 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414c190 con 0x7f2d8414edf0 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53740/0 (socket says 172.21.15.81:53740) 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 -- 172.21.15.81:0/1185193637 learned_addr learned my addr 172.21.15.81:0/1185193637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d8406b230 0x7f2d840c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8ab4d640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8414edf0 0x7f2d8414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8414edf0 msgr2=0x7f2d8414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d8414edf0 0x7f2d8414d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d8406b230 msgr2=0x7f2d840c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d8406b230 0x7f2d840c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009420 con 0x7f2d84070c00 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d89b4b640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d740191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b4610 con 0x7f2d84070c00 2024-05-08T20:35:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740b4790 con 0x7f2d84070c00 2024-05-08T20:35:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8414c470 con 0x7f2d84070c00 2024-05-08T20:35:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b4b40 con 0x7f2d84070c00 2024-05-08T20:35:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d841482d0 con 0x7f2d84070c00 2024-05-08T20:35:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 0x7f2d841ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84069550 con 0x7f2d84152af0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 0x7f2d841ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d740b2040 con 0x7f2d84070c00 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8a34c640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d84069ec0 con 0x7f2d84152af0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d68066690 0x7f2d68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2d7411e5d0 con 0x7f2d84070c00 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 0x7f2d841ea850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e7a0 tx=0x7f2d8000ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.120+0000 7f2d8ab4d640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d68066690 0x7f2d68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000ee50 con 0x7f2d84152af0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d8ab4d640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d68066690 0x7f2d68068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0012f0 tx=0x7f2d7c007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2d8000a990 con 0x7f2d84152af0 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 msgr2=0x7f2d841ea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 0x7f2d841ea850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e7a0 tx=0x7f2d8000ec60 comp rx=0 tx=0).stop 2024-05-08T20:35:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 msgr2=0x7f2d841ea850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.124+0000 7f2d7affd640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d84152af0 0x7f2d841ea850 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.128+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 0x7f2d841ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.128+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8414c600 con 0x7f2d840c6330 2024-05-08T20:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.128+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 0x7f2d841ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8a34c640 1 -- 172.21.15.81:0/1185193637 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2d840675e0 con 0x7f2d840c6330 2024-05-08T20:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8a34c640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 0x7f2d841ead90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e7a0 tx=0x7f2d800046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800202b0 con 0x7f2d840c6330 2024-05-08T20:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f2d80004530 con 0x7f2d840c6330 2024-05-08T20:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 msgr2=0x7f2d841ead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 0x7f2d841ead90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000e7a0 tx=0x7f2d800046d0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 msgr2=0x7f2d841ead90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d7affd640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d840c6330 0x7f2d841ead90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:55.135 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.136 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.139 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:55.140 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.141 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:55.142 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.143 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.146 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.147 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:55.148 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d68066690 msgr2=0x7f2d68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d68066690 0x7f2d68068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0012f0 tx=0x7f2d7c007ef0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 msgr2=0x7f2d8414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097c0 tx=0x7f2d740191b0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8ab4d640 1 -- 172.21.15.81:0/1185193637 reap_dead start 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 shutdown_connections 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 --2- 172.21.15.81:0/1185193637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d84070c00 0x7f2d8414cf50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 >> 172.21.15.81:0/1185193637 conn(0x7f2d840c71b0 msgr2=0x7f2d841519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 shutdown_connections 2024-05-08T20:35:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.132+0000 7f2d8c5b0640 1 -- 172.21.15.81:0/1185193637 wait complete. 2024-05-08T20:35:55.152 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:55.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:35:55.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:35:55.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.276+0000 7fe5039ac640 1 Processor -- start 2024-05-08T20:35:55.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 -- start start 2024-05-08T20:35:55.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc070c00 0x7fe4fc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4fc1519d0 0x7fe4fc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc0c3a50 con 0x7fe4fc06b230 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4fc072940 con 0x7fe4fc1519d0 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe5039ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc0705e0 con 0x7fe4fc070c00 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe500f47640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc070c00 0x7fe4fc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501f49640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4fc1519d0 0x7fe4fc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501748640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe4fc06b230 0x7fe4fc14e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:47942/0 (socket says 172.21.15.81:47942) 2024-05-08T20:35:55.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501748640 1 -- 172.21.15.81:0/252741249 learned_addr learned my addr 172.21.15.81:0/252741249 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:35:55.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501f49640 1 -- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc070c00 msgr2=0x7fe4fc0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:55.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501f49640 1 --2- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc070c00 0x7fe4fc0c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501f49640 1 -- 172.21.15.81:0/252741249 >> v1:172.21.15.117:6789/0 conn(0x7fe4fc06b230 legacy=0x7fe4fc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.280+0000 7fe501f49640 1 -- 172.21.15.81:0/252741249 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc0708c0 con 0x7fe4fc1519d0 2024-05-08T20:35:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe501f49640 1 --2- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc1519d0 0x7fe4fc151e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009d90 tx=0x7fe4f401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59da84cf4b21f53f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe4f3fff640 1 -- 172.21.15.81:0/252741249 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40a59c0 con 0x7fe4fc1519d0 2024-05-08T20:35:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe4f3fff640 1 -- 172.21.15.81:0/252741249 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f40a5b20 con 0x7fe4fc1519d0 2024-05-08T20:35:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe4f3fff640 1 -- 172.21.15.81:0/252741249 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40ad440 con 0x7fe4fc1519d0 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc1519d0 msgr2=0x7fe4fc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc1519d0 0x7fe4fc151e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009d90 tx=0x7fe4f401c8e0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- 172.21.15.81:0/252741249 shutdown_connections 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc1519d0 0x7fe4fc151e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- 172.21.15.81:0/252741249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc070c00 0x7fe4fc0c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- 172.21.15.81:0/252741249 >> 172.21.15.81:0/252741249 conn(0x7fe4fc0c71b0 msgr2=0x7fe4fc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- 172.21.15.81:0/252741249 shutdown_connections 2024-05-08T20:35:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- 172.21.15.81:0/252741249 wait complete. 2024-05-08T20:35:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 Processor -- start 2024-05-08T20:35:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- start start 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc06b230 0x7fe4fc1ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 0x7fe4fc0c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1519d0 0x7fe4fc146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc146400 con 0x7fe4fc070c00 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1ed9b0 con 0x7fe4fc06b230 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe5039ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1edc90 con 0x7fe4fc1519d0 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe500f47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 0x7fe4fc0c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe500f47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 0x7fe4fc0c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53748/0 (socket says 172.21.15.81:53748) 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe500f47640 1 -- 172.21.15.81:0/3597850703 learned_addr learned my addr 172.21.15.81:0/3597850703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe501748640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc06b230 0x7fe4fc1ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.284+0000 7fe501f49640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1519d0 0x7fe4fc146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1519d0 msgr2=0x7fe4fc146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1519d0 0x7fe4fc146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc06b230 msgr2=0x7fe4fc1ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4fc06b230 0x7fe4fc1ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4009a70 con 0x7fe4fc070c00 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe500f47640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 0x7fe4fc0c05e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e930 tx=0x7fe4ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec009690 con 0x7fe4fc070c00 2024-05-08T20:35:55.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00ca00 con 0x7fe4fc070c00 2024-05-08T20:35:55.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00cd70 con 0x7fe4fc070c00 2024-05-08T20:35:55.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc1edf70 con 0x7fe4fc070c00 2024-05-08T20:35:55.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc145530 con 0x7fe4fc070c00 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe5039ac640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 0x7fe4fc146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc069550 con 0x7fe4fc0c0b20 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe501748640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 0x7fe4fc146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4ec013470 con 0x7fe4fc070c00 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe501748640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4fc0677d0 con 0x7fe4fc0c0b20 2024-05-08T20:35:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4e0066690 0x7fe4e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe4ec084780 con 0x7fe4fc070c00 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe501f49640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4e0066690 0x7fe4e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe501748640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 0x7fe4fc146dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f70 tx=0x7fe4f8001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8011580 con 0x7fe4fc0c0b20 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.288+0000 7fe501f49640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4e0066690 0x7fe4e0068b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40af000 tx=0x7fe4f40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.292+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe4f80116e0 con 0x7fe4fc0c0b20 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.292+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 msgr2=0x7fe4fc146dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.292+0000 7fe4f1ffb640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 0x7fe4fc146dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f70 tx=0x7fe4f8001930 comp rx=0 tx=0).stop 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.292+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 msgr2=0x7fe4fc146dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.292+0000 7fe4f1ffb640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc0c0b20 0x7fe4fc146dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 0x7fe4fc153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc14f1d0 con 0x7fe4fc1f08d0 2024-05-08T20:35:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe501748640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 0x7fe4fc153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe501748640 1 -- 172.21.15.81:0/3597850703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe4fc0675e0 con 0x7fe4fc1f08d0 2024-05-08T20:35:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe501748640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 0x7fe4fc153d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f70 tx=0x7fe4f8000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8023070 con 0x7fe4fc1f08d0 2024-05-08T20:35:55.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7fe4f8013600 con 0x7fe4fc1f08d0 2024-05-08T20:35:55.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 msgr2=0x7fe4fc153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 0x7fe4fc153d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f70 tx=0x7fe4f8000ee0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 msgr2=0x7fe4fc153d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe4f1ffb640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4fc1f08d0 0x7fe4fc153d10 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f70 tx=0x7fe4f8000ee0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:35:55.304 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:35:55.307 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:35:55.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:35:55.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:35:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:35:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:35:55.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:35:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:35:55.317 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4e0066690 msgr2=0x7fe4e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4e0066690 0x7fe4e0068b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40af000 tx=0x7fe4f40a7070 comp rx=0 tx=0).stop 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 msgr2=0x7fe4fc0c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 --2- 172.21.15.81:0/3597850703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4fc070c00 0x7fe4fc0c05e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e930 tx=0x7fe4ec00edf0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe501f49640 1 -- 172.21.15.81:0/3597850703 reap_dead start 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe501f49640 1 -- 172.21.15.81:0/3597850703 reap_dead start 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 shutdown_connections 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 >> 172.21.15.81:0/3597850703 conn(0x7fe4fc0c71b0 msgr2=0x7fe4fc0c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 shutdown_connections 2024-05-08T20:35:55.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.300+0000 7fe5039ac640 1 -- 172.21.15.81:0/3597850703 wait complete. 2024-05-08T20:35:55.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:35:55.322 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:35:55.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:35:55.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 Processor -- start 2024-05-08T20:35:55.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 -- start start 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c151f00 0x7ff43c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff43c0ca000 0x7ff43c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c158e20 con 0x7ff43c154cf0 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c06bb20 con 0x7ff43c0ca000 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.428+0000 7ff4410df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1548e0 con 0x7ff43c151f00 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff43c0ca000 0x7ff43c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff43c0ca000 0x7ff43c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53764/0 (socket says 172.21.15.81:53764) 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 -- 172.21.15.81:0/836647209 learned_addr learned my addr 172.21.15.81:0/836647209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43ad9d640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c151f00 0x7ff43c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 -- 172.21.15.81:0/836647209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c151f00 msgr2=0x7ff43c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c151f00 0x7ff43c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 -- 172.21.15.81:0/836647209 >> v1:172.21.15.117:6789/0 conn(0x7ff43c154cf0 legacy=0x7ff43c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 -- 172.21.15.81:0/836647209 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c155860 con 0x7ff43c0ca000 2024-05-08T20:35:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff43b59e640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c0ca000 0x7ff43c0ca490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff434009e50 tx=0x7ff43401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f3789d0f19de9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff439d9b640 1 -- 172.21.15.81:0/836647209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a57f0 con 0x7ff43c0ca000 2024-05-08T20:35:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff439d9b640 1 -- 172.21.15.81:0/836647209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340a5950 con 0x7ff43c0ca000 2024-05-08T20:35:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff439d9b640 1 -- 172.21.15.81:0/836647209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a5ce0 con 0x7ff43c0ca000 2024-05-08T20:35:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 -- 172.21.15.81:0/836647209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c0ca000 msgr2=0x7ff43c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c0ca000 0x7ff43c0ca490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff434009e50 tx=0x7ff43401c910 comp rx=0 tx=0).stop 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 -- 172.21.15.81:0/836647209 shutdown_connections 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c0ca000 0x7ff43c0ca490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 --2- 172.21.15.81:0/836647209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c151f00 0x7ff43c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 -- 172.21.15.81:0/836647209 >> 172.21.15.81:0/836647209 conn(0x7ff43c0715f0 msgr2=0x7ff43c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.432+0000 7ff4410df640 1 -- 172.21.15.81:0/836647209 shutdown_connections 2024-05-08T20:35:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- 172.21.15.81:0/836647209 wait complete. 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 Processor -- start 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- start start 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 0x7ff43c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 0x7ff43c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1517e0 con 0x7ff43c154cf0 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0ae8e0 con 0x7ff43c151f00 2024-05-08T20:35:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c14fa60 con 0x7ff43c0ca000 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53768/0 (socket says 172.21.15.81:53768) 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 -- 172.21.15.81:0/2977246356 learned_addr learned my addr 172.21.15.81:0/2977246356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43ad9d640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 0x7ff43c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43a59c640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 0x7ff43c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 -- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 msgr2=0x7ff43c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 0x7ff43c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 -- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 msgr2=0x7ff43c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 0x7ff43c14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 -- 172.21.15.81:0/2977246356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434009b30 con 0x7ff43c154cf0 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43ad9d640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 0x7ff43c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:35:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43a59c640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 0x7ff43c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff43b59e640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff4340af040 tx=0x7ff4340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b8670 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340b87d0 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c0c91b0 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b8b80 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c151500 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.436+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c0ca950 con 0x7ff43c154cf0 2024-05-08T20:35:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.440+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4340b8ce0 con 0x7ff43c154cf0 2024-05-08T20:35:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.440+0000 7ff4237fe640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 0x7ff428068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:35:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.440+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff43411f800 con 0x7ff43c154cf0 2024-05-08T20:35:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.440+0000 7ff43ad9d640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 0x7ff428068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:35:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.440+0000 7ff43ad9d640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 0x7ff428068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0af300 tx=0x7ff42c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:35:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.444+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff4340eca30 con 0x7ff43c154cf0 2024-05-08T20:35:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.700+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff43c074950 con 0x7ff43c154cf0 2024-05-08T20:35:55.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4237fe640 1 -- 172.21.15.81:0/2977246356 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff4340f0050 con 0x7ff43c154cf0 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 msgr2=0x7ff428068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 0x7ff428068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0af300 tx=0x7ff42c008040 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 msgr2=0x7ff43c1eced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff4340af040 tx=0x7ff4340196b0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 shutdown_connections 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff428066690 0x7ff428068b50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff43c154cf0 0x7ff43c1eced0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff43c151f00 0x7ff43c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 --2- 172.21.15.81:0/2977246356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff43c0ca000 0x7ff43c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 >> 172.21.15.81:0/2977246356 conn(0x7ff43c0715f0 msgr2=0x7ff43c0ab430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 shutdown_connections 2024-05-08T20:35:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:35:55.704+0000 7ff4410df640 1 -- 172.21.15.81:0/2977246356 wait complete. 2024-05-08T20:35:55.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:36:05.727 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:36:05.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:36:05.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.860+0000 7f9fdc5cf640 1 Processor -- start 2024-05-08T20:36:05.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.860+0000 7f9fdc5cf640 1 -- start start 2024-05-08T20:36:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fd406a6d0 0x7f9fd415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd4152ab0 con 0x7f9fd4155e90 2024-05-08T20:36:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd4152d90 con 0x7f9fd414fe70 2024-05-08T20:36:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd41528a0 con 0x7f9fd406a6d0 2024-05-08T20:36:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdab6c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fd406a6d0 0x7f9fd415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fd9b6a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9fd4155e90 0x7f9fd4069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46972/0 (socket says 172.21.15.81:46972) 2024-05-08T20:36:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fd9b6a640 1 -- 172.21.15.81:0/2350206093 learned_addr learned my addr 172.21.15.81:0/2350206093 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:36:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdab6c640 1 -- 172.21.15.81:0/2350206093 >> v1:172.21.15.117:6789/0 conn(0x7f9fd414fe70 legacy=0x7f9fd406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdab6c640 1 -- 172.21.15.81:0/2350206093 >> v1:172.21.15.81:6789/0 conn(0x7f9fd4155e90 legacy=0x7f9fd4069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdab6c640 1 -- 172.21.15.81:0/2350206093 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4153070 con 0x7f9fd406a6d0 2024-05-08T20:36:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdab6c640 1 --2- 172.21.15.81:0/2350206093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd415e230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf46fd4e9e419f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fd9369640 1 -- 172.21.15.81:0/2350206093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0a4b70 con 0x7f9fd406a6d0 2024-05-08T20:36:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fd9369640 1 -- 172.21.15.81:0/2350206093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0a4cd0 con 0x7f9fd406a6d0 2024-05-08T20:36:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fd9369640 1 -- 172.21.15.81:0/2350206093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0ac660 con 0x7f9fd406a6d0 2024-05-08T20:36:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/2350206093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 msgr2=0x7f9fd415e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.864+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/2350206093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd415e230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c3f0 comp rx=0 tx=0).stop 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/2350206093 shutdown_connections 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/2350206093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd415e230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/2350206093 >> 172.21.15.81:0/2350206093 conn(0x7f9fd40c71b0 msgr2=0x7f9fd40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/2350206093 shutdown_connections 2024-05-08T20:36:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/2350206093 wait complete. 2024-05-08T20:36:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 Processor -- start 2024-05-08T20:36:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- start start 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fd414fe70 0x7f9fd4140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd4155e90 0x7f9fd41411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41ec480 con 0x7f9fd406a6d0 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41565e0 con 0x7f9fd4155e90 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41eb890 con 0x7f9fd414fe70 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43230/0 (socket says 172.21.15.81:43230) 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 -- 172.21.15.81:0/1175791782 learned_addr learned my addr 172.21.15.81:0/1175791782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdab6c640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd4155e90 0x7f9fd41411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:05.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fd9b6a640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fd414fe70 0x7f9fd4140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 -- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fd414fe70 msgr2=0x7f9fd4140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fd414fe70 0x7f9fd4140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 -- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd4155e90 msgr2=0x7f9fd41411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd4155e90 0x7f9fd41411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 -- 172.21.15.81:0/1175791782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc009a70 con 0x7f9fd406a6d0 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fda36b640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c500 tx=0x7f9fd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0005220 con 0x7f9fd406a6d0 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0005380 con 0x7f9fd406a6d0 2024-05-08T20:36:05.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd41ebb50 con 0x7f9fd406a6d0 2024-05-08T20:36:05.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007270 con 0x7f9fd406a6d0 2024-05-08T20:36:05.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.868+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd41ec110 con 0x7f9fd406a6d0 2024-05-08T20:36:05.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd40675e0 con 0x7f9fd406a6d0 2024-05-08T20:36:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fd00073d0 con 0x7f9fd406a6d0 2024-05-08T20:36:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fcaffd640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 0x7f9fb8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9fd0083880 con 0x7f9fd406a6d0 2024-05-08T20:36:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fd9b6a640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 0x7f9fb8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:05.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.872+0000 7f9fd9b6a640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 0x7f9fb8068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4143ef0 tx=0x7f9fc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:05.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:05.880+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9fd0050860 con 0x7f9fd406a6d0 2024-05-08T20:36:06.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.148+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9fd4074950 con 0x7f9fd406a6d0 2024-05-08T20:36:06.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.148+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1175791782 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f9fd0053e80 con 0x7f9fd406a6d0 2024-05-08T20:36:06.151 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:36:06.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 msgr2=0x7f9fb8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 0x7f9fb8068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4143ef0 tx=0x7f9fc4009040 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 msgr2=0x7f9fd4150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c500 tx=0x7f9fd000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 shutdown_connections 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9fb8066690 0x7f9fb8068b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd4155e90 0x7f9fd41411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fd414fe70 0x7f9fd4140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 --2- 172.21.15.81:0/1175791782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd406a6d0 0x7f9fd4150e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 >> 172.21.15.81:0/1175791782 conn(0x7f9fd40c71b0 msgr2=0x7f9fd40ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 shutdown_connections 2024-05-08T20:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.152+0000 7f9fdc5cf640 1 -- 172.21.15.81:0/1175791782 wait complete. 2024-05-08T20:36:06.171 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:36:06.171 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:36:06.171 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:36:06.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:36:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 Processor -- start 2024-05-08T20:36:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 -- start start 2024-05-08T20:36:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f374006b230 0x7f37400c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400c3a50 con 0x7f37401519d0 2024-05-08T20:36:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400705e0 con 0x7f3740070c00 2024-05-08T20:36:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f37485f1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3740072940 con 0x7f374006b230 2024-05-08T20:36:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37401519d0 0x7f3740151e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46988/0 (socket says 172.21.15.81:46988) 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 -- 172.21.15.81:0/31833291 learned_addr learned my addr 172.21.15.81:0/31833291 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374638d640 1 --2- 172.21.15.81:0/31833291 >> v2:172.21.15.117:3300/0 conn(0x7f374006b230 0x7f37400c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711018518 0 0) 0x7f37400c3a50 con 0x7f37401519d0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c003530 con 0x7f37401519d0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193785529 0 0) 0x7f372c003530 con 0x7f37401519d0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 >> v2:172.21.15.117:3300/0 conn(0x7f374006b230 msgr2=0x7f37400c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 --2- 172.21.15.81:0/31833291 >> v2:172.21.15.117:3300/0 conn(0x7f374006b230 0x7f37400c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 >> v1:172.21.15.117:6789/0 conn(0x7f3740070c00 legacy=0x7f374014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400708c0 con 0x7f37401519d0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3738001a00 con 0x7f37401519d0 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 >> v1:172.21.15.81:6789/0 conn(0x7f37401519d0 legacy=0x7f3740151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f372c0039d0 0x7f372c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f372c0047d0 0x7f372c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f372c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740072940 con 0x7f372c0051e0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c00c130 con 0x7f372c0039d0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c00c2f0 con 0x7f372c0047d0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f372c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374638d640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f372c0039d0 0x7f372c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 -- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f372c0047d0 msgr2=0x7f372c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f372c0047d0 0x7f372c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 -- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f372c0039d0 msgr2=0x7f372c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f372c0039d0 0x7f372c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f3746b8e640 1 -- 172.21.15.81:0/31833291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c003530 con 0x7f372c0051e0 2024-05-08T20:36:06.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.304+0000 7f374638d640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f372c0039d0 0x7f372c003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:36:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f3746b8e640 1 -- 172.21.15.81:0/31833291 reap_dead start 2024-05-08T20:36:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f3746b8e640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f372c00b990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3738002240 tx=0x7f373801f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbad4bd8edebcc05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37380ac650 con 0x7f372c0051e0 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37380ac7b0 con 0x7f372c0051e0 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f374538b640 1 -- 172.21.15.81:0/31833291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37380acb60 con 0x7f372c0051e0 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 -- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 msgr2=0x7f372c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f372c00b990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3738002240 tx=0x7f373801f9a0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 -- 172.21.15.81:0/31833291 shutdown_connections 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 --2- 172.21.15.81:0/31833291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f372c00b990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 -- 172.21.15.81:0/31833291 >> 172.21.15.81:0/31833291 conn(0x7f37400c71b0 msgr2=0x7f37400c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 -- 172.21.15.81:0/31833291 shutdown_connections 2024-05-08T20:36:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.308+0000 7f37485f1640 1 -- 172.21.15.81:0/31833291 wait complete. 2024-05-08T20:36:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 Processor -- start 2024-05-08T20:36:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- start start 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f374014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f374014bc10 0x7f374014a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374014a550 0x7f3740148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400aab20 con 0x7f372c0051e0 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400ac2c0 con 0x7f374014a550 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37400aad70 con 0x7f374014bc10 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f374014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f374014d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43254/0 (socket says 172.21.15.81:43254) 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 -- 172.21.15.81:0/3369297309 learned_addr learned my addr 172.21.15.81:0/3369297309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3746b8e640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374014a550 0x7f3740148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3745b8c640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f374014bc10 0x7f374014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f374014bc10 msgr2=0x7f374014a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f374014bc10 0x7f374014a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374014a550 msgr2=0x7f3740148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f374014a550 0x7f3740148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400ab050 con 0x7f372c0051e0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f374638d640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f374014d3e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f373c009160 tx=0x7f373c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c004220 con 0x7f372c0051e0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c004380 con 0x7f372c0051e0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374014dbd0 con 0x7f372c0051e0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c015890 con 0x7f372c0051e0 2024-05-08T20:36:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374014e190 con 0x7f372c0051e0 2024-05-08T20:36:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 0x7f3740149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740069550 con 0x7f374014aa60 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3745b8c640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 0x7f3740149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3745b8c640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37400c36e0 con 0x7f374014aa60 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.312+0000 7f3745b8c640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 0x7f3740149300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f373000e420 tx=0x7f373000e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f373c0159f0 con 0x7f372c0051e0 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3724066690 0x7f3724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300052e0 con 0x7f374014aa60 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3746b8e640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3724066690 0x7f3724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f373c084900 con 0x7f372c0051e0 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f3730005440 con 0x7f374014aa60 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 msgr2=0x7f3740149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 0x7f3740149300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f373000e420 tx=0x7f373000e8e0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 msgr2=0x7f3740149300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3736ffd640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374014aa60 0x7f3740149300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.316+0000 7f3746b8e640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3724066690 0x7f3724068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c100 tx=0x7f37380ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 0x7f374014f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37400ab1e0 con 0x7f3740149840 2024-05-08T20:36:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3745b8c640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 0x7f374014f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3745b8c640 1 -- 172.21.15.81:0/3369297309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f37400675e0 con 0x7f3740149840 2024-05-08T20:36:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3745b8c640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 0x7f374014f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3730017000 tx=0x7f3730000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730003c90 con 0x7f3740149840 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f3730003df0 con 0x7f3740149840 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 msgr2=0x7f374014f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 0x7f374014f590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3730017000 tx=0x7f3730000bd0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 msgr2=0x7f374014f590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3736ffd640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3740149840 0x7f374014f590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:36:06.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.329 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.330 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:36:06.331 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.332 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.336 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.338 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.340 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:36:06.340 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3724066690 msgr2=0x7f3724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3724066690 0x7f3724068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c100 tx=0x7f37380ab000 comp rx=0 tx=0).stop 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 msgr2=0x7f374014d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 --2- 172.21.15.81:0/3369297309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f372c0051e0 0x7f374014d3e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f373c009160 tx=0x7f373c011a60 comp rx=0 tx=0).stop 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3746b8e640 1 -- 172.21.15.81:0/3369297309 reap_dead start 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f3746b8e640 1 -- 172.21.15.81:0/3369297309 reap_dead start 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 shutdown_connections 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 >> 172.21.15.81:0/3369297309 conn(0x7f37400c71b0 msgr2=0x7f37400c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 shutdown_connections 2024-05-08T20:36:06.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.324+0000 7f37485f1640 1 -- 172.21.15.81:0/3369297309 wait complete. 2024-05-08T20:36:06.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:36:06.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:36:06.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:36:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.452+0000 7f9264bcc640 1 Processor -- start 2024-05-08T20:36:06.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.452+0000 7f9264bcc640 1 -- start start 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9264bcc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f926006f320 0x7f9260153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9264bcc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92600c3190 0x7f92600c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9264bcc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600a9bc0 con 0x7f926014fdb0 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9264bcc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9260150190 con 0x7f926006f320 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9264bcc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600c4730 con 0x7f92600c3190 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f926006f320 0x7f9260153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f926006f320 0x7f9260153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43292/0 (socket says 172.21.15.81:43292) 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 -- 172.21.15.81:0/2771311127 learned_addr learned my addr 172.21.15.81:0/2771311127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 -- 172.21.15.81:0/2771311127 >> v2:172.21.15.117:3300/0 conn(0x7f92600c3190 msgr2=0x7f92600c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 --2- 172.21.15.81:0/2771311127 >> v2:172.21.15.117:3300/0 conn(0x7f92600c3190 0x7f92600c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 -- 172.21.15.81:0/2771311127 >> v1:172.21.15.117:6789/0 conn(0x7f926014fdb0 legacy=0x7f92600a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 -- 172.21.15.81:0/2771311127 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260152870 con 0x7f926006f320 2024-05-08T20:36:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f9257fff640 1 --2- 172.21.15.81:0/2771311127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f926006f320 0x7f9260153350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9260070f10 tx=0x7f924801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5358fe36c9c14 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f925dd9b640 1 -- 172.21.15.81:0/2771311127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480ad640 con 0x7f926006f320 2024-05-08T20:36:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f925dd9b640 1 -- 172.21.15.81:0/2771311127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92480ad7a0 con 0x7f926006f320 2024-05-08T20:36:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.456+0000 7f925dd9b640 1 -- 172.21.15.81:0/2771311127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480adb30 con 0x7f926006f320 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- 172.21.15.81:0/2771311127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f926006f320 msgr2=0x7f9260153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- 172.21.15.81:0/2771311127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f926006f320 0x7f9260153350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9260070f10 tx=0x7f924801c390 comp rx=0 tx=0).stop 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- 172.21.15.81:0/2771311127 shutdown_connections 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- 172.21.15.81:0/2771311127 >> v2:172.21.15.117:3300/0 conn(0x7f92600c3190 0x7f92600c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- 172.21.15.81:0/2771311127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f926006f320 0x7f9260153350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- 172.21.15.81:0/2771311127 >> 172.21.15.81:0/2771311127 conn(0x7f92600c4e30 msgr2=0x7f92600c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- 172.21.15.81:0/2771311127 shutdown_connections 2024-05-08T20:36:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- 172.21.15.81:0/2771311127 wait complete. 2024-05-08T20:36:06.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 Processor -- start 2024-05-08T20:36:06.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- start start 2024-05-08T20:36:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 0x7f9260143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926014fdb0 0x7f926014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260149a30 0x7f926014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926014e910 con 0x7f92600c3190 2024-05-08T20:36:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600ae410 con 0x7f9260149a30 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9264bcc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9260146b80 con 0x7f926014fdb0 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 0x7f9260143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 0x7f9260143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43302/0 (socket says 172.21.15.81:43302) 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 -- 172.21.15.81:0/3667595203 learned_addr learned my addr 172.21.15.81:0/3667595203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925ed9d640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260149a30 0x7f926014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f9257fff640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926014fdb0 0x7f926014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926014fdb0 msgr2=0x7f926014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926014fdb0 0x7f926014d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260149a30 msgr2=0x7f926014dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9260149a30 0x7f926014dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480094d0 con 0x7f92600c3190 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.460+0000 7f925e59c640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 0x7f9260143170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f925000b3e0 tx=0x7f925000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011830 con 0x7f92600c3190 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500119b0 con 0x7f92600c3190 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9260146e20 con 0x7f92600c3190 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250011d60 con 0x7f92600c3190 2024-05-08T20:36:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92601436b0 con 0x7f92600c3190 2024-05-08T20:36:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9264bcc640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 0x7f92601eea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260073f10 con 0x7f926014f3d0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9257fff640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 0x7f92601eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f925001a400 con 0x7f92600c3190 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9257fff640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92600c4420 con 0x7f926014f3d0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9240066690 0x7f9240068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9250084610 con 0x7f92600c3190 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f925ed9d640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9240066690 0x7f9240068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9257fff640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 0x7f92601eea30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92600c93d0 tx=0x7f924801abd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480b6810 con 0x7f926014f3d0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f925ed9d640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9240066690 0x7f9240068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9258009ea0 tx=0x7f9258009410 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f92480a6040 con 0x7f926014f3d0 2024-05-08T20:36:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 msgr2=0x7f92601eea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 0x7f92601eea30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92600c93d0 tx=0x7f924801abd0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 msgr2=0x7f92601eea30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.464+0000 7f9256ffd640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926014f3d0 0x7f92601eea30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9264bcc640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 0x7f92601eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926014d570 con 0x7f926006f2e0 2024-05-08T20:36:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9257fff640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 0x7f92601eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9257fff640 1 -- 172.21.15.81:0/3667595203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9260074950 con 0x7f926006f2e0 2024-05-08T20:36:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9257fff640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 0x7f92601eef70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f924801c3d0 tx=0x7f92480a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480c1e50 con 0x7f926006f2e0 2024-05-08T20:36:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f92480ca390 con 0x7f926006f2e0 2024-05-08T20:36:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 msgr2=0x7f92601eef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 0x7f92601eef70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f924801c3d0 tx=0x7f92480a7000 comp rx=0 tx=0).stop 2024-05-08T20:36:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 msgr2=0x7f92601eef70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.472+0000 7f9256ffd640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926006f2e0 0x7f92601eef70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.478 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:36:06.479 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.481 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.482 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.483 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:06.484 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.485 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.491 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:36:06.492 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:36:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9240066690 msgr2=0x7f9240068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9240066690 0x7f9240068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9258009ea0 tx=0x7f9258009410 comp rx=0 tx=0).stop 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 msgr2=0x7f9260143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 --2- 172.21.15.81:0/3667595203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600c3190 0x7f9260143170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f925000b3e0 tx=0x7f925000b8a0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f925ed9d640 1 -- 172.21.15.81:0/3667595203 reap_dead start 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f925ed9d640 1 -- 172.21.15.81:0/3667595203 reap_dead start 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 shutdown_connections 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 >> 172.21.15.81:0/3667595203 conn(0x7f92600c4e30 msgr2=0x7f92600aa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 shutdown_connections 2024-05-08T20:36:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.476+0000 7f9264bcc640 1 -- 172.21.15.81:0/3667595203 wait complete. 2024-05-08T20:36:06.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:36:06.495 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:36:06.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:36:06.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 Processor -- start 2024-05-08T20:36:06.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 -- start start 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a3414fe70 0x7f9a3406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 0x7f9a34069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a34152ab0 con 0x7f9a3406d7d0 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a341528a0 con 0x7f9a3414fe70 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a39830640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a34152d90 con 0x7f9a34155e90 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a3406d7d0 0x7f9a3406a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47000/0 (socket says 172.21.15.81:47000) 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a337fe640 1 -- 172.21.15.81:0/3074311085 learned_addr learned my addr 172.21.15.81:0/3074311085 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a32ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a3414fe70 0x7f9a3406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/3074311085 >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 0x7f9a34069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a327fc640 1 -- 172.21.15.81:0/3074311085 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561657513 0 0) 0x7f9a34152ab0 con 0x7f9a3406d7d0 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a327fc640 1 -- 172.21.15.81:0/3074311085 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a20003530 con 0x7f9a3406d7d0 2024-05-08T20:36:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a32ffd640 1 -- 172.21.15.81:0/3074311085 >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 msgr2=0x7f9a34069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:36:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/3074311085 >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 0x7f9a34069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a32ffd640 1 -- 172.21.15.81:0/3074311085 >> v1:172.21.15.81:6789/0 conn(0x7f9a3406d7d0 legacy=0x7f9a3406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a32ffd640 1 -- 172.21.15.81:0/3074311085 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34153070 con 0x7f9a3414fe70 2024-05-08T20:36:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.620+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/3074311085 >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 0x7f9a34069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:36:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/3074311085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3414fe70 0x7f9a3406d290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a3406fd50 tx=0x7f9a2401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6226c5a0b657eed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a327fc640 1 -- 172.21.15.81:0/3074311085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240ab600 con 0x7f9a3414fe70 2024-05-08T20:36:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a327fc640 1 -- 172.21.15.81:0/3074311085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240a7050 con 0x7f9a3414fe70 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a327fc640 1 -- 172.21.15.81:0/3074311085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240ab980 con 0x7f9a3414fe70 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 -- 172.21.15.81:0/3074311085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3414fe70 msgr2=0x7f9a3406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 --2- 172.21.15.81:0/3074311085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3414fe70 0x7f9a3406d290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a3406fd50 tx=0x7f9a2401c330 comp rx=0 tx=0).stop 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 -- 172.21.15.81:0/3074311085 shutdown_connections 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 --2- 172.21.15.81:0/3074311085 >> v2:172.21.15.117:3300/0 conn(0x7f9a34155e90 0x7f9a34069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 --2- 172.21.15.81:0/3074311085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3414fe70 0x7f9a3406d290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 -- 172.21.15.81:0/3074311085 >> 172.21.15.81:0/3074311085 conn(0x7f9a340c71b0 msgr2=0x7f9a340c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 -- 172.21.15.81:0/3074311085 shutdown_connections 2024-05-08T20:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.624+0000 7f9a39830640 1 -- 172.21.15.81:0/3074311085 wait complete. 2024-05-08T20:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 Processor -- start 2024-05-08T20:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- start start 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3406d7d0 0x7f9a3414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3414fe70 0x7f9a340c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341578c0 con 0x7f9a34155e90 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340c6ee0 con 0x7f9a3406d7d0 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340ad240 con 0x7f9a3414fe70 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43308/0 (socket says 172.21.15.81:43308) 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 -- 172.21.15.81:0/783942294 learned_addr learned my addr 172.21.15.81:0/783942294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:06.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3406d7d0 0x7f9a3414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3414fe70 0x7f9a340c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3414fe70 msgr2=0x7f9a340c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3414fe70 0x7f9a340c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3406d7d0 msgr2=0x7f9a3414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3406d7d0 0x7f9a3414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24009420 con 0x7f9a34155e90 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3406d7d0 0x7f9a3414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3414fe70 0x7f9a340c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a337fe640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cb70 tx=0x7f9a2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00ad40 con 0x7f9a34155e90 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c012400 con 0x7f9a34155e90 2024-05-08T20:36:06.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34157b10 con 0x7f9a34155e90 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00aea0 con 0x7f9a34155e90 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3414f2e0 con 0x7f9a34155e90 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 0x7f9a341eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34069550 con 0x7f9a3415bea0 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 0x7f9a341eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a2c007070 con 0x7f9a34155e90 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a32ffd640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a340c69f0 con 0x7f9a3415bea0 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 0x7f9a341eeae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a34072c70 tx=0x7f9a2401ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.628+0000 7f9a30ff9640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a14066690 0x7f9a14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a14066690 0x7f9a14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9a2c0844f0 con 0x7f9a34155e90 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24006e20 con 0x7f9a3415bea0 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a2bfff640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a14066690 0x7f9a14068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a340ac470 tx=0x7f9a1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9a240b5410 con 0x7f9a3415bea0 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 msgr2=0x7f9a341eeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 0x7f9a341eeae0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a34072c70 tx=0x7f9a2401ab70 comp rx=0 tx=0).stop 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 msgr2=0x7f9a341eeae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.632+0000 7f9a30ff9640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a3415bea0 0x7f9a341eeae0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.636+0000 7f9a39830640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 0x7f9a341ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.636+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3415a330 con 0x7f9a341571f0 2024-05-08T20:36:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.636+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 0x7f9a341ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a32ffd640 1 -- 172.21.15.81:0/783942294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a34150250 con 0x7f9a341571f0 2024-05-08T20:36:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a32ffd640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 0x7f9a341ef020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a24019f60 tx=0x7f9a240190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240bfdc0 con 0x7f9a341571f0 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f9a240c4070 con 0x7f9a341571f0 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 msgr2=0x7f9a341ef020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 0x7f9a341ef020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9a24019f60 tx=0x7f9a240190d0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 msgr2=0x7f9a341ef020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a30ff9640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a341571f0 0x7f9a341ef020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:06.644 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 76, 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.646 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:06.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:06.648 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.650 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:06.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.654 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:06.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:06.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:06.656 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:36:06.656 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:36:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a14066690 msgr2=0x7f9a14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9a14066690 0x7f9a14068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a340ac470 tx=0x7f9a1c008040 comp rx=0 tx=0).stop 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 msgr2=0x7f9a340c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cb70 tx=0x7f9a2c00a430 comp rx=0 tx=0).stop 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a337fe640 1 -- 172.21.15.81:0/783942294 reap_dead start 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 shutdown_connections 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 --2- 172.21.15.81:0/783942294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a34155e90 0x7f9a340c5290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 >> 172.21.15.81:0/783942294 conn(0x7f9a340c71b0 msgr2=0x7f9a34150d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 shutdown_connections 2024-05-08T20:36:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:06.640+0000 7f9a39830640 1 -- 172.21.15.81:0/783942294 wait complete. 2024-05-08T20:36:06.663 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:36:06.664 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:36:06.664 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-05-08T20:36:06.664 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:36:06.664 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:36:06.664 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:36:06.664 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:36:06.681 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:36:06.681 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-05-08T20:36:06.682 INFO:tasks.ceph.mon.c:Sent signal 19 2024-05-08T20:36:06.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:36:21.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:36:21.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:36:21.683 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-05-08T20:36:21.683 INFO:tasks.ceph.mon.c:Sent signal 18 2024-05-08T20:36:21.683 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:36:21.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:36:21.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 Processor -- start 2024-05-08T20:36:21.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 -- start start 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc0c23f0 con 0x7fcebc0c1f90 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc155060 con 0x7fcebc1535a0 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec4650640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc155340 con 0x7fcebc0c1bb0 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec1beb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcebc0c1f90 0x7fcebc152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43908/0 (socket says 172.21.15.81:43908) 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 learned_addr learned my addr 172.21.15.81:0/92806110 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcebc1535a0 legacy=0x7fcebc15c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:21.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.811+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.815+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:36:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.815+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.815+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:21.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:21.815+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.015+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcebc1535a0 legacy=0x7fcebc15c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.019+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:36:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.019+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:36:22.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.419+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcebc1535a0 legacy=0x7fcebc15c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.423+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:36:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.423+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:22.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:36:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.223+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcebc1535a0 legacy=0x7fcebc15c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.227+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:36:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.227+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:23.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:36:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 msgr2=0x7fcebc151740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcebc0c1bb0 0x7fcebc151740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcebc1535a0 legacy=0x7fcebc15c080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.81:6789/0 conn(0x7fcebc0c1f90 legacy=0x7fcebc152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc155340 con 0x7fcea00036e0 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea0008d30 con 0x7fcea00061b0 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 msgr2=0x7fcea0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.811+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.815+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.815+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.815+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:24.815+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:25.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.015+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 msgr2=0x7fcea0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:25.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.015+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:36:25.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.019+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:36:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.019+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:25.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.019+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:36:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.419+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 msgr2=0x7fcea0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:25.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.419+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:36:25.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:25.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.423+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:36:25.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.423+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:25.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:25.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:25.423+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:36:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.223+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 msgr2=0x7fcea0008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.223+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:36:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.227+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:36:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.227+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:36:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:36:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:26.227+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 msgr2=0x7fcea0008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea00061b0 0x7fcea0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 msgr2=0x7fcea0005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.81:3300/0 conn(0x7fcea00036e0 0x7fcea0005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 reap_dead start 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 0x7fcea0006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.811+0000 7fceb3fff640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcea0006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc155620 con 0x7fcea00074c0 2024-05-08T20:36:27.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc155340 con 0x7fcea0003b50 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fceb3fff640 1 -- 172.21.15.81:0/92806110 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea0008d30 con 0x7fcea0006ba0 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec23ec640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 msgr2=0x7fcea0006660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec23ec640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 0x7fcea0006660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec2bed640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcea00074c0 legacy=0x7fcea0007970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcea0006f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 msgr2=0x7fcea0006660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:27.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 0x7fcea0006660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 >> v1:172.21.15.117:6789/0 conn(0x7fcea00074c0 legacy=0x7fcea0007970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:27.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.815+0000 7fcec1beb640 1 -- 172.21.15.81:0/92806110 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc155060 con 0x7fcea0006ba0 2024-05-08T20:36:27.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.819+0000 7fcec1beb640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcea0006f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fceac001130 tx=0x7fceac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60222553432751a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec13ea640 1 -- 172.21.15.81:0/92806110 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac004ab0 con 0x7fcea0006ba0 2024-05-08T20:36:27.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec13ea640 1 -- 172.21.15.81:0/92806110 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac004c10 con 0x7fcea0006ba0 2024-05-08T20:36:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec13ea640 1 -- 172.21.15.81:0/92806110 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac007070 con 0x7fcea0006ba0 2024-05-08T20:36:27.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 msgr2=0x7fcea0006f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcea0006f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fceac001130 tx=0x7fceac01c4a0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- 172.21.15.81:0/92806110 shutdown_connections 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 --2- 172.21.15.81:0/92806110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcea0006f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 --2- 172.21.15.81:0/92806110 >> v2:172.21.15.117:3300/0 conn(0x7fcea0003b50 0x7fcea0006660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- 172.21.15.81:0/92806110 >> 172.21.15.81:0/92806110 conn(0x7fcebc0c2ca0 msgr2=0x7fcebc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- 172.21.15.81:0/92806110 shutdown_connections 2024-05-08T20:36:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- 172.21.15.81:0/92806110 wait complete. 2024-05-08T20:36:27.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 Processor -- start 2024-05-08T20:36:27.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.823+0000 7fcec4650640 1 -- start start 2024-05-08T20:36:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 0x7fcebc0bd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcebc0bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0aa700 con 0x7fcea00074c0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc09fb60 con 0x7fcea0003b50 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0be1c0 con 0x7fcea0006ba0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec23ec640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 msgr2=0x7fcebc0bd740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec23ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 0x7fcebc0bd740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52944/0 (socket says 172.21.15.81:52944) 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 -- 172.21.15.81:0/3919906080 learned_addr learned my addr 172.21.15.81:0/3919906080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec1beb640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcebc0bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 -- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 msgr2=0x7fcebc0bdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcebc0bdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 -- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 msgr2=0x7fcebc0bd740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 0x7fcebc0bd740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 -- 172.21.15.81:0/3919906080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0c23f0 con 0x7fcea00074c0 2024-05-08T20:36:27.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec2bed640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea0006120 tx=0x7fceb400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb400cad0 con 0x7fcea00074c0 2024-05-08T20:36:27.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb400a040 con 0x7fcea00074c0 2024-05-08T20:36:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc0aa420 con 0x7fcea00074c0 2024-05-08T20:36:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40060d0 con 0x7fcea00074c0 2024-05-08T20:36:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc1ee580 con 0x7fcea00074c0 2024-05-08T20:36:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.827+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc1ee100 con 0x7fcea00074c0 2024-05-08T20:36:27.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.831+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fceb4012020 con 0x7fcea00074c0 2024-05-08T20:36:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.831+0000 7fceb2ffd640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 0x7fcea006d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.831+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fceb40841a0 con 0x7fcea00074c0 2024-05-08T20:36:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.831+0000 7fcec23ec640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 0x7fcea006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:27.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.831+0000 7fcec23ec640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 0x7fcea006d610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcebc151e30 tx=0x7fceb800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:27.839+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fceb4051350 con 0x7fcea00074c0 2024-05-08T20:36:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.127+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcebc1ee100 con 0x7fcea00074c0 2024-05-08T20:36:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.127+0000 7fceb2ffd640 1 -- 172.21.15.81:0/3919906080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fcebc1ee100 con 0x7fcea00074c0 2024-05-08T20:36:28.131 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":78,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 msgr2=0x7fcea006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 0x7fcea006d610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcebc151e30 tx=0x7fceb800b040 comp rx=0 tx=0).stop 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 msgr2=0x7fcebc0a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea0006120 tx=0x7fceb400bcc0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 shutdown_connections 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcea006b150 0x7fcea006d610 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea00074c0 0x7fcebc0a91c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcea0006ba0 0x7fcebc0bdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 --2- 172.21.15.81:0/3919906080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcea0003b50 0x7fcebc0bd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 >> 172.21.15.81:0/3919906080 conn(0x7fcebc0c2ca0 msgr2=0x7fcebc0c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 shutdown_connections 2024-05-08T20:36:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.131+0000 7fcec4650640 1 -- 172.21.15.81:0/3919906080 wait complete. 2024-05-08T20:36:28.154 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:36:28.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:36:28.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:36:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 Processor -- start 2024-05-08T20:36:28.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 -- start start 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 0x7fa0580c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580c0650 con 0x7fa05806f400 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05806fd60 con 0x7fa0580725f0 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05f128640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa058072180 con 0x7fa0581501e0 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa04ffff640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 msgr2=0x7fa0580c1c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05d6c5640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fa05806f400 legacy=0x7fa0580c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa04ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 0x7fa0580c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:45816/0 (socket says 172.21.15.81:45816) 2024-05-08T20:36:28.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 -- 172.21.15.81:0/3533310996 learned_addr learned my addr 172.21.15.81:0/3533310996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 -- 172.21.15.81:0/3533310996 >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 msgr2=0x7fa0580c1c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 --2- 172.21.15.81:0/3533310996 >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 0x7fa0580c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 -- 172.21.15.81:0/3533310996 >> v1:172.21.15.117:6789/0 conn(0x7fa05806f400 legacy=0x7fa0580c2180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.283+0000 7fa05cec4640 1 -- 172.21.15.81:0/3533310996 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05806fa80 con 0x7fa0581501e0 2024-05-08T20:36:28.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05cec4640 1 --2- 172.21.15.81:0/3533310996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa05401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa0d23b9e11e6b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa04f7fe640 1 -- 172.21.15.81:0/3533310996 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540ac630 con 0x7fa0581501e0 2024-05-08T20:36:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa04f7fe640 1 -- 172.21.15.81:0/3533310996 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540ac790 con 0x7fa0581501e0 2024-05-08T20:36:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa04f7fe640 1 -- 172.21.15.81:0/3533310996 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540acb20 con 0x7fa0581501e0 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- 172.21.15.81:0/3533310996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 msgr2=0x7fa05806c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 --2- 172.21.15.81:0/3533310996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa05401c3f0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- 172.21.15.81:0/3533310996 shutdown_connections 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 --2- 172.21.15.81:0/3533310996 >> v2:172.21.15.117:3300/0 conn(0x7fa0580725f0 0x7fa0580c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 --2- 172.21.15.81:0/3533310996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa05806c930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- 172.21.15.81:0/3533310996 >> 172.21.15.81:0/3533310996 conn(0x7fa0580c2ca0 msgr2=0x7fa0580c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- 172.21.15.81:0/3533310996 shutdown_connections 2024-05-08T20:36:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- 172.21.15.81:0/3533310996 wait complete. 2024-05-08T20:36:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 Processor -- start 2024-05-08T20:36:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.287+0000 7fa05f128640 1 -- start start 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa05806f400 0x7fa05814c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 0x7fa058142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa0581f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05814b550 con 0x7fa0580725f0 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581f15d0 con 0x7fa05806f400 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05814aed0 con 0x7fa0581501e0 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05cec4640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa05806f400 msgr2=0x7fa05814c350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05cec4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa05806f400 0x7fa05814c350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 0x7fa058142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 0x7fa058142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52950/0 (socket says 172.21.15.81:52950) 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 -- 172.21.15.81:0/1357445625 learned_addr learned my addr 172.21.15.81:0/1357445625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05d6c5640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa0581f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 msgr2=0x7fa0581f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0581501e0 0x7fa0581f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa05806f400 msgr2=0x7fa05814c350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa05806f400 0x7fa05814c350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540094d0 con 0x7fa0580725f0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04ffff640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 0x7fa058142710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa04800b530 tx=0x7fa04800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048003dd0 con 0x7fa0580725f0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048005070 con 0x7fa0580725f0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048005420 con 0x7fa0580725f0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa058150740 con 0x7fa0580725f0 2024-05-08T20:36:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0581ed110 con 0x7fa0580725f0 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 0x7fa05814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580696e0 con 0x7fa0581ed300 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05cec4640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 0x7fa05814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05cec4640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa058070a20 con 0x7fa0581ed300 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa05cec4640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 0x7fa05814a910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa058066da0 tx=0x7fa05401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.291+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa048005580 con 0x7fa0580725f0 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa044066640 0x7fa044068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa048084360 con 0x7fa0580725f0 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa05d6c5640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa044066640 0x7fa044068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540ac630 con 0x7fa0581ed300 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa0540ac900 con 0x7fa0581ed300 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 msgr2=0x7fa05814a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 0x7fa05814a910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa058066da0 tx=0x7fa05401ac30 comp rx=0 tx=0).stop 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 msgr2=0x7fa05814a910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa04d7fa640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed300 0x7fa05814a910 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa058066da0 tx=0x7fa05401ac30 comp rx=0 tx=0).stop 2024-05-08T20:36:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.295+0000 7fa05d6c5640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa044066640 0x7fa044068b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa050003bf0 tx=0x7fa0500050d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 0x7fa0581edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581505c0 con 0x7fa0581ed8f0 2024-05-08T20:36:28.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05cec4640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 0x7fa0581edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05cec4640 1 -- 172.21.15.81:0/1357445625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa05815fb20 con 0x7fa0581ed8f0 2024-05-08T20:36:28.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05cec4640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 0x7fa0581edcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa05401cc90 tx=0x7fa054019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054004230 con 0x7fa0581ed8f0 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4796 (secure 0 0 0) 0x7fa054004390 con 0x7fa0581ed8f0 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 msgr2=0x7fa0581edcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 0x7fa0581edcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa05401cc90 tx=0x7fa054019190 comp rx=0 tx=0).stop 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 msgr2=0x7fa0581edcd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa04d7fa640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0581ed8f0 0x7fa0581edcd0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa05401cc90 tx=0x7fa054019190 comp rx=0 tx=0).stop 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 78, 2024-05-08T20:36:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:36:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:36:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:36:28.319 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa044066640 msgr2=0x7fa044068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa044066640 0x7fa044068b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa050003bf0 tx=0x7fa0500050d0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 msgr2=0x7fa058142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 --2- 172.21.15.81:0/1357445625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0580725f0 0x7fa058142710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa04800b530 tx=0x7fa04800b9f0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05d6c5640 1 -- 172.21.15.81:0/1357445625 reap_dead start 2024-05-08T20:36:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05d6c5640 1 -- 172.21.15.81:0/1357445625 reap_dead start 2024-05-08T20:36:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 shutdown_connections 2024-05-08T20:36:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 >> 172.21.15.81:0/1357445625 conn(0x7fa0580c2ca0 msgr2=0x7fa05814e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 shutdown_connections 2024-05-08T20:36:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.303+0000 7fa05f128640 1 -- 172.21.15.81:0/1357445625 wait complete. 2024-05-08T20:36:28.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:36:28.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:36:28.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:36:28.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 Processor -- start 2024-05-08T20:36:28.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 -- start start 2024-05-08T20:36:28.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 0x7f75b00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75b00c2bc0 0x7f75b00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b0155e10 con 0x7f75b00a94b0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b006e790 con 0x7f75b00c2bc0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75b5c9a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b006f460 con 0x7f75b00c30d0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.459+0000 7f75affff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f75b00a94b0 legacy=0x7f75b00a98c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75b00c2bc0 0x7f75b00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75af7fe640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 msgr2=0x7f75b00c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75af7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 0x7f75b00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75b00c2bc0 0x7f75b00c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52978/0 (socket says 172.21.15.81:52978) 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 -- 172.21.15.81:0/1922838941 learned_addr learned my addr 172.21.15.81:0/1922838941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 -- 172.21.15.81:0/1922838941 >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 msgr2=0x7f75b00c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 --2- 172.21.15.81:0/1922838941 >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 0x7f75b00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 -- 172.21.15.81:0/1922838941 >> v1:172.21.15.117:6789/0 conn(0x7f75b00a94b0 legacy=0x7f75b00a98c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:36:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 -- 172.21.15.81:0/1922838941 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0156080 con 0x7f75b00c2bc0 2024-05-08T20:36:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75aeffd640 1 --2- 172.21.15.81:0/1922838941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00c2bc0 0x7f75b00c4120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c59e0 tx=0x7f75a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ec2ecf3e3a1cfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75ae7fc640 1 -- 172.21.15.81:0/1922838941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40ab640 con 0x7f75b00c2bc0 2024-05-08T20:36:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75ae7fc640 1 -- 172.21.15.81:0/1922838941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a40a7070 con 0x7f75b00c2bc0 2024-05-08T20:36:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75ae7fc640 1 -- 172.21.15.81:0/1922838941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40ab9c0 con 0x7f75b00c2bc0 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 -- 172.21.15.81:0/1922838941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00c2bc0 msgr2=0x7f75b00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/1922838941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00c2bc0 0x7f75b00c4120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c59e0 tx=0x7f75a401c440 comp rx=0 tx=0).stop 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 -- 172.21.15.81:0/1922838941 shutdown_connections 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/1922838941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00c2bc0 0x7f75b00c4120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/1922838941 >> v2:172.21.15.117:3300/0 conn(0x7f75b00c30d0 0x7f75b00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 -- 172.21.15.81:0/1922838941 >> 172.21.15.81:0/1922838941 conn(0x7f75b00c4cc0 msgr2=0x7f75b00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 -- 172.21.15.81:0/1922838941 shutdown_connections 2024-05-08T20:36:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.463+0000 7f75b5c9a640 1 -- 172.21.15.81:0/1922838941 wait complete. 2024-05-08T20:36:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 Processor -- start 2024-05-08T20:36:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- start start 2024-05-08T20:36:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 0x7f75b00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b00c2bc0 0x7f75b015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b00c30d0 0x7f75b013d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01f1730 con 0x7f75b00a94b0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00c7f80 con 0x7f75b00c2bc0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01f0af0 con 0x7f75b00c30d0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75aeffd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b00c2bc0 msgr2=0x7f75b015b740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 0x7f75b00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75aeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b00c2bc0 0x7f75b015b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 0x7f75b00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52988/0 (socket says 172.21.15.81:52988) 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 -- 172.21.15.81:0/594091740 learned_addr learned my addr 172.21.15.81:0/594091740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75affff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b00c30d0 0x7f75b013d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b00c30d0 msgr2=0x7f75b013d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b00c30d0 0x7f75b013d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b00c2bc0 msgr2=0x7f75b015b740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75b00c2bc0 0x7f75b015b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40094d0 con 0x7f75b00a94b0 2024-05-08T20:36:28.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75af7fe640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 0x7f75b00c5ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b530 tx=0x7f75a000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0003dd0 con 0x7f75b00a94b0 2024-05-08T20:36:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0005070 con 0x7f75b00a94b0 2024-05-08T20:36:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0005420 con 0x7f75b00a94b0 2024-05-08T20:36:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b01f0d90 con 0x7f75b00a94b0 2024-05-08T20:36:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.467+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b01f1350 con 0x7f75b00a94b0 2024-05-08T20:36:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 0x7f75b006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0073ea0 con 0x7f75b013de00 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75aeffd640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 0x7f75b006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75a0005580 con 0x7f75b00a94b0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75aeffd640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75b00c4970 con 0x7f75b013de00 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f759c066640 0x7f759c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f75a00842b0 con 0x7f75b00a94b0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75aeffd640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 0x7f75b006b8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c3d60 tx=0x7f75a401ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75affff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f759c066640 0x7f759c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40ab640 con 0x7f75b013de00 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f75affff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f759c066640 0x7f759c068b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75b006fbe0 tx=0x7f75a8009450 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f75a40b8070 con 0x7f75b013de00 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 msgr2=0x7f75b006b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 0x7f75b006b8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c3d60 tx=0x7f75a401ac80 comp rx=0 tx=0).stop 2024-05-08T20:36:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 msgr2=0x7f75b006b8f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.471+0000 7f7597fff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b013de00 0x7f75b006b8f0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75b00c3d60 tx=0x7f75a401ac80 comp rx=0 tx=0).stop 2024-05-08T20:36:28.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 0x7f75b006c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:36:28.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01f1870 con 0x7f75b006be30 2024-05-08T20:36:28.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f75aeffd640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 0x7f75b006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:36:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f75aeffd640 1 -- 172.21.15.81:0/594091740 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f75b0074950 con 0x7f75b006be30 2024-05-08T20:36:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f75aeffd640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 0x7f75b006c240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75a401a070 tx=0x7f75a40191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:36:28.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4006820 con 0x7f75b006be30 2024-05-08T20:36:28.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7f75a4000e90 con 0x7f75b006be30 2024-05-08T20:36:28.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 msgr2=0x7f75b006c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 0x7f75b006c240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75a401a070 tx=0x7f75a40191e0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 msgr2=0x7f75b006c240 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:36:28.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.479+0000 7f7597fff640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b006be30 0x7f75b006c240 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f75a401a070 tx=0x7f75a40191e0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.487 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:36:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:36:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 78, 2024-05-08T20:36:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:36:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:36:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:36:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:36:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:36:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:36:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:36:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:36:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:36:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:36:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:36:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:36:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:36:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:36:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:36:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:36:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:36:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:36:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:36:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:36:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:36:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:36:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:36:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:36:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:36:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:36:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:36:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:36:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:36:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:36:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:36:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:36:28.517 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:36:28.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f759c066640 msgr2=0x7f759c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f759c066640 0x7f759c068b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75b006fbe0 tx=0x7f75a8009450 comp rx=0 tx=0).stop 2024-05-08T20:36:28.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 msgr2=0x7f75b00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:36:28.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 --2- 172.21.15.81:0/594091740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b00a94b0 0x7f75b00c5ed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b530 tx=0x7f75a000b9f0 comp rx=0 tx=0).stop 2024-05-08T20:36:28.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75affff640 1 -- 172.21.15.81:0/594091740 reap_dead start 2024-05-08T20:36:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75affff640 1 -- 172.21.15.81:0/594091740 reap_dead start 2024-05-08T20:36:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 shutdown_connections 2024-05-08T20:36:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 >> 172.21.15.81:0/594091740 conn(0x7f75b00c4cc0 msgr2=0x7f75b006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:36:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 shutdown_connections 2024-05-08T20:36:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:36:28.483+0000 7f75b5c9a640 1 -- 172.21.15.81:0/594091740 wait complete. 2024-05-08T20:36:28.520 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:36:28.520 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:36:48.521 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:36:48.521 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:36:48.521 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:36:48.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:36:48.527 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:36:48.527 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-05-08T20:36:48.527 INFO:tasks.ceph.mon.c:Sent signal 19 2024-05-08T20:36:48.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:36:51.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:36:51.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:37:03.528 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-05-08T20:37:03.529 INFO:tasks.ceph.mon.c:Sent signal 18 2024-05-08T20:37:03.529 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:37:03.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 Processor -- start 2024-05-08T20:37:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 -- start start 2024-05-08T20:37:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc0c1730 con 0x7f21fc06d130 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21fc0c1a10 con 0x7f21fc155670 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2203cd7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc154980 con 0x7f21fc0c47c0 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201a73640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21fc06d130 0x7f21fc0bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44778/0 (socket says 172.21.15.81:44778) 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201a73640 1 -- 172.21.15.81:0/508830828 learned_addr learned my addr 172.21.15.81:0/508830828 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.659+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:03.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:03.863+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:37:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:04.267+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:37:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:05.071+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:37:06.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 msgr2=0x7f21fc0c4c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21fc0c47c0 0x7f21fc0c4c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 msgr2=0x7f21fc0a5e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.117:3300/0 conn(0x7f21fc155670 0x7f21fc0a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 -- 172.21.15.81:0/508830828 >> v1:172.21.15.81:6789/0 conn(0x7f21fc06d130 legacy=0x7f21fc0bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 -- 172.21.15.81:0/508830828 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc154b90 con 0x7f21e0003720 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f21f37fe640 1 -- 172.21.15.81:0/508830828 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21fc0c1a10 con 0x7f21e0007390 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.663+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:06.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.867+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:06.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.867+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:37:06.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.867+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:06.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.867+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:06.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:06.867+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:07.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.271+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.271+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:37:07.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.271+0000 7f2201272640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:07.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.271+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:07.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.271+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132354795 0 0) 0x7f21fc154b90 con 0x7f21e0003720 2024-05-08T20:37:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e8003530 con 0x7f21e0003720 2024-05-08T20:37:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126121879 0 0) 0x7f21e8003530 con 0x7f21e0003720 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 msgr2=0x7f21e0009850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 --2- 172.21.15.81:0/508830828 >> v2:172.21.15.81:3300/0 conn(0x7f21e0007390 0x7f21e0009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e000af10 con 0x7f21e0003720 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f21f8001700 con 0x7f21e0003720 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 >> v1:172.21.15.117:6789/0 conn(0x7f21e0003720 legacy=0x7f21e0005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2202274640 1 -- 172.21.15.81:0/508830828 reap_dead start 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 0x7f21e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80047d0 0x7f21e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e80052b0 0x7f21e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0c1a10 con 0x7f21e8003980 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e800c200 con 0x7f21e80052b0 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e800c3c0 con 0x7f21e80047d0 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2201a73640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 0x7f21e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2201272640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80047d0 0x7f21e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.823+0000 7f2202274640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e80052b0 0x7f21e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.827+0000 7f2201a73640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80047d0 msgr2=0x7f21e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.827+0000 7f2201a73640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80047d0 0x7f21e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.827+0000 7f2201a73640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e80052b0 msgr2=0x7f21e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.827+0000 7f2201a73640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e80052b0 0x7f21e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.827+0000 7f2201a73640 1 -- 172.21.15.81:0/508830828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8003530 con 0x7f21e8003980 2024-05-08T20:37:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2201a73640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 0x7f21e8003d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c210 tx=0x7f21f801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f29f02f98086fe8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8005ae0 con 0x7f21e8003980 2024-05-08T20:37:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8005c40 con 0x7f21e8003980 2024-05-08T20:37:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2200a71640 1 -- 172.21.15.81:0/508830828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007070 con 0x7f21e8003980 2024-05-08T20:37:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 -- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 msgr2=0x7f21e8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 0x7f21e8003d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c210 tx=0x7f21f801cc40 comp rx=0 tx=0).stop 2024-05-08T20:37:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 -- 172.21.15.81:0/508830828 shutdown_connections 2024-05-08T20:37:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e80052b0 0x7f21e800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80047d0 0x7f21e8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 --2- 172.21.15.81:0/508830828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e8003980 0x7f21e8003d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 -- 172.21.15.81:0/508830828 >> 172.21.15.81:0/508830828 conn(0x7f21fc0c68c0 msgr2=0x7f21fc0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 -- 172.21.15.81:0/508830828 shutdown_connections 2024-05-08T20:37:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.831+0000 7f2203cd7640 1 -- 172.21.15.81:0/508830828 wait complete. 2024-05-08T20:37:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 Processor -- start 2024-05-08T20:37:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- start start 2024-05-08T20:37:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8003980 0x7f21fc0a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80052b0 0x7f21fc1ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0704f0 con 0x7f21e80047d0 2024-05-08T20:37:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0aa760 con 0x7f21e8003980 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc0a7f50 con 0x7f21e80052b0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57878/0 (socket says 172.21.15.81:57878) 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 -- 172.21.15.81:0/2528989091 learned_addr learned my addr 172.21.15.81:0/2528989091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201a73640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8003980 0x7f21fc0a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2202274640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80052b0 0x7f21fc1ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 -- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80052b0 msgr2=0x7f21fc1ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80052b0 0x7f21fc1ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 -- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8003980 msgr2=0x7f21fc0a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8003980 0x7f21fc0a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 -- 172.21.15.81:0/2528989091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc1eaca0 con 0x7f21e80047d0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2201272640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0187e0 tx=0x7f21ec018ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec016d20 con 0x7f21e80047d0 2024-05-08T20:37:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec01e040 con 0x7f21e80047d0 2024-05-08T20:37:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0225f0 con 0x7f21e80047d0 2024-05-08T20:37:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc0aa940 con 0x7f21e80047d0 2024-05-08T20:37:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.835+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc0aaf00 con 0x7f21e80047d0 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc0a8100 con 0x7f21e80047d0 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21ec022750 con 0x7f21e80047d0 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f21f27fc640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 0x7f21e00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f21ec084eb0 con 0x7f21e80047d0 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f2201a73640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 0x7f21e00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.839+0000 7f2201a73640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 0x7f21e00693b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ab000 tx=0x7f21f80b1040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:07.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:07.843+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f21fc0a8100 con 0x7f21e80047d0 2024-05-08T20:37:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f21fc0a80c0 con 0x7f21e80047d0 2024-05-08T20:37:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f21f27fc640 1 -- 172.21.15.81:0/2528989091 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f21ec027080 con 0x7f21e80047d0 2024-05-08T20:37:08.062 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":80,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 msgr2=0x7f21e00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 0x7f21e00693b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ab000 tx=0x7f21f80b1040 comp rx=0 tx=0).stop 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 msgr2=0x7f21fc1ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0187e0 tx=0x7f21ec018ca0 comp rx=0 tx=0).stop 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 shutdown_connections 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f21e0066ef0 0x7f21e00693b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21e80052b0 0x7f21fc1ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e80047d0 0x7f21fc1ea220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 --2- 172.21.15.81:0/2528989091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8003980 0x7f21fc0a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 >> 172.21.15.81:0/2528989091 conn(0x7f21fc0c68c0 msgr2=0x7f21fc06c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 shutdown_connections 2024-05-08T20:37:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:08.059+0000 7f2203cd7640 1 -- 172.21.15.81:0/2528989091 wait complete. 2024-05-08T20:37:11.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.207+0000 7fce26df3640 1 Processor -- start 2024-05-08T20:37:11.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.207+0000 7fce26df3640 1 -- start start 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 0x7fce2006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce2006f400 0x7fce200c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200c0650 con 0x7fce200725f0 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2006fd60 con 0x7fce2006f400 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce20072180 con 0x7fce201501e0 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce2006f400 0x7fce200c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce200725f0 0x7fce200c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38100/0 (socket says 172.21.15.81:38100) 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1ffff640 1 -- 172.21.15.81:0/3943334681 learned_addr learned my addr 172.21.15.81:0/3943334681 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce24b8f640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 0x7fce2006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 -- 172.21.15.81:0/3943334681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 msgr2=0x7fce2006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 0x7fce2006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 -- 172.21.15.81:0/3943334681 >> v1:172.21.15.81:6789/0 conn(0x7fce200725f0 legacy=0x7fce200c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 -- 172.21.15.81:0/3943334681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2006fa80 con 0x7fce2006f400 2024-05-08T20:37:11.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1f7fe640 1 -- 172.21.15.81:0/3943334681 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34128578 0 0) 0x7fce200c0650 con 0x7fce200725f0 2024-05-08T20:37:11.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce24b8f640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 0x7fce2006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:37:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce25390640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce2006f400 0x7fce200c2350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b650d828133384 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1f7fe640 1 -- 172.21.15.81:0/3943334681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180a5900 con 0x7fce2006f400 2024-05-08T20:37:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1f7fe640 1 -- 172.21.15.81:0/3943334681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce180a5a60 con 0x7fce2006f400 2024-05-08T20:37:11.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce1f7fe640 1 -- 172.21.15.81:0/3943334681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180a5df0 con 0x7fce2006f400 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- 172.21.15.81:0/3943334681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce2006f400 msgr2=0x7fce200c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce2006f400 0x7fce200c2350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fce18009d90 tx=0x7fce1801c820 comp rx=0 tx=0).stop 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- 172.21.15.81:0/3943334681 shutdown_connections 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce2006f400 0x7fce200c2350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 --2- 172.21.15.81:0/3943334681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce201501e0 0x7fce2006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- 172.21.15.81:0/3943334681 >> 172.21.15.81:0/3943334681 conn(0x7fce200c2ca0 msgr2=0x7fce200c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- 172.21.15.81:0/3943334681 shutdown_connections 2024-05-08T20:37:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.211+0000 7fce26df3640 1 -- 172.21.15.81:0/3943334681 wait complete. 2024-05-08T20:37:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 Processor -- start 2024-05-08T20:37:11.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- start start 2024-05-08T20:37:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce2006f400 0x7fce200a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce201501e0 0x7fce20142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200a93c0 con 0x7fce200725f0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200c6030 con 0x7fce201501e0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce201417d0 con 0x7fce2006f400 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46966/0 (socket says 172.21.15.81:46966) 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 -- 172.21.15.81:0/4135687752 learned_addr learned my addr 172.21.15.81:0/4135687752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce25390640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce201501e0 0x7fce20142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce24b8f640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce2006f400 0x7fce200a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 -- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce2006f400 msgr2=0x7fce200a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce2006f400 0x7fce200a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 -- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce201501e0 msgr2=0x7fce20142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce201501e0 0x7fce20142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 -- 172.21.15.81:0/4135687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009a70 con 0x7fce200725f0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1ffff640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c4b0 tx=0x7fce1400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140074e0 con 0x7fce200725f0 2024-05-08T20:37:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce14007660 con 0x7fce200725f0 2024-05-08T20:37:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14004a30 con 0x7fce200725f0 2024-05-08T20:37:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce20150740 con 0x7fce200725f0 2024-05-08T20:37:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce200c5870 con 0x7fce200725f0 2024-05-08T20:37:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.215+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20074950 con 0x7fce200725f0 2024-05-08T20:37:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.219+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce14004b90 con 0x7fce200725f0 2024-05-08T20:37:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.219+0000 7fce1d7fa640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 0x7fce0c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.219+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fce14083700 con 0x7fce200725f0 2024-05-08T20:37:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.219+0000 7fce24b8f640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 0x7fce0c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.219+0000 7fce24b8f640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 0x7fce0c068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce1000a9a0 tx=0x7fce10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.223+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fce14050630 con 0x7fce200725f0 2024-05-08T20:37:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.443+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fce200ab5d0 con 0x7fce200725f0 2024-05-08T20:37:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce1d7fa640 1 -- 172.21.15.81:0/4135687752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fce14018620 con 0x7fce200725f0 2024-05-08T20:37:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 msgr2=0x7fce0c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 0x7fce0c068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce1000a9a0 tx=0x7fce10008040 comp rx=0 tx=0).stop 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 msgr2=0x7fce200a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c4b0 tx=0x7fce1400c970 comp rx=0 tx=0).stop 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 shutdown_connections 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce0c0666c0 0x7fce0c068b80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce201501e0 0x7fce20142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce200725f0 0x7fce200a9f60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 --2- 172.21.15.81:0/4135687752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce2006f400 0x7fce200a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 >> 172.21.15.81:0/4135687752 conn(0x7fce200c2ca0 msgr2=0x7fce2006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 shutdown_connections 2024-05-08T20:37:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.447+0000 7fce26df3640 1 -- 172.21.15.81:0/4135687752 wait complete. 2024-05-08T20:37:11.469 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:37:11.469 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:37:11.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:37:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 Processor -- start 2024-05-08T20:37:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 -- start start 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5644070c00 0x7f56440c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56441519d0 0x7f5644151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440c3a50 con 0x7f564406b230 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5644072940 con 0x7f5644070c00 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f564b7d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440705e0 con 0x7f56441519d0 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5648d71640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5644070c00 0x7f56440c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5649572640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f564406b230 0x7f564414e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38104/0 (socket says 172.21.15.81:38104) 2024-05-08T20:37:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5649572640 1 -- 172.21.15.81:0/2910866853 learned_addr learned my addr 172.21.15.81:0/2910866853 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5649d73640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56441519d0 0x7f5644151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5648d71640 1 -- 172.21.15.81:0/2910866853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56441519d0 msgr2=0x7f5644151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5648d71640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56441519d0 0x7f5644151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5648d71640 1 -- 172.21.15.81:0/2910866853 >> v1:172.21.15.81:6789/0 conn(0x7f564406b230 legacy=0x7f564414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f5648d71640 1 -- 172.21.15.81:0/2910866853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440708c0 con 0x7f5644070c00 2024-05-08T20:37:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.587+0000 7f563bfff640 1 -- 172.21.15.81:0/2910866853 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006156574 0 0) 0x7f56440c3a50 con 0x7f564406b230 2024-05-08T20:37:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f5648d71640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5644070c00 0x7f56440c2800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56340097c0 tx=0x7f563401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2895bc7f5abe26a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f563bfff640 1 -- 172.21.15.81:0/2910866853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340ab610 con 0x7f5644070c00 2024-05-08T20:37:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f563bfff640 1 -- 172.21.15.81:0/2910866853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340ab770 con 0x7f5644070c00 2024-05-08T20:37:11.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f563bfff640 1 -- 172.21.15.81:0/2910866853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340abb00 con 0x7f5644070c00 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- 172.21.15.81:0/2910866853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5644070c00 msgr2=0x7f56440c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5644070c00 0x7f56440c2800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56340097c0 tx=0x7f563401c410 comp rx=0 tx=0).stop 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- 172.21.15.81:0/2910866853 shutdown_connections 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56441519d0 0x7f5644151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2910866853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5644070c00 0x7f56440c2800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- 172.21.15.81:0/2910866853 >> 172.21.15.81:0/2910866853 conn(0x7f56440c71b0 msgr2=0x7f56440c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- 172.21.15.81:0/2910866853 shutdown_connections 2024-05-08T20:37:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- 172.21.15.81:0/2910866853 wait complete. 2024-05-08T20:37:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 Processor -- start 2024-05-08T20:37:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- start start 2024-05-08T20:37:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f564406b230 0x7f5644144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5644070c00 0x7f56441ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 0x7f56441ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56441465f0 con 0x7f56441519d0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644141f70 con 0x7f5644070c00 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.591+0000 7f564b7d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56441ec230 con 0x7f564406b230 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 0x7f56441ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 0x7f56441ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46972/0 (socket says 172.21.15.81:46972) 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 learned_addr learned my addr 172.21.15.81:0/2659062085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649572640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f564406b230 0x7f5644144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5648d71640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5644070c00 0x7f56441ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f564406b230 msgr2=0x7f5644144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f564406b230 0x7f5644144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5644070c00 msgr2=0x7f56441ec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5644070c00 0x7f56441ec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009420 con 0x7f56441519d0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649d73640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 0x7f56441ecee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f563c007ea0 tx=0x7f563c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c014620 con 0x7f56441519d0 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c0147a0 con 0x7f56441519d0 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56440c6ef0 con 0x7f56441519d0 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c014b50 con 0x7f56441519d0 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56441ef050 con 0x7f56441519d0 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 0x7f56440c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644069550 con 0x7f56441ed420 2024-05-08T20:37:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649572640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 0x7f56440c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649572640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f564414f1d0 con 0x7f56441ed420 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5649572640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 0x7f56440c4da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56400077f0 tx=0x7f5640001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f563c014cb0 con 0x7f56441519d0 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5628066690 0x7f5628068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f563c084e90 con 0x7f56441519d0 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5648d71640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5628066690 0x7f5628068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640010510 con 0x7f56441ed420 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5640010670 con 0x7f56441ed420 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 msgr2=0x7f56440c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 0x7f56440c4da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f56400077f0 tx=0x7f5640001820 comp rx=0 tx=0).stop 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 msgr2=0x7f56440c4da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5639ffb640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441ed420 0x7f56440c4da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.595+0000 7f5648d71640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5628066690 0x7f5628068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f56340af000 tx=0x7f56340a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 0x7f56440c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440675e0 con 0x7f56440c6530 2024-05-08T20:37:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5649572640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 0x7f56440c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5649572640 1 -- 172.21.15.81:0/2659062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5644074950 con 0x7f56440c6530 2024-05-08T20:37:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5649572640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 0x7f56440c52e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5640001ec0 tx=0x7f5640001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640022070 con 0x7f56440c6530 2024-05-08T20:37:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7f5640026410 con 0x7f56440c6530 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 msgr2=0x7f56440c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 0x7f56440c52e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5640001ec0 tx=0x7f5640001090 comp rx=0 tx=0).stop 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 msgr2=0x7f56440c52e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5639ffb640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56440c6530 0x7f56440c52e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:11.621 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5628066690 msgr2=0x7f5628068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5628066690 0x7f5628068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f56340af000 tx=0x7f56340a7000 comp rx=0 tx=0).stop 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 msgr2=0x7f56441ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 --2- 172.21.15.81:0/2659062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441519d0 0x7f56441ecee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f563c007ea0 tx=0x7f563c007f90 comp rx=0 tx=0).stop 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 reap_dead start 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f5649d73640 1 -- 172.21.15.81:0/2659062085 reap_dead start 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 shutdown_connections 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 >> 172.21.15.81:0/2659062085 conn(0x7f56440c71b0 msgr2=0x7f56440c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 shutdown_connections 2024-05-08T20:37:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.603+0000 7f564b7d6640 1 -- 172.21.15.81:0/2659062085 wait complete. 2024-05-08T20:37:11.624 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:11.624 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:37:11.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:37:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.731+0000 7fa62b862640 1 Processor -- start 2024-05-08T20:37:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa62b862640 1 -- start start 2024-05-08T20:37:11.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa62b862640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6240afb00 0x7fa6240c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa62b862640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240c4de0 con 0x7fa624155340 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa62b862640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240c50c0 con 0x7fa62406b890 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa62b862640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62406a080 con 0x7fa6240afb00 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa629dff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa624155340 0x7fa62406abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38110/0 (socket says 172.21.15.81:38110) 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa629dff640 1 -- 172.21.15.81:0/2406020024 learned_addr learned my addr 172.21.15.81:0/2406020024 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2406020024 >> v2:172.21.15.81:3300/0 conn(0x7fa6240afb00 0x7fa6240c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa61bfff640 1 -- 172.21.15.81:0/2406020024 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412978864 0 0) 0x7fa6240c4de0 con 0x7fa624155340 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa61bfff640 1 -- 172.21.15.81:0/2406020024 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa610003530 con 0x7fa624155340 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa6295fe640 1 -- 172.21.15.81:0/2406020024 >> v1:172.21.15.117:6789/0 conn(0x7fa62406b890 legacy=0x7fa62406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa6295fe640 1 -- 172.21.15.81:0/2406020024 >> v1:172.21.15.81:6789/0 conn(0x7fa624155340 legacy=0x7fa62406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.735+0000 7fa6295fe640 1 -- 172.21.15.81:0/2406020024 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240c53a0 con 0x7fa6240afb00 2024-05-08T20:37:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2406020024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6240c6cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6200097c0 tx=0x7fa62001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7757a182575702 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa61bfff640 1 -- 172.21.15.81:0/2406020024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200a4ea0 con 0x7fa6240afb00 2024-05-08T20:37:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa61bfff640 1 -- 172.21.15.81:0/2406020024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6200a7050 con 0x7fa6240afb00 2024-05-08T20:37:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa61bfff640 1 -- 172.21.15.81:0/2406020024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200ab820 con 0x7fa6240afb00 2024-05-08T20:37:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- 172.21.15.81:0/2406020024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 msgr2=0x7fa6240c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 --2- 172.21.15.81:0/2406020024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6240c6cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6200097c0 tx=0x7fa62001c380 comp rx=0 tx=0).stop 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- 172.21.15.81:0/2406020024 shutdown_connections 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 --2- 172.21.15.81:0/2406020024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6240c6cd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- 172.21.15.81:0/2406020024 >> 172.21.15.81:0/2406020024 conn(0x7fa6240abfb0 msgr2=0x7fa6240ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- 172.21.15.81:0/2406020024 shutdown_connections 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- 172.21.15.81:0/2406020024 wait complete. 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 Processor -- start 2024-05-08T20:37:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- start start 2024-05-08T20:37:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62406b890 0x7fa62414a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6241ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa624155340 0x7fa6241eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62414d350 con 0x7fa6240afb00 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62414b210 con 0x7fa62406b890 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa62b862640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa624158ab0 con 0x7fa624155340 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6241ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6241ed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47008/0 (socket says 172.21.15.81:47008) 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 -- 172.21.15.81:0/2379716286 learned_addr learned my addr 172.21.15.81:0/2379716286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62406b890 0x7fa62414a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa629dff640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa624155340 0x7fa6241eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa624155340 msgr2=0x7fa6241eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa624155340 0x7fa6241eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62406b890 msgr2=0x7fa62414a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62406b890 0x7fa62414a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009420 con 0x7fa6240afb00 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62406b890 0x7fa62414a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.739+0000 7fa628dfd640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6241ed880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c3c0 tx=0x7fa61400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140052d0 con 0x7fa6240afb00 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614005430 con 0x7fa6240afb00 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614003840 con 0x7fa6240afb00 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6241ed3f0 con 0x7fa6240afb00 2024-05-08T20:37:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6241587d0 con 0x7fa6240afb00 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa62b862640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 0x7fa62414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624069600 con 0x7fa62414d970 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 0x7fa62414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6140039a0 con 0x7fa6240afb00 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa6295fe640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6241ed580 con 0x7fa62414d970 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa608066690 0x7fa608068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa614083a10 con 0x7fa6240afb00 2024-05-08T20:37:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 0x7fa62414dfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6240acd00 tx=0x7fa62001abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa629dff640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa608066690 0x7fa608068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200b5610 con 0x7fa62414d970 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa629dff640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa608066690 0x7fa608068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa6241ed290 tx=0x7fa61c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa6200a4ea0 con 0x7fa62414d970 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 msgr2=0x7fa62414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 0x7fa62414dfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6240acd00 tx=0x7fa62001abc0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 msgr2=0x7fa62414dfb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.743+0000 7fa619ffb640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa62414d970 0x7fa62414dfb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa62b862640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 0x7fa62414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624158960 con 0x7fa624157880 2024-05-08T20:37:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 0x7fa62414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa6295fe640 1 -- 172.21.15.81:0/2379716286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa62414ea30 con 0x7fa624157880 2024-05-08T20:37:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa6295fe640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 0x7fa62414e4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa620019fb0 tx=0x7fa620019120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200c0cf0 con 0x7fa624157880 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7fa6200c4070 con 0x7fa624157880 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 msgr2=0x7fa62414e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 0x7fa62414e4f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa620019fb0 tx=0x7fa620019120 comp rx=0 tx=0).stop 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 msgr2=0x7fa62414e4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.751+0000 7fa619ffb640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624157880 0x7fa62414e4f0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa620019fb0 tx=0x7fa620019120 comp rx=0 tx=0).stop 2024-05-08T20:37:11.757 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:11.758 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.759 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:11.761 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:11.762 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.763 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:11.764 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:11.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:11.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.772 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:11.772 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa608066690 msgr2=0x7fa608068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa608066690 0x7fa608068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa6241ed290 tx=0x7fa61c009040 comp rx=0 tx=0).stop 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 msgr2=0x7fa6241ed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 --2- 172.21.15.81:0/2379716286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6240afb00 0x7fa6241ed880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c3c0 tx=0x7fa61400c880 comp rx=0 tx=0).stop 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa629dff640 1 -- 172.21.15.81:0/2379716286 reap_dead start 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa629dff640 1 -- 172.21.15.81:0/2379716286 reap_dead start 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 shutdown_connections 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 >> 172.21.15.81:0/2379716286 conn(0x7fa6240abfb0 msgr2=0x7fa6240ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 shutdown_connections 2024-05-08T20:37:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.755+0000 7fa62b862640 1 -- 172.21.15.81:0/2379716286 wait complete. 2024-05-08T20:37:11.774 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:11.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:37:11.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:37:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 Processor -- start 2024-05-08T20:37:11.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 -- start start 2024-05-08T20:37:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a1c1501e0 0x7f2a1c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a1c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c0c0650 con 0x7f2a1c0725f0 2024-05-08T20:37:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1c06fd60 con 0x7f2a1c1501e0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a21018640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c072180 con 0x7f2a1c06f400 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1a59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a1c0725f0 0x7f2a1c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38114/0 (socket says 172.21.15.81:38114) 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1a59c640 1 -- 172.21.15.81:0/1373837610 learned_addr learned my addr 172.21.15.81:0/1373837610 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a1c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1ad9d640 1 --2- 172.21.15.81:0/1373837610 >> v2:172.21.15.117:3300/0 conn(0x7f2a1c1501e0 0x7f2a1c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128584088 0 0) 0x7f2a1c0c0650 con 0x7f2a1c0725f0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a04003530 con 0x7f2a1c0725f0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469497118 0 0) 0x7f2a04003530 con 0x7f2a1c0725f0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 msgr2=0x7f2a1c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a1c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 >> v2:172.21.15.117:3300/0 conn(0x7f2a1c1501e0 msgr2=0x7f2a1c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 --2- 172.21.15.81:0/1373837610 >> v2:172.21.15.117:3300/0 conn(0x7f2a1c1501e0 0x7f2a1c06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c06fa80 con 0x7f2a1c0725f0 2024-05-08T20:37:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2a10001680 con 0x7f2a1c0725f0 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 >> v1:172.21.15.81:6789/0 conn(0x7f2a1c0725f0 legacy=0x7f2a1c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a04003980 0x7f2a04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c06fd60 con 0x7f2a04004d10 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c072180 con 0x7f2a04003980 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0400ba40 con 0x7f2a1c06f400 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1ad9d640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a04003980 0x7f2a04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 -- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 msgr2=0x7f2a040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c06f400 0x7f2a040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 -- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a04003980 msgr2=0x7f2a04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a04003980 0x7f2a04003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.891+0000 7f2a1b59e640 1 -- 172.21.15.81:0/1373837610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04003530 con 0x7f2a04004d10 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a04005190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009fc0 tx=0x7f2a1401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312bb8b4162835c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140a5b70 con 0x7f2a04004d10 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400f040 con 0x7f2a04004d10 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a19d9b640 1 -- 172.21.15.81:0/1373837610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140ad440 con 0x7f2a04004d10 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- 172.21.15.81:0/1373837610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 msgr2=0x7f2a04005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 --2- 172.21.15.81:0/1373837610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a04005190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009fc0 tx=0x7f2a1401cc50 comp rx=0 tx=0).stop 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a1b59e640 1 -- 172.21.15.81:0/1373837610 reap_dead start 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- 172.21.15.81:0/1373837610 shutdown_connections 2024-05-08T20:37:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- 172.21.15.81:0/1373837610 >> 172.21.15.81:0/1373837610 conn(0x7f2a1c0c2ca0 msgr2=0x7f2a1c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- 172.21.15.81:0/1373837610 shutdown_connections 2024-05-08T20:37:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- 172.21.15.81:0/1373837610 wait complete. 2024-05-08T20:37:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 Processor -- start 2024-05-08T20:37:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- start start 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a1c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c13e4f0 0x7f2a1c1ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a1c0a8070 0x7f2a1c0a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0a8a30 con 0x7f2a04004d10 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c14ee90 con 0x7f2a1c0a8070 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.895+0000 7f2a21018640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c147c30 con 0x7f2a1c13e4f0 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a1c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a1c13ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47026/0 (socket says 172.21.15.81:47026) 2024-05-08T20:37:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 -- 172.21.15.81:0/3084846870 learned_addr learned my addr 172.21.15.81:0/3084846870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a1c0a8070 0x7f2a1c0a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c13e4f0 0x7f2a1c1ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c13e4f0 msgr2=0x7f2a1c1ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c13e4f0 0x7f2a1c1ee5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a1c0a8070 msgr2=0x7f2a1c0a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a1c0a8070 0x7f2a1c0a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c1eef30 con 0x7f2a04004d10 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c13e4f0 0x7f2a1c1ee5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1ad9d640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a1c13ea40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0115e0 tx=0x7f2a0c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00f8f0 con 0x7f2a04004d10 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00fa50 con 0x7f2a04004d10 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c147ed0 con 0x7f2a04004d10 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00fdc0 con 0x7f2a04004d10 2024-05-08T20:37:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c1ef210 con 0x7f2a04004d10 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a21018640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 0x7f2a1c146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0696e0 con 0x7f2a1c146980 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 0x7f2a1c146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a0c015460 con 0x7f2a04004d10 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1a59c640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a1c15db10 con 0x7f2a1c146980 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a080666c0 0x7f2a08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2a0c084d30 con 0x7f2a04004d10 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 0x7f2a1c146da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a10000c10 tx=0x7f2a1000fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a080666c0 0x7f2a08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000d8c0 con 0x7f2a1c146980 2024-05-08T20:37:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a1b59e640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a080666c0 0x7f2a08068b80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a140af000 tx=0x7f2a14004ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2a1000fe60 con 0x7f2a1c146980 2024-05-08T20:37:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 msgr2=0x7f2a1c146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 0x7f2a1c146da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a10000c10 tx=0x7f2a1000fc10 comp rx=0 tx=0).stop 2024-05-08T20:37:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 msgr2=0x7f2a1c146da0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.899+0000 7f2a037fe640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c146980 0x7f2a1c146da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a21018640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 0x7f2a1c1eae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c148060 con 0x7f2a1c1472e0 2024-05-08T20:37:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 0x7f2a1c1eae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:11.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a1a59c640 1 -- 172.21.15.81:0/3084846870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2a1c074950 con 0x7f2a1c1472e0 2024-05-08T20:37:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a1a59c640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 0x7f2a1c1eae10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a10018000 tx=0x7f2a10001a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.907+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10014aa0 con 0x7f2a1c1472e0 2024-05-08T20:37:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f2a10014c00 con 0x7f2a1c1472e0 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 msgr2=0x7f2a1c1eae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a037fe640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 0x7f2a1c1eae10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a10018000 tx=0x7f2a10001a80 comp rx=0 tx=0).stop 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a037fe640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 msgr2=0x7f2a1c1eae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a037fe640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a1c1472e0 0x7f2a1c1eae10 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a10018000 tx=0x7f2a10001a80 comp rx=0 tx=0).stop 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:37:11.914 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:11.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:11.919 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:11.920 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:11.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:11.927 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:11.927 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a080666c0 msgr2=0x7f2a08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a080666c0 0x7f2a08068b80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a140af000 tx=0x7f2a14004ac0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 msgr2=0x7f2a1c13ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 --2- 172.21.15.81:0/3084846870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a04004d10 0x7f2a1c13ea40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0115e0 tx=0x7f2a0c011aa0 comp rx=0 tx=0).stop 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a1b59e640 1 -- 172.21.15.81:0/3084846870 reap_dead start 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a1b59e640 1 -- 172.21.15.81:0/3084846870 reap_dead start 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 shutdown_connections 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 >> 172.21.15.81:0/3084846870 conn(0x7f2a1c0c2ca0 msgr2=0x7f2a1c14d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 shutdown_connections 2024-05-08T20:37:11.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:11.911+0000 7f2a21018640 1 -- 172.21.15.81:0/3084846870 wait complete. 2024-05-08T20:37:11.929 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:11.929 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:37:11.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:37:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 Processor -- start 2024-05-08T20:37:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 -- start start 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ba8151f00 0x7f6ba81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ba8154cf0 0x7f6ba8155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba8158e20 con 0x7f6ba8155690 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba806bb20 con 0x7f6ba8151f00 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6baede2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba81548e0 con 0x7f6ba8154cf0 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ba8151f00 0x7f6ba81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ba8151f00 0x7f6ba81588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47032/0 (socket says 172.21.15.81:47032) 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3591359170 learned_addr learned my addr 172.21.15.81:0/3591359170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6ba7fff640 1 --2- 172.21.15.81:0/3591359170 >> v2:172.21.15.117:3300/0 conn(0x7f6ba8154cf0 0x7f6ba8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3591359170 >> v2:172.21.15.117:3300/0 conn(0x7f6ba8154cf0 msgr2=0x7f6ba8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 --2- 172.21.15.81:0/3591359170 >> v2:172.21.15.117:3300/0 conn(0x7f6ba8154cf0 0x7f6ba8155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3591359170 >> v1:172.21.15.117:6789/0 conn(0x7f6ba8155690 legacy=0x7f6ba80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.039+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3591359170 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba81522e0 con 0x7f6ba8151f00 2024-05-08T20:37:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6bacb7e640 1 --2- 172.21.15.81:0/3591359170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba81588e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ba808c580 tx=0x7f6b9c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976f655b471385d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6ba77fe640 1 -- 172.21.15.81:0/3591359170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0ac640 con 0x7f6ba8151f00 2024-05-08T20:37:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6ba77fe640 1 -- 172.21.15.81:0/3591359170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0ac7a0 con 0x7f6ba8151f00 2024-05-08T20:37:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6ba77fe640 1 -- 172.21.15.81:0/3591359170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0acb30 con 0x7f6ba8151f00 2024-05-08T20:37:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 -- 172.21.15.81:0/3591359170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 msgr2=0x7f6ba81588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 --2- 172.21.15.81:0/3591359170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba81588e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ba808c580 tx=0x7f6b9c01c3c0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 -- 172.21.15.81:0/3591359170 shutdown_connections 2024-05-08T20:37:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 --2- 172.21.15.81:0/3591359170 >> v2:172.21.15.117:3300/0 conn(0x7f6ba8154cf0 0x7f6ba8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 --2- 172.21.15.81:0/3591359170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba81588e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 -- 172.21.15.81:0/3591359170 >> 172.21.15.81:0/3591359170 conn(0x7f6ba80715f0 msgr2=0x7f6ba8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 -- 172.21.15.81:0/3591359170 shutdown_connections 2024-05-08T20:37:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.043+0000 7f6baede2640 1 -- 172.21.15.81:0/3591359170 wait complete. 2024-05-08T20:37:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 Processor -- start 2024-05-08T20:37:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- start start 2024-05-08T20:37:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ba8154cf0 0x7f6ba80c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ba814ea60 0x7f6ba8144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8150020 con 0x7f6ba8151f00 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8150a90 con 0x7f6ba814ea60 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814f410 con 0x7f6ba8154cf0 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47038/0 (socket says 172.21.15.81:47038) 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3200237101 learned_addr learned my addr 172.21.15.81:0/3200237101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bad37f640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ba814ea60 0x7f6ba8144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6ba7fff640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ba8154cf0 0x7f6ba80c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ba8154cf0 msgr2=0x7f6ba80c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ba8154cf0 0x7f6ba80c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ba814ea60 msgr2=0x7f6ba8144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ba814ea60 0x7f6ba8144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 -- 172.21.15.81:0/3200237101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0094d0 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6bacb7e640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c019ff0 tx=0x7f6b9c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0b7830 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0b7990 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba814f6f0 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0b7d00 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba814fcb0 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80675e0 con 0x7f6ba8151f00 2024-05-08T20:37:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.047+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b9c0b3040 con 0x7f6ba8151f00 2024-05-08T20:37:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.051+0000 7f6ba57fa640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 0x7f6b8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.051+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6b9c11eb50 con 0x7f6ba8151f00 2024-05-08T20:37:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.051+0000 7f6ba7fff640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 0x7f6b8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.051+0000 7f6ba7fff640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 0x7f6b8c068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8158120 tx=0x7f6b94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.055+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6b9c0ebcd0 con 0x7f6ba8151f00 2024-05-08T20:37:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.271+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f6ba8074950 con 0x7f6ba8151f00 2024-05-08T20:37:12.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.271+0000 7f6ba57fa640 1 -- 172.21.15.81:0/3200237101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f6b9c0b7e60 con 0x7f6ba8151f00 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 msgr2=0x7f6b8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 0x7f6b8c068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8158120 tx=0x7f6b94008040 comp rx=0 tx=0).stop 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 msgr2=0x7f6ba8150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c019ff0 tx=0x7f6b9c01ac00 comp rx=0 tx=0).stop 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 shutdown_connections 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6b8c066690 0x7f6b8c068b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ba814ea60 0x7f6ba8144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ba8154cf0 0x7f6ba80c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 --2- 172.21.15.81:0/3200237101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8151f00 0x7f6ba8150550 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 >> 172.21.15.81:0/3200237101 conn(0x7f6ba80715f0 msgr2=0x7f6ba80abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 shutdown_connections 2024-05-08T20:37:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:12.275+0000 7f6baede2640 1 -- 172.21.15.81:0/3200237101 wait complete. 2024-05-08T20:37:12.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:37:21.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:37:21.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:37:22.296 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:37:22.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 Processor -- start 2024-05-08T20:37:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 -- start start 2024-05-08T20:37:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f3406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f340c2570 0x7f1f34154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 0x7f1f341554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3406ab70 con 0x7f1f340c2570 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f34154b10 con 0x7f1f3406d7d0 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f3b805640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34158080 con 0x7f1f34152340 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f340c2570 0x7f1f34154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f340c2570 0x7f1f34154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47180/0 (socket says 172.21.15.81:47180) 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 -- 172.21.15.81:0/1684056231 learned_addr learned my addr 172.21.15.81:0/1684056231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f39da2640 1 --2- 172.21.15.81:0/1684056231 >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 0x7f1f341554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f395a1640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f3406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 -- 172.21.15.81:0/1684056231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 msgr2=0x7f1f3406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f3406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 -- 172.21.15.81:0/1684056231 >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 msgr2=0x7f1f341554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1684056231 >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 0x7f1f341554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f38da0640 1 -- 172.21.15.81:0/1684056231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3406a890 con 0x7f1f340c2570 2024-05-08T20:37:22.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.435+0000 7f1f39da2640 1 --2- 172.21.15.81:0/1684056231 >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 0x7f1f341554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:22.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f340c2570 0x7f1f34154f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f340701a0 tx=0x7f1f3001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f79c6d4e9f2da82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f2bfff640 1 -- 172.21.15.81:0/1684056231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300ab620 con 0x7f1f340c2570 2024-05-08T20:37:22.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f2bfff640 1 -- 172.21.15.81:0/1684056231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f300ab780 con 0x7f1f340c2570 2024-05-08T20:37:22.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f2bfff640 1 -- 172.21.15.81:0/1684056231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300abb10 con 0x7f1f340c2570 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 -- 172.21.15.81:0/1684056231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f340c2570 msgr2=0x7f1f34154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f340c2570 0x7f1f34154f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f340701a0 tx=0x7f1f3001c460 comp rx=0 tx=0).stop 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 -- 172.21.15.81:0/1684056231 shutdown_connections 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1684056231 >> v2:172.21.15.117:3300/0 conn(0x7f1f3406d7d0 0x7f1f341554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f340c2570 0x7f1f34154f60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1684056231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f3406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 -- 172.21.15.81:0/1684056231 >> 172.21.15.81:0/1684056231 conn(0x7f1f340c71b0 msgr2=0x7f1f340c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 -- 172.21.15.81:0/1684056231 shutdown_connections 2024-05-08T20:37:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.439+0000 7f1f3b805640 1 -- 172.21.15.81:0/1684056231 wait complete. 2024-05-08T20:37:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 Processor -- start 2024-05-08T20:37:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- start start 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f340c2570 0x7f1f340c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f34070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34155fd0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f341562b0 con 0x7f1f340c2570 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34156590 con 0x7f1f34152340 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47186/0 (socket says 172.21.15.81:47186) 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 -- 172.21.15.81:0/1042982073 learned_addr learned my addr 172.21.15.81:0/1042982073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f340c2570 0x7f1f340c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f39da2640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f34070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 -- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 msgr2=0x7f1f34070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f34070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 -- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f340c2570 msgr2=0x7f1f340c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f340c2570 0x7f1f340c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 -- 172.21.15.81:0/1042982073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300094d0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f395a1640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400d800 tx=0x7f1f2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400b6c0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400b820 con 0x7f1f3406d7d0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400bb90 con 0x7f1f3406d7d0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f34156870 con 0x7f1f3406d7d0 2024-05-08T20:37:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f34157070 con 0x7f1f3406d7d0 2024-05-08T20:37:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f340675e0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.443+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f2400bcf0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.447+0000 7f1f29ffb640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 0x7f1f18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.447+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1f24084b40 con 0x7f1f3406d7d0 2024-05-08T20:37:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.447+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 0x7f1f18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.447+0000 7f1f38da0640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 0x7f1f18068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f300af000 tx=0x7f1f300a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.451+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1f24051a90 con 0x7f1f3406d7d0 2024-05-08T20:37:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f34074950 con 0x7f1f3406d7d0 2024-05-08T20:37:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f29ffb640 1 -- 172.21.15.81:0/1042982073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1f240550b0 con 0x7f1f3406d7d0 2024-05-08T20:37:22.758 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 msgr2=0x7f1f18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 0x7f1f18068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f300af000 tx=0x7f1f300a7000 comp rx=0 tx=0).stop 2024-05-08T20:37:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 msgr2=0x7f1f341ed2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.755+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400d800 tx=0x7f1f2400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 shutdown_connections 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1f18066690 0x7f1f18068b50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1f34152340 0x7f1f34070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f340c2570 0x7f1f340c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 --2- 172.21.15.81:0/1042982073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f3406d7d0 0x7f1f341ed2d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 >> 172.21.15.81:0/1042982073 conn(0x7f1f340c71b0 msgr2=0x7f1f34154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 shutdown_connections 2024-05-08T20:37:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.759+0000 7f1f3b805640 1 -- 172.21.15.81:0/1042982073 wait complete. 2024-05-08T20:37:22.781 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:37:22.781 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:37:22.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:37:22.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:37:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 Processor -- start 2024-05-08T20:37:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 -- start start 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9408152ab0 con 0x7f940814fe70 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94081528a0 con 0x7f9408155e90 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f940ca84640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9408152d90 con 0x7f940806a500 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9405d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9405d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51050/0 (socket says 172.21.15.81:51050) 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:56326/0 (socket says 172.21.15.81:56326) 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9405d9b640 1 -- 172.21.15.81:0/2450401714 learned_addr learned my addr 172.21.15.81:0/2450401714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 -- 172.21.15.81:0/2450401714 >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 msgr2=0x7f9408069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2450401714 >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 -- 172.21.15.81:0/2450401714 >> v1:172.21.15.117:6789/0 conn(0x7f940814fe70 legacy=0x7f940806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9406d9d640 1 -- 172.21.15.81:0/2450401714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408153070 con 0x7f940806a500 2024-05-08T20:37:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.919+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2450401714 >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:37:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2450401714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9400009d90 tx=0x7f940001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16923f115c8c885d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940559a640 1 -- 172.21.15.81:0/2450401714 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000a58e0 con 0x7f940806a500 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940559a640 1 -- 172.21.15.81:0/2450401714 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000a5a40 con 0x7f940806a500 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940559a640 1 -- 172.21.15.81:0/2450401714 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000a5dd0 con 0x7f940806a500 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 -- 172.21.15.81:0/2450401714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 msgr2=0x7f940815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 --2- 172.21.15.81:0/2450401714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9400009d90 tx=0x7f940001c820 comp rx=0 tx=0).stop 2024-05-08T20:37:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 -- 172.21.15.81:0/2450401714 shutdown_connections 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 --2- 172.21.15.81:0/2450401714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f940806a500 0x7f940815d220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 --2- 172.21.15.81:0/2450401714 >> v2:172.21.15.117:3300/0 conn(0x7f9408155e90 0x7f9408069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 -- 172.21.15.81:0/2450401714 >> 172.21.15.81:0/2450401714 conn(0x7f94080c71b0 msgr2=0x7f94080c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 -- 172.21.15.81:0/2450401714 shutdown_connections 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.923+0000 7f940ca84640 1 -- 172.21.15.81:0/2450401714 wait complete. 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 Processor -- start 2024-05-08T20:37:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- start start 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 0x7f94081ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940814fe70 0x7f940814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9408155e90 0x7f940814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408155cd0 con 0x7f940806a500 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940814e160 con 0x7f940814fe70 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080c6f20 con 0x7f9408155e90 2024-05-08T20:37:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 0x7f94081ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 0x7f94081ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47198/0 (socket says 172.21.15.81:47198) 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 -- 172.21.15.81:0/2224271551 learned_addr learned my addr 172.21.15.81:0/2224271551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940814fe70 0x7f940814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9408155e90 0x7f940814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9408155e90 msgr2=0x7f940814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9408155e90 0x7f940814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940814fe70 msgr2=0x7f940814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f940814fe70 0x7f940814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0094d0 con 0x7f940806a500 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9408155e90 0x7f940814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940659c640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 0x7f94081ebad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93f800c420 tx=0x7f93f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80052d0 con 0x7f940806a500 2024-05-08T20:37:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f8005430 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8007260 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9400009a70 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940814f450 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 0x7f940814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408069550 con 0x7f94081401e0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 0x7f940814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9405d9b640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f940806dd10 con 0x7f94081401e0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93f80073c0 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.927+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 0x7f940814eb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94080c19a0 tx=0x7f93fc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93e80666c0 0x7f93e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f93f8083720 con 0x7f940806a500 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93e80666c0 0x7f93e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc011c90 con 0x7f94081401e0 2024-05-08T20:37:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f93fc011df0 con 0x7f94081401e0 2024-05-08T20:37:22.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 msgr2=0x7f940814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 0x7f940814eb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94080c19a0 tx=0x7f93fc00f610 comp rx=0 tx=0).stop 2024-05-08T20:37:22.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 msgr2=0x7f940814eb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:22.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f93f6ffd640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081401e0 0x7f940814eb10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.931+0000 7f9406d9d640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93e80666c0 0x7f93e8068b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f94000af000 tx=0x7f94000a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.935+0000 7f940ca84640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 0x7f94081ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:22.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.935+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080675e0 con 0x7f94081eb150 2024-05-08T20:37:22.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.935+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 0x7f94081ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:22.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.935+0000 7f9405d9b640 1 -- 172.21.15.81:0/2224271551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f940814f2b0 con 0x7f94081eb150 2024-05-08T20:37:22.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.935+0000 7f9405d9b640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 0x7f94081ee6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94081470e0 tx=0x7f93fc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:22.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc014850 con 0x7f94081eb150 2024-05-08T20:37:22.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4808 (secure 0 0 0) 0x7f93fc02c430 con 0x7f94081eb150 2024-05-08T20:37:22.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 msgr2=0x7f94081ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 0x7f94081ee6c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94081470e0 tx=0x7f93fc0046d0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 msgr2=0x7f94081ee6c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f93f6ffd640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94081eb150 0x7f94081ee6c0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94081470e0 tx=0x7f93fc0046d0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:22.942 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:22.943 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:22.944 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:22.945 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:22.947 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:22.952 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:22.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:22.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:22.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:22.954 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:22.954 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93e80666c0 msgr2=0x7f93e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f93e80666c0 0x7f93e8068b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f94000af000 tx=0x7f94000a7070 comp rx=0 tx=0).stop 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 msgr2=0x7f94081ebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 --2- 172.21.15.81:0/2224271551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940806a500 0x7f94081ebad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f93f800c420 tx=0x7f93f800c8e0 comp rx=0 tx=0).stop 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f9406d9d640 1 -- 172.21.15.81:0/2224271551 reap_dead start 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f9406d9d640 1 -- 172.21.15.81:0/2224271551 reap_dead start 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 shutdown_connections 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 >> 172.21.15.81:0/2224271551 conn(0x7f94080c71b0 msgr2=0x7f940806d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 shutdown_connections 2024-05-08T20:37:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:22.939+0000 7f940ca84640 1 -- 172.21.15.81:0/2224271551 wait complete. 2024-05-08T20:37:22.958 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:22.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:37:22.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:37:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 Processor -- start 2024-05-08T20:37:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 -- start start 2024-05-08T20:37:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc25006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500c8b10 con 0x7fc2500c8230 2024-05-08T20:37:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc250154ee0 con 0x7fc2501522b0 2024-05-08T20:37:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc254913640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc250152690 con 0x7fc250154970 2024-05-08T20:37:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2500c8230 0x7fc25006a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58848/0 (socket says 172.21.15.81:58848) 2024-05-08T20:37:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3141834248 learned_addr learned my addr 172.21.15.81:0/3141834248 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc25006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708218268 0 0) 0x7fc2500c8b10 con 0x7fc2500c8230 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c003530 con 0x7fc2500c8230 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920545272 0 0) 0x7fc23c003530 con 0x7fc2500c8230 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 msgr2=0x7fc25006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc25006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 >> v1:172.21.15.117:6789/0 conn(0x7fc2501522b0 legacy=0x7fc2500c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2501551c0 con 0x7fc2500c8230 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc248001a00 con 0x7fc2500c8230 2024-05-08T20:37:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 >> v1:172.21.15.81:6789/0 conn(0x7fc2500c8230 legacy=0x7fc25006a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc23c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c003ef0 0x7fc23c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c004d10 0x7fc23c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c00ba70 con 0x7fc23c004d10 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c00bbe0 con 0x7fc23c003ef0 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c00bda0 con 0x7fc250154970 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c004d10 0x7fc23c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc23c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c003ef0 0x7fc23c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 msgr2=0x7fc23c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250154970 0x7fc23c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c003ef0 msgr2=0x7fc23c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c003ef0 0x7fc23c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3141834248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c003530 con 0x7fc23c004d10 2024-05-08T20:37:23.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.083+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23c003ef0 0x7fc23c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c004d10 0x7fc23c005190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc24800a840 tx=0x7fc24801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841241c884f2f079 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480ad630 con 0x7fc23c004d10 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2480a8070 con 0x7fc23c004d10 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc24dd9b640 1 -- 172.21.15.81:0/3141834248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480ada10 con 0x7fc23c004d10 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 -- 172.21.15.81:0/3141834248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c004d10 msgr2=0x7fc23c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 --2- 172.21.15.81:0/3141834248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23c004d10 0x7fc23c005190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc24800a840 tx=0x7fc24801d340 comp rx=0 tx=0).stop 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3141834248 reap_dead start 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 -- 172.21.15.81:0/3141834248 shutdown_connections 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 -- 172.21.15.81:0/3141834248 >> 172.21.15.81:0/3141834248 conn(0x7fc2500ca330 msgr2=0x7fc2500ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 -- 172.21.15.81:0/3141834248 shutdown_connections 2024-05-08T20:37:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.087+0000 7fc254913640 1 -- 172.21.15.81:0/3141834248 wait complete. 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 Processor -- start 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- start start 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250153200 0x7fc250155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501562a0 0x7fc25015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250157a50 con 0x7fc2501f17b0 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25014e510 con 0x7fc2501562a0 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25014e230 con 0x7fc250153200 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47252/0 (socket says 172.21.15.81:47252) 2024-05-08T20:37:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3719912589 learned_addr learned my addr 172.21.15.81:0/3719912589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250153200 0x7fc250155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501562a0 0x7fc25015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250153200 msgr2=0x7fc250155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc250153200 0x7fc250155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501562a0 msgr2=0x7fc25015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501562a0 0x7fc25015a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2501f0cd0 con 0x7fc2501f17b0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501562a0 0x7fc25015a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24ed9d640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc24801d170 tx=0x7fc23c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248001210 con 0x7fc2501f17b0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248001800 con 0x7fc2501f17b0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2501f0fb0 con 0x7fc2501f17b0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2480ad630 con 0x7fc2501f17b0 2024-05-08T20:37:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25014c5f0 con 0x7fc2501f17b0 2024-05-08T20:37:23.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 0x7fc25015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250069550 con 0x7fc2501494a0 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 0x7fc25015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.091+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2480aa030 con 0x7fc2501f17b0 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc24e59c640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc250149880 con 0x7fc2501494a0 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2300666c0 0x7fc230068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc24811e8f0 con 0x7fc2501f17b0 2024-05-08T20:37:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2300666c0 0x7fc230068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 0x7fc25015ab40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc240003d30 tx=0x7fc240001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400124d0 con 0x7fc2501494a0 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc245d9b640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2300666c0 0x7fc230068b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc238009360 tx=0x7fc238008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc240012630 con 0x7fc2501494a0 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 msgr2=0x7fc25015ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 0x7fc25015ab40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc240003d30 tx=0x7fc240001710 comp rx=0 tx=0).stop 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 msgr2=0x7fc25015ab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.095+0000 7fc2477fe640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2501494a0 0x7fc25015ab40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 0x7fc250148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2501f0e60 con 0x7fc250148420 2024-05-08T20:37:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 0x7fc250148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc24e59c640 1 -- 172.21.15.81:0/3719912589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc250160b10 con 0x7fc250148420 2024-05-08T20:37:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc24e59c640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 0x7fc250148830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2400050c0 tx=0x7fc240001240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240022070 con 0x7fc250148420 2024-05-08T20:37:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fc240026400 con 0x7fc250148420 2024-05-08T20:37:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 msgr2=0x7fc250148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 0x7fc250148830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc2400050c0 tx=0x7fc240001240 comp rx=0 tx=0).stop 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 msgr2=0x7fc250148830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc2477fe640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc250148420 0x7fc250148830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:23.108 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.109 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.110 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:23.111 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.112 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.117 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.119 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:23.119 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2300666c0 msgr2=0x7fc230068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2300666c0 0x7fc230068b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc238009360 tx=0x7fc238008040 comp rx=0 tx=0).stop 2024-05-08T20:37:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 msgr2=0x7fc25015a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc24ed9d640 1 -- 172.21.15.81:0/3719912589 reap_dead start 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc24801d170 tx=0x7fc23c005800 comp rx=0 tx=0).stop 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 shutdown_connections 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 --2- 172.21.15.81:0/3719912589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2501f17b0 0x7fc25015a600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 >> 172.21.15.81:0/3719912589 conn(0x7fc2500ca330 msgr2=0x7fc2500ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 shutdown_connections 2024-05-08T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.103+0000 7fc254913640 1 -- 172.21.15.81:0/3719912589 wait complete. 2024-05-08T20:37:23.125 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:23.125 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:37:23.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:37:23.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 Processor -- start 2024-05-08T20:37:23.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 -- start start 2024-05-08T20:37:23.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe2280c58d0 0x7fe2280c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe228066010 0x7fe2280c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2280c14e0 con 0x7fe228154e40 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22806d210 con 0x7fe2280c58d0 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe23034a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22806c530 con 0x7fe228066010 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e0e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe2280c58d0 0x7fe2280c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e8e7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe228154e40 0x7fe2281552b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58860/0 (socket says 172.21.15.81:58860) 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e8e7640 1 -- 172.21.15.81:0/2069496421 learned_addr learned my addr 172.21.15.81:0/2069496421 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22d8e5640 1 --2- 172.21.15.81:0/2069496421 >> v2:172.21.15.117:3300/0 conn(0x7fe228066010 0x7fe2280c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e0e6640 1 -- 172.21.15.81:0/2069496421 >> v2:172.21.15.117:3300/0 conn(0x7fe228066010 msgr2=0x7fe2280c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/2069496421 >> v2:172.21.15.117:3300/0 conn(0x7fe228066010 0x7fe2280c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e0e6640 1 -- 172.21.15.81:0/2069496421 >> v1:172.21.15.81:6789/0 conn(0x7fe228154e40 legacy=0x7fe2281552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22e0e6640 1 -- 172.21.15.81:0/2069496421 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2280c1730 con 0x7fe2280c58d0 2024-05-08T20:37:23.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.243+0000 7fe22d0e4640 1 -- 172.21.15.81:0/2069496421 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489592550 0 0) 0x7fe2280c14e0 con 0x7fe228154e40 2024-05-08T20:37:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/2069496421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2280c58d0 0x7fe2280c1a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe22806dba0 tx=0x7fe22401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7727a623bbae366 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22d0e4640 1 -- 172.21.15.81:0/2069496421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224004230 con 0x7fe2280c58d0 2024-05-08T20:37:23.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22d0e4640 1 -- 172.21.15.81:0/2069496421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2240a7050 con 0x7fe2280c58d0 2024-05-08T20:37:23.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22d0e4640 1 -- 172.21.15.81:0/2069496421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003620 con 0x7fe2280c58d0 2024-05-08T20:37:23.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- 172.21.15.81:0/2069496421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2280c58d0 msgr2=0x7fe2280c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- 172.21.15.81:0/2069496421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2280c58d0 0x7fe2280c1a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe22806dba0 tx=0x7fe22401c330 comp rx=0 tx=0).stop 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- 172.21.15.81:0/2069496421 shutdown_connections 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- 172.21.15.81:0/2069496421 >> v2:172.21.15.117:3300/0 conn(0x7fe228066010 0x7fe2280c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- 172.21.15.81:0/2069496421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2280c58d0 0x7fe2280c1a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- 172.21.15.81:0/2069496421 >> 172.21.15.81:0/2069496421 conn(0x7fe2280c68c0 msgr2=0x7fe2280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- 172.21.15.81:0/2069496421 shutdown_connections 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- 172.21.15.81:0/2069496421 wait complete. 2024-05-08T20:37:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 Processor -- start 2024-05-08T20:37:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- start start 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228066010 0x7fe228159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe228154e40 0x7fe228147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22815a440 con 0x7fe228156140 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2281eea00 con 0x7fe228154e40 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe23034a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe228152ca0 con 0x7fe228066010 2024-05-08T20:37:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e8e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e8e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47284/0 (socket says 172.21.15.81:47284) 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e8e7640 1 -- 172.21.15.81:0/3087096219 learned_addr learned my addr 172.21.15.81:0/3087096219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228066010 0x7fe228159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22d8e5640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe228154e40 0x7fe228147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e8e7640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228066010 msgr2=0x7fe228159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.247+0000 7fe22e8e7640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228066010 0x7fe228159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e8e7640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe228154e40 msgr2=0x7fe228147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e8e7640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe228154e40 0x7fe228147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e8e7640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009420 con 0x7fe228156140 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22d8e5640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe228154e40 0x7fe228147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e8e7640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe22000c7b0 tx=0x7fe22000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22000a640 con 0x7fe228156140 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22000a7c0 con 0x7fe228156140 2024-05-08T20:37:23.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22000ab70 con 0x7fe228156140 2024-05-08T20:37:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22815a160 con 0x7fe228156140 2024-05-08T20:37:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2281ee620 con 0x7fe228156140 2024-05-08T20:37:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe23034a640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 0x7fe2281eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe228069550 con 0x7fe2281ec650 2024-05-08T20:37:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 0x7fe2281eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e0e6640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2280c2e60 con 0x7fe2281ec650 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe22000acd0 con 0x7fe228156140 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 0x7fe2281eed20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe228065f10 tx=0x7fe22401ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe20c066690 0x7fe20c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe220083820 con 0x7fe228156140 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22d8e5640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe20c066690 0x7fe20c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003620 con 0x7fe2281ec650 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe22d8e5640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe20c066690 0x7fe20c068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe228072670 tx=0x7fe218008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe2240ba070 con 0x7fe2281ec650 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 msgr2=0x7fe2281eed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 0x7fe2281eed20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe228065f10 tx=0x7fe22401ab70 comp rx=0 tx=0).stop 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 msgr2=0x7fe2281eed20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:23.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.251+0000 7fe21effd640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2281ec650 0x7fe2281eed20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe23034a640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 0x7fe228146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe228071960 con 0x7fe228146850 2024-05-08T20:37:23.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 0x7fe228146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe22e0e6640 1 -- 172.21.15.81:0/3087096219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe2281471a0 con 0x7fe228146850 2024-05-08T20:37:23.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe22e0e6640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 0x7fe228146c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2280c7630 tx=0x7fe2240190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.259+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240bf8b0 con 0x7fe228146850 2024-05-08T20:37:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fe2240c8070 con 0x7fe228146850 2024-05-08T20:37:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 msgr2=0x7fe228146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe21effd640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 0x7fe228146c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2280c7630 tx=0x7fe2240190d0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe21effd640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 msgr2=0x7fe228146c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:23.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe21effd640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe228146850 0x7fe228146c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 84, 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:37:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:23.278 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe20c066690 msgr2=0x7fe20c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe20c066690 0x7fe20c068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe228072670 tx=0x7fe218008040 comp rx=0 tx=0).stop 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 msgr2=0x7fe2281ec110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe22e8e7640 1 -- 172.21.15.81:0/3087096219 reap_dead start 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe22000c7b0 tx=0x7fe22000cc70 comp rx=0 tx=0).stop 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 shutdown_connections 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 --2- 172.21.15.81:0/3087096219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe228156140 0x7fe2281ec110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 >> 172.21.15.81:0/3087096219 conn(0x7fe2280c68c0 msgr2=0x7fe2280c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 shutdown_connections 2024-05-08T20:37:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.263+0000 7fe23034a640 1 -- 172.21.15.81:0/3087096219 wait complete. 2024-05-08T20:37:23.282 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:37:23.282 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:37:23.282 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:37:23.282 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:37:23.282 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:37:23.282 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:37:23.283 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:37:23.304 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:37:23.305 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:37:23.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:23.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 Processor -- start 2024-05-08T20:37:23.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 -- start start 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfc00c30d0 0x7fdfc00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc0155e10 con 0x7fdfc00a94b0 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc006e790 con 0x7fdfc00c30d0 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc729d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc006f460 con 0x7fdfc00c2bc0 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc4838640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 msgr2=0x7fdfc00c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:23.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc4838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc00c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc5039640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfc00c30d0 0x7fdfc00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.415+0000 7fdfc583a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdfc00a94b0 0x7fdfc00a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:53700/0 (socket says 172.21.15.81:53700) 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc583a640 1 -- 172.21.15.81:0/1290604294 learned_addr learned my addr 172.21.15.81:0/1290604294 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc5039640 1 -- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 msgr2=0x7fdfc00c4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc5039640 1 --2- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc00c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc5039640 1 -- 172.21.15.81:0/1290604294 >> v1:172.21.15.117:6789/0 conn(0x7fdfc00a94b0 legacy=0x7fdfc00a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc5039640 1 -- 172.21.15.81:0/1290604294 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0156080 con 0x7fdfc00c30d0 2024-05-08T20:37:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc5039640 1 --2- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00c30d0 0x7fdfc00c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097f0 tx=0x7fdfbc01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f1ab68da94a899 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfb7fff640 1 -- 172.21.15.81:0/1290604294 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ab600 con 0x7fdfc00c30d0 2024-05-08T20:37:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfb7fff640 1 -- 172.21.15.81:0/1290604294 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0ab760 con 0x7fdfc00c30d0 2024-05-08T20:37:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfb7fff640 1 -- 172.21.15.81:0/1290604294 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0abaf0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 -- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00c30d0 msgr2=0x7fdfc00c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 --2- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00c30d0 0x7fdfc00c34b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097f0 tx=0x7fdfbc01c400 comp rx=0 tx=0).stop 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 -- 172.21.15.81:0/1290604294 shutdown_connections 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 --2- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 --2- 172.21.15.81:0/1290604294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00c30d0 0x7fdfc00c34b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 -- 172.21.15.81:0/1290604294 >> 172.21.15.81:0/1290604294 conn(0x7fdfc00c4cc0 msgr2=0x7fdfc00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 -- 172.21.15.81:0/1290604294 shutdown_connections 2024-05-08T20:37:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.419+0000 7fdfc729d640 1 -- 172.21.15.81:0/1290604294 wait complete. 2024-05-08T20:37:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 Processor -- start 2024-05-08T20:37:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- start start 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00a94b0 0x7fdfc01edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc006b670 con 0x7fdfc00c30d0 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc014b1f0 con 0x7fdfc00a94b0 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01ee1d0 con 0x7fdfc00c2bc0 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc4838640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 msgr2=0x7fdfc006ba90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc4838640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc006ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47358/0 (socket says 172.21.15.81:47358) 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 -- 172.21.15.81:0/2420960167 learned_addr learned my addr 172.21.15.81:0/2420960167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc5039640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00a94b0 0x7fdfc01edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 -- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 msgr2=0x7fdfc006ba90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc006ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 -- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00a94b0 msgr2=0x7fdfc01edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00a94b0 0x7fdfc01edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 -- 172.21.15.81:0/2420960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009420 con 0x7fdfc00c30d0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc583a640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800cab0 tx=0x7fdfb800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800ac30 con 0x7fdfc00c30d0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800ad90 con 0x7fdfc00c30d0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc006afd0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8012600 con 0x7fdfc00c30d0 2024-05-08T20:37:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc006cc00 con 0x7fdfc00c30d0 2024-05-08T20:37:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.423+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc006b7b0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.427+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfb8012760 con 0x7fdfc00c30d0 2024-05-08T20:37:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.427+0000 7fdfb5ffb640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 0x7fdfa4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.427+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fdfb80842c0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.427+0000 7fdfc5039640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 0x7fdfa4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.427+0000 7fdfc5039640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 0x7fdfa4068b00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0af000 tx=0x7fdfbc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.431+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fdfc006b7b0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdfc006b7b0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfb5ffb640 1 -- 172.21.15.81:0/2420960167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fdfc006b7b0 con 0x7fdfc00c30d0 2024-05-08T20:37:23.702 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 msgr2=0x7fdfa4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 0x7fdfa4068b00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0af000 tx=0x7fdfbc0a7000 comp rx=0 tx=0).stop 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 msgr2=0x7fdfc01ee6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800cab0 tx=0x7fdfb800cf70 comp rx=0 tx=0).stop 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 shutdown_connections 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdfa4066640 0x7fdfa4068b00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfc00c30d0 0x7fdfc01ee6d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc00c2bc0 0x7fdfc006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 --2- 172.21.15.81:0/2420960167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfc00a94b0 0x7fdfc01edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 >> 172.21.15.81:0/2420960167 conn(0x7fdfc00c4cc0 msgr2=0x7fdfc006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 shutdown_connections 2024-05-08T20:37:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:23.699+0000 7fdfc729d640 1 -- 172.21.15.81:0/2420960167 wait complete. 2024-05-08T20:37:26.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.847+0000 7f1a663f8640 1 Processor -- start 2024-05-08T20:37:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a663f8640 1 -- start start 2024-05-08T20:37:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a663f8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a600c2800 0x7f1a601520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a663f8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600c3a50 con 0x7f1a6006b230 2024-05-08T20:37:26.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a663f8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600705e0 con 0x7f1a60070c00 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a663f8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a600c2c70 con 0x7f1a600c2800 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a6006b230 0x7f1a6014e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58868/0 (socket says 172.21.15.81:58868) 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 -- 172.21.15.81:0/269195307 learned_addr learned my addr 172.21.15.81:0/269195307 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a64995640 1 --2- 172.21.15.81:0/269195307 >> v2:172.21.15.117:3300/0 conn(0x7f1a600c2800 0x7f1a601520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255176382 0 0) 0x7f1a600c3a50 con 0x7f1a6006b230 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a48003530 con 0x7f1a6006b230 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192298996 0 0) 0x7f1a48003530 con 0x7f1a6006b230 2024-05-08T20:37:26.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 >> v2:172.21.15.117:3300/0 conn(0x7f1a600c2800 msgr2=0x7f1a601520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 --2- 172.21.15.81:0/269195307 >> v2:172.21.15.117:3300/0 conn(0x7f1a600c2800 0x7f1a601520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 >> v1:172.21.15.117:6789/0 conn(0x7f1a60070c00 legacy=0x7f1a601519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600708c0 con 0x7f1a6006b230 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1a54001680 con 0x7f1a6006b230 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 >> v1:172.21.15.81:6789/0 conn(0x7f1a6006b230 legacy=0x7f1a6014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 0x7f1a48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a480047d0 0x7f1a48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48005190 0x7f1a4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600c2c70 con 0x7f1a48003980 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c130 con 0x7f1a48005190 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4800c2f0 con 0x7f1a480047d0 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 0x7f1a48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5f7fe640 1 -- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a480047d0 msgr2=0x7f1a48004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5f7fe640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a480047d0 0x7f1a48004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a64995640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48005190 0x7f1a4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 -- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a480047d0 msgr2=0x7f1a48004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:26.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a480047d0 0x7f1a48004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 -- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48005190 msgr2=0x7f1a4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48005190 0x7f1a4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a5ffff640 1 -- 172.21.15.81:0/269195307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48003530 con 0x7f1a48003980 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.851+0000 7f1a64995640 1 -- 172.21.15.81:0/269195307 reap_dead start 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 0x7f1a48003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001060 tx=0x7f1a5401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d654dfe564edf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54005ae0 con 0x7f1a48003980 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54005c40 con 0x7f1a48003980 2024-05-08T20:37:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a5effd640 1 -- 172.21.15.81:0/269195307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54007070 con 0x7f1a48003980 2024-05-08T20:37:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 msgr2=0x7f1a48003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 0x7f1a48003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a54001060 tx=0x7f1a5401c8e0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- 172.21.15.81:0/269195307 shutdown_connections 2024-05-08T20:37:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 --2- 172.21.15.81:0/269195307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a48003980 0x7f1a48003da0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- 172.21.15.81:0/269195307 >> 172.21.15.81:0/269195307 conn(0x7f1a600c71b0 msgr2=0x7f1a600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- 172.21.15.81:0/269195307 shutdown_connections 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- 172.21.15.81:0/269195307 wait complete. 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 Processor -- start 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 -- start start 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48003980 0x7f1a600c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.855+0000 7f1a663f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 0x7f1a600c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601537f0 con 0x7f1a60149170 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6014e0e0 con 0x7f1a48003980 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60154560 con 0x7f1a601f0ca0 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a64995640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 msgr2=0x7f1a600c05e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a64995640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 0x7f1a600c05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47376/0 (socket says 172.21.15.81:47376) 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 -- 172.21.15.81:0/1983245310 learned_addr learned my addr 172.21.15.81:0/1983245310 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48003980 0x7f1a600c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 -- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 msgr2=0x7f1a600c05e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 0x7f1a600c05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 -- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48003980 msgr2=0x7f1a600c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48003980 0x7f1a600c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 -- 172.21.15.81:0/1983245310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60154840 con 0x7f1a60149170 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5f7fe640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c500 tx=0x7f1a5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50007500 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50007660 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50005a10 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a60153480 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a600c16e0 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a600675e0 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a50005b70 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 0x7f1a4c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1a500835e0 con 0x7f1a60149170 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 0x7f1a4c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.859+0000 7f1a5ffff640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 0x7f1a4c068b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ab000 tx=0x7f1a54007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:26.863+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1a50050650 con 0x7f1a60149170 2024-05-08T20:37:27.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.155+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1a60074950 con 0x7f1a60149170 2024-05-08T20:37:27.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.155+0000 7f1a5cff9640 1 -- 172.21.15.81:0/1983245310 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1a50053c70 con 0x7f1a60149170 2024-05-08T20:37:27.161 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 msgr2=0x7f1a4c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 0x7f1a4c068b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ab000 tx=0x7f1a54007040 comp rx=0 tx=0).stop 2024-05-08T20:37:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 msgr2=0x7f1a601f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c500 tx=0x7f1a5000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:37:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 shutdown_connections 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1a4c066640 0x7f1a4c068b00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a601f0ca0 0x7f1a600c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a60149170 0x7f1a601f0760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 --2- 172.21.15.81:0/1983245310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a48003980 0x7f1a600c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 >> 172.21.15.81:0/1983245310 conn(0x7f1a600c71b0 msgr2=0x7f1a600c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 shutdown_connections 2024-05-08T20:37:27.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:27.159+0000 7f1a663f8640 1 -- 172.21.15.81:0/1983245310 wait complete. 2024-05-08T20:37:30.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:30.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 Processor -- start 2024-05-08T20:37:30.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 -- start start 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 0x7fc688154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6880c34e0 0x7fc6881554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc688158080 con 0x7fc688152340 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68806ab70 con 0x7fc6880c34e0 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc68d632640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc688154b10 con 0x7fc6880c2570 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc67e7fc640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 msgr2=0x7fc688154f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc67e7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 0x7fc688154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc686ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc688152340 0x7fc68806d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37962/0 (socket says 172.21.15.81:37962) 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc686ffd640 1 -- 172.21.15.81:0/3448418703 learned_addr learned my addr 172.21.15.81:0/3448418703 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc6877fe640 1 --2- 172.21.15.81:0/3448418703 >> v2:172.21.15.117:3300/0 conn(0x7fc6880c34e0 0x7fc6881554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc6877fe640 1 -- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 msgr2=0x7fc688154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc6877fe640 1 --2- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 0x7fc688154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc6877fe640 1 -- 172.21.15.81:0/3448418703 >> v1:172.21.15.81:6789/0 conn(0x7fc688152340 legacy=0x7fc68806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:30.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.319+0000 7fc6877fe640 1 -- 172.21.15.81:0/3448418703 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68806a890 con 0x7fc6880c34e0 2024-05-08T20:37:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc6877fe640 1 --2- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc6881554a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc680009d90 tx=0x7fc68001c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc10d41ef995872 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc6867fc640 1 -- 172.21.15.81:0/3448418703 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800a5990 con 0x7fc6880c34e0 2024-05-08T20:37:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc6867fc640 1 -- 172.21.15.81:0/3448418703 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800a5af0 con 0x7fc6880c34e0 2024-05-08T20:37:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc6867fc640 1 -- 172.21.15.81:0/3448418703 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800a5e80 con 0x7fc6880c34e0 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 -- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 msgr2=0x7fc6881554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 --2- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc6881554a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc680009d90 tx=0x7fc68001c8d0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 -- 172.21.15.81:0/3448418703 shutdown_connections 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 --2- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc6881554a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 --2- 172.21.15.81:0/3448418703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6880c2570 0x7fc688154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 -- 172.21.15.81:0/3448418703 >> 172.21.15.81:0/3448418703 conn(0x7fc6880c71b0 msgr2=0x7fc6880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 -- 172.21.15.81:0/3448418703 shutdown_connections 2024-05-08T20:37:30.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.323+0000 7fc68d632640 1 -- 172.21.15.81:0/3448418703 wait complete. 2024-05-08T20:37:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 Processor -- start 2024-05-08T20:37:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- start start 2024-05-08T20:37:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc688071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 0x7fc688150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688070440 con 0x7fc6880c2570 2024-05-08T20:37:30.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6881ee1e0 con 0x7fc6880c34e0 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc688156d70 con 0x7fc688152340 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc6877fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 msgr2=0x7fc688150fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47704/0 (socket says 172.21.15.81:47704) 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 -- 172.21.15.81:0/2380260139 learned_addr learned my addr 172.21.15.81:0/2380260139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc6877fe640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 0x7fc688150fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc67e7fc640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc688071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 -- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 msgr2=0x7fc688150fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 0x7fc688150fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 -- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 msgr2=0x7fc688071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc688071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 -- 172.21.15.81:0/2380260139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009a70 con 0x7fc6880c2570 2024-05-08T20:37:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc686ffd640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c370 tx=0x7fc67800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678005cf0 con 0x7fc6880c2570 2024-05-08T20:37:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678005e50 con 0x7fc6880c2570 2024-05-08T20:37:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6881448b0 con 0x7fc6880c2570 2024-05-08T20:37:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780072f0 con 0x7fc6880c2570 2024-05-08T20:37:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc688157280 con 0x7fc6880c2570 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6880675e0 con 0x7fc6880c2570 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.327+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc678007450 con 0x7fc6880c2570 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.331+0000 7fc67ffff640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 0x7fc668068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.331+0000 7fc67e7fc640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 0x7fc668068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.331+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc678083a80 con 0x7fc6880c2570 2024-05-08T20:37:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.331+0000 7fc67e7fc640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 0x7fc668068b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc670006fd0 tx=0x7fc670008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:30.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.335+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc678050a60 con 0x7fc6880c2570 2024-05-08T20:37:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.603+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc688074950 con 0x7fc6880c2570 2024-05-08T20:37:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.603+0000 7fc67ffff640 1 -- 172.21.15.81:0/2380260139 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fc678017080 con 0x7fc6880c2570 2024-05-08T20:37:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:30.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 msgr2=0x7fc668068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:30.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 0x7fc668068b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc670006fd0 tx=0x7fc670008040 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 msgr2=0x7fc6881edca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c370 tx=0x7fc67800c830 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 shutdown_connections 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc668066640 0x7fc668068b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc688152340 0x7fc688150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6880c34e0 0x7fc688071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 --2- 172.21.15.81:0/2380260139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880c2570 0x7fc6881edca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 >> 172.21.15.81:0/2380260139 conn(0x7fc6880c71b0 msgr2=0x7fc68814ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 shutdown_connections 2024-05-08T20:37:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:30.607+0000 7fc68d632640 1 -- 172.21.15.81:0/2380260139 wait complete. 2024-05-08T20:37:33.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:33.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 Processor -- start 2024-05-08T20:37:33.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 -- start start 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f0155e10 con 0x7f01f00a94b0 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f0156080 con 0x7f01f00c30d0 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f87d3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f006e790 con 0x7f01f00c2bc0 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47712/0 (socket says 172.21.15.81:47712) 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 learned_addr learned my addr 172.21.15.81:0/1527212142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.759+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.963+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.963+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.963+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.963+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:33.963+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:34.367+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:34.367+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:34.367+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:34.367+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:34.367+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:35.171+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:35.171+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:35.171+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:35.171+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:35.171+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 msgr2=0x7f01f00c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.81:3300/0 conn(0x7f01f00c2bc0 0x7f01f00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 -- 172.21.15.81:0/1527212142 >> v1:172.21.15.117:6789/0 conn(0x7f01f00c30d0 legacy=0x7f01f00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 -- 172.21.15.81:0/1527212142 >> v1:172.21.15.81:6789/0 conn(0x7f01f00a94b0 legacy=0x7f01f00a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 -- 172.21.15.81:0/1527212142 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f006e790 con 0x7f01d4006200 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01e7fff640 1 -- 172.21.15.81:0/1527212142 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4008d40 con 0x7f01d4003720 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f656f640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 msgr2=0x7f01d4005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f656f640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.758+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f656f640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 msgr2=0x7f01d4005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f656f640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:36.962+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:37:37.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f656f640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 msgr2=0x7f01d4005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:37.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f656f640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:37.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 msgr2=0x7f01d40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:37.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:37.366+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:37:38.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f656f640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 msgr2=0x7f01d4005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f656f640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:37:38.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> v2:172.21.15.117:3300/0 conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 msgr2=0x7f01d4005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:38.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4003720 0x7f01d4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.170+0000 7f01f5d6e640 1 -- 172.21.15.81:0/1527212142 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0156360 con 0x7f01d4006200 2024-05-08T20:37:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.174+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d4006200 0x7f01d40086a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01f00c2ff0 tx=0x7f01e001de60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a77df6d7e0dacc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.174+0000 7f01f556d640 1 -- 172.21.15.81:0/1527212142 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0018230 con 0x7f01d4006200 2024-05-08T20:37:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.174+0000 7f01f556d640 1 -- 172.21.15.81:0/1527212142 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000c040 con 0x7f01d4006200 2024-05-08T20:37:38.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.174+0000 7f01f556d640 1 -- 172.21.15.81:0/1527212142 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00a6cd0 con 0x7f01d4006200 2024-05-08T20:37:38.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 -- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d4006200 msgr2=0x7f01d40086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d4006200 0x7f01d40086a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01f00c2ff0 tx=0x7f01e001de60 comp rx=0 tx=0).stop 2024-05-08T20:37:38.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f6d70640 1 -- 172.21.15.81:0/1527212142 reap_dead start 2024-05-08T20:37:38.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 -- 172.21.15.81:0/1527212142 shutdown_connections 2024-05-08T20:37:38.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 --2- 172.21.15.81:0/1527212142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d4006200 0x7f01d40086a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 -- 172.21.15.81:0/1527212142 >> 172.21.15.81:0/1527212142 conn(0x7f01f00c4cc0 msgr2=0x7f01f00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 -- 172.21.15.81:0/1527212142 shutdown_connections 2024-05-08T20:37:38.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.178+0000 7f01f87d3640 1 -- 172.21.15.81:0/1527212142 wait complete. 2024-05-08T20:37:38.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 Processor -- start 2024-05-08T20:37:38.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- start start 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 0x7f01f00c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f013fd80 0x7f01f01ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00c79b0 con 0x7f01f0153b70 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00c5f50 con 0x7f01f013fd80 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01eefa0 con 0x7f01d4006200 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f656f640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 msgr2=0x7f01f00c2630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f656f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 0x7f01f00c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47746/0 (socket says 172.21.15.81:47746) 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 -- 172.21.15.81:0/605583956 learned_addr learned my addr 172.21.15.81:0/605583956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f6d70640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f013fd80 0x7f01f01ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 -- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 msgr2=0x7f01f00c2630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 0x7f01f00c2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 -- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f013fd80 msgr2=0x7f01f01ee460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f013fd80 0x7f01f01ee460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 -- 172.21.15.81:0/605583956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0018850 con 0x7f01f0153b70 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f5d6e640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01e00079b0 tx=0x7f01e0008b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b6070 con 0x7f01f0153b70 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00b1460 con 0x7f01f0153b70 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f00c6230 con 0x7f01f0153b70 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00b17d0 con 0x7f01f0153b70 2024-05-08T20:37:38.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.182+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f01ef280 con 0x7f01f0153b70 2024-05-08T20:37:38.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0074950 con 0x7f01f0153b70 2024-05-08T20:37:38.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01e00ba070 con 0x7f01f0153b70 2024-05-08T20:37:38.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01e6ffd640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 0x7f01d4069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f01e011f0d0 con 0x7f01f0153b70 2024-05-08T20:37:38.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01f656f640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 0x7f01d4069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.186+0000 7f01f656f640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 0x7f01d4069860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01ec007fd0 tx=0x7f01ec007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.190+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f01e00ec280 con 0x7f01f0153b70 2024-05-08T20:37:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.482+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f01f0072600 con 0x7f01f0153b70 2024-05-08T20:37:38.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.482+0000 7f01e6ffd640 1 -- 172.21.15.81:0/605583956 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f01e00ac620 con 0x7f01f0153b70 2024-05-08T20:37:38.488 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":88,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 msgr2=0x7f01d4069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 0x7f01d4069860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01ec007fd0 tx=0x7f01ec007960 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 msgr2=0x7f01f013f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01e00079b0 tx=0x7f01e0008b30 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 shutdown_connections 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01d40673a0 0x7f01d4069860 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01f013fd80 0x7f01f01ee460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f0153b70 0x7f01f013f840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 --2- 172.21.15.81:0/605583956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01d4006200 0x7f01f00c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 >> 172.21.15.81:0/605583956 conn(0x7f01f00c4cc0 msgr2=0x7f01f006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 shutdown_connections 2024-05-08T20:37:38.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.486+0000 7f01f87d3640 1 -- 172.21.15.81:0/605583956 wait complete. 2024-05-08T20:37:38.507 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:37:38.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:37:38.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:37:38.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 Processor -- start 2024-05-08T20:37:38.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 -- start start 2024-05-08T20:37:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f28181555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2818155140 con 0x7f28180aac30 2024-05-08T20:37:38.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180c32d0 con 0x7f28180c26e0 2024-05-08T20:37:38.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281e7fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180c4780 con 0x7f2818152220 2024-05-08T20:37:38.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281cd97640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28180aac30 0x7f28180c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37984/0 (socket says 172.21.15.81:37984) 2024-05-08T20:37:38.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281cd97640 1 -- 172.21.15.81:0/89270189 learned_addr learned my addr 172.21.15.81:0/89270189 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2817fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 msgr2=0x7f28181555d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2817fff640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f28181555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754466681 0 0) 0x7f2818155140 con 0x7f28180aac30 2024-05-08T20:37:38.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2800003530 con 0x7f28180aac30 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008342397 0 0) 0x7f28180c32d0 con 0x7f28180c26e0 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2818155140 con 0x7f28180c26e0 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809400004 0 0) 0x7f2800003530 con 0x7f28180aac30 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 msgr2=0x7f28181555d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f28181555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 >> v1:172.21.15.117:6789/0 conn(0x7f28180c26e0 legacy=0x7f28180c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818072650 con 0x7f28180aac30 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2810001a00 con 0x7f28180aac30 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 >> v1:172.21.15.81:6789/0 conn(0x7f28180aac30 legacy=0x7f28180c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2800003b40 0x7f2800003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28000047d0 0x7f2800004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f280000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000054e0 con 0x7f28000047d0 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2800005650 con 0x7f2800003b40 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280000bf00 con 0x7f2818152220 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281cd97640 1 -- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 msgr2=0x7f280000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.622+0000 7f281cd97640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f280000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f2817fff640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2800003b40 0x7f2800003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28000047d0 0x7f2800004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 -- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 msgr2=0x7f280000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2818152220 0x7f280000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 -- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2800003b40 msgr2=0x7f2800003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2800003b40 0x7f2800003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 -- 172.21.15.81:0/89270189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800003530 con 0x7f28000047d0 2024-05-08T20:37:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f2817fff640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2800003b40 0x7f2800003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f28177fe640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28000047d0 0x7f2800004c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f280c0018d0 tx=0x7f280c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819b90a892005ab2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0052d0 con 0x7f28000047d0 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c0a7050 con 0x7f28000047d0 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.626+0000 7f2816ffd640 1 -- 172.21.15.81:0/89270189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c003600 con 0x7f28000047d0 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/89270189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28000047d0 msgr2=0x7f2800004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 --2- 172.21.15.81:0/89270189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28000047d0 0x7f2800004c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f280c0018d0 tx=0x7f280c01c510 comp rx=0 tx=0).stop 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 -- 172.21.15.81:0/89270189 reap_dead start 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/89270189 shutdown_connections 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/89270189 >> 172.21.15.81:0/89270189 conn(0x7f28180c4cc0 msgr2=0x7f28180c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/89270189 shutdown_connections 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/89270189 wait complete. 2024-05-08T20:37:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 Processor -- start 2024-05-08T20:37:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- start start 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28000047d0 0x7f281814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180c7060 0x7f2818157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 0x7f28181f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281814d500 con 0x7f2818157d80 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281814bac0 con 0x7f28180c7060 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2818158200 con 0x7f28000047d0 2024-05-08T20:37:38.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f2817fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28000047d0 msgr2=0x7f281814b580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f2817fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28000047d0 0x7f281814b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 0x7f28181f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 0x7f28181f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47764/0 (socket says 172.21.15.81:47764) 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 learned_addr learned my addr 172.21.15.81:0/260508265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f28177fe640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180c7060 0x7f2818157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28000047d0 msgr2=0x7f281814b580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28000047d0 0x7f281814b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180c7060 msgr2=0x7f2818157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180c7060 0x7f2818157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281814cf40 con 0x7f2818157d80 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f28177fe640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28180c7060 0x7f2818157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281cd97640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 0x7f28181f0730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f281806fd00 tx=0x7f281000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000ce50 con 0x7f2818157d80 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000a5b0 con 0x7f2818157d80 2024-05-08T20:37:38.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281814d220 con 0x7f2818157d80 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.630+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000a960 con 0x7f2818157d80 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281806eda0 con 0x7f2818157d80 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f281e7fa640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 0x7f28181f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818073ea0 con 0x7f28181f0c70 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2817fff640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 0x7f28181f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2817fff640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2818158e60 con 0x7f28181f0c70 2024-05-08T20:37:38.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2817fff640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 0x7f28181f1050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2808006fd0 tx=0x7f28080054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280800e750 con 0x7f28181f0c70 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f281000aac0 con 0x7f2818157d80 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2804066730 0x7f2804068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f28100833b0 con 0x7f2818157d80 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f28177fe640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2804066730 0x7f2804068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f280800e8b0 con 0x7f28181f0c70 2024-05-08T20:37:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 msgr2=0x7f28181f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 0x7f28181f1050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2808006fd0 tx=0x7f28080054e0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 msgr2=0x7f28181f1050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f2814ff9640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181f0c70 0x7f28181f1050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.634+0000 7f28177fe640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2804066730 0x7f2804068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f280c004000 tx=0x7f280c001330 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 0x7f28181499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281814d930 con 0x7f28181495c0 2024-05-08T20:37:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2817fff640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 0x7f28181499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2817fff640 1 -- 172.21.15.81:0/260508265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f281806e6e0 con 0x7f28181495c0 2024-05-08T20:37:38.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2817fff640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 0x7f28181499d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2808006fd0 tx=0x7f2808005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2808026620 con 0x7f28181495c0 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7f28080123f0 con 0x7f28181495c0 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 msgr2=0x7f28181499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 0x7f28181499d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2808006fd0 tx=0x7f2808005a90 comp rx=0 tx=0).stop 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 msgr2=0x7f28181499d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f2814ff9640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28181495c0 0x7f28181499d0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2808006fd0 tx=0x7f2808005a90 comp rx=0 tx=0).stop 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 88, 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:37:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:38.661 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:38.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2804066730 msgr2=0x7f2804068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2804066730 0x7f2804068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f280c004000 tx=0x7f280c001330 comp rx=0 tx=0).stop 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 msgr2=0x7f28181f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 --2- 172.21.15.81:0/260508265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2818157d80 0x7f28181f0730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f281806fd00 tx=0x7f281000cc00 comp rx=0 tx=0).stop 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 reap_dead start 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281cd97640 1 -- 172.21.15.81:0/260508265 reap_dead start 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 shutdown_connections 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 >> 172.21.15.81:0/260508265 conn(0x7f28180c4cc0 msgr2=0x7f281814f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 shutdown_connections 2024-05-08T20:37:38.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.642+0000 7f281e7fa640 1 -- 172.21.15.81:0/260508265 wait complete. 2024-05-08T20:37:38.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:37:38.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:37:38.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:37:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 Processor -- start 2024-05-08T20:37:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 -- start start 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d180c26e0 0x7f2d181555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18155140 con 0x7f2d180aac30 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180c32d0 con 0x7f2d18152220 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1eb8a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180c4780 con 0x7f2d180c26e0 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1d127640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d180aac30 0x7f2d180c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42274/0 (socket says 172.21.15.81:42274) 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1d127640 1 -- 172.21.15.81:0/3621411081 learned_addr learned my addr 172.21.15.81:0/3621411081 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 --2- 172.21.15.81:0/3621411081 >> v2:172.21.15.117:3300/0 conn(0x7f2d180c26e0 0x7f2d181555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969855139 0 0) 0x7f2d18155140 con 0x7f2d180aac30 2024-05-08T20:37:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d08003530 con 0x7f2d180aac30 2024-05-08T20:37:38.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350452489 0 0) 0x7f2d08003530 con 0x7f2d180aac30 2024-05-08T20:37:38.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 >> v2:172.21.15.117:3300/0 conn(0x7f2d180c26e0 msgr2=0x7f2d181555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:38.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 --2- 172.21.15.81:0/3621411081 >> v2:172.21.15.117:3300/0 conn(0x7f2d180c26e0 0x7f2d181555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 >> v1:172.21.15.117:6789/0 conn(0x7f2d18152220 legacy=0x7f2d180c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18072650 con 0x7f2d180aac30 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2d10001a00 con 0x7f2d180aac30 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 >> v1:172.21.15.81:6789/0 conn(0x7f2d180aac30 legacy=0x7f2d180c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08003980 0x7f2d08003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 0x7f2d08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d080050f0 0x7f2d0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0800c000 con 0x7f2d08004380 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0800c170 con 0x7f2d080050f0 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0800c330 con 0x7f2d08003980 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1c926640 1 -- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08003980 msgr2=0x7f2d08003d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1c926640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08003980 0x7f2d08003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 0x7f2d08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1d127640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d080050f0 0x7f2d0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 -- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08003980 msgr2=0x7f2d08003d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08003980 0x7f2d08003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 -- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d080050f0 msgr2=0x7f2d0800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d080050f0 0x7f2d0800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d17fff640 1 -- 172.21.15.81:0/3621411081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08003530 con 0x7f2d08004380 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1d127640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d080050f0 0x7f2d0800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:37:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.774+0000 7f2d1d127640 1 -- 172.21.15.81:0/3621411081 reap_dead start 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d17fff640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 0x7f2d08004850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ae0 tx=0x7f2d0c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3c977deb0d194a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0a5660 con 0x7f2d08004380 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0a57c0 con 0x7f2d08004380 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d177fe640 1 -- 172.21.15.81:0/3621411081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0a5b70 con 0x7f2d08004380 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 msgr2=0x7f2d08004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 0x7f2d08004850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ae0 tx=0x7f2d0c01ca70 comp rx=0 tx=0).stop 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/3621411081 shutdown_connections 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/3621411081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d08004380 0x7f2d08004850 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/3621411081 >> 172.21.15.81:0/3621411081 conn(0x7f2d180c4cc0 msgr2=0x7f2d180c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/3621411081 shutdown_connections 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.778+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/3621411081 wait complete. 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 Processor -- start 2024-05-08T20:37:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- start start 2024-05-08T20:37:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08004380 0x7f2d18149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180ad5d0 0x7f2d18156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 0x7f2d18146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181ee630 con 0x7f2d18156790 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18157ad0 con 0x7f2d180ad5d0 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18146d10 con 0x7f2d08004380 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1c926640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08004380 msgr2=0x7f2d18149910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1c926640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08004380 0x7f2d18149910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 0x7f2d18146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 0x7f2d18146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57190/0 (socket says 172.21.15.81:57190) 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 learned_addr learned my addr 172.21.15.81:0/2942978853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d17fff640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180ad5d0 0x7f2d18156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08004380 msgr2=0x7f2d18149910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d08004380 0x7f2d18149910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180ad5d0 msgr2=0x7f2d18156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180ad5d0 0x7f2d18156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d181ee250 con 0x7f2d18156790 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d17fff640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180ad5d0 0x7f2d18156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1d127640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 0x7f2d18146020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d180abd50 tx=0x7f2d1000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100020b0 con 0x7f2d18156790 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1000bb20 con 0x7f2d18156790 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d181519c0 con 0x7f2d18156790 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1000bed0 con 0x7f2d18156790 2024-05-08T20:37:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18150d30 con 0x7f2d18156790 2024-05-08T20:37:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 0x7f2d18146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.782+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18073ea0 con 0x7f2d18146e80 2024-05-08T20:37:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d1c926640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 0x7f2d18146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d10007070 con 0x7f2d18156790 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2cfc066640 0x7f2cfc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d1c926640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d18154dd0 con 0x7f2d18146e80 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d17fff640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2cfc066640 0x7f2cfc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2d10084300 con 0x7f2d18156790 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d1c926640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 0x7f2d18146560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d04001120 tx=0x7f2d0400c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d17fff640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2cfc066640 0x7f2cfc068b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0af000 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04004020 con 0x7f2d18146e80 2024-05-08T20:37:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2d04004180 con 0x7f2d18146e80 2024-05-08T20:37:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 msgr2=0x7f2d18146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 0x7f2d18146560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d04001120 tx=0x7f2d0400c430 comp rx=0 tx=0).stop 2024-05-08T20:37:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 msgr2=0x7f2d18146560 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.786+0000 7f2d157fa640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d18146e80 0x7f2d18146560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.794+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 0x7f2d1814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.794+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18154af0 con 0x7f2d1814fa50 2024-05-08T20:37:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1c926640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 0x7f2d1814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1c926640 1 -- 172.21.15.81:0/2942978853 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2d18158e60 con 0x7f2d1814fa50 2024-05-08T20:37:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1c926640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 0x7f2d1814fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2d04016000 tx=0x7f2d04001a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04022070 con 0x7f2d1814fa50 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4794 (secure 0 0 0) 0x7f2d0401c720 con 0x7f2d1814fa50 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 msgr2=0x7f2d1814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 0x7f2d1814fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2d04016000 tx=0x7f2d04001a80 comp rx=0 tx=0).stop 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 msgr2=0x7f2d1814fe60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d157fa640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1814fa50 0x7f2d1814fe60 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2d04016000 tx=0x7f2d04001a80 comp rx=0 tx=0).stop 2024-05-08T20:37:38.804 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 88, 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:37:38.805 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.806 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.807 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:37:38.808 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:37:38.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.812 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:37:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:37:38.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:37:38.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:37:38.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:37:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2cfc066640 msgr2=0x7f2cfc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2cfc066640 0x7f2cfc068b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0af000 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2024-05-08T20:37:38.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 msgr2=0x7f2d18146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 --2- 172.21.15.81:0/2942978853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18156790 0x7f2d18146020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d180abd50 tx=0x7f2d1000b4a0 comp rx=0 tx=0).stop 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 reap_dead start 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1d127640 1 -- 172.21.15.81:0/2942978853 reap_dead start 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 shutdown_connections 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.798+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 >> 172.21.15.81:0/2942978853 conn(0x7f2d180c4cc0 msgr2=0x7f2d18071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.802+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 shutdown_connections 2024-05-08T20:37:38.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:38.802+0000 7f2d1eb8a640 1 -- 172.21.15.81:0/2942978853 wait complete. 2024-05-08T20:37:38.823 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:37:38.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:37:51.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:37:51.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:37:58.824 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:37:58.824 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:37:58.824 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:37:58.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:37:58.827 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:37:58.827 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:37:58.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:37:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.974+0000 7fe1daa43640 1 Processor -- start 2024-05-08T20:37:58.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.974+0000 7fe1daa43640 1 -- start start 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1daa43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1daa43640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1d4155690 0x7fe1d40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1daa43640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d41522e0 con 0x7fe1d4151f00 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1daa43640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d406bb20 con 0x7fe1d4155690 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1daa43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41548e0 con 0x7fe1d4154cf0 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe1d4151f00 0x7fe1d41588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59346/0 (socket says 172.21.15.81:59346) 2024-05-08T20:37:58.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d3fff640 1 -- 172.21.15.81:0/1035465793 learned_addr learned my addr 172.21.15.81:0/1035465793 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d8fe0640 1 --2- 172.21.15.81:0/1035465793 >> v2:172.21.15.117:3300/0 conn(0x7fe1d4155690 0x7fe1d40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d37fe640 1 -- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d37fe640 1 -- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d2ffd640 1 -- 172.21.15.81:0/1035465793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032805525 0 0) 0x7fe1d41522e0 con 0x7fe1d4151f00 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d2ffd640 1 -- 172.21.15.81:0/1035465793 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1bc003530 con 0x7fe1d4151f00 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d8fe0640 1 -- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d4155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d8fe0640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d8fe0640 1 -- 172.21.15.81:0/1035465793 >> v1:172.21.15.81:6789/0 conn(0x7fe1d4151f00 legacy=0x7fe1d41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:58.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.978+0000 7fe1d8fe0640 1 -- 172.21.15.81:0/1035465793 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40c5f80 con 0x7fe1d4155690 2024-05-08T20:37:58.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1d8fe0640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4155690 0x7fe1d40ca000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cd8e96fb6536fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:58.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1d2ffd640 1 -- 172.21.15.81:0/1035465793 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0a5890 con 0x7fe1d4155690 2024-05-08T20:37:58.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1d2ffd640 1 -- 172.21.15.81:0/1035465793 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0a59f0 con 0x7fe1d4155690 2024-05-08T20:37:58.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1d2ffd640 1 -- 172.21.15.81:0/1035465793 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0a5d80 con 0x7fe1d4155690 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4155690 msgr2=0x7fe1d40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4155690 0x7fe1d40ca000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc01c830 comp rx=0 tx=0).stop 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- 172.21.15.81:0/1035465793 shutdown_connections 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d4155690 0x7fe1d40ca000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- 172.21.15.81:0/1035465793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d4155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- 172.21.15.81:0/1035465793 >> 172.21.15.81:0/1035465793 conn(0x7fe1d40715f0 msgr2=0x7fe1d4071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- 172.21.15.81:0/1035465793 shutdown_connections 2024-05-08T20:37:58.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- 172.21.15.81:0/1035465793 wait complete. 2024-05-08T20:37:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 Processor -- start 2024-05-08T20:37:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- start start 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40af4a0 0x7fe1d41476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41f13d0 con 0x7fe1d4151f00 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40c8b50 con 0x7fe1d40af4a0 2024-05-08T20:37:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.982+0000 7fe1daa43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d414e830 con 0x7fe1d4154cf0 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45042/0 (socket says 172.21.15.81:45042) 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 -- 172.21.15.81:0/2562086824 learned_addr learned my addr 172.21.15.81:0/2562086824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d8fe0640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40af4a0 0x7fe1d41476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:37:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 msgr2=0x7fe1d40ae340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40af4a0 msgr2=0x7fe1d41476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40af4a0 0x7fe1d41476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 -- 172.21.15.81:0/2562086824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009a70 con 0x7fe1d4151f00 2024-05-08T20:37:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d3fff640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c420 tx=0x7fe1c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4005cf0 con 0x7fe1d4151f00 2024-05-08T20:37:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4005e50 con 0x7fe1d4151f00 2024-05-08T20:37:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d41510f0 con 0x7fe1d4151f00 2024-05-08T20:37:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40072d0 con 0x7fe1d4151f00 2024-05-08T20:37:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d41516b0 con 0x7fe1d4151f00 2024-05-08T20:37:58.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d40675e0 con 0x7fe1d4151f00 2024-05-08T20:37:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1c4007430 con 0x7fe1d4151f00 2024-05-08T20:37:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 0x7fe1c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:37:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe1c4083990 con 0x7fe1d4151f00 2024-05-08T20:37:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 0x7fe1c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:37:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.986+0000 7fe1d37fe640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 0x7fe1c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8006aa0 tx=0x7fe1c8006a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:37:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:58.990+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe1c4050aa0 con 0x7fe1d4151f00 2024-05-08T20:37:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe1d4074950 con 0x7fe1d4151f00 2024-05-08T20:37:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1d0ff9640 1 -- 172.21.15.81:0/2562086824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fe1c4017080 con 0x7fe1d4151f00 2024-05-08T20:37:59.246 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":88,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 msgr2=0x7fe1c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 0x7fe1c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8006aa0 tx=0x7fe1c8006a30 comp rx=0 tx=0).stop 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 msgr2=0x7fe1d41f0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c420 tx=0x7fe1c400c8e0 comp rx=0 tx=0).stop 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 shutdown_connections 2024-05-08T20:37:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1c0066690 0x7fe1c0068b50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1d40af4a0 0x7fe1d41476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1d4154cf0 0x7fe1d40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 --2- 172.21.15.81:0/2562086824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1d4151f00 0x7fe1d41f0e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 >> 172.21.15.81:0/2562086824 conn(0x7fe1d40715f0 msgr2=0x7fe1d4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 shutdown_connections 2024-05-08T20:37:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:37:59.242+0000 7fe1daa43640 1 -- 172.21.15.81:0/2562086824 wait complete. 2024-05-08T20:38:02.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:02.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 Processor -- start 2024-05-08T20:38:02.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 -- start start 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4300c30d0 0x7fd4300c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300c2bc0 0x7fd4300c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd430155e10 con 0x7fd4300a94b0 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43006e790 con 0x7fd4300c30d0 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd435524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43006f460 con 0x7fd4300c2bc0 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4300c30d0 0x7fd4300c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd4300c30d0 0x7fd4300c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45050/0 (socket says 172.21.15.81:45050) 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 -- 172.21.15.81:0/2046484844 learned_addr learned my addr 172.21.15.81:0/2046484844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42f7fe640 1 --1- 172.21.15.81:0/2046484844 >> v1:172.21.15.81:6789/0 conn(0x7fd4300a94b0 0x7fd4300a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59350/0 (socket says 172.21.15.81:59350) 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42e7fc640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300c2bc0 0x7fd4300c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 -- 172.21.15.81:0/2046484844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300c2bc0 msgr2=0x7fd4300c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:02.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300c2bc0 0x7fd4300c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 -- 172.21.15.81:0/2046484844 >> v1:172.21.15.81:6789/0 conn(0x7fd4300a94b0 legacy=0x7fd4300a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:02.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42effd640 1 -- 172.21.15.81:0/2046484844 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430156080 con 0x7fd4300c30d0 2024-05-08T20:38:02.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.410+0000 7fd42dffb640 1 -- 172.21.15.81:0/2046484844 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400539523 0 0) 0x7fd430155e10 con 0x7fd4300a94b0 2024-05-08T20:38:02.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd42effd640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c30d0 0x7fd4300c34b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098a0 tx=0x7fd42001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71259393ef632116 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:02.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd42dffb640 1 -- 172.21.15.81:0/2046484844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200ab680 con 0x7fd4300c30d0 2024-05-08T20:38:02.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd42dffb640 1 -- 172.21.15.81:0/2046484844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4200ab7e0 con 0x7fd4300c30d0 2024-05-08T20:38:02.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd42dffb640 1 -- 172.21.15.81:0/2046484844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200abb70 con 0x7fd4300c30d0 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 -- 172.21.15.81:0/2046484844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c30d0 msgr2=0x7fd4300c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c30d0 0x7fd4300c34b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098a0 tx=0x7fd42001c480 comp rx=0 tx=0).stop 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 -- 172.21.15.81:0/2046484844 shutdown_connections 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300c2bc0 0x7fd4300c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 --2- 172.21.15.81:0/2046484844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c30d0 0x7fd4300c34b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 -- 172.21.15.81:0/2046484844 >> 172.21.15.81:0/2046484844 conn(0x7fd4300c4cc0 msgr2=0x7fd4300c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 -- 172.21.15.81:0/2046484844 shutdown_connections 2024-05-08T20:38:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.414+0000 7fd435524640 1 -- 172.21.15.81:0/2046484844 wait complete. 2024-05-08T20:38:02.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 Processor -- start 2024-05-08T20:38:02.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- start start 2024-05-08T20:38:02.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4300c30d0 0x7fd430145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300ade10 con 0x7fd4300c2bc0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301eec60 con 0x7fd4300c30d0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301eef40 con 0x7fd4300a94b0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45054/0 (socket says 172.21.15.81:45054) 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 -- 172.21.15.81:0/2972633583 learned_addr learned my addr 172.21.15.81:0/2972633583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42effd640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42f7fe640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4300c30d0 0x7fd430145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42effd640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 msgr2=0x7fd43015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42effd640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 msgr2=0x7fd43015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42effd640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42effd640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 msgr2=0x7fd43015c590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4300c30d0 msgr2=0x7fd430145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4300c30d0 0x7fd430145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 -- 172.21.15.81:0/2972633583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200094d0 con 0x7fd4300c2bc0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd42e7fc640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd42400d800 tx=0x7fd42400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400b6c0 con 0x7fd4300c2bc0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400b820 con 0x7fd4300c2bc0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd430150370 con 0x7fd4300c2bc0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400bb90 con 0x7fd4300c2bc0 2024-05-08T20:38:02.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd430152340 con 0x7fd4300c2bc0 2024-05-08T20:38:02.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.418+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430074950 con 0x7fd4300c2bc0 2024-05-08T20:38:02.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.422+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd42400bcf0 con 0x7fd4300c2bc0 2024-05-08T20:38:02.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.422+0000 7fd4177fe640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 0x7fd41c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:02.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.422+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd424084a30 con 0x7fd4300c2bc0 2024-05-08T20:38:02.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.422+0000 7fd42effd640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 0x7fd41c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:02.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.422+0000 7fd42effd640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 0x7fd41c068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd4200af000 tx=0x7fd4200a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:02.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.426+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd424051a90 con 0x7fd4300c2bc0 2024-05-08T20:38:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd43014ef40 con 0x7fd4300c2bc0 2024-05-08T20:38:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd4177fe640 1 -- 172.21.15.81:0/2972633583 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fd424011340 con 0x7fd4300c2bc0 2024-05-08T20:38:02.702 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":88,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 msgr2=0x7fd41c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 0x7fd41c068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd4200af000 tx=0x7fd4200a7000 comp rx=0 tx=0).stop 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 msgr2=0x7fd43015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd42400d800 tx=0x7fd42400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 shutdown_connections 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd41c066690 0x7fd41c068b50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4300c30d0 0x7fd430145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4300c2bc0 0x7fd43015cad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 --2- 172.21.15.81:0/2972633583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4300a94b0 0x7fd43015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 >> 172.21.15.81:0/2972633583 conn(0x7fd4300c4cc0 msgr2=0x7fd4300c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 shutdown_connections 2024-05-08T20:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:02.698+0000 7fd435524640 1 -- 172.21.15.81:0/2972633583 wait complete. 2024-05-08T20:38:05.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 Processor -- start 2024-05-08T20:38:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 -- start start 2024-05-08T20:38:05.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2740151f00 0x7f27401588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2740158e20 con 0x7f2740155690 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274006bb20 con 0x7f2740151f00 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f274742e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27401548e0 con 0x7f2740154cf0 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2740151f00 0x7f27401588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2740151f00 0x7f27401588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:49558/0 (socket says 172.21.15.81:49558) 2024-05-08T20:38:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 -- 172.21.15.81:0/2873804606 learned_addr learned my addr 172.21.15.81:0/2873804606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27449c9640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27459cb640 1 --1- 172.21.15.81:0/2873804606 >> v1:172.21.15.117:6789/0 conn(0x7f2740155690 0x7f27400ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:43286/0 (socket says 172.21.15.81:43286) 2024-05-08T20:38:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27449c9640 1 -- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 msgr2=0x7f2740155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:38:05.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27449c9640 1 -- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 msgr2=0x7f2740155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27449c9640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27449c9640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 -- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 msgr2=0x7f2740155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 -- 172.21.15.81:0/2873804606 >> v1:172.21.15.117:6789/0 conn(0x7f2740155690 legacy=0x7f27400ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:05.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.850+0000 7f27451ca640 1 -- 172.21.15.81:0/2873804606 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27401522e0 con 0x7f2740151f00 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f27451ca640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740151f00 0x7f27401588e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f273c0098a0 tx=0x7f273c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce7112a18976a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f2737fff640 1 -- 172.21.15.81:0/2873804606 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0ab640 con 0x7f2740151f00 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f2737fff640 1 -- 172.21.15.81:0/2873804606 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c0a7070 con 0x7f2740151f00 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f2737fff640 1 -- 172.21.15.81:0/2873804606 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0ab9c0 con 0x7f2740151f00 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 -- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740151f00 msgr2=0x7f27401588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740151f00 0x7f27401588e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f273c0098a0 tx=0x7f273c01c420 comp rx=0 tx=0).stop 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 -- 172.21.15.81:0/2873804606 shutdown_connections 2024-05-08T20:38:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740154cf0 0x7f2740155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 --2- 172.21.15.81:0/2873804606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740151f00 0x7f27401588e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 -- 172.21.15.81:0/2873804606 >> 172.21.15.81:0/2873804606 conn(0x7f27400715f0 msgr2=0x7f2740071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 -- 172.21.15.81:0/2873804606 shutdown_connections 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.854+0000 7f274742e640 1 -- 172.21.15.81:0/2873804606 wait complete. 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 Processor -- start 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- start start 2024-05-08T20:38:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 0x7f27401f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27401f1720 con 0x7f2740151f00 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400ae000 con 0x7f2740154cf0 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27401f1990 con 0x7f2740148b40 2024-05-08T20:38:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45058/0 (socket says 172.21.15.81:45058) 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 -- 172.21.15.81:0/3183483056 learned_addr learned my addr 172.21.15.81:0/3183483056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27459cb640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27449c9640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 0x7f27401f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27459cb640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 msgr2=0x7f2740156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:38:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 msgr2=0x7f2740156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27459cb640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 msgr2=0x7f2740156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27459cb640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27459cb640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 msgr2=0x7f27401f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 0x7f27401f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 -- 172.21.15.81:0/3183483056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0094d0 con 0x7f2740151f00 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27449c9640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 0x7f27401f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f27451ca640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f273c01ccc0 tx=0x7f273c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0be3f0 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c0be550 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27400ada40 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0be900 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27400af150 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.858+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2740156290 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.862+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f273c0c7440 con 0x7f2740151f00 2024-05-08T20:38:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.862+0000 7f2735ffb640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 0x7f2724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.862+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f273c11ed00 con 0x7f2740151f00 2024-05-08T20:38:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.862+0000 7f27449c9640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 0x7f2724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.862+0000 7f27449c9640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 0x7f2724068b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2730006aa0 tx=0x7f2730006a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:05.866+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2740156290 con 0x7f2740151f00 2024-05-08T20:38:06.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.114+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2740156290 con 0x7f2740151f00 2024-05-08T20:38:06.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.114+0000 7f2735ffb640 1 -- 172.21.15.81:0/3183483056 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f273c0ebe80 con 0x7f2740151f00 2024-05-08T20:38:06.119 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 msgr2=0x7f2724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 0x7f2724068b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2730006aa0 tx=0x7f2730006a30 comp rx=0 tx=0).stop 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 msgr2=0x7f27401f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f273c01ccc0 tx=0x7f273c01ac60 comp rx=0 tx=0).stop 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 shutdown_connections 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2724066690 0x7f2724068b50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2740148b40 0x7f2740156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2740154cf0 0x7f27401f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 --2- 172.21.15.81:0/3183483056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2740151f00 0x7f27401f0ca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 >> 172.21.15.81:0/3183483056 conn(0x7f27400715f0 msgr2=0x7f27400719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 shutdown_connections 2024-05-08T20:38:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.118+0000 7f274742e640 1 -- 172.21.15.81:0/3183483056 wait complete. 2024-05-08T20:38:06.139 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:38:06.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:38:06.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:38:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.258+0000 7f06a79f0640 1 Processor -- start 2024-05-08T20:38:06.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.258+0000 7f06a79f0640 1 -- start start 2024-05-08T20:38:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a79f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06a00aac30 0x7f06a01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a79f0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a0155140 con 0x7f06a00c26e0 2024-05-08T20:38:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a79f0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a00c32d0 con 0x7f06a0152220 2024-05-08T20:38:06.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a79f0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a00c4780 con 0x7f06a00aac30 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06a00aac30 0x7f06a01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06a00aac30 0x7f06a01555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45070/0 (socket says 172.21.15.81:45070) 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2588975982 learned_addr learned my addr 172.21.15.81:0/2588975982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2588975982 >> v1:172.21.15.117:6789/0 conn(0x7f06a0152220 legacy=0x7f06a00c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2588975982 >> v1:172.21.15.81:6789/0 conn(0x7f06a00c26e0 legacy=0x7f06a00c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2588975982 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0072650 con 0x7f06a00aac30 2024-05-08T20:38:06.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f06a5f8d640 1 --2- 172.21.15.81:0/2588975982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00aac30 0x7f06a01555d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0698009e50 tx=0x7f069801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5420ec792a87a2de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f0697fff640 1 -- 172.21.15.81:0/2588975982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980a5830 con 0x7f06a00aac30 2024-05-08T20:38:06.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f0697fff640 1 -- 172.21.15.81:0/2588975982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06980a5990 con 0x7f06a00aac30 2024-05-08T20:38:06.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.262+0000 7f0697fff640 1 -- 172.21.15.81:0/2588975982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980a5d20 con 0x7f06a00aac30 2024-05-08T20:38:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2588975982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00aac30 msgr2=0x7f06a01555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2588975982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00aac30 0x7f06a01555d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0698009e50 tx=0x7f069801c970 comp rx=0 tx=0).stop 2024-05-08T20:38:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2588975982 shutdown_connections 2024-05-08T20:38:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2588975982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00aac30 0x7f06a01555d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2588975982 >> 172.21.15.81:0/2588975982 conn(0x7f06a00c4cc0 msgr2=0x7f06a00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2588975982 shutdown_connections 2024-05-08T20:38:06.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2588975982 wait complete. 2024-05-08T20:38:06.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 Processor -- start 2024-05-08T20:38:06.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- start start 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06a00aac30 0x7f06a0150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 0x7f06a00c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06a0152220 0x7f06a00c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00c7180 con 0x7f06a00c26e0 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00c6830 con 0x7f06a00aac30 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0157f20 con 0x7f06a0152220 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 0x7f06a00c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 0x7f06a00c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45078/0 (socket says 172.21.15.81:45078) 2024-05-08T20:38:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 -- 172.21.15.81:0/2076721234 learned_addr learned my addr 172.21.15.81:0/2076721234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a578c640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06a00aac30 0x7f06a0150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a5f8d640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06a0152220 0x7f06a00c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06a0152220 msgr2=0x7f06a00c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06a0152220 0x7f06a00c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06a00aac30 msgr2=0x7f06a0150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06a00aac30 0x7f06a0150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698009b30 con 0x7f06a00c26e0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a4f8b640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 0x7f06a00c5db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f069000c500 tx=0x7f069000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690005220 con 0x7f06a00c26e0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690005380 con 0x7f06a00c26e0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a0157c40 con 0x7f06a00c26e0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.266+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690007270 con 0x7f06a00c26e0 2024-05-08T20:38:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01f0a50 con 0x7f06a00c26e0 2024-05-08T20:38:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 0x7f06a01f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0073ea0 con 0x7f06a0158380 2024-05-08T20:38:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a578c640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 0x7f06a01f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a578c640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06a0158e60 con 0x7f06a0158380 2024-05-08T20:38:06.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a578c640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 0x7f06a01f0c70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c00e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0052e0 con 0x7f06a0158380 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06900073d0 con 0x7f06a00c26e0 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0684066730 0x7f0684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0690083890 con 0x7f06a00c26e0 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a5f8d640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0684066730 0x7f0684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f069c005440 con 0x7f06a0158380 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 msgr2=0x7f06a01f0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 0x7f06a01f0c70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c00e960 comp rx=0 tx=0).stop 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 msgr2=0x7f06a01f0c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:06.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f0695ffb640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a0158380 0x7f06a01f0c70 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c00e960 comp rx=0 tx=0).stop 2024-05-08T20:38:06.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.270+0000 7f06a5f8d640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0684066730 0x7f0684068bf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06980ae000 tx=0x7f06980a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 0x7f06a0145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0074950 con 0x7f06a00c7a50 2024-05-08T20:38:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a578c640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 0x7f06a0145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a578c640 1 -- 172.21.15.81:0/2076721234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f06a0160150 con 0x7f06a00c7a50 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a578c640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 0x7f06a0145840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0038d0 con 0x7f06a00c7a50 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f069c003a30 con 0x7f06a00c7a50 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 msgr2=0x7f06a0145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 0x7f06a0145840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c001130 comp rx=0 tx=0).stop 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 msgr2=0x7f06a0145840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:06.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f0695ffb640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c7a50 0x7f06a0145840 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f069c000f70 tx=0x7f069c001130 comp rx=0 tx=0).stop 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:06.285 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.287 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.288 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.290 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:06.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.293 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:06.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.295 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:06.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.298 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:38:06.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:06.300 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0684066730 msgr2=0x7f0684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0684066730 0x7f0684068bf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06980ae000 tx=0x7f06980a7070 comp rx=0 tx=0).stop 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 msgr2=0x7f06a00c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 --2- 172.21.15.81:0/2076721234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a00c26e0 0x7f06a00c5db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f069000c500 tx=0x7f069000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2076721234 reap_dead start 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a5f8d640 1 -- 172.21.15.81:0/2076721234 reap_dead start 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 shutdown_connections 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 >> 172.21.15.81:0/2076721234 conn(0x7f06a00c4cc0 msgr2=0x7f06a00c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 shutdown_connections 2024-05-08T20:38:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.278+0000 7f06a79f0640 1 -- 172.21.15.81:0/2076721234 wait complete. 2024-05-08T20:38:06.303 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:06.303 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:38:06.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:38:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 Processor -- start 2024-05-08T20:38:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 -- start start 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b3414fe70 0x7f1b3406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b34155e90 0x7f1b34069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b34152ab0 con 0x7f1b3406d7d0 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b341528a0 con 0x7f1b34155e90 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b3972c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b34152d90 con 0x7f1b3414fe70 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b34155e90 0x7f1b34069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b34155e90 0x7f1b34069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45108/0 (socket says 172.21.15.81:45108) 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 -- 172.21.15.81:0/2587977405 learned_addr learned my addr 172.21.15.81:0/2587977405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2587977405 >> v2:172.21.15.117:3300/0 conn(0x7f1b3414fe70 0x7f1b3406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 -- 172.21.15.81:0/2587977405 >> v2:172.21.15.117:3300/0 conn(0x7f1b3414fe70 msgr2=0x7f1b3406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/2587977405 >> v2:172.21.15.117:3300/0 conn(0x7f1b3414fe70 0x7f1b3406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 -- 172.21.15.81:0/2587977405 >> v1:172.21.15.117:6789/0 conn(0x7f1b3406d7d0 legacy=0x7f1b3406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:06.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.418+0000 7f1b2bfff640 1 -- 172.21.15.81:0/2587977405 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34153070 con 0x7f1b34155e90 2024-05-08T20:38:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/2587977405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34069fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b34073fc0 tx=0x7f1b2401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dc6f4732ae776 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b327fc640 1 -- 172.21.15.81:0/2587977405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240ad640 con 0x7f1b34155e90 2024-05-08T20:38:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b327fc640 1 -- 172.21.15.81:0/2587977405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b240ad7a0 con 0x7f1b34155e90 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b327fc640 1 -- 172.21.15.81:0/2587977405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240adb30 con 0x7f1b34155e90 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- 172.21.15.81:0/2587977405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 msgr2=0x7f1b34069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2587977405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34069fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b34073fc0 tx=0x7f1b2401c390 comp rx=0 tx=0).stop 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- 172.21.15.81:0/2587977405 shutdown_connections 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2587977405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34069fc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2587977405 >> v2:172.21.15.117:3300/0 conn(0x7f1b3414fe70 0x7f1b3406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- 172.21.15.81:0/2587977405 >> 172.21.15.81:0/2587977405 conn(0x7f1b340c71b0 msgr2=0x7f1b340c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- 172.21.15.81:0/2587977405 shutdown_connections 2024-05-08T20:38:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- 172.21.15.81:0/2587977405 wait complete. 2024-05-08T20:38:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 Processor -- start 2024-05-08T20:38:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.422+0000 7f1b3972c640 1 -- start start 2024-05-08T20:38:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3406d7d0 0x7f1b34148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b3414fe70 0x7f1b340c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414dcb0 con 0x7f1b34155e90 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414d9d0 con 0x7f1b3406d7d0 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414e6b0 con 0x7f1b3414fe70 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45112/0 (socket says 172.21.15.81:45112) 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 learned_addr learned my addr 172.21.15.81:0/2968762514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3406d7d0 0x7f1b34148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b3414fe70 0x7f1b340c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b3414fe70 msgr2=0x7f1b340c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b3414fe70 0x7f1b340c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3406d7d0 msgr2=0x7f1b34148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3406d7d0 0x7f1b34148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240094d0 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3406d7d0 0x7f1b34148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b337fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34149f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b970 tx=0x7f1b2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00cb40 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00cca0 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3414e990 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c014680 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b340c6d40 con 0x7f1b34155e90 2024-05-08T20:38:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 0x7f1b3414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34069550 con 0x7f1b3414c010 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 0x7f1b3414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b2c01d3b0 con 0x7f1b34155e90 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b32ffd640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b3415cbd0 con 0x7f1b3414c010 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b14066690 0x7f1b14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b14066690 0x7f1b14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1b2c0843d0 con 0x7f1b34155e90 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 0x7f1b3414a4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007fd0 tx=0x7f1b1c00f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c004230 con 0x7f1b3414c010 2024-05-08T20:38:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.426+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b14066690 0x7f1b14068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1b240af000 tx=0x7f1b24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.430+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1b1c004390 con 0x7f1b3414c010 2024-05-08T20:38:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.430+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 msgr2=0x7f1b3414a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.430+0000 7f1b2b7fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 0x7f1b3414a4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007fd0 tx=0x7f1b1c00f9e0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.430+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 msgr2=0x7f1b3414a4b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.430+0000 7f1b2b7fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414c010 0x7f1b3414a4b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 0x7f1b341ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34150250 con 0x7f1b3414a9f0 2024-05-08T20:38:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 0x7f1b341ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b32ffd640 1 -- 172.21.15.81:0/2968762514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1b3414e510 con 0x7f1b3414a9f0 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b32ffd640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 0x7f1b341ee8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007fd0 tx=0x7f1b1c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.434+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c003840 con 0x7f1b3414a9f0 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f1b1c0039a0 con 0x7f1b3414a9f0 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 msgr2=0x7f1b341ee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b2b7fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 0x7f1b341ee8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c007fd0 tx=0x7f1b1c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b2b7fe640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 msgr2=0x7f1b341ee8d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b2b7fe640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b3414a9f0 0x7f1b341ee8d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:06.445 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:06.446 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.448 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:06.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.452 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.453 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:06.454 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:06.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b14066690 msgr2=0x7f1b14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b14066690 0x7f1b14068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1b240af000 tx=0x7f1b24008040 comp rx=0 tx=0).stop 2024-05-08T20:38:06.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 msgr2=0x7f1b34149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 --2- 172.21.15.81:0/2968762514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b34155e90 0x7f1b34149f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00b970 tx=0x7f1b2c00be30 comp rx=0 tx=0).stop 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 reap_dead start 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b337fe640 1 -- 172.21.15.81:0/2968762514 reap_dead start 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 shutdown_connections 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 >> 172.21.15.81:0/2968762514 conn(0x7f1b340c71b0 msgr2=0x7f1b340c2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 shutdown_connections 2024-05-08T20:38:06.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.438+0000 7f1b3972c640 1 -- 172.21.15.81:0/2968762514 wait complete. 2024-05-08T20:38:06.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:06.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:38:06.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:38:06.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 Processor -- start 2024-05-08T20:38:06.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 -- start start 2024-05-08T20:38:06.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1da4152220 0x7f1da41555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da4155140 con 0x7f1da40aac30 2024-05-08T20:38:06.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40c32d0 con 0x7f1da40c26e0 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1dab90a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da40c4780 con 0x7f1da4152220 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1da40aac30 0x7f1da40c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59374/0 (socket says 172.21.15.81:59374) 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3232003729 learned_addr learned my addr 172.21.15.81:0/3232003729 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da96a6640 1 --2- 172.21.15.81:0/3232003729 >> v2:172.21.15.117:3300/0 conn(0x7f1da4152220 0x7f1da41555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902777527 0 0) 0x7f1da4155140 con 0x7f1da40aac30 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c003530 con 0x7f1da40aac30 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720291171 0 0) 0x7f1d8c003530 con 0x7f1da40aac30 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 >> v2:172.21.15.117:3300/0 conn(0x7f1da4152220 msgr2=0x7f1da41555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 --2- 172.21.15.81:0/3232003729 >> v2:172.21.15.117:3300/0 conn(0x7f1da4152220 0x7f1da41555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 >> v1:172.21.15.117:6789/0 conn(0x7f1da40c26e0 legacy=0x7f1da40c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4072650 con 0x7f1da40aac30 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1d9c001680 con 0x7f1da40aac30 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 >> v1:172.21.15.81:6789/0 conn(0x7f1da40aac30 legacy=0x7f1da40c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d8c003980 0x7f1d8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8c0047d0 0x7f1d8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1d8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c00c100 con 0x7f1d8c005190 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c00c270 con 0x7f1d8c003980 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c00c430 con 0x7f1d8c0047d0 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1d8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8c0047d0 0x7f1d8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da96a6640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d8c003980 0x7f1d8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8c0047d0 msgr2=0x7f1d8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8c0047d0 0x7f1d8c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d8c003980 msgr2=0x7f1d8c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:06.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d8c003980 0x7f1d8c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.570+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3232003729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c003530 con 0x7f1d8c005190 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3232003729 reap_dead start 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1d8c00b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c240 tx=0x7f1d9c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80d02ff5c4e6656 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c005ae0 con 0x7f1d8c005190 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0ab070 con 0x7f1d8c005190 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1da3fff640 1 -- 172.21.15.81:0/3232003729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007070 con 0x7f1d8c005190 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 -- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 msgr2=0x7f1d8c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1d8c00b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c240 tx=0x7f1d9c01f3d0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 -- 172.21.15.81:0/3232003729 shutdown_connections 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3232003729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1d8c00b990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 -- 172.21.15.81:0/3232003729 >> 172.21.15.81:0/3232003729 conn(0x7f1da40c4cc0 msgr2=0x7f1da40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 -- 172.21.15.81:0/3232003729 shutdown_connections 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 -- 172.21.15.81:0/3232003729 wait complete. 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.574+0000 7f1dab90a640 1 Processor -- start 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- start start 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1da41ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41573d0 0x7f1da41ede00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da40ad1d0 0x7f1da4155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da41ee340 con 0x7f1d8c005190 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4148640 con 0x7f1da40ad1d0 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4158380 con 0x7f1da41573d0 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1da41ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1da41ea940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45122/0 (socket says 172.21.15.81:45122) 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 -- 172.21.15.81:0/3023913277 learned_addr learned my addr 172.21.15.81:0/3023913277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41573d0 0x7f1da41ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da40ad1d0 0x7f1da4155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41573d0 msgr2=0x7f1da41ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41573d0 0x7f1da41ede00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da40ad1d0 msgr2=0x7f1da4155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da40ad1d0 0x7f1da4155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da41e9e80 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41573d0 0x7f1da41ede00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da40ad1d0 0x7f1da4155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da96a6640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1da41ea940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009fb0 tx=0x7f1d940115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400e030 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d94016470 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da4157920 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94016820 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da41ea140 con 0x7f1d8c005190 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4073ea0 con 0x7f1da41ea330 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d94016980 con 0x7f1d8c005190 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d900666c0 0x7f1d90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1d9400f070 con 0x7f1d8c005190 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.578+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d900666c0 0x7f1d90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.582+0000 7f1da9ea7640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d900666c0 0x7f1d90068b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c240 tx=0x7f1d9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:06.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.782+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:06.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.782+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:38:06.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.782+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:06.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.782+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:06.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:06.782+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:38:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.186+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.186+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:38:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.186+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.186+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.186+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:38:07.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.990+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:07.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.990+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:38:07.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.990+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:07.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.990+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:07.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:07.990+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:38:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1da40c2010 con 0x7f1da41ea330 2024-05-08T20:38:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c10 tx=0x7f1d980019d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980052e0 con 0x7f1da41ea330 2024-05-08T20:38:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1d9800d040 con 0x7f1da41ea330 2024-05-08T20:38:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c10 tx=0x7f1d980019d0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 msgr2=0x7f1da406c4e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.594+0000 7f1da1ffb640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da41ea330 0x7f1da406c4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.602+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 0x7f1da406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.602+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4158e60 con 0x7f1da406ca20 2024-05-08T20:38:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.602+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 0x7f1da406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da8ea5640 1 -- 172.21.15.81:0/3023913277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1da4154dd0 con 0x7f1da406ca20 2024-05-08T20:38:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da8ea5640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 0x7f1da406e3e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c10 tx=0x7f1d98001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98003be0 con 0x7f1da406ca20 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f1d98003d40 con 0x7f1da406ca20 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 msgr2=0x7f1da406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 0x7f1da406e3e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c10 tx=0x7f1d98001130 comp rx=0 tx=0).stop 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 msgr2=0x7f1da406e3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da1ffb640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da406ca20 0x7f1da406e3e0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d98000c10 tx=0x7f1d98001130 comp rx=0 tx=0).stop 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:09.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:09.612 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:09.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:09.614 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:09.617 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:09.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:09.621 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:09.622 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d900666c0 msgr2=0x7f1d90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d900666c0 0x7f1d90068b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c240 tx=0x7f1d9c009040 comp rx=0 tx=0).stop 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 msgr2=0x7f1da41ea940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 --2- 172.21.15.81:0/3023913277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d8c005190 0x7f1da41ea940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009fb0 tx=0x7f1d940115a0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3023913277 reap_dead start 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1da9ea7640 1 -- 172.21.15.81:0/3023913277 reap_dead start 2024-05-08T20:38:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 shutdown_connections 2024-05-08T20:38:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 >> 172.21.15.81:0/3023913277 conn(0x7f1da40c4cc0 msgr2=0x7f1da40a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 shutdown_connections 2024-05-08T20:38:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.606+0000 7f1dab90a640 1 -- 172.21.15.81:0/3023913277 wait complete. 2024-05-08T20:38:09.634 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:09.634 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:38:09.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:38:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 Processor -- start 2024-05-08T20:38:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 -- start start 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f816014fe70 0x7f816006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8160155e90 0x7f8160069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816006d7d0 0x7f816006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81601528a0 con 0x7f816006d7d0 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8160152ab0 con 0x7f816014fe70 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f816818b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8160152d90 con 0x7f8160155e90 2024-05-08T20:38:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816006d7d0 0x7f816006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816006d7d0 0x7f816006a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59224/0 (socket says 172.21.15.81:59224) 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 -- 172.21.15.81:0/1486104185 learned_addr learned my addr 172.21.15.81:0/1486104185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8165f27640 1 --2- 172.21.15.81:0/1486104185 >> v2:172.21.15.117:3300/0 conn(0x7f816014fe70 0x7f816006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8165726640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8160155e90 0x7f8160069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 -- 172.21.15.81:0/1486104185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8160155e90 msgr2=0x7f8160069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8160155e90 0x7f8160069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 -- 172.21.15.81:0/1486104185 >> v2:172.21.15.117:3300/0 conn(0x7f816014fe70 msgr2=0x7f816006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 --2- 172.21.15.81:0/1486104185 >> v2:172.21.15.117:3300/0 conn(0x7f816014fe70 0x7f816006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.758+0000 7f8166728640 1 -- 172.21.15.81:0/1486104185 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160153070 con 0x7f816006d7d0 2024-05-08T20:38:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f8166728640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816006d7d0 0x7f816006a500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8160073fc0 tx=0x7f815801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8025483f9ec1afd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f8164f25640 1 -- 172.21.15.81:0/1486104185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580a5720 con 0x7f816006d7d0 2024-05-08T20:38:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f8164f25640 1 -- 172.21.15.81:0/1486104185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81580a5880 con 0x7f816006d7d0 2024-05-08T20:38:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f8164f25640 1 -- 172.21.15.81:0/1486104185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580a5c10 con 0x7f816006d7d0 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- 172.21.15.81:0/1486104185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816006d7d0 msgr2=0x7f816006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816006d7d0 0x7f816006a500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8160073fc0 tx=0x7f815801c8a0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- 172.21.15.81:0/1486104185 shutdown_connections 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8160155e90 0x7f8160069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 --2- 172.21.15.81:0/1486104185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816006d7d0 0x7f816006a500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 --2- 172.21.15.81:0/1486104185 >> v2:172.21.15.117:3300/0 conn(0x7f816014fe70 0x7f816006d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- 172.21.15.81:0/1486104185 >> 172.21.15.81:0/1486104185 conn(0x7f81600c71b0 msgr2=0x7f81600c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- 172.21.15.81:0/1486104185 shutdown_connections 2024-05-08T20:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- 172.21.15.81:0/1486104185 wait complete. 2024-05-08T20:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 Processor -- start 2024-05-08T20:38:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.762+0000 7f816818b640 1 -- start start 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 0x7f81601eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f816014fe70 0x7f81601514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c56b0 con 0x7f8160155e90 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8160152230 con 0x7f816006d7d0 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81601eecf0 con 0x7f816014fe70 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59228/0 (socket says 172.21.15.81:59228) 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 -- 172.21.15.81:0/404226080 learned_addr learned my addr 172.21.15.81:0/404226080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8165f27640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 0x7f81601eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8165726640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f816014fe70 0x7f81601514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 -- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f816014fe70 msgr2=0x7f81601514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f816014fe70 0x7f81601514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 -- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 msgr2=0x7f81601eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 0x7f81601eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 -- 172.21.15.81:0/404226080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158009b30 con 0x7f8160155e90 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8165f27640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 0x7f81601eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f8166728640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f815801af50 tx=0x7f8158019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580b8670 con 0x7f8160155e90 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81580b87d0 con 0x7f8160155e90 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8160148fc0 con 0x7f8160155e90 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580b8b80 con 0x7f8160155e90 2024-05-08T20:38:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8160149580 con 0x7f8160155e90 2024-05-08T20:38:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600675e0 con 0x7f8160155e90 2024-05-08T20:38:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.766+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81580b8ce0 con 0x7f8160155e90 2024-05-08T20:38:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.770+0000 7f81567fc640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 0x7f8144068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.770+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f815811fba0 con 0x7f8160155e90 2024-05-08T20:38:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.770+0000 7f8165f27640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 0x7f8144068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.770+0000 7f8165f27640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 0x7f8144068b50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f81600acab0 tx=0x7f815c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:09.774+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f81580ecd20 con 0x7f8160155e90 2024-05-08T20:38:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.046+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f8160074950 con 0x7f8160155e90 2024-05-08T20:38:10.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.046+0000 7f81567fc640 1 -- 172.21.15.81:0/404226080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f81580bc020 con 0x7f8160155e90 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 msgr2=0x7f8144068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 0x7f8144068b50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f81600acab0 tx=0x7f815c008040 comp rx=0 tx=0).stop 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 msgr2=0x7f81601ef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f815801af50 tx=0x7f8158019640 comp rx=0 tx=0).stop 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 shutdown_connections 2024-05-08T20:38:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8144066690 0x7f8144068b50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8160155e90 0x7f81601ef180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f816014fe70 0x7f81601514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 --2- 172.21.15.81:0/404226080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f816006d7d0 0x7f81601eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 >> 172.21.15.81:0/404226080 conn(0x7f81600c71b0 msgr2=0x7f8160069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 shutdown_connections 2024-05-08T20:38:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:10.050+0000 7f816818b640 1 -- 172.21.15.81:0/404226080 wait complete. 2024-05-08T20:38:10.071 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:38:20.072 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:38:20.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 Processor -- start 2024-05-08T20:38:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 -- start start 2024-05-08T20:38:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c580c2570 0x7f5c58154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 0x7f5c581554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5806ab70 con 0x7f5c580c2570 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c58154b10 con 0x7f5c5806d7d0 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5e2cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58158080 con 0x7f5c58152340 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c4ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c580c2570 0x7f5c58154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c4ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5c580c2570 0x7f5c58154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39798/0 (socket says 172.21.15.81:39798) 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c4ffff640 1 -- 172.21.15.81:0/1831994331 learned_addr learned my addr 172.21.15.81:0/1831994331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c57fff640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.202+0000 7f5c5c868640 1 --2- 172.21.15.81:0/1831994331 >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 0x7f5c581554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 -- 172.21.15.81:0/1831994331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 msgr2=0x7f5c5806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 -- 172.21.15.81:0/1831994331 >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 msgr2=0x7f5c581554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1831994331 >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 0x7f5c581554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 -- 172.21.15.81:0/1831994331 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5806a890 con 0x7f5c580c2570 2024-05-08T20:38:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5c868640 1 --2- 172.21.15.81:0/1831994331 >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 0x7f5c581554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c57fff640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:38:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c580c2570 0x7f5c58154f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c580701a0 tx=0x7f5c4001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be64df14a7a07e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c577fe640 1 -- 172.21.15.81:0/1831994331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400ab620 con 0x7f5c580c2570 2024-05-08T20:38:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c577fe640 1 -- 172.21.15.81:0/1831994331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c400ab780 con 0x7f5c580c2570 2024-05-08T20:38:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c577fe640 1 -- 172.21.15.81:0/1831994331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400abb10 con 0x7f5c580c2570 2024-05-08T20:38:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1831994331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c580c2570 msgr2=0x7f5c58154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c580c2570 0x7f5c58154f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c580701a0 tx=0x7f5c4001c460 comp rx=0 tx=0).stop 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1831994331 shutdown_connections 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1831994331 >> v2:172.21.15.117:3300/0 conn(0x7f5c5806d7d0 0x7f5c581554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c580c2570 0x7f5c58154f60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1831994331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1831994331 >> 172.21.15.81:0/1831994331 conn(0x7f5c580c71b0 msgr2=0x7f5c580c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1831994331 shutdown_connections 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.206+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1831994331 wait complete. 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 Processor -- start 2024-05-08T20:38:20.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- start start 2024-05-08T20:38:20.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c580c2570 0x7f5c58148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581edb00 con 0x7f5c5806d7d0 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581ee340 con 0x7f5c580c2570 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c581f1a80 con 0x7f5c58152340 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39814/0 (socket says 172.21.15.81:39814) 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 -- 172.21.15.81:0/1990162371 learned_addr learned my addr 172.21.15.81:0/1990162371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c580c2570 0x7f5c58148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5c868640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 -- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 msgr2=0x7f5c5814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 -- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c580c2570 msgr2=0x7f5c58148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c580c2570 0x7f5c58148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 -- 172.21.15.81:0/1990162371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400094d0 con 0x7f5c5806d7d0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5c868640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c57fff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c7c0 tx=0x7f5c4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48007a30 con 0x7f5c5806d7d0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c48007b90 con 0x7f5c5806d7d0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c581f1d60 con 0x7f5c5806d7d0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800ce70 con 0x7f5c5806d7d0 2024-05-08T20:38:20.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c581edfd0 con 0x7f5c5806d7d0 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.210+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c580675e0 con 0x7f5c5806d7d0 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.214+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c480113f0 con 0x7f5c5806d7d0 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.214+0000 7f5c557fa640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 0x7f5c38068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.214+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5c48084920 con 0x7f5c5806d7d0 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.214+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 0x7f5c38068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.214+0000 7f5c4ffff640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 0x7f5c38068b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c400af000 tx=0x7f5c400b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.218+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5c480519a0 con 0x7f5c5806d7d0 2024-05-08T20:38:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5c58074950 con 0x7f5c5806d7d0 2024-05-08T20:38:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c557fa640 1 -- 172.21.15.81:0/1990162371 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f5c4801e080 con 0x7f5c5806d7d0 2024-05-08T20:38:20.462 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 msgr2=0x7f5c38068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 0x7f5c38068b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c400af000 tx=0x7f5c400b6040 comp rx=0 tx=0).stop 2024-05-08T20:38:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 msgr2=0x7f5c58070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800c7c0 tx=0x7f5c4800cc80 comp rx=0 tx=0).stop 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 shutdown_connections 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c380666c0 0x7f5c38068b80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c58152340 0x7f5c5814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c580c2570 0x7f5c58148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 --2- 172.21.15.81:0/1990162371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c5806d7d0 0x7f5c58070be0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 >> 172.21.15.81:0/1990162371 conn(0x7f5c580c71b0 msgr2=0x7f5c580c1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 shutdown_connections 2024-05-08T20:38:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.458+0000 7f5c5e2cb640 1 -- 172.21.15.81:0/1990162371 wait complete. 2024-05-08T20:38:20.480 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:38:20.480 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:38:20.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:38:20.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:38:20.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.606+0000 7fa0ea160640 1 Processor -- start 2024-05-08T20:38:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.606+0000 7fa0ea160640 1 -- start start 2024-05-08T20:38:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0ea160640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0e40c3510 0x7fa0e40aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0ea160640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e40c47c0 con 0x7fa0e40c38f0 2024-05-08T20:38:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0ea160640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e40c6220 con 0x7fa0e40a9970 2024-05-08T20:38:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0ea160640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e40c6500 con 0x7fa0e40c3510 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa0e40c38f0 0x7fa0e414fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39356/0 (socket says 172.21.15.81:39356) 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e3fff640 1 -- 172.21.15.81:0/454269089 learned_addr learned my addr 172.21.15.81:0/454269089 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/454269089 >> v2:172.21.15.117:3300/0 conn(0x7fa0e40c3510 0x7fa0e40aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500469000 0 0) 0x7fa0e40c47c0 con 0x7fa0e40c38f0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0cc003530 con 0x7fa0e40c38f0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 965960663 0 0) 0x7fa0cc003530 con 0x7fa0e40c38f0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 >> v2:172.21.15.117:3300/0 conn(0x7fa0e40c3510 msgr2=0x7fa0e40aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 --2- 172.21.15.81:0/454269089 >> v2:172.21.15.117:3300/0 conn(0x7fa0e40c3510 0x7fa0e40aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 >> v1:172.21.15.117:6789/0 conn(0x7fa0e40a9970 legacy=0x7fa0e40c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40c4a10 con 0x7fa0e40c38f0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa0dc001a00 con 0x7fa0e40c38f0 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 >> v1:172.21.15.81:6789/0 conn(0x7fa0e40c38f0 legacy=0x7fa0e414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 0x7fa0cc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc004380 0x7fa0cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc0050f0 0x7fa0cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40c6500 con 0x7fa0cc003980 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc00c030 con 0x7fa0cc0050f0 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc00c1f0 con 0x7fa0cc004380 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 0x7fa0cc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e3fff640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc0050f0 0x7fa0cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e2ffd640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc004380 0x7fa0cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 -- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc004380 msgr2=0x7fa0cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc004380 0x7fa0cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 -- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc0050f0 msgr2=0x7fa0cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0cc0050f0 0x7fa0cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e37fe640 1 -- 172.21.15.81:0/454269089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc003530 con 0x7fa0cc003980 2024-05-08T20:38:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.610+0000 7fa0e3fff640 1 -- 172.21.15.81:0/454269089 reap_dead start 2024-05-08T20:38:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 0x7fa0cc003d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ae0 tx=0x7fa0d401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b1d5b33dc61862 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a5520 con 0x7fa0cc003980 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a5680 con 0x7fa0cc003980 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e27fc640 1 -- 172.21.15.81:0/454269089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a5a30 con 0x7fa0cc003980 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 msgr2=0x7fa0cc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 0x7fa0cc003d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ae0 tx=0x7fa0d401ca40 comp rx=0 tx=0).stop 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- 172.21.15.81:0/454269089 shutdown_connections 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 --2- 172.21.15.81:0/454269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc003980 0x7fa0cc003d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- 172.21.15.81:0/454269089 >> 172.21.15.81:0/454269089 conn(0x7fa0e40c68c0 msgr2=0x7fa0e40c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- 172.21.15.81:0/454269089 shutdown_connections 2024-05-08T20:38:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- 172.21.15.81:0/454269089 wait complete. 2024-05-08T20:38:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 Processor -- start 2024-05-08T20:38:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- start start 2024-05-08T20:38:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc003980 0x7fa0e41edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 0x7fa0e41ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0e40bfcf0 0x7fa0e40c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40c2410 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e406d9a0 con 0x7fa0e40bfcf0 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0ea160640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41eaca0 con 0x7fa0cc003980 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 0x7fa0e41ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 0x7fa0e41ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39832/0 (socket says 172.21.15.81:39832) 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e2ffd640 1 -- 172.21.15.81:0/1672062367 learned_addr learned my addr 172.21.15.81:0/1672062367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e3fff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0e40bfcf0 0x7fa0e40c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc003980 0x7fa0e41edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e2ffd640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc003980 msgr2=0x7fa0e41edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.614+0000 7fa0e2ffd640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0cc003980 0x7fa0e41edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e2ffd640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0e40bfcf0 msgr2=0x7fa0e40c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e2ffd640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0e40bfcf0 0x7fa0e40c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e2ffd640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40c2160 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e2ffd640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 0x7fa0e41ea760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800e510 tx=0x7fa0d800e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80052e0 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8005460 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e406d3e0 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8003840 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e406ba70 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0ea160640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 0x7fa0e406c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4069550 con 0x7fa0e406bf90 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 0x7fa0e406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e37fe640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0e40c5a20 con 0x7fa0e406bf90 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 0x7fa0e406c370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ab0 tx=0x7fa0cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a5520 con 0x7fa0e406bf90 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0d80039a0 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0d0066730 0x7fa0d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa0d8083c40 con 0x7fa0e40c1ce0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e3fff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0d0066730 0x7fa0d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa0d40c1470 con 0x7fa0e406bf90 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 msgr2=0x7fa0e406c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 0x7fa0e406c370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009ab0 tx=0x7fa0cc005800 comp rx=0 tx=0).stop 2024-05-08T20:38:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 msgr2=0x7fa0e406c370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0cbfff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406bf90 0x7fa0e406c370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.618+0000 7fa0e3fff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0d0066730 0x7fa0d0068bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40660d0 tx=0x7fa0dc006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 0x7fa0e41f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e406ccc0 con 0x7fa0e406c8b0 2024-05-08T20:38:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 0x7fa0e41f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0e37fe640 1 -- 172.21.15.81:0/1672062367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa0e4074950 con 0x7fa0e406c8b0 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0e37fe640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 0x7fa0e41f0590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006f90 tx=0x7fa0d40a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40c1db0 con 0x7fa0e406c8b0 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fa0d4006040 con 0x7fa0e406c8b0 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 msgr2=0x7fa0e41f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 0x7fa0e41f0590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006f90 tx=0x7fa0d40a7070 comp rx=0 tx=0).stop 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 msgr2=0x7fa0e41f0590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0cbfff640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e406c8b0 0x7fa0e41f0590 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:20.632 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.633 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:20.635 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.636 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:20.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:20.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.642 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.643 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:20.644 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0d0066730 msgr2=0x7fa0d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0d0066730 0x7fa0d0068bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40660d0 tx=0x7fa0dc006040 comp rx=0 tx=0).stop 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 msgr2=0x7fa0e41ea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 --2- 172.21.15.81:0/1672062367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e40c1ce0 0x7fa0e41ea760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800e510 tx=0x7fa0d800e910 comp rx=0 tx=0).stop 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0e3fff640 1 -- 172.21.15.81:0/1672062367 reap_dead start 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0e3fff640 1 -- 172.21.15.81:0/1672062367 reap_dead start 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 shutdown_connections 2024-05-08T20:38:20.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 >> 172.21.15.81:0/1672062367 conn(0x7fa0e40c68c0 msgr2=0x7fa0e41559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 shutdown_connections 2024-05-08T20:38:20.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.626+0000 7fa0ea160640 1 -- 172.21.15.81:0/1672062367 wait complete. 2024-05-08T20:38:20.652 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:20.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:38:20.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:38:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 Processor -- start 2024-05-08T20:38:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 -- start start 2024-05-08T20:38:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8b414fe70 0x7ff8b406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b4152ab0 con 0x7ff8b4155e90 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b4152d90 con 0x7ff8b406d7d0 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8b98d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b41528a0 con 0x7ff8b414fe70 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8abfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8b4155e90 0x7ff8b4069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39372/0 (socket says 172.21.15.81:39372) 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.786+0000 7ff8abfff640 1 -- 172.21.15.81:0/2459867097 learned_addr learned my addr 172.21.15.81:0/2459867097 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b2ffd640 1 --2- 172.21.15.81:0/2459867097 >> v2:172.21.15.117:3300/0 conn(0x7ff8b414fe70 0x7ff8b406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153731249 0 0) 0x7ff8b4152ab0 con 0x7ff8b4155e90 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a0003530 con 0x7ff8b4155e90 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155593144 0 0) 0x7ff8b4152d90 con 0x7ff8b406d7d0 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b4152ab0 con 0x7ff8b406d7d0 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626958381 0 0) 0x7ff8a0003530 con 0x7ff8b4155e90 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2459867097 >> v1:172.21.15.117:6789/0 conn(0x7ff8b406d7d0 legacy=0x7ff8b406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2459867097 >> v1:172.21.15.81:6789/0 conn(0x7ff8b4155e90 legacy=0x7ff8b4069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2459867097 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b4153070 con 0x7ff8b414fe70 2024-05-08T20:38:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b2ffd640 1 --2- 172.21.15.81:0/2459867097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414fe70 0x7ff8b406d290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8cc90cb393d1a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c001680 con 0x7ff8b414fe70 2024-05-08T20:38:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a40a7050 con 0x7ff8b414fe70 2024-05-08T20:38:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.790+0000 7ff8b27fc640 1 -- 172.21.15.81:0/2459867097 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40ab620 con 0x7ff8b414fe70 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2459867097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414fe70 msgr2=0x7ff8b406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2459867097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414fe70 0x7ff8b406d290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097c0 tx=0x7ff8a401c270 comp rx=0 tx=0).stop 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2459867097 shutdown_connections 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2459867097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414fe70 0x7ff8b406d290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2459867097 >> 172.21.15.81:0/2459867097 conn(0x7ff8b40c71b0 msgr2=0x7ff8b40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2459867097 shutdown_connections 2024-05-08T20:38:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2459867097 wait complete. 2024-05-08T20:38:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 Processor -- start 2024-05-08T20:38:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- start start 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 0x7ff8b40c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8b414fe70 0x7ff8b41f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b4155e90 0x7ff8b41f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4071cc0 con 0x7ff8b406d7d0 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b414e530 con 0x7ff8b4155e90 2024-05-08T20:38:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b414cdc0 con 0x7ff8b414fe70 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 0x7ff8b40c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 0x7ff8b40c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39866/0 (socket says 172.21.15.81:39866) 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2402669324 learned_addr learned my addr 172.21.15.81:0/2402669324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8b414fe70 0x7ff8b41f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b37fe640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b4155e90 0x7ff8b41f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8b414fe70 msgr2=0x7ff8b41f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8b414fe70 0x7ff8b41f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b4155e90 msgr2=0x7ff8b41f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b4155e90 0x7ff8b41f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009420 con 0x7ff8b406d7d0 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8b414fe70 0x7ff8b41f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b2ffd640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 0x7ff8b40c5fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40ae040 tx=0x7ff8a4019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4004020 con 0x7ff8b406d7d0 2024-05-08T20:38:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4004180 con 0x7ff8b406d7d0 2024-05-08T20:38:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b414f570 con 0x7ff8b406d7d0 2024-05-08T20:38:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40044f0 con 0x7ff8b406d7d0 2024-05-08T20:38:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.794+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40c6510 con 0x7ff8b406d7d0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 0x7ff8b414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4069550 con 0x7ff8b41f0c90 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8a40b2040 con 0x7ff8b406d7d0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 0x7ff8b414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8940666c0 0x7ff894068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8abfff640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8b40675e0 con 0x7ff8b41f0c90 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff8a411e2f0 con 0x7ff8b406d7d0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b37fe640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8940666c0 0x7ff894068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 0x7ff8b414a160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8b406a650 tx=0x7ff89c00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b37fe640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8940666c0 0x7ff894068b80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007fd0 tx=0x7ff8ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0058e0 con 0x7ff8b41f0c90 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff89c005a40 con 0x7ff8b41f0c90 2024-05-08T20:38:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 msgr2=0x7ff8b414a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 0x7ff8b414a160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8b406a650 tx=0x7ff89c00eb90 comp rx=0 tx=0).stop 2024-05-08T20:38:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 msgr2=0x7ff8b414a160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.798+0000 7ff8b0ff9640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b41f0c90 0x7ff8b414a160 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8b406a650 tx=0x7ff89c00eb90 comp rx=0 tx=0).stop 2024-05-08T20:38:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 0x7ff8b414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4071e00 con 0x7ff8b414a6a0 2024-05-08T20:38:20.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 0x7ff8b414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8abfff640 1 -- 172.21.15.81:0/2402669324 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff8b414aff0 con 0x7ff8b414a6a0 2024-05-08T20:38:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8abfff640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 0x7ff8b414aab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40c7e60 tx=0x7ff89c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0074e0 con 0x7ff8b414a6a0 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7ff89c007640 con 0x7ff8b414a6a0 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 msgr2=0x7ff8b414aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 0x7ff8b414aab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40c7e60 tx=0x7ff89c005800 comp rx=0 tx=0).stop 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 msgr2=0x7ff8b414aab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b0ff9640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8b414a6a0 0x7ff8b414aab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.817 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.818 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.819 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.820 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:20.821 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.824 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:20.825 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8940666c0 msgr2=0x7ff894068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8940666c0 0x7ff894068b80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007fd0 tx=0x7ff8ac009040 comp rx=0 tx=0).stop 2024-05-08T20:38:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 msgr2=0x7ff8b40c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 --2- 172.21.15.81:0/2402669324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8b406d7d0 0x7ff8b40c5fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40ae040 tx=0x7ff8a4019010 comp rx=0 tx=0).stop 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b37fe640 1 -- 172.21.15.81:0/2402669324 reap_dead start 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b37fe640 1 -- 172.21.15.81:0/2402669324 reap_dead start 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 shutdown_connections 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 >> 172.21.15.81:0/2402669324 conn(0x7ff8b40c71b0 msgr2=0x7ff8b4156340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 shutdown_connections 2024-05-08T20:38:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.806+0000 7ff8b98d5640 1 -- 172.21.15.81:0/2402669324 wait complete. 2024-05-08T20:38:20.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:20.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:38:20.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:38:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.942+0000 7f46c0915640 1 Processor -- start 2024-05-08T20:38:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.942+0000 7f46c0915640 1 -- start start 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46c0915640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46bc0c2800 0x7f46bc1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46c0915640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0c3a50 con 0x7f46bc070c00 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46c0915640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0705e0 con 0x7f46bc06b230 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46c0915640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc0c2c70 con 0x7f46bc0c2800 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46bc0c2800 0x7f46bc1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46bc0c2800 0x7f46bc1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39878/0 (socket says 172.21.15.81:39878) 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 -- 172.21.15.81:0/821124388 learned_addr learned my addr 172.21.15.81:0/821124388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46b9d9b640 1 --1- 172.21.15.81:0/821124388 >> v1:172.21.15.81:6789/0 conn(0x7f46bc070c00 0x7f46bc1519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39384/0 (socket says 172.21.15.81:39384) 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 -- 172.21.15.81:0/821124388 >> v1:172.21.15.117:6789/0 conn(0x7f46bc06b230 legacy=0x7f46bc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 -- 172.21.15.81:0/821124388 >> v1:172.21.15.81:6789/0 conn(0x7f46bc070c00 legacy=0x7f46bc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 -- 172.21.15.81:0/821124388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0708c0 con 0x7f46bc0c2800 2024-05-08T20:38:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46bad9d640 1 --2- 172.21.15.81:0/821124388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc0c2800 0x7f46bc1520e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f46b400d150 tx=0x7f46b401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cb4389dc518a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46b959a640 1 -- 172.21.15.81:0/821124388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400b2d0 con 0x7f46bc0c2800 2024-05-08T20:38:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46b959a640 1 -- 172.21.15.81:0/821124388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400b430 con 0x7f46bc0c2800 2024-05-08T20:38:20.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.946+0000 7f46b959a640 1 -- 172.21.15.81:0/821124388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40a7aa0 con 0x7f46bc0c2800 2024-05-08T20:38:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/821124388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc0c2800 msgr2=0x7f46bc1520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 --2- 172.21.15.81:0/821124388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc0c2800 0x7f46bc1520e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f46b400d150 tx=0x7f46b401eba0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/821124388 shutdown_connections 2024-05-08T20:38:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 --2- 172.21.15.81:0/821124388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc0c2800 0x7f46bc1520e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/821124388 >> 172.21.15.81:0/821124388 conn(0x7f46bc0c71b0 msgr2=0x7f46bc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/821124388 shutdown_connections 2024-05-08T20:38:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/821124388 wait complete. 2024-05-08T20:38:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 Processor -- start 2024-05-08T20:38:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- start start 2024-05-08T20:38:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46bc06b230 0x7f46bc1e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 0x7f46bc149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc0c2800 0x7f46bc146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc146ff0 con 0x7f46bc070c00 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc15cd60 con 0x7f46bc06b230 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc14ae10 con 0x7f46bc0c2800 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 0x7f46bc149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 0x7f46bc149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39882/0 (socket says 172.21.15.81:39882) 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 -- 172.21.15.81:0/383250606 learned_addr learned my addr 172.21.15.81:0/383250606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46bad9d640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc0c2800 0x7f46bc146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46ba59c640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46bc06b230 0x7f46bc1e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc0c2800 msgr2=0x7f46bc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc0c2800 0x7f46bc146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46bc06b230 msgr2=0x7f46bc1e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46bc06b230 0x7f46bc1e9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b400bd40 con 0x7f46bc070c00 2024-05-08T20:38:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46b9d9b640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 0x7f46bc149230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c490 tx=0x7f46b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0007480 con 0x7f46bc070c00 2024-05-08T20:38:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b00075e0 con 0x7f46bc070c00 2024-05-08T20:38:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc14b0f0 con 0x7f46bc070c00 2024-05-08T20:38:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0004a10 con 0x7f46bc070c00 2024-05-08T20:38:20.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.950+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc1e9260 con 0x7f46bc070c00 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46c0915640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 0x7f46bc1e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc069550 con 0x7f46bc149770 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46ba59c640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 0x7f46bc1e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46ba59c640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46bc06b610 con 0x7f46bc149770 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46ba59c640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 0x7f46bc1e9480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac00fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0050d0 con 0x7f46bc149770 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46b0004b70 con 0x7f46bc070c00 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066730 0x7f469c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f46b0083590 con 0x7f46bc070c00 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46bad9d640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066730 0x7f469c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f46ac005230 con 0x7f46bc149770 2024-05-08T20:38:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 msgr2=0x7f46bc1e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 0x7f46bc1e9480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac00fc00 comp rx=0 tx=0).stop 2024-05-08T20:38:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 msgr2=0x7f46bc1e9480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46aaffd640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc149770 0x7f46bc1e9480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.954+0000 7f46bad9d640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066730 0x7f469c068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46b40b0000 tx=0x7f46b40a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 0x7f46bc1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0675e0 con 0x7f46bc148b70 2024-05-08T20:38:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46ba59c640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 0x7f46bc1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46ba59c640 1 -- 172.21.15.81:0/383250606 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f46bc074950 con 0x7f46bc148b70 2024-05-08T20:38:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46ba59c640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 0x7f46bc1467b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac023070 con 0x7f46bc148b70 2024-05-08T20:38:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f46ac00dc30 con 0x7f46bc148b70 2024-05-08T20:38:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 msgr2=0x7f46bc1467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 0x7f46bc1467b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac001130 comp rx=0 tx=0).stop 2024-05-08T20:38:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 msgr2=0x7f46bc1467b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46aaffd640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46bc148b70 0x7f46bc1467b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 90, 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:20.972 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.973 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:20.975 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:20.976 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.977 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:20.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:20.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:20.982 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:20.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:20.984 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066730 msgr2=0x7f469c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f469c066730 0x7f469c068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46b40b0000 tx=0x7f46b40a9070 comp rx=0 tx=0).stop 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 msgr2=0x7f46bc149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 --2- 172.21.15.81:0/383250606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46bc070c00 0x7f46bc149230 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c490 tx=0x7f46b000c950 comp rx=0 tx=0).stop 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46bad9d640 1 -- 172.21.15.81:0/383250606 reap_dead start 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46bad9d640 1 -- 172.21.15.81:0/383250606 reap_dead start 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 shutdown_connections 2024-05-08T20:38:20.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 >> 172.21.15.81:0/383250606 conn(0x7f46bc0c71b0 msgr2=0x7f46bc14b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 shutdown_connections 2024-05-08T20:38:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:20.966+0000 7f46c0915640 1 -- 172.21.15.81:0/383250606 wait complete. 2024-05-08T20:38:20.989 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:38:20.989 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:38:20.989 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:38:20.989 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:38:20.989 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:38:20.990 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:38:20.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:38:21.005 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:38:21.005 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:38:21.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 Processor -- start 2024-05-08T20:38:21.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 -- start start 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f40c2570 0x7f24f4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f4158080 con 0x7f24f4152340 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f406a890 con 0x7f24f40c34e0 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24fa2e3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f406ab70 con 0x7f24f40c2570 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f8880640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f24f40c34e0 legacy=0x7f24f41554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f24f40c2570 0x7f24f4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f24f4152340 0x7f24f406d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39388/0 (socket says 172.21.15.81:39388) 2024-05-08T20:38:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f3fff640 1 -- 172.21.15.81:0/3570445828 learned_addr learned my addr 172.21.15.81:0/3570445828 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f37fe640 1 -- 172.21.15.81:0/3570445828 >> v1:172.21.15.117:6789/0 conn(0x7f24f40c34e0 legacy=0x7f24f41554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f37fe640 1 -- 172.21.15.81:0/3570445828 >> v1:172.21.15.81:6789/0 conn(0x7f24f4152340 legacy=0x7f24f406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.138+0000 7f24f37fe640 1 -- 172.21.15.81:0/3570445828 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40c2d70 con 0x7f24f40c2570 2024-05-08T20:38:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f37fe640 1 --2- 172.21.15.81:0/3570445828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40c2570 0x7f24f4154f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24e80097c0 tx=0x7f24e801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47f606a9b2bc8be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f2ffd640 1 -- 172.21.15.81:0/3570445828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e80ab600 con 0x7f24f40c2570 2024-05-08T20:38:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f2ffd640 1 -- 172.21.15.81:0/3570445828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e80a7050 con 0x7f24f40c2570 2024-05-08T20:38:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f2ffd640 1 -- 172.21.15.81:0/3570445828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e80ab980 con 0x7f24f40c2570 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3570445828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40c2570 msgr2=0x7f24f4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3570445828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40c2570 0x7f24f4154f60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24e80097c0 tx=0x7f24e801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3570445828 shutdown_connections 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3570445828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f40c2570 0x7f24f4154f60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3570445828 >> 172.21.15.81:0/3570445828 conn(0x7f24f40c71b0 msgr2=0x7f24f40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3570445828 shutdown_connections 2024-05-08T20:38:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3570445828 wait complete. 2024-05-08T20:38:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 Processor -- start 2024-05-08T20:38:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- start start 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24f40c2570 0x7f24f4147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 0x7f24f41479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4147f00 con 0x7f24f4152340 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4137630 con 0x7f24f40c34e0 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24fa2e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f41433d0 con 0x7f24f40c2570 2024-05-08T20:38:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f37fe640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 msgr2=0x7f24f41479c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 0x7f24f41479c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39914/0 (socket says 172.21.15.81:39914) 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 -- 172.21.15.81:0/3975480170 learned_addr learned my addr 172.21.15.81:0/3975480170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f3fff640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24f40c2570 0x7f24f4147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 -- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24f40c2570 msgr2=0x7f24f4147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24f40c2570 0x7f24f4147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 -- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 msgr2=0x7f24f41479c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 0x7f24f41479c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 -- 172.21.15.81:0/3975480170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8009420 con 0x7f24f4152340 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.142+0000 7f24f8880640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b790 tx=0x7f24ec00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00c960 con 0x7f24f4152340 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00cac0 con 0x7f24f4152340 2024-05-08T20:38:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f40aa940 con 0x7f24f4152340 2024-05-08T20:38:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00ce70 con 0x7f24f4152340 2024-05-08T20:38:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f4142d80 con 0x7f24f4152340 2024-05-08T20:38:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f40675e0 con 0x7f24f4152340 2024-05-08T20:38:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24ec012070 con 0x7f24f4152340 2024-05-08T20:38:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 0x7f24e0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f3fff640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 0x7f24e0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f24ec084370 con 0x7f24f4152340 2024-05-08T20:38:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.146+0000 7f24f3fff640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 0x7f24e0068b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005890 tx=0x7f24e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.150+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f24ec0512b0 con 0x7f24f4152340 2024-05-08T20:38:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f24f4074950 con 0x7f24f4152340 2024-05-08T20:38:21.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24f0ff9640 1 -- 172.21.15.81:0/3975480170 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f24ec0548d0 con 0x7f24f4152340 2024-05-08T20:38:21.426 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 msgr2=0x7f24e0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 0x7f24e0068b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005890 tx=0x7f24e4009040 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 msgr2=0x7f24f4146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b790 tx=0x7f24ec00bc50 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 shutdown_connections 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f24e0066640 0x7f24e0068b00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24f4152340 0x7f24f4146440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24f40c34e0 0x7f24f41479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 --2- 172.21.15.81:0/3975480170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24f40c2570 0x7f24f4147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 >> 172.21.15.81:0/3975480170 conn(0x7f24f40c71b0 msgr2=0x7f24f4070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.422+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 shutdown_connections 2024-05-08T20:38:21.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:21.426+0000 7f24fa2e3640 1 -- 172.21.15.81:0/3975480170 wait complete. 2024-05-08T20:38:21.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:38:21.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:38:24.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:24.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.570+0000 7f1d8c7ec640 1 Processor -- start 2024-05-08T20:38:24.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.570+0000 7f1d8c7ec640 1 -- start start 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8c7ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d840aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8c7ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840c47c0 con 0x7f1d840c3510 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8c7ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840c6220 con 0x7f1d840c38f0 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8c7ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c6500 con 0x7f1d840a9970 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8ad89640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f1d840c38f0 legacy=0x7f1d8414fa00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1d840c3510 0x7f1d840c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39396/0 (socket says 172.21.15.81:39396) 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 -- 172.21.15.81:0/3463509120 learned_addr learned my addr 172.21.15.81:0/3463509120 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89d87640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d840aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816057206 0 0) 0x7f1d840c47c0 con 0x7f1d840c3510 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70003530 con 0x7f1d840c3510 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657840802 0 0) 0x7f1d70003530 con 0x7f1d840c3510 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 msgr2=0x7f1d840aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d840aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 >> v1:172.21.15.117:6789/0 conn(0x7f1d840c38f0 legacy=0x7f1d8414fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840c4a10 con 0x7f1d840c3510 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1d80001680 con 0x7f1d840c3510 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 >> v1:172.21.15.81:6789/0 conn(0x7f1d840c3510 legacy=0x7f1d840c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d700039b0 0x7f1d70003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d70004d10 0x7f1d70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c6500 con 0x7f1d700039b0 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000ba70 con 0x7f1d70004d10 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000bc30 con 0x7f1d840a9970 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d70004d10 msgr2=0x7f1d70005190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8ad89640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d70004d10 0x7f1d70005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d700039b0 0x7f1d70003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d89d87640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 -- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 msgr2=0x7f1d700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d840a9970 0x7f1d700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 -- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d70004d10 msgr2=0x7f1d70005190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d70004d10 0x7f1d70005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.574+0000 7f1d8a588640 1 -- 172.21.15.81:0/3463509120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70003530 con 0x7f1d700039b0 2024-05-08T20:38:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d700039b0 0x7f1d70003db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c210 tx=0x7f1d8001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211ea794429f5c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80005ae0 con 0x7f1d700039b0 2024-05-08T20:38:24.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80005c60 con 0x7f1d700039b0 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d89586640 1 -- 172.21.15.81:0/3463509120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800a58d0 con 0x7f1d700039b0 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3463509120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d700039b0 msgr2=0x7f1d70003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3463509120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d700039b0 0x7f1d70003db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c210 tx=0x7f1d8001cc50 comp rx=0 tx=0).stop 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3463509120 reap_dead start 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3463509120 shutdown_connections 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3463509120 >> 172.21.15.81:0/3463509120 conn(0x7f1d840c68c0 msgr2=0x7f1d840c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3463509120 shutdown_connections 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3463509120 wait complete. 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 Processor -- start 2024-05-08T20:38:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- start start 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 0x7f1d8414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8406d770 0x7f1d84146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84147e90 con 0x7f1d84147470 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c1660 con 0x7f1d700039b0 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8c7ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84147900 con 0x7f1d8406d770 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8a588640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 msgr2=0x7f1d8414d780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8a588640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 0x7f1d8414d780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39934/0 (socket says 172.21.15.81:39934) 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3121047186 learned_addr learned my addr 172.21.15.81:0/3121047186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d89d87640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8406d770 0x7f1d84146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8406d770 msgr2=0x7f1d84146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8406d770 0x7f1d84146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 msgr2=0x7f1d8414d780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 0x7f1d8414d780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 -- 172.21.15.81:0/3121047186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d84148060 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.578+0000 7f1d8ad89640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d84072d20 tx=0x7f1d7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c015470 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0155d0 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d84148320 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0159c0 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d840c12f0 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d84074950 con 0x7f1d84147470 2024-05-08T20:38:24.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d7c012070 con 0x7f1d84147470 2024-05-08T20:38:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 0x7f1d68068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1d7c006e40 con 0x7f1d84147470 2024-05-08T20:38:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 0x7f1d68068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.582+0000 7f1d8a588640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 0x7f1d68068b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1d800ab000 tx=0x7f1d800a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.590+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1d7c051680 con 0x7f1d84147470 2024-05-08T20:38:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1d840aa610 con 0x7f1d84147470 2024-05-08T20:38:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d7affd640 1 -- 172.21.15.81:0/3121047186 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1d7c01a620 con 0x7f1d84147470 2024-05-08T20:38:24.838 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 msgr2=0x7f1d68068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 0x7f1d68068b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1d800ab000 tx=0x7f1d800a7070 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 msgr2=0x7f1d841ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d84072d20 tx=0x7f1d7c009e30 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 shutdown_connections 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d68066670 0x7f1d68068b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d84147470 0x7f1d841ed9a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d8406d770 0x7f1d84146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 --2- 172.21.15.81:0/3121047186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d700039b0 0x7f1d8414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 >> 172.21.15.81:0/3121047186 conn(0x7f1d840c68c0 msgr2=0x7f1d841581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 shutdown_connections 2024-05-08T20:38:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:24.834+0000 7f1d8c7ec640 1 -- 172.21.15.81:0/3121047186 wait complete. 2024-05-08T20:38:27.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 Processor -- start 2024-05-08T20:38:28.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 -- start start 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f666c06b230 0x7f666c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 0x7f666c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c072940 con 0x7f666c06b230 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0c3a50 con 0x7f666c070c00 2024-05-08T20:38:28.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f6671581640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0705e0 con 0x7f666c14edf0 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666a7fc640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 msgr2=0x7f666c14e8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f666c06b230 0x7f666c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 0x7f666c14e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f666c06b230 0x7f666c0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39938/0 (socket says 172.21.15.81:39938) 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 -- 172.21.15.81:0/1665021716 learned_addr learned my addr 172.21.15.81:0/1665021716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:28.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666b7fe640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 -- 172.21.15.81:0/1665021716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 msgr2=0x7f666c1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 -- 172.21.15.81:0/1665021716 >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 msgr2=0x7f666c14e8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 --2- 172.21.15.81:0/1665021716 >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 0x7f666c14e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.002+0000 7f666affd640 1 -- 172.21.15.81:0/1665021716 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0708c0 con 0x7f666c06b230 2024-05-08T20:38:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f666affd640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c06b230 0x7f666c0c2800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f666c06bd60 tx=0x7f665c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccf6e99398f468c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6669ffb640 1 -- 172.21.15.81:0/1665021716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c152720 con 0x7f666c06b230 2024-05-08T20:38:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6669ffb640 1 -- 172.21.15.81:0/1665021716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c0ad680 con 0x7f666c06b230 2024-05-08T20:38:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6669ffb640 1 -- 172.21.15.81:0/1665021716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0ada10 con 0x7f666c06b230 2024-05-08T20:38:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- 172.21.15.81:0/1665021716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c06b230 msgr2=0x7f666c0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c06b230 0x7f666c0c2800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f666c06bd60 tx=0x7f665c01c4b0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- 172.21.15.81:0/1665021716 shutdown_connections 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 --2- 172.21.15.81:0/1665021716 >> v2:172.21.15.117:3300/0 conn(0x7f666c070c00 0x7f666c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 --2- 172.21.15.81:0/1665021716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c06b230 0x7f666c0c2800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- 172.21.15.81:0/1665021716 >> 172.21.15.81:0/1665021716 conn(0x7f666c0c71b0 msgr2=0x7f666c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- 172.21.15.81:0/1665021716 shutdown_connections 2024-05-08T20:38:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- 172.21.15.81:0/1665021716 wait complete. 2024-05-08T20:38:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 Processor -- start 2024-05-08T20:38:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.006+0000 7f6671581640 1 -- start start 2024-05-08T20:38:28.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 0x7f666c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c155430 con 0x7f666c070c00 2024-05-08T20:38:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c144440 con 0x7f666c06b230 2024-05-08T20:38:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c1436f0 con 0x7f666c14edf0 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666affd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 msgr2=0x7f666c154ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 0x7f666c154ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39950/0 (socket says 172.21.15.81:39950) 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 -- 172.21.15.81:0/4060182608 learned_addr learned my addr 172.21.15.81:0/4060182608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666b7fe640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 -- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 msgr2=0x7f666c069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 -- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 msgr2=0x7f666c154ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 0x7f666c154ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 -- 172.21.15.81:0/4060182608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c0094d0 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666a7fc640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f666000b560 tx=0x7f666000ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660003dd0 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660005070 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c1eb7f0 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660005420 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c143a20 con 0x7f666c070c00 2024-05-08T20:38:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0675e0 con 0x7f666c070c00 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6660005580 con 0x7f666c070c00 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 0x7f6658068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6660084430 con 0x7f666c070c00 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666affd640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 0x7f6658068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.010+0000 7f666affd640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 0x7f6658068b30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f665c0af000 tx=0x7f665c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.018+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6660051490 con 0x7f666c070c00 2024-05-08T20:38:28.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.298+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f666c074950 con 0x7f666c070c00 2024-05-08T20:38:28.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.298+0000 7f66537fe640 1 -- 172.21.15.81:0/4060182608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f6660054ab0 con 0x7f666c070c00 2024-05-08T20:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":90,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 msgr2=0x7f6658068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 0x7f6658068b30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f665c0af000 tx=0x7f665c008040 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 msgr2=0x7f666c143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f666000b560 tx=0x7f666000ba20 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 shutdown_connections 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6658066670 0x7f6658068b30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f666c14edf0 0x7f666c069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f666c070c00 0x7f666c143d00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 --2- 172.21.15.81:0/4060182608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f666c06b230 0x7f666c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 >> 172.21.15.81:0/4060182608 conn(0x7f666c0c71b0 msgr2=0x7f666c15b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 shutdown_connections 2024-05-08T20:38:28.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:28.302+0000 7f6671581640 1 -- 172.21.15.81:0/4060182608 wait complete. 2024-05-08T20:38:31.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 Processor -- start 2024-05-08T20:38:31.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 -- start start 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e50155140 con 0x7f1e50152220 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500c4780 con 0x7f1e500aac30 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e55639640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500c32d0 con 0x7f1e500c26e0 2024-05-08T20:38:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4f7fe640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 msgr2=0x7f1e500c15f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4effd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e50152220 0x7f1e500c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42414/0 (socket says 172.21.15.81:42414) 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 learned_addr learned my addr 172.21.15.81:0/565222165 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.454+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4f7fe640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 msgr2=0x7f1e500c15f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4f7fe640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:31.658+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:38:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4f7fe640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 msgr2=0x7f1e500c15f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4f7fe640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:38:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:38:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.062+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:38:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4f7fe640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 msgr2=0x7f1e500c15f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4f7fe640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:32.866+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:38:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 msgr2=0x7f1e501555d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e500c26e0 0x7f1e501555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 msgr2=0x7f1e500c15f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.117:3300/0 conn(0x7f1e500aac30 0x7f1e500c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.81:6789/0 conn(0x7f1e50152220 legacy=0x7f1e500c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 -- 172.21.15.81:0/565222165 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e50072650 con 0x7f1e3c0061a0 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4cff9640 1 -- 172.21.15.81:0/565222165 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500c32d0 con 0x7f1e3c0036d0 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.117:6789/0 conn(0x7f1e3c0061a0 legacy=0x7f1e3c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.454+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:34.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.117:6789/0 conn(0x7f1e3c0061a0 legacy=0x7f1e3c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:34.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:34.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:38:34.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:34.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:34.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:34.658+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:38:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.117:6789/0 conn(0x7f1e3c0061a0 legacy=0x7f1e3c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:38:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.062+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:38:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.866+0000 7f1e4e7fc640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.117:6789/0 conn(0x7f1e3c0061a0 legacy=0x7f1e3c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:38:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.866+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> v2:172.21.15.81:3300/0 conn(0x7f1e3c0036d0 0x7f1e3c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:35.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.866+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 >> v1:172.21.15.117:6789/0 conn(0x7f1e3c0061a0 legacy=0x7f1e3c008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:35.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.866+0000 7f1e4effd640 1 -- 172.21.15.81:0/565222165 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c00af90 con 0x7f1e3c0036d0 2024-05-08T20:38:35.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.870+0000 7f1e4effd640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e3c0036d0 0x7f1e3c005b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e40007d30 tx=0x7f1e4001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d87cc97c6f4b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:35.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e4dffb640 1 -- 172.21.15.81:0/565222165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e400a5940 con 0x7f1e3c0036d0 2024-05-08T20:38:35.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e4dffb640 1 -- 172.21.15.81:0/565222165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e400a9070 con 0x7f1e3c0036d0 2024-05-08T20:38:35.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e4dffb640 1 -- 172.21.15.81:0/565222165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e400a5cc0 con 0x7f1e3c0036d0 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 -- 172.21.15.81:0/565222165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e3c0036d0 msgr2=0x7f1e3c005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e3c0036d0 0x7f1e3c005b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e40007d30 tx=0x7f1e4001ca80 comp rx=0 tx=0).stop 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e4f7fe640 1 -- 172.21.15.81:0/565222165 reap_dead start 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 -- 172.21.15.81:0/565222165 shutdown_connections 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 --2- 172.21.15.81:0/565222165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e3c0036d0 0x7f1e3c005b50 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e40007d30 tx=0x7f1e4001ca80 comp rx=0 tx=0).stop 2024-05-08T20:38:35.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 -- 172.21.15.81:0/565222165 >> 172.21.15.81:0/565222165 conn(0x7f1e500c4cc0 msgr2=0x7f1e500c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:35.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 -- 172.21.15.81:0/565222165 shutdown_connections 2024-05-08T20:38:35.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.874+0000 7f1e55639640 1 -- 172.21.15.81:0/565222165 wait complete. 2024-05-08T20:38:35.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 Processor -- start 2024-05-08T20:38:35.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 -- start start 2024-05-08T20:38:35.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:35.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 0x7f1e5014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:35.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e50149860 0x7f1e501f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5014e400 con 0x7f1e50146a20 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500c76f0 con 0x7f1e5014c4d0 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501f1540 con 0x7f1e50149860 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4e7fc640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 msgr2=0x7f1e5014b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 0x7f1e5014b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37774/0 (socket says 172.21.15.81:37774) 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 -- 172.21.15.81:0/1257112427 learned_addr learned my addr 172.21.15.81:0/1257112427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4f7fe640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e50149860 0x7f1e501f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 -- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e50149860 msgr2=0x7f1e501f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e50149860 0x7f1e501f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:35.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 -- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 msgr2=0x7f1e5014b110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 0x7f1e5014b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 -- 172.21.15.81:0/1257112427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4000f040 con 0x7f1e50146a20 2024-05-08T20:38:35.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e4effd640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000c10 tx=0x7f1e40019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e400bf070 con 0x7f1e50146a20 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e500c7a00 con 0x7f1e50146a20 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e400a57c0 con 0x7f1e50146a20 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.878+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e400a5b50 con 0x7f1e50146a20 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5014c960 con 0x7f1e50146a20 2024-05-08T20:38:35.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e50074950 con 0x7f1e50146a20 2024-05-08T20:38:35.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e400a5cb0 con 0x7f1e50146a20 2024-05-08T20:38:35.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e377fe640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 0x7f1e3c0698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:35.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1e4011ed40 con 0x7f1e50146a20 2024-05-08T20:38:35.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 0x7f1e3c0698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:35.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.882+0000 7f1e4e7fc640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 0x7f1e3c0698c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006d50 tx=0x7f1e44006be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:35.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:35.886+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1e400ebc90 con 0x7f1e50146a20 2024-05-08T20:38:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.138+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1e50074950 con 0x7f1e50146a20 2024-05-08T20:38:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.138+0000 7f1e377fe640 1 -- 172.21.15.81:0/1257112427 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f1e400ab080 con 0x7f1e50146a20 2024-05-08T20:38:36.144 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":94,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 msgr2=0x7f1e3c0698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 0x7f1e3c0698c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006d50 tx=0x7f1e44006be0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 msgr2=0x7f1e5014dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000c10 tx=0x7f1e40019820 comp rx=0 tx=0).stop 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 shutdown_connections 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1e3c067400 0x7f1e3c0698c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e50149860 0x7f1e501f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5014c4d0 0x7f1e5014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 --2- 172.21.15.81:0/1257112427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e50146a20 0x7f1e5014dec0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 >> 172.21.15.81:0/1257112427 conn(0x7f1e500c4cc0 msgr2=0x7f1e50158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 shutdown_connections 2024-05-08T20:38:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.142+0000 7f1e55639640 1 -- 172.21.15.81:0/1257112427 wait complete. 2024-05-08T20:38:36.165 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:38:36.166 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:38:36.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:38:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 Processor -- start 2024-05-08T20:38:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 -- start start 2024-05-08T20:38:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc0041555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0040aac30 0x7fc0040c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc004155140 con 0x7fc0040c26e0 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040c4780 con 0x7fc0040aac30 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc00b7ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040c32d0 con 0x7fc004152220 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0040aac30 0x7fc0040c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0040aac30 0x7fc0040c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37776/0 (socket says 172.21.15.81:37776) 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc008d55640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc0040c26e0 0x7fc0040c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42424/0 (socket says 172.21.15.81:42424) 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 -- 172.21.15.81:0/2402412916 learned_addr learned my addr 172.21.15.81:0/2402412916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009556640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc0041555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 -- 172.21.15.81:0/2402412916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 msgr2=0x7fc0041555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc0041555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 -- 172.21.15.81:0/2402412916 >> v1:172.21.15.81:6789/0 conn(0x7fc0040c26e0 legacy=0x7fc0040c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.294+0000 7fc009d57640 1 -- 172.21.15.81:0/2402412916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004072650 con 0x7fc0040aac30 2024-05-08T20:38:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc009d57640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040aac30 0x7fc0040c15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009e50 tx=0x7fbffc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e55d2d66fb378be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fbffbfff640 1 -- 172.21.15.81:0/2402412916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5830 con 0x7fc0040aac30 2024-05-08T20:38:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fbffbfff640 1 -- 172.21.15.81:0/2402412916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a5990 con 0x7fc0040aac30 2024-05-08T20:38:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fbffbfff640 1 -- 172.21.15.81:0/2402412916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5d20 con 0x7fc0040aac30 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- 172.21.15.81:0/2402412916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040aac30 msgr2=0x7fc0040c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040aac30 0x7fc0040c15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009e50 tx=0x7fbffc01c970 comp rx=0 tx=0).stop 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- 172.21.15.81:0/2402412916 shutdown_connections 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040aac30 0x7fc0040c15f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/2402412916 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc0041555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- 172.21.15.81:0/2402412916 >> 172.21.15.81:0/2402412916 conn(0x7fc0040c4cc0 msgr2=0x7fc0040c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- 172.21.15.81:0/2402412916 shutdown_connections 2024-05-08T20:38:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- 172.21.15.81:0/2402412916 wait complete. 2024-05-08T20:38:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 Processor -- start 2024-05-08T20:38:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.298+0000 7fc00b7ba640 1 -- start start 2024-05-08T20:38:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0040aac30 0x7fc0041ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 0x7fc004150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc00414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00414ead0 con 0x7fc0040c26e0 2024-05-08T20:38:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0041ed910 con 0x7fc0040aac30 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00414ca90 con 0x7fc004152220 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009556640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0040aac30 msgr2=0x7fc0041ed3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009556640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0040aac30 0x7fc0041ed3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 0x7fc004150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 0x7fc004150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37782/0 (socket says 172.21.15.81:37782) 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 -- 172.21.15.81:0/1849444682 learned_addr learned my addr 172.21.15.81:0/1849444682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009d57640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc00414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 msgr2=0x7fc00414ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc00414ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0040aac30 msgr2=0x7fc0041ed3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0040aac30 0x7fc0041ed3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009b30 con 0x7fc0040c26e0 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009d57640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc004152220 0x7fc00414ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:38:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc008d55640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 0x7fc004150d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c4c0 tx=0x7fbff400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007480 con 0x7fc0040c26e0 2024-05-08T20:38:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff40075e0 con 0x7fc0040c26e0 2024-05-08T20:38:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00414cd70 con 0x7fc0040c26e0 2024-05-08T20:38:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4004a10 con 0x7fc0040c26e0 2024-05-08T20:38:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004151260 con 0x7fc0040c26e0 2024-05-08T20:38:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 0x7fc004148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc004073ea0 con 0x7fc00414bb00 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009556640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 0x7fc004148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009556640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0040721a0 con 0x7fc00414bb00 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbff4004b70 con 0x7fc0040c26e0 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fc009556640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 0x7fc004148970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc00000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfe8066640 0x7fbfe8068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.302+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbff40838c0 con 0x7fc0040c26e0 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fc009d57640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfe8066640 0x7fbfe8068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000018070 con 0x7fc00414bb00 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc000004020 con 0x7fc00414bb00 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 msgr2=0x7fc004148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 0x7fc004148970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc00000d990 comp rx=0 tx=0).stop 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 msgr2=0x7fc004148970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fbff9ffb640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414bb00 0x7fc004148970 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc00000d990 comp rx=0 tx=0).stop 2024-05-08T20:38:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.306+0000 7fc009d57640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfe8066640 0x7fbfe8068b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ae000 tx=0x7fbffc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 0x7fc004148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc004153c40 con 0x7fc00414cf60 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc009556640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 0x7fc004148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc009556640 1 -- 172.21.15.81:0/1849444682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc004158e60 con 0x7fc00414cf60 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc009556640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 0x7fc004148eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc000004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000003830 con 0x7fc00414cf60 2024-05-08T20:38:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7fc000003990 con 0x7fc00414cf60 2024-05-08T20:38:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 msgr2=0x7fc004148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 0x7fc004148eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc000004740 comp rx=0 tx=0).stop 2024-05-08T20:38:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 msgr2=0x7fc004148eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fbff9ffb640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00414cf60 0x7fc004148eb0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d4d0 tx=0x7fc000004740 comp rx=0 tx=0).stop 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 94, 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:36.332 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfe8066640 msgr2=0x7fbfe8068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbfe8066640 0x7fbfe8068b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ae000 tx=0x7fbffc0a7070 comp rx=0 tx=0).stop 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 msgr2=0x7fc004150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 --2- 172.21.15.81:0/1849444682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0040c26e0 0x7fc004150d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c4c0 tx=0x7fbff400c980 comp rx=0 tx=0).stop 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc009d57640 1 -- 172.21.15.81:0/1849444682 reap_dead start 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc009d57640 1 -- 172.21.15.81:0/1849444682 reap_dead start 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 shutdown_connections 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 >> 172.21.15.81:0/1849444682 conn(0x7fc0040c4cc0 msgr2=0x7fc0041526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 shutdown_connections 2024-05-08T20:38:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.314+0000 7fc00b7ba640 1 -- 172.21.15.81:0/1849444682 wait complete. 2024-05-08T20:38:36.337 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:38:36.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:38:36.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:38:36.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 Processor -- start 2024-05-08T20:38:36.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 -- start start 2024-05-08T20:38:36.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa7941555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7940aac30 0x7fa7940c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa794155140 con 0x7fa7940c26e0 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940c4780 con 0x7fa7940aac30 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa798bff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c32d0 con 0x7fa794152220 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7940aac30 0x7fa7940c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7940aac30 0x7fa7940c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37810/0 (socket says 172.21.15.81:37810) 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 -- 172.21.15.81:0/505466633 learned_addr learned my addr 172.21.15.81:0/505466633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa789d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa7940c26e0 0x7fa7940c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42430/0 (socket says 172.21.15.81:42430) 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa79259c640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa7941555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 -- 172.21.15.81:0/505466633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 msgr2=0x7fa7941555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa7941555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 -- 172.21.15.81:0/505466633 >> v1:172.21.15.81:6789/0 conn(0x7fa7940c26e0 legacy=0x7fa7940c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa792d9d640 1 -- 172.21.15.81:0/505466633 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794072650 con 0x7fa7940aac30 2024-05-08T20:38:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.458+0000 7fa791d9b640 1 -- 172.21.15.81:0/505466633 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209734709 0 0) 0x7fa794155140 con 0x7fa7940c26e0 2024-05-08T20:38:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa792d9d640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940aac30 0x7fa7940c15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009e50 tx=0x7fa78c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5119fbdbbd65bb62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa791d9b640 1 -- 172.21.15.81:0/505466633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0a5830 con 0x7fa7940aac30 2024-05-08T20:38:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa791d9b640 1 -- 172.21.15.81:0/505466633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c0a5990 con 0x7fa7940aac30 2024-05-08T20:38:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa791d9b640 1 -- 172.21.15.81:0/505466633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0a5d20 con 0x7fa7940aac30 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 -- 172.21.15.81:0/505466633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940aac30 msgr2=0x7fa7940c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940aac30 0x7fa7940c15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009e50 tx=0x7fa78c01c970 comp rx=0 tx=0).stop 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 -- 172.21.15.81:0/505466633 shutdown_connections 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940aac30 0x7fa7940c15f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 --2- 172.21.15.81:0/505466633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa7941555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 -- 172.21.15.81:0/505466633 >> 172.21.15.81:0/505466633 conn(0x7fa7940c4cc0 msgr2=0x7fa7940c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 -- 172.21.15.81:0/505466633 shutdown_connections 2024-05-08T20:38:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.462+0000 7fa798bff640 1 -- 172.21.15.81:0/505466633 wait complete. 2024-05-08T20:38:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 Processor -- start 2024-05-08T20:38:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- start start 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940aac30 0x7fa7940ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 0x7fa7941eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa794156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7941ee300 con 0x7fa7940c26e0 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794156380 con 0x7fa7940aac30 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7941571f0 con 0x7fa794152220 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa79259c640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940aac30 msgr2=0x7fa7940ac3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa79259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940aac30 0x7fa7940ac3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 0x7fa7941eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 0x7fa7941eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37814/0 (socket says 172.21.15.81:37814) 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 -- 172.21.15.81:0/1292584011 learned_addr learned my addr 172.21.15.81:0/1292584011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa792d9d640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa794156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 msgr2=0x7fa794156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794152220 0x7fa794156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940aac30 msgr2=0x7fa7940ac3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7940aac30 0x7fa7940ac3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c009b30 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa789d9b640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 0x7fa7941eddc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0011f0 tx=0x7fa77c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0074e0 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c007640 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7941574d0 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004a10 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa794156010 con 0x7fa7940c26e0 2024-05-08T20:38:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 0x7fa794144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794073ea0 con 0x7fa794144570 2024-05-08T20:38:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa79259c640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 0x7fa794144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa79259c640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa794158e60 con 0x7fa794144570 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.466+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa77c004b70 con 0x7fa7940c26e0 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa79259c640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 0x7fa794144950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c5ec0 tx=0x7fa78400d960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa774066640 0x7fa774068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa77c083650 con 0x7fa7940c26e0 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa792d9d640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa774066640 0x7fa774068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784004030 con 0x7fa794144570 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa792d9d640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa774066640 0x7fa774068b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ae000 tx=0x7fa78c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa784004190 con 0x7fa794144570 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 msgr2=0x7fa794144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 0x7fa794144950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c5ec0 tx=0x7fa78400d960 comp rx=0 tx=0).stop 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 msgr2=0x7fa794144950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.470+0000 7fa78b7fe640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa794144570 0x7fa794144950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa798bff640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 0x7fa7940c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794074950 con 0x7fa7940c6e20 2024-05-08T20:38:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa79259c640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 0x7fa7940c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa79259c640 1 -- 172.21.15.81:0/1292584011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa79406f240 con 0x7fa7940c6e20 2024-05-08T20:38:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa79259c640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 0x7fa7940c7230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c5ec0 tx=0x7fa784004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.478+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784003e00 con 0x7fa7940c6e20 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7fa7840125f0 con 0x7fa7940c6e20 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 msgr2=0x7fa7940c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa78b7fe640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 0x7fa7940c7230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa7940c5ec0 tx=0x7fa784004740 comp rx=0 tx=0).stop 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa78b7fe640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 msgr2=0x7fa7940c7230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa78b7fe640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7940c6e20 0x7fa7940c7230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.485 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 94, 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.487 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:38:36.488 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:38:36.489 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.491 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:38:36.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:38:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:38:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:38:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:38:36.496 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa774066640 msgr2=0x7fa774068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa774066640 0x7fa774068b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ae000 tx=0x7fa78c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 msgr2=0x7fa7941eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 --2- 172.21.15.81:0/1292584011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7940c26e0 0x7fa7941eddc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0011f0 tx=0x7fa77c00c9b0 comp rx=0 tx=0).stop 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa792d9d640 1 -- 172.21.15.81:0/1292584011 reap_dead start 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa792d9d640 1 -- 172.21.15.81:0/1292584011 reap_dead start 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 shutdown_connections 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 >> 172.21.15.81:0/1292584011 conn(0x7fa7940c4cc0 msgr2=0x7fa7940c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 shutdown_connections 2024-05-08T20:38:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:36.482+0000 7fa798bff640 1 -- 172.21.15.81:0/1292584011 wait complete. 2024-05-08T20:38:36.501 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:38:36.501 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:38:51.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:38:51.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:38:56.502 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:38:56.503 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:38:56.503 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:38:56.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:38:56.505 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:38:56.505 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:38:56.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:38:56.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.641+0000 7f576054e640 1 Processor -- start 2024-05-08T20:38:56.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.641+0000 7f576054e640 1 -- start start 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580c58d0 0x7f57580c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5758066010 0x7f57580c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575806d210 con 0x7f5758066010 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580c14e0 con 0x7f5758154e40 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f576054e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575806c530 con 0x7f57580c58d0 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5758066010 0x7f57580c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5758066010 0x7f57580c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37104/0 (socket says 172.21.15.81:37104) 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 -- 172.21.15.81:0/1026509205 learned_addr learned my addr 172.21.15.81:0/1026509205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575eaeb640 1 --2- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575e2ea640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580c58d0 0x7f57580c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575eaeb640 1 -- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 msgr2=0x7f57581552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575eaeb640 1 -- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 msgr2=0x7f57581552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575eaeb640 1 --2- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575eaeb640 1 --2- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 -- 172.21.15.81:0/1026509205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580c58d0 msgr2=0x7f57580c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580c58d0 0x7f57580c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 -- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 msgr2=0x7f57581552d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 --2- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.645+0000 7f575dae9640 1 -- 172.21.15.81:0/1026509205 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580c1730 con 0x7f5758066010 2024-05-08T20:38:56.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575dae9640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57580c5cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57580c6490 tx=0x7f574801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5d10519c44215 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575d2e8640 1 -- 172.21.15.81:0/1026509205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57480ad640 con 0x7f5758066010 2024-05-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575d2e8640 1 -- 172.21.15.81:0/1026509205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57480ad7a0 con 0x7f5758066010 2024-05-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575d2e8640 1 -- 172.21.15.81:0/1026509205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57480adb30 con 0x7f5758066010 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- 172.21.15.81:0/1026509205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 msgr2=0x7f57580c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57580c5cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57580c6490 tx=0x7f574801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- 172.21.15.81:0/1026509205 shutdown_connections 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- 172.21.15.81:0/1026509205 >> v2:172.21.15.117:3300/0 conn(0x7f5758154e40 0x7f57581552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57580c5cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- 172.21.15.81:0/1026509205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57580c58d0 0x7f57580c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- 172.21.15.81:0/1026509205 >> 172.21.15.81:0/1026509205 conn(0x7f57580c68c0 msgr2=0x7f57580c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- 172.21.15.81:0/1026509205 shutdown_connections 2024-05-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- 172.21.15.81:0/1026509205 wait complete. 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 Processor -- start 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- start start 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5758154e40 0x7f57581eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581ef110 con 0x7f5758066010 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581ef640 con 0x7f57580c58d0 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f576054e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758153890 con 0x7f5758154e40 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575e2ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575e2ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37110/0 (socket says 172.21.15.81:37110) 2024-05-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575e2ea640 1 -- 172.21.15.81:0/3773822898 learned_addr learned my addr 172.21.15.81:0/3773822898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575eaeb640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5758154e40 0x7f57581eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.649+0000 7f575dae9640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 msgr2=0x7f575815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 msgr2=0x7f575815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5758154e40 msgr2=0x7f57581eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5758154e40 0x7f57581eb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 msgr2=0x7f575815a420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 -- 172.21.15.81:0/3773822898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57480094d0 con 0x7f5758066010 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575e2ea640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f575400e8b0 tx=0x7f575400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400c940 con 0x7f5758066010 2024-05-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400caa0 con 0x7f5758066010 2024-05-08T20:38:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400ce10 con 0x7f5758066010 2024-05-08T20:38:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57581ef360 con 0x7f5758066010 2024-05-08T20:38:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5758153520 con 0x7f5758066010 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758074950 con 0x7f5758066010 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5754013470 con 0x7f5758066010 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 0x7f573c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5754084650 con 0x7f5758066010 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 0x7f573c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.653+0000 7f575dae9640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 0x7f573c068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f57480af000 tx=0x7f5748008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:38:56.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.657+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5754051760 con 0x7f5758066010 2024-05-08T20:38:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.917+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f57580c12c0 con 0x7f5758066010 2024-05-08T20:38:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.917+0000 7f574effd640 1 -- 172.21.15.81:0/3773822898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f5754017620 con 0x7f5758066010 2024-05-08T20:38:56.923 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":94,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:38:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 msgr2=0x7f573c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 0x7f573c068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f57480af000 tx=0x7f5748008040 comp rx=0 tx=0).stop 2024-05-08T20:38:56.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 msgr2=0x7f57581518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f575400e8b0 tx=0x7f575400ed70 comp rx=0 tx=0).stop 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 shutdown_connections 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f573c066690 0x7f573c068b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5758154e40 0x7f57581eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57580c58d0 0x7f575815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 --2- 172.21.15.81:0/3773822898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5758066010 0x7f57581518e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 >> 172.21.15.81:0/3773822898 conn(0x7f57580c68c0 msgr2=0x7f575806b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 shutdown_connections 2024-05-08T20:38:56.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:38:56.921+0000 7f576054e640 1 -- 172.21.15.81:0/3773822898 wait complete. 2024-05-08T20:38:59.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:39:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 Processor -- start 2024-05-08T20:39:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 -- start start 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 0x7f6d101588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10154cf0 0x7f6d10155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d10155690 0x7f6d100ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1006bb20 con 0x7f6d10155690 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d101548e0 con 0x7f6d10151f00 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d167c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10158e20 con 0x7f6d10154cf0 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d10155690 0x7f6d100ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d10155690 0x7f6d100ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41168/0 (socket says 172.21.15.81:41168) 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 -- 172.21.15.81:0/3469627188 learned_addr learned my addr 172.21.15.81:0/3469627188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10154cf0 0x7f6d10155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 -- 172.21.15.81:0/3469627188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10154cf0 msgr2=0x7f6d10155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10154cf0 0x7f6d10155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 -- 172.21.15.81:0/3469627188 >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 msgr2=0x7f6d101588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/3469627188 >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 0x7f6d101588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 --2- 172.21.15.81:0/3469627188 >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 0x7f6d101588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 -- 172.21.15.81:0/3469627188 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d101522e0 con 0x7f6d10155690 2024-05-08T20:39:00.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/3469627188 >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 0x7f6d101588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.081+0000 7f6d14d63640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10155690 0x7f6d100ca000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009e80 tx=0x7f6d0801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d418d5e204a3e360 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d0effd640 1 -- 172.21.15.81:0/3469627188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080a56d0 con 0x7f6d10155690 2024-05-08T20:39:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d0effd640 1 -- 172.21.15.81:0/3469627188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080a5830 con 0x7f6d10155690 2024-05-08T20:39:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d0effd640 1 -- 172.21.15.81:0/3469627188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080a5bc0 con 0x7f6d10155690 2024-05-08T20:39:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- 172.21.15.81:0/3469627188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10155690 msgr2=0x7f6d100ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10155690 0x7f6d100ca000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009e80 tx=0x7f6d0801c8b0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- 172.21.15.81:0/3469627188 shutdown_connections 2024-05-08T20:39:00.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10154cf0 0x7f6d10155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 --2- 172.21.15.81:0/3469627188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10155690 0x7f6d100ca000 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 --2- 172.21.15.81:0/3469627188 >> v2:172.21.15.117:3300/0 conn(0x7f6d10151f00 0x7f6d101588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- 172.21.15.81:0/3469627188 >> 172.21.15.81:0/3469627188 conn(0x7f6d100715f0 msgr2=0x7f6d10071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- 172.21.15.81:0/3469627188 shutdown_connections 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- 172.21.15.81:0/3469627188 wait complete. 2024-05-08T20:39:00.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 Processor -- start 2024-05-08T20:39:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.085+0000 7f6d167c6640 1 -- start start 2024-05-08T20:39:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10151f00 0x7f6d101579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101464c0 0x7f6d10146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10146eb0 con 0x7f6d10154cf0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10147370 con 0x7f6d101464c0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d101507a0 con 0x7f6d10151f00 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41184/0 (socket says 172.21.15.81:41184) 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/4190400500 learned_addr learned my addr 172.21.15.81:0/4190400500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10151f00 0x7f6d101579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d14d63640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101464c0 0x7f6d10146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10151f00 msgr2=0x7f6d101579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10151f00 0x7f6d101579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101464c0 msgr2=0x7f6d10146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101464c0 0x7f6d10146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 -- 172.21.15.81:0/4190400500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08009b30 con 0x7f6d10154cf0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0f7fe640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400b6c0 con 0x7f6d10154cf0 2024-05-08T20:39:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400b820 con 0x7f6d10154cf0 2024-05-08T20:39:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d10150a80 con 0x7f6d10154cf0 2024-05-08T20:39:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400bb90 con 0x7f6d10154cf0 2024-05-08T20:39:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d10147020 con 0x7f6d10154cf0 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d10150c70 con 0x7f6d10154cf0 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d0400bcf0 con 0x7f6d10154cf0 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6d04084990 con 0x7f6d10154cf0 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.089+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.093+0000 7f6d0ffff640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000a9a0 tx=0x7f6d00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.097+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6d040519f0 con 0x7f6d10154cf0 2024-05-08T20:39:00.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.365+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d10074950 con 0x7f6d10154cf0 2024-05-08T20:39:00.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d0cff9640 1 -- 172.21.15.81:0/4190400500 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f6d04055010 con 0x7f6d10154cf0 2024-05-08T20:39:00.369 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 msgr2=0x7f6cfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000a9a0 tx=0x7f6d00008040 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 msgr2=0x7f6d10158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d800 tx=0x7f6d0400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 shutdown_connections 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6cfc066690 0x7f6cfc068b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d101464c0 0x7f6d10146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d10154cf0 0x7f6d10158460 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 --2- 172.21.15.81:0/4190400500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d10151f00 0x7f6d101579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 >> 172.21.15.81:0/4190400500 conn(0x7f6d100715f0 msgr2=0x7f6d1015eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 shutdown_connections 2024-05-08T20:39:00.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.369+0000 7f6d167c6640 1 -- 172.21.15.81:0/4190400500 wait complete. 2024-05-08T20:39:00.390 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:39:00.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:39:00.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:39:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 Processor -- start 2024-05-08T20:39:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 -- start start 2024-05-08T20:39:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57900c30d0 0x7f57900c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57900c2bc0 0x7f57900c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5790155e10 con 0x7f57900a94b0 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579006e790 con 0x7f57900c30d0 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f5795434640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579006f460 con 0x7f57900c2bc0 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57900c30d0 0x7f57900c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57900c30d0 0x7f57900c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41186/0 (socket says 172.21.15.81:41186) 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 -- 172.21.15.81:0/96021117 learned_addr learned my addr 172.21.15.81:0/96021117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578e7fc640 1 --2- 172.21.15.81:0/96021117 >> v2:172.21.15.117:3300/0 conn(0x7f57900c2bc0 0x7f57900c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 -- 172.21.15.81:0/96021117 >> v2:172.21.15.117:3300/0 conn(0x7f57900c2bc0 msgr2=0x7f57900c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 --2- 172.21.15.81:0/96021117 >> v2:172.21.15.117:3300/0 conn(0x7f57900c2bc0 0x7f57900c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 -- 172.21.15.81:0/96021117 >> v1:172.21.15.117:6789/0 conn(0x7f57900a94b0 legacy=0x7f57900a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 -- 172.21.15.81:0/96021117 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790156080 con 0x7f57900c30d0 2024-05-08T20:39:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.521+0000 7f578effd640 1 --2- 172.21.15.81:0/96021117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f57900c34b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5790071050 tx=0x7f578001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a8ac297edc5ce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578dffb640 1 -- 172.21.15.81:0/96021117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800ab620 con 0x7f57900c30d0 2024-05-08T20:39:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578dffb640 1 -- 172.21.15.81:0/96021117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800ab780 con 0x7f57900c30d0 2024-05-08T20:39:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578dffb640 1 -- 172.21.15.81:0/96021117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800abb10 con 0x7f57900c30d0 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- 172.21.15.81:0/96021117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 msgr2=0x7f57900c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- 172.21.15.81:0/96021117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f57900c34b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5790071050 tx=0x7f578001c420 comp rx=0 tx=0).stop 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- 172.21.15.81:0/96021117 shutdown_connections 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- 172.21.15.81:0/96021117 >> v2:172.21.15.117:3300/0 conn(0x7f57900c2bc0 0x7f57900c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- 172.21.15.81:0/96021117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f57900c34b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- 172.21.15.81:0/96021117 >> 172.21.15.81:0/96021117 conn(0x7f57900c4cc0 msgr2=0x7f57900c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- 172.21.15.81:0/96021117 shutdown_connections 2024-05-08T20:39:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- 172.21.15.81:0/96021117 wait complete. 2024-05-08T20:39:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 Processor -- start 2024-05-08T20:39:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- start start 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 0x7f5790158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57900c2bc0 0x7f57901577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f5790146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900ad370 con 0x7f57900c30d0 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790159110 con 0x7f57900a94b0 2024-05-08T20:39:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f5795434640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579014a030 con 0x7f57900c2bc0 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f5790146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f5790146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41188/0 (socket says 172.21.15.81:41188) 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 learned_addr learned my addr 172.21.15.81:0/1153416342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 0x7f5790158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578e7fc640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57900c2bc0 0x7f57901577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578effd640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 msgr2=0x7f5790158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57900c2bc0 msgr2=0x7f57901577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578effd640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 msgr2=0x7f5790158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57900c2bc0 0x7f57901577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 0x7f5790158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 msgr2=0x7f5790158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 0x7f5790158bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57900a94b0 0x7f5790158bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800094d0 con 0x7f57900c30d0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f578f7fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f5790146b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f578800c780 tx=0x7f578800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.525+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788004b70 con 0x7f57900c30d0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800ce90 con 0x7f57900c30d0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57900ad550 con 0x7f57900c30d0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800a850 con 0x7f57900c30d0 2024-05-08T20:39:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57900adb10 con 0x7f57900c30d0 2024-05-08T20:39:00.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f5795434640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 0x7f5790147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790073ea0 con 0x7f57901470b0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 0x7f5790147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f578effd640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57900c4970 con 0x7f57901470b0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 0x7f5790147490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57900c3d60 tx=0x7f57800191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800abe40 con 0x7f57901470b0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f578800a9b0 con 0x7f57900c30d0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f577c066730 0x7f577c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f578e7fc640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f577c066730 0x7f577c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f57880846c0 con 0x7f57900c30d0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f57800b43f0 con 0x7f57901470b0 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 msgr2=0x7f5790147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 0x7f5790147490 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57900c3d60 tx=0x7f57800191c0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 msgr2=0x7f5790147490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f57777fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57901470b0 0x7f5790147490 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.529+0000 7f578e7fc640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f577c066730 0x7f577c068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f579006ebf0 tx=0x7f5784008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 0x7f5790148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900add30 con 0x7f5790148200 2024-05-08T20:39:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 0x7f5790148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f578effd640 1 -- 172.21.15.81:0/1153416342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5790074950 con 0x7f5790148200 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f578effd640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 0x7f5790148610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f578001c460 tx=0x7f5780009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800c5a90 con 0x7f5790148200 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f5780003620 con 0x7f5790148200 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 msgr2=0x7f5790148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 0x7f5790148610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f578001c460 tx=0x7f5780009240 comp rx=0 tx=0).stop 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 msgr2=0x7f5790148610 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f57777fe640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790148200 0x7f5790148610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:00.541 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:00.542 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:00.543 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:00.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:00.545 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:00.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:00.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.550 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.551 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:00.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:00.553 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f577c066730 msgr2=0x7f577c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f577c066730 0x7f577c068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f579006ebf0 tx=0x7f5784008040 comp rx=0 tx=0).stop 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 msgr2=0x7f5790146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 --2- 172.21.15.81:0/1153416342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57900c30d0 0x7f5790146b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f578800c780 tx=0x7f578800cc40 comp rx=0 tx=0).stop 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 reap_dead start 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f578f7fe640 1 -- 172.21.15.81:0/1153416342 reap_dead start 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 shutdown_connections 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 >> 172.21.15.81:0/1153416342 conn(0x7f57900c4cc0 msgr2=0x7f579014ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 shutdown_connections 2024-05-08T20:39:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.537+0000 7f5795434640 1 -- 172.21.15.81:0/1153416342 wait complete. 2024-05-08T20:39:00.556 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:00.556 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:39:00.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:39:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 Processor -- start 2024-05-08T20:39:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 -- start start 2024-05-08T20:39:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9c40a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40c1730 con 0x7ff9c406d130 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c4154b90 con 0x7ff9c40c47c0 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9cb4c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c1a10 con 0x7ff9c4155670 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c9264640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff9c406d130 0x7ff9c40bfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39602/0 (socket says 172.21.15.81:39602) 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c9264640 1 -- 172.21.15.81:0/112965923 learned_addr learned my addr 172.21.15.81:0/112965923 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9c40a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579986285 0 0) 0x7ff9c40c1730 con 0x7ff9c406d130 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b0003530 con 0x7ff9c406d130 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804818002 0 0) 0x7ff9b0003530 con 0x7ff9c406d130 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 msgr2=0x7ff9c40a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9c40a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 >> v1:172.21.15.117:6789/0 conn(0x7ff9c40c47c0 legacy=0x7ff9c41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4154e70 con 0x7ff9c406d130 2024-05-08T20:39:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff9c0001680 con 0x7ff9c406d130 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 >> v1:172.21.15.81:6789/0 conn(0x7ff9c406d130 legacy=0x7ff9c40bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b00039b0 0x7ff9b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c1a10 con 0x7ff9b00047d0 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000ba70 con 0x7ff9b00039b0 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000bc30 con 0x7ff9c4155670 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c9264640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b00039b0 0x7ff9b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 -- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 msgr2=0x7ff9b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 -- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b00039b0 msgr2=0x7ff9b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9b00039b0 0x7ff9b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c8a63640 1 -- 172.21.15.81:0/112965923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0003530 con 0x7ff9b00047d0 2024-05-08T20:39:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.681+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c4155670 0x7ff9b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9b0004c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009ab0 tx=0x7ff9b401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5c028c87e76353 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40a5510 con 0x7ff9b00047d0 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40a5670 con 0x7ff9b00047d0 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9bbfff640 1 -- 172.21.15.81:0/112965923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40a5a20 con 0x7ff9b00047d0 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/112965923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 msgr2=0x7ff9b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 --2- 172.21.15.81:0/112965923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9b0004c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009ab0 tx=0x7ff9b401ca30 comp rx=0 tx=0).stop 2024-05-08T20:39:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9c9a65640 1 -- 172.21.15.81:0/112965923 reap_dead start 2024-05-08T20:39:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/112965923 shutdown_connections 2024-05-08T20:39:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/112965923 >> 172.21.15.81:0/112965923 conn(0x7ff9c40c68c0 msgr2=0x7ff9c40c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/112965923 shutdown_connections 2024-05-08T20:39:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/112965923 wait complete. 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 Processor -- start 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.685+0000 7ff9cb4c8640 1 -- start start 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9c41de360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c41e1a60 0x7ff9c41df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 0x7ff9c41dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4071720 con 0x7ff9b00047d0 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4071a00 con 0x7ff9c41de8a0 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4071ce0 con 0x7ff9c41e1a60 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9c41de360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9c41de360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41232/0 (socket says 172.21.15.81:41232) 2024-05-08T20:39:00.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 -- 172.21.15.81:0/1862829768 learned_addr learned my addr 172.21.15.81:0/1862829768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 0x7ff9c41dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c41e1a60 0x7ff9c41df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 msgr2=0x7ff9c41dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 msgr2=0x7ff9c41dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 0x7ff9c41dfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c41e1a60 msgr2=0x7ff9c41df900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 0x7ff9c41dfe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9c41e1a60 0x7ff9c41df900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 msgr2=0x7ff9c41dfe40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41de8a0 0x7ff9c41dfe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4071fc0 con 0x7ff9b00047d0 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9264640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9c41de360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0001060 tx=0x7ff9c0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000fc20 con 0x7ff9b00047d0 2024-05-08T20:39:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c000fda0 con 0x7ff9b00047d0 2024-05-08T20:39:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40713b0 con 0x7ff9b00047d0 2024-05-08T20:39:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0015650 con 0x7ff9b00047d0 2024-05-08T20:39:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c41e0380 con 0x7ff9b00047d0 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4071540 con 0x7ff9c414f4f0 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:00.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9c00157b0 con 0x7ff9b00047d0 2024-05-08T20:39:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9a80666c0 0x7ff9a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9a80666c0 0x7ff9a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.689+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff9c0087880 con 0x7ff9b00047d0 2024-05-08T20:39:00.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.693+0000 7ff9c9a65640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9a80666c0 0x7ff9a8068b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40a6590 tx=0x7ff9bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.893+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.893+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:39:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.893+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:39:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.893+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:00.893+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:39:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:01.297+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:01.297+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:39:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:01.297+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:39:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:01.297+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:01.297+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:39:02.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9c40c00b0 con 0x7ff9c414f4f0 2024-05-08T20:39:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00057b0 tx=0x7ff9b0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40a5510 con 0x7ff9c414f4f0 2024-05-08T20:39:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff9b40bb070 con 0x7ff9c414f4f0 2024-05-08T20:39:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00057b0 tx=0x7ff9b0005800 comp rx=0 tx=0).stop 2024-05-08T20:39:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 msgr2=0x7ff9c41ed7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.101+0000 7ff9b9ffb640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c414f4f0 0x7ff9c41ed7b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.109+0000 7ff9cb4c8640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 0x7ff9c41ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.109+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4069550 con 0x7ff9c41edcf0 2024-05-08T20:39:02.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.109+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 0x7ff9c41ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9c8a63640 1 -- 172.21.15.81:0/1862829768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff9c41e0630 con 0x7ff9c41edcf0 2024-05-08T20:39:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9c8a63640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 0x7ff9c41ee100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000c10 tx=0x7ff9b4009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40ad940 con 0x7ff9c41edcf0 2024-05-08T20:39:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7ff9b40c5580 con 0x7ff9c41edcf0 2024-05-08T20:39:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 msgr2=0x7ff9c41ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 0x7ff9c41ee100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4000c10 tx=0x7ff9b4009190 comp rx=0 tx=0).stop 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 msgr2=0x7ff9c41ee100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9b9ffb640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9c41edcf0 0x7ff9c41ee100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:02.127 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:02.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9a80666c0 msgr2=0x7ff9a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff9a80666c0 0x7ff9a8068b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40a6590 tx=0x7ff9bc009040 comp rx=0 tx=0).stop 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 msgr2=0x7ff9c41de360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 --2- 172.21.15.81:0/1862829768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b00047d0 0x7ff9c41de360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0001060 tx=0x7ff9c0011de0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9c9a65640 1 -- 172.21.15.81:0/1862829768 reap_dead start 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9c9a65640 1 -- 172.21.15.81:0/1862829768 reap_dead start 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 shutdown_connections 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 >> 172.21.15.81:0/1862829768 conn(0x7ff9c40c68c0 msgr2=0x7ff9c40c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 shutdown_connections 2024-05-08T20:39:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.113+0000 7ff9cb4c8640 1 -- 172.21.15.81:0/1862829768 wait complete. 2024-05-08T20:39:02.132 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:02.132 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:39:02.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:39:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 Processor -- start 2024-05-08T20:39:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 -- start start 2024-05-08T20:39:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c151f00 0x7fbc0c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc0c154cf0 0x7fbc0c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c158e20 con 0x7fbc0c155690 2024-05-08T20:39:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c06bb20 con 0x7fbc0c154cf0 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc12181640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1548e0 con 0x7fbc0c151f00 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc03fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc0c154cf0 0x7fbc0c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc0bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbc0c155690 0x7fbc0c0ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39608/0 (socket says 172.21.15.81:39608) 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc0bfff640 1 -- 172.21.15.81:0/121634430 learned_addr learned my addr 172.21.15.81:0/121634430 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc0b7fe640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c151f00 0x7fbc0c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc03fff640 1 -- 172.21.15.81:0/121634430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c151f00 msgr2=0x7fbc0c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc03fff640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c151f00 0x7fbc0c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc03fff640 1 -- 172.21.15.81:0/121634430 >> v1:172.21.15.81:6789/0 conn(0x7fbc0c155690 legacy=0x7fbc0c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.245+0000 7fbc03fff640 1 -- 172.21.15.81:0/121634430 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c1522e0 con 0x7fbc0c154cf0 2024-05-08T20:39:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc03fff640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c154cf0 0x7fbc0c155150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097f0 tx=0x7fbbf401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54806fcda657d72d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc0affd640 1 -- 172.21.15.81:0/121634430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a56f0 con 0x7fbc0c154cf0 2024-05-08T20:39:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc0affd640 1 -- 172.21.15.81:0/121634430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40a5850 con 0x7fbc0c154cf0 2024-05-08T20:39:02.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc0affd640 1 -- 172.21.15.81:0/121634430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a5be0 con 0x7fbc0c154cf0 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- 172.21.15.81:0/121634430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c154cf0 msgr2=0x7fbc0c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c154cf0 0x7fbc0c155150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097f0 tx=0x7fbbf401bf80 comp rx=0 tx=0).stop 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- 172.21.15.81:0/121634430 shutdown_connections 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c154cf0 0x7fbc0c155150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 --2- 172.21.15.81:0/121634430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c151f00 0x7fbc0c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- 172.21.15.81:0/121634430 >> 172.21.15.81:0/121634430 conn(0x7fbc0c0715f0 msgr2=0x7fbc0c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- 172.21.15.81:0/121634430 shutdown_connections 2024-05-08T20:39:02.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- 172.21.15.81:0/121634430 wait complete. 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 Processor -- start 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.249+0000 7fbc12181640 1 -- start start 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 0x7fbc0c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c153480 0x7fbc0c1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c148910 0x7fbc0c148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1f33d0 con 0x7fbc0c151f00 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c152750 con 0x7fbc0c148910 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c152ff0 con 0x7fbc0c153480 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 0x7fbc0c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 0x7fbc0c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41248/0 (socket says 172.21.15.81:41248) 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 -- 172.21.15.81:0/967223946 learned_addr learned my addr 172.21.15.81:0/967223946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0bfff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c148910 0x7fbc0c148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c153480 msgr2=0x7fbc0c1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc03fff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c153480 0x7fbc0c1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c153480 0x7fbc0c1f2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c148910 msgr2=0x7fbc0c148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c148910 0x7fbc0c148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4009420 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc0b7fe640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 0x7fbc0c153e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00d830 tx=0x7fbbfc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00b660 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc00b7c0 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c154570 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00bb30 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c152c80 con 0x7fbc0c151f00 2024-05-08T20:39:02.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 0x7fbc0c146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c069600 con 0x7fbc0c155690 2024-05-08T20:39:02.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc03fff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 0x7fbc0c146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbbfc01e460 con 0x7fbc0c151f00 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc03fff640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc0c153130 con 0x7fbc0c155690 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.253+0000 7fbc08ff9640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbbec0666c0 0x7fbbec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbbfc084bc0 con 0x7fbc0c151f00 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc0bfff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbbec0666c0 0x7fbbec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc03fff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 0x7fbc0c146040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097c0 tx=0x7fbbf401a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a5570 con 0x7fbc0c155690 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc0bfff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbbec0666c0 0x7fbbec068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc040012f0 tx=0x7fbc04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbbf40a56d0 con 0x7fbc0c155690 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 msgr2=0x7fbc0c146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 0x7fbc0c146040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097c0 tx=0x7fbbf401a7c0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 msgr2=0x7fbc0c146040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.257+0000 7fbc08ff9640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c155690 0x7fbc0c146040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc12181640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 0x7fbc0c146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c152e70 con 0x7fbc0c1622a0 2024-05-08T20:39:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc03fff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 0x7fbc0c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc03fff640 1 -- 172.21.15.81:0/967223946 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbc0c0675e0 con 0x7fbc0c1622a0 2024-05-08T20:39:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc03fff640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 0x7fbc0c146580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097f0 tx=0x7fbbf4019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4003b30 con 0x7fbc0c1622a0 2024-05-08T20:39:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7fbbf4003c90 con 0x7fbc0c1622a0 2024-05-08T20:39:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 msgr2=0x7fbc0c146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 0x7fbc0c146580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097f0 tx=0x7fbbf4019040 comp rx=0 tx=0).stop 2024-05-08T20:39:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 msgr2=0x7fbc0c146580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.265+0000 7fbc08ff9640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c1622a0 0x7fbc0c146580 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097f0 tx=0x7fbbf4019040 comp rx=0 tx=0).stop 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.271 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:02.273 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:02.274 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:02.275 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:02.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.279 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:02.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:02.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:02.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:02.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:02.283 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:02.283 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbbec0666c0 msgr2=0x7fbbec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbbec0666c0 0x7fbbec068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc040012f0 tx=0x7fbc04009040 comp rx=0 tx=0).stop 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 msgr2=0x7fbc0c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 --2- 172.21.15.81:0/967223946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc0c151f00 0x7fbc0c153e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00d830 tx=0x7fbbfc00dcf0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc0bfff640 1 -- 172.21.15.81:0/967223946 reap_dead start 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc0bfff640 1 -- 172.21.15.81:0/967223946 reap_dead start 2024-05-08T20:39:02.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 shutdown_connections 2024-05-08T20:39:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 >> 172.21.15.81:0/967223946 conn(0x7fbc0c0715f0 msgr2=0x7fbc0c0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 shutdown_connections 2024-05-08T20:39:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.269+0000 7fbc12181640 1 -- 172.21.15.81:0/967223946 wait complete. 2024-05-08T20:39:02.288 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:02.288 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:39:02.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:39:02.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 Processor -- start 2024-05-08T20:39:02.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 -- start start 2024-05-08T20:39:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ca014fee0 0x7f9ca006f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9ca0071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca01502c0 con 0x7f9ca006f200 2024-05-08T20:39:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca00abc70 con 0x7f9ca014fee0 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca7ec7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca006d360 con 0x7f9ca0071290 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca5462640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9ca006f200 0x7f9ca006cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39616/0 (socket says 172.21.15.81:39616) 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca5462640 1 -- 172.21.15.81:0/3815582219 learned_addr learned my addr 172.21.15.81:0/3815582219 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca6464640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9ca0071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca5c63640 1 --2- 172.21.15.81:0/3815582219 >> v2:172.21.15.117:3300/0 conn(0x7f9ca014fee0 0x7f9ca006f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551055664 0 0) 0x7f9ca01502c0 con 0x7f9ca006f200 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c8c003530 con 0x7f9ca006f200 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044107369 0 0) 0x7f9c8c003530 con 0x7f9ca006f200 2024-05-08T20:39:02.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 msgr2=0x7f9ca0071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9ca0071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 >> v2:172.21.15.117:3300/0 conn(0x7f9ca014fee0 msgr2=0x7f9ca006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 --2- 172.21.15.81:0/3815582219 >> v2:172.21.15.117:3300/0 conn(0x7f9ca014fee0 0x7f9ca006f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00ab990 con 0x7f9ca006f200 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9c90001680 con 0x7f9ca006f200 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 >> v1:172.21.15.81:6789/0 conn(0x7f9ca006f200 legacy=0x7f9ca006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9c8c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c8c003f00 0x7f9c8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c8c004d10 0x7f9c8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00abc70 con 0x7f9c8c004d10 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.433+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca006d360 con 0x7f9c8c003f00 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c00b9e0 con 0x7f9ca0071290 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c8c004d10 0x7f9c8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca5462640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c8c003f00 0x7f9c8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca5c63640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9c8c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 -- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 msgr2=0x7f9c8c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca0071290 0x7f9c8c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 -- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c8c003f00 msgr2=0x7f9c8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c8c003f00 0x7f9c8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 -- 172.21.15.81:0/3815582219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c003530 con 0x7f9c8c004d10 2024-05-08T20:39:02.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca5462640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c8c003f00 0x7f9c8c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:39:02.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c8c004d10 0x7f9c8c005190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800e170 tx=0x7f9c9801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52e0ddaf06a5cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980a5c70 con 0x7f9c8c004d10 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9800f040 con 0x7f9c8c004d10 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca4c61640 1 -- 172.21.15.81:0/3815582219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980ad440 con 0x7f9c8c004d10 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/3815582219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c8c004d10 msgr2=0x7f9c8c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/3815582219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c8c004d10 0x7f9c8c005190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800e170 tx=0x7f9c9801cc60 comp rx=0 tx=0).stop 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca6464640 1 -- 172.21.15.81:0/3815582219 reap_dead start 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/3815582219 shutdown_connections 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/3815582219 >> 172.21.15.81:0/3815582219 conn(0x7f9ca00c2ca0 msgr2=0x7f9ca00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/3815582219 shutdown_connections 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.437+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/3815582219 wait complete. 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 Processor -- start 2024-05-08T20:39:02.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- start start 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ca0147540 0x7f9ca0147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca00c2570 0x7f9ca01e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00c2a30 con 0x7f9ca01e8940 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00c1920 con 0x7f9ca0147540 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01ec3b0 con 0x7f9ca00c2570 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41256/0 (socket says 172.21.15.81:41256) 2024-05-08T20:39:02.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 -- 172.21.15.81:0/4041287131 learned_addr learned my addr 172.21.15.81:0/4041287131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca5462640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca00c2570 0x7f9ca01e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca5c63640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ca0147540 0x7f9ca0147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 -- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca00c2570 msgr2=0x7f9ca01e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca00c2570 0x7f9ca01e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 -- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ca0147540 msgr2=0x7f9ca0147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ca0147540 0x7f9ca0147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 -- 172.21.15.81:0/4041287131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00c1bc0 con 0x7f9ca01e8940 2024-05-08T20:39:02.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca6464640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b0040 tx=0x7f9c98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980bc070 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c980039a0 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca01ec690 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98003b30 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00c54b0 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.441+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca0074950 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.445+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c980b4040 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.445+0000 7f9c967fc640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 0x7f9c84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.445+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9c9811e6a0 con 0x7f9ca01e8940 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.445+0000 7f9ca5c63640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 0x7f9c84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:02.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.445+0000 7f9ca5c63640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 0x7f9c84068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ab0 tx=0x7f9c9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:02.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.449+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9c980eb7b0 con 0x7f9ca01e8940 2024-05-08T20:39:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.705+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f9ca00a91a0 con 0x7f9ca01e8940 2024-05-08T20:39:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.705+0000 7f9c967fc640 1 -- 172.21.15.81:0/4041287131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f9c980b2080 con 0x7f9ca01e8940 2024-05-08T20:39:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 msgr2=0x7f9c84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 0x7f9c84068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009ab0 tx=0x7f9c9c008040 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 msgr2=0x7f9ca013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b0040 tx=0x7f9c98009750 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 shutdown_connections 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c84066690 0x7f9c84068b50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ca01e8940 0x7f9ca013ee90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ca00c2570 0x7f9ca01e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 --2- 172.21.15.81:0/4041287131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ca0147540 0x7f9ca0147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 >> 172.21.15.81:0/4041287131 conn(0x7f9ca00c2ca0 msgr2=0x7f9ca0151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 shutdown_connections 2024-05-08T20:39:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:02.709+0000 7f9ca7ec7640 1 -- 172.21.15.81:0/4041287131 wait complete. 2024-05-08T20:39:02.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:39:12.735 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:39:12.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:39:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 Processor -- start 2024-05-08T20:39:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 -- start start 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8ccc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ccc070c00 0x7f8ccc14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0c3a50 con 0x7f8ccc14edf0 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc072940 con 0x7f8ccc070c00 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd346b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0705e0 con 0x7f8ccc06b230 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd1a08640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ccc14edf0 0x7f8ccc1519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41522/0 (socket says 172.21.15.81:41522) 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd1a08640 1 -- 172.21.15.81:0/1216730471 learned_addr learned my addr 172.21.15.81:0/1216730471 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8ccc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1216730471 >> v2:172.21.15.117:3300/0 conn(0x7f8ccc070c00 0x7f8ccc14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290743762 0 0) 0x7f8ccc0c3a50 con 0x7f8ccc14edf0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb8003530 con 0x7f8ccc14edf0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089189999 0 0) 0x7f8cb8003530 con 0x7f8ccc14edf0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 msgr2=0x7f8ccc0c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8ccc0c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 >> v2:172.21.15.117:3300/0 conn(0x7f8ccc070c00 msgr2=0x7f8ccc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 --2- 172.21.15.81:0/1216730471 >> v2:172.21.15.117:3300/0 conn(0x7f8ccc070c00 0x7f8ccc14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0708c0 con 0x7f8ccc14edf0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8cc4001a00 con 0x7f8ccc14edf0 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 >> v1:172.21.15.81:6789/0 conn(0x7f8ccc14edf0 legacy=0x7f8ccc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8cb8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8cb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8004d10 0x7f8cb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc072940 con 0x7f8cb8003f00 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0705e0 con 0x7f8cb8004d10 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.877+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb800b9e0 con 0x7f8ccc06b230 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8cb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8cb8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd1a08640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8004d10 0x7f8cb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 -- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 msgr2=0x7f8cb8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8cb8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 -- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8004d10 msgr2=0x7f8cb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:12.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8004d10 0x7f8cb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 -- 172.21.15.81:0/1216730471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8003530 con 0x7f8cb8003f00 2024-05-08T20:39:12.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc06b230 0x7f8cb8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:12.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8cb80047d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009b10 tx=0x7f8cc801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9be678820089945 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80a56a0 con 0x7f8cb8003f00 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc80a5800 con 0x7f8cb8003f00 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cc3fff640 1 -- 172.21.15.81:0/1216730471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80a5bb0 con 0x7f8cb8003f00 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 -- 172.21.15.81:0/1216730471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 msgr2=0x7f8cb80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1216730471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8cb80047d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009b10 tx=0x7f8cc801cab0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd1a08640 1 -- 172.21.15.81:0/1216730471 reap_dead start 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 -- 172.21.15.81:0/1216730471 shutdown_connections 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 -- 172.21.15.81:0/1216730471 >> 172.21.15.81:0/1216730471 conn(0x7f8ccc0c71b0 msgr2=0x7f8ccc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 -- 172.21.15.81:0/1216730471 shutdown_connections 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.881+0000 7f8cd346b640 1 -- 172.21.15.81:0/1216730471 wait complete. 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 Processor -- start 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- start start 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc0acd10 0x7f8ccc141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ccc141fd0 0x7f8ccc1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c4f60 con 0x7f8cb8003f00 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc1eb770 con 0x7f8ccc141fd0 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0c5200 con 0x7f8ccc0acd10 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50356/0 (socket says 172.21.15.81:50356) 2024-05-08T20:39:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 -- 172.21.15.81:0/1592574621 learned_addr learned my addr 172.21.15.81:0/1592574621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc0acd10 0x7f8ccc141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1a08640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ccc141fd0 0x7f8ccc1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 -- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc0acd10 msgr2=0x7f8ccc141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc0acd10 0x7f8ccc141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 -- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ccc141fd0 msgr2=0x7f8ccc1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ccc141fd0 0x7f8ccc1433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 -- 172.21.15.81:0/1592574621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0c54e0 con 0x7f8cb8003f00 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd1207640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0108d0 tx=0x7f8cbc010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc004220 con 0x7f8cb8003f00 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc004380 con 0x7f8cb8003f00 2024-05-08T20:39:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00eba0 con 0x7f8cb8003f00 2024-05-08T20:39:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0c5ee0 con 0x7f8cb8003f00 2024-05-08T20:39:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc142450 con 0x7f8cb8003f00 2024-05-08T20:39:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.885+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0675e0 con 0x7f8cb8003f00 2024-05-08T20:39:12.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.889+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cbc00ed00 con 0x7f8cb8003f00 2024-05-08T20:39:12.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.889+0000 7f8cc1ffb640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 0x7f8cb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:12.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.889+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8cbc084360 con 0x7f8cb8003f00 2024-05-08T20:39:12.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.889+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 0x7f8cb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:12.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.889+0000 7f8cd0a06640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 0x7f8cb0068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80af000 tx=0x7f8cc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:12.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:12.893+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8cbc0513c0 con 0x7f8cb8003f00 2024-05-08T20:39:13.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.121+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8ccc1440f0 con 0x7f8cb8003f00 2024-05-08T20:39:13.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.121+0000 7f8cc1ffb640 1 -- 172.21.15.81:0/1592574621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f8cbc0549e0 con 0x7f8cb8003f00 2024-05-08T20:39:13.124 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 msgr2=0x7f8cb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 0x7f8cb0068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80af000 tx=0x7f8cc8008040 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 msgr2=0x7f8ccc0c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0108d0 tx=0x7f8cbc010d90 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 shutdown_connections 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8cb0066690 0x7f8cb0068b50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ccc141fd0 0x7f8ccc1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ccc0acd10 0x7f8ccc141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 --2- 172.21.15.81:0/1592574621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb8003f00 0x7f8ccc0c59a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 >> 172.21.15.81:0/1592574621 conn(0x7f8ccc0c71b0 msgr2=0x7f8ccc14b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 shutdown_connections 2024-05-08T20:39:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.125+0000 7f8cd346b640 1 -- 172.21.15.81:0/1592574621 wait complete. 2024-05-08T20:39:13.144 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:39:13.145 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:39:13.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:39:13.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:39:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 Processor -- start 2024-05-08T20:39:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 -- start start 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f3c0ca000 0x7f5f3c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c155860 con 0x7f5f3c154cf0 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c1522e0 con 0x7f5f3c151f00 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f414e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c06bb20 con 0x7f5f3c0ca000 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3a7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5f3c154cf0 0x7f5f3c155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41536/0 (socket says 172.21.15.81:41536) 2024-05-08T20:39:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3a7fc640 1 -- 172.21.15.81:0/4289158482 learned_addr learned my addr 172.21.15.81:0/4289158482 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/4289158482 >> v2:172.21.15.117:3300/0 conn(0x7f5f3c0ca000 0x7f5f3c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782837805 0 0) 0x7f5f3c155860 con 0x7f5f3c154cf0 2024-05-08T20:39:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003530 con 0x7f5f3c154cf0 2024-05-08T20:39:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988628697 0 0) 0x7f5f3c1522e0 con 0x7f5f3c151f00 2024-05-08T20:39:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f3c155860 con 0x7f5f3c151f00 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821344026 0 0) 0x7f5f24003530 con 0x7f5f3c154cf0 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 >> v2:172.21.15.117:3300/0 conn(0x7f5f3c0ca000 msgr2=0x7f5f3c0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 --2- 172.21.15.81:0/4289158482 >> v2:172.21.15.117:3300/0 conn(0x7f5f3c0ca000 0x7f5f3c0ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 >> v1:172.21.15.117:6789/0 conn(0x7f5f3c151f00 legacy=0x7f5f3c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0c5f80 con 0x7f5f3c154cf0 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f5f30001680 con 0x7f5f3c154cf0 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 >> v1:172.21.15.81:6789/0 conn(0x7f5f3c154cf0 legacy=0x7f5f3c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f24003b60 0x7f5f24003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240047d0 0x7f5f24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 0x7f5f2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2400c180 con 0x7f5f240052a0 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2400c2f0 con 0x7f5f24003b60 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2400c4b0 con 0x7f5f240047d0 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 0x7f5f2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3affd640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f24003b60 0x7f5f24003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3a7fc640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240047d0 0x7f5f24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 -- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240047d0 msgr2=0x7f5f24004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240047d0 0x7f5f24004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 -- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f24003b60 msgr2=0x7f5f24003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f24003b60 0x7f5f24003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.281+0000 7f5f3b7fe640 1 -- 172.21.15.81:0/4289158482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24003530 con 0x7f5f240052a0 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f3b7fe640 1 -- 172.21.15.81:0/4289158482 reap_dead start 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 0x7f5f2400b990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009fc0 tx=0x7f5f3401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43633589bf1421f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340a5cd0 con 0x7f5f240052a0 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400f040 con 0x7f5f240052a0 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f39ffb640 1 -- 172.21.15.81:0/4289158482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34003be0 con 0x7f5f240052a0 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 -- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 msgr2=0x7f5f2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 0x7f5f2400b990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009fc0 tx=0x7f5f3401ccc0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 -- 172.21.15.81:0/4289158482 shutdown_connections 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 --2- 172.21.15.81:0/4289158482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f240052a0 0x7f5f2400b990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 -- 172.21.15.81:0/4289158482 >> 172.21.15.81:0/4289158482 conn(0x7f5f3c0715f0 msgr2=0x7f5f3c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 -- 172.21.15.81:0/4289158482 shutdown_connections 2024-05-08T20:39:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.285+0000 7f5f414e1640 1 -- 172.21.15.81:0/4289158482 wait complete. 2024-05-08T20:39:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 Processor -- start 2024-05-08T20:39:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- start start 2024-05-08T20:39:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240052a0 0x7f5f3c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3c0c38a0 0x7f5f3c1ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c156ee0 con 0x7f5f3c158a60 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c14d150 con 0x7f5f3c0c38a0 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c155a50 con 0x7f5f240052a0 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50378/0 (socket says 172.21.15.81:50378) 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 -- 172.21.15.81:0/2371385680 learned_addr learned my addr 172.21.15.81:0/2371385680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3affd640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240052a0 0x7f5f3c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3c0c38a0 0x7f5f3c1ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240052a0 msgr2=0x7f5f3c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240052a0 0x7f5f3c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3c0c38a0 msgr2=0x7f5f3c1ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3c0c38a0 0x7f5f3c1ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c14cb90 con 0x7f5f3c158a60 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3a7fc640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000fe0 tx=0x7f5f3000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000c6c0 con 0x7f5f3c158a60 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000c840 con 0x7f5f3c158a60 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000cbf0 con 0x7f5f3c158a60 2024-05-08T20:39:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c14ce70 con 0x7f5f3c158a60 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c155d30 con 0x7f5f3c158a60 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 0x7f5f3c1ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c069600 con 0x7f5f3c0ca3e0 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3affd640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 0x7f5f3c1ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3affd640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f3c074950 con 0x7f5f3c0ca3e0 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f3affd640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 0x7f5f3c1ed270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003c30 tx=0x7f5f2c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.289+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f3000cd50 con 0x7f5f3c158a60 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f280666c0 0x7f5f28068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5f300842f0 con 0x7f5f3c158a60 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f280666c0 0x7f5f28068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c013570 con 0x7f5f3c0ca3e0 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5f2c0136d0 con 0x7f5f3c0ca3e0 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 msgr2=0x7f5f3c1ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 0x7f5f3c1ed270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003c30 tx=0x7f5f2c0017b0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 msgr2=0x7f5f3c1ed270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f237fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c0ca3e0 0x7f5f3c1ed270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.293+0000 7f5f3b7fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f280666c0 0x7f5f28068b80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c2c0 tx=0x7f5f34004ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f414e1640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 0x7f5f3c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c06ab10 con 0x7f5f3c14aac0 2024-05-08T20:39:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f3affd640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 0x7f5f3c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f3affd640 1 -- 172.21.15.81:0/2371385680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5f3c0c96e0 con 0x7f5f3c14aac0 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f3affd640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 0x7f5f3c14aed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003c30 tx=0x7f5f2c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.297+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c021070 con 0x7f5f3c14aac0 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f5f2c01ce10 con 0x7f5f3c14aac0 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 msgr2=0x7f5f3c14aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f237fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 0x7f5f3c14aed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c003c30 tx=0x7f5f2c000bd0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f237fe640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 msgr2=0x7f5f3c14aed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f237fe640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c14aac0 0x7f5f3c14aed0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:39:13.304 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.305 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.306 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:13.307 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.308 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.310 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.313 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.314 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.316 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f280666c0 msgr2=0x7f5f28068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5f280666c0 0x7f5f28068b80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c2c0 tx=0x7f5f34004ac0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 msgr2=0x7f5f3c150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000fe0 tx=0x7f5f3000ec10 comp rx=0 tx=0).stop 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f3b7fe640 1 -- 172.21.15.81:0/2371385680 reap_dead start 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 shutdown_connections 2024-05-08T20:39:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 --2- 172.21.15.81:0/2371385680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f3c158a60 0x7f5f3c150b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 >> 172.21.15.81:0/2371385680 conn(0x7f5f3c0715f0 msgr2=0x7f5f3c0a9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 shutdown_connections 2024-05-08T20:39:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.301+0000 7f5f414e1640 1 -- 172.21.15.81:0/2371385680 wait complete. 2024-05-08T20:39:13.319 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:13.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:39:13.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:39:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 Processor -- start 2024-05-08T20:39:13.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 -- start start 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81380c2570 0x7f8138154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 0x7f81381554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8138158080 con 0x7f8138152340 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813806ab70 con 0x7f81380c2570 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813e6d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8138154b10 con 0x7f81380c34e0 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81380c2570 0x7f8138154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81380c2570 0x7f8138154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50404/0 (socket says 172.21.15.81:50404) 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 -- 172.21.15.81:0/1000916898 learned_addr learned my addr 172.21.15.81:0/1000916898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813cc76640 1 --2- 172.21.15.81:0/1000916898 >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 0x7f81381554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 -- 172.21.15.81:0/1000916898 >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 msgr2=0x7f81381554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 --2- 172.21.15.81:0/1000916898 >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 0x7f81381554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 -- 172.21.15.81:0/1000916898 >> v1:172.21.15.117:6789/0 conn(0x7f8138152340 legacy=0x7f813806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f812ffff640 1 -- 172.21.15.81:0/1000916898 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813806a890 con 0x7f81380c2570 2024-05-08T20:39:13.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.433+0000 7f813cc76640 1 --2- 172.21.15.81:0/1000916898 >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 0x7f81381554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f812ffff640 1 --2- 172.21.15.81:0/1000916898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81380c2570 0x7f8138154f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81380c1780 tx=0x7f812001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d228fa43bb852a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f81377fe640 1 -- 172.21.15.81:0/1000916898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200ab620 con 0x7f81380c2570 2024-05-08T20:39:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f81377fe640 1 -- 172.21.15.81:0/1000916898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200ab780 con 0x7f81380c2570 2024-05-08T20:39:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f81377fe640 1 -- 172.21.15.81:0/1000916898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200abb10 con 0x7f81380c2570 2024-05-08T20:39:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- 172.21.15.81:0/1000916898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81380c2570 msgr2=0x7f8138154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- 172.21.15.81:0/1000916898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81380c2570 0x7f8138154f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81380c1780 tx=0x7f812001c420 comp rx=0 tx=0).stop 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- 172.21.15.81:0/1000916898 shutdown_connections 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- 172.21.15.81:0/1000916898 >> v2:172.21.15.117:3300/0 conn(0x7f81380c34e0 0x7f81381554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- 172.21.15.81:0/1000916898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81380c2570 0x7f8138154f60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- 172.21.15.81:0/1000916898 >> 172.21.15.81:0/1000916898 conn(0x7f81380c71b0 msgr2=0x7f81380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- 172.21.15.81:0/1000916898 shutdown_connections 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- 172.21.15.81:0/1000916898 wait complete. 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 Processor -- start 2024-05-08T20:39:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- start start 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81380c2570 0x7f81380c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81380c34e0 0x7f8138150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138156710 con 0x7f8138152340 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380c6f00 con 0x7f81380c34e0 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813e6d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81381573f0 con 0x7f81380c2570 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50420/0 (socket says 172.21.15.81:50420) 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 -- 172.21.15.81:0/3634686011 learned_addr learned my addr 172.21.15.81:0/3634686011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f812ffff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81380c34e0 0x7f8138150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f8137fff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81380c2570 0x7f81380c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81380c2570 msgr2=0x7f81380c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81380c2570 0x7f81380c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81380c34e0 msgr2=0x7f8138150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81380c34e0 0x7f8138150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.437+0000 7f813cc76640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200094d0 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f813cc76640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f813000cef0 tx=0x7f813000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000d840 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000d9c0 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000dd70 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81381576d0 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8138157c90 con 0x7f8138152340 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f813e6d9640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 0x7f81381f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138069550 con 0x7f81381516f0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f8137fff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 0x7f81381f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f813001e3b0 con 0x7f8138152340 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f8137fff640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81381559e0 con 0x7f81381516f0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8118066690 0x7f8118068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8130084f60 con 0x7f8138152340 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f812ffff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8118066690 0x7f8118068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f8137fff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 0x7f81381f0a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812800e450 tx=0x7f812800e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128007240 con 0x7f81381516f0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.441+0000 7f812ffff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8118066690 0x7f8118068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f81200af000 tx=0x7f81200a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.445+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f81280073a0 con 0x7f81381516f0 2024-05-08T20:39:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.445+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 msgr2=0x7f81381f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.445+0000 7f81357fa640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 0x7f81381f0a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812800e450 tx=0x7f812800e910 comp rx=0 tx=0).stop 2024-05-08T20:39:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.445+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 msgr2=0x7f81381f0a90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.445+0000 7f81357fa640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381516f0 0x7f81381f0a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f813e6d9640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 0x7f813813a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138157e80 con 0x7f81381f0fd0 2024-05-08T20:39:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f8137fff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 0x7f813813a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f8137fff640 1 -- 172.21.15.81:0/3634686011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f81380675e0 con 0x7f81381f0fd0 2024-05-08T20:39:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f8137fff640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 0x7f813813a890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f812800e450 tx=0x7f8128003770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.449+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812801eca0 con 0x7f81381f0fd0 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f812801ee00 con 0x7f81381f0fd0 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 msgr2=0x7f813813a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f81357fa640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 0x7f813813a890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f812800e450 tx=0x7f8128003770 comp rx=0 tx=0).stop 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f81357fa640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 msgr2=0x7f813813a890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f81357fa640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81381f0fd0 0x7f813813a890 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f812800e450 tx=0x7f8128003770 comp rx=0 tx=0).stop 2024-05-08T20:39:13.453 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:13.465 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8118066690 msgr2=0x7f8118068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8118066690 0x7f8118068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f81200af000 tx=0x7f81200a7000 comp rx=0 tx=0).stop 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 msgr2=0x7f81381f0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f813000cef0 tx=0x7f813000a710 comp rx=0 tx=0).stop 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813cc76640 1 -- 172.21.15.81:0/3634686011 reap_dead start 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 shutdown_connections 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 --2- 172.21.15.81:0/3634686011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8138152340 0x7f81381f0550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 >> 172.21.15.81:0/3634686011 conn(0x7f81380c71b0 msgr2=0x7f8138153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 shutdown_connections 2024-05-08T20:39:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.453+0000 7f813e6d9640 1 -- 172.21.15.81:0/3634686011 wait complete. 2024-05-08T20:39:13.472 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:13.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:39:13.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:39:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.589+0000 7f86a730e640 1 Processor -- start 2024-05-08T20:39:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.589+0000 7f86a730e640 1 -- start start 2024-05-08T20:39:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a730e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00c30d0 0x7f86a00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a730e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a00a94b0 0x7f86a00a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a730e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a0155e10 con 0x7f86a00c2bc0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a730e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a006e790 con 0x7f86a00a94b0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a730e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a006f460 con 0x7f86a00c30d0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a00a94b0 0x7f86a00a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a48a9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86a00c2bc0 0x7f86a00c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41548/0 (socket says 172.21.15.81:41548) 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a48a9640 1 -- 172.21.15.81:0/460861789 learned_addr learned my addr 172.21.15.81:0/460861789 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a50aa640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00c30d0 0x7f86a00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f8697fff640 1 -- 172.21.15.81:0/460861789 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281389777 0 0) 0x7f86a0155e10 con 0x7f86a00c2bc0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f8697fff640 1 -- 172.21.15.81:0/460861789 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003530 con 0x7f86a00c2bc0 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 -- 172.21.15.81:0/460861789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00c30d0 msgr2=0x7f86a00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00c30d0 0x7f86a00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 -- 172.21.15.81:0/460861789 >> v1:172.21.15.81:6789/0 conn(0x7f86a00c2bc0 legacy=0x7f86a00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 -- 172.21.15.81:0/460861789 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00a9e60 con 0x7f86a00a94b0 2024-05-08T20:39:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f86a58ab640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00a94b0 0x7f86a00a9920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8698009dc0 tx=0x7f869801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f62b338b43e6bbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f8697fff640 1 -- 172.21.15.81:0/460861789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980a5950 con 0x7f86a00a94b0 2024-05-08T20:39:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f8697fff640 1 -- 172.21.15.81:0/460861789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980a5ab0 con 0x7f86a00a94b0 2024-05-08T20:39:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.593+0000 7f8697fff640 1 -- 172.21.15.81:0/460861789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980a5e40 con 0x7f86a00a94b0 2024-05-08T20:39:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- 172.21.15.81:0/460861789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00a94b0 msgr2=0x7f86a00a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00a94b0 0x7f86a00a9920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8698009dc0 tx=0x7f869801c890 comp rx=0 tx=0).stop 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- 172.21.15.81:0/460861789 shutdown_connections 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00a94b0 0x7f86a00a9920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- 172.21.15.81:0/460861789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00c30d0 0x7f86a00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- 172.21.15.81:0/460861789 >> 172.21.15.81:0/460861789 conn(0x7f86a00c4cc0 msgr2=0x7f86a00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- 172.21.15.81:0/460861789 shutdown_connections 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- 172.21.15.81:0/460861789 wait complete. 2024-05-08T20:39:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 Processor -- start 2024-05-08T20:39:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- start start 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00a94b0 0x7f86a0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a00c2bc0 0x7f86a0145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 0x7f86a00ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00ac7f0 con 0x7f86a00c30d0 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00ab2d0 con 0x7f86a00c2bc0 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a730e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0149ea0 con 0x7f86a00a94b0 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 0x7f86a00ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 0x7f86a00ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50444/0 (socket says 172.21.15.81:50444) 2024-05-08T20:39:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 learned_addr learned my addr 172.21.15.81:0/1641271336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a50aa640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00a94b0 0x7f86a0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a48a9640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a00c2bc0 0x7f86a0145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00a94b0 msgr2=0x7f86a0146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a00a94b0 0x7f86a0146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a00c2bc0 msgr2=0x7f86a0145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a00c2bc0 0x7f86a0145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698009a70 con 0x7f86a00c30d0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f86a58ab640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 0x7f86a00ab760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f869801af40 tx=0x7f8698019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980adce0 con 0x7f86a00c30d0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980ade40 con 0x7f86a00c30d0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.597+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980b9670 con 0x7f86a00c30d0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a0149600 con 0x7f86a00c30d0 2024-05-08T20:39:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a0149bc0 con 0x7f86a00c30d0 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a730e640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 0x7f86a0142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0073ea0 con 0x7f86a0148cc0 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a50aa640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 0x7f86a0142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a50aa640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86a00c4970 con 0x7f86a0148cc0 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86980b97d0 con 0x7f86a00c30d0 2024-05-08T20:39:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a50aa640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 0x7f86a0142b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f869c0118d0 tx=0x7f869c011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8684066690 0x7f8684068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f869811fb70 con 0x7f86a00c30d0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a48a9640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8684066690 0x7f8684068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c004240 con 0x7f86a0148cc0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f86a48a9640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8684066690 0x7f8684068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f86a00c3b80 tx=0x7f8690009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f869c0043a0 con 0x7f86a0148cc0 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 msgr2=0x7f86a0142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 0x7f86a0142b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f869c0118d0 tx=0x7f869c011d90 comp rx=0 tx=0).stop 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 msgr2=0x7f86a0142b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.601+0000 7f8695ffb640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0148cc0 0x7f86a0142b40 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f869c0118d0 tx=0x7f869c011d90 comp rx=0 tx=0).stop 2024-05-08T20:39:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.609+0000 7f86a730e640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 0x7f86a01eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.609+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0143490 con 0x7f86a0143080 2024-05-08T20:39:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.609+0000 7f86a50aa640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 0x7f86a01eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.609+0000 7f86a50aa640 1 -- 172.21.15.81:0/1641271336 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f86a0074950 con 0x7f86a0143080 2024-05-08T20:39:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a50aa640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 0x7f86a01eaee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f869c0118d0 tx=0x7f869c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c01e450 con 0x7f86a0143080 2024-05-08T20:39:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f869c0133a0 con 0x7f86a0143080 2024-05-08T20:39:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 msgr2=0x7f86a01eaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 0x7f86a01eaee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f869c0118d0 tx=0x7f869c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 msgr2=0x7f86a01eaee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f8695ffb640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a0143080 0x7f86a01eaee0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 96, 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:39:13.615 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.616 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:13.619 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:13.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:13.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:13.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:13.626 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8684066690 msgr2=0x7f8684068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8684066690 0x7f8684068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f86a00c3b80 tx=0x7f8690009040 comp rx=0 tx=0).stop 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 msgr2=0x7f86a00ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 --2- 172.21.15.81:0/1641271336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a00c30d0 0x7f86a00ab760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f869801af40 tx=0x7f8698019630 comp rx=0 tx=0).stop 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 reap_dead start 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a58ab640 1 -- 172.21.15.81:0/1641271336 reap_dead start 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 shutdown_connections 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 >> 172.21.15.81:0/1641271336 conn(0x7f86a00c4cc0 msgr2=0x7f86a00c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 shutdown_connections 2024-05-08T20:39:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:13.613+0000 7f86a730e640 1 -- 172.21.15.81:0/1641271336 wait complete. 2024-05-08T20:39:13.633 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:39:13.634 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:39:13.634 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-05-08T20:39:13.634 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:39:13.634 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:39:13.634 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:39:13.634 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:39:13.652 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:39:13.652 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:39:13.652 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:39:13.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:39:22.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:39:22.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:39:28.653 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:39:28.653 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:39:28.653 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:39:28.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:39:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 Processor -- start 2024-05-08T20:39:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 -- start start 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c155e10 con 0x7f587c0a94b0 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c156080 con 0x7f587c0c2bc0 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f58818b9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c06e790 con 0x7f587c0c30d0 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f587affd640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 msgr2=0x7f587c0c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f587affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f587b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f587c0a94b0 0x7f587c0a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44438/0 (socket says 172.21.15.81:44438) 2024-05-08T20:39:28.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.785+0000 7f587b7fe640 1 -- 172.21.15.81:0/913766793 learned_addr learned my addr 172.21.15.81:0/913766793 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.989+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 msgr2=0x7f587c0c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:28.989+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:39:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:29.393+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 msgr2=0x7f587c0c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:29.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:29.393+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:39:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:30.197+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 msgr2=0x7f587c0c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:30.197+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 msgr2=0x7f587c0c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0c30d0 0x7f587c0c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 >> v1:172.21.15.117:6789/0 conn(0x7f587c0c2bc0 legacy=0x7f587c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 >> v1:172.21.15.81:6789/0 conn(0x7f587c0a94b0 legacy=0x7f587c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c06e790 con 0x7f58680061f0 2024-05-08T20:39:31.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5868008d70 con 0x7f5868003720 2024-05-08T20:39:31.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:31.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:31.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:39:31.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.785+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:39:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:39:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:39:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:31.989+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:39:32.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:32.393+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:39:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:39:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587a7fc640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587a7fc640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:39:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:33.197+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 msgr2=0x7f5868005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.117:3300/0 conn(0x7f5868003720 0x7f5868005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 msgr2=0x7f58680086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f58680086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f587b7fe640 1 -- 172.21.15.81:0/913766793 reap_dead start 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f5868008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c156360 con 0x7f587c0a94b0 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586800f070 con 0x7f5868003b50 2024-05-08T20:39:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5878ff9640 1 -- 172.21.15.81:0/913766793 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c06e790 con 0x7f58680061f0 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> v2:172.21.15.81:3300/0 conn(0x7f58680061f0 0x7f5868008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103360049 0 0) 0x7f587c156360 con 0x7f587c0a94b0 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5864003530 con 0x7f587c0a94b0 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v1:172.21.15.117:6789/0 conn(0x7f5868003b50 legacy=0x7f586800c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 >> v1:172.21.15.81:6789/0 conn(0x7f587c0a94b0 legacy=0x7f586800b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976100751 0 0) 0x7f586800f070 con 0x7f5868003b50 2024-05-08T20:39:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.785+0000 7f587affd640 1 -- 172.21.15.81:0/913766793 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868010260 con 0x7f58680061f0 2024-05-08T20:39:34.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f587affd640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f5868008630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f586c003940 tx=0x7f586c01d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78047176f75a74c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:34.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c006ea0 con 0x7f58680061f0 2024-05-08T20:39:34.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0a8030 con 0x7f58680061f0 2024-05-08T20:39:34.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f5879ffb640 1 -- 172.21.15.81:0/913766793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ae410 con 0x7f58680061f0 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 -- 172.21.15.81:0/913766793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 msgr2=0x7f5868008630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f5868008630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f586c003940 tx=0x7f586c01d4f0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 -- 172.21.15.81:0/913766793 shutdown_connections 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 --2- 172.21.15.81:0/913766793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f5868008630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 -- 172.21.15.81:0/913766793 >> 172.21.15.81:0/913766793 conn(0x7f587c0c4cc0 msgr2=0x7f587c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 -- 172.21.15.81:0/913766793 shutdown_connections 2024-05-08T20:39:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.793+0000 7f58818b9640 1 -- 172.21.15.81:0/913766793 wait complete. 2024-05-08T20:39:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.797+0000 7f58818b9640 1 Processor -- start 2024-05-08T20:39:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.797+0000 7f58818b9640 1 -- start start 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 0x7f587c1eb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 0x7f587c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c13d8c0 con 0x7f58680061f0 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0c7dd0 con 0x7f5868003b50 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0c6ee0 con 0x7f587c0a94b0 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35812/0 (socket says 172.21.15.81:35812) 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587b7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 msgr2=0x7f587c14c2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 -- 172.21.15.81:0/3570890017 learned_addr learned my addr 172.21.15.81:0/3570890017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:34.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587b7fe640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 0x7f587c14c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587affd640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 0x7f587c1eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 -- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 msgr2=0x7f587c14c2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 0x7f587c14c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 -- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 msgr2=0x7f587c1eb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 0x7f587c1eb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 -- 172.21.15.81:0/3570890017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c009af0 con 0x7f58680061f0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587affd640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 0x7f587c1eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f587a7fc640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f58700125d0 tx=0x7f5870012a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700052e0 con 0x7f58680061f0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870005460 con 0x7f58680061f0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0c71c0 con 0x7f58680061f0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870003840 con 0x7f58680061f0 2024-05-08T20:39:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.801+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0c7780 con 0x7f58680061f0 2024-05-08T20:39:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c074950 con 0x7f58680061f0 2024-05-08T20:39:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58700039a0 con 0x7f58680061f0 2024-05-08T20:39:34.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f5863fff640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 0x7f5868069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:34.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5870084930 con 0x7f58680061f0 2024-05-08T20:39:34.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f587affd640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 0x7f5868069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:34.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.805+0000 7f587affd640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 0x7f5868069ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f587c066af0 tx=0x7f586c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:34.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:34.813+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5870051990 con 0x7f58680061f0 2024-05-08T20:39:35.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.097+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f587c06ebd0 con 0x7f58680061f0 2024-05-08T20:39:35.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f5863fff640 1 -- 172.21.15.81:0/3570890017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f5870023620 con 0x7f58680061f0 2024-05-08T20:39:35.101 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":98,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 msgr2=0x7f5868069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 0x7f5868069ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f587c066af0 tx=0x7f586c0a7000 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 msgr2=0x7f587c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f58700125d0 tx=0x7f5870012a90 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 shutdown_connections 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5868067820 0x7f5868069ce0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587c0a94b0 0x7f587c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58680061f0 0x7f587c154c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 --2- 172.21.15.81:0/3570890017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5868003b50 0x7f587c1eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 >> 172.21.15.81:0/3570890017 conn(0x7f587c0c4cc0 msgr2=0x7f587c151230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 shutdown_connections 2024-05-08T20:39:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.101+0000 7f58818b9640 1 -- 172.21.15.81:0/3570890017 wait complete. 2024-05-08T20:39:35.121 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:39:35.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:39:35.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:39:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 Processor -- start 2024-05-08T20:39:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 -- start start 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe63806a6d0 0x7fe63815e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe638152ab0 con 0x7fe638155e90 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe638152d90 con 0x7fe63814fe70 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe63dd2d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6381528a0 con 0x7fe63806a6d0 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe636ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe638155e90 0x7fe638069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44458/0 (socket says 172.21.15.81:44458) 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe636ffd640 1 -- 172.21.15.81:0/4125400379 learned_addr learned my addr 172.21.15.81:0/4125400379 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe637fff640 1 --2- 172.21.15.81:0/4125400379 >> v2:172.21.15.117:3300/0 conn(0x7fe63806a6d0 0x7fe63815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522589039 0 0) 0x7fe638152ab0 con 0x7fe638155e90 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe620003530 con 0x7fe638155e90 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281896390 0 0) 0x7fe620003530 con 0x7fe638155e90 2024-05-08T20:39:35.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 >> v2:172.21.15.117:3300/0 conn(0x7fe63806a6d0 msgr2=0x7fe63815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 --2- 172.21.15.81:0/4125400379 >> v2:172.21.15.117:3300/0 conn(0x7fe63806a6d0 0x7fe63815e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 >> v1:172.21.15.117:6789/0 conn(0x7fe63814fe70 legacy=0x7fe63806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638153070 con 0x7fe638155e90 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe62c001680 con 0x7fe638155e90 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 >> v1:172.21.15.81:6789/0 conn(0x7fe638155e90 legacy=0x7fe638069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 0x7fe620003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6200047d0 0x7fe620004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6200052b0 0x7fe62000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381528a0 con 0x7fe620003980 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe620010590 con 0x7fe6200047d0 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe620010750 con 0x7fe6200052b0 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe637fff640 1 -- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6200052b0 msgr2=0x7fe62000fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:35.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 0x7fe620003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe637fff640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6200052b0 0x7fe62000fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 -- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6200052b0 msgr2=0x7fe62000fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6200052b0 0x7fe62000fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 -- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6200047d0 msgr2=0x7fe620004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6200047d0 0x7fe620004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe637fff640 1 -- 172.21.15.81:0/4125400379 reap_dead start 2024-05-08T20:39:35.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.249+0000 7fe6377fe640 1 -- 172.21.15.81:0/4125400379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620003530 con 0x7fe620003980 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe6377fe640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 0x7fe620003da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe628001750 tx=0x7fe62801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c780adaf8416605c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280050d0 con 0x7fe620003980 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6280a7050 con 0x7fe620003980 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe6367fc640 1 -- 172.21.15.81:0/4125400379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628005490 con 0x7fe620003980 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 -- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 msgr2=0x7fe620003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 0x7fe620003da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe628001750 tx=0x7fe62801c370 comp rx=0 tx=0).stop 2024-05-08T20:39:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 -- 172.21.15.81:0/4125400379 shutdown_connections 2024-05-08T20:39:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/4125400379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620003980 0x7fe620003da0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 -- 172.21.15.81:0/4125400379 >> 172.21.15.81:0/4125400379 conn(0x7fe6380c71b0 msgr2=0x7fe6380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 -- 172.21.15.81:0/4125400379 shutdown_connections 2024-05-08T20:39:35.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.253+0000 7fe63dd2d640 1 -- 172.21.15.81:0/4125400379 wait complete. 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 Processor -- start 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- start start 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe620003980 0x7fe6380bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 0x7fe6380bf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6380bf6d0 0x7fe6381ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381ed070 con 0x7fe6380bc960 2024-05-08T20:39:35.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6381ecd90 con 0x7fe620003980 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380c10a0 con 0x7fe6380bf6d0 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 0x7fe6380bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 0x7fe6380bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35828/0 (socket says 172.21.15.81:35828) 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 -- 172.21.15.81:0/576749543 learned_addr learned my addr 172.21.15.81:0/576749543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe637fff640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6380bf6d0 msgr2=0x7fe6381ec0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe637fff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6380bf6d0 0x7fe6381ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe620003980 0x7fe6380bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6380bf6d0 msgr2=0x7fe6381ec0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6380bf6d0 0x7fe6381ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe620003980 msgr2=0x7fe6380bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe620003980 0x7fe6380bcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380c1380 con 0x7fe6380bc960 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe620003980 0x7fe6380bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe636ffd640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 0x7fe6380bf190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0011f0 tx=0x7fe62c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0072d0 con 0x7fe6380bc960 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c007430 con 0x7fe6380bc960 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380c6c50 con 0x7fe6380bc960 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0047f0 con 0x7fe6380bc960 2024-05-08T20:39:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6381ec7f0 con 0x7fe6380bc960 2024-05-08T20:39:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 0x7fe6380c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638069550 con 0x7fe6380c57d0 2024-05-08T20:39:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 0x7fe6380c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe6377fe640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6381ecf00 con 0x7fe6380c57d0 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 0x7fe6380c5bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe628004000 tx=0x7fe620005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.257+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe62c004950 con 0x7fe6380bc960 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe624066640 0x7fe624068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe62c083700 con 0x7fe6380bc960 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe637fff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe624066640 0x7fe624068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628007300 con 0x7fe6380c57d0 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe628007460 con 0x7fe6380c57d0 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 msgr2=0x7fe6380c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 0x7fe6380c5bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe628004000 tx=0x7fe620005800 comp rx=0 tx=0).stop 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 msgr2=0x7fe6380c5bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe61ffff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c57d0 0x7fe6380c5bb0 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe628004000 tx=0x7fe620005800 comp rx=0 tx=0).stop 2024-05-08T20:39:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.261+0000 7fe637fff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe624066640 0x7fe624068b00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe63806fd80 tx=0x7fe63000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.265+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 0x7fe6381e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.265+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380c6500 con 0x7fe6380c60f0 2024-05-08T20:39:35.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.265+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 0x7fe6381e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe6377fe640 1 -- 172.21.15.81:0/576749543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe6380c1210 con 0x7fe6380c60f0 2024-05-08T20:39:35.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe6377fe640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 0x7fe6381e8af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe62801c1a0 tx=0x7fe6280a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280c4070 con 0x7fe6380c60f0 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4966 (secure 0 0 0) 0x7fe628004aa0 con 0x7fe6380c60f0 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 msgr2=0x7fe6381e8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 0x7fe6381e8af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe62801c1a0 tx=0x7fe6280a6000 comp rx=0 tx=0).stop 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 msgr2=0x7fe6381e8af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe61ffff640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380c60f0 0x7fe6381e8af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:35.270 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 98, 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.271 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:35.276 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.279 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.280 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.281 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:39:35.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.283 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:35.283 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe624066640 msgr2=0x7fe624068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe624066640 0x7fe624068b00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe63806fd80 tx=0x7fe63000b040 comp rx=0 tx=0).stop 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 msgr2=0x7fe6380bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 --2- 172.21.15.81:0/576749543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380bc960 0x7fe6380bf190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0011f0 tx=0x7fe62c00cb90 comp rx=0 tx=0).stop 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe637fff640 1 -- 172.21.15.81:0/576749543 reap_dead start 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe637fff640 1 -- 172.21.15.81:0/576749543 reap_dead start 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 shutdown_connections 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 >> 172.21.15.81:0/576749543 conn(0x7fe6380c71b0 msgr2=0x7fe638156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 shutdown_connections 2024-05-08T20:39:35.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.269+0000 7fe63dd2d640 1 -- 172.21.15.81:0/576749543 wait complete. 2024-05-08T20:39:35.287 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:39:35.287 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:39:35.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:39:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 Processor -- start 2024-05-08T20:39:35.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 -- start start 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f016406b230 0x7f01640c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 0x7f016414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01640c3a50 con 0x7f016414edf0 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0164072940 con 0x7f016406b230 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f016bcba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01640705e0 con 0x7f0164070c00 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f016406b230 0x7f01640c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f016406b230 0x7f01640c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35850/0 (socket says 172.21.15.81:35850) 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 -- 172.21.15.81:0/3009120542 learned_addr learned my addr 172.21.15.81:0/3009120542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:35.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169255640 1 --2- 172.21.15.81:0/3009120542 >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 0x7f016414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 -- 172.21.15.81:0/3009120542 >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 msgr2=0x7f016414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:35.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 --2- 172.21.15.81:0/3009120542 >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 0x7f016414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 -- 172.21.15.81:0/3009120542 >> v1:172.21.15.117:6789/0 conn(0x7f016414edf0 legacy=0x7f01641519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:39:35.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169a56640 1 -- 172.21.15.81:0/3009120542 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640708c0 con 0x7f016406b230 2024-05-08T20:39:35.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.417+0000 7f0169255640 1 --2- 172.21.15.81:0/3009120542 >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 0x7f016414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:39:35.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0169a56640 1 --2- 172.21.15.81:0/3009120542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f016406b230 0x7f01640c2800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f016406bd60 tx=0x7f016001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a87ab1957c64135 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0168a54640 1 -- 172.21.15.81:0/3009120542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600ab670 con 0x7f016406b230 2024-05-08T20:39:35.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0168a54640 1 -- 172.21.15.81:0/3009120542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600ab7d0 con 0x7f016406b230 2024-05-08T20:39:35.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0168a54640 1 -- 172.21.15.81:0/3009120542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600abb60 con 0x7f016406b230 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- 172.21.15.81:0/3009120542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f016406b230 msgr2=0x7f01640c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- 172.21.15.81:0/3009120542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f016406b230 0x7f01640c2800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f016406bd60 tx=0x7f016001c450 comp rx=0 tx=0).stop 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- 172.21.15.81:0/3009120542 shutdown_connections 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- 172.21.15.81:0/3009120542 >> v2:172.21.15.117:3300/0 conn(0x7f0164070c00 0x7f016414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- 172.21.15.81:0/3009120542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f016406b230 0x7f01640c2800 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f016406bd60 tx=0x7f016001c450 comp rx=0 tx=0).stop 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- 172.21.15.81:0/3009120542 >> 172.21.15.81:0/3009120542 conn(0x7f01640c71b0 msgr2=0x7f01640c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- 172.21.15.81:0/3009120542 shutdown_connections 2024-05-08T20:39:35.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- 172.21.15.81:0/3009120542 wait complete. 2024-05-08T20:39:35.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 Processor -- start 2024-05-08T20:39:35.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- start start 2024-05-08T20:39:35.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0164070c00 0x7f01640aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f016414edf0 0x7f0164147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 0x7f0164146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016414a5b0 con 0x7f0164147a50 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0164156d70 con 0x7f016414edf0 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016bcba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0164149970 con 0x7f0164070c00 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0169a56640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0164070c00 msgr2=0x7f01640aa420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016a257640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 0x7f0164146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0169a56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0164070c00 0x7f01640aa420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016a257640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 0x7f0164146830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35860/0 (socket says 172.21.15.81:35860) 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 learned_addr learned my addr 172.21.15.81:0/178517111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.421+0000 7f0169255640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f016414edf0 0x7f0164147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0164070c00 msgr2=0x7f01640aa420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0164070c00 0x7f01640aa420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f016414edf0 msgr2=0x7f0164147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f016414edf0 0x7f0164147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600094d0 con 0x7f0164147a50 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016a257640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 0x7f0164146830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f015c00b9a0 tx=0x7f015c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c00cb40 con 0x7f0164147a50 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c00cca0 con 0x7f0164147a50 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0164149c10 con 0x7f0164147a50 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c014680 con 0x7f0164147a50 2024-05-08T20:39:35.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016414a1d0 con 0x7f0164147a50 2024-05-08T20:39:35.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016bcba640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 0x7f01641ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0164069550 con 0x7f0164146d70 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f0169a56640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 0x7f01641ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f0169a56640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f016406add0 con 0x7f0164146d70 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f015c01d3b0 con 0x7f0164147a50 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f0169a56640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 0x7f01641ec950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01640c2d40 tx=0x7f016001ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0148066640 0x7f0148068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f015c0842c0 con 0x7f0164147a50 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f0169255640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0148066640 0x7f0148068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600abb40 con 0x7f0164146d70 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f0169255640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0148066640 0x7f0148068b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0164070210 tx=0x7f0154008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f01600b8070 con 0x7f0164146d70 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 msgr2=0x7f01641ec950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 0x7f01641ec950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01640c2d40 tx=0x7f016001ac90 comp rx=0 tx=0).stop 2024-05-08T20:39:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 msgr2=0x7f01641ec950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.425+0000 7f015a7fc640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0164146d70 0x7f01641ec950 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01640c2d40 tx=0x7f016001ac90 comp rx=0 tx=0).stop 2024-05-08T20:39:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.433+0000 7f016bcba640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 0x7f01640c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:39:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.433+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0164149da0 con 0x7f01640c1bd0 2024-05-08T20:39:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.433+0000 7f0169a56640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 0x7f01640c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:39:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f0169a56640 1 -- 172.21.15.81:0/178517111 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0164152700 con 0x7f01640c1bd0 2024-05-08T20:39:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f0169a56640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 0x7f01640c1fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0160000c10 tx=0x7f01600191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:39:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600c5880 con 0x7f01640c1bd0 2024-05-08T20:39:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4454 (secure 0 0 0) 0x7f01600068a0 con 0x7f01640c1bd0 2024-05-08T20:39:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 msgr2=0x7f01640c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 0x7f01640c1fe0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0160000c10 tx=0x7f01600191f0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 msgr2=0x7f01640c1fe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f015a7fc640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01640c1bd0 0x7f01640c1fe0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 98, 2024-05-08T20:39:35.439 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:39:35.443 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:39:35.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:39:35.445 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:39:35.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:39:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:39:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:39:35.451 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:39:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0148066640 msgr2=0x7f0148068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0148066640 0x7f0148068b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0164070210 tx=0x7f0154008040 comp rx=0 tx=0).stop 2024-05-08T20:39:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 msgr2=0x7f0164146830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:39:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 --2- 172.21.15.81:0/178517111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0164147a50 0x7f0164146830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f015c00b9a0 tx=0x7f015c00be60 comp rx=0 tx=0).stop 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 reap_dead start 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016a257640 1 -- 172.21.15.81:0/178517111 reap_dead start 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 shutdown_connections 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 >> 172.21.15.81:0/178517111 conn(0x7f01640c71b0 msgr2=0x7f016414bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 shutdown_connections 2024-05-08T20:39:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:39:35.437+0000 7f016bcba640 1 -- 172.21.15.81:0/178517111 wait complete. 2024-05-08T20:39:35.456 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:39:35.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:39:52.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:39:52.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:39:55.457 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:39:55.458 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:39:55.458 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:39:55.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:39:55.461 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:39:55.461 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-05-08T20:39:55.461 INFO:tasks.ceph.mon.b:Sent signal 19 2024-05-08T20:39:55.461 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:40:10.462 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-05-08T20:40:10.463 INFO:tasks.ceph.mon.b:Sent signal 18 2024-05-08T20:40:10.463 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:40:10.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:40:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.592+0000 7f5cb814f640 1 Processor -- start 2024-05-08T20:40:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.592+0000 7f5cb814f640 1 -- start start 2024-05-08T20:40:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb814f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb814f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb814f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb0158080 con 0x7f5cb006d7d0 2024-05-08T20:40:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb814f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb006ab70 con 0x7f5cb0152340 2024-05-08T20:40:10.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb814f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0154b10 con 0x7f5cb00c2570 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb66ec640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5cb006d7d0 0x7f5cb01554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50428/0 (socket says 172.21.15.81:50428) 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb66ec640 1 -- 172.21.15.81:0/4166163519 learned_addr learned my addr 172.21.15.81:0/4166163519 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:10.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.596+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:10.800+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:11.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:11.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:11.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:11.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:11.204+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:40:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb56ea640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:12.008+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 msgr2=0x7f5cb0154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb00c2570 0x7f5cb0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 msgr2=0x7f5cb006d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.117:3300/0 conn(0x7f5cb0152340 0x7f5cb006d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 -- 172.21.15.81:0/4166163519 >> v1:172.21.15.81:6789/0 conn(0x7f5cb006d7d0 legacy=0x7f5cb01554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 -- 172.21.15.81:0/4166163519 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb006a890 con 0x7f5c94006180 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5ca77fe640 1 -- 172.21.15.81:0/4166163519 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb006ab70 con 0x7f5c940036d0 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.596+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.800+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.800+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:13.800+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:14.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:14.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:14.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:14.204+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:14.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:14.204+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:14.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:14.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:14.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:14.204+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:15.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.008+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> v2:172.21.15.81:3300/0 conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.008+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 >> v1:172.21.15.117:6789/0 conn(0x7f5c94006180 legacy=0x7f5c94008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:15.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.008+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/4166163519 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9400af10 con 0x7f5c940036d0 2024-05-08T20:40:15.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.012+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5c94005b30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000ee0 tx=0x7f5cac01da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81733bf763010ab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:15.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.012+0000 7f5cb4ee9640 1 -- 172.21.15.81:0/4166163519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0a69d0 con 0x7f5c940036d0 2024-05-08T20:40:15.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.012+0000 7f5cb4ee9640 1 -- 172.21.15.81:0/4166163519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac0aa070 con 0x7f5c940036d0 2024-05-08T20:40:15.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.012+0000 7f5cb4ee9640 1 -- 172.21.15.81:0/4166163519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0a69d0 con 0x7f5c940036d0 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 -- 172.21.15.81:0/4166163519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 msgr2=0x7f5c94005b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5c94005b30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000ee0 tx=0x7f5cac01da90 comp rx=0 tx=0).stop 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb66ec640 1 -- 172.21.15.81:0/4166163519 reap_dead start 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 -- 172.21.15.81:0/4166163519 shutdown_connections 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 --2- 172.21.15.81:0/4166163519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5c94005b30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 -- 172.21.15.81:0/4166163519 >> 172.21.15.81:0/4166163519 conn(0x7f5cb00c71b0 msgr2=0x7f5cb00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 -- 172.21.15.81:0/4166163519 shutdown_connections 2024-05-08T20:40:15.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.016+0000 7f5cb814f640 1 -- 172.21.15.81:0/4166163519 wait complete. 2024-05-08T20:40:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 Processor -- start 2024-05-08T20:40:15.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- start start 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0147f70 con 0x7f5c940036d0 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01574b0 con 0x7f5cb0147af0 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0157cc0 con 0x7f5cb0153e20 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58748/0 (socket says 172.21.15.81:58748) 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/99526971 learned_addr learned my addr 172.21.15.81:0/99526971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb66ec640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:15.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb66ec640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 msgr2=0x7f5cb01f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb66ec640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 msgr2=0x7f5cb01f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb66ec640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb66ec640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb56ea640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 msgr2=0x7f5cb01538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb56ea640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 msgr2=0x7f5cb01538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 msgr2=0x7f5cb01f1060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 msgr2=0x7f5cb01538e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 -- 172.21.15.81:0/99526971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac00e040 con 0x7f5c940036d0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb5eeb640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0075a0 tx=0x7f5cac007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0b7070 con 0x7f5c940036d0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb013f060 con 0x7f5c940036d0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac00c040 con 0x7f5c940036d0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0b0650 con 0x7f5c940036d0 2024-05-08T20:40:15.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.020+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb01579e0 con 0x7f5c940036d0 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb00675e0 con 0x7f5c940036d0 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5cac0b07b0 con 0x7f5c940036d0 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5ca67fc640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 0x7f5c94069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5cac0ac070 con 0x7f5c940036d0 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 0x7f5c94069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:15.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.024+0000 7f5cb56ea640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 0x7f5c94069830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006cf0 tx=0x7f5ca0006c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.032+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5cac0ec6d0 con 0x7f5c940036d0 2024-05-08T20:40:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5cb0074950 con 0x7f5c940036d0 2024-05-08T20:40:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5ca67fc640 1 -- 172.21.15.81:0/99526971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f5cac00f040 con 0x7f5c940036d0 2024-05-08T20:40:15.310 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":100,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:40:15.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 msgr2=0x7f5c94069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 0x7f5c94069830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0006cf0 tx=0x7f5ca0006c80 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 msgr2=0x7f5cb01475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0075a0 tx=0x7f5cac007730 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 shutdown_connections 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5c94067370 0x7f5c94069830 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5cb0153e20 0x7f5cb01f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cb0147af0 0x7f5cb01538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 --2- 172.21.15.81:0/99526971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c940036d0 0x7f5cb01475b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 >> 172.21.15.81:0/99526971 conn(0x7f5cb00c71b0 msgr2=0x7f5cb01500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 shutdown_connections 2024-05-08T20:40:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:15.308+0000 7f5cb814f640 1 -- 172.21.15.81:0/99526971 wait complete. 2024-05-08T20:40:18.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:40:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 Processor -- start 2024-05-08T20:40:18.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 -- start start 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b280c3510 0x7f9b280aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b280c38f0 0x7f9b280c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b28153880 con 0x7f9b280c3510 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280c47c0 con 0x7f9b280c38f0 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.460+0000 7f9b2ffe1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c6220 con 0x7f9b280a9970 2024-05-08T20:40:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b280c3510 0x7f9b280aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b280c3510 0x7f9b280aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58762/0 (socket says 172.21.15.81:58762) 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 -- 172.21.15.81:0/3757167309 learned_addr learned my addr 172.21.15.81:0/3757167309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 -- 172.21.15.81:0/3757167309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 msgr2=0x7f9b28153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/3757167309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 -- 172.21.15.81:0/3757167309 >> v2:172.21.15.117:3300/0 conn(0x7f9b280c38f0 msgr2=0x7f9b280c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/3757167309 >> v2:172.21.15.117:3300/0 conn(0x7f9b280c38f0 0x7f9b280c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 -- 172.21.15.81:0/3757167309 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280c6500 con 0x7f9b280c3510 2024-05-08T20:40:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/3757167309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c3510 0x7f9b280aaa80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b28065e10 tx=0x7f9b2401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4287214a6153398 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2cd7b640 1 -- 172.21.15.81:0/3757167309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b240ab600 con 0x7f9b280c3510 2024-05-08T20:40:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2cd7b640 1 -- 172.21.15.81:0/3757167309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b240a7050 con 0x7f9b280c3510 2024-05-08T20:40:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2cd7b640 1 -- 172.21.15.81:0/3757167309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b240ab980 con 0x7f9b280c3510 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/3757167309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c3510 msgr2=0x7f9b280aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/3757167309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c3510 0x7f9b280aaa80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9b28065e10 tx=0x7f9b2401c460 comp rx=0 tx=0).stop 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/3757167309 shutdown_connections 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/3757167309 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/3757167309 >> v2:172.21.15.117:3300/0 conn(0x7f9b280c38f0 0x7f9b280c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/3757167309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c3510 0x7f9b280aaa80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/3757167309 >> 172.21.15.81:0/3757167309 conn(0x7f9b280c68c0 msgr2=0x7f9b280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:18.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/3757167309 shutdown_connections 2024-05-08T20:40:18.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.464+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/3757167309 wait complete. 2024-05-08T20:40:18.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 Processor -- start 2024-05-08T20:40:18.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- start start 2024-05-08T20:40:18.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280c3510 0x7f9b2813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2814a060 con 0x7f9b280c38f0 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2813fd50 con 0x7f9b280c3510 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281f2200 con 0x7f9b280a9970 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58770/0 (socket says 172.21.15.81:58770) 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 -- 172.21.15.81:0/2548994718 learned_addr learned my addr 172.21.15.81:0/2548994718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2d57c640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280c3510 0x7f9b2813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 -- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 msgr2=0x7f9b28149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 -- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280c3510 msgr2=0x7f9b2813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280c3510 0x7f9b2813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 -- 172.21.15.81:0/2548994718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240094d0 con 0x7f9b280c38f0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2e57e640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b9e0 tx=0x7f9b2000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000cb20 con 0x7f9b280c38f0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000cca0 con 0x7f9b280c38f0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28154010 con 0x7f9b280c38f0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20014680 con 0x7f9b280c38f0 2024-05-08T20:40:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.468+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b281545d0 con 0x7f9b280c38f0 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280aa2d0 con 0x7f9b280c38f0 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b2001d3b0 con 0x7f9b280c38f0 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b1e7fc640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 0x7f9b0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9b200843b0 con 0x7f9b280c38f0 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 0x7f9b0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.472+0000 7f9b2dd7d640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 0x7f9b0c068b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ad000 tx=0x7f9b240a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.476+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9b20051410 con 0x7f9b280c38f0 2024-05-08T20:40:18.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.760+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9b28074950 con 0x7f9b280c38f0 2024-05-08T20:40:18.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.760+0000 7f9b1e7fc640 1 -- 172.21.15.81:0/2548994718 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f9b20019620 con 0x7f9b280c38f0 2024-05-08T20:40:18.764 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 msgr2=0x7f9b0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 0x7f9b0c068b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ad000 tx=0x7f9b240a6000 comp rx=0 tx=0).stop 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 msgr2=0x7f9b281f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b9e0 tx=0x7f9b2000bea0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 shutdown_connections 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9b0c066690 0x7f9b0c068b50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b280c38f0 0x7f9b281f1cc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280c3510 0x7f9b2813f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 --2- 172.21.15.81:0/2548994718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b280a9970 0x7f9b28149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 >> 172.21.15.81:0/2548994718 conn(0x7f9b280c68c0 msgr2=0x7f9b28156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 shutdown_connections 2024-05-08T20:40:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.764+0000 7f9b2ffe1640 1 -- 172.21.15.81:0/2548994718 wait complete. 2024-05-08T20:40:18.784 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:40:18.784 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:40:18.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:40:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.912+0000 7fb941dcf640 1 Processor -- start 2024-05-08T20:40:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.912+0000 7fb941dcf640 1 -- start start 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb941dcf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb93c0c2570 0x7fb93c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb941dcf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb93c0c34e0 0x7fb93c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb941dcf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c158080 con 0x7fb93c152340 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb941dcf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c06ab70 con 0x7fb93c0c2570 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb941dcf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c154b10 con 0x7fb93c0c34e0 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb93c152340 0x7fb93c06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49606/0 (socket says 172.21.15.81:49606) 2024-05-08T20:40:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93b7fe640 1 -- 172.21.15.81:0/2891845750 learned_addr learned my addr 172.21.15.81:0/2891845750 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 --2- 172.21.15.81:0/2891845750 >> v2:172.21.15.81:3300/0 conn(0x7fb93c0c2570 0x7fb93c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93bfff640 1 --2- 172.21.15.81:0/2891845750 >> v2:172.21.15.117:3300/0 conn(0x7fb93c0c34e0 0x7fb93c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93affd640 1 -- 172.21.15.81:0/2891845750 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60268903 0 0) 0x7fb93c158080 con 0x7fb93c152340 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93affd640 1 -- 172.21.15.81:0/2891845750 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb928003530 con 0x7fb93c152340 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 -- 172.21.15.81:0/2891845750 >> v2:172.21.15.117:3300/0 conn(0x7fb93c0c34e0 msgr2=0x7fb93c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 --2- 172.21.15.81:0/2891845750 >> v2:172.21.15.117:3300/0 conn(0x7fb93c0c34e0 0x7fb93c1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 -- 172.21.15.81:0/2891845750 >> v1:172.21.15.81:6789/0 conn(0x7fb93c152340 legacy=0x7fb93c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 -- 172.21.15.81:0/2891845750 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c06a890 con 0x7fb93c0c2570 2024-05-08T20:40:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb933fff640 1 --2- 172.21.15.81:0/2891845750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c154f60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0c1780 tx=0x7fb92401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c9af390af78cf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93affd640 1 -- 172.21.15.81:0/2891845750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240ac620 con 0x7fb93c0c2570 2024-05-08T20:40:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93affd640 1 -- 172.21.15.81:0/2891845750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240ac780 con 0x7fb93c0c2570 2024-05-08T20:40:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.916+0000 7fb93affd640 1 -- 172.21.15.81:0/2891845750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240acb10 con 0x7fb93c0c2570 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- 172.21.15.81:0/2891845750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 msgr2=0x7fb93c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2891845750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c154f60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0c1780 tx=0x7fb92401c3c0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- 172.21.15.81:0/2891845750 shutdown_connections 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2891845750 >> v2:172.21.15.117:3300/0 conn(0x7fb93c0c34e0 0x7fb93c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2891845750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c154f60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- 172.21.15.81:0/2891845750 >> 172.21.15.81:0/2891845750 conn(0x7fb93c0c71b0 msgr2=0x7fb93c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- 172.21.15.81:0/2891845750 shutdown_connections 2024-05-08T20:40:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- 172.21.15.81:0/2891845750 wait complete. 2024-05-08T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 Processor -- start 2024-05-08T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- start start 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93c0c34e0 0x7fb93c13fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93c152340 0x7fb93c13b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1ed040 con 0x7fb93c0c2570 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0c6ea0 con 0x7fb93c0c34e0 2024-05-08T20:40:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb941dcf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1ed250 con 0x7fb93c152340 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c13eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44608/0 (socket says 172.21.15.81:44608) 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb93b7fe640 1 -- 172.21.15.81:0/2910761540 learned_addr learned my addr 172.21.15.81:0/2910761540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93c0c34e0 0x7fb93c13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb93bfff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93c152340 0x7fb93c13b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.920+0000 7fb93b7fe640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93c152340 msgr2=0x7fb93c13b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93b7fe640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93c152340 0x7fb93c13b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93b7fe640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93c0c34e0 msgr2=0x7fb93c13fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93b7fe640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93c0c34e0 0x7fb93c13fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93b7fe640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009420 con 0x7fb93c0c2570 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93c0c34e0 0x7fb93c13fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93b7fe640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c13eff0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c4d0 tx=0x7fb92c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c005cf0 con 0x7fb93c0c2570 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c005e50 con 0x7fb93c0c2570 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c1ed530 con 0x7fb93c0c2570 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c007270 con 0x7fb93c0c2570 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c1edaf0 con 0x7fb93c0c2570 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 0x7fb93c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c13bfc0 con 0x7fb93c13e090 2024-05-08T20:40:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 0x7fb93c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb933fff640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb93c1559e0 con 0x7fb93c13e090 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 0x7fb93c13b7e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06fd50 tx=0x7fb92401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240ac620 con 0x7fb93c13e090 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb92c0073d0 con 0x7fb93c0c2570 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb91c066730 0x7fb91c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb92c0839a0 con 0x7fb93c0c2570 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93bfff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb91c066730 0x7fb91c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb9240b6410 con 0x7fb93c13e090 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 msgr2=0x7fb93c13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 0x7fb93c13b7e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06fd50 tx=0x7fb92401ac00 comp rx=0 tx=0).stop 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 msgr2=0x7fb93c13b7e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb938ff9640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c13e090 0x7fb93c13b7e0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06fd50 tx=0x7fb92401ac00 comp rx=0 tx=0).stop 2024-05-08T20:40:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.924+0000 7fb93bfff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb91c066730 0x7fb91c068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9340074a0 tx=0x7fb93400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 0x7fb93c13c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c069550 con 0x7fb93c1edce0 2024-05-08T20:40:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 0x7fb93c13c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb933fff640 1 -- 172.21.15.81:0/2910761540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb93c0675e0 con 0x7fb93c1edce0 2024-05-08T20:40:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb933fff640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 0x7fb93c13c240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb924018fd0 tx=0x7fb924019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924003620 con 0x7fb93c1edce0 2024-05-08T20:40:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fb9240c0e90 con 0x7fb93c1edce0 2024-05-08T20:40:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 msgr2=0x7fb93c13c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 0x7fb93c13c240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb924018fd0 tx=0x7fb924019160 comp rx=0 tx=0).stop 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 msgr2=0x7fb93c13c240 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb938ff9640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c1edce0 0x7fb93c13c240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:18.948 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:18.950 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb91c066730 msgr2=0x7fb91c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb91c066730 0x7fb91c068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9340074a0 tx=0x7fb93400b040 comp rx=0 tx=0).stop 2024-05-08T20:40:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 msgr2=0x7fb93c13eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 --2- 172.21.15.81:0/2910761540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb93c0c2570 0x7fb93c13eff0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c4d0 tx=0x7fb92c00c990 comp rx=0 tx=0).stop 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb93bfff640 1 -- 172.21.15.81:0/2910761540 reap_dead start 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb93bfff640 1 -- 172.21.15.81:0/2910761540 reap_dead start 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 shutdown_connections 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 >> 172.21.15.81:0/2910761540 conn(0x7fb93c0c71b0 msgr2=0x7fb93c0c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 shutdown_connections 2024-05-08T20:40:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:18.932+0000 7fb941dcf640 1 -- 172.21.15.81:0/2910761540 wait complete. 2024-05-08T20:40:18.953 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:18.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:40:18.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:40:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 Processor -- start 2024-05-08T20:40:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 -- start start 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a5c0c30d0 0x7f4a5c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c155e10 con 0x7f4a5c0a94b0 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06e790 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a6265a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06f460 con 0x7f4a5c0c30d0 2024-05-08T20:40:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44636/0 (socket says 172.21.15.81:44636) 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/2787274707 learned_addr learned my addr 172.21.15.81:0/2787274707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/2787274707 >> v2:172.21.15.117:3300/0 conn(0x7f4a5c0c30d0 0x7f4a5c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/2787274707 >> v2:172.21.15.117:3300/0 conn(0x7f4a5c0c30d0 msgr2=0x7f4a5c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 --2- 172.21.15.81:0/2787274707 >> v2:172.21.15.117:3300/0 conn(0x7f4a5c0c30d0 0x7f4a5c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/2787274707 >> v1:172.21.15.117:6789/0 conn(0x7f4a5c0a94b0 legacy=0x7f4a5c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.072+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/2787274707 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c156080 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a5b7fe640 1 --2- 172.21.15.81:0/2787274707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0c59e0 tx=0x7f4a5001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2efc7c2cc8afa0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a5affd640 1 -- 172.21.15.81:0/2787274707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500ab620 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a5affd640 1 -- 172.21.15.81:0/2787274707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500ab780 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a5affd640 1 -- 172.21.15.81:0/2787274707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500abb10 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 -- 172.21.15.81:0/2787274707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 msgr2=0x7f4a5c0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 --2- 172.21.15.81:0/2787274707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0c59e0 tx=0x7f4a5001c420 comp rx=0 tx=0).stop 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 -- 172.21.15.81:0/2787274707 shutdown_connections 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 --2- 172.21.15.81:0/2787274707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c0c4120 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 --2- 172.21.15.81:0/2787274707 >> v2:172.21.15.117:3300/0 conn(0x7f4a5c0c30d0 0x7f4a5c0c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 -- 172.21.15.81:0/2787274707 >> 172.21.15.81:0/2787274707 conn(0x7f4a5c0c4cc0 msgr2=0x7f4a5c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 -- 172.21.15.81:0/2787274707 shutdown_connections 2024-05-08T20:40:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.076+0000 7f4a6265a640 1 -- 172.21.15.81:0/2787274707 wait complete. 2024-05-08T20:40:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 Processor -- start 2024-05-08T20:40:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- start start 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0a94b0 0x7f4a5c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0c30d0 0x7f4a5c1f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06d000 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06bd20 con 0x7f4a5c0c30d0 2024-05-08T20:40:19.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06ca60 con 0x7f4a5c0a94b0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44652/0 (socket says 172.21.15.81:44652) 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/1172197409 learned_addr learned my addr 172.21.15.81:0/1172197409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a60bf7640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0c30d0 0x7f4a5c1f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0a94b0 0x7f4a5c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0a94b0 msgr2=0x7f4a5c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5c0a94b0 0x7f4a5c1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0c30d0 msgr2=0x7f4a5c1f0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0c30d0 0x7f4a5c1f0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094d0 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a60bf7640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a5c0c30d0 0x7f4a5c1f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5b7fe640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c15b740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a5001c900 tx=0x7f4a5001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500be3f0 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500be550 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c06cd20 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c15bc80 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500be900 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 0x7f4a3c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c007e90 con 0x7f4a3c002a40 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.080+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 0x7f4a3c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a500c7440 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a5bfff640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a3c008050 con 0x7f4a3c002a40 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a480666c0 0x7f4a48068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4a5011ecb0 con 0x7f4a5c0c2bc0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a60bf7640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a480666c0 0x7f4a48068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 0x7f4a3c004f00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00f410 tx=0x7f4a4c00f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a60bf7640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a480666c0 0x7f4a48068b80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004540 tx=0x7f4a54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c014870 con 0x7f4a3c002a40 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4a4c0149d0 con 0x7f4a3c002a40 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 msgr2=0x7f4a3c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 0x7f4a3c004f00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00f410 tx=0x7f4a4c00f8d0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 msgr2=0x7f4a3c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.084+0000 7f4a58ff9640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c002a40 0x7f4a3c004f00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 0x7f4a3c007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c00a350 con 0x7f4a3c006f20 2024-05-08T20:40:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 0x7f4a3c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a5bfff640 1 -- 172.21.15.81:0/1172197409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a3c00a510 con 0x7f4a3c006f20 2024-05-08T20:40:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a5bfff640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 0x7f4a3c007390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00f410 tx=0x7f4a4c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c020230 con 0x7f4a3c006f20 2024-05-08T20:40:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f4a4c003620 con 0x7f4a3c006f20 2024-05-08T20:40:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 msgr2=0x7f4a3c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 0x7f4a3c007390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00f410 tx=0x7f4a4c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 msgr2=0x7f4a3c007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a58ff9640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a3c006f20 0x7f4a3c007390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:19.107 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a480666c0 msgr2=0x7f4a48068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4a480666c0 0x7f4a48068b80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004540 tx=0x7f4a54009040 comp rx=0 tx=0).stop 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 msgr2=0x7f4a5c15b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 --2- 172.21.15.81:0/1172197409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5c0c2bc0 0x7f4a5c15b740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a5001c900 tx=0x7f4a5001ac60 comp rx=0 tx=0).stop 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a60bf7640 1 -- 172.21.15.81:0/1172197409 reap_dead start 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a60bf7640 1 -- 172.21.15.81:0/1172197409 reap_dead start 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 shutdown_connections 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 >> 172.21.15.81:0/1172197409 conn(0x7f4a5c0c4cc0 msgr2=0x7f4a5c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 shutdown_connections 2024-05-08T20:40:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.092+0000 7f4a6265a640 1 -- 172.21.15.81:0/1172197409 wait complete. 2024-05-08T20:40:19.116 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:19.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:40:19.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:40:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 Processor -- start 2024-05-08T20:40:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 -- start start 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 0x7f1d9c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c155e90 0x7f1d9c069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9c06d7d0 0x7f1d9c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c1528a0 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c152ab0 con 0x7f1d9c14fe70 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da4360640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c152d90 con 0x7f1d9c155e90 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9c06d7d0 0x7f1d9c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9c06d7d0 0x7f1d9c06a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44654/0 (socket says 172.21.15.81:44654) 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 -- 172.21.15.81:0/3155805590 learned_addr learned my addr 172.21.15.81:0/3155805590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3155805590 >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 0x7f1d9c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da18fb640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c155e90 0x7f1d9c069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 -- 172.21.15.81:0/3155805590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c155e90 msgr2=0x7f1d9c069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c155e90 0x7f1d9c069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 -- 172.21.15.81:0/3155805590 >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 msgr2=0x7f1d9c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3155805590 >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 0x7f1d9c06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da28fd640 1 -- 172.21.15.81:0/3155805590 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c153070 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.232+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3155805590 >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 0x7f1d9c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:40:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c06a500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c073fc0 tx=0x7f1d9401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a301dfcb18ad7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da10fa640 1 -- 172.21.15.81:0/3155805590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a5720 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da10fa640 1 -- 172.21.15.81:0/3155805590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940a5880 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da10fa640 1 -- 172.21.15.81:0/3155805590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a5c10 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 -- 172.21.15.81:0/3155805590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c06d7d0 msgr2=0x7f1d9c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c06a500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c073fc0 tx=0x7f1d9401c8a0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 -- 172.21.15.81:0/3155805590 shutdown_connections 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c155e90 0x7f1d9c069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 --2- 172.21.15.81:0/3155805590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c06a500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 --2- 172.21.15.81:0/3155805590 >> v2:172.21.15.117:3300/0 conn(0x7f1d9c14fe70 0x7f1d9c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 -- 172.21.15.81:0/3155805590 >> 172.21.15.81:0/3155805590 conn(0x7f1d9c0c71b0 msgr2=0x7f1d9c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 -- 172.21.15.81:0/3155805590 shutdown_connections 2024-05-08T20:40:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.236+0000 7f1da4360640 1 -- 172.21.15.81:0/3155805590 wait complete. 2024-05-08T20:40:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 Processor -- start 2024-05-08T20:40:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- start start 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c14fe70 0x7f1d9c1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 0x7f1d9c1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0c6f70 con 0x7f1d9c155e90 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1ee6c0 con 0x7f1d9c06d7d0 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c1493a0 con 0x7f1d9c14fe70 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 0x7f1d9c1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 0x7f1d9c1ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44666/0 (socket says 172.21.15.81:44666) 2024-05-08T20:40:19.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 learned_addr learned my addr 172.21.15.81:0/3423981520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da18fb640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c14fe70 0x7f1d9c1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c14fe70 msgr2=0x7f1d9c1eeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c14fe70 0x7f1d9c1eeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d9c06d7d0 msgr2=0x7f1d9c149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d9c06d7d0 0x7f1d9c149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009b30 con 0x7f1d9c155e90 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da28fd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 0x7f1d9c1ef090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d9401af50 tx=0x7f1d94019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940b8670 con 0x7f1d9c155e90 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940b87d0 con 0x7f1d9c155e90 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c148de0 con 0x7f1d9c155e90 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940b8b60 con 0x7f1d9c155e90 2024-05-08T20:40:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c14a440 con 0x7f1d9c155e90 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 0x7f1d9c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c069550 con 0x7f1d9c1eb020 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 0x7f1d9c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d940b8cc0 con 0x7f1d9c155e90 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1da20fc640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d9c14f750 con 0x7f1d9c1eb020 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d80066690 0x7f1d80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.240+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1d9411fb00 con 0x7f1d9c155e90 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1da18fb640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d80066690 0x7f1d80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 0x7f1d9c147bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e7a0 tx=0x7f1d9800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800ee50 con 0x7f1d9c1eb020 2024-05-08T20:40:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1da18fb640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d80066690 0x7f1d80068b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c06e4a0 tx=0x7f1d8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1d98004020 con 0x7f1d9c1eb020 2024-05-08T20:40:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 msgr2=0x7f1d9c147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 0x7f1d9c147bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e7a0 tx=0x7f1d9800ec60 comp rx=0 tx=0).stop 2024-05-08T20:40:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 msgr2=0x7f1d9c147bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.244+0000 7f1d92ffd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c1eb020 0x7f1d9c147bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.252+0000 7f1da4360640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 0x7f1d9c148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.252+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c148f70 con 0x7f1d9c151bc0 2024-05-08T20:40:19.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.252+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 0x7f1d9c148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.252+0000 7f1da20fc640 1 -- 172.21.15.81:0/3423981520 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1d9c0675e0 con 0x7f1d9c151bc0 2024-05-08T20:40:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.252+0000 7f1da20fc640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 0x7f1d9c148130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e7a0 tx=0x7f1d980046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800aec0 con 0x7f1d9c151bc0 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f1d98003830 con 0x7f1d9c151bc0 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 msgr2=0x7f1d9c148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 0x7f1d9c148130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e7a0 tx=0x7f1d980046d0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 msgr2=0x7f1d9c148130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1d92ffd640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d9c151bc0 0x7f1d9c148130 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e7a0 tx=0x7f1d980046d0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:19.269 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d80066690 msgr2=0x7f1d80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d80066690 0x7f1d80068b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c06e4a0 tx=0x7f1d8c008040 comp rx=0 tx=0).stop 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 msgr2=0x7f1d9c1ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 --2- 172.21.15.81:0/3423981520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9c155e90 0x7f1d9c1ef090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d9401af50 tx=0x7f1d94019640 comp rx=0 tx=0).stop 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 reap_dead start 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da28fd640 1 -- 172.21.15.81:0/3423981520 reap_dead start 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 shutdown_connections 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 >> 172.21.15.81:0/3423981520 conn(0x7f1d9c0c71b0 msgr2=0x7f1d9c06ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 shutdown_connections 2024-05-08T20:40:19.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.256+0000 7f1da4360640 1 -- 172.21.15.81:0/3423981520 wait complete. 2024-05-08T20:40:19.275 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:19.276 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:40:19.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:40:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 Processor -- start 2024-05-08T20:40:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 -- start start 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b5c0c30d0 0x7f3b5c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c06e790 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c06f460 con 0x7f3b5c0c30d0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b61c01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c155e10 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44678/0 (socket says 172.21.15.81:44678) 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 -- 172.21.15.81:0/2759682962 learned_addr learned my addr 172.21.15.81:0/2759682962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b52ffd640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5b7fe640 1 --2- 172.21.15.81:0/2759682962 >> v2:172.21.15.117:3300/0 conn(0x7f3b5c0c30d0 0x7f3b5c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 -- 172.21.15.81:0/2759682962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0c2bc0 msgr2=0x7f3b5c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 -- 172.21.15.81:0/2759682962 >> v2:172.21.15.117:3300/0 conn(0x7f3b5c0c30d0 msgr2=0x7f3b5c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 --2- 172.21.15.81:0/2759682962 >> v2:172.21.15.117:3300/0 conn(0x7f3b5c0c30d0 0x7f3b5c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.392+0000 7f3b5bfff640 1 -- 172.21.15.81:0/2759682962 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0a9e60 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5bfff640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0c59e0 tx=0x7f3b5401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f6fd3d94ff1423 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5affd640 1 -- 172.21.15.81:0/2759682962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540a57b0 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5affd640 1 -- 172.21.15.81:0/2759682962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540a5910 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5affd640 1 -- 172.21.15.81:0/2759682962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540a5ca0 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- 172.21.15.81:0/2759682962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0a94b0 msgr2=0x7f3b5c0a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0c59e0 tx=0x7f3b5401c930 comp rx=0 tx=0).stop 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- 172.21.15.81:0/2759682962 shutdown_connections 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- 172.21.15.81:0/2759682962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0a94b0 0x7f3b5c0a9920 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- 172.21.15.81:0/2759682962 >> v2:172.21.15.117:3300/0 conn(0x7f3b5c0c30d0 0x7f3b5c0c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- 172.21.15.81:0/2759682962 >> 172.21.15.81:0/2759682962 conn(0x7f3b5c0c4cc0 msgr2=0x7f3b5c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- 172.21.15.81:0/2759682962 shutdown_connections 2024-05-08T20:40:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- 172.21.15.81:0/2759682962 wait complete. 2024-05-08T20:40:19.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 Processor -- start 2024-05-08T20:40:19.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- start start 2024-05-08T20:40:19.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0a94b0 0x7f3b5c0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5c0c30d0 0x7f3b5c142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c1490f0 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0ad810 con 0x7f3b5c0c30d0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b61c01640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0adca0 con 0x7f3b5c0a94b0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44688/0 (socket says 172.21.15.81:44688) 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b52ffd640 1 -- 172.21.15.81:0/695943207 learned_addr learned my addr 172.21.15.81:0/695943207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5b7fe640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0a94b0 0x7f3b5c0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.396+0000 7f3b5bfff640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5c0c30d0 0x7f3b5c142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 -- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0a94b0 msgr2=0x7f3b5c0ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0a94b0 0x7f3b5c0ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 -- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5c0c30d0 msgr2=0x7f3b5c142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5c0c30d0 0x7f3b5c142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 -- 172.21.15.81:0/695943207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54009b30 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b52ffd640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d800 tx=0x7f3b4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440096a0 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44009800 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c0adf80 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44009b70 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c148e10 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c074950 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b44009cd0 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 0x7f3b3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3b44084ba0 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b5b7fe640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 0x7f3b3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:19.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.400+0000 7f3b5b7fe640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 0x7f3b3c068b80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c156960 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.404+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3b44051c00 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.660+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f3b5c14f830 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b58ff9640 1 -- 172.21.15.81:0/695943207 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f3b44055220 con 0x7f3b5c0c2bc0 2024-05-08T20:40:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 msgr2=0x7f3b3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 0x7f3b3c068b80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c156960 tx=0x7f3b4c008040 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 msgr2=0x7f3b5c0ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d800 tx=0x7f3b4400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 shutdown_connections 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3b3c0666c0 0x7f3b3c068b80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b5c0c30d0 0x7f3b5c142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b5c0c2bc0 0x7f3b5c0ab490 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 --2- 172.21.15.81:0/695943207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b5c0a94b0 0x7f3b5c0ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 >> 172.21.15.81:0/695943207 conn(0x7f3b5c0c4cc0 msgr2=0x7f3b5c1513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 shutdown_connections 2024-05-08T20:40:19.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:19.664+0000 7f3b61c01640 1 -- 172.21.15.81:0/695943207 wait complete. 2024-05-08T20:40:19.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:40:22.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:40:22.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:40:29.684 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:40:29.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:40:29.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 Processor -- start 2024-05-08T20:40:29.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 -- start start 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8d80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d80abc50 con 0x7fb8d806b6e0 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d80c2900 con 0x7fb8d80aac20 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8df54d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80aa320 con 0x7fb8d814e410 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8ddaea640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8d806b6e0 0x7fb8d815b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35328/0 (socket says 172.21.15.81:35328) 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8ddaea640 1 -- 172.21.15.81:0/2108996895 learned_addr learned my addr 172.21.15.81:0/2108996895 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8d80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484138183 0 0) 0x7fb8d80abc50 con 0x7fb8d806b6e0 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c4004640 con 0x7fb8d806b6e0 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294875002 0 0) 0x7fb8c4004640 con 0x7fb8d806b6e0 2024-05-08T20:40:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 msgr2=0x7fb8d80aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8d80aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 >> v1:172.21.15.117:6789/0 conn(0x7fb8d80aac20 legacy=0x7fb8d806afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d80a9560 con 0x7fb8d806b6e0 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb8d0001a00 con 0x7fb8d806b6e0 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 >> v1:172.21.15.81:6789/0 conn(0x7fb8d806b6e0 legacy=0x7fb8d815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c4004ac0 0x7fb8c4004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8c40058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c4005e20 0x7fb8c40062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80aa320 con 0x7fb8c4004ac0 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c400cbd0 con 0x7fb8c4005e20 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40034d0 con 0x7fb8d814e410 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c4004ac0 0x7fb8c4004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dcae8640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8c40058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8ddaea640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c4005e20 0x7fb8c40062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 -- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 msgr2=0x7fb8c40058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8c40058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 -- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c4005e20 msgr2=0x7fb8c40062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c4005e20 0x7fb8c40062a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dd2e9640 1 -- 172.21.15.81:0/2108996895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4004640 con 0x7fb8c4004ac0 2024-05-08T20:40:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.816+0000 7fb8dcae8640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d814e410 0x7fb8c40058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c4004ac0 0x7fb8c4004ee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009ae0 tx=0x7fb8d401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7859970ba232912a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40a8450 con 0x7fb8c4004ac0 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d40a85b0 con 0x7fb8c4004ac0 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8cffff640 1 -- 172.21.15.81:0/2108996895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40a8960 con 0x7fb8c4004ac0 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 -- 172.21.15.81:0/2108996895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c4004ac0 msgr2=0x7fb8c4004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 --2- 172.21.15.81:0/2108996895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c4004ac0 0x7fb8c4004ee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009ae0 tx=0x7fb8d401c980 comp rx=0 tx=0).stop 2024-05-08T20:40:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8ddaea640 1 -- 172.21.15.81:0/2108996895 reap_dead start 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 -- 172.21.15.81:0/2108996895 shutdown_connections 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 -- 172.21.15.81:0/2108996895 >> 172.21.15.81:0/2108996895 conn(0x7fb8d80c2ca0 msgr2=0x7fb8d80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 -- 172.21.15.81:0/2108996895 shutdown_connections 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.820+0000 7fb8df54d640 1 -- 172.21.15.81:0/2108996895 wait complete. 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 Processor -- start 2024-05-08T20:40:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- start start 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8c4004ac0 0x7fb8d80722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d80706f0 0x7fb8d8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81546a0 con 0x7fb8d81538e0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d806fa00 con 0x7fb8d80706f0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81543c0 con 0x7fb8c4004ac0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51750/0 (socket says 172.21.15.81:51750) 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 -- 172.21.15.81:0/1568998926 learned_addr learned my addr 172.21.15.81:0/1568998926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8c4004ac0 0x7fb8d80722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8ddaea640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d80706f0 0x7fb8d8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 -- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8c4004ac0 msgr2=0x7fb8d80722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8c4004ac0 0x7fb8d80722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 -- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d80706f0 msgr2=0x7fb8d8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d80706f0 0x7fb8d8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 -- 172.21.15.81:0/1568998926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d806fc10 con 0x7fb8d81538e0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8dcae8640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800d770 tx=0x7fb8c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8005270 con 0x7fb8d81538e0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c80053d0 con 0x7fb8d81538e0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d806fef0 con 0x7fb8d81538e0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800b8d0 con 0x7fb8d81538e0 2024-05-08T20:40:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d8072810 con 0x7fb8d81538e0 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.824+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d806f1e0 con 0x7fb8d81538e0 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.828+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8c800ba30 con 0x7fb8d81538e0 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.828+0000 7fb8cdffb640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 0x7fb8bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.828+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb8c8084510 con 0x7fb8d81538e0 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.828+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 0x7fb8bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.828+0000 7fb8dd2e9640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 0x7fb8bc068b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d40b2040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:29.832+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb8d806f1e0 con 0x7fb8d81538e0 2024-05-08T20:40:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.132+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb8d806f1e0 con 0x7fb8d81538e0 2024-05-08T20:40:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.132+0000 7fb8cdffb640 1 -- 172.21.15.81:0/1568998926 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fb8d806f1e0 con 0x7fb8d81538e0 2024-05-08T20:40:30.136 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:40:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 msgr2=0x7fb8bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 0x7fb8bc068b80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d40b2040 comp rx=0 tx=0).stop 2024-05-08T20:40:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 msgr2=0x7fb8d8153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800d770 tx=0x7fb8c800dc30 comp rx=0 tx=0).stop 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 shutdown_connections 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8bc0666c0 0x7fb8bc068b80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d80706f0 0x7fb8d8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d81538e0 0x7fb8d8153d20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 --2- 172.21.15.81:0/1568998926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8c4004ac0 0x7fb8d80722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 >> 172.21.15.81:0/1568998926 conn(0x7fb8d80c2ca0 msgr2=0x7fb8d8073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 shutdown_connections 2024-05-08T20:40:30.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.136+0000 7fb8df54d640 1 -- 172.21.15.81:0/1568998926 wait complete. 2024-05-08T20:40:30.160 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:40:30.160 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:40:30.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:40:30.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:40:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 Processor -- start 2024-05-08T20:40:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 -- start start 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9d00c32f0 0x7fc9d01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00c3b60 con 0x7fc9d00a9de0 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00aaa60 con 0x7fc9d00c36d0 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d84dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00a95b0 con 0x7fc9d00c32f0 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d6279640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9d00c32f0 0x7fc9d01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d5a78640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9d00a9de0 0x7fc9d0152050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35342/0 (socket says 172.21.15.81:35342) 2024-05-08T20:40:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d6279640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9d00c32f0 0x7fc9d01556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51758/0 (socket says 172.21.15.81:51758) 2024-05-08T20:40:30.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d5a78640 1 -- 172.21.15.81:0/1424976636 learned_addr learned my addr 172.21.15.81:0/1424976636 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:30.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d6279640 1 -- 172.21.15.81:0/1424976636 >> v1:172.21.15.117:6789/0 conn(0x7fc9d00c36d0 legacy=0x7fc9d00aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:30.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d6279640 1 -- 172.21.15.81:0/1424976636 >> v1:172.21.15.81:6789/0 conn(0x7fc9d00a9de0 legacy=0x7fc9d0152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d6279640 1 -- 172.21.15.81:0/1424976636 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00a9890 con 0x7fc9d00c32f0 2024-05-08T20:40:30.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.288+0000 7fc9d5277640 1 -- 172.21.15.81:0/1424976636 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073862500 0 0) 0x7fc9c0001120 con 0x7fc9d00a9de0 2024-05-08T20:40:30.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d6279640 1 --2- 172.21.15.81:0/1424976636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d01556d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58732d93019ec6d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5277640 1 -- 172.21.15.81:0/1424976636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0ac640 con 0x7fc9d00c32f0 2024-05-08T20:40:30.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5277640 1 -- 172.21.15.81:0/1424976636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc0ac7a0 con 0x7fc9d00c32f0 2024-05-08T20:40:30.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5277640 1 -- 172.21.15.81:0/1424976636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0acb30 con 0x7fc9d00c32f0 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- 172.21.15.81:0/1424976636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 msgr2=0x7fc9d01556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/1424976636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d01556d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0097c0 tx=0x7fc9cc01c310 comp rx=0 tx=0).stop 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- 172.21.15.81:0/1424976636 shutdown_connections 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/1424976636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d01556d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- 172.21.15.81:0/1424976636 >> 172.21.15.81:0/1424976636 conn(0x7fc9d006a2f0 msgr2=0x7fc9d006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- 172.21.15.81:0/1424976636 shutdown_connections 2024-05-08T20:40:30.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- 172.21.15.81:0/1424976636 wait complete. 2024-05-08T20:40:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 Processor -- start 2024-05-08T20:40:30.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- start start 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00a9de0 0x7fc9d00a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d00c36d0 0x7fc9d00c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d014d010 con 0x7fc9d00c32f0 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d013c700 con 0x7fc9d00c36d0 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d84dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d013da30 con 0x7fc9d00a9de0 2024-05-08T20:40:30.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5a78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5a78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d014cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51762/0 (socket says 172.21.15.81:51762) 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.292+0000 7fc9d5a78640 1 -- 172.21.15.81:0/3087520392 learned_addr learned my addr 172.21.15.81:0/3087520392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6279640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00a9de0 0x7fc9d00a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6a7a640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d00c36d0 0x7fc9d00c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00a9de0 msgr2=0x7fc9d00a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d00a9de0 0x7fc9d00a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d00c36d0 msgr2=0x7fc9d00c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d00c36d0 0x7fc9d00c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc009420 con 0x7fc9d00c32f0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d5a78640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d014cad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c480 tx=0x7fc9c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00074e0 con 0x7fc9d00c32f0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0007660 con 0x7fc9d00c32f0 2024-05-08T20:40:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d013e490 con 0x7fc9d00c32f0 2024-05-08T20:40:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0004a30 con 0x7fc9d00c32f0 2024-05-08T20:40:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d013d750 con 0x7fc9d00c32f0 2024-05-08T20:40:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 0x7fc9d014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00699c0 con 0x7fc9d014e4d0 2024-05-08T20:40:30.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6279640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 0x7fc9d014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6279640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9d014ef90 con 0x7fc9d014e4d0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6279640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 0x7fc9d014f470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00c0660 tx=0x7fc9cc0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9c0004b90 con 0x7fc9d00c32f0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc9b4066690 0x7fc9b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6a7a640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc9b4066690 0x7fc9b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc9c0083860 con 0x7fc9d00c32f0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0acb10 con 0x7fc9d014e4d0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc9cc0acc70 con 0x7fc9d014e4d0 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 msgr2=0x7fc9d014f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 0x7fc9d014f470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00c0660 tx=0x7fc9cc0190b0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 msgr2=0x7fc9d014f470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9c6ffd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d014e4d0 0x7fc9d014f470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.296+0000 7fc9d6a7a640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc9b4066690 0x7fc9b4068b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009ea0 tx=0x7fc9c8009410 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 0x7fc9d013bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c3b60 con 0x7fc9d013bb40 2024-05-08T20:40:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d6279640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 0x7fc9d013bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d6279640 1 -- 172.21.15.81:0/3087520392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc9d0074950 con 0x7fc9d013bb40 2024-05-08T20:40:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d6279640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 0x7fc9d013bf20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc019f40 tx=0x7fc9cc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0c4040 con 0x7fc9d013bb40 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7fc9cc0c52d0 con 0x7fc9d013bb40 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 msgr2=0x7fc9d013bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 0x7fc9d013bf20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc019f40 tx=0x7fc9cc009190 comp rx=0 tx=0).stop 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 msgr2=0x7fc9d013bf20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9c6ffd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d013bb40 0x7fc9d013bf20 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc019f40 tx=0x7fc9cc009190 comp rx=0 tx=0).stop 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:40:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:40:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:30.325 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc9b4066690 msgr2=0x7fc9b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc9b4066690 0x7fc9b4068b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009ea0 tx=0x7fc9c8009410 comp rx=0 tx=0).stop 2024-05-08T20:40:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 msgr2=0x7fc9d014cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 --2- 172.21.15.81:0/3087520392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9d00c32f0 0x7fc9d014cad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c480 tx=0x7fc9c000c940 comp rx=0 tx=0).stop 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d6a7a640 1 -- 172.21.15.81:0/3087520392 reap_dead start 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d6a7a640 1 -- 172.21.15.81:0/3087520392 reap_dead start 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 shutdown_connections 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 >> 172.21.15.81:0/3087520392 conn(0x7fc9d006a2f0 msgr2=0x7fc9d006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 shutdown_connections 2024-05-08T20:40:30.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.304+0000 7fc9d84dd640 1 -- 172.21.15.81:0/3087520392 wait complete. 2024-05-08T20:40:30.327 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:30.327 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:40:30.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:40:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.452+0000 7f8a11044640 1 Processor -- start 2024-05-08T20:40:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.452+0000 7f8a11044640 1 -- start start 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a11044640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 0x7f8a0c0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a11044640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c155670 0x7f8a0c0bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a11044640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0c1730 con 0x7f8a0c0c0230 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a11044640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0c1a10 con 0x7f8a0c155670 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a11044640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c154980 con 0x7f8a0c06d130 2024-05-08T20:40:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0b59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8a0c0c0230 0x7f8a0c0c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35352/0 (socket says 172.21.15.81:35352) 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c155670 0x7f8a0c0bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0b59e640 1 -- 172.21.15.81:0/3409255559 learned_addr learned my addr 172.21.15.81:0/3409255559 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0ad9d640 1 --2- 172.21.15.81:0/3409255559 >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 0x7f8a0c0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 -- 172.21.15.81:0/3409255559 >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 msgr2=0x7f8a0c0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/3409255559 >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 0x7f8a0c0a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 -- 172.21.15.81:0/3409255559 >> v1:172.21.15.81:6789/0 conn(0x7f8a0c0c0230 legacy=0x7f8a0c0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 -- 172.21.15.81:0/3409255559 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c154b90 con 0x7f8a0c155670 2024-05-08T20:40:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0ad9d640 1 --2- 172.21.15.81:0/3409255559 >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 0x7f8a0c0a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:40:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/3409255559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c155670 0x7f8a0c0bfcf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097c0 tx=0x7f8a0001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add8c92caf9eabe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a09d9b640 1 -- 172.21.15.81:0/3409255559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000ab600 con 0x7f8a0c155670 2024-05-08T20:40:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a09d9b640 1 -- 172.21.15.81:0/3409255559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000a7050 con 0x7f8a0c155670 2024-05-08T20:40:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.456+0000 7f8a09d9b640 1 -- 172.21.15.81:0/3409255559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000ab980 con 0x7f8a0c155670 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/3409255559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c155670 msgr2=0x7f8a0c0bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- 172.21.15.81:0/3409255559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c155670 0x7f8a0c0bfcf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097c0 tx=0x7f8a0001c460 comp rx=0 tx=0).stop 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/3409255559 shutdown_connections 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- 172.21.15.81:0/3409255559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c155670 0x7f8a0c0bfcf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- 172.21.15.81:0/3409255559 >> v2:172.21.15.117:3300/0 conn(0x7f8a0c06d130 0x7f8a0c0a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/3409255559 >> 172.21.15.81:0/3409255559 conn(0x7f8a0c0c68c0 msgr2=0x7f8a0c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/3409255559 shutdown_connections 2024-05-08T20:40:30.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/3409255559 wait complete. 2024-05-08T20:40:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 Processor -- start 2024-05-08T20:40:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- start start 2024-05-08T20:40:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 0x7f8a0c150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c0c0230 0x7f8a0c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a0c155670 0x7f8a0c0a7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15a2b0 con 0x7f8a0c06d130 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0a8c90 con 0x7f8a0c0c0230 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c1f13f0 con 0x7f8a0c155670 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 0x7f8a0c150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 0x7f8a0c150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51808/0 (socket says 172.21.15.81:51808) 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 -- 172.21.15.81:0/125757804 learned_addr learned my addr 172.21.15.81:0/125757804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c0c0230 0x7f8a0c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0b59e640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a0c155670 0x7f8a0c0a7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a0c155670 msgr2=0x7f8a0c0a7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a0c155670 0x7f8a0c0a7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c0c0230 msgr2=0x7f8a0c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c0c0230 0x7f8a0c15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00009420 con 0x7f8a0c06d130 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c0c0230 0x7f8a0c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a0ad9d640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 0x7f8a0c150ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c7c0 tx=0x7f89fc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc007a30 con 0x7f8a0c06d130 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc007b90 con 0x7f8a0c06d130 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0a8ee0 con 0x7f8a0c06d130 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00ce70 con 0x7f8a0c06d130 2024-05-08T20:40:30.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.460+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0a6ff0 con 0x7f8a0c06d130 2024-05-08T20:40:30.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a11044640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 0x7f8a0c0a7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c069550 con 0x7f8a0c153a60 2024-05-08T20:40:30.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 0x7f8a0c0a7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89fc0113f0 con 0x7f8a0c06d130 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89f8066690 0x7f89f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a0a59c640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a0c0a7f90 con 0x7f8a0c153a60 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f89fc0849a0 con 0x7f8a0c06d130 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a0b59e640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89f8066690 0x7f89f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 0x7f8a0c0a7a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0a6590 tx=0x7f8a00019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f8a0b59e640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89f8066690 0x7f89f8068b50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005c10 tx=0x7f8a04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000bf440 con 0x7f8a0c153a60 2024-05-08T20:40:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8a000bf5a0 con 0x7f8a0c153a60 2024-05-08T20:40:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 msgr2=0x7f8a0c0a7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 0x7f8a0c0a7a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0a6590 tx=0x7f8a00019200 comp rx=0 tx=0).stop 2024-05-08T20:40:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 msgr2=0x7f8a0c0a7a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.464+0000 7f89f37fe640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c153a60 0x7f8a0c0a7a50 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0a6590 tx=0x7f8a00019200 comp rx=0 tx=0).stop 2024-05-08T20:40:30.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f8a11044640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 0x7f8a0c1f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0a9070 con 0x7f8a0c1f0670 2024-05-08T20:40:30.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 0x7f8a0c1f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f8a0a59c640 1 -- 172.21.15.81:0/125757804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8a0c066170 con 0x7f8a0c1f0670 2024-05-08T20:40:30.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f8a0a59c640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 0x7f8a0c1f0a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097c0 tx=0x7f8a000a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.472+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000c4990 con 0x7f8a0c1f0670 2024-05-08T20:40:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f8a000c8070 con 0x7f8a0c1f0670 2024-05-08T20:40:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 msgr2=0x7f8a0c1f0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f89f37fe640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 0x7f8a0c1f0a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097c0 tx=0x7f8a000a8000 comp rx=0 tx=0).stop 2024-05-08T20:40:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f89f37fe640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 msgr2=0x7f8a0c1f0a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f89f37fe640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a0c1f0670 0x7f8a0c1f0a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89f8066690 msgr2=0x7f89f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f89f8066690 0x7f89f8068b50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8a04005c10 tx=0x7f8a04009040 comp rx=0 tx=0).stop 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 msgr2=0x7f8a0c150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 --2- 172.21.15.81:0/125757804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06d130 0x7f8a0c150ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c7c0 tx=0x7f89fc00cc80 comp rx=0 tx=0).stop 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a0b59e640 1 -- 172.21.15.81:0/125757804 reap_dead start 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a0b59e640 1 -- 172.21.15.81:0/125757804 reap_dead start 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 shutdown_connections 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 >> 172.21.15.81:0/125757804 conn(0x7f8a0c0c68c0 msgr2=0x7f8a0c0c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 shutdown_connections 2024-05-08T20:40:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.476+0000 7f8a11044640 1 -- 172.21.15.81:0/125757804 wait complete. 2024-05-08T20:40:30.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:30.496 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:40:30.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:40:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 Processor -- start 2024-05-08T20:40:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 -- start start 2024-05-08T20:40:30.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4780c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4780c2570 0x7fc4780c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4781520a0 con 0x7fc47814f1a0 2024-05-08T20:40:30.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780c2f20 con 0x7fc4780c2570 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc47e058640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780c13e0 con 0x7fc47806c250 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4780c2570 0x7fc4780c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4780c2570 0x7fc4780c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51822/0 (socket says 172.21.15.81:51822) 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 -- 172.21.15.81:0/1564356072 learned_addr learned my addr 172.21.15.81:0/1564356072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc476ffd640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4780c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 -- 172.21.15.81:0/1564356072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 msgr2=0x7fc4780c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4780c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 -- 172.21.15.81:0/1564356072 >> v1:172.21.15.117:6789/0 conn(0x7fc47814f1a0 legacy=0x7fc4780c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.628+0000 7fc477fff640 1 -- 172.21.15.81:0/1564356072 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4781517d0 con 0x7fc4780c2570 2024-05-08T20:40:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc477fff640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc4780c29e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc470009e50 tx=0x7fc47001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8364cf18911fb8e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc4767fc640 1 -- 172.21.15.81:0/1564356072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a7700 con 0x7fc4780c2570 2024-05-08T20:40:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc4767fc640 1 -- 172.21.15.81:0/1564356072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700a7860 con 0x7fc4780c2570 2024-05-08T20:40:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc4767fc640 1 -- 172.21.15.81:0/1564356072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a7bf0 con 0x7fc4780c2570 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- 172.21.15.81:0/1564356072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 msgr2=0x7fc4780c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc4780c29e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc470009e50 tx=0x7fc47001eb70 comp rx=0 tx=0).stop 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- 172.21.15.81:0/1564356072 shutdown_connections 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc4780c29e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- 172.21.15.81:0/1564356072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4780c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- 172.21.15.81:0/1564356072 >> 172.21.15.81:0/1564356072 conn(0x7fc4780c68c0 msgr2=0x7fc4780c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- 172.21.15.81:0/1564356072 shutdown_connections 2024-05-08T20:40:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- 172.21.15.81:0/1564356072 wait complete. 2024-05-08T20:40:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 Processor -- start 2024-05-08T20:40:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- start start 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4781e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc47814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc47814f1a0 0x7fc4780716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4781ea280 con 0x7fc4780c2570 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47814b2e0 con 0x7fc47814f1a0 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc47e058640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47814b5c0 con 0x7fc47806c250 2024-05-08T20:40:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc47814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc47814a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51826/0 (socket says 172.21.15.81:51826) 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 -- 172.21.15.81:0/2743806926 learned_addr learned my addr 172.21.15.81:0/2743806926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc4777fe640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4781e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc477fff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc47814f1a0 0x7fc4780716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 msgr2=0x7fc4781e9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc47806c250 0x7fc4781e9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc47814f1a0 msgr2=0x7fc4780716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc47814f1a0 0x7fc4780716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009b30 con 0x7fc4780c2570 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.632+0000 7fc476ffd640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc47814a9b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d5f0 tx=0x7fc46c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0125f0 con 0x7fc4780c2570 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c012750 con 0x7fc4780c2570 2024-05-08T20:40:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47814b8a0 con 0x7fc4780c2570 2024-05-08T20:40:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c012ae0 con 0x7fc4780c2570 2024-05-08T20:40:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4781514f0 con 0x7fc4780c2570 2024-05-08T20:40:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc47e058640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 0x7fc478071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc478069550 con 0x7fc4781435f0 2024-05-08T20:40:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc4777fe640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 0x7fc478071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc46c012c40 con 0x7fc4780c2570 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc4777fe640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc478066050 con 0x7fc4781435f0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc4777fe640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 0x7fc478071c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc46800e4d0 tx=0x7fc46800e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc464066690 0x7fc464068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc477fff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc464066690 0x7fc464068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc46c0849d0 con 0x7fc4780c2570 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468007240 con 0x7fc4781435f0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc477fff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc464066690 0x7fc464068b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc4700b0000 tx=0x7fc4700a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc4680073a0 con 0x7fc4781435f0 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 msgr2=0x7fc478071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 0x7fc478071c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc46800e4d0 tx=0x7fc46800e990 comp rx=0 tx=0).stop 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 msgr2=0x7fc478071c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.636+0000 7fc45ffff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4781435f0 0x7fc478071c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc47e058640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 0x7fc4780aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc478073d20 con 0x7fc4780aa3b0 2024-05-08T20:40:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc4777fe640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 0x7fc4780aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc4777fe640 1 -- 172.21.15.81:0/2743806926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc478074950 con 0x7fc4780aa3b0 2024-05-08T20:40:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc4777fe640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 0x7fc4780aa7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc46800e4d0 tx=0x7fc468003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.644+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46801eb80 con 0x7fc4780aa3b0 2024-05-08T20:40:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fc46801ece0 con 0x7fc4780aa3b0 2024-05-08T20:40:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 msgr2=0x7fc4780aa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc45ffff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 0x7fc4780aa7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc46800e4d0 tx=0x7fc468003770 comp rx=0 tx=0).stop 2024-05-08T20:40:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc45ffff640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 msgr2=0x7fc4780aa7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc45ffff640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4780aa3b0 0x7fc4780aa7c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 104, 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 15, 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:30.662 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc464066690 msgr2=0x7fc464068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc464066690 0x7fc464068b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc4700b0000 tx=0x7fc4700a9070 comp rx=0 tx=0).stop 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 msgr2=0x7fc47814a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 --2- 172.21.15.81:0/2743806926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4780c2570 0x7fc47814a9b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d5f0 tx=0x7fc46c00dab0 comp rx=0 tx=0).stop 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc477fff640 1 -- 172.21.15.81:0/2743806926 reap_dead start 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc477fff640 1 -- 172.21.15.81:0/2743806926 reap_dead start 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 shutdown_connections 2024-05-08T20:40:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 >> 172.21.15.81:0/2743806926 conn(0x7fc4780c68c0 msgr2=0x7fc4780c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 shutdown_connections 2024-05-08T20:40:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:30.648+0000 7fc47e058640 1 -- 172.21.15.81:0/2743806926 wait complete. 2024-05-08T20:40:30.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:40:30.665 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-05-08T20:40:30.665 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-05-08T20:40:30.665 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-05-08T20:40:30.665 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:40:30.666 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:40:30.666 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:40:30.679 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:40:30.679 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-05-08T20:40:30.679 INFO:tasks.ceph.mon.c:Sent signal 19 2024-05-08T20:40:30.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:40:45.681 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-05-08T20:40:45.681 INFO:tasks.ceph.mon.c:Sent signal 18 2024-05-08T20:40:45.682 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:40:45.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:40:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 Processor -- start 2024-05-08T20:40:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 -- start start 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d006fd60 con 0x7f75d006f400 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d0072180 con 0x7f75d00725f0 2024-05-08T20:40:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75d4f9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c0650 con 0x7f75d01501e0 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75ced9d640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75d00c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.807+0000 7f75ced9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75cdd9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 learned_addr learned my addr 172.21.15.81:0/1085165885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:45.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:45.811+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.011+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75d00c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.011+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.015+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:40:46.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.415+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75d00c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:46.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.415+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:46.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:46.419+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:40:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.219+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75d00c2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.219+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:40:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:40:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:47.223+0000 7f75ce59c640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75d006c930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75d006c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 msgr2=0x7f75d00c1c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.117:3300/0 conn(0x7f75d00725f0 0x7f75d00c1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75d00c2180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75d00c2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d006fa80 con 0x7f75b0003680 2024-05-08T20:40:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b000c150 con 0x7f75b00073d0 2024-05-08T20:40:48.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:48.811+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:49.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:49.015+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:49.419+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:50.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:50.223+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:50.463+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.117:6789/0 conn(0x7f75b00073d0 legacy=0x7f75b0009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-08T20:40:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:50.463+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.117:6789/0 conn(0x7f75b00073d0 legacy=0x7f75b0009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:40:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:50.463+0000 7f75cdd9b640 1 --1- 172.21.15.81:0/1085165885 >> v1:172.21.15.117:6789/0 conn(0x7f75b00073d0 0x7f75b0009890 :-1 s=OPENED pgs=66 cs=1 l=1).handle_message read tag failed 2024-05-08T20:40:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:50.463+0000 7f75cdd9b640 1 --1- 172.21.15.81:0/1085165885 >> v1:172.21.15.117:6789/0 conn(0x7f75b00073d0 0x7f75b0009890 :-1 s=OPENED pgs=66 cs=1 l=1).fault on lossy channel, failing 2024-05-08T20:40:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.117:6789/0 conn(0x7f75b00073d0 legacy=0x7f75b0009890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:51.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 reap_dead start 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75b000c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75b000c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b000d350 con 0x7f75b0003680 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d006fd60 con 0x7f75d006f400 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75bffff640 1 -- 172.21.15.81:0/1085165885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0072180 con 0x7f75d01501e0 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ce59c640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75cdd9b640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75b000c360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75b000c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:51.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75b000c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 msgr2=0x7f75b000c360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75b000c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 >> v1:172.21.15.81:6789/0 conn(0x7f75b0003680 legacy=0x7f75b0005aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.811+0000 7f75ced9d640 1 -- 172.21.15.81:0/1085165885 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d006fa80 con 0x7f75d01501e0 2024-05-08T20:40:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.815+0000 7f75ced9d640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75b000c8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d00706c0 tx=0x7f75c801cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3bf73b96db482a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75cd59a640 1 -- 172.21.15.81:0/1085165885 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80ac420 con 0x7f75d01501e0 2024-05-08T20:40:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75cd59a640 1 -- 172.21.15.81:0/1085165885 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80a8070 con 0x7f75d01501e0 2024-05-08T20:40:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75cd59a640 1 -- 172.21.15.81:0/1085165885 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80ac7c0 con 0x7f75d01501e0 2024-05-08T20:40:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 -- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 msgr2=0x7f75b000c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75b000c8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d00706c0 tx=0x7f75c801cf50 comp rx=0 tx=0).stop 2024-05-08T20:40:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 -- 172.21.15.81:0/1085165885 shutdown_connections 2024-05-08T20:40:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/1085165885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75d01501e0 0x7f75b000c8c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:51.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/1085165885 >> v2:172.21.15.81:3300/0 conn(0x7f75d006f400 0x7f75b000c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 -- 172.21.15.81:0/1085165885 >> 172.21.15.81:0/1085165885 conn(0x7f75d00c2ca0 msgr2=0x7f75d00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 -- 172.21.15.81:0/1085165885 shutdown_connections 2024-05-08T20:40:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.819+0000 7f75d4f9a640 1 -- 172.21.15.81:0/1085165885 wait complete. 2024-05-08T20:40:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 Processor -- start 2024-05-08T20:40:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 -- start start 2024-05-08T20:40:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 0x7f75d01ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 0x7f75d0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01eec80 con 0x7f75d01501e0 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01eef20 con 0x7f75d006f400 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75d4f9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01e0a40 con 0x7f75b0003680 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ced9d640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 msgr2=0x7f75d0141ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 0x7f75d0141ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75cdd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 0x7f75d01ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58132/0 (socket says 172.21.15.81:58132) 2024-05-08T20:40:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 -- 172.21.15.81:0/794645145 learned_addr learned my addr 172.21.15.81:0/794645145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 -- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 msgr2=0x7f75d01ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 0x7f75d01ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 -- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 msgr2=0x7f75d0141ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 0x7f75d0141ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75ce59c640 1 -- 172.21.15.81:0/794645145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8007b10 con 0x7f75b0003680 2024-05-08T20:40:51.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.823+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 0x7f75d01ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75ce59c640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75c0010660 tx=0x7f75c0010b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0012930 con 0x7f75b0003680 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c000c040 con 0x7f75b0003680 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0012cf0 con 0x7f75b0003680 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d01e0d20 con 0x7f75b0003680 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0140bd0 con 0x7f75b0003680 2024-05-08T20:40:51.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d0074950 con 0x7f75b0003680 2024-05-08T20:40:51.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75c0020400 con 0x7f75b0003680 2024-05-08T20:40:51.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 0x7f75b0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:51.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f75c0084440 con 0x7f75b0003680 2024-05-08T20:40:51.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 0x7f75b0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:51.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.827+0000 7f75cdd9b640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 0x7f75b0069990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f75d01e89a0 tx=0x7f75c4012420 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:51.839+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f75c0051580 con 0x7f75b0003680 2024-05-08T20:40:52.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f75d01dea00 con 0x7f75b0003680 2024-05-08T20:40:52.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75beffd640 1 -- 172.21.15.81:0/794645145 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f75c0054ba0 con 0x7f75b0003680 2024-05-08T20:40:52.058 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":106,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:40:52.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 msgr2=0x7f75b0069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 0x7f75b0069990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f75d01e89a0 tx=0x7f75c4012420 comp rx=0 tx=0).stop 2024-05-08T20:40:52.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 msgr2=0x7f75d01ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75c0010660 tx=0x7f75c0010b20 comp rx=0 tx=0).stop 2024-05-08T20:40:52.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 shutdown_connections 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f75b00674d0 0x7f75b0069990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d01501e0 0x7f75d0141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75d006f400 0x7f75d01ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 --2- 172.21.15.81:0/794645145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75b0003680 0x7f75d01ee0d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 >> 172.21.15.81:0/794645145 conn(0x7f75d00c2ca0 msgr2=0x7f75d006aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 shutdown_connections 2024-05-08T20:40:52.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.055+0000 7f75d4f9a640 1 -- 172.21.15.81:0/794645145 wait complete. 2024-05-08T20:40:52.075 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:40:52.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:40:52.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:40:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 Processor -- start 2024-05-08T20:40:52.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 -- start start 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbcd80c2e30 0x7fbcd80c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80c2b60 con 0x7fbcd814ff20 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd8065f00 con 0x7fbcd8155cc0 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcde557640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd80661e0 con 0x7fbcd80c2e30 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd7fff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7fbcd814ff20 legacy=0x7fbcd80c2450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd77fe640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7fbcd80c2e30 msgr2=0x7fbcd80c12c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbcd80c2e30 0x7fbcd80c12c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcdcaf4640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbcd8155cc0 0x7fbcd815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:50884/0 (socket says 172.21.15.81:50884) 2024-05-08T20:40:52.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcdcaf4640 1 -- 172.21.15.81:0/3665135314 learned_addr learned my addr 172.21.15.81:0/3665135314 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:52.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861779567 0 0) 0x7fbcd8065f00 con 0x7fbcd8155cc0 2024-05-08T20:40:52.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc0003530 con 0x7fbcd8155cc0 2024-05-08T20:40:52.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176251209 0 0) 0x7fbcc0003530 con 0x7fbcd8155cc0 2024-05-08T20:40:52.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 >> v2:172.21.15.81:3300/0 conn(0x7fbcd80c2e30 msgr2=0x7fbcd80c12c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 --2- 172.21.15.81:0/3665135314 >> v2:172.21.15.81:3300/0 conn(0x7fbcd80c2e30 0x7fbcd80c12c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 >> v1:172.21.15.81:6789/0 conn(0x7fbcd814ff20 legacy=0x7fbcd80c2450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80a9970 con 0x7fbcd8155cc0 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.191+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fbcd0001a00 con 0x7fbcd8155cc0 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 >> v1:172.21.15.117:6789/0 conn(0x7fbcd8155cc0 legacy=0x7fbcd815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcc0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcc00047d0 0x7fbcc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc00052b0 0x7fbcc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80661e0 con 0x7fbcc00052b0 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc000c200 con 0x7fbcc0003980 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc000c3c0 con 0x7fbcc00047d0 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcdcaf4640 1 -- 172.21.15.81:0/3665135314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc00052b0 msgr2=0x7fbcc000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcdcaf4640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc00052b0 0x7fbcc000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd77fe640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcc00047d0 0x7fbcc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcc0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 -- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcc00047d0 msgr2=0x7fbcc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcc00047d0 0x7fbcc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 -- 172.21.15.81:0/3665135314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc00052b0 msgr2=0x7fbcc000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc00052b0 0x7fbcc000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 -- 172.21.15.81:0/3665135314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0003530 con 0x7fbcc0003980 2024-05-08T20:40:52.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcdcaf4640 1 -- 172.21.15.81:0/3665135314 reap_dead start 2024-05-08T20:40:52.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcc0003d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbccc006fd0 tx=0x7fbccc01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a799bf981f97815 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc003bc0 con 0x7fbcc0003980 2024-05-08T20:40:52.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0a7070 con 0x7fbcc0003980 2024-05-08T20:40:52.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.195+0000 7fbcd6ffd640 1 -- 172.21.15.81:0/3665135314 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc005070 con 0x7fbcc0003980 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 msgr2=0x7fbcc0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcc0003d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbccc006fd0 tx=0x7fbccc01c400 comp rx=0 tx=0).stop 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- 172.21.15.81:0/3665135314 shutdown_connections 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 --2- 172.21.15.81:0/3665135314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcc0003d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- 172.21.15.81:0/3665135314 >> 172.21.15.81:0/3665135314 conn(0x7fbcd80a8670 msgr2=0x7fbcd80a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- 172.21.15.81:0/3665135314 shutdown_connections 2024-05-08T20:40:52.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- 172.21.15.81:0/3665135314 wait complete. 2024-05-08T20:40:52.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 Processor -- start 2024-05-08T20:40:52.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- start start 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcd814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 0x7fbcd81ea620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd81eab60 0x7fbcd80bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81536f0 con 0x7fbcd81eab60 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81ea190 con 0x7fbcc0003980 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcde557640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81e9e80 con 0x7fbcd81529b0 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcdcaf4640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd81eab60 msgr2=0x7fbcd80bfcf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcdcaf4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd81eab60 0x7fbcd80bfcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcd814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 0x7fbcd81ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 0x7fbcd81ea620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58152/0 (socket says 172.21.15.81:58152) 2024-05-08T20:40:52.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 -- 172.21.15.81:0/982017614 learned_addr learned my addr 172.21.15.81:0/982017614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:52.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 msgr2=0x7fbcd814c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc0003980 0x7fbcd814c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd81eab60 msgr2=0x7fbcd80bfcf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcd81eab60 0x7fbcd80bfcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8072190 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd77fe640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 0x7fbcd81ea620 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80095f0 tx=0x7fbcc80099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.199+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8012600 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8012760 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8012ad0 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd8072430 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd814cbc0 con 0x7fbcd81529b0 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcde557640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 0x7fbcd81ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8069670 con 0x7fbcd80c0230 2024-05-08T20:40:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 0x7fbcd81ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd7fff640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcd8156ab0 con 0x7fbcd80c0230 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 0x7fbcd81ed470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00057b0 tx=0x7fbccc0191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0bb070 con 0x7fbcd80c0230 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcc8012c30 con 0x7fbcd81529b0 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbcc4066760 0x7fbcc4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbcc8084190 con 0x7fbcd81529b0 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcdcaf4640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbcc4066760 0x7fbcc4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbccc0b3040 con 0x7fbcd80c0230 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 msgr2=0x7fbcd81ed470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 0x7fbcd81ed470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00057b0 tx=0x7fbccc0191a0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 msgr2=0x7fbcd81ed470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcd4ff9640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd80c0230 0x7fbcd81ed470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.203+0000 7fbcdcaf4640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbcc4066760 0x7fbcc4068c20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcd806f5a0 tx=0x7fbcd00012c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 0x7fbcd81ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80c0610 con 0x7fbcd8070a10 2024-05-08T20:40:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 0x7fbcd81ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd7fff640 1 -- 172.21.15.81:0/982017614 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbcd80728e0 con 0x7fbcd8070a10 2024-05-08T20:40:52.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd7fff640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 0x7fbcd81ed9b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009770 tx=0x7fbcc0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b2070 con 0x7fbcd8070a10 2024-05-08T20:40:52.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4797 (secure 0 0 0) 0x7fbccc005830 con 0x7fbcd8070a10 2024-05-08T20:40:52.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 msgr2=0x7fbcd81ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 0x7fbcd81ed9b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009770 tx=0x7fbcc0005800 comp rx=0 tx=0).stop 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 msgr2=0x7fbcd81ed9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcd4ff9640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcd8070a10 0x7fbcd81ed9b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 106, 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:52.216 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.217 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.220 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:52.222 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:52.223 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:52.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.228 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:52.228 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:52.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbcc4066760 msgr2=0x7fbcc4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbcc4066760 0x7fbcc4068c20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcd806f5a0 tx=0x7fbcd00012c0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 msgr2=0x7fbcd81ea620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 --2- 172.21.15.81:0/982017614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbcd81529b0 0x7fbcd81ea620 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80095f0 tx=0x7fbcc80099f0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcdcaf4640 1 -- 172.21.15.81:0/982017614 reap_dead start 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcdcaf4640 1 -- 172.21.15.81:0/982017614 reap_dead start 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 shutdown_connections 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 >> 172.21.15.81:0/982017614 conn(0x7fbcd80a8670 msgr2=0x7fbcd80c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 shutdown_connections 2024-05-08T20:40:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.211+0000 7fbcde557640 1 -- 172.21.15.81:0/982017614 wait complete. 2024-05-08T20:40:52.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:40:52.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:40:52.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:40:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 Processor -- start 2024-05-08T20:40:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 -- start start 2024-05-08T20:40:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3080c1f90 0x7fc30815d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3080c23c0 con 0x7fc3080c1bb0 2024-05-08T20:40:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308155060 con 0x7fc308151740 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc310721640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc308155340 con 0x7fc3080c1f90 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30e4bd640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7fc3080c1bb0 legacy=0x7fc308152e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30ecbe640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7fc3080c1f90 msgr2=0x7fc30815d090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30ecbe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3080c1f90 0x7fc30815d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc308151740 0x7fc3081535a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:50886/0 (socket says 172.21.15.81:50886) 2024-05-08T20:40:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 -- 172.21.15.81:0/755081625 learned_addr learned my addr 172.21.15.81:0/755081625 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:40:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171889923 0 0) 0x7fc308155060 con 0x7fc308151740 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f4003530 con 0x7fc308151740 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951662037 0 0) 0x7fc2f4003530 con 0x7fc308151740 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 >> v2:172.21.15.81:3300/0 conn(0x7fc3080c1f90 msgr2=0x7fc30815d090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 --2- 172.21.15.81:0/755081625 >> v2:172.21.15.81:3300/0 conn(0x7fc3080c1f90 0x7fc30815d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 >> v1:172.21.15.81:6789/0 conn(0x7fc3080c1bb0 legacy=0x7fc308152e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308155620 con 0x7fc308151740 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc2f8001680 con 0x7fc308151740 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 >> v1:172.21.15.117:6789/0 conn(0x7fc308151740 legacy=0x7fc3081535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f4003980 0x7fc2f4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 0x7fc2f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f4005390 0x7fc2f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc308155340 con 0x7fc2f4005390 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f400c230 con 0x7fc2f4003980 2024-05-08T20:40:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f400c3f0 con 0x7fc2f40047d0 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30ecbe640 1 -- 172.21.15.81:0/755081625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f4005390 msgr2=0x7fc2f400b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30ecbe640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f4005390 0x7fc2f400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 0x7fc2f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30e4bd640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f4003980 0x7fc2f4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 -- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f4003980 msgr2=0x7fc2f4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f4003980 0x7fc2f4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 -- 172.21.15.81:0/755081625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f4005390 msgr2=0x7fc2f400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2f4005390 0x7fc2f400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30dcbc640 1 -- 172.21.15.81:0/755081625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4003530 con 0x7fc2f40047d0 2024-05-08T20:40:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.335+0000 7fc30ecbe640 1 -- 172.21.15.81:0/755081625 reap_dead start 2024-05-08T20:40:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 0x7fc2f4004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c1c0 tx=0x7fc2f801cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad8757de6b1bd33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80058e0 con 0x7fc2f40047d0 2024-05-08T20:40:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8005a40 con 0x7fc2f40047d0 2024-05-08T20:40:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc30d4bb640 1 -- 172.21.15.81:0/755081625 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005e30 con 0x7fc2f40047d0 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 -- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 msgr2=0x7fc2f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 0x7fc2f4004c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c1c0 tx=0x7fc2f801cbd0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 -- 172.21.15.81:0/755081625 shutdown_connections 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 --2- 172.21.15.81:0/755081625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2f40047d0 0x7fc2f4004c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 -- 172.21.15.81:0/755081625 >> 172.21.15.81:0/755081625 conn(0x7fc3080c2ca0 msgr2=0x7fc3080c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 -- 172.21.15.81:0/755081625 shutdown_connections 2024-05-08T20:40:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.339+0000 7fc310721640 1 -- 172.21.15.81:0/755081625 wait complete. 2024-05-08T20:40:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 Processor -- start 2024-05-08T20:40:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- start start 2024-05-08T20:40:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 0x7fc3081f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3081f1af0 0x7fc3080a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081f1f70 con 0x7fc3081f1af0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080aabb0 con 0x7fc2f40047d0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc308152610 con 0x7fc3080bb1c0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30ecbe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3081f1af0 msgr2=0x7fc3080a84e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30ecbe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3081f1af0 0x7fc3080a84e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30dcbc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 0x7fc3081f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30dcbc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 0x7fc3081f15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58180/0 (socket says 172.21.15.81:58180) 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39194/0 (socket says 172.21.15.81:39194) 2024-05-08T20:40:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30dcbc640 1 -- 172.21.15.81:0/353575247 learned_addr learned my addr 172.21.15.81:0/353575247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:40:52.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 msgr2=0x7fc3081f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 0x7fc3081f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3081f1af0 msgr2=0x7fc3080a84e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3081f1af0 0x7fc3080a84e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080ab0e0 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080bb1c0 0x7fc3081f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc30e4bd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc304003990 tx=0x7fc304009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304009e80 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400e7b0 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400eb40 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3080bfd70 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3081f1090 con 0x7fc2f40047d0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 0x7fc3080a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.343+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080696e0 con 0x7fc3080c25c0 2024-05-08T20:40:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 0x7fc3080a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc30dcbc640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc308072250 con 0x7fc3080c25c0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 0x7fc3080a8a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80ab040 tx=0x7fc2f8019970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc30400eca0 con 0x7fc2f40047d0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2ec066670 0x7fc2ec068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80a5c90 con 0x7fc3080c25c0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc30ecbe640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2ec066670 0x7fc2ec068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc304084480 con 0x7fc2f40047d0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc2f80047f0 con 0x7fc3080c25c0 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 msgr2=0x7fc3080a8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 0x7fc3080a8a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80ab040 tx=0x7fc2f8019970 comp rx=0 tx=0).stop 2024-05-08T20:40:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 msgr2=0x7fc3080a8a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:52.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc2feffd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3080c25c0 0x7fc3080a8a20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.347+0000 7fc30ecbe640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2ec066670 0x7fc2ec068b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc308072a50 tx=0x7fc300009170 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.351+0000 7fc310721640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 0x7fc3081ee290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:40:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.351+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080c29a0 con 0x7fc3081ede80 2024-05-08T20:40:52.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 0x7fc3081ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:40:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc30dcbc640 1 -- 172.21.15.81:0/353575247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc308154cf0 con 0x7fc3081ede80 2024-05-08T20:40:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc30dcbc640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 0x7fc3081ee290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000fc0 tx=0x7fc2f4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:40:52.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80bb050 con 0x7fc3081ede80 2024-05-08T20:40:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7fc2f80c0070 con 0x7fc3081ede80 2024-05-08T20:40:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 msgr2=0x7fc3081ee290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 0x7fc3081ee290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000fc0 tx=0x7fc2f4005800 comp rx=0 tx=0).stop 2024-05-08T20:40:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 msgr2=0x7fc3081ee290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:40:52.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc2feffd640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3081ede80 0x7fc3081ee290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 106, 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:40:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:40:52.362 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:40:52.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:40:52.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:40:52.366 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:40:52.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:40:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:40:52.371 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:40:52.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2ec066670 msgr2=0x7fc2ec068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2ec066670 0x7fc2ec068b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc308072a50 tx=0x7fc300009170 comp rx=0 tx=0).stop 2024-05-08T20:40:52.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 msgr2=0x7fc308070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc30ecbe640 1 -- 172.21.15.81:0/353575247 reap_dead start 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc304003990 tx=0x7fc304009b40 comp rx=0 tx=0).stop 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 shutdown_connections 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 --2- 172.21.15.81:0/353575247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2f40047d0 0x7fc308070c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 >> 172.21.15.81:0/353575247 conn(0x7fc3080c2ca0 msgr2=0x7fc308071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 shutdown_connections 2024-05-08T20:40:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:40:52.355+0000 7fc310721640 1 -- 172.21.15.81:0/353575247 wait complete. 2024-05-08T20:40:52.373 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:40:52.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:40:52.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:40:52.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:41:12.374 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:41:12.375 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-05-08T20:41:12.375 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:41:12.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:41:12.378 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:41:12.378 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-05-08T20:41:12.378 INFO:tasks.ceph.mon.c:Sent signal 19 2024-05-08T20:41:12.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:41:23.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:41:23.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:41:27.379 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-05-08T20:41:27.380 INFO:tasks.ceph.mon.c:Sent signal 18 2024-05-08T20:41:27.380 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:41:27.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:41:27.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.515+0000 7f3ec9464640 1 Processor -- start 2024-05-08T20:41:27.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.515+0000 7f3ec9464640 1 -- start start 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec9464640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec9464640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec4158e20 con 0x7f3ec40ca000 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec9464640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec4155860 con 0x7f3ec4154cf0 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec9464640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec406bb20 con 0x7f3ec4151f00 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ec40ca000 0x7f3ec40ca440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49608/0 (socket says 172.21.15.81:49608) 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec37fe640 1 -- 172.21.15.81:0/1313649420 learned_addr learned my addr 172.21.15.81:0/1313649420 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:27.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:27.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:27.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:28.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 msgr2=0x7f3ec41588e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ec4151f00 0x7f3ec41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.117:6789/0 conn(0x7f3ec4154cf0 legacy=0x7f3ec4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.81:6789/0 conn(0x7f3ec40ca000 legacy=0x7f3ec40ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:30.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:30.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea4008df0 con 0x7f3ea40062a0 2024-05-08T20:41:30.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4008f60 con 0x7f3ea4003740 2024-05-08T20:41:30.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:30.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:30.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:30.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:30.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:31.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:31.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 msgr2=0x7f3ea4005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003740 0x7f3ea4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 msgr2=0x7f3ea4008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea40062a0 0x7f3ea4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec37fe640 1 -- 172.21.15.81:0/1313649420 reap_dead start 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec41522e0 con 0x7f3ea4006c90 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea4008920 con 0x7f3ec4154cf0 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4008df0 con 0x7f3ea4003b60 2024-05-08T20:41:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:33.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:34.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:34.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:34.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:34.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:34.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:34.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.117:6789/0 conn(0x7f3ec4154cf0 legacy=0x7f3ea400b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.81:6789/0 conn(0x7f3ea4006c90 legacy=0x7f3ea4007140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea4008df0 con 0x7f3ea400eb80 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea4008f60 con 0x7f3ea400f680 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:36.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:36.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:36.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:36.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:36.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:36.723+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.127+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:41:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:37.931+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:41:39.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 msgr2=0x7f3ea400fa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:39.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.117:3300/0 conn(0x7f3ea400f680 0x7f3ea400fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 msgr2=0x7f3ea400ef90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:39.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> v2:172.21.15.81:3300/0 conn(0x7f3ea400eb80 0x7f3ea400ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec37fe640 1 -- 172.21.15.81:0/1313649420 reap_dead start 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea4010ac0 con 0x7f3ea4006c90 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea400ef90 con 0x7f3ec4154cf0 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec17fa640 1 -- 172.21.15.81:0/1313649420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4008df0 con 0x7f3ea4003b60 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ec27fc640 1 -- 172.21.15.81:0/1313649420 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942470595 0 0) 0x7f3ea4010ac0 con 0x7f3ea4006c90 2024-05-08T20:41:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.117:6789/0 conn(0x7f3ec4154cf0 legacy=0x7f3ea4010300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 >> v1:172.21.15.81:6789/0 conn(0x7f3ea4006c90 legacy=0x7f3ea400e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.519+0000 7f3ebbfff640 1 -- 172.21.15.81:0/1313649420 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea400f120 con 0x7f3ea4003b60 2024-05-08T20:41:39.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005450 tx=0x7f3eac01d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8069ce4fc32aa0be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec27fc640 1 -- 172.21.15.81:0/1313649420 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0a57e0 con 0x7f3ea4003b60 2024-05-08T20:41:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec27fc640 1 -- 172.21.15.81:0/1313649420 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0a9070 con 0x7f3ea4003b60 2024-05-08T20:41:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec27fc640 1 -- 172.21.15.81:0/1313649420 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0a5b80 con 0x7f3ea4003b60 2024-05-08T20:41:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 -- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 msgr2=0x7f3ea4006750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3eac005450 tx=0x7f3eac01d530 comp rx=0 tx=0).stop 2024-05-08T20:41:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 -- 172.21.15.81:0/1313649420 shutdown_connections 2024-05-08T20:41:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 --2- 172.21.15.81:0/1313649420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4003b60 0x7f3ea4006750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 -- 172.21.15.81:0/1313649420 >> 172.21.15.81:0/1313649420 conn(0x7f3ec40715f0 msgr2=0x7f3ec4071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 -- 172.21.15.81:0/1313649420 shutdown_connections 2024-05-08T20:41:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.527+0000 7f3ec9464640 1 -- 172.21.15.81:0/1313649420 wait complete. 2024-05-08T20:41:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.531+0000 7f3ec9464640 1 Processor -- start 2024-05-08T20:41:39.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.531+0000 7f3ec9464640 1 -- start start 2024-05-08T20:41:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4006c90 0x7f3ec40c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4154cf0 0x7f3ec40ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40c35c0 con 0x7f3ea4003b60 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec41ef740 con 0x7f3ec4154cf0 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40bf110 con 0x7f3ea4006c90 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38818/0 (socket says 172.21.15.81:38818) 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/3686771144 learned_addr learned my addr 172.21.15.81:0/3686771144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4006c90 0x7f3ec40c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec37fe640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4154cf0 0x7f3ec40ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4006c90 msgr2=0x7f3ec40c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4006c90 0x7f3ec40c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4154cf0 msgr2=0x7f3ec40ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4154cf0 0x7f3ec40ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 -- 172.21.15.81:0/3686771144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac00f040 con 0x7f3ea4003b60 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec2ffd640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4016b40 tx=0x7f3eb401ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4017c20 con 0x7f3ea4003b60 2024-05-08T20:41:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb401e050 con 0x7f3ea4003b60 2024-05-08T20:41:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004030 con 0x7f3ea4003b60 2024-05-08T20:41:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec40bf3f0 con 0x7f3ea4003b60 2024-05-08T20:41:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec41e5960 con 0x7f3ea4003b60 2024-05-08T20:41:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.535+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec4074950 con 0x7f3ea4003b60 2024-05-08T20:41:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.539+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3eb4004190 con 0x7f3ea4003b60 2024-05-08T20:41:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.539+0000 7f3ebb7fe640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 0x7f3ea406b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.539+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3eb4085c10 con 0x7f3ea4003b60 2024-05-08T20:41:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.539+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 0x7f3ea406b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.539+0000 7f3ebbfff640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 0x7f3ea406b3d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0b0000 tx=0x7f3eac0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:39.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.543+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3eb4052d20 con 0x7f3ea4003b60 2024-05-08T20:41:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3ec406ab10 con 0x7f3ea4003b60 2024-05-08T20:41:39.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ebb7fe640 1 -- 172.21.15.81:0/3686771144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f3eb4029620 con 0x7f3ea4003b60 2024-05-08T20:41:39.850 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:41:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 msgr2=0x7f3ea406b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 0x7f3ea406b3d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0b0000 tx=0x7f3eac0a7070 comp rx=0 tx=0).stop 2024-05-08T20:41:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 msgr2=0x7f3ec41ef200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4016b40 tx=0x7f3eb401ae20 comp rx=0 tx=0).stop 2024-05-08T20:41:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 shutdown_connections 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ea4068f10 0x7f3ea406b3d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec4154cf0 0x7f3ec40ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ea4006c90 0x7f3ec40c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 --2- 172.21.15.81:0/3686771144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea4003b60 0x7f3ec41ef200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 >> 172.21.15.81:0/3686771144 conn(0x7f3ec40715f0 msgr2=0x7f3ec40ac5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.847+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 shutdown_connections 2024-05-08T20:41:39.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.851+0000 7f3ec9464640 1 -- 172.21.15.81:0/3686771144 wait complete. 2024-05-08T20:41:39.869 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:41:39.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:41:39.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:41:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 Processor -- start 2024-05-08T20:41:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 -- start start 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fdc151f00 0x7f1fdc1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc154cf0 0x7f1fdc155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc158e20 con 0x7f1fdc155690 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc06bb20 con 0x7f1fdc151f00 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe2e99640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1548e0 con 0x7f1fdc154cf0 2024-05-08T20:41:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe0c35640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fdc151f00 0x7f1fdc1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe1436640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1fdc155690 0x7f1fdc0ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37956/0 (socket says 172.21.15.81:37956) 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe1436640 1 -- 172.21.15.81:0/3089839935 learned_addr learned my addr 172.21.15.81:0/3089839935 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe0c35640 1 -- 172.21.15.81:0/3089839935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc154cf0 msgr2=0x7f1fdc155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3089839935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc154cf0 0x7f1fdc155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe0c35640 1 -- 172.21.15.81:0/3089839935 >> v1:172.21.15.81:6789/0 conn(0x7f1fdc155690 legacy=0x7f1fdc0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.991+0000 7f1fe0c35640 1 -- 172.21.15.81:0/3089839935 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc1522e0 con 0x7f1fdc151f00 2024-05-08T20:41:39.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3089839935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc151f00 0x7f1fdc1588e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00097f0 tx=0x7f1fd001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0364fd15a8e5b10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:39.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fdb7fe640 1 -- 172.21.15.81:0/3089839935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00ac600 con 0x7f1fdc151f00 2024-05-08T20:41:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fdb7fe640 1 -- 172.21.15.81:0/3089839935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd00a8050 con 0x7f1fdc151f00 2024-05-08T20:41:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fdb7fe640 1 -- 172.21.15.81:0/3089839935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00ac980 con 0x7f1fdc151f00 2024-05-08T20:41:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3089839935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc151f00 msgr2=0x7f1fdc1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3089839935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc151f00 0x7f1fdc1588e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00097f0 tx=0x7f1fd001c3a0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3089839935 shutdown_connections 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3089839935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc154cf0 0x7f1fdc155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3089839935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc151f00 0x7f1fdc1588e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3089839935 >> 172.21.15.81:0/3089839935 conn(0x7f1fdc0715f0 msgr2=0x7f1fdc071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3089839935 shutdown_connections 2024-05-08T20:41:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3089839935 wait complete. 2024-05-08T20:41:39.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 Processor -- start 2024-05-08T20:41:39.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.995+0000 7f1fe2e99640 1 -- start start 2024-05-08T20:41:40.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc151f00 0x7f1fdc150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 0x7f1fdc1f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fdc1edc60 0x7f1fdc1f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1f1770 con 0x7f1fdc154cf0 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1ee1b0 con 0x7f1fdc1edc60 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1f0840 con 0x7f1fdc151f00 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 0x7f1fdc1f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 0x7f1fdc1f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38832/0 (socket says 172.21.15.81:38832) 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 -- 172.21.15.81:0/3327508011 learned_addr learned my addr 172.21.15.81:0/3327508011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc151f00 0x7f1fdc150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe1436640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fdc1edc60 0x7f1fdc1f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc151f00 msgr2=0x7f1fdc150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fdc151f00 0x7f1fdc150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fdc1edc60 msgr2=0x7f1fdc1f1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fdc1edc60 0x7f1fdc1f1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0009420 con 0x7f1fdc154cf0 2024-05-08T20:41:40.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe1436640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fdc1edc60 0x7f1fdc1f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fdbfff640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 0x7f1fdc1f0cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b580 tx=0x7f1fc800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8010870 con 0x7f1fdc154cf0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc80109f0 con 0x7f1fdc154cf0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc155d40 con 0x7f1fdc154cf0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8010da0 con 0x7f1fdc154cf0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc1511d0 con 0x7f1fdc154cf0 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 0x7f1fdc149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc069600 con 0x7f1fdc155610 2024-05-08T20:41:40.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 0x7f1fdc149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe0c35640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fdc0cab20 con 0x7f1fdc155610 2024-05-08T20:41:40.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:39.999+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 0x7f1fdc149b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00097c0 tx=0x7f1fd0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00c0640 con 0x7f1fdc155610 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1fd00c07a0 con 0x7f1fdc155610 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 msgr2=0x7f1fdc149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 0x7f1fdc149b00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00097c0 tx=0x7f1fd0019140 comp rx=0 tx=0).stop 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 msgr2=0x7f1fdc149b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc155610 0x7f1fdc149b00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fc800f3c0 con 0x7f1fdc154cf0 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1fc00663a0 0x7f1fc0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1fc8084510 con 0x7f1fdc154cf0 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1fc00663a0 0x7f1fc0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.003+0000 7f1fe0c35640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1fc00663a0 0x7f1fc0068860 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0c6c50 tx=0x7f1fd00b9000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.007+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 0x7f1fdc14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.007+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c6820 con 0x7f1fdc0aeec0 2024-05-08T20:41:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.007+0000 7f1fe1436640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 0x7f1fdc14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.007+0000 7f1fe1436640 1 -- 172.21.15.81:0/3327508011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1fdc161a80 con 0x7f1fdc0aeec0 2024-05-08T20:41:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.007+0000 7f1fe1436640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 0x7f1fdc14a040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40012f0 tx=0x7f1fd400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4017070 con 0x7f1fdc0aeec0 2024-05-08T20:41:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f1fd400cbb0 con 0x7f1fdc0aeec0 2024-05-08T20:41:40.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 msgr2=0x7f1fdc14a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 0x7f1fdc14a040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40012f0 tx=0x7f1fd400c4b0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 msgr2=0x7f1fdc14a040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fd97fa640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc0aeec0 0x7f1fdc14a040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:40.024 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:40.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1fc00663a0 msgr2=0x7f1fc0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1fc00663a0 0x7f1fc0068860 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0c6c50 tx=0x7f1fd00b9000 comp rx=0 tx=0).stop 2024-05-08T20:41:40.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 msgr2=0x7f1fdc1f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 --2- 172.21.15.81:0/3327508011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fdc154cf0 0x7f1fdc1f0cf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b580 tx=0x7f1fc800ba40 comp rx=0 tx=0).stop 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe1436640 1 -- 172.21.15.81:0/3327508011 reap_dead start 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe1436640 1 -- 172.21.15.81:0/3327508011 reap_dead start 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 shutdown_connections 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 >> 172.21.15.81:0/3327508011 conn(0x7f1fdc0715f0 msgr2=0x7f1fdc0c9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 shutdown_connections 2024-05-08T20:41:40.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.011+0000 7f1fe2e99640 1 -- 172.21.15.81:0/3327508011 wait complete. 2024-05-08T20:41:40.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:40.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:41:40.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:41:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 Processor -- start 2024-05-08T20:41:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 -- start start 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f392806b230 0x7f39280c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f39281519d0 0x7f3928151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280c3a50 con 0x7f3928070c00 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3928072940 con 0x7f392806b230 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392e6dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39280705e0 con 0x7f39281519d0 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f3927fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f392806b230 0x7f39280c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f391f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3928070c00 0x7f392814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37968/0 (socket says 172.21.15.81:37968) 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f391f7fe640 1 -- 172.21.15.81:0/2163487044 learned_addr learned my addr 172.21.15.81:0/2163487044 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f392cc79640 1 --2- 172.21.15.81:0/2163487044 >> v2:172.21.15.117:3300/0 conn(0x7f39281519d0 0x7f3928151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f3927fff640 1 -- 172.21.15.81:0/2163487044 >> v2:172.21.15.117:3300/0 conn(0x7f39281519d0 msgr2=0x7f3928151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f3927fff640 1 --2- 172.21.15.81:0/2163487044 >> v2:172.21.15.117:3300/0 conn(0x7f39281519d0 0x7f3928151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f3927fff640 1 -- 172.21.15.81:0/2163487044 >> v1:172.21.15.81:6789/0 conn(0x7f3928070c00 legacy=0x7f392814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f3927fff640 1 -- 172.21.15.81:0/2163487044 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280708c0 con 0x7f392806b230 2024-05-08T20:41:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.159+0000 7f39277fe640 1 -- 172.21.15.81:0/2163487044 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634816574 0 0) 0x7f39280c3a50 con 0x7f3928070c00 2024-05-08T20:41:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f3927fff640 1 --2- 172.21.15.81:0/2163487044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392806b230 0x7f39280c2800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39280c2d40 tx=0x7f391801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c682cd1e6f86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f39277fe640 1 -- 172.21.15.81:0/2163487044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180ab5f0 con 0x7f392806b230 2024-05-08T20:41:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f39277fe640 1 -- 172.21.15.81:0/2163487044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39180ab750 con 0x7f392806b230 2024-05-08T20:41:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f39277fe640 1 -- 172.21.15.81:0/2163487044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180abae0 con 0x7f392806b230 2024-05-08T20:41:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- 172.21.15.81:0/2163487044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392806b230 msgr2=0x7f39280c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 --2- 172.21.15.81:0/2163487044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392806b230 0x7f39280c2800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39280c2d40 tx=0x7f391801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- 172.21.15.81:0/2163487044 shutdown_connections 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 --2- 172.21.15.81:0/2163487044 >> v2:172.21.15.117:3300/0 conn(0x7f39281519d0 0x7f3928151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 --2- 172.21.15.81:0/2163487044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392806b230 0x7f39280c2800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- 172.21.15.81:0/2163487044 >> 172.21.15.81:0/2163487044 conn(0x7f39280c71b0 msgr2=0x7f39280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- 172.21.15.81:0/2163487044 shutdown_connections 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- 172.21.15.81:0/2163487044 wait complete. 2024-05-08T20:41:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 Processor -- start 2024-05-08T20:41:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.163+0000 7f392e6dc640 1 -- start start 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392806b230 0x7f3928147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3928070c00 0x7f392815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 0x7f392815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39281efa40 con 0x7f39281519d0 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280aa8b0 con 0x7f3928070c00 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280aa2f0 con 0x7f392806b230 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 0x7f392815ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 0x7f392815ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38876/0 (socket says 172.21.15.81:38876) 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 learned_addr learned my addr 172.21.15.81:0/934562087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392806b230 0x7f3928147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f391f7fe640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3928070c00 0x7f392815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392806b230 msgr2=0x7f3928147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392806b230 0x7f3928147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3928070c00 msgr2=0x7f392815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3928070c00 0x7f392815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009420 con 0x7f39281519d0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f392806b230 0x7f3928147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392cc79640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 0x7f392815ad00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3920007e60 tx=0x7f392000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920014420 con 0x7f39281519d0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200145a0 con 0x7f39281519d0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39280aa5d0 con 0x7f39281519d0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920014950 con 0x7f39281519d0 2024-05-08T20:41:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392814ab00 con 0x7f39281519d0 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 0x7f39281eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928069550 con 0x7f39281eeb30 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 0x7f39281eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3920014ab0 con 0x7f39281519d0 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39080666c0 0x7f3908068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f3927fff640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f392814f1d0 con 0x7f39281eeb30 2024-05-08T20:41:40.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3920084ec0 con 0x7f39281519d0 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f391f7fe640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39080666c0 0x7f3908068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.167+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 0x7f39281eef10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f392806bd60 tx=0x7f3918019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180abad0 con 0x7f39281eeb30 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f391f7fe640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39080666c0 0x7f3908068b80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39280c16b0 tx=0x7f3910007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f39180abc30 con 0x7f39281eeb30 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 msgr2=0x7f39281eef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 0x7f39281eef10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f392806bd60 tx=0x7f3918019190 comp rx=0 tx=0).stop 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 msgr2=0x7f39281eef10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.171+0000 7f39257fa640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281eeb30 0x7f39281eef10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 0x7f39281ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39281ef860 con 0x7f39281ef450 2024-05-08T20:41:40.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 0x7f39281ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f3927fff640 1 -- 172.21.15.81:0/934562087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f39280675e0 con 0x7f39281ef450 2024-05-08T20:41:40.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f3927fff640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 0x7f39281ecff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3918019000 tx=0x7f3918009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180c32b0 con 0x7f39281ef450 2024-05-08T20:41:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f39180c7070 con 0x7f39281ef450 2024-05-08T20:41:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 msgr2=0x7f39281ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 0x7f39281ecff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3918019000 tx=0x7f3918009190 comp rx=0 tx=0).stop 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 msgr2=0x7f39281ecff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f39257fa640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39281ef450 0x7f39281ecff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:41:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.195 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:40.196 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39080666c0 msgr2=0x7f3908068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f39080666c0 0x7f3908068b80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39280c16b0 tx=0x7f3910007b60 comp rx=0 tx=0).stop 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 msgr2=0x7f392815ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 --2- 172.21.15.81:0/934562087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39281519d0 0x7f392815ad00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3920007e60 tx=0x7f392000e4b0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 reap_dead start 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392cc79640 1 -- 172.21.15.81:0/934562087 reap_dead start 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 shutdown_connections 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 >> 172.21.15.81:0/934562087 conn(0x7f39280c71b0 msgr2=0x7f39280c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 shutdown_connections 2024-05-08T20:41:40.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.179+0000 7f392e6dc640 1 -- 172.21.15.81:0/934562087 wait complete. 2024-05-08T20:41:40.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:40.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:41:40.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:41:40.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 Processor -- start 2024-05-08T20:41:40.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 -- start start 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f042c0a9bc0 0x7f042c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c155e10 con 0x7f042c0c2bc0 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c156080 con 0x7f042c0c30d0 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f04345b8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c06e790 con 0x7f042c0a9bc0 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f0431b53640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f042c0c2bc0 0x7f042c0a94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37972/0 (socket says 172.21.15.81:37972) 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f0431b53640 1 -- 172.21.15.81:0/845613484 learned_addr learned my addr 172.21.15.81:0/845613484 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f0432b55640 1 --2- 172.21.15.81:0/845613484 >> v2:172.21.15.81:3300/0 conn(0x7f042c0a9bc0 0x7f042c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768231727 0 0) 0x7f042c155e10 con 0x7f042c0c2bc0 2024-05-08T20:41:40.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.323+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0418003530 con 0x7f042c0c2bc0 2024-05-08T20:41:40.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187419317 0 0) 0x7f0418003530 con 0x7f042c0c2bc0 2024-05-08T20:41:40.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0432b55640 1 -- 172.21.15.81:0/845613484 >> v1:172.21.15.117:6789/0 conn(0x7f042c0c30d0 legacy=0x7f042c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0432b55640 1 -- 172.21.15.81:0/845613484 >> v1:172.21.15.81:6789/0 conn(0x7f042c0c2bc0 legacy=0x7f042c0a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0432b55640 1 -- 172.21.15.81:0/845613484 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c156360 con 0x7f042c0a9bc0 2024-05-08T20:41:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0432b55640 1 --2- 172.21.15.81:0/845613484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c34b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26df7a2e181f8678 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c001680 con 0x7f042c0a9bc0 2024-05-08T20:41:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04240a5550 con 0x7f042c0a9bc0 2024-05-08T20:41:40.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.327+0000 7f0431352640 1 -- 172.21.15.81:0/845613484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240a58c0 con 0x7f042c0a9bc0 2024-05-08T20:41:40.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/845613484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 msgr2=0x7f042c0c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 --2- 172.21.15.81:0/845613484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c34b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042401c800 comp rx=0 tx=0).stop 2024-05-08T20:41:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/845613484 shutdown_connections 2024-05-08T20:41:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 --2- 172.21.15.81:0/845613484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c34b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/845613484 >> 172.21.15.81:0/845613484 conn(0x7f042c0c4cc0 msgr2=0x7f042c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/845613484 shutdown_connections 2024-05-08T20:41:40.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/845613484 wait complete. 2024-05-08T20:41:40.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 Processor -- start 2024-05-08T20:41:40.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- start start 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c0c2bc0 0x7f042c1ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f042c0c30d0 0x7f042c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c14bc70 con 0x7f042c0a9bc0 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c153570 con 0x7f042c0c30d0 2024-05-08T20:41:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c152f40 con 0x7f042c0c2bc0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38888/0 (socket says 172.21.15.81:38888) 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 -- 172.21.15.81:0/3262186427 learned_addr learned my addr 172.21.15.81:0/3262186427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432b55640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f042c0c30d0 0x7f042c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c0c2bc0 0x7f042c1ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c0c2bc0 msgr2=0x7f042c1ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c0c2bc0 0x7f042c1ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f042c0c30d0 msgr2=0x7f042c150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f042c0c30d0 0x7f042c150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424009a70 con 0x7f042c0a9bc0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c0c2bc0 0x7f042c1ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0432354640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c24d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f042800c500 tx=0x7f042800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428005220 con 0x7f042c0a9bc0 2024-05-08T20:41:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0428005380 con 0x7f042c0a9bc0 2024-05-08T20:41:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c1eeed0 con 0x7f042c0a9bc0 2024-05-08T20:41:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.331+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428007270 con 0x7f042c0a9bc0 2024-05-08T20:41:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c1ee980 con 0x7f042c0a9bc0 2024-05-08T20:41:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f04345b8640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 0x7f042c151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c073ea0 con 0x7f042c150db0 2024-05-08T20:41:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 0x7f042c151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04280073d0 con 0x7f042c0a9bc0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0410066690 0x7f0410068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0431b53640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f042c152dc0 con 0x7f042c150db0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0428083830 con 0x7f042c0a9bc0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0432b55640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0410066690 0x7f0410068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 0x7f042c151190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f042c14b240 tx=0x7f041c00db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0432b55640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0410066690 0x7f0410068b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04240af000 tx=0x7f04240a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c005ae0 con 0x7f042c150db0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f041c005c40 con 0x7f042c150db0 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 msgr2=0x7f042c151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 0x7f042c151190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f042c14b240 tx=0x7f041c00db60 comp rx=0 tx=0).stop 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 msgr2=0x7f042c151190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.335+0000 7f0422ffd640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c150db0 0x7f042c151190 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f042c14b240 tx=0x7f041c00db60 comp rx=0 tx=0).stop 2024-05-08T20:41:40.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.343+0000 7f04345b8640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 0x7f042c142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.343+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c160930 con 0x7f042c142550 2024-05-08T20:41:40.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.343+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 0x7f042c142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.343+0000 7f0431b53640 1 -- 172.21.15.81:0/3262186427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f042c1eec60 con 0x7f042c142550 2024-05-08T20:41:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0431b53640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 0x7f042c142960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f5b0 tx=0x7f041c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c021070 con 0x7f042c142550 2024-05-08T20:41:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f041c0073a0 con 0x7f042c142550 2024-05-08T20:41:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 msgr2=0x7f042c142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 0x7f042c142960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f5b0 tx=0x7f041c000ee0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 msgr2=0x7f042c142960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0422ffd640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f042c142550 0x7f042c142960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.350 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:40.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:40.352 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:40.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:40.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:40.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.362 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:40.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:40.364 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0410066690 msgr2=0x7f0410068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0410066690 0x7f0410068b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04240af000 tx=0x7f04240a7070 comp rx=0 tx=0).stop 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 msgr2=0x7f042c0c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 --2- 172.21.15.81:0/3262186427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a9bc0 0x7f042c0c24d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f042800c500 tx=0x7f042800c9c0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0432b55640 1 -- 172.21.15.81:0/3262186427 reap_dead start 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f0432b55640 1 -- 172.21.15.81:0/3262186427 reap_dead start 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 shutdown_connections 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 >> 172.21.15.81:0/3262186427 conn(0x7f042c0c4cc0 msgr2=0x7f042c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 shutdown_connections 2024-05-08T20:41:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.347+0000 7f04345b8640 1 -- 172.21.15.81:0/3262186427 wait complete. 2024-05-08T20:41:40.367 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:40.367 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:41:40.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:41:40.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 Processor -- start 2024-05-08T20:41:40.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 -- start start 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f140c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f141519d0 0x7f2f14151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f140c3a50 con 0x7f2f14070c00 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f14072940 con 0x7f2f141519d0 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1bcfe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140705e0 con 0x7f2f1406b230 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f141519d0 0x7f2f14151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f141519d0 0x7f2f14151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38892/0 (socket says 172.21.15.81:38892) 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 -- 172.21.15.81:0/2736220091 learned_addr learned my addr 172.21.15.81:0/2736220091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f19a9a640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f140c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 -- 172.21.15.81:0/2736220091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 msgr2=0x7f2f140c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f140c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 -- 172.21.15.81:0/2736220091 >> v1:172.21.15.117:6789/0 conn(0x7f2f14070c00 legacy=0x7f2f1414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:40.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.487+0000 7f2f1a29b640 1 -- 172.21.15.81:0/2736220091 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140708c0 con 0x7f2f141519d0 2024-05-08T20:41:40.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1a29b640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f14151e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009e50 tx=0x7f2f0c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfa9f53d5fd7c6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f18a98640 1 -- 172.21.15.81:0/2736220091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a57e0 con 0x7f2f141519d0 2024-05-08T20:41:40.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f18a98640 1 -- 172.21.15.81:0/2736220091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0a5940 con 0x7f2f141519d0 2024-05-08T20:41:40.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f18a98640 1 -- 172.21.15.81:0/2736220091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a5cd0 con 0x7f2f141519d0 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/2736220091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 msgr2=0x7f2f14151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f14151e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009e50 tx=0x7f2f0c01c960 comp rx=0 tx=0).stop 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/2736220091 shutdown_connections 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f14151e60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/2736220091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f140c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/2736220091 >> 172.21.15.81:0/2736220091 conn(0x7f2f140c71b0 msgr2=0x7f2f140c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/2736220091 shutdown_connections 2024-05-08T20:41:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/2736220091 wait complete. 2024-05-08T20:41:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 Processor -- start 2024-05-08T20:41:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- start start 2024-05-08T20:41:40.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f1415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f14070c00 0x7f2f1414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1414ad20 con 0x7f2f141519d0 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f141500d0 con 0x7f2f14070c00 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1bcfe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14149e90 con 0x7f2f1406b230 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1a29b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1a29b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38898/0 (socket says 172.21.15.81:38898) 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f1a29b640 1 -- 172.21.15.81:0/263063106 learned_addr learned my addr 172.21.15.81:0/263063106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f19a9a640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f1415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.491+0000 7f2f19299640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f14070c00 0x7f2f1414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 -- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 msgr2=0x7f2f1415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f1415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 -- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f14070c00 msgr2=0x7f2f1414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f14070c00 0x7f2f1414f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 -- 172.21.15.81:0/263063106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009b30 con 0x7f2f141519d0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1a29b640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0af040 tx=0x7f2f0c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0b8640 con 0x7f2f141519d0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0b87a0 con 0x7f2f141519d0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1414a0a0 con 0x7f2f141519d0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0b8b10 con 0x7f2f141519d0 2024-05-08T20:41:40.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1414a660 con 0x7f2f141519d0 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f140675e0 con 0x7f2f141519d0 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f0c0b8c70 con 0x7f2f141519d0 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 0x7f2ef8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2f0c11f740 con 0x7f2f141519d0 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f19a9a640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 0x7f2ef8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:40.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.495+0000 7f2f19a9a640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 0x7f2ef8068b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b9d0 tx=0x7f2f10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.503+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2f0c0ec710 con 0x7f2f141519d0 2024-05-08T20:41:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.815+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2f1414ae60 con 0x7f2f141519d0 2024-05-08T20:41:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f0a7fc640 1 -- 172.21.15.81:0/263063106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2f1414ae60 con 0x7f2f141519d0 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 msgr2=0x7f2ef8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 0x7f2ef8068b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000b9d0 tx=0x7f2f10008040 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 msgr2=0x7f2f1414fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0af040 tx=0x7f2f0c019700 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 shutdown_connections 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ef8066690 0x7f2ef8068b50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f141519d0 0x7f2f1414fb90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f14070c00 0x7f2f1414f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 --2- 172.21.15.81:0/263063106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f1406b230 0x7f2f1415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 >> 172.21.15.81:0/263063106 conn(0x7f2f140c71b0 msgr2=0x7f2f140c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 shutdown_connections 2024-05-08T20:41:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:40.819+0000 7f2f1bcfe640 1 -- 172.21.15.81:0/263063106 wait complete. 2024-05-08T20:41:40.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:41:50.840 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:41:50.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:41:50.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 Processor -- start 2024-05-08T20:41:50.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 -- start start 2024-05-08T20:41:50.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 0x7f2f801588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f800ca000 0x7f2f800ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f80158e20 con 0x7f2f80154cf0 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8006bb20 con 0x7f2f800ca000 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f85e73640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f801548e0 con 0x7f2f80151f00 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f77fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f80154cf0 0x7f2f80155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44272/0 (socket says 172.21.15.81:44272) 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f77fff640 1 -- 172.21.15.81:0/2253333455 learned_addr learned my addr 172.21.15.81:0/2253333455 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2253333455 >> v2:172.21.15.81:3300/0 conn(0x7f2f800ca000 0x7f2f800ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7f7fe640 1 --2- 172.21.15.81:0/2253333455 >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 0x7f2f801588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2253333455 >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 msgr2=0x7f2f801588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2253333455 >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 0x7f2f801588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2253333455 >> v1:172.21.15.81:6789/0 conn(0x7f2f80154cf0 legacy=0x7f2f80155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7effd640 1 -- 172.21.15.81:0/2253333455 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199267319 0 0) 0x7f2f80158e20 con 0x7f2f80154cf0 2024-05-08T20:41:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2253333455 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80155860 con 0x7f2f800ca000 2024-05-08T20:41:50.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.970+0000 7f2f7f7fe640 1 --2- 172.21.15.81:0/2253333455 >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 0x7f2f801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:41:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2253333455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f800ca000 0x7f2f800ca440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2f80155a50 tx=0x7f2f7801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670d6d3da8c9be3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7effd640 1 -- 172.21.15.81:0/2253333455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780a58f0 con 0x7f2f800ca000 2024-05-08T20:41:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7effd640 1 -- 172.21.15.81:0/2253333455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780a5a50 con 0x7f2f800ca000 2024-05-08T20:41:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7effd640 1 -- 172.21.15.81:0/2253333455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780a5de0 con 0x7f2f800ca000 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- 172.21.15.81:0/2253333455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f800ca000 msgr2=0x7f2f800ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2253333455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f800ca000 0x7f2f800ca440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2f80155a50 tx=0x7f2f7801c810 comp rx=0 tx=0).stop 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- 172.21.15.81:0/2253333455 shutdown_connections 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2253333455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f800ca000 0x7f2f800ca440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2253333455 >> v2:172.21.15.117:3300/0 conn(0x7f2f80151f00 0x7f2f801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- 172.21.15.81:0/2253333455 >> 172.21.15.81:0/2253333455 conn(0x7f2f800715f0 msgr2=0x7f2f80071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- 172.21.15.81:0/2253333455 shutdown_connections 2024-05-08T20:41:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- 172.21.15.81:0/2253333455 wait complete. 2024-05-08T20:41:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 Processor -- start 2024-05-08T20:41:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- start start 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f800ca000 0x7f2f8014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80151f00 0x7f2f8014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80157a90 con 0x7f2f80154cf0 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80156bc0 con 0x7f2f80151f00 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f85e73640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80156e10 con 0x7f2f800ca000 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36018/0 (socket says 172.21.15.81:36018) 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.974+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2171764042 learned_addr learned my addr 172.21.15.81:0/2171764042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f77fff640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80151f00 0x7f2f8014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7f7fe640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f800ca000 0x7f2f8014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f800ca000 msgr2=0x7f2f8014bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f800ca000 0x7f2f8014bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80151f00 msgr2=0x7f2f8014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80151f00 0x7f2f8014c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 -- 172.21.15.81:0/2171764042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78009a70 con 0x7f2f80154cf0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f780b0040 tx=0x7f2f780195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b9860 con 0x7f2f80154cf0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780b99c0 con 0x7f2f80154cf0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b9d90 con 0x7f2f80154cf0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f801570f0 con 0x7f2f80154cf0 2024-05-08T20:41:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f801576b0 con 0x7f2f80154cf0 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f80157870 con 0x7f2f80154cf0 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f780ad440 con 0x7f2f80154cf0 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 0x7f2f60068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2f7811f5f0 con 0x7f2f80154cf0 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7f7fe640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 0x7f2f60068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:50.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.978+0000 7f2f7f7fe640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 0x7f2f60068b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f800af340 tx=0x7f2f70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:50.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:50.986+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2f780ec770 con 0x7f2f80154cf0 2024-05-08T20:41:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.210+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2f80157bd0 con 0x7f2f80154cf0 2024-05-08T20:41:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.210+0000 7f2f7cff9640 1 -- 172.21.15.81:0/2171764042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f2f80157bd0 con 0x7f2f80154cf0 2024-05-08T20:41:51.215 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:41:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 msgr2=0x7f2f60068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 0x7f2f60068b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f800af340 tx=0x7f2f70008040 comp rx=0 tx=0).stop 2024-05-08T20:41:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 msgr2=0x7f2f801ee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2f780b0040 tx=0x7f2f780195b0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 shutdown_connections 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2f60066690 0x7f2f60068b50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f80154cf0 0x7f2f801ee5c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f80151f00 0x7f2f8014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 --2- 172.21.15.81:0/2171764042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f800ca000 0x7f2f8014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 >> 172.21.15.81:0/2171764042 conn(0x7f2f800715f0 msgr2=0x7f2f80155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 shutdown_connections 2024-05-08T20:41:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.214+0000 7f2f85e73640 1 -- 172.21.15.81:0/2171764042 wait complete. 2024-05-08T20:41:51.234 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:41:51.234 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:41:51.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:41:51.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:41:51.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 Processor -- start 2024-05-08T20:41:51.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 -- start start 2024-05-08T20:41:51.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafa0151f00 0x7fafa01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa0155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafa0155690 0x7fafa00ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa006bb20 con 0x7fafa0155690 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa01548e0 con 0x7fafa0151f00 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7fafa57ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0158e20 con 0x7fafa0154cf0 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafa0155690 0x7fafa00ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafa0155690 0x7fafa00ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36034/0 (socket says 172.21.15.81:36034) 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 -- 172.21.15.81:0/336237150 learned_addr learned my addr 172.21.15.81:0/336237150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9effd640 1 --2- 172.21.15.81:0/336237150 >> v2:172.21.15.117:3300/0 conn(0x7fafa0151f00 0x7fafa01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa0155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 -- 172.21.15.81:0/336237150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 msgr2=0x7fafa0155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa0155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 -- 172.21.15.81:0/336237150 >> v2:172.21.15.117:3300/0 conn(0x7fafa0151f00 msgr2=0x7fafa01588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/336237150 >> v2:172.21.15.117:3300/0 conn(0x7fafa0151f00 0x7fafa01588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.358+0000 7faf9f7fe640 1 -- 172.21.15.81:0/336237150 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa01522e0 con 0x7fafa0155690 2024-05-08T20:41:51.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa00ca000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e80 tx=0x7faf9801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309d082b6893543d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7faf9dffb640 1 -- 172.21.15.81:0/336237150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf980a56d0 con 0x7fafa0155690 2024-05-08T20:41:51.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7faf9dffb640 1 -- 172.21.15.81:0/336237150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf980a5830 con 0x7fafa0155690 2024-05-08T20:41:51.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7faf9dffb640 1 -- 172.21.15.81:0/336237150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf980a5bc0 con 0x7fafa0155690 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- 172.21.15.81:0/336237150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 msgr2=0x7fafa00ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa00ca000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e80 tx=0x7faf9801c8b0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- 172.21.15.81:0/336237150 shutdown_connections 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa0155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- 172.21.15.81:0/336237150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa00ca000 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- 172.21.15.81:0/336237150 >> v2:172.21.15.117:3300/0 conn(0x7fafa0151f00 0x7fafa01588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- 172.21.15.81:0/336237150 >> 172.21.15.81:0/336237150 conn(0x7fafa00715f0 msgr2=0x7fafa0071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- 172.21.15.81:0/336237150 shutdown_connections 2024-05-08T20:41:51.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- 172.21.15.81:0/336237150 wait complete. 2024-05-08T20:41:51.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 Processor -- start 2024-05-08T20:41:51.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 -- start start 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 0x7fafa01584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.362+0000 7fafa57ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa01eda70 0x7fafa014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0157dd0 con 0x7fafa0151f00 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0150620 con 0x7fafa01eda70 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0156580 con 0x7fafa0154cf0 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 0x7fafa01584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 0x7fafa01584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36038/0 (socket says 172.21.15.81:36038) 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 -- 172.21.15.81:0/2704201220 learned_addr learned my addr 172.21.15.81:0/2704201220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa01eda70 0x7fafa014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 msgr2=0x7fafa014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafa0154cf0 0x7fafa014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa01eda70 msgr2=0x7fafa014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa01eda70 0x7fafa014ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009b30 con 0x7fafa0151f00 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa01eda70 0x7fafa014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9effd640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 0x7fafa01584c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d800 tx=0x7faf9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000b6c0 con 0x7fafa0151f00 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000b820 con 0x7fafa0151f00 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa01edf00 con 0x7fafa0151f00 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000bb90 con 0x7fafa0151f00 2024-05-08T20:41:51.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa0150340 con 0x7fafa0151f00 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0069600 con 0x7fafa0155690 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9e7fc640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafa00c6820 con 0x7fafa0155690 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa014bec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ab9b0 tx=0x7faf9400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf9000bcf0 con 0x7fafa0151f00 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faf8c066690 0x7faf8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faf8c066690 0x7faf8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7faf90084a30 con 0x7fafa0151f00 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400a750 con 0x7fafa0155690 2024-05-08T20:41:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7faf9400a8b0 con 0x7fafa0155690 2024-05-08T20:41:51.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 msgr2=0x7fafa014bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa014bec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ab9b0 tx=0x7faf9400ec00 comp rx=0 tx=0).stop 2024-05-08T20:41:51.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 msgr2=0x7fafa014bec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf877fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0155690 0x7fafa014bec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.366+0000 7faf9f7fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faf8c066690 0x7faf8c068b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faf980ae000 tx=0x7faf980a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.374+0000 7fafa57ec640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 0x7fafa014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.374+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa01566c0 con 0x7fafa0146fb0 2024-05-08T20:41:51.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.374+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 0x7fafa014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf9e7fc640 1 -- 172.21.15.81:0/2704201220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fafa0074950 con 0x7fafa0146fb0 2024-05-08T20:41:51.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf9e7fc640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 0x7fafa014c400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ab9b0 tx=0x7faf940046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940038a0 con 0x7fafa0146fb0 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7faf94003a00 con 0x7fafa0146fb0 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 msgr2=0x7fafa014c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 0x7fafa014c400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fafa00ab9b0 tx=0x7faf940046d0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 msgr2=0x7fafa014c400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf877fe640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0146fb0 0x7fafa014c400 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:51.391 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faf8c066690 msgr2=0x7faf8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faf8c066690 0x7faf8c068b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faf980ae000 tx=0x7faf980a7070 comp rx=0 tx=0).stop 2024-05-08T20:41:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 msgr2=0x7fafa01584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 --2- 172.21.15.81:0/2704201220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafa0151f00 0x7fafa01584c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf9000d800 tx=0x7faf9000dcc0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf9f7fe640 1 -- 172.21.15.81:0/2704201220 reap_dead start 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7faf9f7fe640 1 -- 172.21.15.81:0/2704201220 reap_dead start 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 shutdown_connections 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 >> 172.21.15.81:0/2704201220 conn(0x7fafa00715f0 msgr2=0x7fafa0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 shutdown_connections 2024-05-08T20:41:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.378+0000 7fafa57ec640 1 -- 172.21.15.81:0/2704201220 wait complete. 2024-05-08T20:41:51.399 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:51.399 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:41:51.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:41:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 Processor -- start 2024-05-08T20:41:51.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 -- start start 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa06c154cf0 0x7fa06c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c155690 0x7fa06c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c1522e0 con 0x7fa06c151f00 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06c06bb20 con 0x7fa06c154cf0 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa070c98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c1548e0 con 0x7fa06c155690 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa06a59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa06c151f00 0x7fa06c1588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44284/0 (socket says 172.21.15.81:44284) 2024-05-08T20:41:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa06a59c640 1 -- 172.21.15.81:0/59955370 learned_addr learned my addr 172.21.15.81:0/59955370 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa069d9b640 1 --2- 172.21.15.81:0/59955370 >> v2:172.21.15.117:3300/0 conn(0x7fa06c154cf0 0x7fa06c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa06ad9d640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c155690 0x7fa06c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590679443 0 0) 0x7fa06c1522e0 con 0x7fa06c151f00 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.518+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa054003530 con 0x7fa06c151f00 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720426680 0 0) 0x7fa054003530 con 0x7fa06c151f00 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c155690 msgr2=0x7fa06c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c155690 0x7fa06c0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 >> v2:172.21.15.117:3300/0 conn(0x7fa06c154cf0 msgr2=0x7fa06c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 --2- 172.21.15.81:0/59955370 >> v2:172.21.15.117:3300/0 conn(0x7fa06c154cf0 0x7fa06c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0c5f80 con 0x7fa06c151f00 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa05c001680 con 0x7fa06c151f00 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 >> v1:172.21.15.81:6789/0 conn(0x7fa06c151f00 legacy=0x7fa06c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa054003980 0x7fa054003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0540047d0 0x7fa054004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa054005190 0x7fa05400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05400bed0 con 0x7fa054003980 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05400c010 con 0x7fa0540047d0 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05400c150 con 0x7fa054005190 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa054003980 0x7fa054003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa069d9b640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0540047d0 0x7fa054004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06ad9d640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa054005190 0x7fa05400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 -- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa054005190 msgr2=0x7fa05400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa054005190 0x7fa05400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 -- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0540047d0 msgr2=0x7fa054004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0540047d0 0x7fa054004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 -- 172.21.15.81:0/59955370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054003530 con 0x7fa054003980 2024-05-08T20:41:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa069d9b640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0540047d0 0x7fa054004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:41:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06a59c640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa054003980 0x7fa054003da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c2c0 tx=0x7fa05c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ebe6752f21e5a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0a5950 con 0x7fa054003980 2024-05-08T20:41:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c0a5ab0 con 0x7fa054003980 2024-05-08T20:41:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06959a640 1 -- 172.21.15.81:0/59955370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0a5e60 con 0x7fa054003980 2024-05-08T20:41:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa070c98640 1 -- 172.21.15.81:0/59955370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa054003980 msgr2=0x7fa054003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa070c98640 1 --2- 172.21.15.81:0/59955370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa054003980 0x7fa054003da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c2c0 tx=0x7fa05c01cce0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa06ad9d640 1 -- 172.21.15.81:0/59955370 reap_dead start 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa070c98640 1 -- 172.21.15.81:0/59955370 shutdown_connections 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa070c98640 1 -- 172.21.15.81:0/59955370 >> 172.21.15.81:0/59955370 conn(0x7fa06c0715f0 msgr2=0x7fa06c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.522+0000 7fa070c98640 1 -- 172.21.15.81:0/59955370 shutdown_connections 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- 172.21.15.81:0/59955370 wait complete. 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 Processor -- start 2024-05-08T20:41:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- start start 2024-05-08T20:41:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 0x7fa06c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c1ed330 0x7fa06c1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c14bad0 0x7fa06c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c153c50 con 0x7fa06c15c6d0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0ae2b0 con 0x7fa06c14bad0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0adcf0 con 0x7fa06c1ed330 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 0x7fa06c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 0x7fa06c1564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36074/0 (socket says 172.21.15.81:36074) 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 -- 172.21.15.81:0/1859129281 learned_addr learned my addr 172.21.15.81:0/1859129281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa069d9b640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c1ed330 0x7fa06c1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06ad9d640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c14bad0 0x7fa06c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c1ed330 msgr2=0x7fa06c1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa06c1ed330 0x7fa06c1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c14bad0 msgr2=0x7fa06c14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c14bad0 0x7fa06c14bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0adfd0 con 0x7fa06c15c6d0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa06a59c640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 0x7fa06c1564d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa05c01cd20 tx=0x7fa054005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c004ab0 con 0x7fa06c15c6d0 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c004c10 con 0x7fa06c15c6d0 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06c1538e0 con 0x7fa06c15c6d0 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c001c90 con 0x7fa06c15c6d0 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.526+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c1ed790 con 0x7fa06c15c6d0 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa070c98640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 0x7fa06c1efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0ae160 con 0x7fa06c0ca810 2024-05-08T20:41:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa069d9b640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 0x7fa06c1efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa05c0ae430 con 0x7fa06c15c6d0 2024-05-08T20:41:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa069d9b640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa06c153740 con 0x7fa06c0ca810 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa04c0666c0 0x7fa04c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa05c0b4030 con 0x7fa06c15c6d0 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa06ad9d640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa04c0666c0 0x7fa04c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa069d9b640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 0x7fa06c1efe20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa060013510 tx=0x7fa0600139d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600158e0 con 0x7fa06c0ca810 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa06ad9d640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa04c0666c0 0x7fa04c068b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0c5b00 tx=0x7fa06400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa060015a40 con 0x7fa06c0ca810 2024-05-08T20:41:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 msgr2=0x7fa06c1efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 0x7fa06c1efe20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa060013510 tx=0x7fa0600139d0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 msgr2=0x7fa06c1efe20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.530+0000 7fa05affd640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c0ca810 0x7fa06c1efe20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.538+0000 7fa070c98640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 0x7fa06c1f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.538+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c069600 con 0x7fa06c1f0360 2024-05-08T20:41:51.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.538+0000 7fa069d9b640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 0x7fa06c1f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.538+0000 7fa069d9b640 1 -- 172.21.15.81:0/1859129281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa06c153d90 con 0x7fa06c1f0360 2024-05-08T20:41:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa069d9b640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 0x7fa06c1f0770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa06001e000 tx=0x7fa060004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060026070 con 0x7fa06c1f0360 2024-05-08T20:41:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7fa060006750 con 0x7fa06c1f0360 2024-05-08T20:41:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 msgr2=0x7fa06c1f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 0x7fa06c1f0770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa06001e000 tx=0x7fa060004740 comp rx=0 tx=0).stop 2024-05-08T20:41:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 msgr2=0x7fa06c1f0770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa05affd640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c1f0360 0x7fa06c1f0770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.546 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.547 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.548 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:51.549 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:51.559 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa04c0666c0 msgr2=0x7fa04c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa04c0666c0 0x7fa04c068b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0c5b00 tx=0x7fa06400b040 comp rx=0 tx=0).stop 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 msgr2=0x7fa06c1564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 --2- 172.21.15.81:0/1859129281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa06c15c6d0 0x7fa06c1564d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa05c01cd20 tx=0x7fa054005800 comp rx=0 tx=0).stop 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa06ad9d640 1 -- 172.21.15.81:0/1859129281 reap_dead start 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa06ad9d640 1 -- 172.21.15.81:0/1859129281 reap_dead start 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 shutdown_connections 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 >> 172.21.15.81:0/1859129281 conn(0x7fa06c0715f0 msgr2=0x7fa06c0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 shutdown_connections 2024-05-08T20:41:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.542+0000 7fa070c98640 1 -- 172.21.15.81:0/1859129281 wait complete. 2024-05-08T20:41:51.563 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:51.563 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:41:51.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:41:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.682+0000 7ff8aeff5640 1 Processor -- start 2024-05-08T20:41:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 -- start start 2024-05-08T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8a8155e90 0x7ff8a8069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8a815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a8152ab0 con 0x7ff8a814fe70 2024-05-08T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a81528a0 con 0x7ff8a8155e90 2024-05-08T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8aeff5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8152d90 con 0x7ff8a806a500 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8a814fe70 0x7ff8a806d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44290/0 (socket says 172.21.15.81:44290) 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 -- 172.21.15.81:0/1289686934 learned_addr learned my addr 172.21.15.81:0/1289686934 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193811992 0 0) 0x7ff8a8152ab0 con 0x7ff8a814fe70 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff898003530 con 0x7ff8a814fe70 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8ad592640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8a815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1289686934 >> v2:172.21.15.117:3300/0 conn(0x7ff8a8155e90 0x7ff8a8069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744800773 0 0) 0x7ff898003530 con 0x7ff8a814fe70 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 msgr2=0x7ff8a815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8a815d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 >> v2:172.21.15.117:3300/0 conn(0x7ff8a8155e90 msgr2=0x7ff8a8069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 --2- 172.21.15.81:0/1289686934 >> v2:172.21.15.117:3300/0 conn(0x7ff8a8155e90 0x7ff8a8069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8153070 con 0x7ff8a814fe70 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff89c001680 con 0x7ff8a814fe70 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 >> v1:172.21.15.81:6789/0 conn(0x7ff8a814fe70 legacy=0x7ff8a806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff898003980 0x7ff898003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898004d10 0x7ff898005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81528a0 con 0x7ff898003980 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8152d90 con 0x7ff898004d10 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89800bac0 con 0x7ff8a806a500 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff898003980 0x7ff898003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 -- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 msgr2=0x7ff8980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8ad592640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898004d10 0x7ff898005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 -- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898004d10 msgr2=0x7ff898005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898004d10 0x7ff898005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8acd91640 1 -- 172.21.15.81:0/1289686934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898003530 con 0x7ff898003980 2024-05-08T20:41:51.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.686+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a806a500 0x7ff8980047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:41:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff898003980 0x7ff898003da0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c240 tx=0x7ff89c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70e01099497f8cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0058e0 con 0x7ff898003980 2024-05-08T20:41:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c005a40 con 0x7ff898003980 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8a77fe640 1 -- 172.21.15.81:0/1289686934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c005e10 con 0x7ff898003980 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1289686934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff898003980 msgr2=0x7ff898003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1289686934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff898003980 0x7ff898003da0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c240 tx=0x7ff89c01cc50 comp rx=0 tx=0).stop 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8ad592640 1 -- 172.21.15.81:0/1289686934 reap_dead start 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1289686934 shutdown_connections 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1289686934 >> 172.21.15.81:0/1289686934 conn(0x7ff8a80c71b0 msgr2=0x7ff8a80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1289686934 shutdown_connections 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1289686934 wait complete. 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 Processor -- start 2024-05-08T20:41:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.690+0000 7ff8aeff5640 1 -- start start 2024-05-08T20:41:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898003980 0x7ff8a81571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c5da0 0x7ff8a80c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a814e000 con 0x7ff8a8150dc0 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8159440 con 0x7ff898003980 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81eb1d0 con 0x7ff8a80c5da0 2024-05-08T20:41:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36102/0 (socket says 172.21.15.81:36102) 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 -- 172.21.15.81:0/1160047545 learned_addr learned my addr 172.21.15.81:0/1160047545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898003980 0x7ff8a81571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8ad592640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c5da0 0x7ff8a80c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c5da0 msgr2=0x7ff8a80c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c5da0 0x7ff8a80c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898003980 msgr2=0x7ff8a81571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898003980 0x7ff8a81571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a81eaea0 con 0x7ff8a8150dc0 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a7fff640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff894010950 tx=0x7ff894010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400ec20 con 0x7ff8a8150dc0 2024-05-08T20:41:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400ed80 con 0x7ff8a8150dc0 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a81eeeb0 con 0x7ff8a8150dc0 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894004220 con 0x7ff8a8150dc0 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a814c370 con 0x7ff8a8150dc0 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 0x7ff8a813d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8069550 con 0x7ff8a80c6760 2024-05-08T20:41:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 0x7ff8a813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff894004380 con 0x7ff8a8150dc0 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8acd91640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8a806dd10 con 0x7ff8a80c6760 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff88c0666c0 0x7ff88c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff894084780 con 0x7ff8a8150dc0 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8ad592640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff88c0666c0 0x7ff88c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 0x7ff8a813d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c210 tx=0x7ff898005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0b3070 con 0x7ff8a80c6760 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.694+0000 7ff8ad592640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff88c0666c0 0x7ff88c068b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8072490 tx=0x7ff8a000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.698+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff89c001440 con 0x7ff8a80c6760 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.698+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 msgr2=0x7ff8a813d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.698+0000 7ff8a57fa640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 0x7ff8a813d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c210 tx=0x7ff898005800 comp rx=0 tx=0).stop 2024-05-08T20:41:51.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.698+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 msgr2=0x7ff8a813d500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.698+0000 7ff8a57fa640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a80c6760 0x7ff8a813d500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 0x7ff8a813de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81eb030 con 0x7ff8a813da40 2024-05-08T20:41:51.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 0x7ff8a813de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8acd91640 1 -- 172.21.15.81:0/1160047545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff8a813e390 con 0x7ff8a813da40 2024-05-08T20:41:51.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8acd91640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 0x7ff8a813de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000c10 tx=0x7ff89c0a7070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0c02b0 con 0x7ff8a813da40 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7ff89c0070b0 con 0x7ff8a813da40 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 msgr2=0x7ff8a813de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 0x7ff8a813de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000c10 tx=0x7ff89c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 msgr2=0x7ff8a813de50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:41:51.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.706+0000 7ff8a57fa640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8a813da40 0x7ff8a813de50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.714 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:41:51.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:51.714 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:51.714 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:41:51.715 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 114, 2024-05-08T20:41:51.715 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:41:51.715 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:41:51.715 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:41:51.715 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:41:51.716 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.717 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:41:51.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.719 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:41:51.721 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:41:51.722 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:41:51.723 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:41:51.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:41:51.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.732 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.733 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:41:51.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:41:51.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:41:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:41:51.737 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.738 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:41:51.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:41:51.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.741 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:41:51.742 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:41:51.743 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:41:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff88c0666c0 msgr2=0x7ff88c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff88c0666c0 0x7ff88c068b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8072490 tx=0x7ff8a000b040 comp rx=0 tx=0).stop 2024-05-08T20:41:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 msgr2=0x7ff8a81eb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff894010950 tx=0x7ff894010e10 comp rx=0 tx=0).stop 2024-05-08T20:41:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8ad592640 1 -- 172.21.15.81:0/1160047545 reap_dead start 2024-05-08T20:41:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 shutdown_connections 2024-05-08T20:41:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 --2- 172.21.15.81:0/1160047545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a8150dc0 0x7ff8a81eb660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 >> 172.21.15.81:0/1160047545 conn(0x7ff8a80c71b0 msgr2=0x7ff8a815a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 shutdown_connections 2024-05-08T20:41:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.710+0000 7ff8aeff5640 1 -- 172.21.15.81:0/1160047545 wait complete. 2024-05-08T20:41:51.748 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:41:51.748 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:41:51.748 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:41:51.748 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:41:51.748 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:41:51.749 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:41:51.749 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:41:51.776 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:41:51.776 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:41:51.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:41:51.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.878+0000 7f566650f640 1 Processor -- start 2024-05-08T20:41:51.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.878+0000 7f566650f640 1 -- start start 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5660151f00 0x7f56601588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 0x7f5660155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5660155690 0x7f56600ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566006bb20 con 0x7f5660151f00 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56601548e0 con 0x7f5660155690 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5660158e20 con 0x7f5660154cf0 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565f7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 msgr2=0x7f5660155150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 0x7f5660155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:51.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5660151f00 0x7f56601588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5660151f00 0x7f56601588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36192/0 (socket says 172.21.15.81:36192) 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 -- 172.21.15.81:0/3001324985 learned_addr learned my addr 172.21.15.81:0/3001324985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f5664aac640 1 --2- 172.21.15.81:0/3001324985 >> v2:172.21.15.117:3300/0 conn(0x7f5660155690 0x7f56600ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 -- 172.21.15.81:0/3001324985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 msgr2=0x7f5660155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 --2- 172.21.15.81:0/3001324985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 0x7f5660155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 -- 172.21.15.81:0/3001324985 >> v2:172.21.15.117:3300/0 conn(0x7f5660155690 msgr2=0x7f56600ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 --2- 172.21.15.81:0/3001324985 >> v2:172.21.15.117:3300/0 conn(0x7f5660155690 0x7f56600ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 -- 172.21.15.81:0/3001324985 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56601522e0 con 0x7f5660151f00 2024-05-08T20:41:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565ffff640 1 --2- 172.21.15.81:0/3001324985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660151f00 0x7f56601588e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e80 tx=0x7f565001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02fa4470ed9378f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565effd640 1 -- 172.21.15.81:0/3001324985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500a56f0 con 0x7f5660151f00 2024-05-08T20:41:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565effd640 1 -- 172.21.15.81:0/3001324985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500a5850 con 0x7f5660151f00 2024-05-08T20:41:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f565effd640 1 -- 172.21.15.81:0/3001324985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500a5be0 con 0x7f5660151f00 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 -- 172.21.15.81:0/3001324985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660151f00 msgr2=0x7f56601588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.882+0000 7f566650f640 1 --2- 172.21.15.81:0/3001324985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660151f00 0x7f56601588e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e80 tx=0x7f565001c8d0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/3001324985 shutdown_connections 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- 172.21.15.81:0/3001324985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660154cf0 0x7f5660155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- 172.21.15.81:0/3001324985 >> v2:172.21.15.117:3300/0 conn(0x7f5660155690 0x7f56600ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- 172.21.15.81:0/3001324985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660151f00 0x7f56601588e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/3001324985 >> 172.21.15.81:0/3001324985 conn(0x7f56600715f0 msgr2=0x7f5660071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:51.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/3001324985 shutdown_connections 2024-05-08T20:41:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/3001324985 wait complete. 2024-05-08T20:41:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 Processor -- start 2024-05-08T20:41:51.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- start start 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5660151f00 0x7f56600ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 0x7f56601465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566014b450 con 0x7f5660154cf0 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600af0a0 con 0x7f5660151f00 2024-05-08T20:41:51.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600adc80 con 0x7f5660146130 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f5664aac640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 msgr2=0x7f56601465b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f5664aac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 0x7f56601465b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36208/0 (socket says 172.21.15.81:36208) 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 -- 172.21.15.81:0/2373397998 learned_addr learned my addr 172.21.15.81:0/2373397998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565ffff640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5660151f00 0x7f56600ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 -- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 msgr2=0x7f56601465b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 0x7f56601465b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 -- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5660151f00 msgr2=0x7f56600ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5660151f00 0x7f56600ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 -- 172.21.15.81:0/2373397998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009b30 con 0x7f5660154cf0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565f7fe640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f564800b530 tx=0x7f564800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648003dd0 con 0x7f5660154cf0 2024-05-08T20:41:51.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648005070 con 0x7f5660154cf0 2024-05-08T20:41:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648005420 con 0x7f5660154cf0 2024-05-08T20:41:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56600aedc0 con 0x7f5660154cf0 2024-05-08T20:41:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.886+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566014b0e0 con 0x7f5660154cf0 2024-05-08T20:41:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566014ce80 con 0x7f5660154cf0 2024-05-08T20:41:51.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5648005580 con 0x7f5660154cf0 2024-05-08T20:41:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f565cff9640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 0x7f5640068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5648084230 con 0x7f5660154cf0 2024-05-08T20:41:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f565ffff640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 0x7f5640068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:51.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.890+0000 7f565ffff640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 0x7f5640068b00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f56500ae000 tx=0x7f56500a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:51.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:51.894+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f566014ce80 con 0x7f5660154cf0 2024-05-08T20:41:52.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.142+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f566014af40 con 0x7f5660154cf0 2024-05-08T20:41:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.142+0000 7f565cff9640 1 -- 172.21.15.81:0/2373397998 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f566014af40 con 0x7f5660154cf0 2024-05-08T20:41:52.148 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 msgr2=0x7f5640068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 0x7f5640068b00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f56500ae000 tx=0x7f56500a7070 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 msgr2=0x7f566014e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f564800b530 tx=0x7f564800b9f0 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 shutdown_connections 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5640066640 0x7f5640068b00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5660146130 0x7f56601465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5660154cf0 0x7f566014e600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 --2- 172.21.15.81:0/2373397998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5660151f00 0x7f56600ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 >> 172.21.15.81:0/2373397998 conn(0x7f56600715f0 msgr2=0x7f5660152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:52.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 shutdown_connections 2024-05-08T20:41:52.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:52.146+0000 7f566650f640 1 -- 172.21.15.81:0/2373397998 wait complete. 2024-05-08T20:41:53.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:41:53.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:41:55.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:41:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.290+0000 7fbbbe4b0640 1 Processor -- start 2024-05-08T20:41:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.290+0000 7fbbbe4b0640 1 -- start start 2024-05-08T20:41:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbe4b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb80c2570 0x7fbbb8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbe4b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbb80c34e0 0x7fbbb81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbe4b0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb8158080 con 0x7fbbb8152340 2024-05-08T20:41:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbe4b0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb806ab70 con 0x7fbbb80c2570 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbe4b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8154b10 con 0x7fbbb80c34e0 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb80c2570 0x7fbbb8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbb80c2570 0x7fbbb8154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36216/0 (socket says 172.21.15.81:36216) 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2074288019 learned_addr learned my addr 172.21.15.81:0/2074288019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbb8152340 0x7fbbb806d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44294/0 (socket says 172.21.15.81:44294) 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbbca4d640 1 --2- 172.21.15.81:0/2074288019 >> v2:172.21.15.117:3300/0 conn(0x7fbbb80c34e0 0x7fbbb81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2074288019 >> v2:172.21.15.117:3300/0 conn(0x7fbbb80c34e0 msgr2=0x7fbbb81554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 --2- 172.21.15.81:0/2074288019 >> v2:172.21.15.117:3300/0 conn(0x7fbbb80c34e0 0x7fbbb81554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2074288019 >> v1:172.21.15.81:6789/0 conn(0x7fbbb8152340 legacy=0x7fbbb806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2074288019 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb806a890 con 0x7fbbb80c2570 2024-05-08T20:41:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb6ffd640 1 -- 172.21.15.81:0/2074288019 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108029698 0 0) 0x7fbbb8158080 con 0x7fbbb8152340 2024-05-08T20:41:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.294+0000 7fbbb77fe640 1 --2- 172.21.15.81:0/2074288019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c2570 0x7fbbb8154f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1780 tx=0x7fbbac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe87b01e828f63a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb6ffd640 1 -- 172.21.15.81:0/2074288019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0ab660 con 0x7fbbb80c2570 2024-05-08T20:41:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb6ffd640 1 -- 172.21.15.81:0/2074288019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0ab7c0 con 0x7fbbb80c2570 2024-05-08T20:41:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb6ffd640 1 -- 172.21.15.81:0/2074288019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0abb50 con 0x7fbbb80c2570 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2074288019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c2570 msgr2=0x7fbbb8154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2074288019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c2570 0x7fbbb8154f60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80c1780 tx=0x7fbbac01c460 comp rx=0 tx=0).stop 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2074288019 shutdown_connections 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2074288019 >> v2:172.21.15.117:3300/0 conn(0x7fbbb80c34e0 0x7fbbb81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2074288019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c2570 0x7fbbb8154f60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2074288019 >> 172.21.15.81:0/2074288019 conn(0x7fbbb80c71b0 msgr2=0x7fbbb80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2074288019 shutdown_connections 2024-05-08T20:41:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2074288019 wait complete. 2024-05-08T20:41:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 Processor -- start 2024-05-08T20:41:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- start start 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 0x7fbbb814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb8152340 0x7fbbb80c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8151a40 con 0x7fbbb80c34e0 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c6ed0 con 0x7fbbb8152340 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbe4b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81510e0 con 0x7fbbb80c2570 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb7fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 msgr2=0x7fbbb814efd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36224/0 (socket says 172.21.15.81:36224) 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2456217911 learned_addr learned my addr 172.21.15.81:0/2456217911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:41:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 0x7fbbb814efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbbca4d640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb8152340 0x7fbbb80c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 msgr2=0x7fbbb814efd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 0x7fbbb814efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb8152340 msgr2=0x7fbbb80c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb8152340 0x7fbbb80c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 -- 172.21.15.81:0/2456217911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0094d0 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.298+0000 7fbbb77fe640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbac019070 tx=0x7fbbac01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0b4800 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0b4980 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb8151380 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0b4d30 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8143fc0 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb80675e0 con 0x7fbbb80c34e0 2024-05-08T20:41:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbbac0a9070 con 0x7fbbb80c34e0 2024-05-08T20:41:55.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 0x7fbba4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:55.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbbac11ee40 con 0x7fbbb80c34e0 2024-05-08T20:41:55.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 0x7fbba4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:41:55.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.302+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 0x7fbba4068b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806dd10 tx=0x7fbba8007a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:41:55.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.310+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbbac0ebe90 con 0x7fbbb80c34e0 2024-05-08T20:41:55.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbbb8151b80 con 0x7fbbb80c34e0 2024-05-08T20:41:55.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbb4ff9640 1 -- 172.21.15.81:0/2456217911 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fbbb8151b80 con 0x7fbbb80c34e0 2024-05-08T20:41:55.581 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:41:55.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 msgr2=0x7fbba4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:55.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 0x7fbba4068b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806dd10 tx=0x7fbba8007a10 comp rx=0 tx=0).stop 2024-05-08T20:41:55.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 msgr2=0x7fbbb8143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:41:55.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbac019070 tx=0x7fbbac01aca0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 shutdown_connections 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbba4066640 0x7fbba4068b00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb8152340 0x7fbbb80c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbb80c34e0 0x7fbbb8143a80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 --2- 172.21.15.81:0/2456217911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb80c2570 0x7fbbb814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 >> 172.21.15.81:0/2456217911 conn(0x7fbbb80c71b0 msgr2=0x7fbbb80c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 shutdown_connections 2024-05-08T20:41:55.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:55.578+0000 7fbbbe4b0640 1 -- 172.21.15.81:0/2456217911 wait complete. 2024-05-08T20:41:58.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:41:58.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 Processor -- start 2024-05-08T20:41:58.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 -- start start 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67814e830 con 0x7ff67806b840 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67806d6a0 con 0x7ff6780c6410 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff680536640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff678151900 con 0x7ff678155070 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff67e2d2640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 msgr2=0x7ff6780c5ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff67e2d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff67ead3640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff67806b840 0x7ff67815b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49946/0 (socket says 172.21.15.81:49946) 2024-05-08T20:41:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.730+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 learned_addr learned my addr 172.21.15.81:0/2534511981 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:41:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.934+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 msgr2=0x7ff6780c5ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:58.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:58.934+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:41:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:59.338+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 msgr2=0x7ff6780c5ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:41:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:41:59.338+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:00.142+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 msgr2=0x7ff6780c5ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:00.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:00.142+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:42:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 msgr2=0x7ff6780c5ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff678155070 0x7ff6780c5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 >> v1:172.21.15.117:6789/0 conn(0x7ff6780c6410 legacy=0x7ff6780c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 >> v1:172.21.15.81:6789/0 conn(0x7ff67806b840 legacy=0x7ff67815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff678151900 con 0x7ff65c007300 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c003480 con 0x7ff65c004830 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:01.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:42:01.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:01.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:01.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.730+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:42:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:42:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:01.934+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:02.338+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:42:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:42:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:03.142+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 msgr2=0x7ff65c006cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c004830 0x7ff65c006cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 msgr2=0x7ff65c0097a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.81:3300/0 conn(0x7ff65c007300 0x7ff65c0097a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 reap_dead start 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff678151be0 con 0x7ff65c003890 2024-05-08T20:42:04.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff678151900 con 0x7ff65c008c30 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff66ffff640 1 -- 172.21.15.81:0/2534511981 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c003480 con 0x7ff65c006c90 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff65c0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.730+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.734+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.734+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.734+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.734+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.934+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff65c0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.934+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:42:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.938+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.938+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.938+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.938+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:04.938+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:42:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.338+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff65c0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.338+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.342+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.342+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.342+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.342+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:05.342+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:06.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.142+0000 7ff67dad1640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff65c0086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:06.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.142+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:42:06.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.146+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.146+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:42:06.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.146+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:06.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.146+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:06.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.146+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:42:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385909450 0 0) 0x7ff678151be0 con 0x7ff65c003890 2024-05-08T20:42:06.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff664003530 con 0x7ff65c003890 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663200143 0 0) 0x7ff664003530 con 0x7ff65c003890 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff65c0086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff65c0086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 msgr2=0x7ff65c0090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 --2- 172.21.15.81:0/2534511981 >> v2:172.21.15.117:3300/0 conn(0x7ff65c008c30 0x7ff65c0090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c009800 con 0x7ff65c003890 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff674006ea0 con 0x7ff65c003890 2024-05-08T20:42:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 >> v1:172.21.15.81:6789/0 conn(0x7ff65c003890 legacy=0x7ff65c003c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff6640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff664003fd0 0x7ff6640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664004d60 0x7ff6640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678151900 con 0x7ff664004d60 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c003480 con 0x7ff664003fd0 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.754+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66400bcd0 con 0x7ff65c006c90 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67e2d2640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff6640039a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff6640039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664004d60 0x7ff6640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67dad1640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff664003fd0 0x7ff6640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 msgr2=0x7ff6640039a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65c006c90 0x7ff6640039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff664003fd0 msgr2=0x7ff6640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff664003fd0 0x7ff6640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.758+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664003530 con 0x7ff664004d60 2024-05-08T20:42:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.762+0000 7ff67ead3640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664004d60 0x7ff6640051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6780a9730 tx=0x7ff67001d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ccd88fc80ab2ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700ad430 con 0x7ff664004d60 2024-05-08T20:42:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6700a8070 con 0x7ff664004d60 2024-05-08T20:42:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff67d2d0640 1 -- 172.21.15.81:0/2534511981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700ad7f0 con 0x7ff664004d60 2024-05-08T20:42:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 -- 172.21.15.81:0/2534511981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664004d60 msgr2=0x7ff6640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 --2- 172.21.15.81:0/2534511981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664004d60 0x7ff6640051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff6780a9730 tx=0x7ff67001d660 comp rx=0 tx=0).stop 2024-05-08T20:42:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff67ead3640 1 -- 172.21.15.81:0/2534511981 reap_dead start 2024-05-08T20:42:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 -- 172.21.15.81:0/2534511981 shutdown_connections 2024-05-08T20:42:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 -- 172.21.15.81:0/2534511981 >> 172.21.15.81:0/2534511981 conn(0x7ff6780c68c0 msgr2=0x7ff6780c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 -- 172.21.15.81:0/2534511981 shutdown_connections 2024-05-08T20:42:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.766+0000 7ff680536640 1 -- 172.21.15.81:0/2534511981 wait complete. 2024-05-08T20:42:06.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 Processor -- start 2024-05-08T20:42:06.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 -- start start 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 0x7ff678071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff678147020 0x7ff6781e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67814ac60 con 0x7ff678072460 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67814a090 con 0x7ff678147020 2024-05-08T20:42:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff680536640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780728e0 con 0x7ff6781dde20 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67e2d2640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 msgr2=0x7ff678071f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67e2d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 0x7ff678071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67dad1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67dad1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41860/0 (socket says 172.21.15.81:41860) 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67dad1640 1 -- 172.21.15.81:0/976296995 learned_addr learned my addr 172.21.15.81:0/976296995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.770+0000 7ff67ead3640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff678147020 0x7ff6781e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 -- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 msgr2=0x7ff678071f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 0x7ff678071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 -- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff678147020 msgr2=0x7ff6781e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff678147020 0x7ff6781e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 -- 172.21.15.81:0/976296995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67814a330 con 0x7ff678072460 2024-05-08T20:42:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67dad1640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff668015770 tx=0x7ff668015c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668015e80 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680052e0 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67814a610 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668013ad0 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff678148a10 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff678074950 con 0x7ff678072460 2024-05-08T20:42:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff66801c070 con 0x7ff678072460 2024-05-08T20:42:06.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 0x7ff65c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:06.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff668084f00 con 0x7ff678072460 2024-05-08T20:42:06.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.774+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 0x7ff65c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:06.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.778+0000 7ff67e2d2640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 0x7ff65c06c070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff674006fd0 tx=0x7ff67400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:06.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:06.782+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff668051f60 con 0x7ff678072460 2024-05-08T20:42:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.070+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff6781e9240 con 0x7ff678072460 2024-05-08T20:42:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.070+0000 7ff66effd640 1 -- 172.21.15.81:0/976296995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7ff668055580 con 0x7ff678072460 2024-05-08T20:42:07.075 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":118,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:07.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 msgr2=0x7ff65c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 0x7ff65c06c070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff674006fd0 tx=0x7ff67400d040 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 msgr2=0x7ff678146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff668015770 tx=0x7ff668015c30 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 shutdown_connections 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff65c069bb0 0x7ff65c06c070 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff678147020 0x7ff6781e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678072460 0x7ff678146ae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 --2- 172.21.15.81:0/976296995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6781dde20 0x7ff678071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 >> 172.21.15.81:0/976296995 conn(0x7ff6780c68c0 msgr2=0x7ff678150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 shutdown_connections 2024-05-08T20:42:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.074+0000 7ff680536640 1 -- 172.21.15.81:0/976296995 wait complete. 2024-05-08T20:42:07.098 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:42:07.098 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:42:07.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:42:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.202+0000 7f4d77c34640 1 Processor -- start 2024-05-08T20:42:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.202+0000 7f4d77c34640 1 -- start start 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d77c34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d70155070 0x7f4d700c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d77c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d7015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d77c34640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7014e830 con 0x7f4d700c6410 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d77c34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7006d6a0 con 0x7f4d70155070 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d77c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70151900 con 0x7f4d7006b840 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d761d1640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 msgr2=0x7f4d7015b6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4d700c6410 0x7f4d700c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49962/0 (socket says 172.21.15.81:49962) 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 -- 172.21.15.81:0/485913607 learned_addr learned my addr 172.21.15.81:0/485913607 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d761d1640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d7015b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d759d0640 1 --2- 172.21.15.81:0/485913607 >> v2:172.21.15.117:3300/0 conn(0x7f4d70155070 0x7f4d700c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731632035 0 0) 0x7f4d60001120 con 0x7f4d700c6410 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c003530 con 0x7f4d700c6410 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2462334076 0 0) 0x7f4d5c003530 con 0x7f4d700c6410 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 msgr2=0x7f4d7015b6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d7015b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 >> v2:172.21.15.117:3300/0 conn(0x7f4d70155070 msgr2=0x7f4d700c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 --2- 172.21.15.81:0/485913607 >> v2:172.21.15.117:3300/0 conn(0x7f4d70155070 0x7f4d700c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70151be0 con 0x7f4d700c6410 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4d60001810 con 0x7f4d700c6410 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 >> v1:172.21.15.81:6789/0 conn(0x7f4d700c6410 legacy=0x7f4d700c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d5c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c003f20 0x7f4d5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c004d10 0x7f4d5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006d6a0 con 0x7f4d5c003f20 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70151900 con 0x7f4d5c004d10 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c00ba90 con 0x7f4d7006b840 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d759d0640 1 --2- 172.21.15.81:0/485913607 >> v2:172.21.15.117:3300/0 conn(0x7f4d70155070 0x7f4d700c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d759d0640 1 -- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 msgr2=0x7f4d5c0039a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c003f20 0x7f4d5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d759d0640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d5c0039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d761d1640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c004d10 0x7f4d5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 -- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 msgr2=0x7f4d5c0039a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d7006b840 0x7f4d5c0039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 -- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c004d10 msgr2=0x7f4d5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c004d10 0x7f4d5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d751cf640 1 -- 172.21.15.81:0/485913607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c003530 con 0x7f4d5c003f20 2024-05-08T20:42:07.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.206+0000 7f4d761d1640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c004d10 0x7f4d5c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d751cf640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c003f20 0x7f4d5c0047d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c67f0 tx=0x7f4d60021540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d3a4ff729d196e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005ae0 con 0x7f4d5c003f20 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600ad070 con 0x7f4d5c003f20 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d749ce640 1 -- 172.21.15.81:0/485913607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005e80 con 0x7f4d5c003f20 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 -- 172.21.15.81:0/485913607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c003f20 msgr2=0x7f4d5c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 --2- 172.21.15.81:0/485913607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c003f20 0x7f4d5c0047d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c67f0 tx=0x7f4d60021540 comp rx=0 tx=0).stop 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d761d1640 1 -- 172.21.15.81:0/485913607 reap_dead start 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 -- 172.21.15.81:0/485913607 shutdown_connections 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 -- 172.21.15.81:0/485913607 >> 172.21.15.81:0/485913607 conn(0x7f4d700c68c0 msgr2=0x7f4d700c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:07.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 -- 172.21.15.81:0/485913607 shutdown_connections 2024-05-08T20:42:07.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 -- 172.21.15.81:0/485913607 wait complete. 2024-05-08T20:42:07.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.210+0000 7f4d77c34640 1 Processor -- start 2024-05-08T20:42:07.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- start start 2024-05-08T20:42:07.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c003f20 0x7f4d701e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 0x7f4d70070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d70071fc0 0x7f4d70072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700a89e0 con 0x7f4d700a6a80 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700706c0 con 0x7f4d5c003f20 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700a6ee0 con 0x7f4d70071fc0 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 0x7f4d70070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d761d1640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d70071fc0 msgr2=0x7f4d70072440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 0x7f4d70070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41888/0 (socket says 172.21.15.81:41888) 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 -- 172.21.15.81:0/3813368013 learned_addr learned my addr 172.21.15.81:0/3813368013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d761d1640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d70071fc0 0x7f4d70072440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c003f20 0x7f4d701e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d70071fc0 msgr2=0x7f4d70072440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d70071fc0 0x7f4d70072440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c003f20 msgr2=0x7f4d701e5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c003f20 0x7f4d701e5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700bb9c0 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d5c003f20 0x7f4d701e5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d751cf640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 0x7f4d70070b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d600281b0 tx=0x7f4d5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60001810 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600b8040 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7006faf0 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60007270 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70070070 con 0x7f4d700a6a80 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 0x7f4d701e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70069550 con 0x7f4d70070290 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 0x7f4d701e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d759d0640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d7006c620 con 0x7f4d70070290 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 0x7f4d701e9370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0109d0 tx=0x7f4d6c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d600073d0 con 0x7f4d700a6a80 2024-05-08T20:42:07.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.214+0000 7f4d667fc640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d54066640 0x7f4d54068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d761d1640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d54066640 0x7f4d54068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4d60120f10 con 0x7f4d700a6a80 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00edf0 con 0x7f4d70070290 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4d6c019070 con 0x7f4d70070290 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 msgr2=0x7f4d701e9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 0x7f4d701e9370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0109d0 tx=0x7f4d6c010e90 comp rx=0 tx=0).stop 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 msgr2=0x7f4d701e9370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d667fc640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d70070290 0x7f4d701e9370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.218+0000 7f4d761d1640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d54066640 0x7f4d54068b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c7850 tx=0x7f4d68003b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.222+0000 7f4d77c34640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 0x7f4d701e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.222+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006d2a0 con 0x7f4d701e98b0 2024-05-08T20:42:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.222+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 0x7f4d701e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.222+0000 7f4d759d0640 1 -- 172.21.15.81:0/3813368013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d701ea200 con 0x7f4d701e98b0 2024-05-08T20:42:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.222+0000 7f4d759d0640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 0x7f4d701e9cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0109d0 tx=0x7f4d6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c023040 con 0x7f4d701e98b0 2024-05-08T20:42:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f4d6c028070 con 0x7f4d701e98b0 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 msgr2=0x7f4d701e9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 0x7f4d701e9cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0109d0 tx=0x7f4d6c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 msgr2=0x7f4d701e9cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d667fc640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d701e98b0 0x7f4d701e9cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:07.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 118, 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.230 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:07.232 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.233 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.234 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:07.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.241 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:07.242 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d54066640 msgr2=0x7f4d54068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d54066640 0x7f4d54068b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c7850 tx=0x7f4d68003b40 comp rx=0 tx=0).stop 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 msgr2=0x7f4d70070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 --2- 172.21.15.81:0/3813368013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d700a6a80 0x7f4d70070b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d600281b0 tx=0x7f4d5c005800 comp rx=0 tx=0).stop 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d761d1640 1 -- 172.21.15.81:0/3813368013 reap_dead start 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d761d1640 1 -- 172.21.15.81:0/3813368013 reap_dead start 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 shutdown_connections 2024-05-08T20:42:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 >> 172.21.15.81:0/3813368013 conn(0x7f4d700c68c0 msgr2=0x7f4d700ab770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:07.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 shutdown_connections 2024-05-08T20:42:07.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.226+0000 7f4d77c34640 1 -- 172.21.15.81:0/3813368013 wait complete. 2024-05-08T20:42:07.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:42:07.250 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:42:07.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:42:07.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 Processor -- start 2024-05-08T20:42:07.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 -- start start 2024-05-08T20:42:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f048c155e90 0x7f048c069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c152ab0 con 0x7f048c14fe70 2024-05-08T20:42:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048c152d90 con 0x7f048c06a500 2024-05-08T20:42:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f0491cc4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048c1528a0 con 0x7f048c155e90 2024-05-08T20:42:07.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f048c155e90 0x7f048c069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f048c14fe70 0x7f048c06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49976/0 (socket says 172.21.15.81:49976) 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048b7fe640 1 -- 172.21.15.81:0/4240716143 learned_addr learned my addr 172.21.15.81:0/4240716143 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048affd640 1 -- 172.21.15.81:0/4240716143 >> v1:172.21.15.117:6789/0 conn(0x7f048c06a500 legacy=0x7f048c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048affd640 1 -- 172.21.15.81:0/4240716143 >> v1:172.21.15.81:6789/0 conn(0x7f048c14fe70 legacy=0x7f048c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048affd640 1 -- 172.21.15.81:0/4240716143 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c153070 con 0x7f048c155e90 2024-05-08T20:42:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.382+0000 7f048a7fc640 1 -- 172.21.15.81:0/4240716143 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206027064 0 0) 0x7f048c152ab0 con 0x7f048c14fe70 2024-05-08T20:42:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f048affd640 1 --2- 172.21.15.81:0/4240716143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c155e90 0x7f048c069fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04800097c0 tx=0x7f048001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7599e1e7bd4ad4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f048a7fc640 1 -- 172.21.15.81:0/4240716143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800ab600 con 0x7f048c155e90 2024-05-08T20:42:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f048a7fc640 1 -- 172.21.15.81:0/4240716143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04800a7050 con 0x7f048c155e90 2024-05-08T20:42:07.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f048a7fc640 1 -- 172.21.15.81:0/4240716143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800ab980 con 0x7f048c155e90 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 -- 172.21.15.81:0/4240716143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c155e90 msgr2=0x7f048c069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 --2- 172.21.15.81:0/4240716143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c155e90 0x7f048c069fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04800097c0 tx=0x7f048001c350 comp rx=0 tx=0).stop 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 -- 172.21.15.81:0/4240716143 shutdown_connections 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 --2- 172.21.15.81:0/4240716143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c155e90 0x7f048c069fc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 -- 172.21.15.81:0/4240716143 >> 172.21.15.81:0/4240716143 conn(0x7f048c0c71b0 msgr2=0x7f048c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 -- 172.21.15.81:0/4240716143 shutdown_connections 2024-05-08T20:42:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.386+0000 7f0491cc4640 1 -- 172.21.15.81:0/4240716143 wait complete. 2024-05-08T20:42:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 Processor -- start 2024-05-08T20:42:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- start start 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 0x7f048c1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14fe70 0x7f048c148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f048c155e90 0x7f048c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c1eb3d0 con 0x7f048c06a500 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c1ef2b0 con 0x7f048c14fe70 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048c1eb620 con 0x7f048c155e90 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 0x7f048c1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 0x7f048c1480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41926/0 (socket says 172.21.15.81:41926) 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 -- 172.21.15.81:0/1918050068 learned_addr learned my addr 172.21.15.81:0/1918050068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048bfff640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f048c155e90 msgr2=0x7f048c0c5e90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048bfff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f048c155e90 0x7f048c0c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048affd640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14fe70 0x7f048c148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f048c155e90 msgr2=0x7f048c0c5e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f048c155e90 0x7f048c0c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14fe70 msgr2=0x7f048c148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14fe70 0x7f048c148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480009420 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048b7fe640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 0x7f048c1480f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c4a0 tx=0x7f047c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c0074e0 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c007640 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c1ee980 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c004a30 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c1eef40 con 0x7f048c06a500 2024-05-08T20:42:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 0x7f048c14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c069550 con 0x7f048c0c63d0 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.390+0000 7f048affd640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 0x7f048c14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f047c004b90 con 0x7f048c06a500 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f048affd640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f048c06dd10 con 0x7f048c0c63d0 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f048affd640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 0x7f048c14ec80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f048c073fc0 tx=0x7f048001ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0478066670 0x7f0478068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f047c083900 con 0x7f048c06a500 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f048bfff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0478066670 0x7f0478068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800b5610 con 0x7f048c0c63d0 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f048bfff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0478066670 0x7f0478068b30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0484007fd0 tx=0x7f0484007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f04800b5770 con 0x7f048c0c63d0 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 msgr2=0x7f048c14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 0x7f048c14ec80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f048c073fc0 tx=0x7f048001ab90 comp rx=0 tx=0).stop 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 msgr2=0x7f048c14ec80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.394+0000 7f0473fff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c0c63d0 0x7f048c14ec80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 0x7f048c0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c1ef420 con 0x7f048c14f1c0 2024-05-08T20:42:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f048affd640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 0x7f048c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f048affd640 1 -- 172.21.15.81:0/1918050068 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f048c0675e0 con 0x7f048c14f1c0 2024-05-08T20:42:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f048affd640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 0x7f048c0c4c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c10 tx=0x7f04800190f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800c0c10 con 0x7f048c14f1c0 2024-05-08T20:42:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f0480003620 con 0x7f048c14f1c0 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 msgr2=0x7f048c0c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 0x7f048c0c4c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c10 tx=0x7f04800190f0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 msgr2=0x7f048c0c4c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0473fff640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f048c14f1c0 0x7f048c0c4c70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:07.407 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 118, 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.409 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:07.410 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.412 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:07.415 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.417 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.418 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:07.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:07.420 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0478066670 msgr2=0x7f0478068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0478066670 0x7f0478068b30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0484007fd0 tx=0x7f0484007d40 comp rx=0 tx=0).stop 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 msgr2=0x7f048c1480f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 --2- 172.21.15.81:0/1918050068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f048c06a500 0x7f048c1480f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c4a0 tx=0x7f047c00c960 comp rx=0 tx=0).stop 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f048bfff640 1 -- 172.21.15.81:0/1918050068 reap_dead start 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f048bfff640 1 -- 172.21.15.81:0/1918050068 reap_dead start 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 shutdown_connections 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 >> 172.21.15.81:0/1918050068 conn(0x7f048c0c71b0 msgr2=0x7f048c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 shutdown_connections 2024-05-08T20:42:07.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:07.402+0000 7f0491cc4640 1 -- 172.21.15.81:0/1918050068 wait complete. 2024-05-08T20:42:07.425 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:42:07.425 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:42:23.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:42:23.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:42:27.426 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:42:27.426 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:42:27.427 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:42:27.427 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:42:27.430 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:42:27.430 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:42:27.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:27.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 Processor -- start 2024-05-08T20:42:27.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 -- start start 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95280c2570 0x7f9528154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f952806d7d0 0x7f95281554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952806ab70 con 0x7f95280c2570 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9528154b10 con 0x7f952806d7d0 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952c88b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9528158080 con 0x7f9528152340 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95280c2570 0x7f9528154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95280c2570 0x7f9528154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41822/0 (socket says 172.21.15.81:41822) 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 -- 172.21.15.81:0/1172079340 learned_addr learned my addr 172.21.15.81:0/1172079340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9526d9d640 1 --2- 172.21.15.81:0/1172079340 >> v2:172.21.15.117:3300/0 conn(0x7f952806d7d0 0x7f95281554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952659c640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952659c640 1 -- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 msgr2=0x7f952806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952659c640 1 -- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 msgr2=0x7f952806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952659c640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 -- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 msgr2=0x7f952806d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f952659c640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 -- 172.21.15.81:0/1172079340 >> v2:172.21.15.117:3300/0 conn(0x7f952806d7d0 msgr2=0x7f95281554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1172079340 >> v2:172.21.15.117:3300/0 conn(0x7f952806d7d0 0x7f95281554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.574+0000 7f9525d9b640 1 -- 172.21.15.81:0/1172079340 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952806a890 con 0x7f95280c2570 2024-05-08T20:42:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c2570 0x7f9528154f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95280701a0 tx=0x7f951c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e40e4ee73e95e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952559a640 1 -- 172.21.15.81:0/1172079340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0ab620 con 0x7f95280c2570 2024-05-08T20:42:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952559a640 1 -- 172.21.15.81:0/1172079340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0ab780 con 0x7f95280c2570 2024-05-08T20:42:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952559a640 1 -- 172.21.15.81:0/1172079340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0abb10 con 0x7f95280c2570 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 -- 172.21.15.81:0/1172079340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c2570 msgr2=0x7f9528154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c2570 0x7f9528154f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95280701a0 tx=0x7f951c01c460 comp rx=0 tx=0).stop 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 -- 172.21.15.81:0/1172079340 shutdown_connections 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 --2- 172.21.15.81:0/1172079340 >> v2:172.21.15.117:3300/0 conn(0x7f952806d7d0 0x7f95281554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95280c2570 0x7f9528154f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 --2- 172.21.15.81:0/1172079340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9528152340 0x7f952806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 -- 172.21.15.81:0/1172079340 >> 172.21.15.81:0/1172079340 conn(0x7f95280c71b0 msgr2=0x7f95280c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 -- 172.21.15.81:0/1172079340 shutdown_connections 2024-05-08T20:42:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.578+0000 7f952c88b640 1 -- 172.21.15.81:0/1172079340 wait complete. 2024-05-08T20:42:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 Processor -- start 2024-05-08T20:42:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- start start 2024-05-08T20:42:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 0x7f9528155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281f19e0 con 0x7f9528152340 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c6f30 con 0x7f952806d7d0 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952814ba20 con 0x7f95280c2570 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41834/0 (socket says 172.21.15.81:41834) 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 0x7f9528155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 -- 172.21.15.81:0/1777324592 learned_addr learned my addr 172.21.15.81:0/1777324592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9525d9b640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 msgr2=0x7f95280c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9525d9b640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 msgr2=0x7f95280c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9525d9b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 msgr2=0x7f95280c69f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 msgr2=0x7f9528155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 0x7f9528155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 -- 172.21.15.81:0/1777324592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0094d0 con 0x7f9528152340 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952659c640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 0x7f9528155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9526d9d640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f952000eed0 tx=0x7f952000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520010040 con 0x7f9528152340 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000bd20 con 0x7f9528152340 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952814bd00 con 0x7f9528152340 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520014620 con 0x7f9528152340 2024-05-08T20:42:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95281eda90 con 0x7f9528152340 2024-05-08T20:42:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95280675e0 con 0x7f9528152340 2024-05-08T20:42:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.582+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9520014780 con 0x7f9528152340 2024-05-08T20:42:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.586+0000 7f9516ffd640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 0x7f9508068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.586+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9520084ad0 con 0x7f9528152340 2024-05-08T20:42:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.586+0000 7f952659c640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 0x7f9508068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.586+0000 7f952659c640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 0x7f9508068b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9518000ee0 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:27.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.590+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9520051aa0 con 0x7f9528152340 2024-05-08T20:42:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.862+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f952814bef0 con 0x7f9528152340 2024-05-08T20:42:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.862+0000 7f9516ffd640 1 -- 172.21.15.81:0/1777324592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f9520018020 con 0x7f9528152340 2024-05-08T20:42:27.866 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":118,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:27.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 msgr2=0x7f9508068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:27.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 0x7f9508068b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9518000ee0 tx=0x7f9518008040 comp rx=0 tx=0).stop 2024-05-08T20:42:27.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 msgr2=0x7f95281ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:27.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f952000eed0 tx=0x7f952000b480 comp rx=0 tx=0).stop 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 shutdown_connections 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9508066690 0x7f9508068b50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9528152340 0x7f95281ed550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95280c2570 0x7f95280c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 --2- 172.21.15.81:0/1777324592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952806d7d0 0x7f9528155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 >> 172.21.15.81:0/1777324592 conn(0x7f95280c71b0 msgr2=0x7f9528152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 shutdown_connections 2024-05-08T20:42:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:27.866+0000 7f952c88b640 1 -- 172.21.15.81:0/1777324592 wait complete. 2024-05-08T20:42:30.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.018+0000 7f3d72804640 1 Processor -- start 2024-05-08T20:42:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.018+0000 7f3d72804640 1 -- start start 2024-05-08T20:42:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d72804640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d6c154970 0x7f3d6c06a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d72804640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c0c8b10 con 0x7f3d6c1522b0 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d72804640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c154ee0 con 0x7f3d6c0c8230 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d72804640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c152690 con 0x7f3d6c154970 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3d6c1522b0 0x7f3d6c0c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37400/0 (socket says 172.21.15.81:37400) 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6bfff640 1 -- 172.21.15.81:0/3691294597 learned_addr learned my addr 172.21.15.81:0/3691294597 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/3691294597 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c154970 0x7f3d6c06a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299275222 0 0) 0x7f3d6c0c8b10 con 0x7f3d6c1522b0 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54003530 con 0x7f3d6c1522b0 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1820619772 0 0) 0x7f3d54003530 con 0x7f3d6c1522b0 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c154970 msgr2=0x7f3d6c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 --2- 172.21.15.81:0/3691294597 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c154970 0x7f3d6c06a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 >> v1:172.21.15.117:6789/0 conn(0x7f3d6c0c8230 legacy=0x7f3d6c06a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c1551c0 con 0x7f3d6c1522b0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3d5c001680 con 0x7f3d6c1522b0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 >> v1:172.21.15.81:6789/0 conn(0x7f3d6c1522b0 legacy=0x7f3d6c0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d540039d0 0x7f3d54003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d540051e0 0x7f3d5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400c100 con 0x7f3d540047d0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400c270 con 0x7f3d540039d0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400c430 con 0x7f3d540051e0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 -- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d540051e0 msgr2=0x7f3d5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d70da1640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d540051e0 0x7f3d5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6bfff640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d540039d0 0x7f3d54003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d540051e0 0x7f3d5400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 -- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d540039d0 msgr2=0x7f3d54003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d540039d0 0x7f3d54003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6b7fe640 1 -- 172.21.15.81:0/3691294597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54003530 con 0x7f3d540047d0 2024-05-08T20:42:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d6bfff640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d540039d0 0x7f3d54003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.022+0000 7f3d70da1640 1 -- 172.21.15.81:0/3691294597 reap_dead start 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009a90 tx=0x7f3d6001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8219299efb94b5f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600059a0 con 0x7f3d540047d0 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60005b00 con 0x7f3d540047d0 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6affd640 1 -- 172.21.15.81:0/3691294597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60005cb0 con 0x7f3d540047d0 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 msgr2=0x7f3d54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009a90 tx=0x7f3d6001ca50 comp rx=0 tx=0).stop 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/3691294597 shutdown_connections 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 --2- 172.21.15.81:0/3691294597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d54004c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/3691294597 >> 172.21.15.81:0/3691294597 conn(0x7f3d6c0ca330 msgr2=0x7f3d6c0ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:31.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/3691294597 shutdown_connections 2024-05-08T20:42:31.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/3691294597 wait complete. 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 Processor -- start 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- start start 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0c0050 0x7f3d6c0ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0abf30 0x7f3d6c14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0c1120 con 0x7f3d540047d0 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0aa800 con 0x7f3d6c0c0050 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0aaaa0 con 0x7f3d6c0abf30 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37526/0 (socket says 172.21.15.81:37526) 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 -- 172.21.15.81:0/4176430474 learned_addr learned my addr 172.21.15.81:0/4176430474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0c0050 0x7f3d6c0ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d70da1640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0abf30 0x7f3d6c14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 -- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0abf30 msgr2=0x7f3d6c14c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0abf30 0x7f3d6c14c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 -- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0c0050 msgr2=0x7f3d6c0ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0c0050 0x7f3d6c0ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 -- 172.21.15.81:0/4176430474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0ac7b0 con 0x7f3d540047d0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d6bfff640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d770 tx=0x7f3d5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0074e0 con 0x7f3d540047d0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c007640 con 0x7f3d540047d0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0aca90 con 0x7f3d540047d0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.026+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c004a30 con 0x7f3d540047d0 2024-05-08T20:42:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c0ab890 con 0x7f3d540047d0 2024-05-08T20:42:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c0675e0 con 0x7f3d540047d0 2024-05-08T20:42:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d5c004b90 con 0x7f3d540047d0 2024-05-08T20:42:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d68ff9640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 0x7f3d58068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3d5c083e20 con 0x7f3d540047d0 2024-05-08T20:42:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 0x7f3d58068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:31.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.030+0000 7f3d6b7fe640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 0x7f3d58068b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ae000 tx=0x7f3d600046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:31.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.038+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3d5c050eb0 con 0x7f3d540047d0 2024-05-08T20:42:31.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3d6c0ac610 con 0x7f3d540047d0 2024-05-08T20:42:31.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d68ff9640 1 -- 172.21.15.81:0/4176430474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f3d6c0ac610 con 0x7f3d540047d0 2024-05-08T20:42:31.292 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":118,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 msgr2=0x7f3d58068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 0x7f3d58068b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ae000 tx=0x7f3d600046d0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 msgr2=0x7f3d6c0c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d770 tx=0x7f3d5c00dc30 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 shutdown_connections 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3d580666c0 0x7f3d58068b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0abf30 0x7f3d6c14c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0c0050 0x7f3d6c0ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 --2- 172.21.15.81:0/4176430474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540047d0 0x7f3d6c0c0be0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 >> 172.21.15.81:0/4176430474 conn(0x7f3d6c0ca330 msgr2=0x7f3d6c14fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 shutdown_connections 2024-05-08T20:42:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:31.290+0000 7f3d72804640 1 -- 172.21.15.81:0/4176430474 wait complete. 2024-05-08T20:42:34.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 Processor -- start 2024-05-08T20:42:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 -- start start 2024-05-08T20:42:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa46c151f00 0x7fa46c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa46c154cf0 0x7fa46c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c158e20 con 0x7fa46c155690 2024-05-08T20:42:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c06bb20 con 0x7fa46c154cf0 2024-05-08T20:42:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa471224640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c1548e0 con 0x7fa46c151f00 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa46c154cf0 0x7fa46c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa46c154cf0 0x7fa46c155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37528/0 (socket says 172.21.15.81:37528) 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 -- 172.21.15.81:0/2387912809 learned_addr learned my addr 172.21.15.81:0/2387912809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46ad9d640 1 --2- 172.21.15.81:0/2387912809 >> v2:172.21.15.117:3300/0 conn(0x7fa46c151f00 0x7fa46c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 -- 172.21.15.81:0/2387912809 >> v2:172.21.15.117:3300/0 conn(0x7fa46c151f00 msgr2=0x7fa46c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 --2- 172.21.15.81:0/2387912809 >> v2:172.21.15.117:3300/0 conn(0x7fa46c151f00 0x7fa46c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 -- 172.21.15.81:0/2387912809 >> v1:172.21.15.117:6789/0 conn(0x7fa46c155690 legacy=0x7fa46c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.434+0000 7fa46a59c640 1 -- 172.21.15.81:0/2387912809 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c1522e0 con 0x7fa46c154cf0 2024-05-08T20:42:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa46a59c640 1 --2- 172.21.15.81:0/2387912809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c155150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cb390 tx=0x7fa46001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f545c4ef9a542c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa469d9b640 1 -- 172.21.15.81:0/2387912809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600ac640 con 0x7fa46c154cf0 2024-05-08T20:42:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa469d9b640 1 -- 172.21.15.81:0/2387912809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600ac7a0 con 0x7fa46c154cf0 2024-05-08T20:42:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa469d9b640 1 -- 172.21.15.81:0/2387912809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600acb30 con 0x7fa46c154cf0 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 -- 172.21.15.81:0/2387912809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 msgr2=0x7fa46c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 --2- 172.21.15.81:0/2387912809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c155150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cb390 tx=0x7fa46001c3c0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 -- 172.21.15.81:0/2387912809 shutdown_connections 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 --2- 172.21.15.81:0/2387912809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c155150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 --2- 172.21.15.81:0/2387912809 >> v2:172.21.15.117:3300/0 conn(0x7fa46c151f00 0x7fa46c1588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 -- 172.21.15.81:0/2387912809 >> 172.21.15.81:0/2387912809 conn(0x7fa46c0715f0 msgr2=0x7fa46c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 -- 172.21.15.81:0/2387912809 shutdown_connections 2024-05-08T20:42:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.438+0000 7fa471224640 1 -- 172.21.15.81:0/2387912809 wait complete. 2024-05-08T20:42:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 Processor -- start 2024-05-08T20:42:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- start start 2024-05-08T20:42:34.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 0x7fa46c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa46c14df90 0x7fa46c1edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c14ece0 con 0x7fa46c154cf0 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c144ca0 con 0x7fa46c14df90 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0ada00 con 0x7fa46c151f00 2024-05-08T20:42:34.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37534/0 (socket says 172.21.15.81:37534) 2024-05-08T20:42:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 -- 172.21.15.81:0/1803064485 learned_addr learned my addr 172.21.15.81:0/1803064485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46b59e640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa46c14df90 0x7fa46c1edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46ad9d640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 0x7fa46c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 -- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 msgr2=0x7fa46c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 0x7fa46c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 -- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa46c14df90 msgr2=0x7fa46c1edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa46c14df90 0x7fa46c1edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 -- 172.21.15.81:0/1803064485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600094d0 con 0x7fa46c154cf0 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46ad9d640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 0x7fa46c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa46a59c640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa46001aa70 tx=0x7fa460019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b5640 con 0x7fa46c154cf0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600b57a0 con 0x7fa46c154cf0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c0ad720 con 0x7fa46c154cf0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b5b30 con 0x7fa46c154cf0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c1512e0 con 0x7fa46c154cf0 2024-05-08T20:42:34.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.442+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c074950 con 0x7fa46c154cf0 2024-05-08T20:42:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.446+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4600b3070 con 0x7fa46c154cf0 2024-05-08T20:42:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.446+0000 7fa4537fe640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 0x7fa458068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.446+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa46011e750 con 0x7fa46c154cf0 2024-05-08T20:42:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.446+0000 7fa46ad9d640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 0x7fa458068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.446+0000 7fa46ad9d640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 0x7fa458068b50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009840 tx=0x7fa45c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.450+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa4600eb8d0 con 0x7fa46c154cf0 2024-05-08T20:42:34.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.710+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa46c06ab10 con 0x7fa46c154cf0 2024-05-08T20:42:34.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa4537fe640 1 -- 172.21.15.81:0/1803064485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fa4600eeef0 con 0x7fa46c154cf0 2024-05-08T20:42:34.716 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 msgr2=0x7fa458068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 0x7fa458068b50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009840 tx=0x7fa45c008040 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 msgr2=0x7fa46c1ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa46001aa70 tx=0x7fa460019160 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 shutdown_connections 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa458066690 0x7fa458068b50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa46c14df90 0x7fa46c1edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa46c154cf0 0x7fa46c1ed5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 --2- 172.21.15.81:0/1803064485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa46c151f00 0x7fa46c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 >> 172.21.15.81:0/1803064485 conn(0x7fa46c0715f0 msgr2=0x7fa46c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 shutdown_connections 2024-05-08T20:42:34.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.714+0000 7fa471224640 1 -- 172.21.15.81:0/1803064485 wait complete. 2024-05-08T20:42:34.735 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:42:34.736 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:42:34.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:42:34.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.846+0000 7f38d25f8640 1 Processor -- start 2024-05-08T20:42:34.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 -- start start 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38cc152340 0x7f38cc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38cc06d7d0 0x7f38cc155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc158080 con 0x7f38cc0c2570 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc06ab70 con 0x7f38cc06d7d0 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d25f8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc154b10 con 0x7f38cc152340 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38cc06d7d0 0x7f38cc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38cc06d7d0 0x7f38cc155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37538/0 (socket says 172.21.15.81:37538) 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38cb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38cc0c2570 0x7f38cc154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37406/0 (socket says 172.21.15.81:37406) 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 -- 172.21.15.81:0/999363237 learned_addr learned my addr 172.21.15.81:0/999363237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38cbfff640 1 --2- 172.21.15.81:0/999363237 >> v2:172.21.15.117:3300/0 conn(0x7f38cc152340 0x7f38cc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 -- 172.21.15.81:0/999363237 >> v2:172.21.15.117:3300/0 conn(0x7f38cc152340 msgr2=0x7f38cc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:34.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 --2- 172.21.15.81:0/999363237 >> v2:172.21.15.117:3300/0 conn(0x7f38cc152340 0x7f38cc06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 -- 172.21.15.81:0/999363237 >> v1:172.21.15.81:6789/0 conn(0x7f38cc0c2570 legacy=0x7f38cc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 -- 172.21.15.81:0/999363237 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc06a890 con 0x7f38cc06d7d0 2024-05-08T20:42:34.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.850+0000 7f38d0b95640 1 --2- 172.21.15.81:0/999363237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc155670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38cc06fd50 tx=0x7f38c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2804e54a16ad93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38caffd640 1 -- 172.21.15.81:0/999363237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a5810 con 0x7f38cc06d7d0 2024-05-08T20:42:34.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38caffd640 1 -- 172.21.15.81:0/999363237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c40a5970 con 0x7f38cc06d7d0 2024-05-08T20:42:34.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38caffd640 1 -- 172.21.15.81:0/999363237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40a5d40 con 0x7f38cc06d7d0 2024-05-08T20:42:34.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- 172.21.15.81:0/999363237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 msgr2=0x7f38cc155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- 172.21.15.81:0/999363237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc155670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38cc06fd50 tx=0x7f38c401c950 comp rx=0 tx=0).stop 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- 172.21.15.81:0/999363237 shutdown_connections 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- 172.21.15.81:0/999363237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc155670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- 172.21.15.81:0/999363237 >> v2:172.21.15.117:3300/0 conn(0x7f38cc152340 0x7f38cc06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- 172.21.15.81:0/999363237 >> 172.21.15.81:0/999363237 conn(0x7f38cc0c71b0 msgr2=0x7f38cc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- 172.21.15.81:0/999363237 shutdown_connections 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- 172.21.15.81:0/999363237 wait complete. 2024-05-08T20:42:34.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 Processor -- start 2024-05-08T20:42:34.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- start start 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38cc0c2570 0x7f38cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc152340 0x7f38cc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f15a0 con 0x7f38cc06d7d0 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0aae00 con 0x7f38cc152340 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d25f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc13af70 con 0x7f38cc0c2570 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37552/0 (socket says 172.21.15.81:37552) 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 -- 172.21.15.81:0/321316004 learned_addr learned my addr 172.21.15.81:0/321316004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d0b95640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc152340 0x7f38cc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38cc0c2570 0x7f38cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38cc0c2570 msgr2=0x7f38cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38cc0c2570 0x7f38cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc152340 msgr2=0x7f38cc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc152340 0x7f38cc1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cbfff640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4009b30 con 0x7f38cc06d7d0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38d0b95640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38cc152340 0x7f38cc1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.854+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38cc0c2570 0x7f38cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38cbfff640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc144120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00d800 tx=0x7f38bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00b6c0 con 0x7f38cc06d7d0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b820 con 0x7f38cc06d7d0 2024-05-08T20:42:34.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc151800 con 0x7f38cc06d7d0 2024-05-08T20:42:34.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bb90 con 0x7f38cc06d7d0 2024-05-08T20:42:34.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc151b00 con 0x7f38cc06d7d0 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d25f8640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 0x7f38cc139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc069550 con 0x7f38cc1f1000 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 0x7f38cc139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38cb7fe640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38cc161bf0 con 0x7f38cc1f1000 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 0x7f38cc139ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38cc13f420 tx=0x7f38c0001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0012590 con 0x7f38cc1f1000 2024-05-08T20:42:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38bc00bcf0 con 0x7f38cc06d7d0 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f38b8066730 0x7f38b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d0b95640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f38b8066730 0x7f38b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f38bc084a10 con 0x7f38cc06d7d0 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f38c00126f0 con 0x7f38cc1f1000 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 msgr2=0x7f38cc139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 0x7f38cc139ed0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38cc13f420 tx=0x7f38c0001860 comp rx=0 tx=0).stop 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 msgr2=0x7f38cc139ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38c8ff9640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc1f1000 0x7f38cc139ed0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38cc13f420 tx=0x7f38c0001860 comp rx=0 tx=0).stop 2024-05-08T20:42:34.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.858+0000 7f38d0b95640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f38b8066730 0x7f38b8068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f38c40ae000 tx=0x7f38c40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38d25f8640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 0x7f38cc13a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f1810 con 0x7f38cc13b100 2024-05-08T20:42:34.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 0x7f38cc13a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38cb7fe640 1 -- 172.21.15.81:0/321316004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f38cc0675e0 con 0x7f38cc13b100 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38cb7fe640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 0x7f38cc13a410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38c0017000 tx=0x7f38c0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.866+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c001dd30 con 0x7f38cc13b100 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f38c001de90 con 0x7f38cc13b100 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 msgr2=0x7f38cc13a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38c8ff9640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 0x7f38cc13a410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38c0017000 tx=0x7f38c0001130 comp rx=0 tx=0).stop 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38c8ff9640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 msgr2=0x7f38cc13a410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38c8ff9640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc13b100 0x7f38cc13a410 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38c0017000 tx=0x7f38c0001130 comp rx=0 tx=0).stop 2024-05-08T20:42:34.872 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:34.876 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:34.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:42:34.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:34.885 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f38b8066730 msgr2=0x7f38b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f38b8066730 0x7f38b8068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f38c40ae000 tx=0x7f38c40a7070 comp rx=0 tx=0).stop 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 msgr2=0x7f38cc144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 --2- 172.21.15.81:0/321316004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38cc06d7d0 0x7f38cc144120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00d800 tx=0x7f38bc00dcc0 comp rx=0 tx=0).stop 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d0b95640 1 -- 172.21.15.81:0/321316004 reap_dead start 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d0b95640 1 -- 172.21.15.81:0/321316004 reap_dead start 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 shutdown_connections 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 >> 172.21.15.81:0/321316004 conn(0x7f38cc0c71b0 msgr2=0x7f38cc152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 shutdown_connections 2024-05-08T20:42:34.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:34.870+0000 7f38d25f8640 1 -- 172.21.15.81:0/321316004 wait complete. 2024-05-08T20:42:34.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:34.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:42:34.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:42:35.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.002+0000 7f7c88fbb640 1 Processor -- start 2024-05-08T20:42:35.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.002+0000 7f7c88fbb640 1 -- start start 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c88fbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c840c30d0 0x7f7c840c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c88fbb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c840a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c88fbb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c84155e10 con 0x7f7c840c2bc0 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c88fbb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8406e790 con 0x7f7c840c30d0 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c88fbb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8406f460 con 0x7f7c840a94b0 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c840c30d0 0x7f7c840c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c840c30d0 0x7f7c840c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37592/0 (socket says 172.21.15.81:37592) 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 -- 172.21.15.81:0/4138170832 learned_addr learned my addr 172.21.15.81:0/4138170832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c82d9d640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c840a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 -- 172.21.15.81:0/4138170832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 msgr2=0x7f7c840a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c840a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 -- 172.21.15.81:0/4138170832 >> v1:172.21.15.117:6789/0 conn(0x7f7c840c2bc0 legacy=0x7f7c840c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 -- 172.21.15.81:0/4138170832 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840a9e20 con 0x7f7c840c30d0 2024-05-08T20:42:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8259c640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c30d0 0x7f7c840c34b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009870 tx=0x7f7c7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6b617995edc38f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8159a640 1 -- 172.21.15.81:0/4138170832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740a6040 con 0x7f7c840c30d0 2024-05-08T20:42:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8159a640 1 -- 172.21.15.81:0/4138170832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c740aa600 con 0x7f7c840c30d0 2024-05-08T20:42:35.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.006+0000 7f7c8159a640 1 -- 172.21.15.81:0/4138170832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740aa990 con 0x7f7c840c30d0 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/4138170832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c30d0 msgr2=0x7f7c840c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c30d0 0x7f7c840c34b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009870 tx=0x7f7c7401c4a0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/4138170832 shutdown_connections 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c840a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/4138170832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c30d0 0x7f7c840c34b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/4138170832 >> 172.21.15.81:0/4138170832 conn(0x7f7c840c4cc0 msgr2=0x7f7c840c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/4138170832 shutdown_connections 2024-05-08T20:42:35.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/4138170832 wait complete. 2024-05-08T20:42:35.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 Processor -- start 2024-05-08T20:42:35.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- start start 2024-05-08T20:42:35.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c8415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 0x7f7c84145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840c30d0 0x7f7c84145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84148320 con 0x7f7c840c2bc0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84147270 con 0x7f7c840c30d0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841464c0 con 0x7f7c840a94b0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 0x7f7c84145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 0x7f7c84145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37604/0 (socket says 172.21.15.81:37604) 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 -- 172.21.15.81:0/1025141884 learned_addr learned my addr 172.21.15.81:0/1025141884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c82d9d640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840c30d0 0x7f7c84145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c8415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 msgr2=0x7f7c8415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c8415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840c30d0 msgr2=0x7f7c84145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840c30d0 0x7f7c84145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740094d0 con 0x7f7c840c2bc0 2024-05-08T20:42:35.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c840a94b0 0x7f7c8415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c81d9b640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 0x7f7c84145a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c500 tx=0x7f7c7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c780052d0 con 0x7f7c840c2bc0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78005430 con 0x7f7c840c2bc0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c841474c0 con 0x7f7c840c2bc0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78012830 con 0x7f7c840c2bc0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.010+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c84147a80 con 0x7f7c840c2bc0 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 0x7f7c841ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84073ea0 con 0x7f7c8414bfe0 2024-05-08T20:42:35.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 0x7f7c841ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c8259c640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c840c4970 con 0x7f7c8414bfe0 2024-05-08T20:42:35.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c78012990 con 0x7f7c840c2bc0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 0x7f7c841ed190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7c84071050 tx=0x7f7c7401ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c640666c0 0x7f7c64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7c78084040 con 0x7f7c840c2bc0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c82d9d640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c640666c0 0x7f7c64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740aae60 con 0x7f7c8414bfe0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c82d9d640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c640666c0 0x7f7c64068b80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7c841ecfb0 tx=0x7f7c7c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7c740b7070 con 0x7f7c8414bfe0 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 msgr2=0x7f7c841ed190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 0x7f7c841ed190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7c84071050 tx=0x7f7c7401ace0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 msgr2=0x7f7c841ed190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.014+0000 7f7c72ffd640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8414bfe0 0x7f7c841ed190 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7c84071050 tx=0x7f7c7401ace0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.022+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 0x7f7c841ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.022+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84074950 con 0x7f7c84147c40 2024-05-08T20:42:35.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.022+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 0x7f7c841ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.022+0000 7f7c8259c640 1 -- 172.21.15.81:0/1025141884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7c84072600 con 0x7f7c84147c40 2024-05-08T20:42:35.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c8259c640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 0x7f7c841ed6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c7401a0d0 tx=0x7f7c74019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740a6040 con 0x7f7c84147c40 2024-05-08T20:42:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f7c740c4880 con 0x7f7c84147c40 2024-05-08T20:42:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 msgr2=0x7f7c841ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 0x7f7c841ed6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c7401a0d0 tx=0x7f7c74019240 comp rx=0 tx=0).stop 2024-05-08T20:42:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 msgr2=0x7f7c841ed6d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:35.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c72ffd640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c84147c40 0x7f7c841ed6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:35.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c640666c0 msgr2=0x7f7c64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c640666c0 0x7f7c64068b80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7c841ecfb0 tx=0x7f7c7c00b040 comp rx=0 tx=0).stop 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 msgr2=0x7f7c84145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 --2- 172.21.15.81:0/1025141884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c840c2bc0 0x7f7c84145a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c500 tx=0x7f7c7800c9c0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c82d9d640 1 -- 172.21.15.81:0/1025141884 reap_dead start 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c82d9d640 1 -- 172.21.15.81:0/1025141884 reap_dead start 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 shutdown_connections 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 >> 172.21.15.81:0/1025141884 conn(0x7f7c840c4cc0 msgr2=0x7f7c8415c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 shutdown_connections 2024-05-08T20:42:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.026+0000 7f7c88fbb640 1 -- 172.21.15.81:0/1025141884 wait complete. 2024-05-08T20:42:35.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:35.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:42:35.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:42:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.166+0000 7fc3d105b640 1 Processor -- start 2024-05-08T20:42:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.166+0000 7fc3d105b640 1 -- start start 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3d105b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3cc0aac30 0x7fc3cc1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3d105b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc155140 con 0x7fc3cc152220 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3d105b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc0c32d0 con 0x7fc3cc0c26e0 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3d105b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0c4780 con 0x7fc3cc0aac30 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3cc152220 0x7fc3cc0c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37416/0 (socket says 172.21.15.81:37416) 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 -- 172.21.15.81:0/2062580693 learned_addr learned my addr 172.21.15.81:0/2062580693 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cb59e640 1 --2- 172.21.15.81:0/2062580693 >> v2:172.21.15.117:3300/0 conn(0x7fc3cc0aac30 0x7fc3cc1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027924068 0 0) 0x7fc3cc155140 con 0x7fc3cc152220 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b8003530 con 0x7fc3cc152220 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856152627 0 0) 0x7fc3b8003530 con 0x7fc3cc152220 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 >> v2:172.21.15.117:3300/0 conn(0x7fc3cc0aac30 msgr2=0x7fc3cc1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 --2- 172.21.15.81:0/2062580693 >> v2:172.21.15.117:3300/0 conn(0x7fc3cc0aac30 0x7fc3cc1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 >> v1:172.21.15.117:6789/0 conn(0x7fc3cc0c26e0 legacy=0x7fc3cc0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc072650 con 0x7fc3cc152220 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc3bc001680 con 0x7fc3cc152220 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 >> v1:172.21.15.81:6789/0 conn(0x7fc3cc152220 legacy=0x7fc3cc0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 0x7fc3b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3b80047d0 0x7fc3b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8005190 0x7fc3b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b800c100 con 0x7fc3b8003980 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b800c270 con 0x7fc3b80047d0 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b800c430 con 0x7fc3b8005190 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 0x7fc3b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 -- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8005190 msgr2=0x7fc3b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8005190 0x7fc3b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 -- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3b80047d0 msgr2=0x7fc3b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3b80047d0 0x7fc3b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cad9d640 1 -- 172.21.15.81:0/2062580693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8003530 con 0x7fc3b8003980 2024-05-08T20:42:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.170+0000 7fc3cb59e640 1 -- 172.21.15.81:0/2062580693 reap_dead start 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 0x7fc3b8003da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c240 tx=0x7fc3bc01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d607815fb93f43 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc005ae0 con 0x7fc3b8003980 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc005c40 con 0x7fc3b8003980 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3ca59c640 1 -- 172.21.15.81:0/2062580693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0a5a20 con 0x7fc3b8003980 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 msgr2=0x7fc3b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 0x7fc3b8003da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c240 tx=0x7fc3bc01cbf0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- 172.21.15.81:0/2062580693 shutdown_connections 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 --2- 172.21.15.81:0/2062580693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b8003980 0x7fc3b8003da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- 172.21.15.81:0/2062580693 >> 172.21.15.81:0/2062580693 conn(0x7fc3cc0c4cc0 msgr2=0x7fc3cc0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- 172.21.15.81:0/2062580693 shutdown_connections 2024-05-08T20:42:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- 172.21.15.81:0/2062580693 wait complete. 2024-05-08T20:42:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 Processor -- start 2024-05-08T20:42:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- start start 2024-05-08T20:42:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8003980 0x7fc3cc1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3cc150960 0x7fc3cc071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 0x7fc3cc141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc142330 con 0x7fc3cc141970 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc06bdc0 con 0x7fc3cc150960 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3d105b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc153600 con 0x7fc3b8003980 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3cb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 0x7fc3cc141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3cb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 0x7fc3cc141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37628/0 (socket says 172.21.15.81:37628) 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.174+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 learned_addr learned my addr 172.21.15.81:0/3336949045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c3fff640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3cc150960 0x7fc3cc071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8003980 0x7fc3cc1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8003980 msgr2=0x7fc3cc1ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3b8003980 0x7fc3cc1ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3cc150960 msgr2=0x7fc3cc071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3cc150960 0x7fc3cc071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc1edb30 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c3fff640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3cc150960 0x7fc3cc071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cb59e640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 0x7fc3cc141df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400ede0 tx=0x7fc3c400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4010040 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400bab0 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3d105b640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc1edd60 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400be40 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3d105b640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc1ee320 con 0x7fc3cc141970 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c17fa640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 0x7fc3a4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4007e90 con 0x7fc3a4002a40 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 0x7fc3a4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3c401f460 con 0x7fc3cc141970 2024-05-08T20:42:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cad9d640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3a4008050 con 0x7fc3a4002a40 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3ac066690 0x7fc3ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc3c4084870 con 0x7fc3cc141970 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c3fff640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3ac066690 0x7fc3ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 0x7fc3a4004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c210 tx=0x7fc3bc019990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0b4040 con 0x7fc3a4002a40 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.178+0000 7fc3c3fff640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3ac066690 0x7fc3ac068b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc14f6d0 tx=0x7fc3b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.182+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc3bc0070c0 con 0x7fc3a4002a40 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.182+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 msgr2=0x7fc3a4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.182+0000 7fc3c37fe640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 0x7fc3a4004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c210 tx=0x7fc3bc019990 comp rx=0 tx=0).stop 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.182+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 msgr2=0x7fc3a4004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.182+0000 7fc3c37fe640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4002a40 0x7fc3a4004f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.186+0000 7fc3c17fa640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 0x7fc3a40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.186+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a400a350 con 0x7fc3a4006f70 2024-05-08T20:42:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.186+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 0x7fc3a40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3cad9d640 1 -- 172.21.15.81:0/3336949045 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc3a400a510 con 0x7fc3a4006f70 2024-05-08T20:42:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3cad9d640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 0x7fc3a40073e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c240 tx=0x7fc3b8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0c1300 con 0x7fc3a4006f70 2024-05-08T20:42:35.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fc3bc0c16d0 con 0x7fc3a4006f70 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 msgr2=0x7fc3a40073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 0x7fc3a40073e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c240 tx=0x7fc3b8005800 comp rx=0 tx=0).stop 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 msgr2=0x7fc3a40073e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c37fe640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3a4006f70 0x7fc3a40073e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:35.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.196 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:35.197 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:35.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:35.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:35.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:35.205 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:35.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:35.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:35.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:35.206 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:35.206 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3ac066690 msgr2=0x7fc3ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3ac066690 0x7fc3ac068b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc14f6d0 tx=0x7fc3b4009040 comp rx=0 tx=0).stop 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 msgr2=0x7fc3cc141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 --2- 172.21.15.81:0/3336949045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3cc141970 0x7fc3cc141df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400ede0 tx=0x7fc3c400b480 comp rx=0 tx=0).stop 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 reap_dead start 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3cb59e640 1 -- 172.21.15.81:0/3336949045 reap_dead start 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 shutdown_connections 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 >> 172.21.15.81:0/3336949045 conn(0x7fc3cc0c4cc0 msgr2=0x7fc3cc0ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 shutdown_connections 2024-05-08T20:42:35.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.190+0000 7fc3c17fa640 1 -- 172.21.15.81:0/3336949045 wait complete. 2024-05-08T20:42:35.209 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:35.209 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:42:35.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:42:35.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 Processor -- start 2024-05-08T20:42:35.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 -- start start 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22ac0c34e0 0x7f22ac1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac158080 con 0x7f22ac152340 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac06ab70 con 0x7f22ac0c34e0 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b33dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac154b10 con 0x7f22ac0c2570 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36792/0 (socket says 172.21.15.81:36792) 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 -- 172.21.15.81:0/2186304070 learned_addr learned my addr 172.21.15.81:0/2186304070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:35.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b1979640 1 --2- 172.21.15.81:0/2186304070 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0c34e0 0x7f22ac1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 -- 172.21.15.81:0/2186304070 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0c34e0 msgr2=0x7f22ac1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:35.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 --2- 172.21.15.81:0/2186304070 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0c34e0 0x7f22ac1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 -- 172.21.15.81:0/2186304070 >> v1:172.21.15.117:6789/0 conn(0x7f22ac152340 legacy=0x7f22ac06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.326+0000 7f22b0977640 1 -- 172.21.15.81:0/2186304070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac06a890 con 0x7f22ac0c2570 2024-05-08T20:42:35.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b0977640 1 --2- 172.21.15.81:0/2186304070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=467ffbe05ee3bda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22a3fff640 1 -- 172.21.15.81:0/2186304070 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0a6040 con 0x7f22ac0c2570 2024-05-08T20:42:35.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22a3fff640 1 -- 172.21.15.81:0/2186304070 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0aa600 con 0x7f22ac0c2570 2024-05-08T20:42:35.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22a3fff640 1 -- 172.21.15.81:0/2186304070 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0aa990 con 0x7f22ac0c2570 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 -- 172.21.15.81:0/2186304070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 msgr2=0x7f22ac154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 --2- 172.21.15.81:0/2186304070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c01c4a0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 -- 172.21.15.81:0/2186304070 shutdown_connections 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 --2- 172.21.15.81:0/2186304070 >> v2:172.21.15.117:3300/0 conn(0x7f22ac0c34e0 0x7f22ac1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 --2- 172.21.15.81:0/2186304070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac0c2570 0x7f22ac154f60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 -- 172.21.15.81:0/2186304070 >> 172.21.15.81:0/2186304070 conn(0x7f22ac0c71b0 msgr2=0x7f22ac0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 -- 172.21.15.81:0/2186304070 shutdown_connections 2024-05-08T20:42:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.330+0000 7f22b33dc640 1 -- 172.21.15.81:0/2186304070 wait complete. 2024-05-08T20:42:35.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 Processor -- start 2024-05-08T20:42:35.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- start start 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 0x7f22ac13c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 0x7f22ac13ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac14d760 con 0x7f22ac0c34e0 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac13d9d0 con 0x7f22ac152340 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac13dcb0 con 0x7f22ac071f60 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37640/0 (socket says 172.21.15.81:37640) 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 -- 172.21.15.81:0/4116734603 learned_addr learned my addr 172.21.15.81:0/4116734603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b0977640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 0x7f22ac13c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1979640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 0x7f22ac13ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 -- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 msgr2=0x7f22ac13ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 0x7f22ac13ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 -- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 msgr2=0x7f22ac13c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 0x7f22ac13c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 -- 172.21.15.81:0/4116734603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0094d0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b0977640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 0x7f22ac13c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1979640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 0x7f22ac13ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b1178640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c500 tx=0x7f22a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8005220 con 0x7f22ac0c34e0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8005380 con 0x7f22ac0c34e0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac13df90 con 0x7f22ac0c34e0 2024-05-08T20:42:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8007270 con 0x7f22ac0c34e0 2024-05-08T20:42:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac13e550 con 0x7f22ac0c34e0 2024-05-08T20:42:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.334+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0675e0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.338+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f22a80073d0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.338+0000 7f22a1ffb640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 0x7f2290068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.338+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f22a8083de0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.338+0000 7f22b0977640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 0x7f2290068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.338+0000 7f22b0977640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 0x7f2290068b80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f229c0ae000 tx=0x7f229c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:35.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.342+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f22a8050dc0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.586+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f22ac13e740 con 0x7f22ac0c34e0 2024-05-08T20:42:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.586+0000 7f22a1ffb640 1 -- 172.21.15.81:0/4116734603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f22a80543e0 con 0x7f22ac0c34e0 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 msgr2=0x7f2290068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 0x7f2290068b80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f229c0ae000 tx=0x7f229c0a7000 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 msgr2=0x7f22ac144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c500 tx=0x7f22a800c9c0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 shutdown_connections 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22900666c0 0x7f2290068b80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22ac071f60 0x7f22ac13ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22ac152340 0x7f22ac13c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 --2- 172.21.15.81:0/4116734603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22ac0c34e0 0x7f22ac144ee0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 >> 172.21.15.81:0/4116734603 conn(0x7f22ac0c71b0 msgr2=0x7f22ac0c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 shutdown_connections 2024-05-08T20:42:35.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:35.590+0000 7f22b33dc640 1 -- 172.21.15.81:0/4116734603 wait complete. 2024-05-08T20:42:35.615 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:42:45.616 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:42:45.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 Processor -- start 2024-05-08T20:42:45.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 -- start start 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa30c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa30c0a94b0 0x7fa30c0a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c155e10 con 0x7fa30c0c30d0 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c06e790 con 0x7fa30c0a94b0 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa311ac6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06f460 con 0x7fa30c0c2bc0 2024-05-08T20:42:45.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa30c0c30d0 0x7fa30c0c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35554/0 (socket says 172.21.15.81:35554) 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30b7fe640 1 -- 172.21.15.81:0/2052503248 learned_addr learned my addr 172.21.15.81:0/2052503248 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30bfff640 1 --2- 172.21.15.81:0/2052503248 >> v2:172.21.15.117:3300/0 conn(0x7fa30c0a94b0 0x7fa30c0a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30affd640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa30c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577056199 0 0) 0x7fa30c155e10 con 0x7fa30c0c30d0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f4003530 con 0x7fa30c0c30d0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760251824 0 0) 0x7fa2f4003530 con 0x7fa30c0c30d0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 msgr2=0x7fa30c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa30c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 >> v2:172.21.15.117:3300/0 conn(0x7fa30c0a94b0 msgr2=0x7fa30c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 --2- 172.21.15.81:0/2052503248 >> v2:172.21.15.117:3300/0 conn(0x7fa30c0a94b0 0x7fa30c0a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0a9e60 con 0x7fa30c0c30d0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa2fc001680 con 0x7fa30c0c30d0 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 >> v1:172.21.15.81:6789/0 conn(0x7fa30c0c30d0 legacy=0x7fa30c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:45.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.738+0000 7fa30a7fc640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40039b0 0x7fa2f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa2f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f4004d10 0x7fa2f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06e790 con 0x7fa2f40039b0 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f400b990 con 0x7fa2f4004d10 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f400bb20 con 0x7fa30c0c2bc0 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40039b0 0x7fa2f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30affd640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa2f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 -- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 msgr2=0x7fa2f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa2f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 -- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f4004d10 msgr2=0x7fa2f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30bfff640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f4004d10 0x7fa2f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2f4004d10 0x7fa2f4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 -- 172.21.15.81:0/2052503248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4003530 con 0x7fa2f40039b0 2024-05-08T20:42:45.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30affd640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c0c2bc0 0x7fa2f40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40039b0 0x7fa2f4003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c1f0 tx=0x7fa2fc01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb59ebd58bb02fc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0a5b10 con 0x7fa2f40039b0 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0a5c70 con 0x7fa2f40039b0 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.742+0000 7fa30a7fc640 1 -- 172.21.15.81:0/2052503248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc005b20 con 0x7fa2f40039b0 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/2052503248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40039b0 msgr2=0x7fa2f4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 --2- 172.21.15.81:0/2052503248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f40039b0 0x7fa2f4003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c1f0 tx=0x7fa2fc01cc10 comp rx=0 tx=0).stop 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30bfff640 1 -- 172.21.15.81:0/2052503248 reap_dead start 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/2052503248 shutdown_connections 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/2052503248 >> 172.21.15.81:0/2052503248 conn(0x7fa30c0c4cc0 msgr2=0x7fa30c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/2052503248 shutdown_connections 2024-05-08T20:42:45.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/2052503248 wait complete. 2024-05-08T20:42:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 Processor -- start 2024-05-08T20:42:45.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- start start 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c1ed060 0x7fa30c06be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa30c1f0dd0 0x7fa30c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c1ed4e0 con 0x7fa30c06ca30 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06c3b0 con 0x7fa30c1f0dd0 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c154bf0 con 0x7fa30c1ed060 2024-05-08T20:42:45.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59414/0 (socket says 172.21.15.81:59414) 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 -- 172.21.15.81:0/1550815912 learned_addr learned my addr 172.21.15.81:0/1550815912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30affd640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c1ed060 0x7fa30c06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30bfff640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa30c1f0dd0 0x7fa30c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 -- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c1ed060 msgr2=0x7fa30c06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c1ed060 0x7fa30c06be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 -- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa30c1f0dd0 msgr2=0x7fa30c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa30c1f0dd0 0x7fa30c0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 -- 172.21.15.81:0/1550815912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c154ed0 con 0x7fa30c06ca30 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa30b7fe640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c190 tx=0x7fa2f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:45.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0b3070 con 0x7fa30c06ca30 2024-05-08T20:42:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0048b0 con 0x7fa30c06ca30 2024-05-08T20:42:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c1551b0 con 0x7fa30c06ca30 2024-05-08T20:42:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc004c20 con 0x7fa30c06ca30 2024-05-08T20:42:45.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.746+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c1f08b0 con 0x7fa30c06ca30 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c074950 con 0x7fa30c06ca30 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2fc007140 con 0x7fa30c06ca30 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa2f3fff640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 0x7fa2f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa2fc11e360 con 0x7fa30c06ca30 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa30affd640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 0x7fa2f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.750+0000 7fa30affd640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 0x7fa2f8068b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0c80a0 tx=0x7fa300008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:45.754+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa2fc0eb3c0 con 0x7fa30c06ca30 2024-05-08T20:42:46.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.030+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa30c0c28a0 con 0x7fa30c06ca30 2024-05-08T20:42:46.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.030+0000 7fa2f3fff640 1 -- 172.21.15.81:0/1550815912 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fa2fc0ee9e0 con 0x7fa30c06ca30 2024-05-08T20:42:46.035 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:46.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 msgr2=0x7fa2f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 0x7fa2f8068b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0c80a0 tx=0x7fa300008040 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 msgr2=0x7fa30c154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c190 tx=0x7fa2f4005800 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 shutdown_connections 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa2f8066690 0x7fa2f8068b50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa30c1f0dd0 0x7fa30c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa30c1ed060 0x7fa30c06be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 --2- 172.21.15.81:0/1550815912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c06ca30 0x7fa30c154580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 >> 172.21.15.81:0/1550815912 conn(0x7fa30c0c4cc0 msgr2=0x7fa30c06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 shutdown_connections 2024-05-08T20:42:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.034+0000 7fa311ac6640 1 -- 172.21.15.81:0/1550815912 wait complete. 2024-05-08T20:42:46.055 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:42:46.055 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:42:46.055 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:42:46.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:42:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 Processor -- start 2024-05-08T20:42:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 -- start start 2024-05-08T20:42:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a640c2bc0 0x7f2a640c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 0x7f2a640a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a64155e10 con 0x7f2a640c30d0 2024-05-08T20:42:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6406e790 con 0x7f2a640c2bc0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a688d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6406f460 con 0x7f2a640a94b0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2a640c30d0 0x7f2a640c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35564/0 (socket says 172.21.15.81:35564) 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 -- 172.21.15.81:0/1151169700 learned_addr learned my addr 172.21.15.81:0/1151169700 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1151169700 >> v2:172.21.15.117:3300/0 conn(0x7f2a640c2bc0 0x7f2a640c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 0x7f2a640a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125352286 0 0) 0x7f2a64155e10 con 0x7f2a640c30d0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a50003530 con 0x7f2a640c30d0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801931603 0 0) 0x7f2a50003530 con 0x7f2a640c30d0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 msgr2=0x7f2a640a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 0x7f2a640a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 >> v2:172.21.15.117:3300/0 conn(0x7f2a640c2bc0 msgr2=0x7f2a640c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/1151169700 >> v2:172.21.15.117:3300/0 conn(0x7f2a640c2bc0 0x7f2a640c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640a9e20 con 0x7f2a640c30d0 2024-05-08T20:42:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f2a54001680 con 0x7f2a640c30d0 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 >> v1:172.21.15.81:6789/0 conn(0x7f2a640c30d0 legacy=0x7f2a640c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a50003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a500047d0 0x7f2a50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 0x7f2a50005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6406e790 con 0x7f2a50003980 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5000b990 con 0x7f2a500047d0 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5000bad0 con 0x7f2a640a94b0 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a50003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 -- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 msgr2=0x7f2a50005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640a94b0 0x7f2a50005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 -- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a500047d0 msgr2=0x7f2a50004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a500047d0 0x7f2a50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.166+0000 7f2a6259c640 1 -- 172.21.15.81:0/1151169700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50003530 con 0x7f2a50003980 2024-05-08T20:42:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a50003da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c240 tx=0x7f2a5401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5976c352a249515c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540058e0 con 0x7f2a50003980 2024-05-08T20:42:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54005a40 con 0x7f2a50003980 2024-05-08T20:42:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a61d9b640 1 -- 172.21.15.81:0/1151169700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54005df0 con 0x7f2a50003980 2024-05-08T20:42:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 -- 172.21.15.81:0/1151169700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 msgr2=0x7f2a50003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 --2- 172.21.15.81:0/1151169700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a50003da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c240 tx=0x7f2a5401cc10 comp rx=0 tx=0).stop 2024-05-08T20:42:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a62d9d640 1 -- 172.21.15.81:0/1151169700 reap_dead start 2024-05-08T20:42:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 -- 172.21.15.81:0/1151169700 shutdown_connections 2024-05-08T20:42:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 -- 172.21.15.81:0/1151169700 >> 172.21.15.81:0/1151169700 conn(0x7f2a640c4cc0 msgr2=0x7f2a640c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 -- 172.21.15.81:0/1151169700 shutdown_connections 2024-05-08T20:42:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.170+0000 7f2a688d4640 1 -- 172.21.15.81:0/1151169700 wait complete. 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 Processor -- start 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- start start 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a640c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640adda0 0x7f2a64148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a640c26d0 0x7f2a64149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ad250 con 0x7f2a50003980 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640abfa0 con 0x7f2a640c26d0 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64159c90 con 0x7f2a640adda0 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a640c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a640c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59434/0 (socket says 172.21.15.81:59434) 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 -- 172.21.15.81:0/1054812253 learned_addr learned my addr 172.21.15.81:0/1054812253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640adda0 0x7f2a64148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a640c26d0 0x7f2a64149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640adda0 msgr2=0x7f2a64148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a640adda0 0x7f2a64148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a640c26d0 msgr2=0x7f2a64149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a640c26d0 0x7f2a64149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640ac1f0 con 0x7f2a50003980 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a6259c640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a640c7060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c240 tx=0x7f2a50005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54001c80 con 0x7f2a50003980 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a54005dd0 con 0x7f2a50003980 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54001660 con 0x7f2a50003980 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640ac4d0 con 0x7f2a50003980 2024-05-08T20:42:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a640c7b00 con 0x7f2a50003980 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 0x7f2a641eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ac380 con 0x7f2a640ac6c0 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 0x7f2a641eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a59d9b640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a640c4970 con 0x7f2a640ac6c0 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.174+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 0x7f2a641eb100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2ff0 tx=0x7f2a4c011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a54007070 con 0x7f2a50003980 2024-05-08T20:42:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a44066690 0x7f2a44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2a5411dec0 con 0x7f2a50003980 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c004230 con 0x7f2a640ac6c0 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a44066690 0x7f2a44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2a4c004390 con 0x7f2a640ac6c0 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 msgr2=0x7f2a641eb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 0x7f2a641eb100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2ff0 tx=0x7f2a4c011990 comp rx=0 tx=0).stop 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 msgr2=0x7f2a641eb100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a5b7fe640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a640ac6c0 0x7f2a641eb100 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.178+0000 7f2a62d9d640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a44066690 0x7f2a44068b50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2fa0 tx=0x7f2a5c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a688d4640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 0x7f2a641ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64073ea0 con 0x7f2a641eb640 2024-05-08T20:42:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 0x7f2a641ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a59d9b640 1 -- 172.21.15.81:0/1054812253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2a641eadf0 con 0x7f2a641eb640 2024-05-08T20:42:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a59d9b640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 0x7f2a641ee3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2ff0 tx=0x7f2a4c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c024070 con 0x7f2a641eb640 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7f2a4c003830 con 0x7f2a641eb640 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 msgr2=0x7f2a641ee3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 0x7f2a641ee3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2ff0 tx=0x7f2a4c009190 comp rx=0 tx=0).stop 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 msgr2=0x7f2a641ee3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.186+0000 7f2a5b7fe640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a641eb640 0x7f2a641ee3e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:42:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:46.205 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a44066690 msgr2=0x7f2a44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2a44066690 0x7f2a44068b50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c2fa0 tx=0x7f2a5c00d040 comp rx=0 tx=0).stop 2024-05-08T20:42:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 msgr2=0x7f2a640c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 --2- 172.21.15.81:0/1054812253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a50003980 0x7f2a640c7060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c240 tx=0x7f2a50005800 comp rx=0 tx=0).stop 2024-05-08T20:42:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a62d9d640 1 -- 172.21.15.81:0/1054812253 reap_dead start 2024-05-08T20:42:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a62d9d640 1 -- 172.21.15.81:0/1054812253 reap_dead start 2024-05-08T20:42:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 shutdown_connections 2024-05-08T20:42:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 >> 172.21.15.81:0/1054812253 conn(0x7f2a640c4cc0 msgr2=0x7f2a6414c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 shutdown_connections 2024-05-08T20:42:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.190+0000 7f2a688d4640 1 -- 172.21.15.81:0/1054812253 wait complete. 2024-05-08T20:42:46.210 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:46.210 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:42:46.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:42:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 Processor -- start 2024-05-08T20:42:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 -- start start 2024-05-08T20:42:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7fc069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc152ab0 con 0x7ff7fc14fe70 2024-05-08T20:42:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc152d90 con 0x7ff7fc06a500 2024-05-08T20:42:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff8027ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1528a0 con 0x7ff7fc155e90 2024-05-08T20:42:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7fc14fe70 0x7ff7fc06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35572/0 (socket says 172.21.15.81:35572) 2024-05-08T20:42:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3473823971 learned_addr learned my addr 172.21.15.81:0/3473823971 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080759077 0 0) 0x7ff7fc152ab0 con 0x7ff7fc14fe70 2024-05-08T20:42:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7fc069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e4003530 con 0x7ff7fc14fe70 2024-05-08T20:42:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454174524 0 0) 0x7ff7e4003530 con 0x7ff7fc14fe70 2024-05-08T20:42:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 msgr2=0x7ff7fc069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7fc069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 >> v1:172.21.15.117:6789/0 conn(0x7ff7fc06a500 legacy=0x7ff7fc15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc153070 con 0x7ff7fc14fe70 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff7ec001680 con 0x7ff7fc14fe70 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 >> v1:172.21.15.81:6789/0 conn(0x7ff7fc14fe70 legacy=0x7ff7fc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e40047d0 0x7ff7e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7e4005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1528a0 con 0x7ff7e40039b0 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e400ff60 con 0x7ff7e40047d0 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4010120 con 0x7ff7fc155e90 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e40047d0 0x7ff7e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 msgr2=0x7ff7e4005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff800d67640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7e4005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc155e90 0x7ff7e4005260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e40047d0 msgr2=0x7ff7e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e40047d0 0x7ff7e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3473823971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4003530 con 0x7ff7e40039b0 2024-05-08T20:42:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.342+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7e40047d0 0x7ff7e4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7e4003dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c240 tx=0x7ff7ec01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0815ad676e5bac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec005ae0 con 0x7ff7e40039b0 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec005c60 con 0x7ff7e40039b0 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff7faffd640 1 -- 172.21.15.81:0/3473823971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0a5820 con 0x7ff7e40039b0 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 -- 172.21.15.81:0/3473823971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 msgr2=0x7ff7e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 --2- 172.21.15.81:0/3473823971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7e4003dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c240 tx=0x7ff7ec01cc30 comp rx=0 tx=0).stop 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff800d67640 1 -- 172.21.15.81:0/3473823971 reap_dead start 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 -- 172.21.15.81:0/3473823971 shutdown_connections 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 -- 172.21.15.81:0/3473823971 >> 172.21.15.81:0/3473823971 conn(0x7ff7fc0c71b0 msgr2=0x7ff7fc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 -- 172.21.15.81:0/3473823971 shutdown_connections 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 -- 172.21.15.81:0/3473823971 wait complete. 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.346+0000 7ff8027ca640 1 Processor -- start 2024-05-08T20:42:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- start start 2024-05-08T20:42:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7fc148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc147ea0 0x7ff7fc14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1ed150 0x7ff7fc1ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc146930 con 0x7ff7e40039b0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1edaf0 con 0x7ff7fc1ed150 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1e95b0 con 0x7ff7fc147ea0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7fc148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7fc148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59454/0 (socket says 172.21.15.81:59454) 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3923667648 learned_addr learned my addr 172.21.15.81:0/3923667648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff800d67640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1ed150 0x7ff7fc1ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc147ea0 0x7ff7fc14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc147ea0 msgr2=0x7ff7fc14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7fc147ea0 0x7ff7fc14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1ed150 msgr2=0x7ff7fc1ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1ed150 0x7ff7fc1ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc154ef0 con 0x7ff7e40039b0 2024-05-08T20:42:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fbfff640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7fc148350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec001940 tx=0x7ff7e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0b4070 con 0x7ff7e40039b0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec000ee0 con 0x7ff7e40039b0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec001680 con 0x7ff7e40039b0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc1551d0 con 0x7ff7e40039b0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc155790 con 0x7ff7e40039b0 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 0x7ff7fc1e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc069550 con 0x7ff7fc1e9a90 2024-05-08T20:42:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 0x7ff7fc1e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7fc06dd10 con 0x7ff7fc1e9a90 2024-05-08T20:42:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7ec0a5820 con 0x7ff7e40039b0 2024-05-08T20:42:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.350+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 0x7ff7fc1e9e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0012810 tx=0x7ff7f0012cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e8066690 0x7ff7e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff7ec11dea0 con 0x7ff7e40039b0 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff800d67640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e8066690 0x7ff7e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0010a40 con 0x7ff7fc1e9a90 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff800d67640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e8066690 0x7ff7e8068b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc072920 tx=0x7ff7f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff7f0010ba0 con 0x7ff7fc1e9a90 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 msgr2=0x7ff7fc1e9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 0x7ff7fc1e9e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0012810 tx=0x7ff7f0012cd0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 msgr2=0x7ff7fc1e9e90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.354+0000 7ff7f8ff9640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1e9a90 0x7ff7fc1e9e90 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0012810 tx=0x7ff7f0012cd0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 0x7ff7fc14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0675e0 con 0x7ff7fc14ad20 2024-05-08T20:42:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 0x7ff7fc14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3923667648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff7fc074950 con 0x7ff7fc14ad20 2024-05-08T20:42:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7fb7fe640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 0x7ff7fc14b130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7f001d000 tx=0x7ff7f0004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0025070 con 0x7ff7fc14ad20 2024-05-08T20:42:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7ff7f0006520 con 0x7ff7fc14ad20 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 msgr2=0x7ff7fc14b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 0x7ff7fc14b130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7f001d000 tx=0x7ff7f0004740 comp rx=0 tx=0).stop 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 msgr2=0x7ff7fc14b130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff7f8ff9640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc14ad20 0x7ff7fc14b130 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff7f001d000 tx=0x7ff7f0004740 comp rx=0 tx=0).stop 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:46.366 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.368 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:42:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:46.378 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e8066690 msgr2=0x7ff7e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e8066690 0x7ff7e8068b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc072920 tx=0x7ff7f4009040 comp rx=0 tx=0).stop 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 msgr2=0x7ff7fc148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 --2- 172.21.15.81:0/3923667648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7e40039b0 0x7ff7fc148350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec001940 tx=0x7ff7e4005800 comp rx=0 tx=0).stop 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff800d67640 1 -- 172.21.15.81:0/3923667648 reap_dead start 2024-05-08T20:42:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff800d67640 1 -- 172.21.15.81:0/3923667648 reap_dead start 2024-05-08T20:42:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 shutdown_connections 2024-05-08T20:42:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 >> 172.21.15.81:0/3923667648 conn(0x7ff7fc0c71b0 msgr2=0x7ff7fc156270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 shutdown_connections 2024-05-08T20:42:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.362+0000 7ff8027ca640 1 -- 172.21.15.81:0/3923667648 wait complete. 2024-05-08T20:42:46.382 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:46.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:42:46.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:42:46.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.498+0000 7fbfb247a640 1 Processor -- start 2024-05-08T20:42:46.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.498+0000 7fbfb247a640 1 -- start start 2024-05-08T20:42:46.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb247a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbfac0c2570 0x7fbfac154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb247a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbfac1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb247a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac158080 con 0x7fbfac152340 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb247a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac06ab70 con 0x7fbfac0c2570 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb247a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac154b10 con 0x7fbfac0c34e0 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbfac152340 0x7fbfac06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35582/0 (socket says 172.21.15.81:35582) 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 -- 172.21.15.81:0/2612010216 learned_addr learned my addr 172.21.15.81:0/2612010216 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbfac1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfab7fe640 1 --2- 172.21.15.81:0/2612010216 >> v2:172.21.15.117:3300/0 conn(0x7fbfac0c2570 0x7fbfac154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169015384 0 0) 0x7fbfac158080 con 0x7fbfac152340 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003530 con 0x7fbfac152340 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786725203 0 0) 0x7fbf94003530 con 0x7fbfac152340 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 msgr2=0x7fbfac1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbfac1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 >> v2:172.21.15.117:3300/0 conn(0x7fbfac0c2570 msgr2=0x7fbfac154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 --2- 172.21.15.81:0/2612010216 >> v2:172.21.15.117:3300/0 conn(0x7fbfac0c2570 0x7fbfac154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac06a890 con 0x7fbfac152340 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fbf9c001680 con 0x7fbfac152340 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 >> v1:172.21.15.81:6789/0 conn(0x7fbfac152340 legacy=0x7fbfac06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf94003980 0x7fbf94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940047d0 0x7fbf94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbf94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac06ab70 con 0x7fbf94003980 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac154b10 con 0x7fbf940047d0 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9400b9c0 con 0x7fbfac0c34e0 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf94003980 0x7fbf94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbf94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 -- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 msgr2=0x7fbf94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfab7fe640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940047d0 0x7fbf94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbf94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 -- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940047d0 msgr2=0x7fbf94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:46.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940047d0 0x7fbf94004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfabfff640 1 -- 172.21.15.81:0/2612010216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94003530 con 0x7fbf94003980 2024-05-08T20:42:46.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.502+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac0c34e0 0x7fbf94005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfabfff640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf94003980 0x7fbf94003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c290 tx=0x7fbf9c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1fd818b6ccb589 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0058e0 con 0x7fbf94003980 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c005a40 con 0x7fbf94003980 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfaaffd640 1 -- 172.21.15.81:0/2612010216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c005df0 con 0x7fbf94003980 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- 172.21.15.81:0/2612010216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf94003980 msgr2=0x7fbf94003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 --2- 172.21.15.81:0/2612010216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf94003980 0x7fbf94003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c290 tx=0x7fbf9c01cc70 comp rx=0 tx=0).stop 2024-05-08T20:42:46.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb0a17640 1 -- 172.21.15.81:0/2612010216 reap_dead start 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- 172.21.15.81:0/2612010216 shutdown_connections 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- 172.21.15.81:0/2612010216 >> 172.21.15.81:0/2612010216 conn(0x7fbfac0c71b0 msgr2=0x7fbfac0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- 172.21.15.81:0/2612010216 shutdown_connections 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- 172.21.15.81:0/2612010216 wait complete. 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 Processor -- start 2024-05-08T20:42:46.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.506+0000 7fbfb247a640 1 -- start start 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf94003980 0x7fbfac13e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfac13daa0 0x7fbfac1ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac14fac0 con 0x7fbfac1ed910 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1ecbf0 con 0x7fbfac13daa0 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac13f9f0 con 0x7fbf94003980 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59472/0 (socket says 172.21.15.81:59472) 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 -- 172.21.15.81:0/1177166954 learned_addr learned my addr 172.21.15.81:0/1177166954 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfabfff640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf94003980 0x7fbfac13e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfab7fe640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfac13daa0 0x7fbfac1ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf94003980 msgr2=0x7fbfac13e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf94003980 0x7fbfac13e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfac13daa0 msgr2=0x7fbfac1ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfac13daa0 0x7fbfac1ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac13fcd0 con 0x7fbfac1ed910 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb0a17640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ad520 tx=0x7fbfa400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4017400 con 0x7fbfac1ed910 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4011040 con 0x7fbfac1ed910 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40177c0 con 0x7fbfac1ed910 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac13ffb0 con 0x7fbfac1ed910 2024-05-08T20:42:46.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac142d90 con 0x7fbfac1ed910 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 0x7fbfac1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac13de80 con 0x7fbfac144170 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfabfff640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 0x7fbfac1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.510+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfa40203b0 con 0x7fbfac1ed910 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfabfff640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfac06a4b0 con 0x7fbfac144170 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf98066690 0x7fbf98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbfa4084800 con 0x7fbfac1ed910 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfab7fe640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf98066690 0x7fbf98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfabfff640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 0x7fbfac1496a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c001060 tx=0x7fbf94005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0b4070 con 0x7fbfac144170 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfab7fe640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf98066690 0x7fbf98068b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfac13dfc0 tx=0x7fbfa0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbf9c005bb0 con 0x7fbfac144170 2024-05-08T20:42:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 msgr2=0x7fbfac1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 0x7fbfac1496a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c001060 tx=0x7fbf94005800 comp rx=0 tx=0).stop 2024-05-08T20:42:46.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 msgr2=0x7fbfac1496a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.514+0000 7fbfa8ff9640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac144170 0x7fbfac1496a0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c001060 tx=0x7fbf94005800 comp rx=0 tx=0).stop 2024-05-08T20:42:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.522+0000 7fbfb247a640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 0x7fbfac1f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.522+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac13fe60 con 0x7fbfac149be0 2024-05-08T20:42:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.522+0000 7fbfabfff640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 0x7fbfac1f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.522+0000 7fbfabfff640 1 -- 172.21.15.81:0/1177166954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbfac0675e0 con 0x7fbfac149be0 2024-05-08T20:42:46.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfabfff640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 0x7fbfac1f0160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0728d0 tx=0x7fbf9c0a7070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c007520 con 0x7fbfac149be0 2024-05-08T20:42:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fbf9c007680 con 0x7fbfac149be0 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 msgr2=0x7fbfac1f0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 0x7fbfac1f0160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0728d0 tx=0x7fbf9c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 msgr2=0x7fbfac1f0160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfa8ff9640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbfac149be0 0x7fbfac1f0160 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0728d0 tx=0x7fbf9c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 120, 2024-05-08T20:42:46.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.531 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:42:46.532 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:42:46.533 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:42:46.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:42:46.540 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf98066690 msgr2=0x7fbf98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf98066690 0x7fbf98068b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfac13dfc0 tx=0x7fbfa0008040 comp rx=0 tx=0).stop 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 msgr2=0x7fbfac143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ad520 tx=0x7fbfa400f4a0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb0a17640 1 -- 172.21.15.81:0/1177166954 reap_dead start 2024-05-08T20:42:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 shutdown_connections 2024-05-08T20:42:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 --2- 172.21.15.81:0/1177166954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfac1ed910 0x7fbfac143c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 >> 172.21.15.81:0/1177166954 conn(0x7fbfac0c71b0 msgr2=0x7fbfac0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 shutdown_connections 2024-05-08T20:42:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.526+0000 7fbfb247a640 1 -- 172.21.15.81:0/1177166954 wait complete. 2024-05-08T20:42:46.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:42:46.547 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:42:46.547 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:42:46.547 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:42:46.547 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:42:46.547 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:42:46.548 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:42:46.565 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:42:46.565 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:42:46.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 Processor -- start 2024-05-08T20:42:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 -- start start 2024-05-08T20:42:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff098069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff09806a500 0x7ff09815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff098152ab0 con 0x7ff09814fe70 2024-05-08T20:42:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0981528a0 con 0x7ff09806a500 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff09d787640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff098152d90 con 0x7ff098155e90 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0967fc640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 msgr2=0x7ff098069fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0967fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff098069fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff09806a500 0x7ff09815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff09806a500 0x7ff09815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:50794/0 (socket says 172.21.15.81:50794) 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 -- 172.21.15.81:0/2891920877 learned_addr learned my addr 172.21.15.81:0/2891920877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 -- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 msgr2=0x7ff098069fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 --2- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff098069fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 -- 172.21.15.81:0/2891920877 >> v1:172.21.15.117:6789/0 conn(0x7ff09814fe70 legacy=0x7ff09806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.678+0000 7ff0977fe640 1 -- 172.21.15.81:0/2891920877 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098153070 con 0x7ff09806a500 2024-05-08T20:42:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff0977fe640 1 --2- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09806a500 0x7ff09815d220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff090009e50 tx=0x7ff09001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1d599fb15a3bb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff095ffb640 1 -- 172.21.15.81:0/2891920877 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a57c0 con 0x7ff09806a500 2024-05-08T20:42:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff095ffb640 1 -- 172.21.15.81:0/2891920877 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0900a5920 con 0x7ff09806a500 2024-05-08T20:42:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff095ffb640 1 -- 172.21.15.81:0/2891920877 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a5cb0 con 0x7ff09806a500 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09806a500 msgr2=0x7ff09815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09806a500 0x7ff09815d220 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff090009e50 tx=0x7ff09001c900 comp rx=0 tx=0).stop 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- 172.21.15.81:0/2891920877 shutdown_connections 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09806a500 0x7ff09815d220 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- 172.21.15.81:0/2891920877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff098069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- 172.21.15.81:0/2891920877 >> 172.21.15.81:0/2891920877 conn(0x7ff0980c71b0 msgr2=0x7ff0980c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- 172.21.15.81:0/2891920877 shutdown_connections 2024-05-08T20:42:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- 172.21.15.81:0/2891920877 wait complete. 2024-05-08T20:42:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 Processor -- start 2024-05-08T20:42:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- start start 2024-05-08T20:42:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09814fe70 0x7ff0981f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff0981f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0981414f0 con 0x7ff09806a500 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0981f0c70 con 0x7ff09814fe70 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.682+0000 7ff09d787640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff098142de0 con 0x7ff098155e90 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff0977fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 msgr2=0x7ff0981f1640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff0977fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff0981f1640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff0967fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09814fe70 0x7ff0981f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59488/0 (socket says 172.21.15.81:59488) 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 -- 172.21.15.81:0/3984797460 learned_addr learned my addr 172.21.15.81:0/3984797460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 -- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 msgr2=0x7ff0981f1640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff0981f1640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 -- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09814fe70 msgr2=0x7ff0981f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09814fe70 0x7ff0981f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 -- 172.21.15.81:0/3984797460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009b30 con 0x7ff09806a500 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff096ffd640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c3a0 tx=0x7ff08c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0052d0 con 0x7ff09806a500 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c005430 con 0x7ff09806a500 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007260 con 0x7ff09806a500 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0981430c0 con 0x7ff09806a500 2024-05-08T20:42:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff098149b20 con 0x7ff09806a500 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0980675e0 con 0x7ff09806a500 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff08c0073c0 con 0x7ff09806a500 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.686+0000 7ff07f7fe640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 0x7ff084068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.690+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff08c0837b0 con 0x7ff09806a500 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.690+0000 7ff0967fc640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 0x7ff084068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.690+0000 7ff0967fc640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 0x7ff084068b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff0880093d0 tx=0x7ff088009360 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.694+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff08c0508c0 con 0x7ff09806a500 2024-05-08T20:42:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff098074950 con 0x7ff09806a500 2024-05-08T20:42:46.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff07f7fe640 1 -- 172.21.15.81:0/3984797460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7ff08c053ee0 con 0x7ff09806a500 2024-05-08T20:42:46.973 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 msgr2=0x7ff084068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 0x7ff084068b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff0880093d0 tx=0x7ff088009360 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 msgr2=0x7ff0981495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00c3a0 tx=0x7ff08c00c860 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 shutdown_connections 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff084066640 0x7ff084068b00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff098155e90 0x7ff0981f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff09814fe70 0x7ff0981f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 --2- 172.21.15.81:0/3984797460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09806a500 0x7ff0981495e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 >> 172.21.15.81:0/3984797460 conn(0x7ff0980c71b0 msgr2=0x7ff0980c2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 shutdown_connections 2024-05-08T20:42:46.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:46.970+0000 7ff09d787640 1 -- 172.21.15.81:0/3984797460 wait complete. 2024-05-08T20:42:49.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 Processor -- start 2024-05-08T20:42:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 -- start start 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f05dc151740 0x7f05dc0c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc155060 con 0x7f05dc1535a0 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc155340 con 0x7f05dc0c1bb0 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e2f27640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc155620 con 0x7f05dc151740 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f05dc1535a0 0x7f05dc15c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38330/0 (socket says 172.21.15.81:38330) 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 -- 172.21.15.81:0/3069492447 learned_addr learned my addr 172.21.15.81:0/3069492447 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05dbfff640 1 --2- 172.21.15.81:0/3069492447 >> v2:172.21.15.117:3300/0 conn(0x7f05dc151740 0x7f05dc0c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773326322 0 0) 0x7f05dc155060 con 0x7f05dc1535a0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05cc003530 con 0x7f05dc1535a0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99259857 0 0) 0x7f05cc003530 con 0x7f05dc1535a0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 >> v2:172.21.15.117:3300/0 conn(0x7f05dc151740 msgr2=0x7f05dc0c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 --2- 172.21.15.81:0/3069492447 >> v2:172.21.15.117:3300/0 conn(0x7f05dc151740 0x7f05dc0c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 >> v1:172.21.15.117:6789/0 conn(0x7f05dc0c1bb0 legacy=0x7f05dc152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc155900 con 0x7f05dc1535a0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f05d4001a00 con 0x7f05dc1535a0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 >> v1:172.21.15.81:6789/0 conn(0x7f05dc1535a0 legacy=0x7f05dc15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc003980 0x7f05cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0047d0 0x7f05cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 0x7f05cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc155620 con 0x7f05cc005190 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc00bed0 con 0x7f05cc0047d0 2024-05-08T20:42:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc00c090 con 0x7f05cc003980 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e0cc3640 1 -- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc003980 msgr2=0x7f05cc003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e0cc3640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc003980 0x7f05cc003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 0x7f05cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05dbfff640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0047d0 0x7f05cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 -- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc003980 msgr2=0x7f05cc003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05cc003980 0x7f05cc003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 -- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0047d0 msgr2=0x7f05cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0047d0 0x7f05cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05e14c4640 1 -- 172.21.15.81:0/3069492447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc003530 con 0x7f05cc005190 2024-05-08T20:42:50.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.129+0000 7f05dbfff640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc0047d0 0x7f05cc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:42:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e14c4640 1 -- 172.21.15.81:0/3069492447 reap_dead start 2024-05-08T20:42:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e14c4640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 0x7f05cc00b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f05d400a830 tx=0x7f05d401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35957e047cb37510 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40aa6f0 con 0x7f05cc005190 2024-05-08T20:42:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40aa890 con 0x7f05cc005190 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05db7fe640 1 -- 172.21.15.81:0/3069492447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40aac40 con 0x7f05cc005190 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 msgr2=0x7f05cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 0x7f05cc00b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f05d400a830 tx=0x7f05d401fac0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- 172.21.15.81:0/3069492447 shutdown_connections 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 --2- 172.21.15.81:0/3069492447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05cc005190 0x7f05cc00b990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- 172.21.15.81:0/3069492447 >> 172.21.15.81:0/3069492447 conn(0x7f05dc0c2ca0 msgr2=0x7f05dc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- 172.21.15.81:0/3069492447 shutdown_connections 2024-05-08T20:42:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- 172.21.15.81:0/3069492447 wait complete. 2024-05-08T20:42:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 Processor -- start 2024-05-08T20:42:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.133+0000 7f05e2f27640 1 -- start start 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc005190 0x7f05dc150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 0x7f05dc14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc1e9cb0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc14af40 con 0x7f05cc005190 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc06cf20 con 0x7f05dc14a550 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e14c4640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 msgr2=0x7f05dc14aa00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e14c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 0x7f05dc14aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48674/0 (socket says 172.21.15.81:48674) 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 -- 172.21.15.81:0/2365278654 learned_addr learned my addr 172.21.15.81:0/2365278654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:50.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e0cc3640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc005190 0x7f05dc150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 -- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 msgr2=0x7f05dc14aa00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 0x7f05dc14aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 -- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc005190 msgr2=0x7f05dc150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc005190 0x7f05dc150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 -- 172.21.15.81:0/2365278654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc1e9030 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05dbfff640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f05c8010890 tx=0x7f05c8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8004220 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8004380 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800eba0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc1e9310 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc1e98d0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc1e9a90 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05c800ed00 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.137+0000 7f05d97fa640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 0x7f05c0068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.141+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f05c80841a0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.141+0000 7f05e0cc3640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 0x7f05c0068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.141+0000 7f05e0cc3640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 0x7f05c0068b30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f05d0007fd0 tx=0x7f05d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:50.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.145+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f05c80512b0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.417+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f05dc074950 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.417+0000 7f05d97fa640 1 -- 172.21.15.81:0/2365278654 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f05c80044f0 con 0x7f05dc0bbbd0 2024-05-08T20:42:50.422 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 msgr2=0x7f05c0068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 0x7f05c0068b30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f05d0007fd0 tx=0x7f05d0009040 comp rx=0 tx=0).stop 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 msgr2=0x7f05dc0ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f05c8010890 tx=0x7f05c8010d50 comp rx=0 tx=0).stop 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 shutdown_connections 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f05c0066670 0x7f05c0068b30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f05dc14a550 0x7f05dc14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05dc0bbbd0 0x7f05dc0ab140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 --2- 172.21.15.81:0/2365278654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05cc005190 0x7f05dc150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:50.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 >> 172.21.15.81:0/2365278654 conn(0x7f05dc0c2ca0 msgr2=0x7f05dc152300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:50.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 shutdown_connections 2024-05-08T20:42:50.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:50.421+0000 7f05e2f27640 1 -- 172.21.15.81:0/2365278654 wait complete. 2024-05-08T20:42:53.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:53.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 Processor -- start 2024-05-08T20:42:53.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 -- start start 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95d006b840 0x7f95d00c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d014e830 con 0x7f95d0154340 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d006d6a0 con 0x7f95d0155070 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d6eba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d0151900 con 0x7f95d006b840 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95cffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95d006b840 0x7f95d00c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d5457640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f95d0154340 0x7f95d015b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38332/0 (socket says 172.21.15.81:38332) 2024-05-08T20:42:53.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95d5457640 1 -- 172.21.15.81:0/2884638834 learned_addr learned my addr 172.21.15.81:0/2884638834 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95cffff640 1 -- 172.21.15.81:0/2884638834 >> v1:172.21.15.117:6789/0 conn(0x7f95d0155070 legacy=0x7f95d00c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95cffff640 1 -- 172.21.15.81:0/2884638834 >> v1:172.21.15.81:6789/0 conn(0x7f95d0154340 legacy=0x7f95d015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.569+0000 7f95cffff640 1 -- 172.21.15.81:0/2884638834 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0151be0 con 0x7f95d006b840 2024-05-08T20:42:53.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95cffff640 1 --2- 172.21.15.81:0/2884638834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d00c3350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097c0 tx=0x7f95bc01e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b697319826c020 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:53.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95cf7fe640 1 -- 172.21.15.81:0/2884638834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0ab630 con 0x7f95d006b840 2024-05-08T20:42:53.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95cf7fe640 1 -- 172.21.15.81:0/2884638834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc0ab790 con 0x7f95d006b840 2024-05-08T20:42:53.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95cf7fe640 1 -- 172.21.15.81:0/2884638834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0abb20 con 0x7f95d006b840 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95d6eba640 1 -- 172.21.15.81:0/2884638834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 msgr2=0x7f95d00c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.573+0000 7f95d6eba640 1 --2- 172.21.15.81:0/2884638834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d00c3350 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097c0 tx=0x7f95bc01e6b0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/2884638834 shutdown_connections 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 --2- 172.21.15.81:0/2884638834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d00c3350 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/2884638834 >> 172.21.15.81:0/2884638834 conn(0x7f95d00c68c0 msgr2=0x7f95d00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/2884638834 shutdown_connections 2024-05-08T20:42:53.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/2884638834 wait complete. 2024-05-08T20:42:53.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 Processor -- start 2024-05-08T20:42:53.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- start start 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 0x7f95d0148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d0155070 0x7f95d01502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0149170 con 0x7f95d006b840 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00a8220 con 0x7f95d0155070 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00a8500 con 0x7f95d0154340 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95cffff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 msgr2=0x7f95d0148730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:53.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95cffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 0x7f95d0148730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48696/0 (socket says 172.21.15.81:48696) 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 -- 172.21.15.81:0/149603005 learned_addr learned my addr 172.21.15.81:0/149603005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 -- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 msgr2=0x7f95d0148730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 0x7f95d0148730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 -- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d0155070 msgr2=0x7f95d01502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d0155070 0x7f95d01502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 -- 172.21.15.81:0/149603005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009420 con 0x7f95d006b840 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d4c56640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c3c0 tx=0x7f95c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40052d0 con 0x7f95d006b840 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c4005430 con 0x7f95d006b840 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4003840 con 0x7f95d006b840 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d00a87e0 con 0x7f95d006b840 2024-05-08T20:42:53.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.577+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d0147130 con 0x7f95d006b840 2024-05-08T20:42:53.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d00a67a0 con 0x7f95d006b840 2024-05-08T20:42:53.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95c40039a0 con 0x7f95d006b840 2024-05-08T20:42:53.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95cd7fa640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 0x7f95b4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:53.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95cffff640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 0x7f95b4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:53.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f95c4083ae0 con 0x7f95d006b840 2024-05-08T20:42:53.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.581+0000 7f95cffff640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 0x7f95b4068b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0b0000 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:42:53.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.585+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f95d00a67a0 con 0x7f95d006b840 2024-05-08T20:42:53.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:42:53.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:42:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.853+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f95d00a67a0 con 0x7f95d006b840 2024-05-08T20:42:53.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.853+0000 7f95cd7fa640 1 -- 172.21.15.81:0/149603005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f95c4017620 con 0x7f95d006b840 2024-05-08T20:42:53.859 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 msgr2=0x7f95b4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 0x7f95b4068b00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0b0000 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 msgr2=0x7f95d01e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c3c0 tx=0x7f95c400c880 comp rx=0 tx=0).stop 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 shutdown_connections 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f95b4066640 0x7f95b4068b00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d0155070 0x7f95d01502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95d0154340 0x7f95d0148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 --2- 172.21.15.81:0/149603005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d006b840 0x7f95d01e9fd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:42:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 >> 172.21.15.81:0/149603005 conn(0x7f95d00c68c0 msgr2=0x7f95d0145e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:42:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 shutdown_connections 2024-05-08T20:42:53.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:53.857+0000 7f95d6eba640 1 -- 172.21.15.81:0/149603005 wait complete. 2024-05-08T20:42:56.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:42:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.005+0000 7f22e0429640 1 Processor -- start 2024-05-08T20:42:57.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.005+0000 7f22e0429640 1 -- start start 2024-05-08T20:42:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22e0429640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:42:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22e0429640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d80c3a50 con 0x7f22d806b230 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22e0429640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d80705e0 con 0x7f22d8070c00 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22e0429640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d80c2c70 con 0x7f22d80c2800 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de1c5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22d806b230 0x7f22d814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38336/0 (socket says 172.21.15.81:38336) 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 learned_addr learned my addr 172.21.15.81:0/2615361633 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.009+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:42:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.213+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.213+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:42:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.213+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.213+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:57.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.213+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:42:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.617+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.617+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:42:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.617+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.617+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:57.617+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:42:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:58.421+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:42:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:58.421+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:42:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:58.421+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:42:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:58.421+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:42:58.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:42:58.421+0000 7f22de9c6640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:43:00.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 msgr2=0x7f22d81520e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.81:3300/0 conn(0x7f22d80c2800 0x7f22d81520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 -- 172.21.15.81:0/2615361633 >> v1:172.21.15.117:6789/0 conn(0x7f22d8070c00 legacy=0x7f22d81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 -- 172.21.15.81:0/2615361633 >> v1:172.21.15.81:6789/0 conn(0x7f22d806b230 legacy=0x7f22d814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 -- 172.21.15.81:0/2615361633 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d80c2c70 con 0x7f22bc0036d0 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22cffff640 1 -- 172.21.15.81:0/2615361633 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc008d40 con 0x7f22bc006170 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22dd9c4640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 msgr2=0x7f22bc008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:00.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:00.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:00.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:43:00.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:00.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:00.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.009+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:00.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22dd9c4640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 msgr2=0x7f22bc008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:00.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.213+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22dd9c4640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 msgr2=0x7f22bc008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:00.617+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22dd9c4640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 msgr2=0x7f22bc008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:43:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> v2:172.21.15.117:3300/0 conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 msgr2=0x7f22bc008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22bc006170 0x7f22bc008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.421+0000 7f22de1c5640 1 -- 172.21.15.81:0/2615361633 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d80708c0 con 0x7f22bc0036d0 2024-05-08T20:43:01.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.425+0000 7f22de1c5640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22bc0036d0 0x7f22bc005b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007d30 tx=0x7f22d401caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcffd484cbb6f0a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.425+0000 7f22dd1c3640 1 -- 172.21.15.81:0/2615361633 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a58c0 con 0x7f22bc0036d0 2024-05-08T20:43:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22dd1c3640 1 -- 172.21.15.81:0/2615361633 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a9070 con 0x7f22bc0036d0 2024-05-08T20:43:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22dd1c3640 1 -- 172.21.15.81:0/2615361633 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5c20 con 0x7f22bc0036d0 2024-05-08T20:43:01.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 -- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22bc0036d0 msgr2=0x7f22bc005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22bc0036d0 0x7f22bc005b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007d30 tx=0x7f22d401caf0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22de9c6640 1 -- 172.21.15.81:0/2615361633 reap_dead start 2024-05-08T20:43:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 -- 172.21.15.81:0/2615361633 shutdown_connections 2024-05-08T20:43:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 --2- 172.21.15.81:0/2615361633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22bc0036d0 0x7f22bc005b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 -- 172.21.15.81:0/2615361633 >> 172.21.15.81:0/2615361633 conn(0x7f22d80c71b0 msgr2=0x7f22d80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 -- 172.21.15.81:0/2615361633 shutdown_connections 2024-05-08T20:43:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.429+0000 7f22e0429640 1 -- 172.21.15.81:0/2615361633 wait complete. 2024-05-08T20:43:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 Processor -- start 2024-05-08T20:43:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 -- start start 2024-05-08T20:43:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 0x7f22d8140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d81498f0 0x7f22d814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22dd9c4640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 msgr2=0x7f22d8140440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22dd9c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 0x7f22d8140440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d815cf10 con 0x7f22bc0036d0 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51372/0 (socket says 172.21.15.81:51372) 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 -- 172.21.15.81:0/3872857974 learned_addr learned my addr 172.21.15.81:0/3872857974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:01.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8141380 con 0x7f22d81498f0 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81410e0 con 0x7f22d8144fc0 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de9c6640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d81498f0 0x7f22d814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 -- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 msgr2=0x7f22d8140440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 0x7f22d8140440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 -- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d81498f0 msgr2=0x7f22d814f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d81498f0 0x7f22d814f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d400f040 con 0x7f22bc0036d0 2024-05-08T20:43:01.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22de1c5640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22d401b1a0 tx=0x7f22d4019890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5980 con 0x7f22bc0036d0 2024-05-08T20:43:01.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d813f960 con 0x7f22bc0036d0 2024-05-08T20:43:01.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a5ae0 con 0x7f22bc0036d0 2024-05-08T20:43:01.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.433+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5e50 con 0x7f22bc0036d0 2024-05-08T20:43:01.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d813ff20 con 0x7f22bc0036d0 2024-05-08T20:43:01.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d80675e0 con 0x7f22bc0036d0 2024-05-08T20:43:01.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f22d4004fa0 con 0x7f22bc0036d0 2024-05-08T20:43:01.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22ceffd640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 0x7f22bc069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f22d411eee0 con 0x7f22bc0036d0 2024-05-08T20:43:01.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 0x7f22bc069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.437+0000 7f22dd9c4640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 0x7f22bc069850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22c8007fd0 tx=0x7f22c8007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.445+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f22d40ec060 con 0x7f22bc0036d0 2024-05-08T20:43:01.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.701+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f22d8074950 con 0x7f22bc0036d0 2024-05-08T20:43:01.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22ceffd640 1 -- 172.21.15.81:0/3872857974 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f22d40ab080 con 0x7f22bc0036d0 2024-05-08T20:43:01.708 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":124,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:01.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 msgr2=0x7f22bc069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 0x7f22bc069850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22c8007fd0 tx=0x7f22c8007960 comp rx=0 tx=0).stop 2024-05-08T20:43:01.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 msgr2=0x7f22d8142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22d401b1a0 tx=0x7f22d4019890 comp rx=0 tx=0).stop 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 shutdown_connections 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f22bc067390 0x7f22bc069850 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d81498f0 0x7f22d814f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22d8144fc0 0x7f22d8140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 --2- 172.21.15.81:0/3872857974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22bc0036d0 0x7f22d8142cf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 >> 172.21.15.81:0/3872857974 conn(0x7f22d80c71b0 msgr2=0x7f22d8148480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 shutdown_connections 2024-05-08T20:43:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.705+0000 7f22e0429640 1 -- 172.21.15.81:0/3872857974 wait complete. 2024-05-08T20:43:01.728 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:43:01.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:43:01.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:43:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 Processor -- start 2024-05-08T20:43:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 -- start start 2024-05-08T20:43:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65800c26e0 0x7f65801555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 0x7f65800c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6580155140 con 0x7f6580152220 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65800c4780 con 0x7f65800c26e0 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f6585496640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65800c32d0 con 0x7f65800aac30 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65800c26e0 0x7f65801555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657f7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 msgr2=0x7f65800c15f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 0x7f65800c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65800c26e0 0x7f65801555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51388/0 (socket says 172.21.15.81:51388) 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 -- 172.21.15.81:0/3783219903 learned_addr learned my addr 172.21.15.81:0/3783219903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 -- 172.21.15.81:0/3783219903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 msgr2=0x7f65800c15f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 --2- 172.21.15.81:0/3783219903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 0x7f65800c15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 -- 172.21.15.81:0/3783219903 >> v1:172.21.15.117:6789/0 conn(0x7f6580152220 legacy=0x7f65800c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:01.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.841+0000 7f657e7fc640 1 -- 172.21.15.81:0/3783219903 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580072650 con 0x7f65800c26e0 2024-05-08T20:43:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f657e7fc640 1 --2- 172.21.15.81:0/3783219903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c26e0 0x7f65801555d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6574009870 tx=0x7f657401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d477c4a6b46697f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f657dffb640 1 -- 172.21.15.81:0/3783219903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740ab640 con 0x7f65800c26e0 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f657dffb640 1 -- 172.21.15.81:0/3783219903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65740a7070 con 0x7f65800c26e0 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f657dffb640 1 -- 172.21.15.81:0/3783219903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740ab9c0 con 0x7f65800c26e0 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- 172.21.15.81:0/3783219903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c26e0 msgr2=0x7f65801555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 --2- 172.21.15.81:0/3783219903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c26e0 0x7f65801555d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6574009870 tx=0x7f657401c480 comp rx=0 tx=0).stop 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- 172.21.15.81:0/3783219903 shutdown_connections 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 --2- 172.21.15.81:0/3783219903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800aac30 0x7f65800c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 --2- 172.21.15.81:0/3783219903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c26e0 0x7f65801555d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- 172.21.15.81:0/3783219903 >> 172.21.15.81:0/3783219903 conn(0x7f65800c4cc0 msgr2=0x7f65800c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- 172.21.15.81:0/3783219903 shutdown_connections 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- 172.21.15.81:0/3783219903 wait complete. 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 Processor -- start 2024-05-08T20:43:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.845+0000 7f6585496640 1 -- start start 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65800aac30 0x7f658014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800c26e0 0x7f65801ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 0x7f65801565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580155e20 con 0x7f6580152220 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658014c600 con 0x7f65800aac30 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658014c8e0 con 0x7f65800c26e0 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657e7fc640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800c26e0 msgr2=0x7f65801ed230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657e7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800c26e0 0x7f65801ed230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 0x7f65801565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 0x7f65801565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51390/0 (socket says 172.21.15.81:51390) 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 learned_addr learned my addr 172.21.15.81:0/970104479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657effd640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65800aac30 0x7f658014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800c26e0 msgr2=0x7f65801ed230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65800c26e0 0x7f65801ed230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65800aac30 msgr2=0x7f658014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65800aac30 0x7f658014eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740094d0 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657f7fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 0x7f65801565e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f657800b760 tx=0x7f657800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657800c960 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65801560c0 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657800cac0 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578015470 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6580156b20 con 0x7f6580152220 2024-05-08T20:43:01.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 0x7f65801511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580073ea0 con 0x7f65800c7d00 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657effd640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 0x7f65801511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657effd640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6580158e60 con 0x7f65800c7d00 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657effd640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 0x7f65801511a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f657000e4d0 tx=0x7f657000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570007240 con 0x7f65800c7d00 2024-05-08T20:43:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6578012070 con 0x7f6580152220 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f656c066730 0x7f656c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f65780843b0 con 0x7f6580152220 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.849+0000 7f657e7fc640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f656c066730 0x7f656c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f65700073a0 con 0x7f65800c7d00 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 msgr2=0x7f65801511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f65677fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 0x7f65801511a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f657000e4d0 tx=0x7f657000e990 comp rx=0 tx=0).stop 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 msgr2=0x7f65801511a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:01.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f65677fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65800c7d00 0x7f65801511a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:01.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.853+0000 7f657e7fc640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f656c066730 0x7f656c068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f6574008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.857+0000 7f6585496640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 0x7f65801487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:01.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.857+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580155f60 con 0x7f658014caa0 2024-05-08T20:43:01.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.857+0000 7f657effd640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 0x7f65801487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:01.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.857+0000 7f657effd640 1 -- 172.21.15.81:0/970104479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6580156300 con 0x7f658014caa0 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.857+0000 7f657effd640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 0x7f65801487e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f657000e4d0 tx=0x7f6570003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657001ec60 con 0x7f658014caa0 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f657001edc0 con 0x7f658014caa0 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 msgr2=0x7f65801487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 0x7f65801487e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f657000e4d0 tx=0x7f6570003770 comp rx=0 tx=0).stop 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 msgr2=0x7f65801487e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f65677fe640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f658014caa0 0x7f65801487e0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f657000e4d0 tx=0x7f6570003770 comp rx=0 tx=0).stop 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 124, 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:43:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:01.886 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f656c066730 msgr2=0x7f656c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f656c066730 0x7f656c068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f6574008040 comp rx=0 tx=0).stop 2024-05-08T20:43:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 msgr2=0x7f65801565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 --2- 172.21.15.81:0/970104479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6580152220 0x7f65801565e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f657800b760 tx=0x7f657800bc20 comp rx=0 tx=0).stop 2024-05-08T20:43:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 reap_dead start 2024-05-08T20:43:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f657f7fe640 1 -- 172.21.15.81:0/970104479 reap_dead start 2024-05-08T20:43:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 shutdown_connections 2024-05-08T20:43:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 >> 172.21.15.81:0/970104479 conn(0x7f65800c4cc0 msgr2=0x7f65800c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 shutdown_connections 2024-05-08T20:43:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:01.861+0000 7f6585496640 1 -- 172.21.15.81:0/970104479 wait complete. 2024-05-08T20:43:01.890 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:43:01.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:43:01.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:43:02.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.013+0000 7f638f8aa640 1 Processor -- start 2024-05-08T20:43:02.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.013+0000 7f638f8aa640 1 -- start start 2024-05-08T20:43:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638f8aa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 0x7f63880c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638f8aa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63880c2570 0x7f63880c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638f8aa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63881520a0 con 0x7f638814f1a0 2024-05-08T20:43:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638f8aa640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880c2f20 con 0x7f63880c2570 2024-05-08T20:43:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638f8aa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c13e0 con 0x7f638806c250 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638ce45640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 msgr2=0x7f63880c1940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638ce45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 0x7f63880c1940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63880c2570 0x7f63880c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63880c2570 0x7f63880c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51416/0 (socket says 172.21.15.81:51416) 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 -- 172.21.15.81:0/3017873862 learned_addr learned my addr 172.21.15.81:0/3017873862 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 -- 172.21.15.81:0/3017873862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 msgr2=0x7f63880c1940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 --2- 172.21.15.81:0/3017873862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 0x7f63880c1940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 -- 172.21.15.81:0/3017873862 >> v1:172.21.15.117:6789/0 conn(0x7f638814f1a0 legacy=0x7f63880c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 -- 172.21.15.81:0/3017873862 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63881517d0 con 0x7f63880c2570 2024-05-08T20:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f638de47640 1 --2- 172.21.15.81:0/3017873862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63880c2570 0x7f63880c29e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6380009e50 tx=0x7f638001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c230bbf29246c347 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f637ffff640 1 -- 172.21.15.81:0/3017873862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800a5680 con 0x7f63880c2570 2024-05-08T20:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f637ffff640 1 -- 172.21.15.81:0/3017873862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63800a57e0 con 0x7f63880c2570 2024-05-08T20:43:02.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.017+0000 7f637ffff640 1 -- 172.21.15.81:0/3017873862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800a5b70 con 0x7f63880c2570 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/3017873862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63880c2570 msgr2=0x7f63880c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- 172.21.15.81:0/3017873862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63880c2570 0x7f63880c29e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6380009e50 tx=0x7f638001c9c0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/3017873862 shutdown_connections 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- 172.21.15.81:0/3017873862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63880c2570 0x7f63880c29e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- 172.21.15.81:0/3017873862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638806c250 0x7f63880c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/3017873862 >> 172.21.15.81:0/3017873862 conn(0x7f63880c68c0 msgr2=0x7f63880c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/3017873862 shutdown_connections 2024-05-08T20:43:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/3017873862 wait complete. 2024-05-08T20:43:02.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 Processor -- start 2024-05-08T20:43:02.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- start start 2024-05-08T20:43:02.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638806c250 0x7f6388146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63880c2570 0x7f6388152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 0x7f63881552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388072190 con 0x7f638814f1a0 2024-05-08T20:43:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880723e0 con 0x7f638806c250 2024-05-08T20:43:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880726c0 con 0x7f63880c2570 2024-05-08T20:43:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638ce45640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63880c2570 msgr2=0x7f6388152d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638ce45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63880c2570 0x7f6388152d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 0x7f63881552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 0x7f63881552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51418/0 (socket says 172.21.15.81:51418) 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 learned_addr learned my addr 172.21.15.81:0/2806433238 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638d646640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638806c250 0x7f6388146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63880c2570 msgr2=0x7f6388152d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63880c2570 0x7f6388152d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638806c250 msgr2=0x7f6388146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638806c250 0x7f6388146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009b30 con 0x7f638814f1a0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638de47640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 0x7f63881552a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f638001a5f0 tx=0x7f6380019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800b8670 con 0x7f638814f1a0 2024-05-08T20:43:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63800b87d0 con 0x7f638814f1a0 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6388153550 con 0x7f638814f1a0 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800b8b40 con 0x7f638814f1a0 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.021+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388153b10 con 0x7f638814f1a0 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638f8aa640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 0x7f63881557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63881e8810 con 0x7f638814c990 2024-05-08T20:43:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638d646640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 0x7f63881557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63800b8ca0 con 0x7f638814f1a0 2024-05-08T20:43:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638d646640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6388066050 con 0x7f638814c990 2024-05-08T20:43:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f636c066670 0x7f636c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f638011f530 con 0x7f638814f1a0 2024-05-08T20:43:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638ce45640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f636c066670 0x7f636c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638d646640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 0x7f63881557e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f638400e4d0 tx=0x7f638400e990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63840052e0 con 0x7f638814c990 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f638ce45640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f636c066670 0x7f636c068b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6388151a20 tx=0x7f6378006d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6384005440 con 0x7f638814c990 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 msgr2=0x7f63881557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 0x7f63881557e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f638400e4d0 tx=0x7f638400e990 comp rx=0 tx=0).stop 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 msgr2=0x7f63881557e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.025+0000 7f637dffb640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638814c990 0x7f63881557e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 0x7f63881e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6388069550 con 0x7f63881e89c0 2024-05-08T20:43:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638d646640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 0x7f63881e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638d646640 1 -- 172.21.15.81:0/2806433238 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6388153d00 con 0x7f63881e89c0 2024-05-08T20:43:02.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638d646640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 0x7f63881e8dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f638400e4d0 tx=0x7f6384001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384021070 con 0x7f63881e89c0 2024-05-08T20:43:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f6384006d40 con 0x7f63881e89c0 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 msgr2=0x7f63881e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 0x7f63881e8dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f638400e4d0 tx=0x7f6384001130 comp rx=0 tx=0).stop 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 msgr2=0x7f63881e8dd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f637dffb640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63881e89c0 0x7f63881e8dd0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f638400e4d0 tx=0x7f6384001130 comp rx=0 tx=0).stop 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 124, 2024-05-08T20:43:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:02.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:02.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f636c066670 msgr2=0x7f636c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f636c066670 0x7f636c068b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6388151a20 tx=0x7f6378006d90 comp rx=0 tx=0).stop 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 msgr2=0x7f63881552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 --2- 172.21.15.81:0/2806433238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638814f1a0 0x7f63881552a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f638001a5f0 tx=0x7f6380019760 comp rx=0 tx=0).stop 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 reap_dead start 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638de47640 1 -- 172.21.15.81:0/2806433238 reap_dead start 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 shutdown_connections 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 >> 172.21.15.81:0/2806433238 conn(0x7f63880c68c0 msgr2=0x7f638814dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 shutdown_connections 2024-05-08T20:43:02.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:02.037+0000 7f638f8aa640 1 -- 172.21.15.81:0/2806433238 wait complete. 2024-05-08T20:43:02.060 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:43:02.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:43:22.061 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:43:22.061 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:43:22.061 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:43:22.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:43:22.065 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:43:22.065 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:43:22.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:22.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 Processor -- start 2024-05-08T20:43:22.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 -- start start 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb27c070c00 0x7fb27c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0c3a50 con 0x7fb27c06b230 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c072940 con 0x7fb27c070c00 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb282a30640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0705e0 con 0x7fb27c1519d0 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb27c070c00 0x7fb27c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb27c070c00 0x7fb27c0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33524/0 (socket says 172.21.15.81:33524) 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 -- 172.21.15.81:0/100834589 learned_addr learned my addr 172.21.15.81:0/100834589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb280fcd640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb280fcd640 1 -- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 msgr2=0x7fb27c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb280fcd640 1 -- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 msgr2=0x7fb27c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb280fcd640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb280fcd640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 -- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 msgr2=0x7fb27c151e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 -- 172.21.15.81:0/100834589 >> v1:172.21.15.117:6789/0 conn(0x7fb27c06b230 legacy=0x7fb27c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb273fff640 1 -- 172.21.15.81:0/100834589 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0708c0 con 0x7fb27c070c00 2024-05-08T20:43:22.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.201+0000 7fb27b7fe640 1 -- 172.21.15.81:0/100834589 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894789278 0 0) 0x7fb27c0c3a50 con 0x7fb27c06b230 2024-05-08T20:43:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb273fff640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c0c2800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed2c41c0349d505 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb27b7fe640 1 -- 172.21.15.81:0/100834589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640aa430 con 0x7fb27c070c00 2024-05-08T20:43:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb27b7fe640 1 -- 172.21.15.81:0/100834589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2640aa590 con 0x7fb27c070c00 2024-05-08T20:43:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb27b7fe640 1 -- 172.21.15.81:0/100834589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640aa920 con 0x7fb27c070c00 2024-05-08T20:43:22.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- 172.21.15.81:0/100834589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 msgr2=0x7fb27c0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:22.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c0c2800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb264009870 tx=0x7fb26401c4d0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- 172.21.15.81:0/100834589 shutdown_connections 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c1519d0 0x7fb27c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 --2- 172.21.15.81:0/100834589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c0c2800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- 172.21.15.81:0/100834589 >> 172.21.15.81:0/100834589 conn(0x7fb27c0c71b0 msgr2=0x7fb27c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- 172.21.15.81:0/100834589 shutdown_connections 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- 172.21.15.81:0/100834589 wait complete. 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 Processor -- start 2024-05-08T20:43:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.205+0000 7fb282a30640 1 -- start start 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c1519d0 0x7fb27c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c148160 con 0x7fb27c070c00 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1ed8d0 con 0x7fb27c1519d0 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1edb20 con 0x7fb27c06b230 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33528/0 (socket says 172.21.15.81:33528) 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 -- 172.21.15.81:0/712367878 learned_addr learned my addr 172.21.15.81:0/712367878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb280fcd640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c1519d0 0x7fb27c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 msgr2=0x7fb27c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 msgr2=0x7fb27c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 msgr2=0x7fb27c0c66f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c1519d0 msgr2=0x7fb27c13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c1519d0 0x7fb27c13ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 -- 172.21.15.81:0/712367878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640094d0 con 0x7fb27c070c00 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb273fff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb26401a100 tx=0x7fb26401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264004020 con 0x7fb27c070c00 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2640b7070 con 0x7fb27c070c00 2024-05-08T20:43:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c1ede00 con 0x7fb27c070c00 2024-05-08T20:43:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640043a0 con 0x7fb27c070c00 2024-05-08T20:43:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c1ee3c0 con 0x7fb27c070c00 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c0675e0 con 0x7fb27c070c00 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb264003620 con 0x7fb27c070c00 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 0x7fb25c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb26411e5b0 con 0x7fb27c070c00 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.209+0000 7fb27bfff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 0x7fb25c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.213+0000 7fb27bfff640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 0x7fb25c068b80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb26c000f70 tx=0x7fb26c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.217+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb2640eb6b0 con 0x7fb27c070c00 2024-05-08T20:43:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.509+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb27c074950 con 0x7fb27c070c00 2024-05-08T20:43:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.509+0000 7fb2797fa640 1 -- 172.21.15.81:0/712367878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fb2640c2620 con 0x7fb27c070c00 2024-05-08T20:43:22.511 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":124,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 msgr2=0x7fb25c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 0x7fb25c068b80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb26c000f70 tx=0x7fb26c009040 comp rx=0 tx=0).stop 2024-05-08T20:43:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 msgr2=0x7fb27c13e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb26401a100 tx=0x7fb26401ad10 comp rx=0 tx=0).stop 2024-05-08T20:43:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 shutdown_connections 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb25c0666c0 0x7fb25c068b80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c1519d0 0x7fb27c13ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27c070c00 0x7fb27c13e510 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 --2- 172.21.15.81:0/712367878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c06b230 0x7fb27c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 >> 172.21.15.81:0/712367878 conn(0x7fb27c0c71b0 msgr2=0x7fb27c1502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 shutdown_connections 2024-05-08T20:43:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:22.513+0000 7fb282a30640 1 -- 172.21.15.81:0/712367878 wait complete. 2024-05-08T20:43:23.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:43:23.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:43:25.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 Processor -- start 2024-05-08T20:43:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 -- start start 2024-05-08T20:43:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb481520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480c3a50 con 0x7feb4806b230 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480705e0 con 0x7feb48070c00 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4eabe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c2c70 con 0x7feb480c2800 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4c85a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb4806b230 0x7feb4814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51354/0 (socket says 172.21.15.81:51354) 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4c85a640 1 -- 172.21.15.81:0/3011185305 learned_addr learned my addr 172.21.15.81:0/3011185305 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4d05b640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb481520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066412270 0 0) 0x7feb480c3a50 con 0x7feb4806b230 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb30005740 con 0x7feb4806b230 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4d05b640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 msgr2=0x7feb481520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4d05b640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 msgr2=0x7feb481520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4d05b640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb481520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb4d05b640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb481520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 865997381 0 0) 0x7feb30005740 con 0x7feb4806b230 2024-05-08T20:43:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 msgr2=0x7feb481520e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb481520e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 >> v1:172.21.15.117:6789/0 conn(0x7feb48070c00 legacy=0x7feb481519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480708c0 con 0x7feb4806b230 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7feb40001a00 con 0x7feb4806b230 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 >> v1:172.21.15.81:6789/0 conn(0x7feb4806b230 legacy=0x7feb4814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb30005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb300069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.677+0000 7feb477fe640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30006f20 0x7feb300073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c2c70 con 0x7feb300061f0 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3000dde0 con 0x7feb30006f20 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3000dfa0 con 0x7feb480c2800 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb300069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4c85a640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb30005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4d05b640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30006f20 0x7feb300073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 msgr2=0x7feb30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c2800 0x7feb30005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30006f20 msgr2=0x7feb300073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb30006f20 0x7feb300073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 -- 172.21.15.81:0/3011185305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30005740 con 0x7feb300061f0 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb47fff640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb300069e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00e950 tx=0x7feb3c020730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3a9166155796eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00e2d0 con 0x7feb300061f0 2024-05-08T20:43:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0050d0 con 0x7feb300061f0 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb477fe640 1 -- 172.21.15.81:0/3011185305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c005480 con 0x7feb300061f0 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 -- 172.21.15.81:0/3011185305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 msgr2=0x7feb300069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 --2- 172.21.15.81:0/3011185305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb300069e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00e950 tx=0x7feb3c020730 comp rx=0 tx=0).stop 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4d05b640 1 -- 172.21.15.81:0/3011185305 reap_dead start 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 -- 172.21.15.81:0/3011185305 shutdown_connections 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 -- 172.21.15.81:0/3011185305 >> 172.21.15.81:0/3011185305 conn(0x7feb480c71b0 msgr2=0x7feb480c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 -- 172.21.15.81:0/3011185305 shutdown_connections 2024-05-08T20:43:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.681+0000 7feb4eabe640 1 -- 172.21.15.81:0/3011185305 wait complete. 2024-05-08T20:43:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 Processor -- start 2024-05-08T20:43:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- start start 2024-05-08T20:43:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c57b0 0x7feb481551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 0x7feb48140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb48152c90 con 0x7feb300061f0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb48152f70 con 0x7feb481556e0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb48153250 con 0x7feb480c57b0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33550/0 (socket says 172.21.15.81:33550) 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 -- 172.21.15.81:0/1624988830 learned_addr learned my addr 172.21.15.81:0/1624988830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4d05b640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 0x7feb48140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb47fff640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c57b0 0x7feb481551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 -- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c57b0 msgr2=0x7feb481551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c57b0 0x7feb481551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 -- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 msgr2=0x7feb48140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 0x7feb48140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 -- 172.21.15.81:0/1624988830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48153530 con 0x7feb300061f0 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4d05b640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 0x7feb48140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4c85a640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb400079f0 tx=0x7feb4000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000ee50 con 0x7feb300061f0 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40013420 con 0x7feb300061f0 2024-05-08T20:43:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb48154c80 con 0x7feb300061f0 2024-05-08T20:43:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400137d0 con 0x7feb300061f0 2024-05-08T20:43:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.685+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb48145cc0 con 0x7feb300061f0 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480675e0 con 0x7feb300061f0 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb40013930 con 0x7feb300061f0 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb457fa640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 0x7feb34068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7feb40084c20 con 0x7feb300061f0 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb47fff640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 0x7feb34068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.689+0000 7feb47fff640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 0x7feb34068b80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0af000 tx=0x7feb3c0011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.693+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7feb40051c80 con 0x7feb300061f0 2024-05-08T20:43:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.945+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feb48155ac0 con 0x7feb300061f0 2024-05-08T20:43:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.945+0000 7feb457fa640 1 -- 172.21.15.81:0/1624988830 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7feb400552a0 con 0x7feb300061f0 2024-05-08T20:43:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":124,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 msgr2=0x7feb34068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 0x7feb34068b80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0af000 tx=0x7feb3c0011a0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 msgr2=0x7feb48147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb400079f0 tx=0x7feb4000e530 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 shutdown_connections 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7feb340666c0 0x7feb34068b80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb481556e0 0x7feb48140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb480c57b0 0x7feb481551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 --2- 172.21.15.81:0/1624988830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb300061f0 0x7feb48147470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:25.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 >> 172.21.15.81:0/1624988830 conn(0x7feb480c71b0 msgr2=0x7feb480c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:25.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 shutdown_connections 2024-05-08T20:43:25.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:25.949+0000 7feb4eabe640 1 -- 172.21.15.81:0/1624988830 wait complete. 2024-05-08T20:43:28.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.088+0000 7f5b59991640 1 Processor -- start 2024-05-08T20:43:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.088+0000 7f5b59991640 1 -- start start 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59991640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b540aa420 0x7f5b5414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59991640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59991640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b540c1150 con 0x7f5b540a99c0 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59991640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54153460 con 0x7f5b540aa420 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59991640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540c2320 con 0x7f5b5414ff40 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b540aa420 0x7f5b5414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59190640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b540aa420 0x7f5b5414fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:40056/0 (socket says 172.21.15.81:40056) 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 -- 172.21.15.81:0/1252944010 learned_addr learned my addr 172.21.15.81:0/1252944010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b53fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5b540a99c0 0x7f5b54152810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:46280/0 (socket says 172.21.15.81:46280) 2024-05-08T20:43:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59190640 1 -- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 msgr2=0x7f5b54152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59190640 1 -- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 msgr2=0x7f5b54152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59190640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b59190640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 -- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 msgr2=0x7f5b54152f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 -- 172.21.15.81:0/1252944010 >> v1:172.21.15.117:6789/0 conn(0x7f5b540a99c0 legacy=0x7f5b54152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.092+0000 7f5b5898f640 1 -- 172.21.15.81:0/1252944010 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540c1e90 con 0x7f5b540aa420 2024-05-08T20:43:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b5414fa00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098a0 tx=0x7f5b4801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6aae1477ee329f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b537fe640 1 -- 172.21.15.81:0/1252944010 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480a8a30 con 0x7f5b540aa420 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b537fe640 1 -- 172.21.15.81:0/1252944010 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b480a8b90 con 0x7f5b540aa420 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b537fe640 1 -- 172.21.15.81:0/1252944010 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480b0440 con 0x7f5b540aa420 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 msgr2=0x7f5b5414fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b5414fa00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098a0 tx=0x7f5b4801ed30 comp rx=0 tx=0).stop 2024-05-08T20:43:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- 172.21.15.81:0/1252944010 shutdown_connections 2024-05-08T20:43:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b5414ff40 0x7f5b54152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- 172.21.15.81:0/1252944010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b5414fa00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- 172.21.15.81:0/1252944010 >> 172.21.15.81:0/1252944010 conn(0x7f5b540c3100 msgr2=0x7f5b540c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- 172.21.15.81:0/1252944010 shutdown_connections 2024-05-08T20:43:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- 172.21.15.81:0/1252944010 wait complete. 2024-05-08T20:43:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 Processor -- start 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- start start 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b541566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54155b90 con 0x7f5b5414ff40 2024-05-08T20:43:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54156c00 con 0x7f5b540aa420 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59991640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540c6410 con 0x7f5b540a99c0 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.096+0000 7f5b59190640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55530/0 (socket says 172.21.15.81:55530) 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 -- 172.21.15.81:0/1696324017 learned_addr learned my addr 172.21.15.81:0/1696324017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b53fff640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b541566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 msgr2=0x7f5b5414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:43:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 msgr2=0x7f5b5414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 msgr2=0x7f5b5414a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 msgr2=0x7f5b541566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b541566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 -- 172.21.15.81:0/1696324017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480094d0 con 0x7f5b5414ff40 2024-05-08T20:43:29.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59190640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c007e60 tx=0x7f5b4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c014620 con 0x7f5b5414ff40 2024-05-08T20:43:29.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c014780 con 0x7f5b5414ff40 2024-05-08T20:43:29.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c014b30 con 0x7f5b5414ff40 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b540bcd50 con 0x7f5b5414ff40 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b54153fe0 con 0x7f5b5414ff40 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5406de40 con 0x7f5b5414ff40 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b4c014c90 con 0x7f5b5414ff40 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 0x7f5b38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5b4c084e20 con 0x7f5b5414ff40 2024-05-08T20:43:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 0x7f5b38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.100+0000 7f5b5898f640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 0x7f5b38068b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b2000 tx=0x7f5b480aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.108+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5b4c051df0 con 0x7f5b5414ff40 2024-05-08T20:43:29.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.356+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5b540670c0 con 0x7f5b5414ff40 2024-05-08T20:43:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b517fa640 1 -- 172.21.15.81:0/1696324017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f5b4c055410 con 0x7f5b5414ff40 2024-05-08T20:43:29.360 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:29.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 msgr2=0x7f5b38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 0x7f5b38068b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b480b2000 tx=0x7f5b480aa070 comp rx=0 tx=0).stop 2024-05-08T20:43:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 msgr2=0x7f5b54154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c007e60 tx=0x7f5b4c00e4b0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 shutdown_connections 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5b38066690 0x7f5b38068b50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5414ff40 0x7f5b54154b10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b540aa420 0x7f5b541566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 --2- 172.21.15.81:0/1696324017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b540a99c0 0x7f5b5414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 >> 172.21.15.81:0/1696324017 conn(0x7f5b540c3100 msgr2=0x7f5b5414d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 shutdown_connections 2024-05-08T20:43:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.360+0000 7f5b59991640 1 -- 172.21.15.81:0/1696324017 wait complete. 2024-05-08T20:43:29.380 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:43:29.380 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:43:29.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:43:29.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 Processor -- start 2024-05-08T20:43:29.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 -- start start 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc06d130 0x7fa1fc0a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc155670 0x7fa1fc0bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0c1730 con 0x7fa1fc0c0230 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0c1a10 con 0x7fa1fc06d130 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa203729640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc154980 con 0x7fa1fc155670 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc06d130 0x7fa1fc0a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1fc06d130 0x7fa1fc0a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55540/0 (socket says 172.21.15.81:55540) 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 -- 172.21.15.81:0/402709633 learned_addr learned my addr 172.21.15.81:0/402709633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa200cc4640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc155670 0x7fa1fc0bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 -- 172.21.15.81:0/402709633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc155670 msgr2=0x7fa1fc0bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc155670 0x7fa1fc0bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 -- 172.21.15.81:0/402709633 >> v1:172.21.15.117:6789/0 conn(0x7fa1fc0c0230 legacy=0x7fa1fc0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.504+0000 7fa2014c5640 1 -- 172.21.15.81:0/402709633 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc154b90 con 0x7fa1fc06d130 2024-05-08T20:43:29.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa2014c5640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0a5e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009e50 tx=0x7fa1f401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac340a9068985bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa1f3fff640 1 -- 172.21.15.81:0/402709633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40a5700 con 0x7fa1fc06d130 2024-05-08T20:43:29.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa1f3fff640 1 -- 172.21.15.81:0/402709633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40a5860 con 0x7fa1fc06d130 2024-05-08T20:43:29.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa1f3fff640 1 -- 172.21.15.81:0/402709633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40a5bf0 con 0x7fa1fc06d130 2024-05-08T20:43:29.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- 172.21.15.81:0/402709633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc06d130 msgr2=0x7fa1fc0a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0a5e30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009e50 tx=0x7fa1f401ca30 comp rx=0 tx=0).stop 2024-05-08T20:43:29.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- 172.21.15.81:0/402709633 shutdown_connections 2024-05-08T20:43:29.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc155670 0x7fa1fc0bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- 172.21.15.81:0/402709633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0a5e30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- 172.21.15.81:0/402709633 >> 172.21.15.81:0/402709633 conn(0x7fa1fc0c68c0 msgr2=0x7fa1fc0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- 172.21.15.81:0/402709633 shutdown_connections 2024-05-08T20:43:29.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- 172.21.15.81:0/402709633 wait complete. 2024-05-08T20:43:29.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 Processor -- start 2024-05-08T20:43:29.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- start start 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 0x7fa1fc149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 0x7fa1fc147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0ab0c0 con 0x7fa1fc155670 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc14a840 con 0x7fa1fc06d130 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa203729640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0aae20 con 0x7fa1fc0c0230 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.508+0000 7fa201cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 0x7fa1fc147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 0x7fa1fc147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55544/0 (socket says 172.21.15.81:55544) 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 learned_addr learned my addr 172.21.15.81:0/1465335569 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa2014c5640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 0x7fa1fc149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 msgr2=0x7fa1fc149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:43:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 msgr2=0x7fa1fc149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 0x7fa1fc149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 0x7fa1fc149c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 msgr2=0x7fa1fc149c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1fc0c0230 0x7fa1fc149c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1fc06d130 msgr2=0x7fa1fc0ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1fc06d130 0x7fa1fc0ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009b30 con 0x7fa1fc155670 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa201cc6640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 0x7fa1fc147860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c310 tx=0x7fa1ec00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0052d0 con 0x7fa1fc155670 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec005430 con 0x7fa1fc155670 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc1f0d50 con 0x7fa1fc155670 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec003800 con 0x7fa1fc155670 2024-05-08T20:43:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc150f10 con 0x7fa1fc155670 2024-05-08T20:43:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa203729640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 0x7fa1fc0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc069550 con 0x7fa1fc147da0 2024-05-08T20:43:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa2014c5640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 0x7fa1fc0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa2014c5640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1fc148180 con 0x7fa1fc147da0 2024-05-08T20:43:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa2014c5640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 0x7fa1fc0a7ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0664e0 tx=0x7fa1f40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40c0630 con 0x7fa1fc147da0 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1ec003960 con 0x7fa1fc155670 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1e0066730 0x7fa1e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa1ec0838e0 con 0x7fa1fc155670 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa200cc4640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1e0066730 0x7fa1e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa1f40c07b0 con 0x7fa1fc147da0 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 msgr2=0x7fa1fc0a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 0x7fa1fc0a7ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0664e0 tx=0x7fa1f40197d0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 msgr2=0x7fa1fc0a7ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.512+0000 7fa1f1ffb640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc147da0 0x7fa1fc0a7ca0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.516+0000 7fa200cc4640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1e0066730 0x7fa1e0068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc14bb90 tx=0x7fa1f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 0x7fa1fc0a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc066170 con 0x7fa1fc0a81e0 2024-05-08T20:43:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa2014c5640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 0x7fa1fc0a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa2014c5640 1 -- 172.21.15.81:0/1465335569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1fc074950 con 0x7fa1fc0a81e0 2024-05-08T20:43:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa2014c5640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 0x7fa1fc0a9880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1f401b0e0 tx=0x7fa1f40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4004450 con 0x7fa1fc0a81e0 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fa1f40045b0 con 0x7fa1fc0a81e0 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 msgr2=0x7fa1fc0a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 0x7fa1fc0a9880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1f401b0e0 tx=0x7fa1f40a7000 comp rx=0 tx=0).stop 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 msgr2=0x7fa1fc0a9880 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa1f1ffb640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc0a81e0 0x7fa1fc0a9880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:43:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:29.540 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1e0066730 msgr2=0x7fa1e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa1e0066730 0x7fa1e0068bf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc14bb90 tx=0x7fa1f8008040 comp rx=0 tx=0).stop 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 msgr2=0x7fa1fc147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 --2- 172.21.15.81:0/1465335569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1fc155670 0x7fa1fc147860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c310 tx=0x7fa1ec00c7d0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 reap_dead start 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa201cc6640 1 -- 172.21.15.81:0/1465335569 reap_dead start 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 shutdown_connections 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 >> 172.21.15.81:0/1465335569 conn(0x7fa1fc0c68c0 msgr2=0x7fa1fc0c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 shutdown_connections 2024-05-08T20:43:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.524+0000 7fa203729640 1 -- 172.21.15.81:0/1465335569 wait complete. 2024-05-08T20:43:29.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:29.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:43:29.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:43:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 Processor -- start 2024-05-08T20:43:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 -- start start 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68580c6000 0x7f685815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68580c3730 0x7f68581636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6858066000 con 0x7f68580c3350 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685806d8a0 con 0x7f68580c3730 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685f703640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68581567d0 con 0x7f68580c6000 2024-05-08T20:43:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68580c3730 0x7f68581636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68580c3730 0x7f68581636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55586/0 (socket says 172.21.15.81:55586) 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 -- 172.21.15.81:0/3273870102 learned_addr learned my addr 172.21.15.81:0/3273870102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685cc9e640 1 --2- 172.21.15.81:0/3273870102 >> v2:172.21.15.117:3300/0 conn(0x7f68580c6000 0x7f685815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 -- 172.21.15.81:0/3273870102 >> v2:172.21.15.117:3300/0 conn(0x7f68580c6000 msgr2=0x7f685815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 --2- 172.21.15.81:0/3273870102 >> v2:172.21.15.117:3300/0 conn(0x7f68580c6000 0x7f685815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 -- 172.21.15.81:0/3273870102 >> v1:172.21.15.117:6789/0 conn(0x7f68580c3350 legacy=0x7f685815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.672+0000 7f685dca0640 1 -- 172.21.15.81:0/3273870102 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685806cb20 con 0x7f68580c3730 2024-05-08T20:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685dca0640 1 --2- 172.21.15.81:0/3273870102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3730 0x7f68581636e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68580c2410 tx=0x7f685001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa3069c1f825bb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f684ffff640 1 -- 172.21.15.81:0/3273870102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500a56d0 con 0x7f68580c3730 2024-05-08T20:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f684ffff640 1 -- 172.21.15.81:0/3273870102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500a5830 con 0x7f68580c3730 2024-05-08T20:43:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f684ffff640 1 -- 172.21.15.81:0/3273870102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500a5bc0 con 0x7f68580c3730 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- 172.21.15.81:0/3273870102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3730 msgr2=0x7f68581636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- 172.21.15.81:0/3273870102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3730 0x7f68581636e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68580c2410 tx=0x7f685001c920 comp rx=0 tx=0).stop 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- 172.21.15.81:0/3273870102 shutdown_connections 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- 172.21.15.81:0/3273870102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3730 0x7f68581636e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- 172.21.15.81:0/3273870102 >> v2:172.21.15.117:3300/0 conn(0x7f68580c6000 0x7f685815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- 172.21.15.81:0/3273870102 >> 172.21.15.81:0/3273870102 conn(0x7f68580c68c0 msgr2=0x7f68580c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- 172.21.15.81:0/3273870102 shutdown_connections 2024-05-08T20:43:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- 172.21.15.81:0/3273870102 wait complete. 2024-05-08T20:43:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 Processor -- start 2024-05-08T20:43:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- start start 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 0x7f6858155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c3730 0x7f685814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c6000 0x7f685814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685814b0e0 con 0x7f68580c3350 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858072790 con 0x7f68580c3730 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.676+0000 7f685f703640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580aa120 con 0x7f68580c6000 2024-05-08T20:43:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 0x7f6858155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 0x7f6858155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55594/0 (socket says 172.21.15.81:55594) 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 -- 172.21.15.81:0/1926997429 learned_addr learned my addr 172.21.15.81:0/1926997429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685cc9e640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c3730 0x7f685814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685dca0640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c6000 0x7f685814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c6000 msgr2=0x7f685814aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c6000 0x7f685814aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c3730 msgr2=0x7f685814a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c3730 0x7f685814a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009b30 con 0x7f68580c3350 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685d49f640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 0x7f6858155260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f685400c450 tx=0x7f685400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854012830 con 0x7f68580c3350 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68540129b0 con 0x7f68580c3350 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580aa6a0 con 0x7f68580c3350 2024-05-08T20:43:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854012d60 con 0x7f68580c3350 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68580aa3c0 con 0x7f68580c3350 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685f703640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 0x7f68581519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6858069550 con 0x7f68581538b0 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685cc9e640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 0x7f68581519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f685401c460 con 0x7f68580c3350 2024-05-08T20:43:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685cc9e640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68580a65e0 con 0x7f68581538b0 2024-05-08T20:43:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f683c066690 0x7f683c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6854084330 con 0x7f68580c3350 2024-05-08T20:43:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685dca0640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f683c066690 0x7f683c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685cc9e640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 0x7f68581519a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68580c7150 tx=0x7f684800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848004030 con 0x7f68581538b0 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.680+0000 7f685dca0640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f683c066690 0x7f683c068b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f68500ae000 tx=0x7f68500a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.684+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6848004190 con 0x7f68581538b0 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.684+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 msgr2=0x7f68581519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.684+0000 7f684dffb640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 0x7f68581519a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68580c7150 tx=0x7f684800ec00 comp rx=0 tx=0).stop 2024-05-08T20:43:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.684+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 msgr2=0x7f68581519a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:29.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.684+0000 7f684dffb640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68581538b0 0x7f68581519a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 0x7f685814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580aa260 con 0x7f68580ab850 2024-05-08T20:43:29.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685cc9e640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 0x7f685814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685cc9e640 1 -- 172.21.15.81:0/1926997429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f68580c5d60 con 0x7f68580ab850 2024-05-08T20:43:29.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685cc9e640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 0x7f685814e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68580c7150 tx=0x7f68480046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684801f7d0 con 0x7f68580ab850 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f6848003620 con 0x7f68580ab850 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 msgr2=0x7f685814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 0x7f685814e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68580c7150 tx=0x7f68480046d0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 msgr2=0x7f685814e1d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f684dffb640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580ab850 0x7f685814e1d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.694 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:29.709 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f683c066690 msgr2=0x7f683c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f683c066690 0x7f683c068b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f68500ae000 tx=0x7f68500a7070 comp rx=0 tx=0).stop 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 msgr2=0x7f6858155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 --2- 172.21.15.81:0/1926997429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68580c3350 0x7f6858155260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f685400c450 tx=0x7f685400c910 comp rx=0 tx=0).stop 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685dca0640 1 -- 172.21.15.81:0/1926997429 reap_dead start 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685dca0640 1 -- 172.21.15.81:0/1926997429 reap_dead start 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 shutdown_connections 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 >> 172.21.15.81:0/1926997429 conn(0x7f68580c68c0 msgr2=0x7f685814dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 shutdown_connections 2024-05-08T20:43:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.692+0000 7f685f703640 1 -- 172.21.15.81:0/1926997429 wait complete. 2024-05-08T20:43:29.712 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:29.712 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:43:29.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:43:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 Processor -- start 2024-05-08T20:43:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 -- start start 2024-05-08T20:43:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe640c2bc0 0x7efe640c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe64155e10 con 0x7efe640c30d0 2024-05-08T20:43:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6406e790 con 0x7efe640c2bc0 2024-05-08T20:43:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe68a09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6406f460 con 0x7efe640a94b0 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe6259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe640c30d0 0x7efe640c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56822/0 (socket says 172.21.15.81:56822) 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe6259c640 1 -- 172.21.15.81:0/647263141 learned_addr learned my addr 172.21.15.81:0/647263141 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe5bfff640 1 --2- 172.21.15.81:0/647263141 >> v2:172.21.15.81:3300/0 conn(0x7efe640c2bc0 0x7efe640c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.828+0000 7efe62d9d640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe61d9b640 1 -- 172.21.15.81:0/647263141 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648840571 0 0) 0x7efe64155e10 con 0x7efe640c30d0 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe62d9d640 1 -- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 msgr2=0x7efe640a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe62d9d640 1 -- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 msgr2=0x7efe640a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe62d9d640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe61d9b640 1 -- 172.21.15.81:0/647263141 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe50003530 con 0x7efe640c30d0 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe62d9d640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe5bfff640 1 -- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 msgr2=0x7efe640a98e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe5bfff640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe5bfff640 1 -- 172.21.15.81:0/647263141 >> v1:172.21.15.81:6789/0 conn(0x7efe640c30d0 legacy=0x7efe640c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe5bfff640 1 -- 172.21.15.81:0/647263141 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640a9e20 con 0x7efe640c2bc0 2024-05-08T20:43:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe5bfff640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c2bc0 0x7efe640c34b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0097c0 tx=0x7efe4c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6bd5ab39865d2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe61d9b640 1 -- 172.21.15.81:0/647263141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0ac640 con 0x7efe640c2bc0 2024-05-08T20:43:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe61d9b640 1 -- 172.21.15.81:0/647263141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c0ac7a0 con 0x7efe640c2bc0 2024-05-08T20:43:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe61d9b640 1 -- 172.21.15.81:0/647263141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0acb30 con 0x7efe640c2bc0 2024-05-08T20:43:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 -- 172.21.15.81:0/647263141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c2bc0 msgr2=0x7efe640c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c2bc0 0x7efe640c34b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0097c0 tx=0x7efe4c01c3e0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 -- 172.21.15.81:0/647263141 shutdown_connections 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640a94b0 0x7efe640a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 --2- 172.21.15.81:0/647263141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c2bc0 0x7efe640c34b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 -- 172.21.15.81:0/647263141 >> 172.21.15.81:0/647263141 conn(0x7efe640c4cc0 msgr2=0x7efe640c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 -- 172.21.15.81:0/647263141 shutdown_connections 2024-05-08T20:43:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.832+0000 7efe68a09640 1 -- 172.21.15.81:0/647263141 wait complete. 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 Processor -- start 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- start start 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640a94b0 0x7efe6414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 0x7efe64148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 0x7efe641493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe641ebf40 con 0x7efe640c30d0 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64149920 con 0x7efe640a94b0 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe641ee4c0 con 0x7efe640c2bc0 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 0x7efe641493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 0x7efe641493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55612/0 (socket says 172.21.15.81:55612) 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 learned_addr learned my addr 172.21.15.81:0/3102402848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640a94b0 0x7efe6414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5bfff640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 0x7efe64148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5bfff640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 msgr2=0x7efe64148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5bfff640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 msgr2=0x7efe64148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5bfff640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 0x7efe64148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5bfff640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 0x7efe64148ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 msgr2=0x7efe64148ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c2bc0 0x7efe64148ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640a94b0 msgr2=0x7efe6414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640a94b0 0x7efe6414ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c009420 con 0x7efe640c30d0 2024-05-08T20:43:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe62d9d640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 0x7efe641493e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe5c007e30 tx=0x7efe5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c014420 con 0x7efe640c30d0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c0145a0 con 0x7efe640c30d0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c014950 con 0x7efe640c30d0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe641ee7a0 con 0x7efe640c30d0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe641eed60 con 0x7efe640c30d0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe641ef490 con 0x7efe641eaf50 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:43:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.836+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.840+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe5c014ab0 con 0x7efe640c30d0 2024-05-08T20:43:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.840+0000 7efe5affd640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efe440666c0 0x7efe44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.840+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7efe5c084d90 con 0x7efe640c30d0 2024-05-08T20:43:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.840+0000 7efe5bfff640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efe440666c0 0x7efe44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:29.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:29.840+0000 7efe5bfff640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efe440666c0 0x7efe44068b80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ae000 tx=0x7efe4c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.040+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.040+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:43:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.040+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.040+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.040+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.444+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.444+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:43:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.444+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.444+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:30.444+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:31.248+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:31.248+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:43:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:31.248+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:43:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:31.248+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:31.248+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:43:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe640c4970 con 0x7efe641eaf50 2024-05-08T20:43:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe54000f70 tx=0x7efe54017a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54018770 con 0x7efe641eaf50 2024-05-08T20:43:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7efe540188d0 con 0x7efe641eaf50 2024-05-08T20:43:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe54000f70 tx=0x7efe54017a90 comp rx=0 tx=0).stop 2024-05-08T20:43:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 msgr2=0x7efe641eef50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.852+0000 7efe5affd640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe641eaf50 0x7efe641eef50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.860+0000 7efe68a09640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 0x7efe64152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.860+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe64073ea0 con 0x7efe64152860 2024-05-08T20:43:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.860+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 0x7efe64152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe6259c640 1 -- 172.21.15.81:0/3102402848 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efe641525f0 con 0x7efe64152860 2024-05-08T20:43:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe6259c640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 0x7efe64152c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe540078d0 tx=0x7efe54000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54006250 con 0x7efe64152860 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7efe540063b0 con 0x7efe64152860 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 msgr2=0x7efe64152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 0x7efe64152c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe540078d0 tx=0x7efe54000ee0 comp rx=0 tx=0).stop 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 msgr2=0x7efe64152c70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe5affd640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe64152860 0x7efe64152c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:32.866 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:32.870 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:32.872 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.876 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:32.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:32.878 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:32.878 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efe440666c0 msgr2=0x7efe44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efe440666c0 0x7efe44068b80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ae000 tx=0x7efe4c0a7000 comp rx=0 tx=0).stop 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 msgr2=0x7efe641493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 --2- 172.21.15.81:0/3102402848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe640c30d0 0x7efe641493e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe5c007e30 tx=0x7efe5c00e4b0 comp rx=0 tx=0).stop 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 reap_dead start 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe62d9d640 1 -- 172.21.15.81:0/3102402848 reap_dead start 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 shutdown_connections 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 >> 172.21.15.81:0/3102402848 conn(0x7efe640c4cc0 msgr2=0x7efe6406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 shutdown_connections 2024-05-08T20:43:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:32.864+0000 7efe68a09640 1 -- 172.21.15.81:0/3102402848 wait complete. 2024-05-08T20:43:32.888 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:32.888 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:43:32.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:43:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 Processor -- start 2024-05-08T20:43:33.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 -- start start 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff460151f00 0x7ff4601588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 0x7ff460155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff460158e20 con 0x7ff460155690 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46006bb20 con 0x7ff460151f00 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff465033640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4601548e0 con 0x7ff460154cf0 2024-05-08T20:43:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45f59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff460155690 0x7ff4600ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56828/0 (socket says 172.21.15.81:56828) 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45f59e640 1 -- 172.21.15.81:0/873475516 learned_addr learned my addr 172.21.15.81:0/873475516 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45ed9d640 1 --2- 172.21.15.81:0/873475516 >> v2:172.21.15.117:3300/0 conn(0x7ff460151f00 0x7ff4601588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 0x7ff460155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881773511 0 0) 0x7ff460158e20 con 0x7ff460155690 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff448003530 con 0x7ff460155690 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713469216 0 0) 0x7ff448003530 con 0x7ff460155690 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 msgr2=0x7ff460155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 0x7ff460155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 >> v2:172.21.15.117:3300/0 conn(0x7ff460151f00 msgr2=0x7ff4601588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 --2- 172.21.15.81:0/873475516 >> v2:172.21.15.117:3300/0 conn(0x7ff460151f00 0x7ff4601588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4601522e0 con 0x7ff460155690 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff458001a00 con 0x7ff460155690 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 >> v1:172.21.15.81:6789/0 conn(0x7ff460155690 legacy=0x7ff4600ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff448003980 0x7ff448003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff448004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 0x7ff448005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800b990 con 0x7ff4480047d0 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800bad0 con 0x7ff448003980 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44800bc90 con 0x7ff460154cf0 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff448004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45ed9d640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff448003980 0x7ff448003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 -- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 msgr2=0x7ff448005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460154cf0 0x7ff448005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 -- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff448003980 msgr2=0x7ff448003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff448003980 0x7ff448003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.020+0000 7ff45e59c640 1 -- 172.21.15.81:0/873475516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448003530 con 0x7ff4480047d0 2024-05-08T20:43:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff45e59c640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff448004c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff454009ae0 tx=0x7ff45401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c53bc0aa96e6b4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540a56a0 con 0x7ff4480047d0 2024-05-08T20:43:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4540a5800 con 0x7ff4480047d0 2024-05-08T20:43:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff45dd9b640 1 -- 172.21.15.81:0/873475516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4540a5bb0 con 0x7ff4480047d0 2024-05-08T20:43:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 -- 172.21.15.81:0/873475516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 msgr2=0x7ff448004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 --2- 172.21.15.81:0/873475516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff448004c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff454009ae0 tx=0x7ff45401cab0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff45f59e640 1 -- 172.21.15.81:0/873475516 reap_dead start 2024-05-08T20:43:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 -- 172.21.15.81:0/873475516 shutdown_connections 2024-05-08T20:43:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 -- 172.21.15.81:0/873475516 >> 172.21.15.81:0/873475516 conn(0x7ff4600715f0 msgr2=0x7ff460071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 -- 172.21.15.81:0/873475516 shutdown_connections 2024-05-08T20:43:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.024+0000 7ff465033640 1 -- 172.21.15.81:0/873475516 wait complete. 2024-05-08T20:43:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 Processor -- start 2024-05-08T20:43:33.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- start start 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460157cf0 0x7ff4601529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 0x7ff460152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff460153430 con 0x7ff4480047d0 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff460153870 con 0x7ff460158170 2024-05-08T20:43:33.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff460153590 con 0x7ff460157cf0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55628/0 (socket says 172.21.15.81:55628) 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 -- 172.21.15.81:0/2449419173 learned_addr learned my addr 172.21.15.81:0/2449419173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45e59c640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460157cf0 0x7ff4601529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45f59e640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 0x7ff460152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 -- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460157cf0 msgr2=0x7ff4601529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460157cf0 0x7ff4601529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 -- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 msgr2=0x7ff460152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 0x7ff460152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 -- 172.21.15.81:0/2449419173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460153bc0 con 0x7ff4480047d0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45f59e640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 0x7ff460152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff45ed9d640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff450011660 tx=0x7ff450011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000f9c0 con 0x7ff4480047d0 2024-05-08T20:43:33.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000fb20 con 0x7ff4480047d0 2024-05-08T20:43:33.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4601ee1b0 con 0x7ff4480047d0 2024-05-08T20:43:33.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000fe90 con 0x7ff4480047d0 2024-05-08T20:43:33.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.028+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4601513b0 con 0x7ff4480047d0 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4601ee010 con 0x7ff4480047d0 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff450015460 con 0x7ff4480047d0 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff4477fe640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 0x7ff44c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff4500849c0 con 0x7ff4480047d0 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff45e59c640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 0x7ff44c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.032+0000 7ff45e59c640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 0x7ff44c068b50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4540af000 tx=0x7ff4540046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.036+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff4601ee010 con 0x7ff4480047d0 2024-05-08T20:43:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.304+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff460154380 con 0x7ff4480047d0 2024-05-08T20:43:33.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff4477fe640 1 -- 172.21.15.81:0/2449419173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff460154380 con 0x7ff4480047d0 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 msgr2=0x7ff44c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 0x7ff44c068b50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4540af000 tx=0x7ff4540046d0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 msgr2=0x7ff460154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff450011660 tx=0x7ff450011b20 comp rx=0 tx=0).stop 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 shutdown_connections 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff44c066690 0x7ff44c068b50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff460158170 0x7ff460152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff460157cf0 0x7ff4601529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 --2- 172.21.15.81:0/2449419173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480047d0 0x7ff460154640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 >> 172.21.15.81:0/2449419173 conn(0x7ff4600715f0 msgr2=0x7ff4600c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 shutdown_connections 2024-05-08T20:43:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:33.308+0000 7ff465033640 1 -- 172.21.15.81:0/2449419173 wait complete. 2024-05-08T20:43:33.332 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:43:43.333 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:43:43.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:43.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 Processor -- start 2024-05-08T20:43:43.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 -- start start 2024-05-08T20:43:43.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f790c155e90 0x7f790c069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790c06a500 0x7f790c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c152ab0 con 0x7f790c14fe70 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c1528a0 con 0x7f790c06a500 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7911c45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c152d90 con 0x7f790c155e90 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790c06a500 0x7f790c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790c06a500 0x7f790c06a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34034/0 (socket says 172.21.15.81:34034) 2024-05-08T20:43:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 -- 172.21.15.81:0/983645149 learned_addr learned my addr 172.21.15.81:0/983645149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f7903fff640 1 --2- 172.21.15.81:0/983645149 >> v2:172.21.15.117:3300/0 conn(0x7f790c155e90 0x7f790c069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 -- 172.21.15.81:0/983645149 >> v2:172.21.15.117:3300/0 conn(0x7f790c155e90 msgr2=0x7f790c069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 --2- 172.21.15.81:0/983645149 >> v2:172.21.15.117:3300/0 conn(0x7f790c155e90 0x7f790c069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 -- 172.21.15.81:0/983645149 >> v1:172.21.15.117:6789/0 conn(0x7f790c14fe70 legacy=0x7f790c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.472+0000 7f790bfff640 1 -- 172.21.15.81:0/983645149 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c153070 con 0x7f790c06a500 2024-05-08T20:43:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f790bfff640 1 --2- 172.21.15.81:0/983645149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c06a500 0x7f790c06a930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f790c06fd50 tx=0x7f790401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835f791ed495f09d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f790affd640 1 -- 172.21.15.81:0/983645149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a5720 con 0x7f790c06a500 2024-05-08T20:43:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f790affd640 1 -- 172.21.15.81:0/983645149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79040a5880 con 0x7f790c06a500 2024-05-08T20:43:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f790affd640 1 -- 172.21.15.81:0/983645149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a5c10 con 0x7f790c06a500 2024-05-08T20:43:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 -- 172.21.15.81:0/983645149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c06a500 msgr2=0x7f790c06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 --2- 172.21.15.81:0/983645149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c06a500 0x7f790c06a930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f790c06fd50 tx=0x7f790401c860 comp rx=0 tx=0).stop 2024-05-08T20:43:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 -- 172.21.15.81:0/983645149 shutdown_connections 2024-05-08T20:43:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 --2- 172.21.15.81:0/983645149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c06a500 0x7f790c06a930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 --2- 172.21.15.81:0/983645149 >> v2:172.21.15.117:3300/0 conn(0x7f790c155e90 0x7f790c069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 -- 172.21.15.81:0/983645149 >> 172.21.15.81:0/983645149 conn(0x7f790c0c71b0 msgr2=0x7f790c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 -- 172.21.15.81:0/983645149 shutdown_connections 2024-05-08T20:43:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.476+0000 7f7911c45640 1 -- 172.21.15.81:0/983645149 wait complete. 2024-05-08T20:43:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 Processor -- start 2024-05-08T20:43:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- start start 2024-05-08T20:43:43.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f790c06a500 0x7f790c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 0x7f790c1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c14d800 con 0x7f790c155e90 2024-05-08T20:43:43.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c14c920 con 0x7f790c06a500 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c5a70 con 0x7f790c14fe70 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34042/0 (socket says 172.21.15.81:34042) 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 -- 172.21.15.81:0/2485179664 learned_addr learned my addr 172.21.15.81:0/2485179664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7903fff640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 0x7f790c1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790b7fe640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f790c06a500 0x7f790c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 -- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 msgr2=0x7f790c1495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 0x7f790c1495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 -- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f790c06a500 msgr2=0x7f790c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f790c06a500 0x7f790c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 -- 172.21.15.81:0/2485179664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904009b30 con 0x7f790c155e90 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7903fff640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 0x7f790c1495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f790bfff640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f79040af040 tx=0x7f7904019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040b8670 con 0x7f790c155e90 2024-05-08T20:43:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79040b87d0 con 0x7f790c155e90 2024-05-08T20:43:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c14a380 con 0x7f790c155e90 2024-05-08T20:43:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040b8b80 con 0x7f790c155e90 2024-05-08T20:43:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.480+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c14cb70 con 0x7f790c155e90 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0675e0 con 0x7f790c155e90 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79040b8ce0 con 0x7f790c155e90 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f7908ff9640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 0x7f78ec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f790411f730 con 0x7f790c155e90 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f790b7fe640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 0x7f78ec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.484+0000 7f790b7fe640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 0x7f78ec068b80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f790c15c3b0 tx=0x7f78fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.488+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f79040ec8b0 con 0x7f790c155e90 2024-05-08T20:43:43.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.728+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f790c0c1920 con 0x7f790c155e90 2024-05-08T20:43:43.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.728+0000 7f7908ff9640 1 -- 172.21.15.81:0/2485179664 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f79040efed0 con 0x7f790c155e90 2024-05-08T20:43:43.730 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 msgr2=0x7f78ec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 0x7f78ec068b80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f790c15c3b0 tx=0x7f78fc009040 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 msgr2=0x7f790c14b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f79040af040 tx=0x7f7904019600 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 shutdown_connections 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f78ec0666c0 0x7f78ec068b80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c155e90 0x7f790c14b960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f790c14fe70 0x7f790c1495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 --2- 172.21.15.81:0/2485179664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f790c06a500 0x7f790c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 >> 172.21.15.81:0/2485179664 conn(0x7f790c0c71b0 msgr2=0x7f790c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 shutdown_connections 2024-05-08T20:43:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.732+0000 7f7911c45640 1 -- 172.21.15.81:0/2485179664 wait complete. 2024-05-08T20:43:43.751 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:43:43.751 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:43:43.751 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:43:43.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 Processor -- start 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 -- start start 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f693006cca0 0x7f693006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693006afd0 con 0x7f693006f660 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69300728a0 con 0x7f693006f200 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f69367d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693006b220 con 0x7f693006cca0 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f6934d76640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f693006f660 0x7f69301653c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47564/0 (socket says 172.21.15.81:47564) 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f6934d76640 1 -- 172.21.15.81:0/4246706706 learned_addr learned my addr 172.21.15.81:0/4246706706 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:43.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357064069 0 0) 0x7f693006afd0 con 0x7f693006f660 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.872+0000 7f692ffff640 1 --2- 172.21.15.81:0/4246706706 >> v2:172.21.15.117:3300/0 conn(0x7f693006cca0 0x7f693006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f691c003980 con 0x7f693006f660 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173480356 0 0) 0x7f69300728a0 con 0x7f693006f200 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693006afd0 con 0x7f693006f200 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3778713175 0 0) 0x7f691c003980 con 0x7f693006f660 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 >> v2:172.21.15.117:3300/0 conn(0x7f693006cca0 msgr2=0x7f693006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 --2- 172.21.15.81:0/4246706706 >> v2:172.21.15.117:3300/0 conn(0x7f693006cca0 0x7f693006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 >> v1:172.21.15.117:6789/0 conn(0x7f693006f200 legacy=0x7f69300a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693006b500 con 0x7f693006f660 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f6928001a00 con 0x7f693006f660 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 >> v1:172.21.15.81:6789/0 conn(0x7f693006f660 legacy=0x7f69301653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f691c0041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f691c004760 0x7f691c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f691c009320 0x7f691c00b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693006b220 con 0x7f691c003dd0 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c00c0c0 con 0x7f691c009320 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.892+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c010690 con 0x7f691c004760 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f691c0041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f6927fff640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f691c004760 0x7f691c008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 -- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f691c004760 msgr2=0x7f691c008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f691c004760 0x7f691c008c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 -- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f691c009320 msgr2=0x7f691c00b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f691c009320 0x7f691c00b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 -- 172.21.15.81:0/4246706706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c003980 con 0x7f691c003dd0 2024-05-08T20:43:43.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f6934d76640 1 -- 172.21.15.81:0/4246706706 reap_dead start 2024-05-08T20:43:43.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692ffff640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f691c0041d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f692000cb90 tx=0x7f692001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e957ef7372f6902 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300a9bd0 con 0x7f691c003dd0 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200a5a90 con 0x7f691c003dd0 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.896+0000 7f692f7fe640 1 -- 172.21.15.81:0/4246706706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ad440 con 0x7f691c003dd0 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 msgr2=0x7f691c0041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f691c0041d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f692000cb90 tx=0x7f692001cc70 comp rx=0 tx=0).stop 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/4246706706 shutdown_connections 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 --2- 172.21.15.81:0/4246706706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f691c0041d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/4246706706 >> 172.21.15.81:0/4246706706 conn(0x7f69300c2ca0 msgr2=0x7f69300c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/4246706706 shutdown_connections 2024-05-08T20:43:43.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/4246706706 wait complete. 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 Processor -- start 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- start start 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f69301fb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69300bfaa0 0x7f69300711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69300a86d0 0x7f69301fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300bbea0 con 0x7f691c003dd0 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300bc180 con 0x7f69300a86d0 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69300bc460 con 0x7f69300bfaa0 2024-05-08T20:43:43.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f69301fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f69301fb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34050/0 (socket says 172.21.15.81:34050) 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 -- 172.21.15.81:0/1643368512 learned_addr learned my addr 172.21.15.81:0/1643368512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f6927fff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69300bfaa0 0x7f69300711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f6934d76640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69300a86d0 0x7f69301fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69300bfaa0 msgr2=0x7f69300711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69300bfaa0 0x7f69300711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69300a86d0 msgr2=0x7f69301fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69300a86d0 0x7f69301fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69300709b0 con 0x7f691c003dd0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692ffff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f69301fb210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69200b0040 tx=0x7f6920005ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200adb40 con 0x7f691c003dd0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200adcc0 con 0x7f691c003dd0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6930070c90 con 0x7f691c003dd0 2024-05-08T20:43:43.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200b6650 con 0x7f691c003dd0 2024-05-08T20:43:43.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.900+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69301fdab0 con 0x7f691c003dd0 2024-05-08T20:43:43.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f69367d9640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 0x7f69301f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300bbea0 con 0x7f69301fdd60 2024-05-08T20:43:43.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f6927fff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 0x7f69301f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f6927fff640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69301653c0 con 0x7f69301fdd60 2024-05-08T20:43:43.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f6927fff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 0x7f69301f6f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69300683e0 tx=0x7f691800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69200b4040 con 0x7f691c003dd0 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69100666c0 0x7f6910068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f692011f5d0 con 0x7f691c003dd0 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f6934d76640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69100666c0 0x7f6910068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180050d0 con 0x7f69301fdd60 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f6918005230 con 0x7f69301fdd60 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 msgr2=0x7f69301f6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 0x7f69301f6f30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69300683e0 tx=0x7f691800fc00 comp rx=0 tx=0).stop 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 msgr2=0x7f69301f6f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f692d7fa640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301fdd60 0x7f69301f6f30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.904+0000 7f6934d76640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69100666c0 0x7f6910068b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f69300ab500 tx=0x7f6928001800 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 0x7f69301f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930070b40 con 0x7f69301f7470 2024-05-08T20:43:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f6927fff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 0x7f69301f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f6927fff640 1 -- 172.21.15.81:0/1643368512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f69300718c0 con 0x7f69301f7470 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f6927fff640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 0x7f69301f9d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f693006d570 tx=0x7f6918000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800deb0 con 0x7f69301f7470 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7f6918005490 con 0x7f69301f7470 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 msgr2=0x7f69301f9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 0x7f69301f9d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f693006d570 tx=0x7f6918000ee0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 msgr2=0x7f69301f9d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f692d7fa640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69301f7470 0x7f69301f9d20 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f693006d570 tx=0x7f6918000ee0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.913 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:43.914 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:43.915 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.918 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:43.920 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:43.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:43.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:43.923 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:43.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:43.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:43.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:43.926 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:43.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69100666c0 msgr2=0x7f6910068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69100666c0 0x7f6910068b80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f69300ab500 tx=0x7f6928001800 comp rx=0 tx=0).stop 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 msgr2=0x7f69301fb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 --2- 172.21.15.81:0/1643368512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c003dd0 0x7f69301fb210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69200b0040 tx=0x7f6920005ff0 comp rx=0 tx=0).stop 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f6934d76640 1 -- 172.21.15.81:0/1643368512 reap_dead start 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f6934d76640 1 -- 172.21.15.81:0/1643368512 reap_dead start 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 shutdown_connections 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 >> 172.21.15.81:0/1643368512 conn(0x7f69300c2ca0 msgr2=0x7f69301628a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 shutdown_connections 2024-05-08T20:43:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:43.912+0000 7f69367d9640 1 -- 172.21.15.81:0/1643368512 wait complete. 2024-05-08T20:43:43.931 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:43.931 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:43:43.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:43:44.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 Processor -- start 2024-05-08T20:43:44.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 -- start start 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee840c2bc0 0x7fee840c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee840a94b0 0x7fee840a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee84155e10 con 0x7fee840c30d0 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8406e790 con 0x7fee840a94b0 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.052+0000 7fee895e1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8406f460 con 0x7fee840c2bc0 2024-05-08T20:43:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee840a94b0 0x7fee840a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee82ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee840c30d0 0x7fee840c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47574/0 (socket says 172.21.15.81:47574) 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee82ffd640 1 -- 172.21.15.81:0/1861261023 learned_addr learned my addr 172.21.15.81:0/1861261023 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee827fc640 1 --2- 172.21.15.81:0/1861261023 >> v2:172.21.15.117:3300/0 conn(0x7fee840c2bc0 0x7fee840c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee81ffb640 1 -- 172.21.15.81:0/1861261023 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195479766 0 0) 0x7fee84155e10 con 0x7fee840c30d0 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee81ffb640 1 -- 172.21.15.81:0/1861261023 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c003530 con 0x7fee840c30d0 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 -- 172.21.15.81:0/1861261023 >> v2:172.21.15.117:3300/0 conn(0x7fee840c2bc0 msgr2=0x7fee840c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 --2- 172.21.15.81:0/1861261023 >> v2:172.21.15.117:3300/0 conn(0x7fee840c2bc0 0x7fee840c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 -- 172.21.15.81:0/1861261023 >> v1:172.21.15.81:6789/0 conn(0x7fee840c30d0 legacy=0x7fee840c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 -- 172.21.15.81:0/1861261023 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84156080 con 0x7fee840a94b0 2024-05-08T20:43:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee837fe640 1 --2- 172.21.15.81:0/1861261023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840a94b0 0x7fee840a98c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fee84071050 tx=0x7fee7c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bad0f66aee99dd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee81ffb640 1 -- 172.21.15.81:0/1861261023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0a5930 con 0x7fee840a94b0 2024-05-08T20:43:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee81ffb640 1 -- 172.21.15.81:0/1861261023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c0a5a90 con 0x7fee840a94b0 2024-05-08T20:43:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee81ffb640 1 -- 172.21.15.81:0/1861261023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0a5e20 con 0x7fee840a94b0 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 -- 172.21.15.81:0/1861261023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840a94b0 msgr2=0x7fee840a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 --2- 172.21.15.81:0/1861261023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840a94b0 0x7fee840a98c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fee84071050 tx=0x7fee7c01c870 comp rx=0 tx=0).stop 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 -- 172.21.15.81:0/1861261023 shutdown_connections 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 --2- 172.21.15.81:0/1861261023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840a94b0 0x7fee840a98c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 --2- 172.21.15.81:0/1861261023 >> v2:172.21.15.117:3300/0 conn(0x7fee840c2bc0 0x7fee840c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 -- 172.21.15.81:0/1861261023 >> 172.21.15.81:0/1861261023 conn(0x7fee840c4cc0 msgr2=0x7fee840c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 -- 172.21.15.81:0/1861261023 shutdown_connections 2024-05-08T20:43:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.056+0000 7fee895e1640 1 -- 172.21.15.81:0/1861261023 wait complete. 2024-05-08T20:43:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 Processor -- start 2024-05-08T20:43:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- start start 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee840a94b0 0x7fee841eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840c2bc0 0x7fee8413f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84143d30 con 0x7fee840c30d0 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee841ebaa0 con 0x7fee840a94b0 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee84140120 con 0x7fee840c2bc0 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee82ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee840a94b0 0x7fee841eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34076/0 (socket says 172.21.15.81:34076) 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 -- 172.21.15.81:0/1372010805 learned_addr learned my addr 172.21.15.81:0/1372010805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee827fc640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840c2bc0 0x7fee8413f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840c2bc0 msgr2=0x7fee8413f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee840c2bc0 0x7fee8413f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee840a94b0 msgr2=0x7fee841eafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee840a94b0 0x7fee841eafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c009a70 con 0x7fee840c30d0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee837fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee7c019480 tx=0x7fee7c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0adcc0 con 0x7fee840c30d0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c0ade20 con 0x7fee840c30d0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee84154560 con 0x7fee840c30d0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0b9690 con 0x7fee840c30d0 2024-05-08T20:43:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84154b20 con 0x7fee840c30d0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 0x7fee84144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.060+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84073ea0 con 0x7fee841505a0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee82ffd640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 0x7fee84144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee82ffd640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee840c4970 con 0x7fee841505a0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee82ffd640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 0x7fee84144b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee74000f70 tx=0x7fee74001860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee7c0b97f0 con 0x7fee840c30d0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee700666c0 0x7fee70068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fee7c11f430 con 0x7fee840c30d0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee827fc640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee700666c0 0x7fee70068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74013600 con 0x7fee841505a0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fee74013760 con 0x7fee841505a0 2024-05-08T20:43:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 msgr2=0x7fee84144b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 0x7fee84144b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee74000f70 tx=0x7fee74001860 comp rx=0 tx=0).stop 2024-05-08T20:43:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 msgr2=0x7fee84144b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee6b7fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee841505a0 0x7fee84144b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.064+0000 7fee827fc640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee700666c0 0x7fee70068b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fee840c2ff0 tx=0x7fee78009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 0x7fee84145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84074950 con 0x7fee84154d10 2024-05-08T20:43:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee82ffd640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 0x7fee84145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee82ffd640 1 -- 172.21.15.81:0/1372010805 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fee8414dbc0 con 0x7fee84154d10 2024-05-08T20:43:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee82ffd640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 0x7fee84145070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee74017000 tx=0x7fee74001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee74013e60 con 0x7fee84154d10 2024-05-08T20:43:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fee74005e00 con 0x7fee84154d10 2024-05-08T20:43:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 msgr2=0x7fee84145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 0x7fee84145070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee74017000 tx=0x7fee74001160 comp rx=0 tx=0).stop 2024-05-08T20:43:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 msgr2=0x7fee84145070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee6b7fe640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee84154d10 0x7fee84145070 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee74017000 tx=0x7fee74001160 comp rx=0 tx=0).stop 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:43:44.076 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:44.079 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.080 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:44.082 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.083 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:44.084 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.085 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.086 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:44.087 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee700666c0 msgr2=0x7fee70068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fee700666c0 0x7fee70068b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fee840c2ff0 tx=0x7fee78009190 comp rx=0 tx=0).stop 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 msgr2=0x7fee8413fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee7c019480 tx=0x7fee7c019610 comp rx=0 tx=0).stop 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee837fe640 1 -- 172.21.15.81:0/1372010805 reap_dead start 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 shutdown_connections 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 --2- 172.21.15.81:0/1372010805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee840c30d0 0x7fee8413fbe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.072+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 >> 172.21.15.81:0/1372010805 conn(0x7fee840c4cc0 msgr2=0x7fee8406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.076+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 shutdown_connections 2024-05-08T20:43:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.076+0000 7fee895e1640 1 -- 172.21.15.81:0/1372010805 wait complete. 2024-05-08T20:43:44.096 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:44.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:43:44.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:43:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 Processor -- start 2024-05-08T20:43:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 -- start start 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740151f00 0x7f97401588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9740154cf0 0x7f9740155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9740158e20 con 0x7f9740155690 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974006bb20 con 0x7f9740154cf0 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9746d8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97401548e0 con 0x7f9740151f00 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f973ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9740154cf0 0x7f9740155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f973ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9740154cf0 0x7f9740155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34090/0 (socket says 172.21.15.81:34090) 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f973ffff640 1 -- 172.21.15.81:0/3196870259 learned_addr learned my addr 172.21.15.81:0/3196870259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.212+0000 7f9744b29640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740151f00 0x7f97401588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973ffff640 1 -- 172.21.15.81:0/3196870259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740151f00 msgr2=0x7f97401588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973ffff640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740151f00 0x7f97401588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973ffff640 1 -- 172.21.15.81:0/3196870259 >> v1:172.21.15.117:6789/0 conn(0x7f9740155690 legacy=0x7f97400ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973ffff640 1 -- 172.21.15.81:0/3196870259 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97401522e0 con 0x7f9740154cf0 2024-05-08T20:43:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973ffff640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740154cf0 0x7f9740155150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f972c0098a0 tx=0x7f972c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65c219ddbdb6dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973f7fe640 1 -- 172.21.15.81:0/3196870259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab640 con 0x7f9740154cf0 2024-05-08T20:43:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973f7fe640 1 -- 172.21.15.81:0/3196870259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0a7070 con 0x7f9740154cf0 2024-05-08T20:43:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f973f7fe640 1 -- 172.21.15.81:0/3196870259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab9c0 con 0x7f9740154cf0 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 -- 172.21.15.81:0/3196870259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740154cf0 msgr2=0x7f9740155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740154cf0 0x7f9740155150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f972c0098a0 tx=0x7f972c01c420 comp rx=0 tx=0).stop 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 -- 172.21.15.81:0/3196870259 shutdown_connections 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740154cf0 0x7f9740155150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 --2- 172.21.15.81:0/3196870259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740151f00 0x7f97401588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 -- 172.21.15.81:0/3196870259 >> 172.21.15.81:0/3196870259 conn(0x7f97400715f0 msgr2=0x7f9740071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 -- 172.21.15.81:0/3196870259 shutdown_connections 2024-05-08T20:43:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.216+0000 7f9746d8d640 1 -- 172.21.15.81:0/3196870259 wait complete. 2024-05-08T20:43:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 Processor -- start 2024-05-08T20:43:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- start start 2024-05-08T20:43:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9740151f00 0x7f9740146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740154cf0 0x7f97400c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 0x7f9740146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97400ad2a0 con 0x7f9740145fa0 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97401f0c30 con 0x7f9740151f00 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97401f0e80 con 0x7f9740154cf0 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 0x7f9740146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 0x7f9740146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34094/0 (socket says 172.21.15.81:34094) 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 learned_addr learned my addr 172.21.15.81:0/1538651891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740154cf0 msgr2=0x7f97400c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740154cf0 0x7f97400c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9740151f00 msgr2=0x7f9740146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9740151f00 0x7f9740146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0094d0 con 0x7f9740145fa0 2024-05-08T20:43:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f974532a640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 0x7f9740146450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f973800c760 tx=0x7f973800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738003b80 con 0x7f9740145fa0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738003ce0 con 0x7f9740145fa0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97401f1160 con 0x7f9740145fa0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800aa90 con 0x7f9740145fa0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97401f1720 con 0x7f9740145fa0 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 0x7f97400ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.220+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740069600 con 0x7f9740155690 2024-05-08T20:43:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f9744b29640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 0x7f97400ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f973800abf0 con 0x7f9740145fa0 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f9744b29640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97400ae410 con 0x7f9740155690 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9724066690 0x7f9724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9738084200 con 0x7f9740145fa0 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973ffff640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9724066690 0x7f9724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f9744b29640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 0x7f97400ae610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f973400d4e0 tx=0x7f973400d9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734018070 con 0x7f9740155690 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973ffff640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9724066690 0x7f9724068b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f972c0af000 tx=0x7f972c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9734004020 con 0x7f9740155690 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 msgr2=0x7f97400ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 0x7f97400ae610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f973400d4e0 tx=0x7f973400d9a0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 msgr2=0x7f97400ae610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.224+0000 7f973d7fa640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9740155690 0x7f97400ae610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f9746d8d640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 0x7f97400aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97400cab20 con 0x7f97400aeb50 2024-05-08T20:43:44.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f9744b29640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 0x7f97400aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f9744b29640 1 -- 172.21.15.81:0/1538651891 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f97400c6820 con 0x7f97400aeb50 2024-05-08T20:43:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f9744b29640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 0x7f97400aef60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9734017000 tx=0x7f97340046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734003a90 con 0x7f97400aeb50 2024-05-08T20:43:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f9734003bf0 con 0x7f97400aeb50 2024-05-08T20:43:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 msgr2=0x7f97400aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 0x7f97400aef60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9734017000 tx=0x7f97340046d0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 msgr2=0x7f97400aef60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.232+0000 7f973d7fa640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97400aeb50 0x7f97400aef60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 126, 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:44.236 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.237 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.243 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.245 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:44.246 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9724066690 msgr2=0x7f9724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9724066690 0x7f9724068b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f972c0af000 tx=0x7f972c008040 comp rx=0 tx=0).stop 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 msgr2=0x7f9740146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 --2- 172.21.15.81:0/1538651891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9740145fa0 0x7f9740146450 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f973800c760 tx=0x7f973800cc20 comp rx=0 tx=0).stop 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 reap_dead start 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f974532a640 1 -- 172.21.15.81:0/1538651891 reap_dead start 2024-05-08T20:43:44.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 shutdown_connections 2024-05-08T20:43:44.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 >> 172.21.15.81:0/1538651891 conn(0x7f97400715f0 msgr2=0x7f9740069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 shutdown_connections 2024-05-08T20:43:44.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.236+0000 7f9746d8d640 1 -- 172.21.15.81:0/1538651891 wait complete. 2024-05-08T20:43:44.252 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:43:44.253 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:43:44.253 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:43:44.253 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:43:44.253 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:43:44.253 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:43:44.253 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:43:44.267 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:43:44.267 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:43:44.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:44.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 Processor -- start 2024-05-08T20:43:44.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 -- start start 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe544152220 0x7fe5441555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe544155140 con 0x7fe5440aac30 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440c32d0 con 0x7fe5440c26e0 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe54b825640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440c4780 con 0x7fe544152220 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe548dc0640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fe5440c26e0 legacy=0x7fe5440c2bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe5495c1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe544152220 0x7fe5441555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe549dc2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5440aac30 0x7fe5440c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47588/0 (socket says 172.21.15.81:47588) 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe549dc2640 1 -- 172.21.15.81:0/3921984683 learned_addr learned my addr 172.21.15.81:0/3921984683 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe5495c1640 1 -- 172.21.15.81:0/3921984683 >> v1:172.21.15.117:6789/0 conn(0x7fe5440c26e0 legacy=0x7fe5440c2bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe5495c1640 1 -- 172.21.15.81:0/3921984683 >> v1:172.21.15.81:6789/0 conn(0x7fe5440aac30 legacy=0x7fe5440c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.372+0000 7fe5495c1640 1 -- 172.21.15.81:0/3921984683 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe544072650 con 0x7fe544152220 2024-05-08T20:43:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe5495c1640 1 --2- 172.21.15.81:0/3921984683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe5441555d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5400097c0 tx=0x7fe54001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571d95fed25038ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe53bfff640 1 -- 172.21.15.81:0/3921984683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400ab600 con 0x7fe544152220 2024-05-08T20:43:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe53bfff640 1 -- 172.21.15.81:0/3921984683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5400a7050 con 0x7fe544152220 2024-05-08T20:43:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe53bfff640 1 -- 172.21.15.81:0/3921984683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400ab980 con 0x7fe544152220 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- 172.21.15.81:0/3921984683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 msgr2=0x7fe5441555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 --2- 172.21.15.81:0/3921984683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe5441555d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5400097c0 tx=0x7fe54001c260 comp rx=0 tx=0).stop 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- 172.21.15.81:0/3921984683 shutdown_connections 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 --2- 172.21.15.81:0/3921984683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe5441555d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- 172.21.15.81:0/3921984683 >> 172.21.15.81:0/3921984683 conn(0x7fe5440c4cc0 msgr2=0x7fe5440c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- 172.21.15.81:0/3921984683 shutdown_connections 2024-05-08T20:43:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- 172.21.15.81:0/3921984683 wait complete. 2024-05-08T20:43:44.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 Processor -- start 2024-05-08T20:43:44.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.376+0000 7fe54b825640 1 -- start start 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5440aac30 0x7fe54414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 0x7fe544156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544156250 con 0x7fe544152220 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544157b70 con 0x7fe5440c26e0 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5441eb0a0 con 0x7fe5440aac30 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe548dc0640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 msgr2=0x7fe544156670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe548dc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 0x7fe544156670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34142/0 (socket says 172.21.15.81:34142) 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 -- 172.21.15.81:0/3764459380 learned_addr learned my addr 172.21.15.81:0/3764459380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe5495c1640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5440aac30 0x7fe54414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 -- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5440aac30 msgr2=0x7fe54414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5440aac30 0x7fe54414d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 -- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 msgr2=0x7fe544156670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 0x7fe544156670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 -- 172.21.15.81:0/3764459380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540009420 con 0x7fe544152220 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe549dc2640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00e550 tx=0x7fe53c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c012810 con 0x7fe544152220 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c012970 con 0x7fe544152220 2024-05-08T20:43:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544155e70 con 0x7fe544152220 2024-05-08T20:43:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c012d20 con 0x7fe544152220 2024-05-08T20:43:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5441eb380 con 0x7fe544152220 2024-05-08T20:43:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544156390 con 0x7fe544152220 2024-05-08T20:43:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe53c009070 con 0x7fe544152220 2024-05-08T20:43:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 0x7fe528068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe5495c1640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 0x7fe528068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe53c0872e0 con 0x7fe544152220 2024-05-08T20:43:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.380+0000 7fe5495c1640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 0x7fe528068b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe5400ad000 tx=0x7fe5400a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:44.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.388+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe544156390 con 0x7fe544152220 2024-05-08T20:43:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.660+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe544156390 con 0x7fe544152220 2024-05-08T20:43:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.660+0000 7fe539ffb640 1 -- 172.21.15.81:0/3764459380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fe53c016620 con 0x7fe544152220 2024-05-08T20:43:44.662 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 msgr2=0x7fe528068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 0x7fe528068b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe5400ad000 tx=0x7fe5400a6000 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 msgr2=0x7fe544156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00e550 tx=0x7fe53c00ea10 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 shutdown_connections 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe528066640 0x7fe528068b00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe544152220 0x7fe544156bb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5440c26e0 0x7fe544156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 --2- 172.21.15.81:0/3764459380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5440aac30 0x7fe54414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 >> 172.21.15.81:0/3764459380 conn(0x7fe5440c4cc0 msgr2=0x7fe5440ac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 shutdown_connections 2024-05-08T20:43:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:44.664+0000 7fe54b825640 1 -- 172.21.15.81:0/3764459380 wait complete. 2024-05-08T20:43:47.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:47.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 Processor -- start 2024-05-08T20:43:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 -- start start 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f42780c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42781519d0 0x7f4278151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780c3a50 con 0x7f4278070c00 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4278072940 con 0x7f42781519d0 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427e7ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780705e0 con 0x7f427806b230 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427cd49640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f42781519d0 msgr2=0x7f4278151e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f42777fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4278070c00 0x7f427814e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47590/0 (socket says 172.21.15.81:47590) 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f42777fe640 1 -- 172.21.15.81:0/679544215 learned_addr learned my addr 172.21.15.81:0/679544215 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f427cd49640 1 --2- 172.21.15.81:0/679544215 >> v2:172.21.15.117:3300/0 conn(0x7f42781519d0 0x7f4278151e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4277fff640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f42780c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041483237 0 0) 0x7f42780c3a50 con 0x7f4278070c00 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260005740 con 0x7f4278070c00 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3921818456 0 0) 0x7f4260005740 con 0x7f4278070c00 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 msgr2=0x7f42780c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f42780c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 >> v2:172.21.15.117:3300/0 conn(0x7f42781519d0 msgr2=0x7f4278151e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 --2- 172.21.15.81:0/679544215 >> v2:172.21.15.117:3300/0 conn(0x7f42781519d0 0x7f4278151e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780708c0 con 0x7f4278070c00 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f426c001680 con 0x7f4278070c00 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 >> v1:172.21.15.81:6789/0 conn(0x7f4278070c00 legacy=0x7f427814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f4260005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4260006110 0x7f42600069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4260006f20 0x7f42600073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278072940 con 0x7f4260006f20 2024-05-08T20:43:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780705e0 con 0x7f4260006110 2024-05-08T20:43:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.816+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426000dd30 con 0x7f427806b230 2024-05-08T20:43:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f42777fe640 1 -- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4260006110 msgr2=0x7f42600069e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f42777fe640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4260006110 0x7f42600069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4260006f20 0x7f42600073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f4277fff640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f4260005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 -- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 msgr2=0x7f4260005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427806b230 0x7f4260005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 -- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4260006110 msgr2=0x7f42600069e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4260006110 0x7f42600069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 -- 172.21.15.81:0/679544215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260005740 con 0x7f4260006f20 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4260006f20 0x7f42600073a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4270009e30 tx=0x7f427001cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d47a9396259130 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a5a10 con 0x7f4260006f20 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42700a5b70 con 0x7f4260006f20 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f4276ffd640 1 -- 172.21.15.81:0/679544215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700ae470 con 0x7f4260006f20 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 -- 172.21.15.81:0/679544215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4260006f20 msgr2=0x7f42600073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 --2- 172.21.15.81:0/679544215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4260006f20 0x7f42600073a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4270009e30 tx=0x7f427001cb10 comp rx=0 tx=0).stop 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427cd49640 1 -- 172.21.15.81:0/679544215 reap_dead start 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 -- 172.21.15.81:0/679544215 shutdown_connections 2024-05-08T20:43:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 -- 172.21.15.81:0/679544215 >> 172.21.15.81:0/679544215 conn(0x7f42780c71b0 msgr2=0x7f42780c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 -- 172.21.15.81:0/679544215 shutdown_connections 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.820+0000 7f427e7ac640 1 -- 172.21.15.81:0/679544215 wait complete. 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 Processor -- start 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- start start 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427814c320 0x7f4278145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 0x7f4278142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781e8060 con 0x7f4278142780 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781e97e0 con 0x7f4278145550 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42781e70d0 con 0x7f427814c320 2024-05-08T20:43:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427cd49640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 msgr2=0x7f4278142b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34160/0 (socket says 172.21.15.81:34160) 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 -- 172.21.15.81:0/1547043005 learned_addr learned my addr 172.21.15.81:0/1547043005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427cd49640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 0x7f4278142b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f42777fe640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427814c320 0x7f4278145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 -- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427814c320 msgr2=0x7f4278145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427814c320 0x7f4278145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 -- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 msgr2=0x7f4278142b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 0x7f4278142b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 -- 172.21.15.81:0/1547043005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42781e9aa0 con 0x7f4278142780 2024-05-08T20:43:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4277fff640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42680119d0 tx=0x7f4268011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800fb50 con 0x7f4278142780 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800fcb0 con 0x7f4278142780 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42781e9d80 con 0x7f4278142780 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268014440 con 0x7f4278142780 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42781e6cf0 con 0x7f4278142780 2024-05-08T20:43:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.824+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42780675e0 con 0x7f4278142780 2024-05-08T20:43:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.828+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42680145a0 con 0x7f4278142780 2024-05-08T20:43:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.828+0000 7f4274ff9640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 0x7f4264068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.828+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4268084cd0 con 0x7f4278142780 2024-05-08T20:43:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.828+0000 7f42777fe640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 0x7f4264068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.828+0000 7f42777fe640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 0x7f4264068b30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f426c000f70 tx=0x7f426c001810 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:47.832+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4268051df0 con 0x7f4278142780 2024-05-08T20:43:48.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.136+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4278074950 con 0x7f4278142780 2024-05-08T20:43:48.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f4274ff9640 1 -- 172.21.15.81:0/1547043005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f4268022020 con 0x7f4278142780 2024-05-08T20:43:48.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:48.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 msgr2=0x7f4264068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 0x7f4264068b30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f426c000f70 tx=0x7f426c001810 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 msgr2=0x7f42781e76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42680119d0 tx=0x7f4268011e90 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 shutdown_connections 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4264066670 0x7f4264068b30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4278145550 0x7f4278142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f427814c320 0x7f4278145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 --2- 172.21.15.81:0/1547043005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4278142780 0x7f42781e76e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 >> 172.21.15.81:0/1547043005 conn(0x7f42780c71b0 msgr2=0x7f4278145e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 shutdown_connections 2024-05-08T20:43:48.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:48.140+0000 7f427e7ac640 1 -- 172.21.15.81:0/1547043005 wait complete. 2024-05-08T20:43:51.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 Processor -- start 2024-05-08T20:43:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 -- start start 2024-05-08T20:43:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 0x7fa17c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0c3a50 con 0x7fa17c14edf0 2024-05-08T20:43:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c072940 con 0x7fa17c070c00 2024-05-08T20:43:51.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.300+0000 7fa181d8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0705e0 con 0x7fa17c06b230 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17bfff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fa17c14edf0 legacy=0x7fa17c1519d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17affd640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 msgr2=0x7fa17c14e8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 0x7fa17c14e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:43942/0 (socket says 172.21.15.81:43942) 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 -- 172.21.15.81:0/121616764 learned_addr learned my addr 172.21.15.81:0/121616764 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 -- 172.21.15.81:0/121616764 >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 msgr2=0x7fa17c14e8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:51.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 --2- 172.21.15.81:0/121616764 >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 0x7fa17c14e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 -- 172.21.15.81:0/121616764 >> v1:172.21.15.117:6789/0 conn(0x7fa17c14edf0 legacy=0x7fa17c1519d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 -- 172.21.15.81:0/121616764 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0708c0 con 0x7fa17c06b230 2024-05-08T20:43:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17b7fe640 1 --2- 172.21.15.81:0/121616764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009870 tx=0x7fa16c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7cfeec689720e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17a7fc640 1 -- 172.21.15.81:0/121616764 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0ab670 con 0x7fa17c06b230 2024-05-08T20:43:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17a7fc640 1 -- 172.21.15.81:0/121616764 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c0ab7d0 con 0x7fa17c06b230 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa17a7fc640 1 -- 172.21.15.81:0/121616764 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0abb60 con 0x7fa17c06b230 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 -- 172.21.15.81:0/121616764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 msgr2=0x7fa17c0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 --2- 172.21.15.81:0/121616764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009870 tx=0x7fa16c01c4b0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 -- 172.21.15.81:0/121616764 shutdown_connections 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 --2- 172.21.15.81:0/121616764 >> v2:172.21.15.117:3300/0 conn(0x7fa17c070c00 0x7fa17c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 --2- 172.21.15.81:0/121616764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c06b230 0x7fa17c0c2800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 -- 172.21.15.81:0/121616764 >> 172.21.15.81:0/121616764 conn(0x7fa17c0c71b0 msgr2=0x7fa17c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 -- 172.21.15.81:0/121616764 shutdown_connections 2024-05-08T20:43:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.304+0000 7fa181d8c640 1 -- 172.21.15.81:0/121616764 wait complete. 2024-05-08T20:43:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 Processor -- start 2024-05-08T20:43:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- start start 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 0x7fa17c1f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 0x7fa17c0c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1f1a60 con 0x7fa17c06b230 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c1ed550 con 0x7fa17c14edf0 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0c1430 con 0x7fa17c070c00 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17bfff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 msgr2=0x7fa17c0c0840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 0x7fa17c0c0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34368/0 (socket says 172.21.15.81:34368) 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 -- 172.21.15.81:0/2890705028 learned_addr learned my addr 172.21.15.81:0/2890705028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17affd640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 0x7fa17c1f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 -- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 msgr2=0x7fa17c1f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 0x7fa17c1f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 -- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 msgr2=0x7fa17c0c0840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 0x7fa17c0c0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 -- 172.21.15.81:0/2890705028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0094d0 con 0x7fa17c06b230 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17affd640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 0x7fa17c1f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa17b7fe640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0ad040 tx=0x7fa16c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b48c0 con 0x7fa17c06b230 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c0b4a20 con 0x7fa17c06b230 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c1f11c0 con 0x7fa17c06b230 2024-05-08T20:43:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b4db0 con 0x7fa17c06b230 2024-05-08T20:43:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c1f1780 con 0x7fa17c06b230 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.308+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c0675e0 con 0x7fa17c06b230 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.312+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa16c0c7390 con 0x7fa17c06b230 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.312+0000 7fa163fff640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 0x7fa168068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.312+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa16c11f0d0 con 0x7fa17c06b230 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.312+0000 7fa17affd640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 0x7fa168068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:51.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.312+0000 7fa17affd640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 0x7fa168068b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0abc90 tx=0x7fa170008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.316+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa16c0ec1c0 con 0x7fa17c06b230 2024-05-08T20:43:51.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.588+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa17c074950 con 0x7fa17c06b230 2024-05-08T20:43:51.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa163fff640 1 -- 172.21.15.81:0/2890705028 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fa16c0ef7e0 con 0x7fa17c06b230 2024-05-08T20:43:51.592 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 msgr2=0x7fa168068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 0x7fa168068b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0abc90 tx=0x7fa170008040 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 msgr2=0x7fa17c0ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0ad040 tx=0x7fa16c01acf0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 shutdown_connections 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa168066640 0x7fa168068b00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa17c14edf0 0x7fa17c0c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa17c070c00 0x7fa17c1f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 --2- 172.21.15.81:0/2890705028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c06b230 0x7fa17c0ab750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 >> 172.21.15.81:0/2890705028 conn(0x7fa17c0c71b0 msgr2=0x7fa17c0c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 shutdown_connections 2024-05-08T20:43:51.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:51.592+0000 7fa181d8c640 1 -- 172.21.15.81:0/2890705028 wait complete. 2024-05-08T20:43:53.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:43:53.868 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:43:54.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:43:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 Processor -- start 2024-05-08T20:43:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 -- start start 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de8158080 con 0x7f1de806d7d0 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de806ab70 con 0x7f1de80c2570 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1def0fd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de8154b10 con 0x7f1de8152340 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1dece99640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 msgr2=0x7f1de806d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1ded69a640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f1de806d7d0 legacy=0x7f1de81554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1dece99640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34374/0 (socket says 172.21.15.81:34374) 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 learned_addr learned my addr 172.21.15.81:0/405565963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.732+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1ded69a640 1 -- 172.21.15.81:0/405565963 >> v1:172.21.15.117:6789/0 conn(0x7f1de806d7d0 legacy=0x7f1de81554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 msgr2=0x7f1de806d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:54.936+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:55.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 msgr2=0x7f1de806d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:55.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1ded69a640 1 -- 172.21.15.81:0/405565963 >> v1:172.21.15.117:6789/0 conn(0x7f1de806d7d0 legacy=0x7f1de81554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:55.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:55.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:55.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:55.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:55.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:55.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:55.340+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 msgr2=0x7f1de806d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1ded69a640 1 -- 172.21.15.81:0/405565963 >> v1:172.21.15.117:6789/0 conn(0x7f1de806d7d0 legacy=0x7f1de81554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:56.144+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:43:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 msgr2=0x7f1de806d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.117:3300/0 conn(0x7f1de8152340 0x7f1de806d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 -- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 msgr2=0x7f1de8154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 --2- 172.21.15.81:0/405565963 >> v2:172.21.15.81:3300/0 conn(0x7f1de80c2570 0x7f1de8154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 -- 172.21.15.81:0/405565963 >> v1:172.21.15.117:6789/0 conn(0x7f1de806d7d0 legacy=0x7f1de81554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 -- 172.21.15.81:0/405565963 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de806a890 con 0x7f1dcc006110 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1de67fc640 1 -- 172.21.15.81:0/405565963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de806ab70 con 0x7f1dcc003680 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.732+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.936+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.936+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.936+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.936+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:57.936+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:43:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.340+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.340+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:43:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.340+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:43:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.340+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:43:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.340+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:43:58.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913502561 0 0) 0x7f1de806a890 con 0x7f1dcc006110 2024-05-08T20:43:58.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd8003530 con 0x7f1dcc006110 2024-05-08T20:43:58.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 131465362 0 0) 0x7f1dd8003530 con 0x7f1dcc006110 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dcc005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dcc005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8158080 con 0x7f1dcc006110 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1dd400c570 con 0x7f1dcc006110 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 >> v1:172.21.15.81:6789/0 conn(0x7f1dcc006110 legacy=0x7f1dcc0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1dd8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 0x7f1dd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dd8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de806ab70 con 0x7f1dd80047d0 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd800bb20 con 0x7f1dd8003980 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd800bce0 con 0x7f1dcc003680 2024-05-08T20:43:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1ded69a640 1 -- 172.21.15.81:0/405565963 reap_dead start 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 0x7f1dd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1dece99640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 msgr2=0x7f1dd8003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1dece99640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1dd8003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1ded69a640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dd8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 msgr2=0x7f1dd8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dd8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 msgr2=0x7f1dd8003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.800+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1dd8003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.804+0000 7f1de7fff640 1 -- 172.21.15.81:0/405565963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8003530 con 0x7f1dd80047d0 2024-05-08T20:43:58.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1de7fff640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 0x7f1dd8004c50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1de80c2980 tx=0x7f1dd401d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca9434ea65fa35c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40ab630 con 0x7f1dd80047d0 2024-05-08T20:43:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400c040 con 0x7f1dd80047d0 2024-05-08T20:43:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1de77fe640 1 -- 172.21.15.81:0/405565963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40ab9d0 con 0x7f1dd80047d0 2024-05-08T20:43:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 -- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 msgr2=0x7f1dd8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 0x7f1dd8004c50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1de80c2980 tx=0x7f1dd401d6e0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 -- 172.21.15.81:0/405565963 shutdown_connections 2024-05-08T20:43:58.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dcc003680 0x7f1dd8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dd80047d0 0x7f1dd8004c50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 --2- 172.21.15.81:0/405565963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1dd8003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 -- 172.21.15.81:0/405565963 >> 172.21.15.81:0/405565963 conn(0x7f1de80c71b0 msgr2=0x7f1de80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 -- 172.21.15.81:0/405565963 shutdown_connections 2024-05-08T20:43:58.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.808+0000 7f1def0fd640 1 -- 172.21.15.81:0/405565963 wait complete. 2024-05-08T20:43:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.812+0000 7f1def0fd640 1 Processor -- start 2024-05-08T20:43:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.812+0000 7f1def0fd640 1 -- start start 2024-05-08T20:43:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.812+0000 7f1def0fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.812+0000 7f1def0fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1de80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dd80047d0 0x7f1de8148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80c64e0 con 0x7f1dcc003680 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80c6a10 con 0x7f1dd8003980 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81ed9a0 con 0x7f1dd80047d0 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1de7fff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 msgr2=0x7f1de80c4da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1de7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1de80c4da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52210/0 (socket says 172.21.15.81:52210) 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 -- 172.21.15.81:0/1739191374 learned_addr learned my addr 172.21.15.81:0/1739191374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1ded69a640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dd80047d0 0x7f1de8148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 -- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dd80047d0 msgr2=0x7f1de8148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dd80047d0 0x7f1de8148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 -- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 msgr2=0x7f1de80c4da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1de80c4da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 -- 172.21.15.81:0/1739191374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80c6cb0 con 0x7f1dcc003680 2024-05-08T20:43:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1dece99640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00be60 tx=0x7f1ddc005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00a5f0 con 0x7f1dcc003680 2024-05-08T20:43:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00a790 con 0x7f1dcc003680 2024-05-08T20:43:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de814ef10 con 0x7f1dcc003680 2024-05-08T20:43:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00ab80 con 0x7f1dcc003680 2024-05-08T20:43:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de8152980 con 0x7f1dcc003680 2024-05-08T20:43:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.816+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80675e0 con 0x7f1dcc003680 2024-05-08T20:43:58.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.820+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ddc00ace0 con 0x7f1dcc003680 2024-05-08T20:43:58.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.820+0000 7f1de57fa640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 0x7f1dcc0695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:58.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.820+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1ddc084c60 con 0x7f1dcc003680 2024-05-08T20:43:58.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.820+0000 7f1de7fff640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 0x7f1dcc0695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:58.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.820+0000 7f1de7fff640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 0x7f1dcc0695b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1de80c2980 tx=0x7f1dd40ad040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:58.828+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1ddc051ce0 con 0x7f1dcc003680 2024-05-08T20:43:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.112+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1de8154480 con 0x7f1dcc003680 2024-05-08T20:43:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1de57fa640 1 -- 172.21.15.81:0/1739191374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f1ddc009740 con 0x7f1dcc003680 2024-05-08T20:43:59.116 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":130,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:43:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 msgr2=0x7f1dcc0695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 0x7f1dcc0695b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1de80c2980 tx=0x7f1dd40ad040 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 msgr2=0x7f1de814e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00be60 tx=0x7f1ddc005420 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 shutdown_connections 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1dcc0670f0 0x7f1dcc0695b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1dd80047d0 0x7f1de8148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dd8003980 0x7f1de80c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 --2- 172.21.15.81:0/1739191374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dcc003680 0x7f1de814e9d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 >> 172.21.15.81:0/1739191374 conn(0x7f1de80c71b0 msgr2=0x7f1de80c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 shutdown_connections 2024-05-08T20:43:59.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.116+0000 7f1def0fd640 1 -- 172.21.15.81:0/1739191374 wait complete. 2024-05-08T20:43:59.136 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:43:59.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:43:59.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:43:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 Processor -- start 2024-05-08T20:43:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 -- start start 2024-05-08T20:43:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 0x7fc1340c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1340c7280 0x7fc13406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340c8b10 con 0x7fc134154970 2024-05-08T20:43:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134152690 con 0x7fc1340c7280 2024-05-08T20:43:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc13a111640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134069ec0 con 0x7fc1341522b0 2024-05-08T20:43:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc1337fe640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 msgr2=0x7fc1340c6d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc1337fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 0x7fc1340c6d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1340c7280 0x7fc13406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1340c7280 0x7fc13406a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52218/0 (socket says 172.21.15.81:52218) 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc133fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc134154970 0x7fc13406a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60558/0 (socket says 172.21.15.81:60558) 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 -- 172.21.15.81:0/496726679 learned_addr learned my addr 172.21.15.81:0/496726679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 -- 172.21.15.81:0/496726679 >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 msgr2=0x7fc1340c6d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 --2- 172.21.15.81:0/496726679 >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 0x7fc1340c6d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 -- 172.21.15.81:0/496726679 >> v1:172.21.15.81:6789/0 conn(0x7fc134154970 legacy=0x7fc13406a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc132ffd640 1 -- 172.21.15.81:0/496726679 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134154ee0 con 0x7fc1340c7280 2024-05-08T20:43:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.256+0000 7fc1327fc640 1 -- 172.21.15.81:0/496726679 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278591655 0 0) 0x7fc1340c8b10 con 0x7fc134154970 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc132ffd640 1 --2- 172.21.15.81:0/496726679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1340c7280 0x7fc13406a310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1340cb160 tx=0x7fc12801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb1d5a0d5bd7d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc1327fc640 1 -- 172.21.15.81:0/496726679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280ab680 con 0x7fc1340c7280 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc1327fc640 1 -- 172.21.15.81:0/496726679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1280ab7e0 con 0x7fc1340c7280 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc1327fc640 1 -- 172.21.15.81:0/496726679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280abb70 con 0x7fc1340c7280 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- 172.21.15.81:0/496726679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1340c7280 msgr2=0x7fc13406a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 --2- 172.21.15.81:0/496726679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1340c7280 0x7fc13406a310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1340cb160 tx=0x7fc12801c480 comp rx=0 tx=0).stop 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- 172.21.15.81:0/496726679 shutdown_connections 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 --2- 172.21.15.81:0/496726679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1340c7280 0x7fc13406a310 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1340cb160 tx=0x7fc12801c480 comp rx=0 tx=0).stop 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 --2- 172.21.15.81:0/496726679 >> v2:172.21.15.117:3300/0 conn(0x7fc1341522b0 0x7fc1340c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- 172.21.15.81:0/496726679 >> 172.21.15.81:0/496726679 conn(0x7fc1340ca330 msgr2=0x7fc1340ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- 172.21.15.81:0/496726679 shutdown_connections 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- 172.21.15.81:0/496726679 wait complete. 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 Processor -- start 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.260+0000 7fc13a111640 1 -- start start 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1341522b0 0x7fc134157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc134158b90 0x7fc1341f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341ed330 con 0x7fc134154970 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341562b0 con 0x7fc1341522b0 2024-05-08T20:43:59.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341ed5f0 con 0x7fc134158b90 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc1337fe640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1341522b0 msgr2=0x7fc134157ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc1337fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1341522b0 0x7fc134157ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52232/0 (socket says 172.21.15.81:52232) 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 -- 172.21.15.81:0/3329968115 learned_addr learned my addr 172.21.15.81:0/3329968115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc133fff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc134158b90 0x7fc1341f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc134158b90 msgr2=0x7fc1341f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc134158b90 0x7fc1341f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1341522b0 msgr2=0x7fc134157ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1341522b0 0x7fc134157ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128009480 con 0x7fc134154970 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc132ffd640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc12801a0b0 tx=0x7fc128019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280abd60 con 0x7fc134154970 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc128003620 con 0x7fc134154970 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1341ed8d0 con 0x7fc134154970 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280039d0 con 0x7fc134154970 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134158430 con 0x7fc134154970 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 0x7fc1341f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341ed4a0 con 0x7fc13414b9e0 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc1337fe640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 0x7fc1341f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc1337fe640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1341ed760 con 0x7fc13414b9e0 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc1337fe640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 0x7fc1341f0de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b450 tx=0x7fc12400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124003e20 con 0x7fc13414b9e0 2024-05-08T20:43:59.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc128003b30 con 0x7fc134154970 2024-05-08T20:43:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.264+0000 7fc11bfff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc120066730 0x7fc120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc12811f0b0 con 0x7fc134154970 2024-05-08T20:43:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc133fff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc120066730 0x7fc120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc124005070 con 0x7fc13414b9e0 2024-05-08T20:43:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 msgr2=0x7fc1341f0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 0x7fc1341f0de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b450 tx=0x7fc12400b910 comp rx=0 tx=0).stop 2024-05-08T20:43:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 msgr2=0x7fc1341f0de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc11bfff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc13414b9e0 0x7fc1341f0de0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b450 tx=0x7fc12400b910 comp rx=0 tx=0).stop 2024-05-08T20:43:59.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.268+0000 7fc133fff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc120066730 0x7fc120068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc12c007fd0 tx=0x7fc12c007e60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 0x7fc13414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc134069550 con 0x7fc134155d60 2024-05-08T20:43:59.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc1337fe640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 0x7fc13414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc1337fe640 1 -- 172.21.15.81:0/3329968115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc1340c9b00 con 0x7fc134155d60 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc1337fe640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 0x7fc13414a4e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b450 tx=0x7fc124005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12401f070 con 0x7fc134155d60 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7fc12401a070 con 0x7fc134155d60 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 msgr2=0x7fc13414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 0x7fc13414a4e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b450 tx=0x7fc124005a30 comp rx=0 tx=0).stop 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 msgr2=0x7fc13414a4e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc11bfff640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134155d60 0x7fc13414a4e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 130, 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc120066730 msgr2=0x7fc120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc120066730 0x7fc120068bf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc12c007fd0 tx=0x7fc12c007e60 comp rx=0 tx=0).stop 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 msgr2=0x7fc13414d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc12801a0b0 tx=0x7fc128019220 comp rx=0 tx=0).stop 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc133fff640 1 -- 172.21.15.81:0/3329968115 reap_dead start 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 shutdown_connections 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 --2- 172.21.15.81:0/3329968115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc134154970 0x7fc13414d6e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 >> 172.21.15.81:0/3329968115 conn(0x7fc1340ca330 msgr2=0x7fc1341541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 shutdown_connections 2024-05-08T20:43:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.276+0000 7fc13a111640 1 -- 172.21.15.81:0/3329968115 wait complete. 2024-05-08T20:43:59.298 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:43:59.298 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:43:59.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:43:59.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 Processor -- start 2024-05-08T20:43:59.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 -- start start 2024-05-08T20:43:59.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac155e90 0x7f88ac069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88ac06a500 0x7f88ac15d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac152ab0 con 0x7f88ac14fe70 2024-05-08T20:43:59.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac1528a0 con 0x7f88ac06a500 2024-05-08T20:43:59.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88b0de8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac152d90 con 0x7f88ac155e90 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88ac06a500 0x7f88ac15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aa59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88ac14fe70 0x7f88ac06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60574/0 (socket says 172.21.15.81:60574) 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88ac06a500 0x7f88ac15d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52262/0 (socket says 172.21.15.81:52262) 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aa59c640 1 -- 172.21.15.81:0/741671382 learned_addr learned my addr 172.21.15.81:0/741671382 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88a3fff640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac155e90 0x7f88ac069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 -- 172.21.15.81:0/741671382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac155e90 msgr2=0x7f88ac069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac155e90 0x7f88ac069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 -- 172.21.15.81:0/741671382 >> v1:172.21.15.81:6789/0 conn(0x7f88ac14fe70 legacy=0x7f88ac06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 -- 172.21.15.81:0/741671382 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac153070 con 0x7f88ac06a500 2024-05-08T20:43:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.416+0000 7f88aad9d640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac06a500 0x7f88ac15d220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d90 tx=0x7f88a401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a3bb2d941e2597 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a9d9b640 1 -- 172.21.15.81:0/741671382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40a58e0 con 0x7f88ac06a500 2024-05-08T20:43:59.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a9d9b640 1 -- 172.21.15.81:0/741671382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a40a5a40 con 0x7f88ac06a500 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a9d9b640 1 -- 172.21.15.81:0/741671382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40a5dd0 con 0x7f88ac06a500 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/741671382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac06a500 msgr2=0x7f88ac15d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac06a500 0x7f88ac15d220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d90 tx=0x7f88a401c820 comp rx=0 tx=0).stop 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/741671382 shutdown_connections 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac06a500 0x7f88ac15d220 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- 172.21.15.81:0/741671382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac155e90 0x7f88ac069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/741671382 >> 172.21.15.81:0/741671382 conn(0x7f88ac0c71b0 msgr2=0x7f88ac0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/741671382 shutdown_connections 2024-05-08T20:43:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/741671382 wait complete. 2024-05-08T20:43:59.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 Processor -- start 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- start start 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac06a500 0x7f88ac1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 0x7f88ac1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ac155e90 0x7f88ac1f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac070ad0 con 0x7f88ac14fe70 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac1f0fa0 con 0x7f88ac155e90 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac1f11b0 con 0x7f88ac06a500 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 0x7f88ac1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88aad9d640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ac155e90 msgr2=0x7f88ac1f0a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 0x7f88ac1ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52264/0 (socket says 172.21.15.81:52264) 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 -- 172.21.15.81:0/2261324702 learned_addr learned my addr 172.21.15.81:0/2261324702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88aad9d640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ac155e90 0x7f88ac1f0a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:43:59.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88aa59c640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac06a500 0x7f88ac1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac06a500 msgr2=0x7f88ac1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac06a500 0x7f88ac1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ac155e90 msgr2=0x7f88ac1f0a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ac155e90 0x7f88ac1f0a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a4009a70 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a3fff640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 0x7f88ac1ee0e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f889400d800 tx=0x7f889400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400b6c0 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889400b820 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac1451f0 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.420+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400bb90 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac1ed600 con 0x7f88ac14fe70 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88b0de8640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 0x7f88ac142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac069550 con 0x7f88ac1ed7c0 2024-05-08T20:43:59.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88aa59c640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 0x7f88ac142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f889400bcf0 con 0x7f88ac14fe70 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88aa59c640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88ac06dd10 con 0x7f88ac1ed7c0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f888c066670 0x7f888c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8894084990 con 0x7f88ac14fe70 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88aad9d640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f888c066670 0x7f888c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88aa59c640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 0x7f88ac142e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f70 tx=0x7f889c00e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c005ad0 con 0x7f88ac1ed7c0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88aad9d640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f888c066670 0x7f888c068b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88a40af000 tx=0x7f88a40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f889c005c30 con 0x7f88ac1ed7c0 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 msgr2=0x7f88ac142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 0x7f88ac142e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f70 tx=0x7f889c00e960 comp rx=0 tx=0).stop 2024-05-08T20:43:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 msgr2=0x7f88ac142e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:59.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.424+0000 7f88a2ffd640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac1ed7c0 0x7f88ac142e20 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f70 tx=0x7f889c00e960 comp rx=0 tx=0).stop 2024-05-08T20:43:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88b0de8640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 0x7f88ac14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:43:59.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0675e0 con 0x7f88ac143360 2024-05-08T20:43:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88aa59c640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 0x7f88ac14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:43:59.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88aa59c640 1 -- 172.21.15.81:0/2261324702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f88ac074950 con 0x7f88ac143360 2024-05-08T20:43:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88aa59c640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 0x7f88ac14b360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f70 tx=0x7f889c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:43:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.432+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0047f0 con 0x7f88ac143360 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4795 (secure 0 0 0) 0x7f889c004950 con 0x7f88ac143360 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 msgr2=0x7f88ac14b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88a2ffd640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 0x7f88ac14b360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f70 tx=0x7f889c000ee0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88a2ffd640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 msgr2=0x7f88ac14b360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88a2ffd640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88ac143360 0x7f88ac14b360 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:43:59.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 130, 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:59.437 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:43:59.440 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:43:59.441 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:43:59.442 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.445 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:43:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:43:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.447 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:43:59.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:43:59.450 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:59.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:59.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:43:59.453 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f888c066670 msgr2=0x7f888c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f888c066670 0x7f888c068b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88a40af000 tx=0x7f88a40a7070 comp rx=0 tx=0).stop 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 msgr2=0x7f88ac1ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 --2- 172.21.15.81:0/2261324702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88ac14fe70 0x7f88ac1ee0e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f889400d800 tx=0x7f889400dcc0 comp rx=0 tx=0).stop 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88aad9d640 1 -- 172.21.15.81:0/2261324702 reap_dead start 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88aad9d640 1 -- 172.21.15.81:0/2261324702 reap_dead start 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 shutdown_connections 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 >> 172.21.15.81:0/2261324702 conn(0x7f88ac0c71b0 msgr2=0x7f88ac06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 shutdown_connections 2024-05-08T20:43:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:43:59.436+0000 7f88b0de8640 1 -- 172.21.15.81:0/2261324702 wait complete. 2024-05-08T20:43:59.455 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:43:59.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:44:19.457 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:44:19.457 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:44:19.457 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:44:19.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:44:19.460 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:44:19.460 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:44:19.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 Processor -- start 2024-05-08T20:44:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 -- start start 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7074155140 con 0x7f70740aac30 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70740c32d0 con 0x7f70740c26e0 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f707b18c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740c4780 con 0x7f7074152220 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7079729640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70740aac30 0x7f70740c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45516/0 (socket says 172.21.15.81:45516) 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7079729640 1 -- 172.21.15.81:0/1993407671 learned_addr learned my addr 172.21.15.81:0/1993407671 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7078f28640 1 --2- 172.21.15.81:0/1993407671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f70737fe640 1 -- 172.21.15.81:0/1993407671 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797416075 0 0) 0x7f7074155140 con 0x7f70740aac30 2024-05-08T20:44:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7078f28640 1 -- 172.21.15.81:0/1993407671 >> v1:172.21.15.117:6789/0 conn(0x7f70740c26e0 legacy=0x7f70740c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7078f28640 1 -- 172.21.15.81:0/1993407671 >> v1:172.21.15.81:6789/0 conn(0x7f70740aac30 legacy=0x7f70740c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.591+0000 7f7078f28640 1 -- 172.21.15.81:0/1993407671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074072650 con 0x7f7074152220 2024-05-08T20:44:19.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f7078f28640 1 --2- 172.21.15.81:0/1993407671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741555d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f70640097f0 tx=0x7f706401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d51cddd5636a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:19.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f70737fe640 1 -- 172.21.15.81:0/1993407671 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640ab620 con 0x7f7074152220 2024-05-08T20:44:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f70737fe640 1 -- 172.21.15.81:0/1993407671 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70640ab780 con 0x7f7074152220 2024-05-08T20:44:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f70737fe640 1 -- 172.21.15.81:0/1993407671 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640abb10 con 0x7f7074152220 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 -- 172.21.15.81:0/1993407671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 msgr2=0x7f70741555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 --2- 172.21.15.81:0/1993407671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741555d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f70640097f0 tx=0x7f706401c420 comp rx=0 tx=0).stop 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 -- 172.21.15.81:0/1993407671 shutdown_connections 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 --2- 172.21.15.81:0/1993407671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741555d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 -- 172.21.15.81:0/1993407671 >> 172.21.15.81:0/1993407671 conn(0x7f70740c4cc0 msgr2=0x7f70740c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 -- 172.21.15.81:0/1993407671 shutdown_connections 2024-05-08T20:44:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.595+0000 7f707b18c640 1 -- 172.21.15.81:0/1993407671 wait complete. 2024-05-08T20:44:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 Processor -- start 2024-05-08T20:44:19.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- start start 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741ede00 con 0x7f70740aac30 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741ecec0 con 0x7f70740c26e0 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740c5fc0 con 0x7f7074152220 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35586/0 (socket says 172.21.15.81:35586) 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 -- 172.21.15.81:0/4152226813 learned_addr learned my addr 172.21.15.81:0/4152226813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:19.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7073fff640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7079729640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7073fff640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 msgr2=0x7f70741ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7073fff640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 msgr2=0x7f70741ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7073fff640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7073fff640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 msgr2=0x7f70741ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 msgr2=0x7f70741ed380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 -- 172.21.15.81:0/4152226813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064009420 con 0x7f70740aac30 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f7078f28640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70640ad040 tx=0x7f706401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640bf410 con 0x7f70740aac30 2024-05-08T20:44:19.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70640bf5b0 con 0x7f70740aac30 2024-05-08T20:44:19.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640bf960 con 0x7f70740aac30 2024-05-08T20:44:19.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7074153790 con 0x7f70740aac30 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.599+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70741534b0 con 0x7f70740aac30 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074074950 con 0x7f70740aac30 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70640b5400 con 0x7f70740aac30 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f70717fa640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 0x7f7060068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f706411f0f0 con 0x7f70740aac30 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f7073fff640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 0x7f7060068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:19.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.603+0000 7f7073fff640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 0x7f7060068b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f70741ead00 tx=0x7f7068009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.607+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f70640ec280 con 0x7f70740aac30 2024-05-08T20:44:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.851+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f70740aaa10 con 0x7f70740aac30 2024-05-08T20:44:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.851+0000 7f70717fa640 1 -- 172.21.15.81:0/4152226813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f70640c4620 con 0x7f70740aac30 2024-05-08T20:44:19.856 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":130,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 msgr2=0x7f7060068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 0x7f7060068b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f70741ead00 tx=0x7f7068009040 comp rx=0 tx=0).stop 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 msgr2=0x7f707415f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f70640ad040 tx=0x7f706401ac60 comp rx=0 tx=0).stop 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 shutdown_connections 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7060066690 0x7f7060068b50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7074152220 0x7f70741ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70740c26e0 0x7f70741ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 --2- 172.21.15.81:0/4152226813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70740aac30 0x7f707415f800 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 >> 172.21.15.81:0/4152226813 conn(0x7f70740c4cc0 msgr2=0x7f70740abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 shutdown_connections 2024-05-08T20:44:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:19.855+0000 7f707b18c640 1 -- 172.21.15.81:0/4152226813 wait complete. 2024-05-08T20:44:22.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 Processor -- start 2024-05-08T20:44:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 -- start start 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52680c3510 0x7f52680aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f5268153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5268153880 con 0x7f52680c3510 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680c47c0 con 0x7f52680c38f0 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526e744640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c6220 con 0x7f52680a9970 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52680c3510 0x7f52680aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52680c3510 0x7f52680aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35600/0 (socket says 172.21.15.81:35600) 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 -- 172.21.15.81:0/1892263742 learned_addr learned my addr 172.21.15.81:0/1892263742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f52677fe640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f5268153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526cce1640 1 --2- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 -- 172.21.15.81:0/1892263742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 msgr2=0x7f5268153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f5268153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 -- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 msgr2=0x7f52680c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526cce1640 1 -- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 msgr2=0x7f52680c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526cce1640 1 -- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 msgr2=0x7f52680c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526cce1640 1 --2- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f526cce1640 1 --2- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 --2- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f5267fff640 1 -- 172.21.15.81:0/1892263742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680c6500 con 0x7f52680c3510 2024-05-08T20:44:23.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.011+0000 7f52677fe640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f5268153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:44:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f5267fff640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c3510 0x7f52680aaa80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5268065e10 tx=0x7f525801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c07be65f0ac9012 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f5266ffd640 1 -- 172.21.15.81:0/1892263742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580ab620 con 0x7f52680c3510 2024-05-08T20:44:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f5266ffd640 1 -- 172.21.15.81:0/1892263742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580ab780 con 0x7f52680c3510 2024-05-08T20:44:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f5266ffd640 1 -- 172.21.15.81:0/1892263742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580abb10 con 0x7f52680c3510 2024-05-08T20:44:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- 172.21.15.81:0/1892263742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c3510 msgr2=0x7f52680aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c3510 0x7f52680aaa80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5268065e10 tx=0x7f525801c460 comp rx=0 tx=0).stop 2024-05-08T20:44:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- 172.21.15.81:0/1892263742 shutdown_connections 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f5268153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 --2- 172.21.15.81:0/1892263742 >> v2:172.21.15.117:3300/0 conn(0x7f52680c38f0 0x7f52680c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 --2- 172.21.15.81:0/1892263742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c3510 0x7f52680aaa80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- 172.21.15.81:0/1892263742 >> 172.21.15.81:0/1892263742 conn(0x7f52680c68c0 msgr2=0x7f52680c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- 172.21.15.81:0/1892263742 shutdown_connections 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- 172.21.15.81:0/1892263742 wait complete. 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 Processor -- start 2024-05-08T20:44:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.015+0000 7f526e744640 1 -- start start 2024-05-08T20:44:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f526806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526806d930 con 0x7f52680c38f0 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680bfe90 con 0x7f52680c3510 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c0170 con 0x7f52680a9970 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35614/0 (socket says 172.21.15.81:35614) 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 -- 172.21.15.81:0/461750331 learned_addr learned my addr 172.21.15.81:0/461750331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f5267fff640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f526806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f52677fe640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f52677fe640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 msgr2=0x7f5268148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f52677fe640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 msgr2=0x7f5268148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 msgr2=0x7f526806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f52677fe640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f526806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 msgr2=0x7f5268148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f52677fe640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 -- 172.21.15.81:0/461750331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580094d0 con 0x7f52680c38f0 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526cce1640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52600070b0 tx=0x7f526000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260014420 con 0x7f52680c38f0 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260014580 con 0x7f52680c38f0 2024-05-08T20:44:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260014930 con 0x7f52680c38f0 2024-05-08T20:44:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680c0450 con 0x7f52680c38f0 2024-05-08T20:44:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5268148610 con 0x7f52680c38f0 2024-05-08T20:44:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.019+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268074950 con 0x7f52680c38f0 2024-05-08T20:44:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.023+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5260014a90 con 0x7f52680c38f0 2024-05-08T20:44:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.023+0000 7f5264ff9640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 0x7f5254068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.023+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5260084c90 con 0x7f52680c38f0 2024-05-08T20:44:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.023+0000 7f5267fff640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 0x7f5254068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.023+0000 7f5267fff640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 0x7f5254068b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52580af000 tx=0x7f52580b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:23.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.027+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5260051cf0 con 0x7f52680c38f0 2024-05-08T20:44:23.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.295+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5268066100 con 0x7f52680c38f0 2024-05-08T20:44:23.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.295+0000 7f5264ff9640 1 -- 172.21.15.81:0/461750331 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f5260055310 con 0x7f52680c38f0 2024-05-08T20:44:23.298 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":130,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 msgr2=0x7f5254068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 0x7f5254068b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f52580af000 tx=0x7f52580b6040 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 msgr2=0x7f5268149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52600070b0 tx=0x7f526000e4b0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 shutdown_connections 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5254066690 0x7f5254068b50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52680c38f0 0x7f5268149070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52680c3510 0x7f5268148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 --2- 172.21.15.81:0/461750331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52680a9970 0x7f526806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 >> 172.21.15.81:0/461750331 conn(0x7f52680c68c0 msgr2=0x7f52680c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 shutdown_connections 2024-05-08T20:44:23.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:23.299+0000 7f526e744640 1 -- 172.21.15.81:0/461750331 wait complete. 2024-05-08T20:44:23.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:44:23.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:44:26.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:26.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 Processor -- start 2024-05-08T20:44:26.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 -- start start 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 0x7f79781588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7978158e20 con 0x7f7978154cf0 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7978155860 con 0x7f79780ca000 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.467+0000 7f797ce7e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797806bb20 con 0x7f7978151f00 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7978154cf0 0x7f7978155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 -- 172.21.15.81:0/1466869684 learned_addr learned my addr 172.21.15.81:0/1466869684 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 --2- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 0x7f79781588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115853157 0 0) 0x7f7978158e20 con 0x7f7978154cf0 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7960003530 con 0x7f7978154cf0 2024-05-08T20:44:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 -- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 msgr2=0x7f79781588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 -- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 msgr2=0x7f79781588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 --2- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 0x7f79781588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 --2- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 0x7f79781588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1544080362 0 0) 0x7f7960003530 con 0x7f7978154cf0 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 msgr2=0x7f79781588e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 --2- 172.21.15.81:0/1466869684 >> v2:172.21.15.117:3300/0 conn(0x7f7978151f00 0x7f79781588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 >> v1:172.21.15.117:6789/0 conn(0x7f79780ca000 legacy=0x7f79780ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79781522e0 con 0x7f7978154cf0 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f796c001680 con 0x7f7978154cf0 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 >> v1:172.21.15.81:6789/0 conn(0x7f7978154cf0 legacy=0x7f7978155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960003980 0x7f7960003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f7960004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960005390 0x7f796000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796000c1f0 con 0x7f79600047d0 2024-05-08T20:44:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796000c360 con 0x7f7960003980 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796000c520 con 0x7f7960005390 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f7960004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797659c640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960003980 0x7f7960003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7976d9d640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960005390 0x7f796000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 -- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960005390 msgr2=0x7f796000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960005390 0x7f796000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 -- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960003980 msgr2=0x7f7960003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960003980 0x7f7960003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 -- 172.21.15.81:0/1466869684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960003530 con 0x7f79600047d0 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7976d9d640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7960005390 0x7f796000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:44:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7976d9d640 1 -- 172.21.15.81:0/1466869684 reap_dead start 2024-05-08T20:44:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f7975d9b640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f7960004c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c240 tx=0x7f796c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d46f312c4e7695d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a5b60 con 0x7f79600047d0 2024-05-08T20:44:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a5ce0 con 0x7f79600047d0 2024-05-08T20:44:26.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.471+0000 7f797559a640 1 -- 172.21.15.81:0/1466869684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c005b20 con 0x7f79600047d0 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 msgr2=0x7f7960004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f7960004c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c240 tx=0x7f796c01cc60 comp rx=0 tx=0).stop 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- 172.21.15.81:0/1466869684 shutdown_connections 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 --2- 172.21.15.81:0/1466869684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f7960004c50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- 172.21.15.81:0/1466869684 >> 172.21.15.81:0/1466869684 conn(0x7f79780715f0 msgr2=0x7f7978071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- 172.21.15.81:0/1466869684 shutdown_connections 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- 172.21.15.81:0/1466869684 wait complete. 2024-05-08T20:44:26.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 Processor -- start 2024-05-08T20:44:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- start start 2024-05-08T20:44:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79781ed850 0x7f797814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 0x7f79781f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780ae5b0 con 0x7f79600047d0 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780af2f0 con 0x7f79781ed850 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797ce7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797814b540 con 0x7f797814b9d0 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35638/0 (socket says 172.21.15.81:35638) 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 -- 172.21.15.81:0/947773128 learned_addr learned my addr 172.21.15.81:0/947773128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f7975d9b640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79781ed850 0x7f797814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f7976d9d640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 0x7f79781f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 -- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 msgr2=0x7f79781f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 0x7f79781f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 -- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79781ed850 msgr2=0x7f797814d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79781ed850 0x7f797814d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f797659c640 1 -- 172.21.15.81:0/947773128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797814a930 con 0x7f79600047d0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.475+0000 7f7976d9d640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 0x7f79781f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f797659c640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79680108c0 tx=0x7f7968010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800eb60 con 0x7f79600047d0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800c050 con 0x7f79600047d0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797814ac10 con 0x7f79600047d0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800ae60 con 0x7f79600047d0 2024-05-08T20:44:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797814b1d0 con 0x7f79600047d0 2024-05-08T20:44:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780c9900 con 0x7f79600047d0 2024-05-08T20:44:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7968015470 con 0x7f79600047d0 2024-05-08T20:44:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 0x7f7958068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.479+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7968084f30 con 0x7f79600047d0 2024-05-08T20:44:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.483+0000 7f7975d9b640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 0x7f7958068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.483+0000 7f7975d9b640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 0x7f7958068b80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ab000 tx=0x7f796c006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.483+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7968052070 con 0x7f79600047d0 2024-05-08T20:44:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.751+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7978074950 con 0x7f79600047d0 2024-05-08T20:44:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f7966ffd640 1 -- 172.21.15.81:0/947773128 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f7968055690 con 0x7f79600047d0 2024-05-08T20:44:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":132,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 msgr2=0x7f7958068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 0x7f7958068b80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ab000 tx=0x7f796c006040 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 msgr2=0x7f79780ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79680108c0 tx=0x7f7968010d80 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 shutdown_connections 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f79580666c0 0x7f7958068b80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f797814b9d0 0x7f79781f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79781ed850 0x7f797814d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 --2- 172.21.15.81:0/947773128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79600047d0 0x7f79780ac2d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 >> 172.21.15.81:0/947773128 conn(0x7f79780715f0 msgr2=0x7f79780c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 shutdown_connections 2024-05-08T20:44:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.755+0000 7f797ce7e640 1 -- 172.21.15.81:0/947773128 wait complete. 2024-05-08T20:44:26.779 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:44:26.779 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:44:26.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:44:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 Processor -- start 2024-05-08T20:44:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 -- start start 2024-05-08T20:44:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0200c2bc0 0x7fc0200c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0200a94b0 0x7fc0200a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc020155e10 con 0x7fc0200c30d0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006e790 con 0x7fc0200c2bc0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc027c98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02006f460 con 0x7fc0200a94b0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0200c2bc0 0x7fc0200c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0200c2bc0 0x7fc0200c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35644/0 (socket says 172.21.15.81:35644) 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 -- 172.21.15.81:0/332905534 learned_addr learned my addr 172.21.15.81:0/332905534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025a34640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc0200c30d0 0x7fc0200c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45538/0 (socket says 172.21.15.81:45538) 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc026235640 1 --2- 172.21.15.81:0/332905534 >> v2:172.21.15.117:3300/0 conn(0x7fc0200a94b0 0x7fc0200a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 -- 172.21.15.81:0/332905534 >> v2:172.21.15.117:3300/0 conn(0x7fc0200a94b0 msgr2=0x7fc0200a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 --2- 172.21.15.81:0/332905534 >> v2:172.21.15.117:3300/0 conn(0x7fc0200a94b0 0x7fc0200a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 -- 172.21.15.81:0/332905534 >> v1:172.21.15.81:6789/0 conn(0x7fc0200c30d0 legacy=0x7fc0200c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc024a32640 1 -- 172.21.15.81:0/332905534 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687618236 0 0) 0x7fc020155e10 con 0x7fc0200c30d0 2024-05-08T20:44:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.903+0000 7fc025233640 1 -- 172.21.15.81:0/332905534 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020156080 con 0x7fc0200c2bc0 2024-05-08T20:44:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc025233640 1 --2- 172.21.15.81:0/332905534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c34b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc0200c3d60 tx=0x7fc01001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f79aba4fc19586 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc024a32640 1 -- 172.21.15.81:0/332905534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100ab660 con 0x7fc0200c2bc0 2024-05-08T20:44:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc024a32640 1 -- 172.21.15.81:0/332905534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100ab7c0 con 0x7fc0200c2bc0 2024-05-08T20:44:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc024a32640 1 -- 172.21.15.81:0/332905534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100abb50 con 0x7fc0200c2bc0 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 -- 172.21.15.81:0/332905534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c2bc0 msgr2=0x7fc0200c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 --2- 172.21.15.81:0/332905534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c34b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc0200c3d60 tx=0x7fc01001c460 comp rx=0 tx=0).stop 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 -- 172.21.15.81:0/332905534 shutdown_connections 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 --2- 172.21.15.81:0/332905534 >> v2:172.21.15.117:3300/0 conn(0x7fc0200a94b0 0x7fc0200a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 --2- 172.21.15.81:0/332905534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c34b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 -- 172.21.15.81:0/332905534 >> 172.21.15.81:0/332905534 conn(0x7fc0200c4cc0 msgr2=0x7fc0200c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 -- 172.21.15.81:0/332905534 shutdown_connections 2024-05-08T20:44:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.907+0000 7fc027c98640 1 -- 172.21.15.81:0/332905534 wait complete. 2024-05-08T20:44:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 Processor -- start 2024-05-08T20:44:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- start start 2024-05-08T20:44:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200a94b0 0x7fc020153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc020143a70 con 0x7fc0200c30d0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201536d0 con 0x7fc0200c2bc0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201443e0 con 0x7fc0200a94b0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35660/0 (socket says 172.21.15.81:35660) 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 -- 172.21.15.81:0/2438759184 learned_addr learned my addr 172.21.15.81:0/2438759184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025233640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200a94b0 0x7fc020153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200a94b0 msgr2=0x7fc020153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200a94b0 0x7fc020153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c2bc0 msgr2=0x7fc0200c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c2bc0 0x7fc0200c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100094d0 con 0x7fc0200c30d0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200a94b0 0x7fc020153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc026235640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc018007e40 tx=0x7fc01800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018014620 con 0x7fc0200c30d0 2024-05-08T20:44:26.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800ee90 con 0x7fc0200c30d0 2024-05-08T20:44:26.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc020144680 con 0x7fc0200c30d0 2024-05-08T20:44:26.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0180149e0 con 0x7fc0200c30d0 2024-05-08T20:44:26.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc020144c40 con 0x7fc0200c30d0 2024-05-08T20:44:26.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 0x7fc020143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc020073ea0 con 0x7fc0201eb320 2024-05-08T20:44:26.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 0x7fc020143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025a34640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0200723c0 con 0x7fc0201eb320 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.911+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 0x7fc020143bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d4c0 tx=0x7fc01c00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0074e0 con 0x7fc0201eb320 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc018014b40 con 0x7fc0200c30d0 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc004066730 0x7fc004068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc018084ef0 con 0x7fc0200c30d0 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc025233640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc004066730 0x7fc004068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc01c007640 con 0x7fc0201eb320 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 msgr2=0x7fc020143bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 0x7fc020143bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d4c0 tx=0x7fc01c00d980 comp rx=0 tx=0).stop 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 msgr2=0x7fc020143bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc0167fc640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201eb320 0x7fc020143bb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.915+0000 7fc025233640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc004066730 0x7fc004068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0100af000 tx=0x7fc0100a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.919+0000 7fc027c98640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 0x7fc0201ee350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:26.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.919+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200c4970 con 0x7fc0201463e0 2024-05-08T20:44:26.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.919+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 0x7fc0201ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.919+0000 7fc025a34640 1 -- 172.21.15.81:0/2438759184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc020074950 con 0x7fc0201463e0 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.919+0000 7fc025a34640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 0x7fc0201ee350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d4c0 tx=0x7fc01c001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c021070 con 0x7fc0201463e0 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7fc01c013470 con 0x7fc0201463e0 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 msgr2=0x7fc0201ee350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 0x7fc0201ee350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d4c0 tx=0x7fc01c001090 comp rx=0 tx=0).stop 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 msgr2=0x7fc0201ee350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc0167fc640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0201463e0 0x7fc0201ee350 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d4c0 tx=0x7fc01c001090 comp rx=0 tx=0).stop 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:44:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:44:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:26.937 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:26.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc004066730 msgr2=0x7fc004068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc004066730 0x7fc004068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc0100af000 tx=0x7fc0100a7000 comp rx=0 tx=0).stop 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 msgr2=0x7fc0201eade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc018007e40 tx=0x7fc01800e4b0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc026235640 1 -- 172.21.15.81:0/2438759184 reap_dead start 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 shutdown_connections 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 --2- 172.21.15.81:0/2438759184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0200c30d0 0x7fc0201eade0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 >> 172.21.15.81:0/2438759184 conn(0x7fc0200c4cc0 msgr2=0x7fc0200c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 shutdown_connections 2024-05-08T20:44:26.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:26.923+0000 7fc027c98640 1 -- 172.21.15.81:0/2438759184 wait complete. 2024-05-08T20:44:26.941 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:26.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:44:26.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:44:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 Processor -- start 2024-05-08T20:44:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 -- start start 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f036c152340 0x7f036c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c158080 con 0x7f036c0c2570 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c06ab70 con 0x7f036c152340 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0372e2e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c154b10 con 0x7f036c06d7d0 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f036c152340 0x7f036c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f036c152340 0x7f036c06d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35684/0 (socket says 172.21.15.81:35684) 2024-05-08T20:44:27.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 -- 172.21.15.81:0/1042006388 learned_addr learned my addr 172.21.15.81:0/1042006388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f03713cb640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 -- 172.21.15.81:0/1042006388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 msgr2=0x7f036c155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.051+0000 7f0370bca640 1 -- 172.21.15.81:0/1042006388 >> v1:172.21.15.117:6789/0 conn(0x7f036c0c2570 legacy=0x7f036c154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0370bca640 1 -- 172.21.15.81:0/1042006388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c06a890 con 0x7f036c152340 2024-05-08T20:44:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0370bca640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c152340 0x7f036c06d290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0360009870 tx=0x7f036001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1dfe0d0dadbf8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f036b7fe640 1 -- 172.21.15.81:0/1042006388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600a6040 con 0x7f036c152340 2024-05-08T20:44:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f036b7fe640 1 -- 172.21.15.81:0/1042006388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03600aa600 con 0x7f036c152340 2024-05-08T20:44:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f036b7fe640 1 -- 172.21.15.81:0/1042006388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600aa990 con 0x7f036c152340 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 -- 172.21.15.81:0/1042006388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c152340 msgr2=0x7f036c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c152340 0x7f036c06d290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0360009870 tx=0x7f036001c4a0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 -- 172.21.15.81:0/1042006388 shutdown_connections 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 --2- 172.21.15.81:0/1042006388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c152340 0x7f036c06d290 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 -- 172.21.15.81:0/1042006388 >> 172.21.15.81:0/1042006388 conn(0x7f036c0c71b0 msgr2=0x7f036c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 -- 172.21.15.81:0/1042006388 shutdown_connections 2024-05-08T20:44:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.055+0000 7f0372e2e640 1 -- 172.21.15.81:0/1042006388 wait complete. 2024-05-08T20:44:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 Processor -- start 2024-05-08T20:44:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- start start 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0c2570 0x7f036c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0ab310 con 0x7f036c0c4da0 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1f1790 con 0x7f036c0c2570 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0aa5e0 con 0x7f036c06d7d0 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35694/0 (socket says 172.21.15.81:35694) 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 -- 172.21.15.81:0/4247657344 learned_addr learned my addr 172.21.15.81:0/4247657344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f036bfff640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0c2570 0x7f036c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 msgr2=0x7f036c0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f036c06d7d0 0x7f036c0c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0c2570 msgr2=0x7f036c0c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0c2570 0x7f036c0c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600094d0 con 0x7f036c0c4da0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03713cb640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0364007e40 tx=0x7f036400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364014620 con 0x7f036c0c4da0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03640147a0 con 0x7f036c0c4da0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c0acd60 con 0x7f036c0c4da0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364014b50 con 0x7f036c0c4da0 2024-05-08T20:44:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c0c42e0 con 0x7f036c0c4da0 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c069550 con 0x7f036c0aaa50 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.059+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0364014cb0 con 0x7f036c0c4da0 2024-05-08T20:44:27.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f03697fa640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0350066690 0x7f0350068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:27.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0364084ed0 con 0x7f036c0c4da0 2024-05-08T20:44:27.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f036bfff640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0350066690 0x7f0350068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.063+0000 7f036bfff640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0350066690 0x7f0350068b50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f036c1f0790 tx=0x7f0358009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.267+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.267+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:44:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.267+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.267+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.267+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:44:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.671+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.671+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:44:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.671+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.671+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:27.671+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:44:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:28.475+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:28.475+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:44:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:28.475+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:44:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:28.475+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:28.475+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:44:30.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f036c161bf0 con 0x7f036c0aaa50 2024-05-08T20:44:30.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036c06fe70 tx=0x7f0360019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600aade0 con 0x7f036c0aaa50 2024-05-08T20:44:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f03600bd480 con 0x7f036c0aaa50 2024-05-08T20:44:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036c06fe70 tx=0x7f0360019240 comp rx=0 tx=0).stop 2024-05-08T20:44:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 msgr2=0x7f036c1f0fd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.079+0000 7f03697fa640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c0aaa50 0x7f036c1f0fd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.087+0000 7f0372e2e640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 0x7f036c1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.087+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0675e0 con 0x7f036c141cc0 2024-05-08T20:44:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.087+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 0x7f036c1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0370bca640 1 -- 172.21.15.81:0/4247657344 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f036c1f1510 con 0x7f036c141cc0 2024-05-08T20:44:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0370bca640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 0x7f036c1420a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c10 tx=0x7f0360008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600a6040 con 0x7f036c141cc0 2024-05-08T20:44:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f0360003c20 con 0x7f036c141cc0 2024-05-08T20:44:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 msgr2=0x7f036c1420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 0x7f036c1420a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c10 tx=0x7f0360008040 comp rx=0 tx=0).stop 2024-05-08T20:44:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 msgr2=0x7f036c1420a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:30.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03697fa640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f036c141cc0 0x7f036c1420a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0350066690 msgr2=0x7f0350068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0350066690 0x7f0350068b50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f036c1f0790 tx=0x7f0358009040 comp rx=0 tx=0).stop 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 msgr2=0x7f036c1f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0364007e40 tx=0x7f036400e4b0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f03713cb640 1 -- 172.21.15.81:0/4247657344 reap_dead start 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 shutdown_connections 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 --2- 172.21.15.81:0/4247657344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f036c0c4da0 0x7f036c1f0a90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 >> 172.21.15.81:0/4247657344 conn(0x7f036c0c71b0 msgr2=0x7f036c0c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 shutdown_connections 2024-05-08T20:44:30.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.091+0000 7f0372e2e640 1 -- 172.21.15.81:0/4247657344 wait complete. 2024-05-08T20:44:30.118 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:30.118 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:44:30.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:44:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 Processor -- start 2024-05-08T20:44:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 -- start start 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9280c2c80 0x7fb9280c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9281520a0 con 0x7fb92806c250 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9280c13e0 con 0x7fb92814f1a0 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92f435640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9281517d0 con 0x7fb9280c2c80 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb92806c250 0x7fb9280c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58830/0 (socket says 172.21.15.81:58830) 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 -- 172.21.15.81:0/2083323177 learned_addr learned my addr 172.21.15.81:0/2083323177 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92d9d2640 1 --2- 172.21.15.81:0/2083323177 >> v2:172.21.15.117:3300/0 conn(0x7fb9280c2c80 0x7fb9280c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293043561 0 0) 0x7fb9281520a0 con 0x7fb92806c250 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb914003530 con 0x7fb92806c250 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104865839 0 0) 0x7fb914003530 con 0x7fb92806c250 2024-05-08T20:44:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 >> v2:172.21.15.117:3300/0 conn(0x7fb9280c2c80 msgr2=0x7fb9280c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 --2- 172.21.15.81:0/2083323177 >> v2:172.21.15.117:3300/0 conn(0x7fb9280c2c80 0x7fb9280c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 >> v1:172.21.15.117:6789/0 conn(0x7fb92814f1a0 legacy=0x7fb9280c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280c1660 con 0x7fb92806c250 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb918001680 con 0x7fb92806c250 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 >> v1:172.21.15.81:6789/0 conn(0x7fb92806c250 legacy=0x7fb9280c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb914003980 0x7fb914003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9140052b0 0x7fb91400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9281517d0 con 0x7fb9140047d0 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91400c180 con 0x7fb9140052b0 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91400c340 con 0x7fb914003980 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb914003980 0x7fb914003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 -- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb914003980 msgr2=0x7fb914003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb914003980 0x7fb914003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 -- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9140052b0 msgr2=0x7fb91400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9140052b0 0x7fb91400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92c9d0640 1 -- 172.21.15.81:0/2083323177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914003530 con 0x7fb9140047d0 2024-05-08T20:44:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.251+0000 7fb92d9d2640 1 -- 172.21.15.81:0/2083323177 reap_dead start 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 0x7fb914004c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c210 tx=0x7fb91801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c53d2cef53138f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918005ae0 con 0x7fb9140047d0 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918005c40 con 0x7fb9140047d0 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb91ffff640 1 -- 172.21.15.81:0/2083323177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180072b0 con 0x7fb9140047d0 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 -- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 msgr2=0x7fb914004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 0x7fb914004c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c210 tx=0x7fb91801cc40 comp rx=0 tx=0).stop 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 -- 172.21.15.81:0/2083323177 shutdown_connections 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 --2- 172.21.15.81:0/2083323177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 -- 172.21.15.81:0/2083323177 >> 172.21.15.81:0/2083323177 conn(0x7fb9280c68c0 msgr2=0x7fb9280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 -- 172.21.15.81:0/2083323177 shutdown_connections 2024-05-08T20:44:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 -- 172.21.15.81:0/2083323177 wait complete. 2024-05-08T20:44:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.255+0000 7fb92f435640 1 Processor -- start 2024-05-08T20:44:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- start start 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9140047d0 0x7fb9281eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 0x7fb9280bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9280bff40 0x7fb92814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280bde80 con 0x7fb9280bb8e0 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280720b0 con 0x7fb9280bff40 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb928071d60 con 0x7fb9140047d0 2024-05-08T20:44:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 0x7fb9280bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 0x7fb9280bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43104/0 (socket says 172.21.15.81:43104) 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 -- 172.21.15.81:0/3897662905 learned_addr learned my addr 172.21.15.81:0/3897662905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9140047d0 0x7fb9281eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92d9d2640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9280bff40 0x7fb92814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9140047d0 msgr2=0x7fb9281eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9140047d0 0x7fb9281eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9280bff40 msgr2=0x7fb92814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9280bff40 0x7fb92814b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280724d0 con 0x7fb9280bb8e0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92c9d0640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 0x7fb9280bfa00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb91801ca70 tx=0x7fb914005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180b4070 con 0x7fb9280bb8e0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918001500 con 0x7fb9280bb8e0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9280a61f0 con 0x7fb9280bb8e0 2024-05-08T20:44:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918007290 con 0x7fb9280bb8e0 2024-05-08T20:44:30.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9281ef7b0 con 0x7fb9280bb8e0 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 0x7fb92814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb928069550 con 0x7fb92814bbb0 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 0x7fb92814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9180073f0 con 0x7fb9280bb8e0 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.259+0000 7fb92d1d1640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9280c60e0 con 0x7fb92814bbb0 2024-05-08T20:44:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 0x7fb92814bf90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb924003d30 tx=0x7fb924001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb90c0666c0 0x7fb90c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb91811e020 con 0x7fb9280bb8e0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb92d9d2640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb90c0666c0 0x7fb90c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240124d0 con 0x7fb92814bbb0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb92d9d2640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb90c0666c0 0x7fb90c068b80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb928065dc0 tx=0x7fb92000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb924012630 con 0x7fb92814bbb0 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 msgr2=0x7fb92814bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 0x7fb92814bf90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb924003d30 tx=0x7fb924001670 comp rx=0 tx=0).stop 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 msgr2=0x7fb92814bf90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.263+0000 7fb91dffb640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb92814bbb0 0x7fb92814bf90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 0x7fb9281eb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92814c4d0 con 0x7fb9281eb4b0 2024-05-08T20:44:30.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 0x7fb9281eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92d1d1640 1 -- 172.21.15.81:0/3897662905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb928074950 con 0x7fb9281eb4b0 2024-05-08T20:44:30.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92d1d1640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 0x7fb9281eb890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb924017000 tx=0x7fb924001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924015660 con 0x7fb9281eb4b0 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7fb924027470 con 0x7fb9281eb4b0 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 msgr2=0x7fb9281eb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 0x7fb9281eb890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb924017000 tx=0x7fb924001130 comp rx=0 tx=0).stop 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 msgr2=0x7fb9281eb890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb91dffb640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9281eb4b0 0x7fb9281eb890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.275 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:30.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb90c0666c0 msgr2=0x7fb90c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb90c0666c0 0x7fb90c068b80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb928065dc0 tx=0x7fb92000d040 comp rx=0 tx=0).stop 2024-05-08T20:44:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 msgr2=0x7fb9280bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 --2- 172.21.15.81:0/3897662905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9280bb8e0 0x7fb9280bfa00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb91801ca70 tx=0x7fb914005800 comp rx=0 tx=0).stop 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92d9d2640 1 -- 172.21.15.81:0/3897662905 reap_dead start 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92d9d2640 1 -- 172.21.15.81:0/3897662905 reap_dead start 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 shutdown_connections 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 >> 172.21.15.81:0/3897662905 conn(0x7fb9280c68c0 msgr2=0x7fb9280c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 shutdown_connections 2024-05-08T20:44:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.271+0000 7fb92f435640 1 -- 172.21.15.81:0/3897662905 wait complete. 2024-05-08T20:44:30.291 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:30.291 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:44:30.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:44:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 Processor -- start 2024-05-08T20:44:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 -- start start 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d0152340 0x7f73d006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d0158080 con 0x7f73d00c2570 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d006a890 con 0x7f73d006d7d0 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73d5200640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d006ab70 con 0x7f73d0152340 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d0152340 0x7f73d006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73d0152340 0x7f73d006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43120/0 (socket says 172.21.15.81:43120) 2024-05-08T20:44:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 -- 172.21.15.81:0/571215395 learned_addr learned my addr 172.21.15.81:0/571215395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 -- 172.21.15.81:0/571215395 >> v1:172.21.15.117:6789/0 conn(0x7f73d006d7d0 legacy=0x7f73d015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 -- 172.21.15.81:0/571215395 >> v1:172.21.15.81:6789/0 conn(0x7f73d00c2570 legacy=0x7f73d0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73ced9d640 1 -- 172.21.15.81:0/571215395 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d00c2d70 con 0x7f73d0152340 2024-05-08T20:44:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.431+0000 7f73cdd9b640 1 -- 172.21.15.81:0/571215395 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126865949 0 0) 0x7f73d0158080 con 0x7f73d00c2570 2024-05-08T20:44:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73ced9d640 1 --2- 172.21.15.81:0/571215395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d0152340 0x7f73d006d290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dfd952feeaf524 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73cdd9b640 1 -- 172.21.15.81:0/571215395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00ac640 con 0x7f73d0152340 2024-05-08T20:44:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73cdd9b640 1 -- 172.21.15.81:0/571215395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c00ac7a0 con 0x7f73d0152340 2024-05-08T20:44:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73cdd9b640 1 -- 172.21.15.81:0/571215395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00acb30 con 0x7f73d0152340 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 -- 172.21.15.81:0/571215395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d0152340 msgr2=0x7f73d006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 --2- 172.21.15.81:0/571215395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d0152340 0x7f73d006d290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001c4d0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 -- 172.21.15.81:0/571215395 shutdown_connections 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 --2- 172.21.15.81:0/571215395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d0152340 0x7f73d006d290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 -- 172.21.15.81:0/571215395 >> 172.21.15.81:0/571215395 conn(0x7f73d00c71b0 msgr2=0x7f73d00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 -- 172.21.15.81:0/571215395 shutdown_connections 2024-05-08T20:44:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.435+0000 7f73d5200640 1 -- 172.21.15.81:0/571215395 wait complete. 2024-05-08T20:44:30.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 Processor -- start 2024-05-08T20:44:30.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- start start 2024-05-08T20:44:30.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d00c2570 0x7f73d00abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73d0152340 0x7f73d00ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d014d9e0 con 0x7f73d006d7d0 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d014d0b0 con 0x7f73d00c2570 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d014d5e0 con 0x7f73d0152340 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43124/0 (socket says 172.21.15.81:43124) 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 -- 172.21.15.81:0/2727475233 learned_addr learned my addr 172.21.15.81:0/2727475233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ce59c640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d00c2570 0x7f73d00abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73cf59e640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73d0152340 0x7f73d00ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 -- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73d0152340 msgr2=0x7f73d00ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73d0152340 0x7f73d00ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 -- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d00c2570 msgr2=0x7f73d00abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d00c2570 0x7f73d00abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 -- 172.21.15.81:0/2727475233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00094d0 con 0x7f73d006d7d0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73ced9d640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00b7830 con 0x7f73d006d7d0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c00b7990 con 0x7f73d006d7d0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00b7d40 con 0x7f73d006d7d0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d014d300 con 0x7f73d006d7d0 2024-05-08T20:44:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d00ac5f0 con 0x7f73d006d7d0 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d00675e0 con 0x7f73d006d7d0 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.439+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73c00b3040 con 0x7f73d006d7d0 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.443+0000 7f73b77fe640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 0x7f73bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.443+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f73c011e9c0 con 0x7f73d006d7d0 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.443+0000 7f73ce59c640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 0x7f73bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.443+0000 7f73ce59c640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 0x7f73bc068b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f73d014c560 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.447+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f73c00eba20 con 0x7f73d006d7d0 2024-05-08T20:44:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.719+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f73d01ee220 con 0x7f73d006d7d0 2024-05-08T20:44:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.719+0000 7f73b77fe640 1 -- 172.21.15.81:0/2727475233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f73c00ef040 con 0x7f73d006d7d0 2024-05-08T20:44:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 msgr2=0x7f73bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 0x7f73bc068b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f73d014c560 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2024-05-08T20:44:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 msgr2=0x7f73d00ab300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001ad10 comp rx=0 tx=0).stop 2024-05-08T20:44:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 shutdown_connections 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73bc0666c0 0x7f73bc068b80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73d0152340 0x7f73d00ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73d00c2570 0x7f73d00abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 --2- 172.21.15.81:0/2727475233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d006d7d0 0x7f73d00ab300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 >> 172.21.15.81:0/2727475233 conn(0x7f73d00c71b0 msgr2=0x7f73d014ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 shutdown_connections 2024-05-08T20:44:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:30.723+0000 7f73d5200640 1 -- 172.21.15.81:0/2727475233 wait complete. 2024-05-08T20:44:30.744 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:44:40.744 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:44:40.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.867+0000 7f3e2bbc2640 1 Processor -- start 2024-05-08T20:44:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.867+0000 7f3e2bbc2640 1 -- start start 2024-05-08T20:44:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2bbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e24071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2bbc2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e24155a30 con 0x7f3e2414e7f0 2024-05-08T20:44:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2bbc2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240aded0 con 0x7f3e240c25b0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2bbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24155610 con 0x7f3e2414ebd0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2995e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e2414e7f0 0x7f3e240c1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56504/0 (socket says 172.21.15.81:56504) 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2995e640 1 -- 172.21.15.81:0/483916966 learned_addr learned my addr 172.21.15.81:0/483916966 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e24071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170597317 0 0) 0x7f3e200014a0 con 0x7f3e2414e7f0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e10003530 con 0x7f3e2414e7f0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471919402 0 0) 0x7f3e14001120 con 0x7f3e240c25b0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e200014a0 con 0x7f3e240c25b0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722398265 0 0) 0x7f3e10003530 con 0x7f3e2414e7f0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 msgr2=0x7f3e24071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e24071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 >> v1:172.21.15.117:6789/0 conn(0x7f3e240c25b0 legacy=0x7f3e240713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24154cb0 con 0x7f3e2414e7f0 2024-05-08T20:44:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3e20001b90 con 0x7f3e2414e7f0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 >> v1:172.21.15.81:6789/0 conn(0x7f3e2414e7f0 legacy=0x7f3e240c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e10003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e100040f0 0x7f3e100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24155610 con 0x7f3e10004d10 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1000bad0 con 0x7f3e100040f0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1000bc90 con 0x7f3e2414ebd0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2995e640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e10003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2915d640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e100040f0 0x7f3e100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 -- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 msgr2=0x7f3e10003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e10003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 -- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e100040f0 msgr2=0x7f3e100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:40.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e100040f0 0x7f3e100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:40.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2a15f640 1 -- 172.21.15.81:0/483916966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10003530 con 0x7f3e10004d10 2024-05-08T20:44:40.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.871+0000 7f3e2995e640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2414ebd0 0x7f3e10003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e10005190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009ae0 tx=0x7f3e1c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd9c4357c5b7cc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0a5660 con 0x7f3e10004d10 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0a57c0 con 0x7f3e10004d10 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2895c640 1 -- 172.21.15.81:0/483916966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0a5b70 con 0x7f3e10004d10 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/483916966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 msgr2=0x7f3e10005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/483916966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e10005190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009ae0 tx=0x7f3e1c01ca70 comp rx=0 tx=0).stop 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2a15f640 1 -- 172.21.15.81:0/483916966 reap_dead start 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/483916966 shutdown_connections 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/483916966 >> 172.21.15.81:0/483916966 conn(0x7f3e240c83a0 msgr2=0x7f3e240c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/483916966 shutdown_connections 2024-05-08T20:44:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/483916966 wait complete. 2024-05-08T20:44:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 Processor -- start 2024-05-08T20:44:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 -- start start 2024-05-08T20:44:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e241ee080 0x7f3e240c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.875+0000 7f3e2bbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2406c280 0x7f3e240ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241ee500 con 0x7f3e10004d10 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c7c10 con 0x7f3e241ee080 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241ea130 con 0x7f3e2406c280 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35854/0 (socket says 172.21.15.81:35854) 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 -- 172.21.15.81:0/3074334231 learned_addr learned my addr 172.21.15.81:0/3074334231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2915d640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e241ee080 0x7f3e240c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2a15f640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2406c280 0x7f3e240ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 -- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2406c280 msgr2=0x7f3e240ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2406c280 0x7f3e240ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 -- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e241ee080 msgr2=0x7f3e240c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e241ee080 0x7f3e240c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 -- 172.21.15.81:0/3074334231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240c7e40 con 0x7f3e10004d10 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2995e640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e20010d20 tx=0x7f3e2000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200143a0 con 0x7f3e10004d10 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e20014500 con 0x7f3e10004d10 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e241ea3d0 con 0x7f3e10004d10 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20014870 con 0x7f3e10004d10 2024-05-08T20:44:40.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240c8120 con 0x7f3e10004d10 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24066e40 con 0x7f3e10004d10 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e200149d0 con 0x7f3e10004d10 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 0x7f3e08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3e200870c0 con 0x7f3e10004d10 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2915d640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 0x7f3e08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.879+0000 7f3e2915d640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 0x7f3e08068b50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3e14001280 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:40.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:40.887+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3e20054120 con 0x7f3e10004d10 2024-05-08T20:44:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.211+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3e24155a30 con 0x7f3e10004d10 2024-05-08T20:44:41.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.211+0000 7f3e1a7fc640 1 -- 172.21.15.81:0/3074334231 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f3e2001b620 con 0x7f3e10004d10 2024-05-08T20:44:41.218 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":132,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 msgr2=0x7f3e08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 0x7f3e08068b50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3e14001280 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 msgr2=0x7f3e241eabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e20010d20 tx=0x7f3e2000e4d0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 shutdown_connections 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3e08066690 0x7f3e08068b50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e2406c280 0x7f3e240ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e241ee080 0x7f3e240c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 --2- 172.21.15.81:0/3074334231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e10004d10 0x7f3e241eabd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 >> 172.21.15.81:0/3074334231 conn(0x7f3e240c83a0 msgr2=0x7f3e240c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 shutdown_connections 2024-05-08T20:44:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.215+0000 7f3e2bbc2640 1 -- 172.21.15.81:0/3074334231 wait complete. 2024-05-08T20:44:41.235 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:44:41.235 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:44:41.235 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:44:41.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:44:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 Processor -- start 2024-05-08T20:44:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 -- start start 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e1406b230 0x7f9e140c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140c3a50 con 0x7f9e14070c00 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140705e0 con 0x7f9e141519d0 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e19671640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e14072940 con 0x7f9e1406b230 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e1406b230 0x7f9e140c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e1406b230 0x7f9e140c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35860/0 (socket says 172.21.15.81:35860) 2024-05-08T20:44:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 -- 172.21.15.81:0/2483904177 learned_addr learned my addr 172.21.15.81:0/2483904177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e127fc640 1 --1- 172.21.15.81:0/2483904177 >> v1:172.21.15.81:6789/0 conn(0x7f9e14070c00 0x7f9e1414e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56512/0 (socket says 172.21.15.81:56512) 2024-05-08T20:44:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 -- 172.21.15.81:0/2483904177 >> v1:172.21.15.117:6789/0 conn(0x7f9e141519d0 legacy=0x7f9e14151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 -- 172.21.15.81:0/2483904177 >> v1:172.21.15.81:6789/0 conn(0x7f9e14070c00 legacy=0x7f9e1414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.347+0000 7f9e12ffd640 1 -- 172.21.15.81:0/2483904177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140708c0 con 0x7f9e1406b230 2024-05-08T20:44:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e12ffd640 1 --2- 172.21.15.81:0/2483904177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e140c2800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400bb10 tx=0x7f9e0401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4fc69e15b3ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e11ffb640 1 -- 172.21.15.81:0/2483904177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040a7b30 con 0x7f9e1406b230 2024-05-08T20:44:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e11ffb640 1 -- 172.21.15.81:0/2483904177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e040a7c90 con 0x7f9e1406b230 2024-05-08T20:44:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e11ffb640 1 -- 172.21.15.81:0/2483904177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040af440 con 0x7f9e1406b230 2024-05-08T20:44:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- 172.21.15.81:0/2483904177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 msgr2=0x7f9e140c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 --2- 172.21.15.81:0/2483904177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e140c2800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400bb10 tx=0x7f9e0401eb60 comp rx=0 tx=0).stop 2024-05-08T20:44:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- 172.21.15.81:0/2483904177 shutdown_connections 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 --2- 172.21.15.81:0/2483904177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e140c2800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- 172.21.15.81:0/2483904177 >> 172.21.15.81:0/2483904177 conn(0x7f9e140c71b0 msgr2=0x7f9e140c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- 172.21.15.81:0/2483904177 shutdown_connections 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- 172.21.15.81:0/2483904177 wait complete. 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 Processor -- start 2024-05-08T20:44:41.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.351+0000 7f9e19671640 1 -- start start 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e1414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e14070c00 0x7f9e1414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e141519d0 0x7f9e14140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140ac030 con 0x7f9e1406b230 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e141e9d50 con 0x7f9e141519d0 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e141ea280 con 0x7f9e14070c00 2024-05-08T20:44:41.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e1414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e1414d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35862/0 (socket says 172.21.15.81:35862) 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 -- 172.21.15.81:0/105581953 learned_addr learned my addr 172.21.15.81:0/105581953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e127fc640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e14070c00 0x7f9e1414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e137fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e141519d0 0x7f9e14140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e14070c00 msgr2=0x7f9e1414a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e14070c00 0x7f9e1414a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e141519d0 msgr2=0x7f9e14140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e141519d0 0x7f9e14140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0400b770 con 0x7f9e1406b230 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e137fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e141519d0 0x7f9e14140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e12ffd640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e1414d540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400b2c0 tx=0x7f9e0401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040afc60 con 0x7f9e1406b230 2024-05-08T20:44:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e040afde0 con 0x7f9e1406b230 2024-05-08T20:44:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040b8640 con 0x7f9e1406b230 2024-05-08T20:44:41.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e141e9fa0 con 0x7f9e1406b230 2024-05-08T20:44:41.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1414b8a0 con 0x7f9e1406b230 2024-05-08T20:44:41.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 0x7f9e14140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14069550 con 0x7f9e14155860 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e127fc640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 0x7f9e14140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e127fc640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e1406b610 con 0x7f9e14155860 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e040b6040 con 0x7f9e1406b230 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.355+0000 7f9e127fc640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 0x7f9e14140e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e140c6e70 tx=0x7f9e08001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9e00066690 0x7f9e00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9e041211e0 con 0x7f9e1406b230 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9e137fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9e00066690 0x7f9e00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08010510 con 0x7f9e14155860 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9e08010670 con 0x7f9e14155860 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 msgr2=0x7f9e14140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 0x7f9e14140e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e140c6e70 tx=0x7f9e08001860 comp rx=0 tx=0).stop 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 msgr2=0x7f9e14140e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9dfb7fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e14155860 0x7f9e14140e50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.359+0000 7f9e137fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9e00066690 0x7f9e00068b50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c007e10 tx=0x7f9e0c007320 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9e19671640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 0x7f9e141ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e141ea130 con 0x7f9e1414aa70 2024-05-08T20:44:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9e127fc640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 0x7f9e141ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9e127fc640 1 -- 172.21.15.81:0/105581953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9e140675e0 con 0x7f9e1414aa70 2024-05-08T20:44:41.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9e127fc640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 0x7f9e141ec7f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e08016000 tx=0x7f9e08001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.363+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08022070 con 0x7f9e1414aa70 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7f9e0801db20 con 0x7f9e1414aa70 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 msgr2=0x7f9e141ec7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9dfb7fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 0x7f9e141ec7f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e08016000 tx=0x7f9e08001130 comp rx=0 tx=0).stop 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9dfb7fe640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 msgr2=0x7f9e141ec7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9dfb7fe640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1414aa70 0x7f9e141ec7f0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e08016000 tx=0x7f9e08001130 comp rx=0 tx=0).stop 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.369 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:41.372 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.380 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9e00066690 msgr2=0x7f9e00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9e00066690 0x7f9e00068b50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c007e10 tx=0x7f9e0c007320 comp rx=0 tx=0).stop 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 msgr2=0x7f9e1414d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 --2- 172.21.15.81:0/105581953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e1406b230 0x7f9e1414d540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400b2c0 tx=0x7f9e0401b900 comp rx=0 tx=0).stop 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e137fe640 1 -- 172.21.15.81:0/105581953 reap_dead start 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e137fe640 1 -- 172.21.15.81:0/105581953 reap_dead start 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 shutdown_connections 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 >> 172.21.15.81:0/105581953 conn(0x7f9e140c71b0 msgr2=0x7f9e1414fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 shutdown_connections 2024-05-08T20:44:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.367+0000 7f9e19671640 1 -- 172.21.15.81:0/105581953 wait complete. 2024-05-08T20:44:41.385 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:41.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:44:41.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:44:41.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 Processor -- start 2024-05-08T20:44:41.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 -- start start 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5c0154340 0x7ff5c015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c014e830 con 0x7ff5c0155070 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c006d6a0 con 0x7ff5c0154340 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c6387640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0151900 con 0x7ff5c006b840 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5c4924640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5c0154340 0x7ff5c015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:57188/0 (socket says 172.21.15.81:57188) 2024-05-08T20:44:41.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/1733134722 learned_addr learned my addr 172.21.15.81:0/1733134722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/1733134722 >> v2:172.21.15.117:3300/0 conn(0x7ff5c0154340 msgr2=0x7ff5c015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:41.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 --2- 172.21.15.81:0/1733134722 >> v2:172.21.15.117:3300/0 conn(0x7ff5c0154340 0x7ff5c015b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/1733134722 >> v1:172.21.15.117:6789/0 conn(0x7ff5c0155070 legacy=0x7ff5c00c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.503+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/1733134722 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0151be0 con 0x7ff5c006b840 2024-05-08T20:44:41.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5bf7fe640 1 --2- 172.21.15.81:0/1733134722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4006fd0 tx=0x7ff5b401e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25c92416d9c8f94 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5beffd640 1 -- 172.21.15.81:0/1733134722 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4004230 con 0x7ff5c006b840 2024-05-08T20:44:41.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5beffd640 1 -- 172.21.15.81:0/1733134722 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40ab070 con 0x7ff5c006b840 2024-05-08T20:44:41.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5beffd640 1 -- 172.21.15.81:0/1733134722 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a7770 con 0x7ff5c006b840 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- 172.21.15.81:0/1733134722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 msgr2=0x7ff5c00c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- 172.21.15.81:0/1733134722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4006fd0 tx=0x7ff5b401e9f0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- 172.21.15.81:0/1733134722 shutdown_connections 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- 172.21.15.81:0/1733134722 >> v2:172.21.15.117:3300/0 conn(0x7ff5c0154340 0x7ff5c015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- 172.21.15.81:0/1733134722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c006b840 0x7ff5c00c3350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- 172.21.15.81:0/1733134722 >> 172.21.15.81:0/1733134722 conn(0x7ff5c00c68c0 msgr2=0x7ff5c00c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- 172.21.15.81:0/1733134722 shutdown_connections 2024-05-08T20:44:41.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- 172.21.15.81:0/1733134722 wait complete. 2024-05-08T20:44:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 Processor -- start 2024-05-08T20:44:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- start start 2024-05-08T20:44:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c006b840 0x7ff5c006f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 0x7ff5c0072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c0155070 0x7ff5c00bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00707c0 con 0x7ff5c0154340 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00725a0 con 0x7ff5c006b840 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5c6387640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c01f11e0 con 0x7ff5c0155070 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 0x7ff5c0072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 0x7ff5c0072060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35886/0 (socket says 172.21.15.81:35886) 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.507+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/954141112 learned_addr learned my addr 172.21.15.81:0/954141112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c006b840 0x7ff5c006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c4924640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c0155070 0x7ff5c00bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c0155070 msgr2=0x7ff5c00bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c0155070 0x7ff5c00bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c006b840 msgr2=0x7ff5c006f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c006b840 0x7ff5c006f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b400b780 con 0x7ff5c0154340 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c006b840 0x7ff5c006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c4924640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5c0155070 0x7ff5c00bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bf7fe640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 0x7ff5c0072060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4006fd0 tx=0x7ff5b401b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a8a10 con 0x7ff5c0154340 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40a8b70 con 0x7ff5c0154340 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c01f1670 con 0x7ff5c0154340 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4003620 con 0x7ff5c0154340 2024-05-08T20:44:41.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c01f08b0 con 0x7ff5c0154340 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c6387640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 0x7ff5c0140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0069550 con 0x7ff5c01f0aa0 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 0x7ff5c0140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bffff640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5c015dc20 con 0x7ff5c01f0aa0 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 0x7ff5c0140aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e450 tx=0x7ff5b000e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5b4003780 con 0x7ff5c0154340 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5ac066690 0x7ff5ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff5b411ec50 con 0x7ff5c0154340 2024-05-08T20:44:41.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5c4924640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5ac066690 0x7ff5ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.511+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0017070 con 0x7ff5c01f0aa0 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff5b00052e0 con 0x7ff5c01f0aa0 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 msgr2=0x7ff5c0140aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5bcff9640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 0x7ff5c0140aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e450 tx=0x7ff5b000e910 comp rx=0 tx=0).stop 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 msgr2=0x7ff5c0140aa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5bcff9640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c01f0aa0 0x7ff5c0140aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.515+0000 7ff5c4924640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5ac066690 0x7ff5ac068b50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80074c0 tx=0x7ff5b800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 0x7ff5c01ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0154060 con 0x7ff5c0140fe0 2024-05-08T20:44:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 0x7ff5c01ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bffff640 1 -- 172.21.15.81:0/954141112 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff5c0074950 con 0x7ff5c0140fe0 2024-05-08T20:44:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bffff640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 0x7ff5c01ed2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e450 tx=0x7ff5b0000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0021070 con 0x7ff5c0140fe0 2024-05-08T20:44:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7ff5b0006ab0 con 0x7ff5c0140fe0 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 msgr2=0x7ff5c01ed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 0x7ff5c01ed2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e450 tx=0x7ff5b0000ee0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 msgr2=0x7ff5c01ed2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5bcff9640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5c0140fe0 0x7ff5c01ed2a0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e450 tx=0x7ff5b0000ee0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:41.527 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.528 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:41.530 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.531 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:41.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.536 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:41.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:41.538 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5ac066690 msgr2=0x7ff5ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5ac066690 0x7ff5ac068b50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80074c0 tx=0x7ff5b800b040 comp rx=0 tx=0).stop 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 msgr2=0x7ff5c0072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 --2- 172.21.15.81:0/954141112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c0154340 0x7ff5c0072060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4006fd0 tx=0x7ff5b401b790 comp rx=0 tx=0).stop 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c4924640 1 -- 172.21.15.81:0/954141112 reap_dead start 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c4924640 1 -- 172.21.15.81:0/954141112 reap_dead start 2024-05-08T20:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 shutdown_connections 2024-05-08T20:44:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 >> 172.21.15.81:0/954141112 conn(0x7ff5c00c68c0 msgr2=0x7ff5c00c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 shutdown_connections 2024-05-08T20:44:41.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.523+0000 7ff5c6387640 1 -- 172.21.15.81:0/954141112 wait complete. 2024-05-08T20:44:41.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:41.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:44:41.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:44:41.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 Processor -- start 2024-05-08T20:44:41.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 -- start start 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98e0151f00 0x7f98e01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98e00ca000 0x7f98e00ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0158e20 con 0x7f98e0154cf0 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e006bb20 con 0x7f98e0151f00 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98e6030640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e01548e0 con 0x7f98e00ca000 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98e0151f00 0x7f98e01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98e0151f00 0x7f98e01588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35898/0 (socket says 172.21.15.81:35898) 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 -- 172.21.15.81:0/1672461662 learned_addr learned my addr 172.21.15.81:0/1672461662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98dffff640 1 --2- 172.21.15.81:0/1672461662 >> v2:172.21.15.117:3300/0 conn(0x7f98e00ca000 0x7f98e00ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 -- 172.21.15.81:0/1672461662 >> v2:172.21.15.117:3300/0 conn(0x7f98e00ca000 msgr2=0x7f98e00ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:41.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 --2- 172.21.15.81:0/1672461662 >> v2:172.21.15.117:3300/0 conn(0x7f98e00ca000 0x7f98e00ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 -- 172.21.15.81:0/1672461662 >> v1:172.21.15.117:6789/0 conn(0x7f98e0154cf0 legacy=0x7f98e0155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:44:41.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.663+0000 7f98df7fe640 1 -- 172.21.15.81:0/1672461662 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0155860 con 0x7f98e0151f00 2024-05-08T20:44:41.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98df7fe640 1 --2- 172.21.15.81:0/1672461662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e0151f00 0x7f98e01588e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98e0155a50 tx=0x7f98d001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5909652f8b7ff028 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98deffd640 1 -- 172.21.15.81:0/1672461662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00ac640 con 0x7f98e0151f00 2024-05-08T20:44:41.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98deffd640 1 -- 172.21.15.81:0/1672461662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00ac7a0 con 0x7f98e0151f00 2024-05-08T20:44:41.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98deffd640 1 -- 172.21.15.81:0/1672461662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00acb30 con 0x7f98e0151f00 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- 172.21.15.81:0/1672461662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e0151f00 msgr2=0x7f98e01588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 --2- 172.21.15.81:0/1672461662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e0151f00 0x7f98e01588e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98e0155a50 tx=0x7f98d001c3c0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- 172.21.15.81:0/1672461662 shutdown_connections 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 --2- 172.21.15.81:0/1672461662 >> v2:172.21.15.117:3300/0 conn(0x7f98e00ca000 0x7f98e00ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 --2- 172.21.15.81:0/1672461662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e0151f00 0x7f98e01588e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- 172.21.15.81:0/1672461662 >> 172.21.15.81:0/1672461662 conn(0x7f98e00715f0 msgr2=0x7f98e0071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- 172.21.15.81:0/1672461662 shutdown_connections 2024-05-08T20:44:41.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- 172.21.15.81:0/1672461662 wait complete. 2024-05-08T20:44:41.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 Processor -- start 2024-05-08T20:44:41.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.667+0000 7f98e6030640 1 -- start start 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 0x7f98e00c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98e0151f00 0x7f98e0147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e0154cf0 0x7f98e0147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00af6a0 con 0x7f98e00ca000 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e014b880 con 0x7f98e0151f00 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0148d20 con 0x7f98e0154cf0 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 0x7f98e00c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 0x7f98e00c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35900/0 (socket says 172.21.15.81:35900) 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 -- 172.21.15.81:0/1471270052 learned_addr learned my addr 172.21.15.81:0/1471270052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98d6ffd640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98e0151f00 0x7f98e0147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98dffff640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e0154cf0 0x7f98e0147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e0154cf0 msgr2=0x7f98e0147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e0154cf0 0x7f98e0147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98e0151f00 msgr2=0x7f98e0147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98e0151f00 0x7f98e0147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00094d0 con 0x7f98e00ca000 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98df7fe640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 0x7f98e00c8510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98d0019ff0 tx=0x7f98d001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b7830 con 0x7f98e00ca000 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00b7990 con 0x7f98e00ca000 2024-05-08T20:44:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e014c960 con 0x7f98e00ca000 2024-05-08T20:44:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00b7d00 con 0x7f98e00ca000 2024-05-08T20:44:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00c8a50 con 0x7f98e00ca000 2024-05-08T20:44:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 0x7f98e01f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0069600 con 0x7f98e00c9490 2024-05-08T20:44:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98d6ffd640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 0x7f98e01f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98d00b3040 con 0x7f98e00ca000 2024-05-08T20:44:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.671+0000 7f98d6ffd640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98e00c6820 con 0x7f98e00c9490 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98d6ffd640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 0x7f98e01f0ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98e00c4610 tx=0x7f98c800e8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98c00666c0 0x7f98c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f98d011eb10 con 0x7f98e00ca000 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dffff640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98c00666c0 0x7f98c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8007240 con 0x7f98e00c9490 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dffff640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98c00666c0 0x7f98c0068b80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009e10 tx=0x7f98d800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f98c80073a0 con 0x7f98e00c9490 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 msgr2=0x7f98e01f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 0x7f98e01f0ca0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98e00c4610 tx=0x7f98c800e8b0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 msgr2=0x7f98e01f0ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.675+0000 7f98dcff9640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e00c9490 0x7f98e01f0ca0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 0x7f98e01f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c6540 con 0x7f98e01f11e0 2024-05-08T20:44:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98d6ffd640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 0x7f98e01f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98d6ffd640 1 -- 172.21.15.81:0/1471270052 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f98e0161a80 con 0x7f98e01f11e0 2024-05-08T20:44:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98d6ffd640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 0x7f98e01f15f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98e01494d0 tx=0x7f98c8003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8006d30 con 0x7f98e01f11e0 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7f98c8006e90 con 0x7f98e01f11e0 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 msgr2=0x7f98e01f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 0x7f98e01f15f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98e01494d0 tx=0x7f98c8003770 comp rx=0 tx=0).stop 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 msgr2=0x7f98e01f15f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dcff9640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98e01f11e0 0x7f98e01f15f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:41.687 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 132, 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.688 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.689 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:44:41.690 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:44:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:44:41.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:44:41.697 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:44:41.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:44:41.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:44:41.700 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98c00666c0 msgr2=0x7f98c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f98c00666c0 0x7f98c0068b80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009e10 tx=0x7f98d800b040 comp rx=0 tx=0).stop 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 msgr2=0x7f98e00c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 --2- 172.21.15.81:0/1471270052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98e00ca000 0x7f98e00c8510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98d0019ff0 tx=0x7f98d001ac00 comp rx=0 tx=0).stop 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dffff640 1 -- 172.21.15.81:0/1471270052 reap_dead start 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98dffff640 1 -- 172.21.15.81:0/1471270052 reap_dead start 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 shutdown_connections 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 >> 172.21.15.81:0/1471270052 conn(0x7f98e00715f0 msgr2=0x7f98e01530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 shutdown_connections 2024-05-08T20:44:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.683+0000 7f98e6030640 1 -- 172.21.15.81:0/1471270052 wait complete. 2024-05-08T20:44:41.703 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:44:41.704 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-05-08T20:44:41.704 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:44:41.704 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-05-08T20:44:41.704 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:44:41.704 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:44:41.704 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:44:41.718 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:44:41.718 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:44:41.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 Processor -- start 2024-05-08T20:44:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 -- start start 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe53806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 0x7fe538069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe538152ab0 con 0x7fe53806d7d0 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5381528a0 con 0x7fe538155e90 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53e2bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538152d90 con 0x7fe53814fe70 2024-05-08T20:44:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe5377fe640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 msgr2=0x7fe538069fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe5377fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 0x7fe538069fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53c858640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe53806d7d0 0x7fe53806a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38214/0 (socket says 172.21.15.81:38214) 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe53c858640 1 -- 172.21.15.81:0/1402617254 learned_addr learned my addr 172.21.15.81:0/1402617254 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.879+0000 7fe537fff640 1 --2- 172.21.15.81:0/1402617254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe53806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe536ffd640 1 -- 172.21.15.81:0/1402617254 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988297766 0 0) 0x7fe538152ab0 con 0x7fe53806d7d0 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe536ffd640 1 -- 172.21.15.81:0/1402617254 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe520003530 con 0x7fe53806d7d0 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe537fff640 1 -- 172.21.15.81:0/1402617254 >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 msgr2=0x7fe538069fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe537fff640 1 --2- 172.21.15.81:0/1402617254 >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 0x7fe538069fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe537fff640 1 -- 172.21.15.81:0/1402617254 >> v1:172.21.15.117:6789/0 conn(0x7fe53806d7d0 legacy=0x7fe53806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe537fff640 1 -- 172.21.15.81:0/1402617254 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538153070 con 0x7fe53814fe70 2024-05-08T20:44:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe537fff640 1 --2- 172.21.15.81:0/1402617254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe53806d290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097c0 tx=0x7fe52801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72e852fc19ddf8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe536ffd640 1 -- 172.21.15.81:0/1402617254 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280ab600 con 0x7fe53814fe70 2024-05-08T20:44:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe536ffd640 1 -- 172.21.15.81:0/1402617254 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5280a7050 con 0x7fe53814fe70 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe536ffd640 1 -- 172.21.15.81:0/1402617254 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280ab960 con 0x7fe53814fe70 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1402617254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 msgr2=0x7fe53806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1402617254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe53806d290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097c0 tx=0x7fe52801c370 comp rx=0 tx=0).stop 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1402617254 shutdown_connections 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1402617254 >> v2:172.21.15.81:3300/0 conn(0x7fe538155e90 0x7fe538069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1402617254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe53806d290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1402617254 >> 172.21.15.81:0/1402617254 conn(0x7fe5380c71b0 msgr2=0x7fe5380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1402617254 shutdown_connections 2024-05-08T20:44:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.883+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1402617254 wait complete. 2024-05-08T20:44:41.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 Processor -- start 2024-05-08T20:44:41.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- start start 2024-05-08T20:44:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe5380c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 0x7fe5380c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381ee0c0 con 0x7fe538155e90 2024-05-08T20:44:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381ee960 con 0x7fe53806d7d0 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538157380 con 0x7fe53814fe70 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53c858640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 msgr2=0x7fe5380c5240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53c858640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 0x7fe5380c5240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe537fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe5380c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe537fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33358/0 (socket says 172.21.15.81:33358) 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe537fff640 1 -- 172.21.15.81:0/1269916240 learned_addr learned my addr 172.21.15.81:0/1269916240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 -- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 msgr2=0x7fe53814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 -- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 msgr2=0x7fe5380c5240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 0x7fe5380c5240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 -- 172.21.15.81:0/1269916240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528009420 con 0x7fe53814fe70 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe537fff640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe5377fe640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe5380c4d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b470 tx=0x7fe52c00b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c003dd0 con 0x7fe53814fe70 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe538155af0 con 0x7fe53814fe70 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c005070 con 0x7fe53814fe70 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c005420 con 0x7fe53814fe70 2024-05-08T20:44:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.887+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5381ee5f0 con 0x7fe53814fe70 2024-05-08T20:44:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380675e0 con 0x7fe53814fe70 2024-05-08T20:44:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe52c005580 con 0x7fe53814fe70 2024-05-08T20:44:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe534ff9640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 0x7fe524068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe52c084a50 con 0x7fe53814fe70 2024-05-08T20:44:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe537fff640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 0x7fe524068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.891+0000 7fe537fff640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 0x7fe524068b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097c0 tx=0x7fe5280a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:41.907+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe52c051ab0 con 0x7fe53814fe70 2024-05-08T20:44:42.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.135+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe5381eead0 con 0x7fe53814fe70 2024-05-08T20:44:42.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.135+0000 7fe534ff9640 1 -- 172.21.15.81:0/1269916240 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fe52c0550d0 con 0x7fe53814fe70 2024-05-08T20:44:42.139 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":132,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 msgr2=0x7fe524068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 0x7fe524068b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe5280097c0 tx=0x7fe5280a6000 comp rx=0 tx=0).stop 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 msgr2=0x7fe5380c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe5380c4d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b470 tx=0x7fe52c00b930 comp rx=0 tx=0).stop 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 shutdown_connections 2024-05-08T20:44:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe524066670 0x7fe524068b30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe538155e90 0x7fe5380c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe53814fe70 0x7fe5380c4d00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 --2- 172.21.15.81:0/1269916240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe53806d7d0 0x7fe53814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 >> 172.21.15.81:0/1269916240 conn(0x7fe5380c71b0 msgr2=0x7fe538069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 shutdown_connections 2024-05-08T20:44:42.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:42.139+0000 7fe53e2bb640 1 -- 172.21.15.81:0/1269916240 wait complete. 2024-05-08T20:44:45.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 Processor -- start 2024-05-08T20:44:45.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 -- start start 2024-05-08T20:44:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a0414fe70 0x7f6a0406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a04152ab0 con 0x7f6a0406d7d0 2024-05-08T20:44:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a04152d90 con 0x7f6a04155e90 2024-05-08T20:44:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0c29d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a041528a0 con 0x7f6a0414fe70 2024-05-08T20:44:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a83a640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f6a0406d7d0 legacy=0x7f6a0406a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a0414fe70 0x7f6a0406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a0414fe70 0x7f6a0406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33372/0 (socket says 172.21.15.81:33372) 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 -- 172.21.15.81:0/2081924843 learned_addr learned my addr 172.21.15.81:0/2081924843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 -- 172.21.15.81:0/2081924843 >> v1:172.21.15.117:6789/0 conn(0x7f6a04155e90 legacy=0x7f6a04069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 -- 172.21.15.81:0/2081924843 >> v1:172.21.15.81:6789/0 conn(0x7f6a0406d7d0 legacy=0x7f6a0406a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.394+0000 7f6a0a039640 1 -- 172.21.15.81:0/2081924843 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04153070 con 0x7f6a0414fe70 2024-05-08T20:44:45.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0a039640 1 --2- 172.21.15.81:0/2081924843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0406d290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abaeb51a074c1d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:45.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a09037640 1 -- 172.21.15.81:0/2081924843 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000ac630 con 0x7f6a0414fe70 2024-05-08T20:44:45.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a09037640 1 -- 172.21.15.81:0/2081924843 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000ac790 con 0x7f6a0414fe70 2024-05-08T20:44:45.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a09037640 1 -- 172.21.15.81:0/2081924843 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000acb20 con 0x7f6a0414fe70 2024-05-08T20:44:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2081924843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 msgr2=0x7f6a0406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2081924843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0406d290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2081924843 shutdown_connections 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2081924843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0406d290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2081924843 >> 172.21.15.81:0/2081924843 conn(0x7f6a040c71b0 msgr2=0x7f6a040c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2081924843 shutdown_connections 2024-05-08T20:44:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2081924843 wait complete. 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 Processor -- start 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.398+0000 7f6a0c29d640 1 -- start start 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 0x7f6a0414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 0x7f6a04146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0414c990 con 0x7f6a04155e90 2024-05-08T20:44:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041555c0 con 0x7f6a0414fe70 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041552e0 con 0x7f6a0406d7d0 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a83a640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 msgr2=0x7f6a04146b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a83a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 0x7f6a04146b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a09838640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 0x7f6a0414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a09838640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0414a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:33380/0 (socket says 172.21.15.81:33380) 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a09838640 1 -- 172.21.15.81:0/2231964926 learned_addr learned my addr 172.21.15.81:0/2231964926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 -- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 msgr2=0x7f6a0414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0414a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 -- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 msgr2=0x7f6a04146b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 0x7f6a04146b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 -- 172.21.15.81:0/2231964926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000094d0 con 0x7f6a0406d7d0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0a039640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 0x7f6a0414c450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a000ac000 tx=0x7f6a00019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000b6810 con 0x7f6a0406d7d0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a04149b80 con 0x7f6a0406d7d0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a000b6970 con 0x7f6a0406d7d0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000b6d00 con 0x7f6a0406d7d0 2024-05-08T20:44:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0414a140 con 0x7f6a0406d7d0 2024-05-08T20:44:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.402+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a040675e0 con 0x7f6a0406d7d0 2024-05-08T20:44:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.406+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a000de490 con 0x7f6a0406d7d0 2024-05-08T20:44:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.406+0000 7f69faffd640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 0x7f69e8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.406+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6a0011f140 con 0x7f6a0406d7d0 2024-05-08T20:44:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.406+0000 7f6a09838640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 0x7f69e8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.406+0000 7f6a09838640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 0x7f69e8068b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6a041509a0 tx=0x7f69f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.418+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6a000ec1c0 con 0x7f6a0406d7d0 2024-05-08T20:44:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.670+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6a040c3290 con 0x7f6a0406d7d0 2024-05-08T20:44:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.670+0000 7f69faffd640 1 -- 172.21.15.81:0/2231964926 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f6a000c4620 con 0x7f6a0406d7d0 2024-05-08T20:44:45.675 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":132,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 msgr2=0x7f69e8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 0x7f69e8068b30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6a041509a0 tx=0x7f69f4009040 comp rx=0 tx=0).stop 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 msgr2=0x7f6a0414c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 0x7f6a0414c450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a000ac000 tx=0x7f6a00019170 comp rx=0 tx=0).stop 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 shutdown_connections 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f69e8066670 0x7f69e8068b30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a04155e90 0x7f6a04146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a0414fe70 0x7f6a0414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 --2- 172.21.15.81:0/2231964926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a0406d7d0 0x7f6a0414c450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:45.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 >> 172.21.15.81:0/2231964926 conn(0x7f6a040c71b0 msgr2=0x7f6a040ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:45.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 shutdown_connections 2024-05-08T20:44:45.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:45.674+0000 7f6a0c29d640 1 -- 172.21.15.81:0/2231964926 wait complete. 2024-05-08T20:44:48.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 Processor -- start 2024-05-08T20:44:48.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 -- start start 2024-05-08T20:44:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 0x7f30500a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3050155e10 con 0x7f30500c2bc0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305006e790 con 0x7f30500a94b0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3057603640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305006f460 con 0x7f30500c30d0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3054b9e640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f30500c2bc0 legacy=0x7f30500c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3055ba0640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 msgr2=0x7f30500a9920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f3055ba0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 0x7f30500a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40600/0 (socket says 172.21.15.81:40600) 2024-05-08T20:44:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 -- 172.21.15.81:0/3229658502 learned_addr learned my addr 172.21.15.81:0/3229658502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 -- 172.21.15.81:0/3229658502 >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 msgr2=0x7f30500a9920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 --2- 172.21.15.81:0/3229658502 >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 0x7f30500a9920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 -- 172.21.15.81:0/3229658502 >> v1:172.21.15.81:6789/0 conn(0x7f30500c2bc0 legacy=0x7f30500c4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:48.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.990+0000 7f305539f640 1 -- 172.21.15.81:0/3229658502 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500a9e60 con 0x7f30500c30d0 2024-05-08T20:44:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f305539f640 1 --2- 172.21.15.81:0/3229658502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb62f4d3ade6c338 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3047fff640 1 -- 172.21.15.81:0/3229658502 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0ab640 con 0x7f30500c30d0 2024-05-08T20:44:48.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3047fff640 1 -- 172.21.15.81:0/3229658502 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0a7070 con 0x7f30500c30d0 2024-05-08T20:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3047fff640 1 -- 172.21.15.81:0/3229658502 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0ab9c0 con 0x7f30500c30d0 2024-05-08T20:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 -- 172.21.15.81:0/3229658502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 msgr2=0x7f30500c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 --2- 172.21.15.81:0/3229658502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01c480 comp rx=0 tx=0).stop 2024-05-08T20:44:48.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 -- 172.21.15.81:0/3229658502 shutdown_connections 2024-05-08T20:44:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 --2- 172.21.15.81:0/3229658502 >> v2:172.21.15.81:3300/0 conn(0x7f30500a94b0 0x7f30500a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 --2- 172.21.15.81:0/3229658502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500c30d0 0x7f30500c34b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 -- 172.21.15.81:0/3229658502 >> 172.21.15.81:0/3229658502 conn(0x7f30500c4cc0 msgr2=0x7f30500c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 -- 172.21.15.81:0/3229658502 shutdown_connections 2024-05-08T20:44:49.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.994+0000 7f3057603640 1 -- 172.21.15.81:0/3229658502 wait complete. 2024-05-08T20:44:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 Processor -- start 2024-05-08T20:44:49.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 -- start start 2024-05-08T20:44:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500c2bc0 0x7f30500ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 0x7f30500ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:49.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050150630 con 0x7f3050149ad0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501ef220 con 0x7f30500c2bc0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3057603640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501eeca0 con 0x7f30500a94b0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3055ba0640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 msgr2=0x7f30500ad350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3055ba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 0x7f30500ad350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f3054b9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500c2bc0 0x7f30500ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40608/0 (socket says 172.21.15.81:40608) 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 -- 172.21.15.81:0/870082756 learned_addr learned my addr 172.21.15.81:0/870082756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 -- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500c2bc0 msgr2=0x7f30500ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500c2bc0 0x7f30500ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 -- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 msgr2=0x7f30500ad350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 0x7f30500ad350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 -- 172.21.15.81:0/870082756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0094d0 con 0x7f30500a94b0 2024-05-08T20:44:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:48.998+0000 7f305539f640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f304c0ad040 tx=0x7f304c01acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0be5f0 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500c2570 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0be750 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0beb00 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500c2810 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30501507a0 con 0x7f30500a94b0 2024-05-08T20:44:49.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f304c004030 con 0x7f30500a94b0 2024-05-08T20:44:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 0x7f3034068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f304c11f1c0 con 0x7f30500a94b0 2024-05-08T20:44:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3054b9e640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 0x7f3034068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.002+0000 7f3054b9e640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 0x7f3034068b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f305014b580 tx=0x7f3040009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:44:49.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.018+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f304c0ec2d0 con 0x7f30500a94b0 2024-05-08T20:44:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.318+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f30501507a0 con 0x7f30500a94b0 2024-05-08T20:44:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.318+0000 7f3045ffb640 1 -- 172.21.15.81:0/870082756 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f30501507a0 con 0x7f30500a94b0 2024-05-08T20:44:49.323 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":132,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:44:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 msgr2=0x7f3034068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 0x7f3034068b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f305014b580 tx=0x7f3040009110 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 msgr2=0x7f3050152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f304c0ad040 tx=0x7f304c01acc0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 shutdown_connections 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3034066670 0x7f3034068b30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3050149ad0 0x7f30500ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30500c2bc0 0x7f30500ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 --2- 172.21.15.81:0/870082756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30500a94b0 0x7f3050152f60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 >> 172.21.15.81:0/870082756 conn(0x7f30500c4cc0 msgr2=0x7f305014e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 shutdown_connections 2024-05-08T20:44:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:49.322+0000 7f3057603640 1 -- 172.21.15.81:0/870082756 wait complete. 2024-05-08T20:44:52.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:44:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 Processor -- start 2024-05-08T20:44:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 -- start start 2024-05-08T20:44:53.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b0158080 con 0x7f59b00c34e0 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b006a890 con 0x7f59b0152340 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b80db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b006ab70 con 0x7f59b00c2570 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b6678640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f59b01554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5e77640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f59b0152340 0x7f59b006d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:45018/0 (socket says 172.21.15.81:45018) 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 learned_addr learned my addr 172.21.15.81:0/572958950 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:44:53.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:53.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:53.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.654+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f59b01554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:53.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:44:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:53.858+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:44:54.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:44:54.049 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f59b01554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:54.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:54.262+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:44:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f59b01554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:55.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:44:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:55.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:55.066+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:44:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f59b0154f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f59b0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.117:6789/0 conn(0x7f59b0152340 legacy=0x7f59b006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f59b01554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b006ab70 con 0x7f59940061b0 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5994008d30 con 0x7f5994003700 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 msgr2=0x7f5994008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.654+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 msgr2=0x7f5994008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:44:56.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:44:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:56.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:56.858+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:44:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 msgr2=0x7f5994008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:44:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:44:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:57.262+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:44:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 msgr2=0x7f5994008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:44:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:44:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:58.066+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 msgr2=0x7f5994005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.117:3300/0 conn(0x7f5994003700 0x7f5994005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 msgr2=0x7f5994008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f59940061b0 0x7f5994008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 reap_dead start 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:44:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00c2d70 con 0x7f59b00c34e0 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b006ab70 con 0x7f599400b610 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59a77fe640 1 -- 172.21.15.81:0/572958950 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994008d30 con 0x7f59b00c2570 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 msgr2=0x7f599400da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f599400e040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.658+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:44:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f599400e040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:44:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 msgr2=0x7f599400da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:44:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:44:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:44:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:44:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:44:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:44:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:44:59.862+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 msgr2=0x7f599400da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f599400e040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:00.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:00.266+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:45:01.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b6678640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f599400e040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:45:01.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5676640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 msgr2=0x7f599400da60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5676640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:45:01.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 msgr2=0x7f599400da60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:01.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 >> v1:172.21.15.81:6789/0 conn(0x7f59b00c34e0 legacy=0x7f599400e040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:01.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.070+0000 7f59b5e77640 1 -- 172.21.15.81:0/572958950 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0158080 con 0x7f59b00c2570 2024-05-08T20:45:01.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b5e77640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007d30 tx=0x7f59ac01db50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c0392b40d1c3b12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b4e75640 1 -- 172.21.15.81:0/572958950 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0a67e0 con 0x7f59b00c2570 2024-05-08T20:45:01.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b4e75640 1 -- 172.21.15.81:0/572958950 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac0aa070 con 0x7f59b00c2570 2024-05-08T20:45:01.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b4e75640 1 -- 172.21.15.81:0/572958950 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0a6b60 con 0x7f59b00c2570 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 -- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 msgr2=0x7f599400b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007d30 tx=0x7f59ac01db50 comp rx=0 tx=0).stop 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 -- 172.21.15.81:0/572958950 shutdown_connections 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 --2- 172.21.15.81:0/572958950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c2570 0x7f599400b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 --2- 172.21.15.81:0/572958950 >> v2:172.21.15.81:3300/0 conn(0x7f599400b610 0x7f599400da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 -- 172.21.15.81:0/572958950 >> 172.21.15.81:0/572958950 conn(0x7f59b00c71b0 msgr2=0x7f59b00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 -- 172.21.15.81:0/572958950 shutdown_connections 2024-05-08T20:45:01.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.074+0000 7f59b80db640 1 -- 172.21.15.81:0/572958950 wait complete. 2024-05-08T20:45:01.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 Processor -- start 2024-05-08T20:45:01.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 -- start start 2024-05-08T20:45:01.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 0x7f59b01541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 0x7f59b01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01e7af0 con 0x7f599400b610 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0157590 con 0x7f59b00c2570 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b014def0 con 0x7f59b00c34e0 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5e77640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 msgr2=0x7f59b01541d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5e77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 0x7f59b01541d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5676640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5676640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51954/0 (socket says 172.21.15.81:51954) 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5676640 1 -- 172.21.15.81:0/1042916849 learned_addr learned my addr 172.21.15.81:0/1042916849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:01.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 0x7f59b01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 -- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 msgr2=0x7f59b014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 -- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 msgr2=0x7f59b01541d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 0x7f59b01541d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 -- 172.21.15.81:0/1042916849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac00f040 con 0x7f59b00c34e0 2024-05-08T20:45:01.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b5676640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b6678640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 0x7f59b01567d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59b0073f50 tx=0x7f59a800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8016030 con 0x7f59b00c34e0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a800aaa0 con 0x7f59b00c34e0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b014e1d0 con 0x7f59b00c34e0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.078+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800ae50 con 0x7f59b00c34e0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b014e790 con 0x7f59b00c34e0 2024-05-08T20:45:01.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00675e0 con 0x7f59b00c34e0 2024-05-08T20:45:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59a8019070 con 0x7f59b00c34e0 2024-05-08T20:45:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59a67fc640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 0x7f599406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f59a8017070 con 0x7f59b00c34e0 2024-05-08T20:45:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59b5e77640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 0x7f599406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.082+0000 7f59b5e77640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 0x7f599406ce00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b1000 tx=0x7f59ac0a8070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.098+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f59a8051fb0 con 0x7f59b00c34e0 2024-05-08T20:45:01.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.338+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f59b0074950 con 0x7f59b00c34e0 2024-05-08T20:45:01.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.338+0000 7f59a67fc640 1 -- 172.21.15.81:0/1042916849 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f59a80555d0 con 0x7f59b00c34e0 2024-05-08T20:45:01.342 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":136,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:01.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 msgr2=0x7f599406ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 0x7f599406ce00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b1000 tx=0x7f59ac0a8070 comp rx=0 tx=0).stop 2024-05-08T20:45:01.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 msgr2=0x7f59b01567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 0x7f59b01567d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59b0073f50 tx=0x7f59a800cc00 comp rx=0 tx=0).stop 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 shutdown_connections 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f599406a940 0x7f599406ce00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59b00c34e0 0x7f59b01567d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59b00c2570 0x7f59b014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 --2- 172.21.15.81:0/1042916849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f599400b610 0x7f59b01541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 >> 172.21.15.81:0/1042916849 conn(0x7f59b00c71b0 msgr2=0x7f59b00c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 shutdown_connections 2024-05-08T20:45:01.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.342+0000 7f59b80db640 1 -- 172.21.15.81:0/1042916849 wait complete. 2024-05-08T20:45:01.361 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:45:01.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:45:01.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:45:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 Processor -- start 2024-05-08T20:45:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 -- start start 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c5c1501e0 0x7f0c5c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 0x7f0c5c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0c0650 con 0x7f0c5c0725f0 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c06fd60 con 0x7f0c5c06f400 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c643cf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c072180 con 0x7f0c5c1501e0 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6196a640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f0c5c0725f0 legacy=0x7f0c5c0c1c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6296c640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 msgr2=0x7f0c5c0c2350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6296c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 0x7f0c5c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c5c1501e0 0x7f0c5c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c5c1501e0 0x7f0c5c06c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51970/0 (socket says 172.21.15.81:51970) 2024-05-08T20:45:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 -- 172.21.15.81:0/2225205857 learned_addr learned my addr 172.21.15.81:0/2225205857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 -- 172.21.15.81:0/2225205857 >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 msgr2=0x7f0c5c0c2350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2225205857 >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 0x7f0c5c0c2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 -- 172.21.15.81:0/2225205857 >> v1:172.21.15.81:6789/0 conn(0x7f0c5c0725f0 legacy=0x7f0c5c0c1c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.506+0000 7f0c6216b640 1 -- 172.21.15.81:0/2225205857 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c06fa80 con 0x7f0c5c1501e0 2024-05-08T20:45:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2225205857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1501e0 0x7f0c5c06c930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06ae70 tx=0x7f0c5801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35081aed7a200ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c61169640 1 -- 172.21.15.81:0/2225205857 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ac630 con 0x7f0c5c1501e0 2024-05-08T20:45:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c61169640 1 -- 172.21.15.81:0/2225205857 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580ac790 con 0x7f0c5c1501e0 2024-05-08T20:45:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c61169640 1 -- 172.21.15.81:0/2225205857 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580acb20 con 0x7f0c5c1501e0 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 -- 172.21.15.81:0/2225205857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1501e0 msgr2=0x7f0c5c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2225205857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1501e0 0x7f0c5c06c930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06ae70 tx=0x7f0c5801c3b0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 -- 172.21.15.81:0/2225205857 shutdown_connections 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2225205857 >> v2:172.21.15.81:3300/0 conn(0x7f0c5c06f400 0x7f0c5c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2225205857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c1501e0 0x7f0c5c06c930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 -- 172.21.15.81:0/2225205857 >> 172.21.15.81:0/2225205857 conn(0x7f0c5c0c2ca0 msgr2=0x7f0c5c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 -- 172.21.15.81:0/2225205857 shutdown_connections 2024-05-08T20:45:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.510+0000 7f0c643cf640 1 -- 172.21.15.81:0/2225205857 wait complete. 2024-05-08T20:45:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 Processor -- start 2024-05-08T20:45:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- start start 2024-05-08T20:45:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c5c06f400 0x7f0c5c1ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c0725f0 0x7f0c5c0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 0x7f0c5c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c147ed0 con 0x7f0c5c06f400 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0c5380 con 0x7f0c5c0725f0 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c147bf0 con 0x7f0c5c1501e0 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6216b640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c5c06f400 msgr2=0x7f0c5c1ed110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6216b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c5c06f400 0x7f0c5c1ed110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 0x7f0c5c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6196a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c0725f0 0x7f0c5c0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6196a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c0725f0 0x7f0c5c0bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:51982/0 (socket says 172.21.15.81:51982) 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 0x7f0c5c0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:59274/0 (socket says 172.21.15.81:59274) 2024-05-08T20:45:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6196a640 1 -- 172.21.15.81:0/2088871986 learned_addr learned my addr 172.21.15.81:0/2088871986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c0725f0 msgr2=0x7f0c5c0bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c5c0725f0 0x7f0c5c0bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c5c06f400 msgr2=0x7f0c5c1ed110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c5c06f400 0x7f0c5c1ed110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580094d0 con 0x7f0c5c1501e0 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6296c640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 0x7f0c5c0c57d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c54003c40 tx=0x7f0c54009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400cdf0 con 0x7f0c5c1501e0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c150740 con 0x7f0c5c1501e0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c1477a0 con 0x7f0c5c1501e0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54015470 con 0x7f0c5c1501e0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54015860 con 0x7f0c5c1501e0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 0x7f0c44004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44007e90 con 0x7f0c44002a40 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.514+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 0x7f0c44004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c6216b640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c44008050 con 0x7f0c44002a40 2024-05-08T20:45:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 0x7f0c44004f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06f1b0 tx=0x7f0c5801abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ac630 con 0x7f0c44002a40 2024-05-08T20:45:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c54012070 con 0x7f0c5c1501e0 2024-05-08T20:45:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0c40066760 0x7f0c40068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0c54084630 con 0x7f0c5c1501e0 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c6196a640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0c40066760 0x7f0c40068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f0c580ac900 con 0x7f0c44002a40 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 msgr2=0x7f0c44004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 0x7f0c44004f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06f1b0 tx=0x7f0c5801abf0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 msgr2=0x7f0c44004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c52ffd640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44002a40 0x7f0c44004f00 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c06f1b0 tx=0x7f0c5801abf0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.518+0000 7f0c6196a640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0c40066760 0x7f0c40068c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c156c40 tx=0x7f0c4c0091c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 0x7f0c44007420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4400a350 con 0x7f0c44006f90 2024-05-08T20:45:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 0x7f0c44007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c6216b640 1 -- 172.21.15.81:0/2088871986 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0c4400a510 con 0x7f0c44006f90 2024-05-08T20:45:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c6216b640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 0x7f0c44007420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c5801aa60 tx=0x7f0c58019150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580b6c60 con 0x7f0c44006f90 2024-05-08T20:45:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f0c580c22f0 con 0x7f0c44006f90 2024-05-08T20:45:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 msgr2=0x7f0c44007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 0x7f0c44007420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c5801aa60 tx=0x7f0c58019150 comp rx=0 tx=0).stop 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 msgr2=0x7f0c44007420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c52ffd640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c44006f90 0x7f0c44007420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 136, 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:01.531 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:01.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:01.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:01.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:01.543 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0c40066760 msgr2=0x7f0c40068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0c40066760 0x7f0c40068c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c156c40 tx=0x7f0c4c0091c0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 msgr2=0x7f0c5c0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 --2- 172.21.15.81:0/2088871986 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c5c1501e0 0x7f0c5c0c57d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c54003c40 tx=0x7f0c54009ed0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c6296c640 1 -- 172.21.15.81:0/2088871986 reap_dead start 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c6296c640 1 -- 172.21.15.81:0/2088871986 reap_dead start 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 shutdown_connections 2024-05-08T20:45:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 >> 172.21.15.81:0/2088871986 conn(0x7f0c5c0c2ca0 msgr2=0x7f0c5c142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 shutdown_connections 2024-05-08T20:45:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.526+0000 7f0c643cf640 1 -- 172.21.15.81:0/2088871986 wait complete. 2024-05-08T20:45:01.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:45:01.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:45:01.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:45:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 Processor -- start 2024-05-08T20:45:01.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 -- start start 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59741521f0 0x7f59741554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 0x7f59740c2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740aa830 con 0x7f59740c1bb0 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5974155a20 con 0x7f59740c00c0 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5979505640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5974072900 con 0x7f59741521f0 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f59737fe640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 msgr2=0x7f59740c2040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f59737fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 0x7f59740c2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59741521f0 0x7f59741554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59741521f0 0x7f59741554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52024/0 (socket says 172.21.15.81:52024) 2024-05-08T20:45:01.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 -- 172.21.15.81:0/3310016853 learned_addr learned my addr 172.21.15.81:0/3310016853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 -- 172.21.15.81:0/3310016853 >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 msgr2=0x7f59740c2040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 --2- 172.21.15.81:0/3310016853 >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 0x7f59740c2040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 -- 172.21.15.81:0/3310016853 >> v1:172.21.15.117:6789/0 conn(0x7f59740c1bb0 legacy=0x7f59740bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.658+0000 7f5972ffd640 1 -- 172.21.15.81:0/3310016853 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740c0640 con 0x7f59741521f0 2024-05-08T20:45:01.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5972ffd640 1 --2- 172.21.15.81:0/3310016853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59741521f0 0x7f59741554e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5974155b60 tx=0x7f596801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521d448eb68c1784 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5971ffb640 1 -- 172.21.15.81:0/3310016853 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680a7070 con 0x7f59741521f0 2024-05-08T20:45:01.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5971ffb640 1 -- 172.21.15.81:0/3310016853 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680ab430 con 0x7f59741521f0 2024-05-08T20:45:01.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5971ffb640 1 -- 172.21.15.81:0/3310016853 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680ab7c0 con 0x7f59741521f0 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 -- 172.21.15.81:0/3310016853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59741521f0 msgr2=0x7f59741554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 --2- 172.21.15.81:0/3310016853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59741521f0 0x7f59741554e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5974155b60 tx=0x7f596801c540 comp rx=0 tx=0).stop 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 -- 172.21.15.81:0/3310016853 shutdown_connections 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 --2- 172.21.15.81:0/3310016853 >> v2:172.21.15.81:3300/0 conn(0x7f59740c00c0 0x7f59740c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 --2- 172.21.15.81:0/3310016853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59741521f0 0x7f59741554e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 -- 172.21.15.81:0/3310016853 >> 172.21.15.81:0/3310016853 conn(0x7f59740c2ca0 msgr2=0x7f59740c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 -- 172.21.15.81:0/3310016853 shutdown_connections 2024-05-08T20:45:01.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.662+0000 7f5979505640 1 -- 172.21.15.81:0/3310016853 wait complete. 2024-05-08T20:45:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 Processor -- start 2024-05-08T20:45:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- start start 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 0x7f59741581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59740c1bb0 0x7f5974154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59741521f0 0x7f597414af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f0cd0 con 0x7f59741521f0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f1850 con 0x7f59740c00c0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f0f20 con 0x7f59740c1bb0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f59737fe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59741521f0 msgr2=0x7f597414af30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f59737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59741521f0 0x7f597414af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 0x7f59741581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f59727fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59740c1bb0 0x7f5974154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 0x7f59741581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52034/0 (socket says 172.21.15.81:52034) 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 -- 172.21.15.81:0/747270854 learned_addr learned my addr 172.21.15.81:0/747270854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59740c1bb0 msgr2=0x7f5974154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59740c1bb0 0x7f5974154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59741521f0 msgr2=0x7f597414af30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59741521f0 0x7f597414af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680094d0 con 0x7f59740c00c0 2024-05-08T20:45:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5972ffd640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 0x7f59741581e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59680ad040 tx=0x7f596801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680b4800 con 0x7f59740c00c0 2024-05-08T20:45:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59741f1200 con 0x7f59740c00c0 2024-05-08T20:45:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680b4960 con 0x7f59740c00c0 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974158720 con 0x7f59740c00c0 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680b4cd0 con 0x7f59740c00c0 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 0x7f59740c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740696e0 con 0x7f5974155420 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.666+0000 7f59727fc640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 0x7f59740c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f59727fc640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59740ab300 con 0x7f5974155420 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f59727fc640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 0x7f59740c25a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59740c3c50 tx=0x7f596400f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5968004020 con 0x7f59740c00c0 2024-05-08T20:45:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5960066670 0x7f5960068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f596811e930 con 0x7f59740c00c0 2024-05-08T20:45:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f59737fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5960066670 0x7f5960068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964005320 con 0x7f5974155420 2024-05-08T20:45:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5964005480 con 0x7f5974155420 2024-05-08T20:45:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 msgr2=0x7f59740c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 0x7f59740c25a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59740c3c50 tx=0x7f596400f9d0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 msgr2=0x7f59740c25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f595b7fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5974155420 0x7f59740c25a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.670+0000 7f59737fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5960066670 0x7f5960068b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f596c003d10 tx=0x7f596c009270 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.674+0000 7f5979505640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 0x7f597414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:01.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.674+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f1990 con 0x7f597406cf30 2024-05-08T20:45:01.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.674+0000 7f59727fc640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 0x7f597414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:01.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f59727fc640 1 -- 172.21.15.81:0/747270854 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f59740c0640 con 0x7f597406cf30 2024-05-08T20:45:01.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f59727fc640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 0x7f597414b470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5964013000 tx=0x7f5964007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:01.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964022070 con 0x7f597406cf30 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4795 (secure 0 0 0) 0x7f596401c6d0 con 0x7f597406cf30 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 msgr2=0x7f597414b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 0x7f597414b470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5964013000 tx=0x7f5964007f90 comp rx=0 tx=0).stop 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 msgr2=0x7f597414b470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f595b7fe640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597406cf30 0x7f597414b470 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5964013000 tx=0x7f5964007f90 comp rx=0 tx=0).stop 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:01.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 136, 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:45:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.684 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.685 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:01.686 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.688 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:01.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.690 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.691 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:01.692 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.695 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:01.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:01.697 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5960066670 msgr2=0x7f5960068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5960066670 0x7f5960068b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f596c003d10 tx=0x7f596c009270 comp rx=0 tx=0).stop 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 msgr2=0x7f59741581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 --2- 172.21.15.81:0/747270854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59740c00c0 0x7f59741581e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59680ad040 tx=0x7f596801ad80 comp rx=0 tx=0).stop 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f59737fe640 1 -- 172.21.15.81:0/747270854 reap_dead start 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f59737fe640 1 -- 172.21.15.81:0/747270854 reap_dead start 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 shutdown_connections 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 >> 172.21.15.81:0/747270854 conn(0x7f59740c2ca0 msgr2=0x7f597414ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 shutdown_connections 2024-05-08T20:45:01.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:01.678+0000 7f5979505640 1 -- 172.21.15.81:0/747270854 wait complete. 2024-05-08T20:45:01.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:45:01.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:45:21.701 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:45:21.701 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-05-08T20:45:21.701 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:45:21.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:45:21.704 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:45:21.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:45:21.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:21.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 Processor -- start 2024-05-08T20:45:21.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 -- start start 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc314154cf0 0x7fc314155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3141522e0 con 0x7fc314155690 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3140c5f80 con 0x7fc314151f00 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc31b1b9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31406bb20 con 0x7fc314154cf0 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc319756640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc314155690 0x7fc3140ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45532/0 (socket says 172.21.15.81:45532) 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc319756640 1 -- 172.21.15.81:0/2203874706 learned_addr learned my addr 172.21.15.81:0/2203874706 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc313fff640 1 --2- 172.21.15.81:0/2203874706 >> v2:172.21.15.117:3300/0 conn(0x7fc314154cf0 0x7fc314155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc313fff640 1 -- 172.21.15.81:0/2203874706 >> v1:172.21.15.117:6789/0 conn(0x7fc314151f00 legacy=0x7fc3141588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc313fff640 1 -- 172.21.15.81:0/2203874706 >> v1:172.21.15.81:6789/0 conn(0x7fc314155690 legacy=0x7fc3140ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:21.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.866+0000 7fc313fff640 1 -- 172.21.15.81:0/2203874706 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140c6260 con 0x7fc314154cf0 2024-05-08T20:45:21.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc313fff640 1 --2- 172.21.15.81:0/2203874706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc314154cf0 0x7fc314155150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097c0 tx=0x7fc30001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eec920a471db641f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:21.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc3137fe640 1 -- 172.21.15.81:0/2203874706 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000ac600 con 0x7fc314154cf0 2024-05-08T20:45:21.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc3137fe640 1 -- 172.21.15.81:0/2203874706 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3000a8050 con 0x7fc314154cf0 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc3137fe640 1 -- 172.21.15.81:0/2203874706 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000ac980 con 0x7fc314154cf0 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- 172.21.15.81:0/2203874706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc314154cf0 msgr2=0x7fc314155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/2203874706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc314154cf0 0x7fc314155150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3000097c0 tx=0x7fc30001c380 comp rx=0 tx=0).stop 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- 172.21.15.81:0/2203874706 shutdown_connections 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/2203874706 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc314154cf0 0x7fc314155150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- 172.21.15.81:0/2203874706 >> 172.21.15.81:0/2203874706 conn(0x7fc3140715f0 msgr2=0x7fc314071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- 172.21.15.81:0/2203874706 shutdown_connections 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- 172.21.15.81:0/2203874706 wait complete. 2024-05-08T20:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 Processor -- start 2024-05-08T20:45:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.870+0000 7fc31b1b9640 1 -- start start 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 0x7fc314146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31414ef50 0x7fc314146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31414d6a0 con 0x7fc314151f00 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141f1070 con 0x7fc31414ef50 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141f15f0 con 0x7fc314154cf0 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42312/0 (socket says 172.21.15.81:42312) 2024-05-08T20:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 -- 172.21.15.81:0/1559372969 learned_addr learned my addr 172.21.15.81:0/1559372969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 msgr2=0x7fc314149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 msgr2=0x7fc314149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc318f55640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 0x7fc314146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc319756640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31414ef50 0x7fc314146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31414ef50 msgr2=0x7fc314146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31414ef50 0x7fc314146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 msgr2=0x7fc314149020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 -- 172.21.15.81:0/1559372969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300009420 con 0x7fc314154cf0 2024-05-08T20:45:21.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc313fff640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 0x7fc314146820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc3000ac000 tx=0x7fc30001abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000b7650 con 0x7fc314154cf0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3141f1310 con 0x7fc314154cf0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3000b77b0 con 0x7fc314154cf0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000b7b60 con 0x7fc314154cf0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc314149560 con 0x7fc314154cf0 2024-05-08T20:45:21.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.874+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3140675e0 con 0x7fc314154cf0 2024-05-08T20:45:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.878+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3000b3070 con 0x7fc314154cf0 2024-05-08T20:45:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.878+0000 7fc3117fa640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 0x7fc2f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.878+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc30011eda0 con 0x7fc314154cf0 2024-05-08T20:45:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.878+0000 7fc318f55640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 0x7fc2f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:21.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.878+0000 7fc318f55640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 0x7fc2f8068b80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3140acf30 tx=0x7fc308009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:21.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:21.890+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc3000ebf20 con 0x7fc314154cf0 2024-05-08T20:45:22.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.178+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc314074950 con 0x7fc314154cf0 2024-05-08T20:45:22.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.178+0000 7fc3117fa640 1 -- 172.21.15.81:0/1559372969 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fc3000b1620 con 0x7fc314154cf0 2024-05-08T20:45:22.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":136,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 msgr2=0x7fc2f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 0x7fc2f8068b80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3140acf30 tx=0x7fc308009040 comp rx=0 tx=0).stop 2024-05-08T20:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 msgr2=0x7fc314146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 0x7fc314146820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc3000ac000 tx=0x7fc30001abc0 comp rx=0 tx=0).stop 2024-05-08T20:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 shutdown_connections 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2f80666c0 0x7fc2f8068b80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31414ef50 0x7fc314146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc314154cf0 0x7fc314146820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 --2- 172.21.15.81:0/1559372969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314151f00 0x7fc314149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 >> 172.21.15.81:0/1559372969 conn(0x7fc3140715f0 msgr2=0x7fc314069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 shutdown_connections 2024-05-08T20:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:22.182+0000 7fc31b1b9640 1 -- 172.21.15.81:0/1559372969 wait complete. 2024-05-08T20:45:25.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:45:25.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:45:25.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:25.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 Processor -- start 2024-05-08T20:45:25.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 -- start start 2024-05-08T20:45:25.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff2c40c2bc0 0x7ff2c40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40a94b0 0x7ff2c40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406e790 con 0x7ff2c40c30d0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406f460 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c96c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4155e10 con 0x7ff2c40a94b0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42320/0 (socket says 172.21.15.81:42320) 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/1074228438 learned_addr learned my addr 172.21.15.81:0/1074228438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 msgr2=0x7ff2c40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 msgr2=0x7ff2c40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 --2- 172.21.15.81:0/1074228438 >> v2:172.21.15.117:3300/0 conn(0x7ff2c40c2bc0 0x7ff2c40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c37fe640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40a94b0 0x7ff2c40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 -- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40a94b0 msgr2=0x7ff2c40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:25.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40a94b0 0x7ff2c40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 -- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 msgr2=0x7ff2c40c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:25.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 --2- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.382+0000 7ff2c27fc640 1 -- 172.21.15.81:0/1074228438 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40a9e20 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c27fc640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c40c4120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4071050 tx=0x7ff2b801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeade8057c05f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:25.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c1ffb640 1 -- 172.21.15.81:0/1074228438 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80ad680 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c1ffb640 1 -- 172.21.15.81:0/1074228438 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b80ad7e0 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c1ffb640 1 -- 172.21.15.81:0/1074228438 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80adb70 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 msgr2=0x7ff2c40c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c40c4120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4071050 tx=0x7ff2b801c3c0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- 172.21.15.81:0/1074228438 shutdown_connections 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40a94b0 0x7ff2c40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/1074228438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c40c4120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/1074228438 >> v2:172.21.15.81:3300/0 conn(0x7ff2c40c30d0 0x7ff2c40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- 172.21.15.81:0/1074228438 >> 172.21.15.81:0/1074228438 conn(0x7ff2c40c4cc0 msgr2=0x7ff2c40c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- 172.21.15.81:0/1074228438 shutdown_connections 2024-05-08T20:45:25.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- 172.21.15.81:0/1074228438 wait complete. 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 Processor -- start 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.386+0000 7ff2c96c7640 1 -- start start 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 0x7ff2c4142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4145b90 con 0x7ff2c40a94b0 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41457e0 con 0x7ff2c40c2bc0 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4144f40 con 0x7ff2c40c30d0 2024-05-08T20:45:25.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42326/0 (socket says 172.21.15.81:42326) 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/3590544227 learned_addr learned my addr 172.21.15.81:0/3590544227 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 msgr2=0x7ff2c4144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 msgr2=0x7ff2c4144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c27fc640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 0x7ff2c4142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 msgr2=0x7ff2c414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 msgr2=0x7ff2c4144930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 -- 172.21.15.81:0/3590544227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009420 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c37fe640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 0x7ff2c4142930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00ef00 tx=0x7ff2bc00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc010040 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc009e60 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c4145220 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc014640 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c41ebed0 con 0x7ff2c40c30d0 2024-05-08T20:45:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.390+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c41ec0c0 con 0x7ff2c40c30d0 2024-05-08T20:45:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.394+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2bc0147a0 con 0x7ff2c40c30d0 2024-05-08T20:45:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.394+0000 7ff2ab7fe640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 0x7ff2b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.394+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff2bc085510 con 0x7ff2c40c30d0 2024-05-08T20:45:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.394+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 0x7ff2b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.394+0000 7ff2c2ffd640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 0x7ff2b0068b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40091d0 tx=0x7ff2b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.406+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff2bc052440 con 0x7ff2c40c30d0 2024-05-08T20:45:25.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.658+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff2c4146970 con 0x7ff2c40c30d0 2024-05-08T20:45:25.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.658+0000 7ff2ab7fe640 1 -- 172.21.15.81:0/3590544227 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7ff2bc055a60 con 0x7ff2c40c30d0 2024-05-08T20:45:25.662 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":136,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 msgr2=0x7ff2b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 0x7ff2b0068b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40091d0 tx=0x7ff2b4008040 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 msgr2=0x7ff2c4142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 0x7ff2c4142930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00ef00 tx=0x7ff2bc00b480 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 shutdown_connections 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2b0066690 0x7ff2b0068b50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2c40c30d0 0x7ff2c4142930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c40c2bc0 0x7ff2c414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 --2- 172.21.15.81:0/3590544227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40a94b0 0x7ff2c4144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 >> 172.21.15.81:0/3590544227 conn(0x7ff2c40c4cc0 msgr2=0x7ff2c415c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 shutdown_connections 2024-05-08T20:45:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:25.662+0000 7ff2c96c7640 1 -- 172.21.15.81:0/3590544227 wait complete. 2024-05-08T20:45:28.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 Processor -- start 2024-05-08T20:45:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 -- start start 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c0158080 con 0x7fc0c00c2570 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c006a890 con 0x7fc0c0152340 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c7564640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c006ab70 con 0x7fc0c00c34e0 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c4aff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc0c00c2570 0x7fc0c0154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51396/0 (socket says 172.21.15.81:51396) 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40940/0 (socket says 172.21.15.81:40940) 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c4aff640 1 -- 172.21.15.81:0/3855598452 learned_addr learned my addr 172.21.15.81:0/3855598452 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 msgr2=0x7fc0c0155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 msgr2=0x7fc0c0155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:28.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148143282 0 0) 0x7fc0c006a890 con 0x7fc0c0152340 2024-05-08T20:45:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ac003530 con 0x7fc0c0152340 2024-05-08T20:45:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860023214 0 0) 0x7fc0ac003530 con 0x7fc0c0152340 2024-05-08T20:45:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 msgr2=0x7fc0c0155670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:28.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 --2- 172.21.15.81:0/3855598452 >> v2:172.21.15.81:3300/0 conn(0x7fc0c00c34e0 0x7fc0c0155670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 >> v1:172.21.15.81:6789/0 conn(0x7fc0c00c2570 legacy=0x7fc0c0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00c2d70 con 0x7fc0c0152340 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc0bc001680 con 0x7fc0c0152340 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 >> v1:172.21.15.117:6789/0 conn(0x7fc0c0152340 legacy=0x7fc0c006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac003980 0x7fc0ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.821+0000 7fc0b7fff640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac0047d0 0x7fc0ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 0x7fc0ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c006ab70 con 0x7fc0ac0052b0 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac00c180 con 0x7fc0ac003980 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac00c340 con 0x7fc0ac0047d0 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 0x7fc0ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5300640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac003980 0x7fc0ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c4aff640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac0047d0 0x7fc0ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac0047d0 msgr2=0x7fc0ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:28.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac0047d0 0x7fc0ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac003980 msgr2=0x7fc0ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:28.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac003980 0x7fc0ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac003530 con 0x7fc0ac0052b0 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 -- 172.21.15.81:0/3855598452 reap_dead start 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 0x7fc0ac00b990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009610 tx=0x7fc0b801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb62026bf1c0f09 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80a5c10 con 0x7fc0ac0052b0 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80a5d90 con 0x7fc0ac0052b0 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0b7fff640 1 -- 172.21.15.81:0/3855598452 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80ad680 con 0x7fc0ac0052b0 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c7564640 1 -- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 msgr2=0x7fc0ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.825+0000 7fc0c7564640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 0x7fc0ac00b990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009610 tx=0x7fc0b801ce20 comp rx=0 tx=0).stop 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- 172.21.15.81:0/3855598452 shutdown_connections 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 --2- 172.21.15.81:0/3855598452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac0052b0 0x7fc0ac00b990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- 172.21.15.81:0/3855598452 >> 172.21.15.81:0/3855598452 conn(0x7fc0c00c71b0 msgr2=0x7fc0c00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:28.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- 172.21.15.81:0/3855598452 shutdown_connections 2024-05-08T20:45:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- 172.21.15.81:0/3855598452 wait complete. 2024-05-08T20:45:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 Processor -- start 2024-05-08T20:45:28.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- start start 2024-05-08T20:45:28.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 0x7fc0c0071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 0x7fc0c0071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0071140 con 0x7fc0c00ac2b0 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01eadf0 con 0x7fc0ac0052b0 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c7564640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00acc70 con 0x7fc0c00ad020 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40954/0 (socket says 172.21.15.81:40954) 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 -- 172.21.15.81:0/2390805296 learned_addr learned my addr 172.21.15.81:0/2390805296 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 msgr2=0x7fc0c00ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 msgr2=0x7fc0c00ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5300640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 0x7fc0c0071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c4aff640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 0x7fc0c0071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.829+0000 7fc0c5b01640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:28.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 msgr2=0x7fc0c0071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 0x7fc0c0071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 msgr2=0x7fc0c00ac730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 -- 172.21.15.81:0/2390805296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00aaaa0 con 0x7fc0ac0052b0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c4aff640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 0x7fc0c0071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c5300640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 0x7fc0c0071700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007e10 tx=0x7fc0bc0105b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0052d0 con 0x7fc0ac0052b0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc00d050 con 0x7fc0ac0052b0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c0148830 con 0x7fc0ac0052b0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc003800 con 0x7fc0ac0052b0 2024-05-08T20:45:28.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c01eafe0 con 0x7fc0ac0052b0 2024-05-08T20:45:28.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00675e0 con 0x7fc0ac0052b0 2024-05-08T20:45:28.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.833+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0bc003960 con 0x7fc0ac0052b0 2024-05-08T20:45:28.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.837+0000 7fc0b5ffb640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 0x7fc0a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:28.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.837+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc0bc087690 con 0x7fc0ac0052b0 2024-05-08T20:45:28.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.837+0000 7fc0c4aff640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 0x7fc0a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:28.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.837+0000 7fc0c4aff640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 0x7fc0a4068b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0154d60 tx=0x7fc0b0007db0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:28.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:28.853+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc0bc0547d0 con 0x7fc0ac0052b0 2024-05-08T20:45:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.093+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc0c0074950 con 0x7fc0ac0052b0 2024-05-08T20:45:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.093+0000 7fc0b5ffb640 1 -- 172.21.15.81:0/2390805296 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fc0bc057df0 con 0x7fc0ac0052b0 2024-05-08T20:45:29.098 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":136,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.093+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 msgr2=0x7fc0a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.093+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 0x7fc0a4068b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0154d60 tx=0x7fc0b0007db0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 msgr2=0x7fc0c0071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 0x7fc0c0071700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007e10 tx=0x7fc0bc0105b0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 shutdown_connections 2024-05-08T20:45:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc0a4066690 0x7fc0a4068b50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c00ac2b0 0x7fc0c00ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0c00ad020 0x7fc0c0071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 --2- 172.21.15.81:0/2390805296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac0052b0 0x7fc0c0071700 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc007e10 tx=0x7fc0bc0105b0 comp rx=0 tx=0).stop 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 >> 172.21.15.81:0/2390805296 conn(0x7fc0c00c71b0 msgr2=0x7fc0c00c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 shutdown_connections 2024-05-08T20:45:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:29.097+0000 7fc0c7564640 1 -- 172.21.15.81:0/2390805296 wait complete. 2024-05-08T20:45:32.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 Processor -- start 2024-05-08T20:45:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 -- start start 2024-05-08T20:45:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c28154cf0 0x7f8c28155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c281522e0 con 0x7f8c28151f00 2024-05-08T20:45:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2806bb20 con 0x7f8c28154cf0 2024-05-08T20:45:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2e951640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281548e0 con 0x7f8c28155690 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2ceee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c1ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8c28154cf0 0x7f8c28155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2ceee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:54352/0 (socket says 172.21.15.81:54352) 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2ceee640 1 -- 172.21.15.81:0/469450604 learned_addr learned my addr 172.21.15.81:0/469450604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c1ffff640 1 -- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 msgr2=0x7f8c280ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c1ffff640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c1ffff640 1 -- 172.21.15.81:0/469450604 >> v1:172.21.15.117:6789/0 conn(0x7f8c28151f00 legacy=0x7f8c281588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c1ffff640 1 -- 172.21.15.81:0/469450604 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280c5f80 con 0x7f8c28154cf0 2024-05-08T20:45:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.257+0000 7f8c2ceee640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:45:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c1ffff640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28154cf0 0x7f8c28155150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c100097c0 tx=0x7f8c1001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b7418cb5857c62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c277fe640 1 -- 172.21.15.81:0/469450604 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100ab600 con 0x7f8c28154cf0 2024-05-08T20:45:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c277fe640 1 -- 172.21.15.81:0/469450604 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100a7050 con 0x7f8c28154cf0 2024-05-08T20:45:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c277fe640 1 -- 172.21.15.81:0/469450604 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100ab980 con 0x7f8c28154cf0 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 -- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28154cf0 msgr2=0x7f8c28155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28154cf0 0x7f8c28155150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c100097c0 tx=0x7f8c1001c380 comp rx=0 tx=0).stop 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 -- 172.21.15.81:0/469450604 shutdown_connections 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28155690 0x7f8c280ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 --2- 172.21.15.81:0/469450604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28154cf0 0x7f8c28155150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 -- 172.21.15.81:0/469450604 >> 172.21.15.81:0/469450604 conn(0x7f8c280715f0 msgr2=0x7f8c28071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 -- 172.21.15.81:0/469450604 shutdown_connections 2024-05-08T20:45:32.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.261+0000 7f8c2e951640 1 -- 172.21.15.81:0/469450604 wait complete. 2024-05-08T20:45:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 Processor -- start 2024-05-08T20:45:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- start start 2024-05-08T20:45:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 0x7f8c281f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28154cf0 0x7f8c281488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281561a0 con 0x7f8c281f1050 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28155b70 con 0x7f8c28151f00 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28149370 con 0x7f8c28154cf0 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40962/0 (socket says 172.21.15.81:40962) 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 -- 172.21.15.81:0/765451271 learned_addr learned my addr 172.21.15.81:0/765451271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 msgr2=0x7f8c28148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 msgr2=0x7f8c28148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2ceee640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 0x7f8c281f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c1ffff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28154cf0 0x7f8c281488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28154cf0 msgr2=0x7f8c281488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:32.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28154cf0 0x7f8c281488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 msgr2=0x7f8c28148e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 -- 172.21.15.81:0/765451271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009b30 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c27fff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 0x7f8c281f0b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f70 tx=0x7f8c1800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180052d0 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c10009420 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c18005430 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18003840 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28155e30 con 0x7f8c28151f00 2024-05-08T20:45:32.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.265+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c280675e0 con 0x7f8c28151f00 2024-05-08T20:45:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.269+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c180039a0 con 0x7f8c28151f00 2024-05-08T20:45:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.269+0000 7f8c257fa640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 0x7f8c08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.269+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8c18083e10 con 0x7f8c28151f00 2024-05-08T20:45:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.269+0000 7f8c1ffff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 0x7f8c08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.269+0000 7f8c1ffff640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 0x7f8c08068b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c100ad000 tx=0x7f8c10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.285+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8c18050f20 con 0x7f8c28151f00 2024-05-08T20:45:32.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.537+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8c28074950 con 0x7f8c28151f00 2024-05-08T20:45:32.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.537+0000 7f8c257fa640 1 -- 172.21.15.81:0/765451271 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f8c18017080 con 0x7f8c28151f00 2024-05-08T20:45:32.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":136,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 msgr2=0x7f8c08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 0x7f8c08068b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8c100ad000 tx=0x7f8c10008040 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 msgr2=0x7f8c281f0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 0x7f8c281f0b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f70 tx=0x7f8c1800c820 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 shutdown_connections 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c080666c0 0x7f8c08068b80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c281f1050 0x7f8c28148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c28154cf0 0x7f8c281488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 --2- 172.21.15.81:0/765451271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c28151f00 0x7f8c281f0b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 >> 172.21.15.81:0/765451271 conn(0x7f8c280715f0 msgr2=0x7f8c280aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 shutdown_connections 2024-05-08T20:45:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:32.541+0000 7f8c2e951640 1 -- 172.21.15.81:0/765451271 wait complete. 2024-05-08T20:45:35.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.809+0000 7fe3b0c5d640 1 Processor -- start 2024-05-08T20:45:35.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.809+0000 7fe3b0c5d640 1 -- start start 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3b0c5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe3ac0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3b0c5d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe3ac0a9970 0x7fe3ac153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3b0c5d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ac153880 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3b0c5d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3ac0c47c0 con 0x7fe3ac0a9970 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3b0c5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0c6220 con 0x7fe3ac0c3510 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3aad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3ac0c38f0 0x7fe3ac0c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51404/0 (socket says 172.21.15.81:51404) 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3aad9d640 1 -- 172.21.15.81:0/2329424808 learned_addr learned my addr 172.21.15.81:0/2329424808 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/2329424808 >> v2:172.21.15.117:3300/0 conn(0x7fe3ac0a9970 0x7fe3ac153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3aa59c640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe3ac0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554205490 0 0) 0x7fe3a40014a0 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe394003530 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73498268 0 0) 0x7fe394003530 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 msgr2=0x7fe3ac0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe3ac0aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 >> v2:172.21.15.117:3300/0 conn(0x7fe3ac0a9970 msgr2=0x7fe3ac153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 --2- 172.21.15.81:0/2329424808 >> v2:172.21.15.117:3300/0 conn(0x7fe3ac0a9970 0x7fe3ac153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac0c6500 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe3a4001b90 con 0x7fe3ac0c38f0 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 >> v1:172.21.15.81:6789/0 conn(0x7fe3ac0c38f0 legacy=0x7fe3ac0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394003980 0x7fe394003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe394005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0c47c0 con 0x7fe3940047d0 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac0c6220 con 0x7fe394003980 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39400b990 con 0x7fe3ac0c3510 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3aa59c640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394003980 0x7fe394003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3aad9d640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe394005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 -- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 msgr2=0x7fe394005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac0c3510 0x7fe394005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 -- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394003980 msgr2=0x7fe394003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394003980 0x7fe394003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.813+0000 7fe3a9d9b640 1 -- 172.21.15.81:0/2329424808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394003530 con 0x7fe3940047d0 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009ae0 tx=0x7fe3a001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3564860fdfd542f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00a6450 con 0x7fe3940047d0 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00a65b0 con 0x7fe3940047d0 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3a959a640 1 -- 172.21.15.81:0/2329424808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00a6960 con 0x7fe3940047d0 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/2329424808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 msgr2=0x7fe394004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/2329424808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009ae0 tx=0x7fe3a001ca40 comp rx=0 tx=0).stop 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3aad9d640 1 -- 172.21.15.81:0/2329424808 reap_dead start 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/2329424808 shutdown_connections 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/2329424808 >> 172.21.15.81:0/2329424808 conn(0x7fe3ac0c68c0 msgr2=0x7fe3ac0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/2329424808 shutdown_connections 2024-05-08T20:45:35.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/2329424808 wait complete. 2024-05-08T20:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 Processor -- start 2024-05-08T20:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- start start 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac1f0c10 0x7fe3ac1f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3ac1f15d0 0x7fe3ac06b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac15b810 con 0x7fe3940047d0 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac1ed4a0 con 0x7fe3ac1f15d0 2024-05-08T20:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3b0c5d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ac1ed760 con 0x7fe3ac1f0c10 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3aa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3aa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40982/0 (socket says 172.21.15.81:40982) 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.817+0000 7fe3aa59c640 1 -- 172.21.15.81:0/1192974681 learned_addr learned my addr 172.21.15.81:0/1192974681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac1f0c10 0x7fe3ac1f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aad9d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3ac1f15d0 0x7fe3ac06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 -- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac1f0c10 msgr2=0x7fe3ac1f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac1f0c10 0x7fe3ac1f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 -- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3ac1f15d0 msgr2=0x7fe3ac06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3ac1f15d0 0x7fe3ac06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 -- 172.21.15.81:0/1192974681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac1eda40 con 0x7fe3940047d0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3aa59c640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0115e0 tx=0x7fe39c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00f8f0 con 0x7fe3940047d0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00fa50 con 0x7fe3940047d0 2024-05-08T20:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ac1edd20 con 0x7fe3940047d0 2024-05-08T20:45:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00fdc0 con 0x7fe3940047d0 2024-05-08T20:45:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac1ee2e0 con 0x7fe3940047d0 2024-05-08T20:45:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ac074950 con 0x7fe3940047d0 2024-05-08T20:45:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe39c015460 con 0x7fe3940047d0 2024-05-08T20:45:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 0x7fe38c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe39c084c40 con 0x7fe3940047d0 2024-05-08T20:45:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 0x7fe38c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.821+0000 7fe3a9d9b640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 0x7fe38c068b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00ad000 tx=0x7fe3a00b2040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:35.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:35.829+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe39c051ca0 con 0x7fe3940047d0 2024-05-08T20:45:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.329+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe3ac066100 con 0x7fe3940047d0 2024-05-08T20:45:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.333+0000 7fe39affd640 1 -- 172.21.15.81:0/1192974681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe39c0552c0 con 0x7fe3940047d0 2024-05-08T20:45:36.338 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 msgr2=0x7fe38c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 0x7fe38c068b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3a00ad000 tx=0x7fe3a00b2040 comp rx=0 tx=0).stop 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 msgr2=0x7fe3ac0bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0115e0 tx=0x7fe39c011aa0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 shutdown_connections 2024-05-08T20:45:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe38c0666c0 0x7fe38c068b80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3ac1f15d0 0x7fe3ac06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3ac1f0c10 0x7fe3ac1f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 --2- 172.21.15.81:0/1192974681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940047d0 0x7fe3ac0bff50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 >> 172.21.15.81:0/1192974681 conn(0x7fe3ac0c68c0 msgr2=0x7fe3ac0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 shutdown_connections 2024-05-08T20:45:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.337+0000 7fe3b0c5d640 1 -- 172.21.15.81:0/1192974681 wait complete. 2024-05-08T20:45:36.363 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:45:36.364 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:45:36.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:45:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 Processor -- start 2024-05-08T20:45:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 -- start start 2024-05-08T20:45:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea7406b230 0x7fea740c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea740c3a50 con 0x7fea7414edf0 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea74072940 con 0x7fea7406b230 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea7a7d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea740705e0 con 0x7fea74070c00 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea73fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea7406b230 0x7fea740c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea78d6f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea7414edf0 0x7fea741519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51418/0 (socket says 172.21.15.81:51418) 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea78d6f640 1 -- 172.21.15.81:0/2066166514 learned_addr learned my addr 172.21.15.81:0/2066166514 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea6bfff640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea73fff640 1 -- 172.21.15.81:0/2066166514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 msgr2=0x7fea7414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea73fff640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea73fff640 1 -- 172.21.15.81:0/2066166514 >> v1:172.21.15.81:6789/0 conn(0x7fea7414edf0 legacy=0x7fea741519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea73fff640 1 -- 172.21.15.81:0/2066166514 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740708c0 con 0x7fea7406b230 2024-05-08T20:45:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.493+0000 7fea737fe640 1 -- 172.21.15.81:0/2066166514 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289926457 0 0) 0x7fea740c3a50 con 0x7fea7414edf0 2024-05-08T20:45:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea73fff640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7406b230 0x7fea740c2800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea640097c0 tx=0x7fea6401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5eb9649a404dc22 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea737fe640 1 -- 172.21.15.81:0/2066166514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640a7070 con 0x7fea7406b230 2024-05-08T20:45:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea737fe640 1 -- 172.21.15.81:0/2066166514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea640ab430 con 0x7fea7406b230 2024-05-08T20:45:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea737fe640 1 -- 172.21.15.81:0/2066166514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640ab7c0 con 0x7fea7406b230 2024-05-08T20:45:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- 172.21.15.81:0/2066166514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7406b230 msgr2=0x7fea740c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7406b230 0x7fea740c2800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea640097c0 tx=0x7fea6401c410 comp rx=0 tx=0).stop 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- 172.21.15.81:0/2066166514 shutdown_connections 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/2066166514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7406b230 0x7fea740c2800 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- 172.21.15.81:0/2066166514 >> 172.21.15.81:0/2066166514 conn(0x7fea740c71b0 msgr2=0x7fea740c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- 172.21.15.81:0/2066166514 shutdown_connections 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- 172.21.15.81:0/2066166514 wait complete. 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 Processor -- start 2024-05-08T20:45:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.497+0000 7fea7a7d2640 1 -- start start 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea7406b230 0x7fea741ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 0x7fea741f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea740aa5b0 con 0x7fea7414edf0 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74155930 con 0x7fea7406b230 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea741553b0 con 0x7fea74070c00 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 0x7fea741f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 0x7fea741f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41002/0 (socket says 172.21.15.81:41002) 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 learned_addr learned my addr 172.21.15.81:0/4168446422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea6bfff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea73fff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea7406b230 0x7fea741ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 msgr2=0x7fea7414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea74070c00 0x7fea7414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea7406b230 msgr2=0x7fea741ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea7406b230 0x7fea741ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009420 con 0x7fea7414edf0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea78d6f640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 0x7fea741f1270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c780 tx=0x7fea6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00ce90 con 0x7fea7414edf0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c00a640 con 0x7fea7414edf0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea741ed910 con 0x7fea7414edf0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00a9d0 con 0x7fea7414edf0 2024-05-08T20:45:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea74155650 con 0x7fea7414edf0 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 0x7fea741f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74069550 con 0x7fea7413b900 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea73fff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 0x7fea741f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea73fff640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea74152700 con 0x7fea7413b900 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea73fff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 0x7fea741f09d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea7406bd60 tx=0x7fea6401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea6c00ab30 con 0x7fea7414edf0 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fea54066690 0x7fea54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea6bfff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fea54066690 0x7fea54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640b5810 con 0x7fea7413b900 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.501+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fea6c083c90 con 0x7fea7414edf0 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fea640b9070 con 0x7fea7413b900 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 msgr2=0x7fea741f09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea717fa640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 0x7fea741f09d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea7406bd60 tx=0x7fea6401ac50 comp rx=0 tx=0).stop 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 msgr2=0x7fea741f09d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea717fa640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413b900 0x7fea741f09d0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea7406bd60 tx=0x7fea6401ac50 comp rx=0 tx=0).stop 2024-05-08T20:45:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.505+0000 7fea6bfff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fea54066690 0x7fea54068b50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fea7415b2a0 tx=0x7fea5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 0x7fea741ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7413bce0 con 0x7fea7413be50 2024-05-08T20:45:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea73fff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 0x7fea741ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea73fff640 1 -- 172.21.15.81:0/4168446422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fea740675e0 con 0x7fea7413be50 2024-05-08T20:45:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea73fff640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 0x7fea741ea690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea6401c450 tx=0x7fea640191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.509+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640c4040 con 0x7fea7413be50 2024-05-08T20:45:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7fea640c52d0 con 0x7fea7413be50 2024-05-08T20:45:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 msgr2=0x7fea741ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea717fa640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 0x7fea741ea690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea6401c450 tx=0x7fea640191b0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea717fa640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 msgr2=0x7fea741ea690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea717fa640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7413be50 0x7fea741ea690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.518 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.519 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:36.529 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fea54066690 msgr2=0x7fea54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fea54066690 0x7fea54068b50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fea7415b2a0 tx=0x7fea5c008040 comp rx=0 tx=0).stop 2024-05-08T20:45:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 msgr2=0x7fea741f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 --2- 172.21.15.81:0/4168446422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7414edf0 0x7fea741f1270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c780 tx=0x7fea6c00cc40 comp rx=0 tx=0).stop 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 reap_dead start 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea78d6f640 1 -- 172.21.15.81:0/4168446422 reap_dead start 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 shutdown_connections 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 >> 172.21.15.81:0/4168446422 conn(0x7fea740c71b0 msgr2=0x7fea740c1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 shutdown_connections 2024-05-08T20:45:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.513+0000 7fea7a7d2640 1 -- 172.21.15.81:0/4168446422 wait complete. 2024-05-08T20:45:36.538 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:36.538 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:45:36.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:45:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.657+0000 7fcb3f1df640 1 Processor -- start 2024-05-08T20:45:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.657+0000 7fcb3f1df640 1 -- start start 2024-05-08T20:45:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3f1df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb380c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3f1df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb38070c00 0x7fcb3814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3f1df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380c3a50 con 0x7fcb3814edf0 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3f1df640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb38072940 con 0x7fcb38070c00 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3f1df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380705e0 con 0x7fcb3806b230 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb38070c00 0x7fcb3814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb38070c00 0x7fcb3814e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41034/0 (socket says 172.21.15.81:41034) 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 -- 172.21.15.81:0/2962083120 learned_addr learned my addr 172.21.15.81:0/2962083120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb380c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 -- 172.21.15.81:0/2962083120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 msgr2=0x7fcb380c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb380c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 -- 172.21.15.81:0/2962083120 >> v1:172.21.15.117:6789/0 conn(0x7fcb3814edf0 legacy=0x7fcb381519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 -- 172.21.15.81:0/2962083120 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380708c0 con 0x7fcb38070c00 2024-05-08T20:45:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb37fff640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb3814e8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab60829def580a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.661+0000 7fcb377fe640 1 -- 172.21.15.81:0/2962083120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240ac640 con 0x7fcb38070c00 2024-05-08T20:45:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb377fe640 1 -- 172.21.15.81:0/2962083120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240ac7a0 con 0x7fcb38070c00 2024-05-08T20:45:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb377fe640 1 -- 172.21.15.81:0/2962083120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240acb30 con 0x7fcb38070c00 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- 172.21.15.81:0/2962083120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 msgr2=0x7fcb3814e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb3814e8b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb2401c4d0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- 172.21.15.81:0/2962083120 shutdown_connections 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb3814e8b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/2962083120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb380c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- 172.21.15.81:0/2962083120 >> 172.21.15.81:0/2962083120 conn(0x7fcb380c71b0 msgr2=0x7fcb380c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- 172.21.15.81:0/2962083120 shutdown_connections 2024-05-08T20:45:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- 172.21.15.81:0/2962083120 wait complete. 2024-05-08T20:45:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 Processor -- start 2024-05-08T20:45:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- start start 2024-05-08T20:45:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb3814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb38148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3814edf0 0x7fcb38149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815bae0 con 0x7fcb38070c00 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38149770 con 0x7fcb3814edf0 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3f1df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb381455b0 con 0x7fcb3806b230 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb38148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb38148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41036/0 (socket says 172.21.15.81:41036) 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 -- 172.21.15.81:0/1979957253 learned_addr learned my addr 172.21.15.81:0/1979957253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb3814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3d77c640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3814edf0 0x7fcb38149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 msgr2=0x7fcb3814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3806b230 0x7fcb3814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3814edf0 msgr2=0x7fcb38149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3814edf0 0x7fcb38149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240094d0 con 0x7fcb38070c00 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb3d77c640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3814edf0 0x7fcb38149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:45:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.665+0000 7fcb37fff640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb38148cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb240af040 tx=0x7fcb24019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240b7670 con 0x7fcb38070c00 2024-05-08T20:45:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240b77d0 con 0x7fcb38070c00 2024-05-08T20:45:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb381452d0 con 0x7fcb38070c00 2024-05-08T20:45:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240b7b80 con 0x7fcb38070c00 2024-05-08T20:45:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb381edcc0 con 0x7fcb38070c00 2024-05-08T20:45:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 0x7fcb381edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38069550 con 0x7fcb38147ce0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 0x7fcb381edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb240b3070 con 0x7fcb38070c00 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3cf7b640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb38150fb0 con 0x7fcb38147ce0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb1c066690 0x7fcb1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcb2411ef10 con 0x7fcb38070c00 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 0x7fcb381edeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00f4b0 tx=0x7fcb2c00f970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3d77c640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb1c066690 0x7fcb1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb3d77c640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb1c066690 0x7fcb1c068b50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcb30007fd0 tx=0x7fcb30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c014870 con 0x7fcb38147ce0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fcb2c0149d0 con 0x7fcb38147ce0 2024-05-08T20:45:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 msgr2=0x7fcb381edeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 0x7fcb381edeb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00f4b0 tx=0x7fcb2c00f970 comp rx=0 tx=0).stop 2024-05-08T20:45:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 msgr2=0x7fcb381edeb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.669+0000 7fcb357fa640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb38147ce0 0x7fcb381edeb0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00f4b0 tx=0x7fcb2c00f970 comp rx=0 tx=0).stop 2024-05-08T20:45:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.677+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 0x7fcb3813e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.677+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815e8a0 con 0x7fcb3813e510 2024-05-08T20:45:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 0x7fcb3813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3cf7b640 1 -- 172.21.15.81:0/1979957253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcb380675e0 con 0x7fcb3813e510 2024-05-08T20:45:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3cf7b640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 0x7fcb3813e920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00f4b0 tx=0x7fcb2c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c02a620 con 0x7fcb3813e510 2024-05-08T20:45:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fcb2c0202a0 con 0x7fcb3813e510 2024-05-08T20:45:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 msgr2=0x7fcb3813e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 0x7fcb3813e920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00f4b0 tx=0x7fcb2c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 msgr2=0x7fcb3813e920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb357fa640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb3813e510 0x7fcb3813e920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:36.700 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb1c066690 msgr2=0x7fcb1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcb1c066690 0x7fcb1c068b50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcb30007fd0 tx=0x7fcb30009040 comp rx=0 tx=0).stop 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 msgr2=0x7fcb38148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 --2- 172.21.15.81:0/1979957253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb38070c00 0x7fcb38148cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb240af040 tx=0x7fcb24019270 comp rx=0 tx=0).stop 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3d77c640 1 -- 172.21.15.81:0/1979957253 reap_dead start 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3d77c640 1 -- 172.21.15.81:0/1979957253 reap_dead start 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 shutdown_connections 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 >> 172.21.15.81:0/1979957253 conn(0x7fcb380c71b0 msgr2=0x7fcb38142360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 shutdown_connections 2024-05-08T20:45:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.681+0000 7fcb3f1df640 1 -- 172.21.15.81:0/1979957253 wait complete. 2024-05-08T20:45:36.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:36.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:45:36.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:45:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 Processor -- start 2024-05-08T20:45:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 -- start start 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc808152340 0x7fc80806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc80806d7d0 0x7fc808155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc808158080 con 0x7fc8080c2570 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80806ab70 con 0x7fc80806d7d0 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.829+0000 7fc80ebe2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc808154b10 con 0x7fc808152340 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc807fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc8080c2570 0x7fc808154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51430/0 (socket says 172.21.15.81:51430) 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc807fff640 1 -- 172.21.15.81:0/1634309086 learned_addr learned my addr 172.21.15.81:0/1634309086 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 --2- 172.21.15.81:0/1634309086 >> v2:172.21.15.81:3300/0 conn(0x7fc80806d7d0 0x7fc808155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80c97e640 1 --2- 172.21.15.81:0/1634309086 >> v2:172.21.15.117:3300/0 conn(0x7fc808152340 0x7fc80806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc8077fe640 1 -- 172.21.15.81:0/1634309086 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072873666 0 0) 0x7fc808158080 con 0x7fc8080c2570 2024-05-08T20:45:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc8077fe640 1 -- 172.21.15.81:0/1634309086 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8003530 con 0x7fc8080c2570 2024-05-08T20:45:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 -- 172.21.15.81:0/1634309086 >> v2:172.21.15.117:3300/0 conn(0x7fc808152340 msgr2=0x7fc80806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 --2- 172.21.15.81:0/1634309086 >> v2:172.21.15.117:3300/0 conn(0x7fc808152340 0x7fc80806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 -- 172.21.15.81:0/1634309086 >> v1:172.21.15.81:6789/0 conn(0x7fc8080c2570 legacy=0x7fc808154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 -- 172.21.15.81:0/1634309086 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80806a890 con 0x7fc80806d7d0 2024-05-08T20:45:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc80d17f640 1 --2- 172.21.15.81:0/1634309086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808155670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc80806fd50 tx=0x7fc80001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e475983a39805e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc8077fe640 1 -- 172.21.15.81:0/1634309086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a5930 con 0x7fc80806d7d0 2024-05-08T20:45:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc8077fe640 1 -- 172.21.15.81:0/1634309086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000a5a90 con 0x7fc80806d7d0 2024-05-08T20:45:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.833+0000 7fc8077fe640 1 -- 172.21.15.81:0/1634309086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a5e20 con 0x7fc80806d7d0 2024-05-08T20:45:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/1634309086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 msgr2=0x7fc808155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/1634309086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808155670 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc80806fd50 tx=0x7fc80001c870 comp rx=0 tx=0).stop 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/1634309086 shutdown_connections 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/1634309086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808155670 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/1634309086 >> v2:172.21.15.117:3300/0 conn(0x7fc808152340 0x7fc80806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/1634309086 >> 172.21.15.81:0/1634309086 conn(0x7fc8080c71b0 msgr2=0x7fc8080c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/1634309086 shutdown_connections 2024-05-08T20:45:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/1634309086 wait complete. 2024-05-08T20:45:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 Processor -- start 2024-05-08T20:45:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- start start 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8080c2570 0x7fc8081f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc808152340 0x7fc80814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808147200 con 0x7fc80806d7d0 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8081f0ce0 con 0x7fc8080c2570 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8081ed230 con 0x7fc808152340 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41048/0 (socket says 172.21.15.81:41048) 2024-05-08T20:45:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 -- 172.21.15.81:0/2012722714 learned_addr learned my addr 172.21.15.81:0/2012722714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8080c2570 0x7fc8081f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80d17f640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc808152340 0x7fc80814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc808152340 msgr2=0x7fc80814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc808152340 0x7fc80814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8080c2570 msgr2=0x7fc8081f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8080c2570 0x7fc8081f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009a70 con 0x7fc80806d7d0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8080c2570 0x7fc8081f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80c97e640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e930 tx=0x7fc7fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc009690 con 0x7fc80806d7d0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00ca00 con 0x7fc80806d7d0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8081f0f80 con 0x7fc80806d7d0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00cd70 con 0x7fc80806d7d0 2024-05-08T20:45:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.837+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8081f1540 con 0x7fc80806d7d0 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 0x7fc8081eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc808069550 con 0x7fc8081ed450 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 0x7fc8081eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc807fff640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc808161bf0 con 0x7fc8081ed450 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7fc013470 con 0x7fc80806d7d0 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 0x7fc8081eda10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc80814ddd0 tx=0x7fc7f400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc7ec066690 0x7fc7ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc7fc084750 con 0x7fc80806d7d0 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc80d17f640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc7ec066690 0x7fc7ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40058c0 con 0x7fc8081ed450 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc80d17f640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc7ec066690 0x7fc7ec068b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc8000af000 tx=0x7fc8000a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc7f400eed0 con 0x7fc8081ed450 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 msgr2=0x7fc8081eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 0x7fc8081eda10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc80814ddd0 tx=0x7fc7f400eb90 comp rx=0 tx=0).stop 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 msgr2=0x7fc8081eda10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.841+0000 7fc8057fa640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081ed450 0x7fc8081eda10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.849+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 0x7fc808071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.849+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080675e0 con 0x7fc8081edf50 2024-05-08T20:45:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 0x7fc808071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc807fff640 1 -- 172.21.15.81:0/2012722714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc808074950 con 0x7fc8081edf50 2024-05-08T20:45:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc807fff640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 0x7fc808071880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4014000 tx=0x7fc7f4001160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4005ea0 con 0x7fc8081edf50 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7fc7f40072e0 con 0x7fc8081edf50 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 msgr2=0x7fc808071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 0x7fc808071880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4014000 tx=0x7fc7f4001160 comp rx=0 tx=0).stop 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 msgr2=0x7fc808071880 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc8057fa640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8081edf50 0x7fc808071880 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4014000 tx=0x7fc7f4001160 comp rx=0 tx=0).stop 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc7ec066690 msgr2=0x7fc7ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc7ec066690 0x7fc7ec068b50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc8000af000 tx=0x7fc8000a7070 comp rx=0 tx=0).stop 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 msgr2=0x7fc808146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e930 tx=0x7fc7fc00edf0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80d17f640 1 -- 172.21.15.81:0/2012722714 reap_dead start 2024-05-08T20:45:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 shutdown_connections 2024-05-08T20:45:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 --2- 172.21.15.81:0/2012722714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc80806d7d0 0x7fc808146150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 >> 172.21.15.81:0/2012722714 conn(0x7fc8080c71b0 msgr2=0x7fc808153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 shutdown_connections 2024-05-08T20:45:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:36.853+0000 7fc80ebe2640 1 -- 172.21.15.81:0/2012722714 wait complete. 2024-05-08T20:45:36.876 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:36.876 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:45:36.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:45:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 Processor -- start 2024-05-08T20:45:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 -- start start 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0a94b0 0x7f4b5c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c155e10 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c06e790 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b62a8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c06f460 con 0x7f4b5c0a94b0 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41058/0 (socket says 172.21.15.81:41058) 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 -- 172.21.15.81:0/1122950498 learned_addr learned my addr 172.21.15.81:0/1122950498 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b61028640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0a94b0 0x7f4b5c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 -- 172.21.15.81:0/1122950498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0a94b0 msgr2=0x7f4b5c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0a94b0 0x7f4b5c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 -- 172.21.15.81:0/1122950498 >> v1:172.21.15.117:6789/0 conn(0x7f4b5c0c30d0 legacy=0x7f4b5c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.177+0000 7f4b5bfff640 1 -- 172.21.15.81:0/1122950498 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0a9e20 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b5bfff640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009870 tx=0x7f4b4801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d13404301b2723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b5b7fe640 1 -- 172.21.15.81:0/1122950498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480a6040 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b5b7fe640 1 -- 172.21.15.81:0/1122950498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b480aa600 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b5b7fe640 1 -- 172.21.15.81:0/1122950498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480aa990 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- 172.21.15.81:0/1122950498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c2bc0 msgr2=0x7f4b5c0c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009870 tx=0x7f4b4801c4a0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- 172.21.15.81:0/1122950498 shutdown_connections 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0a94b0 0x7f4b5c0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/1122950498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c2bc0 0x7f4b5c0c34b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- 172.21.15.81:0/1122950498 >> 172.21.15.81:0/1122950498 conn(0x7f4b5c0c4cc0 msgr2=0x7f4b5c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- 172.21.15.81:0/1122950498 shutdown_connections 2024-05-08T20:45:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- 172.21.15.81:0/1122950498 wait complete. 2024-05-08T20:45:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 Processor -- start 2024-05-08T20:45:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.181+0000 7f4b62a8b640 1 -- start start 2024-05-08T20:45:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5c0a94b0 0x7f4b5c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0c2bc0 0x7f4b5c142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1452d0 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1433b0 con 0x7f4b5c0a94b0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1ed070 con 0x7f4b5c0c2bc0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41066/0 (socket says 172.21.15.81:41066) 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 -- 172.21.15.81:0/2875807829 learned_addr learned my addr 172.21.15.81:0/2875807829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b5bfff640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0c2bc0 0x7f4b5c142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b60827640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5c0a94b0 0x7f4b5c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 -- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0c2bc0 msgr2=0x7f4b5c142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0c2bc0 0x7f4b5c142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 -- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5c0a94b0 msgr2=0x7f4b5c15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5c0a94b0 0x7f4b5c15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 -- 172.21.15.81:0/2875807829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480094d0 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b61028640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b54007e40 tx=0x7f4b5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54014620 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400ee90 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1ed350 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540149e0 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1ed910 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c074950 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b54014b40 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b60827640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4b54084e70 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.185+0000 7f4b60827640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 0x7f4b40068b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c15bf80 tx=0x7f4b50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.189+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4b54051ed0 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.421+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f4b5c072600 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.421+0000 7f4b597fa640 1 -- 172.21.15.81:0/2875807829 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f4b540554f0 con 0x7f4b5c0c30d0 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 msgr2=0x7f4b40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 0x7f4b40068b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c15bf80 tx=0x7f4b50009040 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 msgr2=0x7f4b5c142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b54007e40 tx=0x7f4b5400e4b0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 shutdown_connections 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b5c0c30d0 0x7f4b5c142e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b5c0c2bc0 0x7f4b5c142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 --2- 172.21.15.81:0/2875807829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b5c0a94b0 0x7f4b5c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 >> 172.21.15.81:0/2875807829 conn(0x7f4b5c0c4cc0 msgr2=0x7f4b5c15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 shutdown_connections 2024-05-08T20:45:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:37.425+0000 7f4b62a8b640 1 -- 172.21.15.81:0/2875807829 wait complete. 2024-05-08T20:45:37.446 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:45:47.447 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:45:47.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 Processor -- start 2024-05-08T20:45:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 -- start start 2024-05-08T20:45:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff628154cf0 0x7ff628155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff628155690 0x7ff6280ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6281522e0 con 0x7ff628151f00 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62806bb20 con 0x7ff628155690 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62e5ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6281548e0 con 0x7ff628154cf0 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff628155690 0x7ff6280ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff628155690 0x7ff6280ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37402/0 (socket says 172.21.15.81:37402) 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 -- 172.21.15.81:0/769175539 learned_addr learned my addr 172.21.15.81:0/769175539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff6277fe640 1 --2- 172.21.15.81:0/769175539 >> v2:172.21.15.117:3300/0 conn(0x7ff628154cf0 0x7ff628155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 -- 172.21.15.81:0/769175539 >> v2:172.21.15.117:3300/0 conn(0x7ff628154cf0 msgr2=0x7ff628155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 --2- 172.21.15.81:0/769175539 >> v2:172.21.15.117:3300/0 conn(0x7ff628154cf0 0x7ff628155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 -- 172.21.15.81:0/769175539 >> v1:172.21.15.117:6789/0 conn(0x7ff628151f00 legacy=0x7ff6281588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.581+0000 7ff62cb8a640 1 -- 172.21.15.81:0/769175539 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280c5f80 con 0x7ff628155690 2024-05-08T20:45:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62cb8a640 1 --2- 172.21.15.81:0/769175539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628155690 0x7ff6280ca000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff62808c580 tx=0x7ff62001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f3b23396a39fa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff626ffd640 1 -- 172.21.15.81:0/769175539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200a56f0 con 0x7ff628155690 2024-05-08T20:45:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff626ffd640 1 -- 172.21.15.81:0/769175539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6200a5850 con 0x7ff628155690 2024-05-08T20:45:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff626ffd640 1 -- 172.21.15.81:0/769175539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200a5be0 con 0x7ff628155690 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 -- 172.21.15.81:0/769175539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628155690 msgr2=0x7ff6280ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/769175539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628155690 0x7ff6280ca000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff62808c580 tx=0x7ff62001c890 comp rx=0 tx=0).stop 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 -- 172.21.15.81:0/769175539 shutdown_connections 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/769175539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628155690 0x7ff6280ca000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/769175539 >> v2:172.21.15.117:3300/0 conn(0x7ff628154cf0 0x7ff628155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 -- 172.21.15.81:0/769175539 >> 172.21.15.81:0/769175539 conn(0x7ff6280715f0 msgr2=0x7ff628071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 -- 172.21.15.81:0/769175539 shutdown_connections 2024-05-08T20:45:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.585+0000 7ff62e5ed640 1 -- 172.21.15.81:0/769175539 wait complete. 2024-05-08T20:45:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 Processor -- start 2024-05-08T20:45:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- start start 2024-05-08T20:45:47.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 0x7ff62814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 0x7ff62814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62814e650 con 0x7ff628151f00 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62814e3b0 con 0x7ff6280af0e0 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff628156570 con 0x7ff628154cf0 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37404/0 (socket says 172.21.15.81:37404) 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 -- 172.21.15.81:0/2583725828 learned_addr learned my addr 172.21.15.81:0/2583725828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff6277fe640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 0x7ff62814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62cb8a640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 0x7ff62814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 -- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 msgr2=0x7ff62814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 0x7ff62814de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 -- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 msgr2=0x7ff62814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 0x7ff62814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 -- 172.21.15.81:0/2583725828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620009b30 con 0x7ff628151f00 2024-05-08T20:45:47.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff6277fe640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 0x7ff62814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62cb8a640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 0x7ff62814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:47.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff627fff640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff61800b410 tx=0x7ff61800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618004020 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618004180 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618011630 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff628156850 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff628156e10 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6280675e0 con 0x7ff628151f00 2024-05-08T20:45:47.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.589+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff618011790 con 0x7ff628151f00 2024-05-08T20:45:47.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.593+0000 7ff624ff9640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 0x7ff614068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:47.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.593+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff618084310 con 0x7ff628151f00 2024-05-08T20:45:47.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.593+0000 7ff6277fe640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 0x7ff614068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:47.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.593+0000 7ff6277fe640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 0x7ff614068b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff628149d80 tx=0x7ff61c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:47.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.597+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff6180512d0 con 0x7ff628151f00 2024-05-08T20:45:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff628150970 con 0x7ff628151f00 2024-05-08T20:45:47.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff624ff9640 1 -- 172.21.15.81:0/2583725828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7ff6180548f0 con 0x7ff628151f00 2024-05-08T20:45:47.889 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 msgr2=0x7ff614068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 0x7ff614068b50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff628149d80 tx=0x7ff61c008040 comp rx=0 tx=0).stop 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 msgr2=0x7ff628149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff61800b410 tx=0x7ff61800b8d0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 shutdown_connections 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff614066690 0x7ff614068b50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6280af0e0 0x7ff62814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff628154cf0 0x7ff62814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 --2- 172.21.15.81:0/2583725828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628151f00 0x7ff628149840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 >> 172.21.15.81:0/2583725828 conn(0x7ff6280715f0 msgr2=0x7ff628152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.889+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 shutdown_connections 2024-05-08T20:45:47.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:47.893+0000 7ff62e5ed640 1 -- 172.21.15.81:0/2583725828 wait complete. 2024-05-08T20:45:47.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:45:47.912 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:45:47.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:45:47.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:45:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 Processor -- start 2024-05-08T20:45:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 -- start start 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 0x7f1620154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1620155020 0x7f162015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200c4d00 con 0x7f1620152120 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200c5bd0 con 0x7f1620155020 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f162681d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c52c0 con 0x7f16200c8280 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f1617fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 0x7f1620154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f1624dba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1620155020 0x7f162015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f1624dba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1620155020 0x7f162015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43406/0 (socket says 172.21.15.81:43406) 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 -- 172.21.15.81:0/1167805612 learned_addr learned my addr 172.21.15.81:0/1167805612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.021+0000 7f161ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1620152120 0x7f16200c6d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:46074/0 (socket says 172.21.15.81:46074) 2024-05-08T20:45:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 -- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 msgr2=0x7f1620154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 0x7f1620154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 -- 172.21.15.81:0/1167805612 >> v1:172.21.15.117:6789/0 conn(0x7f1620152120 legacy=0x7f16200c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 -- 172.21.15.81:0/1167805612 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162006a970 con 0x7f1620155020 2024-05-08T20:45:48.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1617fff640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 0x7f1620154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:45:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f1624dba640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f162015f2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1618009e50 tx=0x7f161801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa16a682c1e53ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f161f7fe640 1 -- 172.21.15.81:0/1167805612 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180a58d0 con 0x7f1620155020 2024-05-08T20:45:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f161f7fe640 1 -- 172.21.15.81:0/1167805612 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180a5a30 con 0x7f1620155020 2024-05-08T20:45:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.025+0000 7f161f7fe640 1 -- 172.21.15.81:0/1167805612 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180a5dc0 con 0x7f1620155020 2024-05-08T20:45:48.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 msgr2=0x7f162015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f162015f2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1618009e50 tx=0x7f161801ca00 comp rx=0 tx=0).stop 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/1167805612 shutdown_connections 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f162015f2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- 172.21.15.81:0/1167805612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16200c8280 0x7f1620154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/1167805612 >> 172.21.15.81:0/1167805612 conn(0x7f16200abfb0 msgr2=0x7f16200ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/1167805612 shutdown_connections 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/1167805612 wait complete. 2024-05-08T20:45:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 Processor -- start 2024-05-08T20:45:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- start start 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 0x7f1620146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1620152120 0x7f1620141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f16201421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620146ea0 con 0x7f16200c8280 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620150b60 con 0x7f1620155020 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16201516c0 con 0x7f1620152120 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 0x7f1620146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 0x7f1620146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37414/0 (socket says 172.21.15.81:37414) 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 -- 172.21.15.81:0/2491885779 learned_addr learned my addr 172.21.15.81:0/2491885779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f1624dba640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f16201421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1620152120 0x7f1620141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1620152120 msgr2=0x7f1620141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1620152120 0x7f1620141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 msgr2=0x7f16201421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1620155020 0x7f16201421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608009420 con 0x7f16200c8280 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1620152120 0x7f1620141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161ffff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 0x7f1620146260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f161000c450 tx=0x7f161000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610007480 con 0x7f16200c8280 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100075e0 con 0x7f16200c8280 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618009b30 con 0x7f16200c8280 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610004a30 con 0x7f16200c8280 2024-05-08T20:45:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.029+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1620151070 con 0x7f16200c8280 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f162681d640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 0x7f16201f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620153b60 con 0x7f162014f430 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 0x7f16201f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f1617fff640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16201548e0 con 0x7f162014f430 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 0x7f16201f0900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f162006a1a0 tx=0x7f1608011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800fc10 con 0x7f162014f430 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1610004b90 con 0x7f16200c8280 2024-05-08T20:45:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1600066730 0x7f1600068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1610083550 con 0x7f16200c8280 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f1624dba640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1600066730 0x7f1600068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1608011e80 con 0x7f162014f430 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 msgr2=0x7f16201f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 0x7f16201f0900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f162006a1a0 tx=0x7f1608011c90 comp rx=0 tx=0).stop 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 msgr2=0x7f16201f0900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f161d7fa640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162014f430 0x7f16201f0900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.033+0000 7f1624dba640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1600066730 0x7f1600068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f16180ae000 tx=0x7f16180a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 0x7f16200c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620069670 con 0x7f1620151260 2024-05-08T20:45:48.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 0x7f16200c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f1617fff640 1 -- 172.21.15.81:0/2491885779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f16201f1600 con 0x7f1620151260 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f1617fff640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 0x7f16200c8710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f162006a1a0 tx=0x7f16080046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608021070 con 0x7f1620151260 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f1608026070 con 0x7f1620151260 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 msgr2=0x7f16200c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 0x7f16200c8710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f162006a1a0 tx=0x7f16080046d0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 msgr2=0x7f16200c8710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f161d7fa640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1620151260 0x7f16200c8710 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f162006a1a0 tx=0x7f16080046d0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:48.044 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.045 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:48.047 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.048 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:48.055 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1600066730 msgr2=0x7f1600068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1600066730 0x7f1600068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f16180ae000 tx=0x7f16180a7070 comp rx=0 tx=0).stop 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 msgr2=0x7f1620146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f162681d640 1 --2- 172.21.15.81:0/2491885779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16200c8280 0x7f1620146260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f161000c450 tx=0x7f161000c910 comp rx=0 tx=0).stop 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f1624dba640 1 -- 172.21.15.81:0/2491885779 reap_dead start 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.041+0000 7f1624dba640 1 -- 172.21.15.81:0/2491885779 reap_dead start 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.045+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 shutdown_connections 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.045+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 >> 172.21.15.81:0/2491885779 conn(0x7f16200abfb0 msgr2=0x7f16200aa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.045+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 shutdown_connections 2024-05-08T20:45:48.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.045+0000 7f162681d640 1 -- 172.21.15.81:0/2491885779 wait complete. 2024-05-08T20:45:48.065 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:48.066 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:45:48.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:45:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 Processor -- start 2024-05-08T20:45:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 -- start start 2024-05-08T20:45:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f545c1501e0 0x7f545c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 0x7f545c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c0c0650 con 0x7f545c0725f0 2024-05-08T20:45:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c06fd60 con 0x7f545c1501e0 2024-05-08T20:45:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5462617640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c072180 con 0x7f545c06f400 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f545c1501e0 0x7f545c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f545c0725f0 0x7f545c0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41570/0 (socket says 172.21.15.81:41570) 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545b7fe640 1 -- 172.21.15.81:0/1753307692 learned_addr learned my addr 172.21.15.81:0/1753307692 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5460bb4640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 0x7f545c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545bfff640 1 -- 172.21.15.81:0/1753307692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 msgr2=0x7f545c0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545bfff640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 0x7f545c0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545bfff640 1 -- 172.21.15.81:0/1753307692 >> v1:172.21.15.81:6789/0 conn(0x7f545c0725f0 legacy=0x7f545c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545bfff640 1 -- 172.21.15.81:0/1753307692 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c06fa80 con 0x7f545c1501e0 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f545affd640 1 -- 172.21.15.81:0/1753307692 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652135904 0 0) 0x7f545c0c0650 con 0x7f545c0725f0 2024-05-08T20:45:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.185+0000 7f5460bb4640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 0x7f545c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:48.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f545bfff640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c1501e0 0x7f545c06c930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f544c0097c0 tx=0x7f544c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff428668d4066d52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f545affd640 1 -- 172.21.15.81:0/1753307692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0ab600 con 0x7f545c1501e0 2024-05-08T20:45:48.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f545affd640 1 -- 172.21.15.81:0/1753307692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c0a7050 con 0x7f545c1501e0 2024-05-08T20:45:48.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f545affd640 1 -- 172.21.15.81:0/1753307692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0ab980 con 0x7f545c1501e0 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 -- 172.21.15.81:0/1753307692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c1501e0 msgr2=0x7f545c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c1501e0 0x7f545c06c930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f544c0097c0 tx=0x7f544c01c350 comp rx=0 tx=0).stop 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 -- 172.21.15.81:0/1753307692 shutdown_connections 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c06f400 0x7f545c0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 --2- 172.21.15.81:0/1753307692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c1501e0 0x7f545c06c930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 -- 172.21.15.81:0/1753307692 >> 172.21.15.81:0/1753307692 conn(0x7f545c0c2ca0 msgr2=0x7f545c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 -- 172.21.15.81:0/1753307692 shutdown_connections 2024-05-08T20:45:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.189+0000 7f5462617640 1 -- 172.21.15.81:0/1753307692 wait complete. 2024-05-08T20:45:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 Processor -- start 2024-05-08T20:45:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- start start 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 0x7f545c1eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c0725f0 0x7f545c14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c1501e0 0x7f545c144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c14a020 con 0x7f545c06f400 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c14cb40 con 0x7f545c1501e0 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c14ce20 con 0x7f545c0725f0 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 0x7f545c1eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 0x7f545c1eb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37464/0 (socket says 172.21.15.81:37464) 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 -- 172.21.15.81:0/4170876189 learned_addr learned my addr 172.21.15.81:0/4170876189 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5460bb4640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c1501e0 0x7f545c144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545b7fe640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c0725f0 0x7f545c14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c0725f0 msgr2=0x7f545c14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f545c0725f0 0x7f545c14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c1501e0 msgr2=0x7f545c144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c1501e0 0x7f545c144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c009420 con 0x7f545c06f400 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545bfff640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 0x7f545c1eb050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f544c019f80 tx=0x7f544c01ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0b7650 con 0x7f545c06f400 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c0abe90 con 0x7f545c06f400 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c150740 con 0x7f545c06f400 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0b7a10 con 0x7f545c06f400 2024-05-08T20:45:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c14d3e0 con 0x7f545c06f400 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 0x7f545c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0696e0 con 0x7f545c14d5d0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545b7fe640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 0x7f545c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f544c0b7b70 con 0x7f545c06f400 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545b7fe640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f545c1505c0 con 0x7f545c14d5d0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f545b7fe640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 0x7f545c147670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f545c146760 tx=0x7f5450001820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5448066690 0x7f5448068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f544c11ed20 con 0x7f545c06f400 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.193+0000 7f5460bb4640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5448066690 0x7f5448068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450010510 con 0x7f545c14d5d0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5460bb4640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5448066690 0x7f5448068b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f54540043b0 tx=0x7f5454003a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5450010670 con 0x7f545c14d5d0 2024-05-08T20:45:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 msgr2=0x7f545c147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 0x7f545c147670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f545c146760 tx=0x7f5450001820 comp rx=0 tx=0).stop 2024-05-08T20:45:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 msgr2=0x7f545c147670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.197+0000 7f5458ff9640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14d5d0 0x7f545c147670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5462617640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 0x7f545c14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c15fb20 con 0x7f545c14c5b0 2024-05-08T20:45:48.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f545b7fe640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 0x7f545c14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f545b7fe640 1 -- 172.21.15.81:0/4170876189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f545c074950 con 0x7f545c14c5b0 2024-05-08T20:45:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f545b7fe640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 0x7f545c14e8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54500077f0 tx=0x7f5450001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450022070 con 0x7f545c14c5b0 2024-05-08T20:45:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f5450014480 con 0x7f545c14c5b0 2024-05-08T20:45:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 msgr2=0x7f545c14e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 0x7f545c14e8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54500077f0 tx=0x7f5450001090 comp rx=0 tx=0).stop 2024-05-08T20:45:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 msgr2=0x7f545c14e8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.205+0000 7f5458ff9640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f545c14c5b0 0x7f545c14e8c0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54500077f0 tx=0x7f5450001090 comp rx=0 tx=0).stop 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:48.208 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.209 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:48.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.212 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.214 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:48.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.218 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.219 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:48.220 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5448066690 msgr2=0x7f5448068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5448066690 0x7f5448068b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f54540043b0 tx=0x7f5454003a00 comp rx=0 tx=0).stop 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 msgr2=0x7f545c1eb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 --2- 172.21.15.81:0/4170876189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f545c06f400 0x7f545c1eb050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f544c019f80 tx=0x7f544c01ab90 comp rx=0 tx=0).stop 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5460bb4640 1 -- 172.21.15.81:0/4170876189 reap_dead start 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5460bb4640 1 -- 172.21.15.81:0/4170876189 reap_dead start 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 shutdown_connections 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 >> 172.21.15.81:0/4170876189 conn(0x7f545c0c2ca0 msgr2=0x7f545c152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 shutdown_connections 2024-05-08T20:45:48.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.209+0000 7f5462617640 1 -- 172.21.15.81:0/4170876189 wait complete. 2024-05-08T20:45:48.230 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:48.230 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:45:48.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:45:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 Processor -- start 2024-05-08T20:45:48.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 -- start start 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff63c0c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c155e10 con 0x7ff63c0c30d0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c156080 con 0x7ff63c0a94b0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff64296d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c06e790 con 0x7ff63c0c2bc0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff63c0c30d0 0x7ff63c0c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41586/0 (socket says 172.21.15.81:41586) 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 -- 172.21.15.81:0/3469837963 learned_addr learned my addr 172.21.15.81:0/3469837963 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff63c0c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460918985 0 0) 0x7ff63c155e10 con 0x7ff63c0c30d0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff624003530 con 0x7ff63c0c30d0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472326666 0 0) 0x7ff624003530 con 0x7ff63c0c30d0 2024-05-08T20:45:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 msgr2=0x7ff63c0c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff63c0c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 >> v1:172.21.15.117:6789/0 conn(0x7ff63c0a94b0 legacy=0x7ff63c0a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c156360 con 0x7ff63c0c30d0 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff62c001680 con 0x7ff63c0c30d0 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 >> v1:172.21.15.81:6789/0 conn(0x7ff63c0c30d0 legacy=0x7ff63c0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6240039b0 0x7ff624003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6240047d0 0x7ff624004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff6240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c06e790 con 0x7ff6240039b0 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400baf0 con 0x7ff6240047d0 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400bcb0 con 0x7ff63c0c2bc0 2024-05-08T20:45:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6240039b0 0x7ff624003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff640f0a640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff6240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6240047d0 0x7ff624004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 -- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 msgr2=0x7ff6240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff6240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 -- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6240047d0 msgr2=0x7ff624004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6240047d0 0x7ff624004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63bfff640 1 -- 172.21.15.81:0/3469837963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624003530 con 0x7ff6240039b0 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff640f0a640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c2bc0 0x7ff6240051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:45:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.345+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6240047d0 0x7ff624004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:45:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6240039b0 0x7ff624003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c1c0 tx=0x7ff62c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af609869200ee76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c005ae0 con 0x7ff6240039b0 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c005c60 con 0x7ff6240039b0 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff63affd640 1 -- 172.21.15.81:0/3469837963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0a5830 con 0x7ff6240039b0 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- 172.21.15.81:0/3469837963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6240039b0 msgr2=0x7ff624003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 --2- 172.21.15.81:0/3469837963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6240039b0 0x7ff624003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c1c0 tx=0x7ff62c01cc40 comp rx=0 tx=0).stop 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff640f0a640 1 -- 172.21.15.81:0/3469837963 reap_dead start 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- 172.21.15.81:0/3469837963 shutdown_connections 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- 172.21.15.81:0/3469837963 >> 172.21.15.81:0/3469837963 conn(0x7ff63c0c4cc0 msgr2=0x7ff63c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- 172.21.15.81:0/3469837963 shutdown_connections 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- 172.21.15.81:0/3469837963 wait complete. 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 Processor -- start 2024-05-08T20:45:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.349+0000 7ff64296d640 1 -- start start 2024-05-08T20:45:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 0x7ff63c1edc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63c06c640 0x7ff63c145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63c0c15f0 0x7ff63c0c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c14af20 con 0x7ff63c06c640 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1ee150 con 0x7ff63c0c15f0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c06ce00 con 0x7ff6240039b0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 0x7ff63c1edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 0x7ff63c1edc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40400/0 (socket says 172.21.15.81:40400) 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 -- 172.21.15.81:0/3715912975 learned_addr learned my addr 172.21.15.81:0/3715912975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63c06c640 0x7ff63c145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff640f0a640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63c0c15f0 0x7ff63c0c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63c0c15f0 msgr2=0x7ff63c0c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63c0c15f0 0x7ff63c0c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63c06c640 msgr2=0x7ff63c145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63c06c640 0x7ff63c145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c14a4e0 con 0x7ff6240039b0 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63c06c640 0x7ff63c145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:45:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63bfff640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 0x7ff63c1edc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff62c01ca70 tx=0x7ff624005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0b4070 con 0x7ff6240039b0 2024-05-08T20:45:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c005e50 con 0x7ff6240039b0 2024-05-08T20:45:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c146410 con 0x7ff6240039b0 2024-05-08T20:45:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0a5830 con 0x7ff6240039b0 2024-05-08T20:45:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c14a200 con 0x7ff6240039b0 2024-05-08T20:45:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 0x7ff63c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c073ea0 con 0x7ff63c0c7990 2024-05-08T20:45:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.353+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 0x7ff63c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff63b7fe640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff63c150070 con 0x7ff63c0c7990 2024-05-08T20:45:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff62c0a5990 con 0x7ff6240039b0 2024-05-08T20:45:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff638ff9640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff628066690 0x7ff628068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff62c11dcc0 con 0x7ff6240039b0 2024-05-08T20:45:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff640f0a640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff628066690 0x7ff628068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff640f0a640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff628066690 0x7ff628068b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ab110 tx=0x7ff634009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 0x7ff63c14bc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6300139c0 tx=0x7ff630013e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.357+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011e50 con 0x7ff63c0c7990 2024-05-08T20:45:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.361+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff630016460 con 0x7ff63c0c7990 2024-05-08T20:45:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.361+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 msgr2=0x7ff63c14bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.361+0000 7ff638ff9640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 0x7ff63c14bc90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6300139c0 tx=0x7ff630013e80 comp rx=0 tx=0).stop 2024-05-08T20:45:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.361+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 msgr2=0x7ff63c14bc90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.361+0000 7ff638ff9640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7990 0x7ff63c14bc90 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6300139c0 tx=0x7ff630013e80 comp rx=0 tx=0).stop 2024-05-08T20:45:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.365+0000 7ff64296d640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 0x7ff63c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.365+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c074950 con 0x7ff63c0c7d70 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.365+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 0x7ff63c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.365+0000 7ff63b7fe640 1 -- 172.21.15.81:0/3715912975 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff63c06cfc0 con 0x7ff63c0c7d70 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff63b7fe640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 0x7ff63c14c1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff63001d000 tx=0x7ff6300046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630025040 con 0x7ff63c0c7d70 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7ff63002b430 con 0x7ff63c0c7d70 2024-05-08T20:45:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 msgr2=0x7ff63c14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 0x7ff63c14c1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff63001d000 tx=0x7ff6300046d0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 msgr2=0x7ff63c14c1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff638ff9640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff63c0c7d70 0x7ff63c14c1d0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff63001d000 tx=0x7ff6300046d0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 140, 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:45:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:45:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:45:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:45:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:45:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:45:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:45:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:45:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:45:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:45:48.383 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff628066690 msgr2=0x7ff628068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff628066690 0x7ff628068b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0ab110 tx=0x7ff634009040 comp rx=0 tx=0).stop 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 msgr2=0x7ff63c1edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 --2- 172.21.15.81:0/3715912975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6240039b0 0x7ff63c1edc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff62c01ca70 tx=0x7ff624005800 comp rx=0 tx=0).stop 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff640f0a640 1 -- 172.21.15.81:0/3715912975 reap_dead start 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff640f0a640 1 -- 172.21.15.81:0/3715912975 reap_dead start 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 shutdown_connections 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 >> 172.21.15.81:0/3715912975 conn(0x7ff63c0c4cc0 msgr2=0x7ff63c14ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 shutdown_connections 2024-05-08T20:45:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.369+0000 7ff64296d640 1 -- 172.21.15.81:0/3715912975 wait complete. 2024-05-08T20:45:48.389 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:45:48.390 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:45:48.390 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:45:48.390 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:45:48.390 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:45:48.391 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:45:48.391 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:45:48.410 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:45:48.410 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:45:48.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:48.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 Processor -- start 2024-05-08T20:45:48.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 -- start start 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03880c2800 0x7f03881520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880c3a50 con 0x7f0388070c00 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880705e0 con 0x7f038806b230 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038f3ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03880c2c70 con 0x7f03880c2800 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038c988640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0388070c00 0x7f03881519d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41598/0 (socket says 172.21.15.81:41598) 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038c988640 1 -- 172.21.15.81:0/4135266646 learned_addr learned my addr 172.21.15.81:0/4135266646 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038d98a640 1 --2- 172.21.15.81:0/4135266646 >> v2:172.21.15.117:3300/0 conn(0x7f03880c2800 0x7f03881520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623599368 0 0) 0x7f03880c3a50 con 0x7f0388070c00 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0374003530 con 0x7f0388070c00 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2683545561 0 0) 0x7f0374003530 con 0x7f0388070c00 2024-05-08T20:45:48.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 >> v2:172.21.15.117:3300/0 conn(0x7f03880c2800 msgr2=0x7f03881520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 --2- 172.21.15.81:0/4135266646 >> v2:172.21.15.117:3300/0 conn(0x7f03880c2800 0x7f03881520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 >> v1:172.21.15.117:6789/0 conn(0x7f038806b230 legacy=0x7f038814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880708c0 con 0x7f0388070c00 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f0378001680 con 0x7f0388070c00 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 >> v1:172.21.15.81:6789/0 conn(0x7f0388070c00 legacy=0x7f03881519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0374003980 0x7f0374003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03740047d0 0x7f0374004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 0x7f037400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03880c2c70 con 0x7f0374005190 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037400c130 con 0x7f0374003980 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037400c2f0 con 0x7f03740047d0 2024-05-08T20:45:48.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038c988640 1 -- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03740047d0 msgr2=0x7f0374004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.521+0000 7f038c988640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03740047d0 0x7f0374004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 0x7f037400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d189640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0374003980 0x7f0374003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 -- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03740047d0 msgr2=0x7f0374004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03740047d0 0x7f0374004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 -- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0374003980 msgr2=0x7f0374003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0374003980 0x7f0374003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 -- 172.21.15.81:0/4135266646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374003530 con 0x7f0374005190 2024-05-08T20:45:48.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d189640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0374003980 0x7f0374003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:48.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 -- 172.21.15.81:0/4135266646 reap_dead start 2024-05-08T20:45:48.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038d98a640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 0x7f037400b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fc0 tx=0x7f038001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dbdbc631068338 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800a5cd0 con 0x7f0374005190 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038000f040 con 0x7f0374005190 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f037ffff640 1 -- 172.21.15.81:0/4135266646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380003be0 con 0x7f0374005190 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 -- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 msgr2=0x7f037400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 0x7f037400b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0380009fc0 tx=0x7f038001ccc0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 -- 172.21.15.81:0/4135266646 shutdown_connections 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 --2- 172.21.15.81:0/4135266646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374005190 0x7f037400b990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 -- 172.21.15.81:0/4135266646 >> 172.21.15.81:0/4135266646 conn(0x7f03880c71b0 msgr2=0x7f03880c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 -- 172.21.15.81:0/4135266646 shutdown_connections 2024-05-08T20:45:48.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.525+0000 7f038f3ed640 1 -- 172.21.15.81:0/4135266646 wait complete. 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 Processor -- start 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- start start 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 0x7f03881e87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0388153e80 0x7f03881ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03880aab40 con 0x7f038814a170 2024-05-08T20:45:48.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881e8d20 con 0x7f0388153e80 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03880aa2e0 con 0x7f0374005190 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d189640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 msgr2=0x7f03881e87e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d189640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 0x7f03881e87e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37554/0 (socket says 172.21.15.81:37554) 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 -- 172.21.15.81:0/694752325 learned_addr learned my addr 172.21.15.81:0/694752325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038c988640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0388153e80 0x7f03881ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 -- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 msgr2=0x7f03881e87e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 0x7f03881e87e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 -- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0388153e80 msgr2=0x7f03881ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0388153e80 0x7f03881ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 -- 172.21.15.81:0/694752325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880aa580 con 0x7f038814a170 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038d98a640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f038001c730 tx=0x7f0380009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380003e70 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380004030 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03880aa860 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800043a0 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03881eb7d0 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.529+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03880675e0 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.533+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0380004500 con 0x7f038814a170 2024-05-08T20:45:48.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.533+0000 7f037dffb640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 0x7f036c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:48.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.533+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f038011f000 con 0x7f038814a170 2024-05-08T20:45:48.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.533+0000 7f038d189640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 0x7f036c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:48.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.533+0000 7f038d189640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 0x7f036c068b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0384000c10 tx=0x7f0384009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:48.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.537+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f03800ec080 con 0x7f038814a170 2024-05-08T20:45:48.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f03881eb350 con 0x7f038814a170 2024-05-08T20:45:48.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f037dffb640 1 -- 172.21.15.81:0/694752325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f03881eb350 con 0x7f038814a170 2024-05-08T20:45:48.801 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 msgr2=0x7f036c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 0x7f036c068b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0384000c10 tx=0x7f0384009040 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 msgr2=0x7f03881448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f038001c730 tx=0x7f0380009750 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 shutdown_connections 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f036c066640 0x7f036c068b00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f038814a170 0x7f03881448c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0388153e80 0x7f03881ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 --2- 172.21.15.81:0/694752325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0374005190 0x7f03881e87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 >> 172.21.15.81:0/694752325 conn(0x7f03880c71b0 msgr2=0x7f03880c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:48.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 shutdown_connections 2024-05-08T20:45:48.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:48.801+0000 7f038f3ed640 1 -- 172.21.15.81:0/694752325 wait complete. 2024-05-08T20:45:51.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 Processor -- start 2024-05-08T20:45:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 -- start start 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07d81522b0 0x7f07d80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07d8154970 0x7f07d806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d80c8b10 con 0x7f07d80c7280 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d8152690 con 0x7f07d8154970 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07e059c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d8069ec0 con 0x7f07d81522b0 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07d8154970 0x7f07d806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07d8154970 0x7f07d806aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53954/0 (socket says 172.21.15.81:53954) 2024-05-08T20:45:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 -- 172.21.15.81:0/656791568 learned_addr learned my addr 172.21.15.81:0/656791568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07de338640 1 --2- 172.21.15.81:0/656791568 >> v2:172.21.15.117:3300/0 conn(0x7f07d81522b0 0x7f07d80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 -- 172.21.15.81:0/656791568 >> v2:172.21.15.117:3300/0 conn(0x7f07d81522b0 msgr2=0x7f07d80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 --2- 172.21.15.81:0/656791568 >> v2:172.21.15.117:3300/0 conn(0x7f07d81522b0 0x7f07d80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 -- 172.21.15.81:0/656791568 >> v1:172.21.15.117:6789/0 conn(0x7f07d80c7280 legacy=0x7f07d806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.033+0000 7f07deb39640 1 -- 172.21.15.81:0/656791568 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8154ee0 con 0x7f07d8154970 2024-05-08T20:45:52.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07deb39640 1 --2- 172.21.15.81:0/656791568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d8154970 0x7f07d806aa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07d80cb160 tx=0x7f07d001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4801f376d0275436 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:52.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07dd336640 1 -- 172.21.15.81:0/656791568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00a57b0 con 0x7f07d8154970 2024-05-08T20:45:52.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07dd336640 1 -- 172.21.15.81:0/656791568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00a5910 con 0x7f07d8154970 2024-05-08T20:45:52.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07dd336640 1 -- 172.21.15.81:0/656791568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00a5ca0 con 0x7f07d8154970 2024-05-08T20:45:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- 172.21.15.81:0/656791568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d8154970 msgr2=0x7f07d806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- 172.21.15.81:0/656791568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d8154970 0x7f07d806aa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07d80cb160 tx=0x7f07d001c8f0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- 172.21.15.81:0/656791568 shutdown_connections 2024-05-08T20:45:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- 172.21.15.81:0/656791568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d8154970 0x7f07d806aa20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- 172.21.15.81:0/656791568 >> v2:172.21.15.117:3300/0 conn(0x7f07d81522b0 0x7f07d80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- 172.21.15.81:0/656791568 >> 172.21.15.81:0/656791568 conn(0x7f07d80ca330 msgr2=0x7f07d80ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- 172.21.15.81:0/656791568 shutdown_connections 2024-05-08T20:45:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- 172.21.15.81:0/656791568 wait complete. 2024-05-08T20:45:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 Processor -- start 2024-05-08T20:45:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- start start 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 0x7f07d814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07d8154970 0x7f07d80be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80c0220 con 0x7f07d81522b0 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d814a6f0 con 0x7f07d8154970 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07e059c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d814b9f0 con 0x7f07d80c7280 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07de338640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 msgr2=0x7f07d814d620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07de338640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 0x7f07d814d620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07ddb37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07ddb37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53966/0 (socket says 172.21.15.81:53966) 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.037+0000 7f07ddb37640 1 -- 172.21.15.81:0/4104473713 learned_addr learned my addr 172.21.15.81:0/4104473713 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07deb39640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07d8154970 0x7f07d80be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 -- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 msgr2=0x7f07d814d620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 0x7f07d814d620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 -- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07d8154970 msgr2=0x7f07d80be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07d8154970 0x7f07d80be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 -- 172.21.15.81:0/4104473713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009b30 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ddb37640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07c800c410 tx=0x7f07c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80054e0 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c8003650 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d80bde30 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8003a60 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d814a410 con 0x7f07d81522b0 2024-05-08T20:45:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d80675e0 con 0x7f07d81522b0 2024-05-08T20:45:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07c8003bc0 con 0x7f07d81522b0 2024-05-08T20:45:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 0x7f07bc068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f07c8083ad0 con 0x7f07d81522b0 2024-05-08T20:45:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07de338640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 0x7f07bc068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.041+0000 7f07de338640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 0x7f07bc068b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006e90 tx=0x7f07d4006e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:52.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.045+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f07c8050b30 con 0x7f07d81522b0 2024-05-08T20:45:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.345+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f07d80be1b0 con 0x7f07d81522b0 2024-05-08T20:45:52.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.345+0000 7f07ceffd640 1 -- 172.21.15.81:0/4104473713 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f07d80be1b0 con 0x7f07d81522b0 2024-05-08T20:45:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 msgr2=0x7f07bc068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 0x7f07bc068b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006e90 tx=0x7f07d4006e20 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 msgr2=0x7f07d80be490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07c800c410 tx=0x7f07c800c8d0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 shutdown_connections 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f07bc066640 0x7f07bc068b00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07d8154970 0x7f07d80be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07d81522b0 0x7f07d80be490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 --2- 172.21.15.81:0/4104473713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07d80c7280 0x7f07d814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 >> 172.21.15.81:0/4104473713 conn(0x7f07d80ca330 msgr2=0x7f07d8153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 shutdown_connections 2024-05-08T20:45:52.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:52.349+0000 7f07e059c640 1 -- 172.21.15.81:0/4104473713 wait complete. 2024-05-08T20:45:55.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:45:55.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:45:55.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 Processor -- start 2024-05-08T20:45:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 -- start start 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 0x7f9db80ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db80c2bc0 0x7f9db80c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80ae010 con 0x7f9db80ad520 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80ae2a0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9dbd3bb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80ac3c0 con 0x7f9db80abdd0 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db80c2bc0 0x7f9db80c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9db80c2bc0 0x7f9db80c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53972/0 (socket says 172.21.15.81:53972) 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 -- 172.21.15.81:0/1064162081 learned_addr learned my addr 172.21.15.81:0/1064162081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9daffff640 1 --2- 172.21.15.81:0/1064162081 >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 0x7f9db80ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 -- 172.21.15.81:0/1064162081 >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 msgr2=0x7f9db80ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:45:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 --2- 172.21.15.81:0/1064162081 >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 0x7f9db80ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 -- 172.21.15.81:0/1064162081 >> v1:172.21.15.81:6789/0 conn(0x7f9db80ad520 legacy=0x7f9db80ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9db77fe640 1 -- 172.21.15.81:0/1064162081 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db815d200 con 0x7f9db80c2bc0 2024-05-08T20:45:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.517+0000 7f9daffff640 1 --2- 172.21.15.81:0/1064162081 >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 0x7f9db80ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:45:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db77fe640 1 --2- 172.21.15.81:0/1064162081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db80c3160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9db80c4c20 tx=0x7f9db001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efd696d2234ea30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db67fc640 1 -- 172.21.15.81:0/1064162081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00a57f0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db67fc640 1 -- 172.21.15.81:0/1064162081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00a5950 con 0x7f9db80c2bc0 2024-05-08T20:45:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db67fc640 1 -- 172.21.15.81:0/1064162081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00a5ce0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/1064162081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 msgr2=0x7f9db80c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/1064162081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db80c3160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9db80c4c20 tx=0x7f9db001c930 comp rx=0 tx=0).stop 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/1064162081 shutdown_connections 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/1064162081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db80c3160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/1064162081 >> v2:172.21.15.117:3300/0 conn(0x7f9db80abdd0 0x7f9db80ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/1064162081 >> 172.21.15.81:0/1064162081 conn(0x7f9db80c4cc0 msgr2=0x7f9db80c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:55.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/1064162081 shutdown_connections 2024-05-08T20:45:55.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/1064162081 wait complete. 2024-05-08T20:45:55.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 Processor -- start 2024-05-08T20:45:55.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- start start 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 0x7f9db8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db81f5110 0x7f9db814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db814bf70 con 0x7f9db80c2bc0 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db815b410 con 0x7f9db81f5110 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9dbd3bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8146890 con 0x7f9db80ad520 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db6ffd640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 msgr2=0x7f9db8155780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 0x7f9db8155780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53986/0 (socket says 172.21.15.81:53986) 2024-05-08T20:45:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9daffff640 1 -- 172.21.15.81:0/2703408891 learned_addr learned my addr 172.21.15.81:0/2703408891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.521+0000 7f9db77fe640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db81f5110 0x7f9db814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 -- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 msgr2=0x7f9db8155780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 0x7f9db8155780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 -- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db81f5110 msgr2=0x7f9db814c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db81f5110 0x7f9db814c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 -- 172.21.15.81:0/2703408891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0009b30 con 0x7f9db80c2bc0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daffff640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e840 tx=0x7f9da000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000c8d0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000ca30 con 0x7f9db80c2bc0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db81465b0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da000cdc0 con 0x7f9db80c2bc0 2024-05-08T20:45:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db81f5c40 con 0x7f9db80c2bc0 2024-05-08T20:45:55.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db80ac740 con 0x7f9db80c2bc0 2024-05-08T20:45:55.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9da0013410 con 0x7f9db80c2bc0 2024-05-08T20:45:55.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 0x7f9d98068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:55.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9da0084100 con 0x7f9db80c2bc0 2024-05-08T20:45:55.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9db6ffd640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 0x7f9d98068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:55.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.525+0000 7f9db6ffd640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 0x7f9d98068b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9da8001040 tx=0x7f9da8007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:45:55.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.533+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9da0051210 con 0x7f9db80c2bc0 2024-05-08T20:45:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.797+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9db8074950 con 0x7f9db80c2bc0 2024-05-08T20:45:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.797+0000 7f9daf7fe640 1 -- 172.21.15.81:0/2703408891 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f9da0054830 con 0x7f9db80c2bc0 2024-05-08T20:45:55.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":140,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 msgr2=0x7f9d98068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 0x7f9d98068b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9da8001040 tx=0x7f9da8007a40 comp rx=0 tx=0).stop 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 msgr2=0x7f9db815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e840 tx=0x7f9da000ed00 comp rx=0 tx=0).stop 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 shutdown_connections 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9d98066670 0x7f9d98068b30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db81f5110 0x7f9db814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db80c2bc0 0x7f9db815aed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 --2- 172.21.15.81:0/2703408891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9db80ad520 0x7f9db8155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:45:55.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 >> 172.21.15.81:0/2703408891 conn(0x7f9db80c4cc0 msgr2=0x7f9db80c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:45:55.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 shutdown_connections 2024-05-08T20:45:55.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:55.801+0000 7f9dbd3bb640 1 -- 172.21.15.81:0/2703408891 wait complete. 2024-05-08T20:45:58.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:45:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.041+0000 7f4e5365c640 1 Processor -- start 2024-05-08T20:45:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.041+0000 7f4e5365c640 1 -- start start 2024-05-08T20:45:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.041+0000 7f4e5365c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.041+0000 7f4e5365c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e5365c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c158e20 con 0x7f4e4c155690 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e5365c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c06bb20 con 0x7f4e4c154cf0 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e5365c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1548e0 con 0x7f4e4c151f00 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e513f8640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c1588e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e513f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43688/0 (socket says 172.21.15.81:43688) 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 learned_addr learned my addr 172.21.15.81:0/3300953326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.045+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:45:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e513f8640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c1588e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e513f8640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e513f8640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c1588e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e513f8640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:45:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:45:59.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e513f8640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c1588e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e513f8640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:00.457+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c1588e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e4c1588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 msgr2=0x7f4e4c155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.81:3300/0 conn(0x7f4e4c154cf0 0x7f4e4c155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 -- 172.21.15.81:0/3300953326 >> v1:172.21.15.81:6789/0 conn(0x7f4e4c155690 legacy=0x7f4e4c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:02.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 -- 172.21.15.81:0/3300953326 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c1522e0 con 0x7f4e30003700 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e42ffd640 1 -- 172.21.15.81:0/3300953326 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3000afb0 con 0x7f4e30007450 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.045+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.249+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.249+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.249+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:46:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.653+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.653+0000 7f4e50bf7640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.653+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:02.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.825+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286660889 0 0) 0x7f4e4c1522e0 con 0x7f4e30003700 2024-05-08T20:46:02.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.825+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e38003530 con 0x7f4e30003700 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1239748103 0 0) 0x7f4e38003530 con 0x7f4e30003700 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 msgr2=0x7f4e30009910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 --2- 172.21.15.81:0/3300953326 >> v2:172.21.15.117:3300/0 conn(0x7f4e30007450 0x7f4e30009910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3000b120 con 0x7f4e30003700 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f4e48004350 con 0x7f4e30003700 2024-05-08T20:46:02.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 >> v1:172.21.15.117:6789/0 conn(0x7f4e30003700 legacy=0x7f4e30005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e38003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 0x7f4e38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3000afb0 con 0x7f4e38003fb0 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3800bba0 con 0x7f4e38004d10 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3800bd60 con 0x7f4e4c151f00 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 -- 172.21.15.81:0/3300953326 reap_dead start 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e513f8640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e38003980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e513f8640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e38003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 0x7f4e38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 msgr2=0x7f4e38003980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e38003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 msgr2=0x7f4e380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e51bf9640 1 -- 172.21.15.81:0/3300953326 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38003530 con 0x7f4e38004d10 2024-05-08T20:46:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.841+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e380047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:46:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 0x7f4e38005190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0c5b00 tx=0x7f4e4401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecaecc21dd006e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44005d50 con 0x7f4e38004d10 2024-05-08T20:46:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440a7070 con 0x7f4e38004d10 2024-05-08T20:46:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e43fff640 1 -- 172.21.15.81:0/3300953326 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44003ba0 con 0x7f4e38004d10 2024-05-08T20:46:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 -- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 msgr2=0x7f4e38005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 0x7f4e38005190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0c5b00 tx=0x7f4e4401c440 comp rx=0 tx=0).stop 2024-05-08T20:46:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 -- 172.21.15.81:0/3300953326 shutdown_connections 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e38004d10 0x7f4e38005190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e380047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 --2- 172.21.15.81:0/3300953326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e4c151f00 0x7f4e38003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 -- 172.21.15.81:0/3300953326 >> 172.21.15.81:0/3300953326 conn(0x7f4e4c0715f0 msgr2=0x7f4e4c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 -- 172.21.15.81:0/3300953326 shutdown_connections 2024-05-08T20:46:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.845+0000 7f4e5365c640 1 -- 172.21.15.81:0/3300953326 wait complete. 2024-05-08T20:46:02.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.849+0000 7f4e5365c640 1 Processor -- start 2024-05-08T20:46:02.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.849+0000 7f4e5365c640 1 -- start start 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 0x7f4e4c1f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 0x7f4e4c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1f1100 con 0x7f4e38003fb0 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1f13e0 con 0x7f4e4c151f00 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1e11b0 con 0x7f4e38004d10 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e50bf7640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 msgr2=0x7f4e4c1f08b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e50bf7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 0x7f4e4c1f08b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:02.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43732/0 (socket says 172.21.15.81:43732) 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 -- 172.21.15.81:0/2429529882 learned_addr learned my addr 172.21.15.81:0/2429529882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 0x7f4e4c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 -- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 msgr2=0x7f4e4c1f08b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 0x7f4e4c1f08b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 -- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 msgr2=0x7f4e4c0aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 0x7f4e4c0aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 -- 172.21.15.81:0/2429529882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0ad1c0 con 0x7f4e38003fb0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e51bf9640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 0x7f4e4c0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e513f8640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c730 tx=0x7f4e4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800a840 con 0x7f4e38003fb0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4800a9a0 con 0x7f4e38003fb0 2024-05-08T20:46:02.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c1f0df0 con 0x7f4e38003fb0 2024-05-08T20:46:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800ad30 con 0x7f4e38003fb0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0af140 con 0x7f4e38003fb0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c1f1550 con 0x7f4e38003fb0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.853+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e48012610 con 0x7f4e38003fb0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.857+0000 7f4e41ffb640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 0x7f4e30069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.857+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4e48083e00 con 0x7f4e38003fb0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.857+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 0x7f4e30069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:02.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.857+0000 7f4e50bf7640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 0x7f4e30069900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006e10 tx=0x7f4e3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:02.861+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4e48050fd0 con 0x7f4e38003fb0 2024-05-08T20:46:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.121+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4e4c074950 con 0x7f4e38003fb0 2024-05-08T20:46:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.121+0000 7f4e41ffb640 1 -- 172.21.15.81:0/2429529882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f4e48017070 con 0x7f4e38003fb0 2024-05-08T20:46:03.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 msgr2=0x7f4e30069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 0x7f4e30069900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006e10 tx=0x7f4e3c008040 comp rx=0 tx=0).stop 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 msgr2=0x7f4e4c0ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c730 tx=0x7f4e4800cbf0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 shutdown_connections 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e30067440 0x7f4e30069900 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e4c151f00 0x7f4e4c0aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e38004d10 0x7f4e4c1f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 --2- 172.21.15.81:0/2429529882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e38003fb0 0x7f4e4c0ae0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 >> 172.21.15.81:0/2429529882 conn(0x7f4e4c0715f0 msgr2=0x7f4e4c0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 shutdown_connections 2024-05-08T20:46:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.125+0000 7f4e5365c640 1 -- 172.21.15.81:0/2429529882 wait complete. 2024-05-08T20:46:03.146 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:46:03.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:46:03.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:46:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.265+0000 7f78305f6640 1 Processor -- start 2024-05-08T20:46:03.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.265+0000 7f78305f6640 1 -- start start 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f78305f6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f7828155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f78305f6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7828155690 0x7f78280ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f78305f6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78281522e0 con 0x7f7828151f00 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f78305f6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782806bb20 con 0x7f7828155690 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f78305f6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281548e0 con 0x7f7828154cf0 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782db91640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 msgr2=0x7f7828155150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782db91640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f7828155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7828151f00 0x7f78281588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60386/0 (socket says 172.21.15.81:60386) 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 -- 172.21.15.81:0/2437315811 learned_addr learned my addr 172.21.15.81:0/2437315811 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782eb93640 1 --2- 172.21.15.81:0/2437315811 >> v2:172.21.15.117:3300/0 conn(0x7f7828155690 0x7f78280ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426025558 0 0) 0x7f78281522e0 con 0x7f7828151f00 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814003530 con 0x7f7828151f00 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363581722 0 0) 0x7f7814003530 con 0x7f7828151f00 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 msgr2=0x7f7828155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f7828155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 >> v2:172.21.15.117:3300/0 conn(0x7f7828155690 msgr2=0x7f78280ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 --2- 172.21.15.81:0/2437315811 >> v2:172.21.15.117:3300/0 conn(0x7f7828155690 0x7f78280ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280c5f80 con 0x7f7828151f00 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f7824001680 con 0x7f7828151f00 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 >> v1:172.21.15.81:6789/0 conn(0x7f7828151f00 legacy=0x7f78281588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f7814003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f78140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d10 0x7f7814005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781400bb20 con 0x7f7814003980 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781400bc60 con 0x7f7814004d10 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781400be20 con 0x7f7828154cf0 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782db91640 1 -- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 msgr2=0x7f78140047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f7814003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782db91640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f78140047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782eb93640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d10 0x7f7814005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 -- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 msgr2=0x7f78140047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7828154cf0 0x7f78140047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 -- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d10 msgr2=0x7f7814005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:03.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d10 0x7f7814005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 -- 172.21.15.81:0/2437315811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814003530 con 0x7f7814003980 2024-05-08T20:46:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782eb93640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7814004d10 0x7f7814005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:46:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782e392640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f7814003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f782400c1c0 tx=0x7f782401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33719c580214f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.269+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824005ae0 con 0x7f7814003980 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824005c60 con 0x7f7814003980 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782d390640 1 -- 172.21.15.81:0/2437315811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a58c0 con 0x7f7814003980 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- 172.21.15.81:0/2437315811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 msgr2=0x7f7814003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 --2- 172.21.15.81:0/2437315811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f7814003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f782400c1c0 tx=0x7f782401cc40 comp rx=0 tx=0).stop 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782eb93640 1 -- 172.21.15.81:0/2437315811 reap_dead start 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- 172.21.15.81:0/2437315811 shutdown_connections 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- 172.21.15.81:0/2437315811 >> 172.21.15.81:0/2437315811 conn(0x7f78280715f0 msgr2=0x7f7828071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- 172.21.15.81:0/2437315811 shutdown_connections 2024-05-08T20:46:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- 172.21.15.81:0/2437315811 wait complete. 2024-05-08T20:46:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 Processor -- start 2024-05-08T20:46:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- start start 2024-05-08T20:46:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f78281f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280ad680 0x7f782815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7828147cc0 0x7f7828148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280af5b0 con 0x7f7814003980 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828148680 con 0x7f7828147cc0 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f78305f6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281541f0 con 0x7f78280ad680 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782db91640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280ad680 msgr2=0x7f782815e570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782db91640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280ad680 0x7f782815e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f78281f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f78281f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43752/0 (socket says 172.21.15.81:43752) 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 -- 172.21.15.81:0/799865634 learned_addr learned my addr 172.21.15.81:0/799865634 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782eb93640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7828147cc0 0x7f7828148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280ad680 msgr2=0x7f782815e570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280ad680 0x7f782815e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7828147cc0 msgr2=0x7f7828148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7828147cc0 0x7f7828148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.273+0000 7f782e392640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828154400 con 0x7f7814003980 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782e392640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f78281f0e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f782401ca70 tx=0x7f7814005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240b4070 con 0x7f7814003980 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824005e90 con 0x7f7814003980 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a5ac0 con 0x7f7814003980 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78281546e0 con 0x7f7814003980 2024-05-08T20:46:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782814a9f0 con 0x7f7814003980 2024-05-08T20:46:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f78305f6640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 0x7f7828152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828154590 con 0x7f782815f260 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782db91640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 0x7f7828152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782db91640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78280af3a0 con 0x7f782815f260 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782db91640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 0x7f7828152870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7818003940 tx=0x7f781800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818003cb0 con 0x7f782815f260 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f78240a5c20 con 0x7f7814003980 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f780c066730 0x7f780c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782eb93640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f780c066730 0x7f780c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f782411dc40 con 0x7f7814003980 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7818003e10 con 0x7f782815f260 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 msgr2=0x7f7828152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 0x7f7828152870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7818003940 tx=0x7f781800b900 comp rx=0 tx=0).stop 2024-05-08T20:46:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 msgr2=0x7f7828152870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f781effd640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815f260 0x7f7828152870 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7818003940 tx=0x7f781800b900 comp rx=0 tx=0).stop 2024-05-08T20:46:03.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.277+0000 7f782eb93640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f780c066730 0x7f780c068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f78280cb080 tx=0x7f782000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 0x7f78281531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828069600 con 0x7f7828152db0 2024-05-08T20:46:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f782db91640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 0x7f78281531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f782db91640 1 -- 172.21.15.81:0/799865634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f78280675e0 con 0x7f7828152db0 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f782db91640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 0x7f78281531c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7818003940 tx=0x7f7818005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818020070 con 0x7f7828152db0 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4797 (secure 0 0 0) 0x7f7818005360 con 0x7f7828152db0 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 msgr2=0x7f78281531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 0x7f78281531c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7818003940 tx=0x7f7818005ac0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 msgr2=0x7f78281531c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f781effd640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828152db0 0x7f78281531c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 144, 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:03.287 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.288 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.289 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:03.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:03.294 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.295 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:03.296 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.297 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:03.299 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f780c066730 msgr2=0x7f780c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f780c066730 0x7f780c068bf0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f78280cb080 tx=0x7f782000b040 comp rx=0 tx=0).stop 2024-05-08T20:46:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 msgr2=0x7f78281f0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 --2- 172.21.15.81:0/799865634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7814003980 0x7f78281f0e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f782401ca70 tx=0x7f7814005800 comp rx=0 tx=0).stop 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f782eb93640 1 -- 172.21.15.81:0/799865634 reap_dead start 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f782eb93640 1 -- 172.21.15.81:0/799865634 reap_dead start 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 shutdown_connections 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 >> 172.21.15.81:0/799865634 conn(0x7f78280715f0 msgr2=0x7f782814af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 shutdown_connections 2024-05-08T20:46:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.285+0000 7f78305f6640 1 -- 172.21.15.81:0/799865634 wait complete. 2024-05-08T20:46:03.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:46:03.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:46:03.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:46:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 Processor -- start 2024-05-08T20:46:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 -- start start 2024-05-08T20:46:03.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f181c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c155140 con 0x7f181c0aac30 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0c32d0 con 0x7f181c152220 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f18230cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c4780 con 0x7f181c0c26e0 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181bfff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 msgr2=0x7f181c1555d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f181c1555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f1821668640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f181c0aac30 0x7f181c0c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60392/0 (socket says 172.21.15.81:60392) 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f1821668640 1 -- 172.21.15.81:0/3078631608 learned_addr learned my addr 172.21.15.81:0/3078631608 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376073609 0 0) 0x7f181c155140 con 0x7f181c0aac30 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f180c003530 con 0x7f181c0aac30 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760371544 0 0) 0x7f180c003530 con 0x7f181c0aac30 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 msgr2=0x7f181c1555d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f181c1555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 >> v1:172.21.15.117:6789/0 conn(0x7f181c152220 legacy=0x7f181c0c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c072650 con 0x7f181c0aac30 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1814001a00 con 0x7f181c0aac30 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 >> v1:172.21.15.81:6789/0 conn(0x7f181c0aac30 legacy=0x7f181c0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f180c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c0040a0 0x7f180c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c004d10 0x7f180c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c00bbc0 con 0x7f180c004d10 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c00bd30 con 0x7f180c0040a0 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c00bef0 con 0x7f181c0c26e0 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f1820e67640 1 -- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 msgr2=0x7f180c0039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f1820e67640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f180c0039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f1821668640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c004d10 0x7f180c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.433+0000 7f181bfff640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c0040a0 0x7f180c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 -- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 msgr2=0x7f180c0039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c26e0 0x7f180c0039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 -- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c0040a0 msgr2=0x7f180c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c0040a0 0x7f180c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 -- 172.21.15.81:0/3078631608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c003530 con 0x7f180c004d10 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c004d10 0x7f180c005190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f181400a820 tx=0x7f181401d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39a2a5a2e40079d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140072d0 con 0x7f180c004d10 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140a8070 con 0x7f180c004d10 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f181b7fe640 1 -- 172.21.15.81:0/3078631608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140076b0 con 0x7f180c004d10 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 -- 172.21.15.81:0/3078631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c004d10 msgr2=0x7f180c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 --2- 172.21.15.81:0/3078631608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c004d10 0x7f180c005190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f181400a820 tx=0x7f181401d2d0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f1821668640 1 -- 172.21.15.81:0/3078631608 reap_dead start 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 -- 172.21.15.81:0/3078631608 shutdown_connections 2024-05-08T20:46:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 -- 172.21.15.81:0/3078631608 >> 172.21.15.81:0/3078631608 conn(0x7f181c0c4cc0 msgr2=0x7f181c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 -- 172.21.15.81:0/3078631608 shutdown_connections 2024-05-08T20:46:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.437+0000 7f18230cb640 1 -- 172.21.15.81:0/3078631608 wait complete. 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 Processor -- start 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- start start 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c004d10 0x7f181c0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 0x7f181c14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c14af60 0x7f181c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c150b00 con 0x7f181c154250 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c14b3e0 con 0x7f180c004d10 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c150d30 con 0x7f181c14af60 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f1821668640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c14af60 msgr2=0x7f181c153160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 0x7f181c14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f1821668640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c14af60 0x7f181c153160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 0x7f181c14aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43780/0 (socket says 172.21.15.81:43780) 2024-05-08T20:46:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 -- 172.21.15.81:0/3803182147 learned_addr learned my addr 172.21.15.81:0/3803182147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f1820e67640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c004d10 0x7f181c0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c14af60 msgr2=0x7f181c153160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c14af60 0x7f181c153160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c004d10 msgr2=0x7f181c0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f180c004d10 0x7f181c0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c151010 con 0x7f181c154250 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f181bfff640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 0x7f181c14aa20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18080096b0 tx=0x7f1808009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800e7b0 con 0x7f181c154250 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180800e910 con 0x7f181c154250 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c1512f0 con 0x7f181c154250 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800ecc0 con 0x7f181c154250 2024-05-08T20:46:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1518b0 con 0x7f181c154250 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 0x7f181c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.441+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c073ea0 con 0x7f181c1536a0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18080123f0 con 0x7f181c154250 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f1820e67640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 0x7f181c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1800066640 0x7f1800068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f1820e67640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f181c158e60 con 0x7f181c1536a0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1808084040 con 0x7f181c154250 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f1821668640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1800066640 0x7f1800068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f1820e67640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 0x7f181c153ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1810000f70 tx=0x7f181000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000fe50 con 0x7f181c1536a0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f1821668640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1800066640 0x7f1800068b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18140ad000 tx=0x7f1814001dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f18100072e0 con 0x7f181c1536a0 2024-05-08T20:46:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 msgr2=0x7f181c153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 0x7f181c153ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1810000f70 tx=0x7f181000fc00 comp rx=0 tx=0).stop 2024-05-08T20:46:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 msgr2=0x7f181c153ab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.445+0000 7f18197fa640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1536a0 0x7f181c153ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 0x7f181c1f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:03.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1511a0 con 0x7f181c1f0650 2024-05-08T20:46:03.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f1820e67640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 0x7f181c1f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:03.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f1820e67640 1 -- 172.21.15.81:0/3803182147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f181c074950 con 0x7f181c1f0650 2024-05-08T20:46:03.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f1820e67640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 0x7f181c1f0a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1810000f70 tx=0x7f1810001270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810023070 con 0x7f181c1f0650 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f1810005d30 con 0x7f181c1f0650 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 msgr2=0x7f181c1f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 0x7f181c1f0a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1810000f70 tx=0x7f1810001270 comp rx=0 tx=0).stop 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 msgr2=0x7f181c1f0a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18197fa640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1f0650 0x7f181c1f0a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 144, 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.457 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.458 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:03.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:03.465 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.466 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:03.467 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:03.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1800066640 msgr2=0x7f1800068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1800066640 0x7f1800068b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18140ad000 tx=0x7f1814001dc0 comp rx=0 tx=0).stop 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 msgr2=0x7f181c14aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 --2- 172.21.15.81:0/3803182147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181c154250 0x7f181c14aa20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18080096b0 tx=0x7f1808009b70 comp rx=0 tx=0).stop 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f1821668640 1 -- 172.21.15.81:0/3803182147 reap_dead start 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f1821668640 1 -- 172.21.15.81:0/3803182147 reap_dead start 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 shutdown_connections 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 >> 172.21.15.81:0/3803182147 conn(0x7f181c0c4cc0 msgr2=0x7f181c15fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 shutdown_connections 2024-05-08T20:46:03.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:03.453+0000 7f18230cb640 1 -- 172.21.15.81:0/3803182147 wait complete. 2024-05-08T20:46:03.474 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:46:03.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:46:23.474 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:46:23.475 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:46:23.475 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:46:23.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:46:23.478 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:46:23.478 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:46:23.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 Processor -- start 2024-05-08T20:46:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 -- start start 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe00151f00 0x7fbe001588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe00154cf0 0x7fbe00155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe00158e20 con 0x7fbe00155690 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0006bb20 con 0x7fbe00151f00 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbe0586f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe001548e0 con 0x7fbe00154cf0 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe00151f00 0x7fbe001588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe00151f00 0x7fbe001588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60156/0 (socket says 172.21.15.81:60156) 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 -- 172.21.15.81:0/3775148583 learned_addr learned my addr 172.21.15.81:0/3775148583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:23.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfe7fc640 1 --2- 172.21.15.81:0/3775148583 >> v2:172.21.15.117:3300/0 conn(0x7fbe00154cf0 0x7fbe00155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 -- 172.21.15.81:0/3775148583 >> v2:172.21.15.117:3300/0 conn(0x7fbe00154cf0 msgr2=0x7fbe00155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:23.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/3775148583 >> v2:172.21.15.117:3300/0 conn(0x7fbe00154cf0 0x7fbe00155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 -- 172.21.15.81:0/3775148583 >> v1:172.21.15.117:6789/0 conn(0x7fbe00155690 legacy=0x7fbe000ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:23.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.644+0000 7fbdfeffd640 1 -- 172.21.15.81:0/3775148583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe001522e0 con 0x7fbe00151f00 2024-05-08T20:46:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/3775148583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe00151f00 0x7fbe001588e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe0008c580 tx=0x7fbdf801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c581f0ba95d30bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbdfdffb640 1 -- 172.21.15.81:0/3775148583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80a57b0 con 0x7fbe00151f00 2024-05-08T20:46:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbdfdffb640 1 -- 172.21.15.81:0/3775148583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf80a5910 con 0x7fbe00151f00 2024-05-08T20:46:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbdfdffb640 1 -- 172.21.15.81:0/3775148583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80a5ca0 con 0x7fbe00151f00 2024-05-08T20:46:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- 172.21.15.81:0/3775148583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe00151f00 msgr2=0x7fbe001588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 --2- 172.21.15.81:0/3775148583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe00151f00 0x7fbe001588e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe0008c580 tx=0x7fbdf801c8d0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- 172.21.15.81:0/3775148583 shutdown_connections 2024-05-08T20:46:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 --2- 172.21.15.81:0/3775148583 >> v2:172.21.15.117:3300/0 conn(0x7fbe00154cf0 0x7fbe00155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 --2- 172.21.15.81:0/3775148583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe00151f00 0x7fbe001588e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- 172.21.15.81:0/3775148583 >> 172.21.15.81:0/3775148583 conn(0x7fbe000715f0 msgr2=0x7fbe00071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- 172.21.15.81:0/3775148583 shutdown_connections 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- 172.21.15.81:0/3775148583 wait complete. 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 Processor -- start 2024-05-08T20:46:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.648+0000 7fbe0586f640 1 -- start start 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe000c3cb0 0x7fbe000c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c2b50 con 0x7fbe000c0ff0 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c0b60 con 0x7fbe000c3cb0 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000bf8d0 con 0x7fbe00154cf0 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfe7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe000c3cb0 0x7fbe000c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60160/0 (socket says 172.21.15.81:60160) 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 -- 172.21.15.81:0/2367817373 learned_addr learned my addr 172.21.15.81:0/2367817373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfeffd640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 msgr2=0x7fbe001f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfeffd640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 msgr2=0x7fbe001f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 msgr2=0x7fbe001f15a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe000c3cb0 msgr2=0x7fbe000c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe000c3cb0 0x7fbe000c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 -- 172.21.15.81:0/2367817373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009b30 con 0x7fbe000c0ff0 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbdff7fe640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000c430 tx=0x7fbdf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0005220 con 0x7fbe000c0ff0 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0005380 con 0x7fbe000c0ff0 2024-05-08T20:46:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0007270 con 0x7fbe000c0ff0 2024-05-08T20:46:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000af2d0 con 0x7fbe000c0ff0 2024-05-08T20:46:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe000bfe00 con 0x7fbe000c0ff0 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe000675e0 con 0x7fbe000c0ff0 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdf00073d0 con 0x7fbe000c0ff0 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.652+0000 7fbde7fff640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 0x7fbdec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.656+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbdf00838b0 con 0x7fbe000c0ff0 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.656+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 0x7fbdec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.656+0000 7fbdfeffd640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 0x7fbdec068b50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80ae000 tx=0x7fbdf80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.660+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbdf0050910 con 0x7fbe000c0ff0 2024-05-08T20:46:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.916+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbe000c0d10 con 0x7fbe000c0ff0 2024-05-08T20:46:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.916+0000 7fbde7fff640 1 -- 172.21.15.81:0/2367817373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fbe000c0d10 con 0x7fbe000c0ff0 2024-05-08T20:46:23.920 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 msgr2=0x7fbdec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 0x7fbdec068b50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80ae000 tx=0x7fbdf80a7070 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 msgr2=0x7fbe000c1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000c430 tx=0x7fbdf000c8f0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 shutdown_connections 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdec066690 0x7fbdec068b50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe000c0ff0 0x7fbe000c1470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe000c3cb0 0x7fbe000c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 --2- 172.21.15.81:0/2367817373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe00154cf0 0x7fbe001f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 >> 172.21.15.81:0/2367817373 conn(0x7fbe000715f0 msgr2=0x7fbe000719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 shutdown_connections 2024-05-08T20:46:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:23.920+0000 7fbe0586f640 1 -- 172.21.15.81:0/2367817373 wait complete. 2024-05-08T20:46:25.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:46:25.305 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:46:26.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.076+0000 7f31b12af640 1 Processor -- start 2024-05-08T20:46:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.076+0000 7f31b12af640 1 -- start start 2024-05-08T20:46:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f31ac0c58d0 0x7f31ac0c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31ac066010 0x7f31ac0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac0c14e0 con 0x7f31ac154e40 2024-05-08T20:46:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac06d210 con 0x7f31ac0c58d0 2024-05-08T20:46:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac06c530 con 0x7f31ac066010 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f31ac0c58d0 0x7f31ac0c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f31ac0c58d0 0x7f31ac0c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60170/0 (socket says 172.21.15.81:60170) 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 -- 172.21.15.81:0/3042003924 learned_addr learned my addr 172.21.15.81:0/3042003924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31a3fff640 1 --2- 172.21.15.81:0/3042003924 >> v2:172.21.15.117:3300/0 conn(0x7f31ac066010 0x7f31ac0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 -- 172.21.15.81:0/3042003924 >> v2:172.21.15.117:3300/0 conn(0x7f31ac066010 msgr2=0x7f31ac0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 --2- 172.21.15.81:0/3042003924 >> v2:172.21.15.117:3300/0 conn(0x7f31ac066010 0x7f31ac0c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 -- 172.21.15.81:0/3042003924 >> v1:172.21.15.81:6789/0 conn(0x7f31ac154e40 legacy=0x7f31ac1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 -- 172.21.15.81:0/3042003924 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0c1730 con 0x7f31ac0c58d0 2024-05-08T20:46:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aaffd640 1 --2- 172.21.15.81:0/3042003924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac0c1a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31ac06dba0 tx=0x7f319c01eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac3b0761fe07285 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aa7fc640 1 -- 172.21.15.81:0/3042003924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0a7a90 con 0x7f31ac0c58d0 2024-05-08T20:46:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aa7fc640 1 -- 172.21.15.81:0/3042003924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c0a7bf0 con 0x7f31ac0c58d0 2024-05-08T20:46:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31aa7fc640 1 -- 172.21.15.81:0/3042003924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0af440 con 0x7f31ac0c58d0 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- 172.21.15.81:0/3042003924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 msgr2=0x7f31ac0c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 --2- 172.21.15.81:0/3042003924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac0c1a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31ac06dba0 tx=0x7f319c01eaa0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- 172.21.15.81:0/3042003924 shutdown_connections 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 --2- 172.21.15.81:0/3042003924 >> v2:172.21.15.117:3300/0 conn(0x7f31ac066010 0x7f31ac0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 --2- 172.21.15.81:0/3042003924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac0c1a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- 172.21.15.81:0/3042003924 >> 172.21.15.81:0/3042003924 conn(0x7f31ac0c68c0 msgr2=0x7f31ac0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- 172.21.15.81:0/3042003924 shutdown_connections 2024-05-08T20:46:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.080+0000 7f31b12af640 1 -- 172.21.15.81:0/3042003924 wait complete. 2024-05-08T20:46:27.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 Processor -- start 2024-05-08T20:46:27.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- start start 2024-05-08T20:46:27.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac066010 0x7f31ac0a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac154e40 0x7f31ac14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1ed050 con 0x7f31ac0c58d0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0bdae0 con 0x7f31ac154e40 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0bcfa0 con 0x7f31ac066010 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60180/0 (socket says 172.21.15.81:60180) 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 -- 172.21.15.81:0/1768105144 learned_addr learned my addr 172.21.15.81:0/1768105144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31ab7fe640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac154e40 0x7f31ac14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31aaffd640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac066010 0x7f31ac0a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 -- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac066010 msgr2=0x7f31ac0a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac066010 0x7f31ac0a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 -- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac154e40 msgr2=0x7f31ac14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac154e40 0x7f31ac14e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 -- 172.21.15.81:0/1768105144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c00b770 con 0x7f31ac0c58d0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a3fff640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f319400d5f0 tx=0x7f319400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31940125f0 con 0x7f31ac0c58d0 2024-05-08T20:46:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3194012750 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194012ae0 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac0bd240 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.084+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac0bd800 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac074950 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3194012c40 con 0x7f31ac0c58d0 2024-05-08T20:46:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31a37fe640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 0x7f318c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f31940849d0 con 0x7f31ac0c58d0 2024-05-08T20:46:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31aaffd640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 0x7f318c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.088+0000 7f31aaffd640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 0x7f318c068b50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f319c0b1000 tx=0x7f319c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.092+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3194051a30 con 0x7f31ac0c58d0 2024-05-08T20:46:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f31ac0c24f0 con 0x7f31ac0c58d0 2024-05-08T20:46:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31a37fe640 1 -- 172.21.15.81:0/1768105144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f3194055050 con 0x7f31ac0c58d0 2024-05-08T20:46:27.378 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 msgr2=0x7f318c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 0x7f318c068b50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f319c0b1000 tx=0x7f319c008040 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 msgr2=0x7f31ac14f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f319400d5f0 tx=0x7f319400dab0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.376+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 shutdown_connections 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f318c066690 0x7f318c068b50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ac154e40 0x7f31ac14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31ac0c58d0 0x7f31ac14f1d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 --2- 172.21.15.81:0/1768105144 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ac066010 0x7f31ac0a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 >> 172.21.15.81:0/1768105144 conn(0x7f31ac0c68c0 msgr2=0x7f31ac1552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 shutdown_connections 2024-05-08T20:46:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:27.380+0000 7f31b12af640 1 -- 172.21.15.81:0/1768105144 wait complete. 2024-05-08T20:46:30.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:30.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 Processor -- start 2024-05-08T20:46:30.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 -- start start 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f9450155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94501522e0 con 0x7f9450151f00 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500c5f80 con 0x7f9450155690 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9454eee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945006bb20 con 0x7f9450154cf0 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9450151f00 0x7f94501588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37802/0 (socket says 172.21.15.81:37802) 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944e59c640 1 -- 172.21.15.81:0/2125419727 learned_addr learned my addr 172.21.15.81:0/2125419727 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f9450155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149683085 0 0) 0x7f94501522e0 con 0x7f9450151f00 2024-05-08T20:46:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f943c003530 con 0x7f9450151f00 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 msgr2=0x7f9450155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 msgr2=0x7f9450155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f9450155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862568103 0 0) 0x7f943c003530 con 0x7f9450151f00 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 msgr2=0x7f9450155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f9450155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f9450155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 >> v1:172.21.15.117:6789/0 conn(0x7f9450155690 legacy=0x7f94500ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500c6260 con 0x7f9450151f00 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9440001680 con 0x7f9450151f00 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 >> v1:172.21.15.81:6789/0 conn(0x7f9450151f00 legacy=0x7f94501588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f943c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c003fe0 0x7f943c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c004d60 0x7f943c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c00bc40 con 0x7f943c004d60 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c00bdb0 con 0x7f943c003fe0 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c00bf70 con 0x7f9450154cf0 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c004d60 0x7f943c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944e59c640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f943c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f9445d9b640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c003fe0 0x7f943c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 msgr2=0x7f943c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9450154cf0 0x7f943c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c003fe0 msgr2=0x7f943c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c003fe0 0x7f943c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.568+0000 7f944ed9d640 1 -- 172.21.15.81:0/2125419727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c003530 con 0x7f943c004d60 2024-05-08T20:46:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c004d60 0x7f943c0051e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9450072960 tx=0x7f944801c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7dc4892dee3ea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448003b80 con 0x7f943c004d60 2024-05-08T20:46:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9448003ce0 con 0x7f943c004d60 2024-05-08T20:46:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f944dd9b640 1 -- 172.21.15.81:0/2125419727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94480052c0 con 0x7f943c004d60 2024-05-08T20:46:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- 172.21.15.81:0/2125419727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c004d60 msgr2=0x7f943c0051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 --2- 172.21.15.81:0/2125419727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c004d60 0x7f943c0051e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9450072960 tx=0x7f944801c720 comp rx=0 tx=0).stop 2024-05-08T20:46:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f944ed9d640 1 -- 172.21.15.81:0/2125419727 reap_dead start 2024-05-08T20:46:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- 172.21.15.81:0/2125419727 shutdown_connections 2024-05-08T20:46:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- 172.21.15.81:0/2125419727 >> 172.21.15.81:0/2125419727 conn(0x7f94500715f0 msgr2=0x7f9450071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- 172.21.15.81:0/2125419727 shutdown_connections 2024-05-08T20:46:30.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- 172.21.15.81:0/2125419727 wait complete. 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 Processor -- start 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.572+0000 7f9454eee640 1 -- start start 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c004d60 0x7f94501536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94500af3a0 0x7f94501f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500aef10 con 0x7f9450153c20 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945014fa20 con 0x7f943c004d60 2024-05-08T20:46:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9450150fd0 con 0x7f94500af3a0 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56548/0 (socket says 172.21.15.81:56548) 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 -- 172.21.15.81:0/2904898120 learned_addr learned my addr 172.21.15.81:0/2904898120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944e59c640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c004d60 0x7f94501536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9445d9b640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94500af3a0 0x7f94501f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 -- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94500af3a0 msgr2=0x7f94501f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94500af3a0 0x7f94501f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 -- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c004d60 msgr2=0x7f94501536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c004d60 0x7f94501536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 -- 172.21.15.81:0/2904898120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94501f1720 con 0x7f9450153c20 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f944ed9d640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9448098130 tx=0x7f943c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448003b80 con 0x7f9450153c20 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9448007dc0 con 0x7f9450153c20 2024-05-08T20:46:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448005830 con 0x7f9450153c20 2024-05-08T20:46:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945014fce0 con 0x7f9450153c20 2024-05-08T20:46:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945014d770 con 0x7f9450153c20 2024-05-08T20:46:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.576+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94500af0c0 con 0x7f9450153c20 2024-05-08T20:46:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.580+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9448006b60 con 0x7f9450153c20 2024-05-08T20:46:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.580+0000 7f94477fe640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 0x7f9430068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.580+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f944811dd20 con 0x7f9450153c20 2024-05-08T20:46:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.580+0000 7f944e59c640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 0x7f9430068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.580+0000 7f944e59c640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 0x7f9430068b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c10 tx=0x7f9440007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.584+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f94480eafa0 con 0x7f9450153c20 2024-05-08T20:46:30.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.856+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9450074950 con 0x7f9450153c20 2024-05-08T20:46:30.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.856+0000 7f94477fe640 1 -- 172.21.15.81:0/2904898120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f94480bb020 con 0x7f9450153c20 2024-05-08T20:46:30.860 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 msgr2=0x7f9430068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 0x7f9430068b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9440000c10 tx=0x7f9440007040 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 msgr2=0x7f94501f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9448098130 tx=0x7f943c005800 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 shutdown_connections 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f94300666c0 0x7f9430068b80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9450153c20 0x7f94501f10d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94500af3a0 0x7f94501f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 --2- 172.21.15.81:0/2904898120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943c004d60 0x7f94501536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 >> 172.21.15.81:0/2904898120 conn(0x7f94500715f0 msgr2=0x7f945014dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 shutdown_connections 2024-05-08T20:46:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:30.860+0000 7f9454eee640 1 -- 172.21.15.81:0/2904898120 wait complete. 2024-05-08T20:46:30.880 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:46:30.880 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:46:30.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:46:31.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 Processor -- start 2024-05-08T20:46:31.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 -- start start 2024-05-08T20:46:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4990154cf0 0x7f4990155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4990155690 0x7f49900ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49901522e0 con 0x7f4990151f00 2024-05-08T20:46:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499006bb20 con 0x7f4990154cf0 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f4995fe3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49901548e0 con 0x7f4990155690 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4990154cf0 0x7f4990155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4990154cf0 0x7f4990155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56552/0 (socket says 172.21.15.81:56552) 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 -- 172.21.15.81:0/1925618200 learned_addr learned my addr 172.21.15.81:0/1925618200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498ffff640 1 --2- 172.21.15.81:0/1925618200 >> v2:172.21.15.117:3300/0 conn(0x7f4990155690 0x7f49900ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 -- 172.21.15.81:0/1925618200 >> v2:172.21.15.117:3300/0 conn(0x7f4990155690 msgr2=0x7f49900ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 --2- 172.21.15.81:0/1925618200 >> v2:172.21.15.117:3300/0 conn(0x7f4990155690 0x7f49900ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 -- 172.21.15.81:0/1925618200 >> v1:172.21.15.117:6789/0 conn(0x7f4990151f00 legacy=0x7f49901588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.004+0000 7f498effd640 1 -- 172.21.15.81:0/1925618200 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900c5f80 con 0x7f4990154cf0 2024-05-08T20:46:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f498effd640 1 --2- 172.21.15.81:0/1925618200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990154cf0 0x7f4990155150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49900caee0 tx=0x7f498401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9d69e852b502e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f498e7fc640 1 -- 172.21.15.81:0/1925618200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840ad660 con 0x7f4990154cf0 2024-05-08T20:46:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f498e7fc640 1 -- 172.21.15.81:0/1925618200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49840ad7c0 con 0x7f4990154cf0 2024-05-08T20:46:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f498e7fc640 1 -- 172.21.15.81:0/1925618200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840adb50 con 0x7f4990154cf0 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- 172.21.15.81:0/1925618200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990154cf0 msgr2=0x7f4990155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 --2- 172.21.15.81:0/1925618200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990154cf0 0x7f4990155150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49900caee0 tx=0x7f498401c3c0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- 172.21.15.81:0/1925618200 shutdown_connections 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 --2- 172.21.15.81:0/1925618200 >> v2:172.21.15.117:3300/0 conn(0x7f4990155690 0x7f49900ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 --2- 172.21.15.81:0/1925618200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990154cf0 0x7f4990155150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- 172.21.15.81:0/1925618200 >> 172.21.15.81:0/1925618200 conn(0x7f49900715f0 msgr2=0x7f4990071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- 172.21.15.81:0/1925618200 shutdown_connections 2024-05-08T20:46:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- 172.21.15.81:0/1925618200 wait complete. 2024-05-08T20:46:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 Processor -- start 2024-05-08T20:46:31.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.008+0000 7f4995fe3640 1 -- start start 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4990151f00 0x7f49901f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4990154cf0 0x7f499014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 0x7f4990157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ae740 con 0x7f4990156530 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901f0820 con 0x7f4990151f00 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ae990 con 0x7f4990154cf0 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 0x7f4990157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 0x7f4990157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56556/0 (socket says 172.21.15.81:56556) 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 learned_addr learned my addr 172.21.15.81:0/362503762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498effd640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4990154cf0 0x7f499014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498f7fe640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4990151f00 0x7f49901f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4990154cf0 msgr2=0x7f499014a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4990154cf0 0x7f499014a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4990151f00 msgr2=0x7f49901f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4990151f00 0x7f49901f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840094d0 con 0x7f4990156530 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498ffff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 0x7f4990157db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4988007e60 tx=0x7f498800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988014420 con 0x7f4990156530 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880145a0 con 0x7f4990156530 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49901f0a70 con 0x7f4990156530 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988014950 con 0x7f4990156530 2024-05-08T20:46:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4990157660 con 0x7f4990156530 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 0x7f499014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990069600 con 0x7f4990155690 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498f7fe640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 0x7f499014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498f7fe640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49900675e0 con 0x7f4990155690 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498f7fe640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 0x7f499014aed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f498000f770 tx=0x7f498000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4988014ab0 con 0x7f4990156530 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f497c066690 0x7f497c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4988084d30 con 0x7f4990156530 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.012+0000 7f498effd640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f497c066690 0x7f497c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980003970 con 0x7f4990155690 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4980003ad0 con 0x7f4990155690 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 msgr2=0x7f499014aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 0x7f499014aed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f498000f770 tx=0x7f498000fc30 comp rx=0 tx=0).stop 2024-05-08T20:46:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 msgr2=0x7f499014aed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f4977fff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990155690 0x7f499014aed0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.016+0000 7f498effd640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f497c066690 0x7f497c068b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49840af000 tx=0x7f49840a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.020+0000 7f4995fe3640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 0x7f499014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.020+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990073af0 con 0x7f4990161270 2024-05-08T20:46:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.020+0000 7f498f7fe640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 0x7f499014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.020+0000 7f498f7fe640 1 -- 172.21.15.81:0/362503762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4990074950 con 0x7f4990161270 2024-05-08T20:46:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.020+0000 7f498f7fe640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 0x7f499014b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f498000f770 tx=0x7f4980003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980004030 con 0x7f4990161270 2024-05-08T20:46:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4808 (secure 0 0 0) 0x7f4980004190 con 0x7f4990161270 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 msgr2=0x7f499014b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 0x7f499014b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f498000f770 tx=0x7f4980003770 comp rx=0 tx=0).stop 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 msgr2=0x7f499014b410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4977fff640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990161270 0x7f499014b410 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f498000f770 tx=0x7f4980003770 comp rx=0 tx=0).stop 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:31.036 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f497c066690 msgr2=0x7f497c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f497c066690 0x7f497c068b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f49840af000 tx=0x7f49840a7000 comp rx=0 tx=0).stop 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 msgr2=0x7f4990157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 --2- 172.21.15.81:0/362503762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4990156530 0x7f4990157db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4988007e60 tx=0x7f498800e4b0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 reap_dead start 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f498ffff640 1 -- 172.21.15.81:0/362503762 reap_dead start 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 shutdown_connections 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 >> 172.21.15.81:0/362503762 conn(0x7f49900715f0 msgr2=0x7f49900ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 shutdown_connections 2024-05-08T20:46:31.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.024+0000 7f4995fe3640 1 -- 172.21.15.81:0/362503762 wait complete. 2024-05-08T20:46:31.041 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:31.041 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:46:31.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:46:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 Processor -- start 2024-05-08T20:46:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 -- start start 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1454155e90 0x7f1454069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1454152ab0 con 0x7f145406d7d0 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14541528a0 con 0x7f1454155e90 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f145acf0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1454152d90 con 0x7f145414fe70 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1454155e90 0x7f1454069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1458a8c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1454155e90 0x7f1454069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:59528/0 (socket says 172.21.15.81:59528) 2024-05-08T20:46:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 -- 172.21.15.81:0/1325503232 learned_addr learned my addr 172.21.15.81:0/1325503232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1458a8c640 1 -- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f145406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1458a8c640 1 -- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f145406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1458a8c640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1458a8c640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 -- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f145406d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 -- 172.21.15.81:0/1325503232 >> v1:172.21.15.117:6789/0 conn(0x7f145406d7d0 legacy=0x7f145406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.168+0000 7f1453fff640 1 -- 172.21.15.81:0/1325503232 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454153070 con 0x7f1454155e90 2024-05-08T20:46:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f1453fff640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454155e90 0x7f1454069fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1440009870 tx=0x7f144001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c2306048e3c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f14537fe640 1 -- 172.21.15.81:0/1325503232 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400ab610 con 0x7f1454155e90 2024-05-08T20:46:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f14537fe640 1 -- 172.21.15.81:0/1325503232 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400ab770 con 0x7f1454155e90 2024-05-08T20:46:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f14537fe640 1 -- 172.21.15.81:0/1325503232 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400abb00 con 0x7f1454155e90 2024-05-08T20:46:31.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454155e90 msgr2=0x7f1454069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454155e90 0x7f1454069fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1440009870 tx=0x7f144001c410 comp rx=0 tx=0).stop 2024-05-08T20:46:31.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- 172.21.15.81:0/1325503232 shutdown_connections 2024-05-08T20:46:31.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454155e90 0x7f1454069fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 --2- 172.21.15.81:0/1325503232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f145406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- 172.21.15.81:0/1325503232 >> 172.21.15.81:0/1325503232 conn(0x7f14540c71b0 msgr2=0x7f14540c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- 172.21.15.81:0/1325503232 shutdown_connections 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- 172.21.15.81:0/1325503232 wait complete. 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 Processor -- start 2024-05-08T20:46:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.172+0000 7f145acf0640 1 -- start start 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f145406d7d0 0x7f14541ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f1454144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 0x7f1454149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541481b0 con 0x7f1454155e90 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14541493f0 con 0x7f145406d7d0 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1454148e80 con 0x7f145414fe70 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 0x7f1454149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 0x7f1454149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56594/0 (socket says 172.21.15.81:56594) 2024-05-08T20:46:31.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 learned_addr learned my addr 172.21.15.81:0/375180936 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1458a8c640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f145406d7d0 0x7f14541ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f1454144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f1454144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f1454144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f1454144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f1454144570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 msgr2=0x7f1454144570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f145414fe70 0x7f1454144570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f145406d7d0 msgr2=0x7f14541ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f145406d7d0 0x7f14541ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400094d0 con 0x7f1454155e90 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145928d640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 0x7f1454149880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f144c00c7a0 tx=0x7f144c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c003b80 con 0x7f1454155e90 2024-05-08T20:46:31.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c003ce0 con 0x7f1454155e90 2024-05-08T20:46:31.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1454155ae0 con 0x7f1454155e90 2024-05-08T20:46:31.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00aa90 con 0x7f1454155e90 2024-05-08T20:46:31.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1454147750 con 0x7f1454155e90 2024-05-08T20:46:31.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 0x7f145414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454069550 con 0x7f1454149dc0 2024-05-08T20:46:31.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1458a8c640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 0x7f145414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f144c00abf0 con 0x7f1454155e90 2024-05-08T20:46:31.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1458a8c640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1454150250 con 0x7f1454149dc0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1438066690 0x7f1438068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f144c084260 con 0x7f1454155e90 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1438066690 0x7f1438068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1458a8c640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 0x7f145414d2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1448000ee0 tx=0x7f14480119f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800c070 con 0x7f1454149dc0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.176+0000 7f1453fff640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1438066690 0x7f1438068b50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f14400af000 tx=0x7f14400a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.180+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1448004230 con 0x7f1454149dc0 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.180+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 msgr2=0x7f145414d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.180+0000 7f14517fa640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 0x7f145414d2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1448000ee0 tx=0x7f14480119f0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.180+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 msgr2=0x7f145414d2e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.180+0000 7f14517fa640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454149dc0 0x7f145414d2e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f145acf0640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 0x7f1454153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540675e0 con 0x7f1454147b80 2024-05-08T20:46:31.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f1458a8c640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 0x7f1454153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f1458a8c640 1 -- 172.21.15.81:0/375180936 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f14541495a0 con 0x7f1454147b80 2024-05-08T20:46:31.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f1458a8c640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 0x7f1454153c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1448000ee0 tx=0x7f14480046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.188+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448025070 con 0x7f1454147b80 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f1448015e00 con 0x7f1454147b80 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 msgr2=0x7f1454153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f14517fa640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 0x7f1454153c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1448000ee0 tx=0x7f14480046d0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f14517fa640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 msgr2=0x7f1454153c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f14517fa640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1454147b80 0x7f1454153c40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:46:31.193 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.194 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:31.197 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:31.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:31.202 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:31.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:31.205 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:31.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1438066690 msgr2=0x7f1438068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1438066690 0x7f1438068b50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f14400af000 tx=0x7f14400a7000 comp rx=0 tx=0).stop 2024-05-08T20:46:31.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 msgr2=0x7f1454149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 --2- 172.21.15.81:0/375180936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1454155e90 0x7f1454149880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f144c00c7a0 tx=0x7f144c00cc60 comp rx=0 tx=0).stop 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 reap_dead start 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145928d640 1 -- 172.21.15.81:0/375180936 reap_dead start 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 shutdown_connections 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 >> 172.21.15.81:0/375180936 conn(0x7f14540c71b0 msgr2=0x7f1454156340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 shutdown_connections 2024-05-08T20:46:31.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.192+0000 7f145acf0640 1 -- 172.21.15.81:0/375180936 wait complete. 2024-05-08T20:46:31.211 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:31.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:46:31.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:46:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 Processor -- start 2024-05-08T20:46:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 -- start start 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 0x7fe1c81555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1c80aac30 0x7fe1c80c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c8155140 con 0x7fe1c80c26e0 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80c4780 con 0x7fe1c80aac30 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1ccd68640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80c32d0 con 0x7fe1c8152220 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1c80aac30 0x7fe1c80c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1c80aac30 0x7fe1c80c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56610/0 (socket says 172.21.15.81:56610) 2024-05-08T20:46:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 -- 172.21.15.81:0/1461134410 learned_addr learned my addr 172.21.15.81:0/1461134410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c659c640 1 --2- 172.21.15.81:0/1461134410 >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 0x7fe1c81555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 -- 172.21.15.81:0/1461134410 >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 msgr2=0x7fe1c81555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 --2- 172.21.15.81:0/1461134410 >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 0x7fe1c81555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 -- 172.21.15.81:0/1461134410 >> v1:172.21.15.81:6789/0 conn(0x7fe1c80c26e0 legacy=0x7fe1c80c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c6d9d640 1 -- 172.21.15.81:0/1461134410 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8072650 con 0x7fe1c80aac30 2024-05-08T20:46:31.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.340+0000 7fe1c659c640 1 --2- 172.21.15.81:0/1461134410 >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 0x7fe1c81555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:46:31.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1c6d9d640 1 --2- 172.21.15.81:0/1461134410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c80c15f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1c806fdc0 tx=0x7fe1c001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c0cd00e8a6927b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1c5d9b640 1 -- 172.21.15.81:0/1461134410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00a57f0 con 0x7fe1c80aac30 2024-05-08T20:46:31.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1c5d9b640 1 -- 172.21.15.81:0/1461134410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c00a5950 con 0x7fe1c80aac30 2024-05-08T20:46:31.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1c5d9b640 1 -- 172.21.15.81:0/1461134410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00a5ce0 con 0x7fe1c80aac30 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- 172.21.15.81:0/1461134410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 msgr2=0x7fe1c80c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/1461134410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c80c15f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe1c806fdc0 tx=0x7fe1c001c930 comp rx=0 tx=0).stop 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- 172.21.15.81:0/1461134410 shutdown_connections 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/1461134410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c80c15f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/1461134410 >> v2:172.21.15.117:3300/0 conn(0x7fe1c8152220 0x7fe1c81555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- 172.21.15.81:0/1461134410 >> 172.21.15.81:0/1461134410 conn(0x7fe1c80c4cc0 msgr2=0x7fe1c80c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- 172.21.15.81:0/1461134410 shutdown_connections 2024-05-08T20:46:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- 172.21.15.81:0/1461134410 wait complete. 2024-05-08T20:46:31.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 Processor -- start 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- start start 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1c80c26e0 0x7fe1c8156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8152220 0x7fe1c81ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8153e00 con 0x7fe1c80aac30 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8154050 con 0x7fe1c80c26e0 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.344+0000 7fe1ccd68640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8154330 con 0x7fe1c8152220 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56618/0 (socket says 172.21.15.81:56618) 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 -- 172.21.15.81:0/2229142424 learned_addr learned my addr 172.21.15.81:0/2229142424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:31.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1c80c26e0 0x7fe1c8156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c6d9d640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8152220 0x7fe1c81ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8152220 msgr2=0x7fe1c81ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8152220 0x7fe1c81ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1c80c26e0 msgr2=0x7fe1c8156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1c80c26e0 0x7fe1c8156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009b30 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c659c640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7c0 tx=0x7fe1b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007a30 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8007b90 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800ce70 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c8152e20 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c81533e0 con 0x7fe1c80aac30 2024-05-08T20:46:31.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8073ea0 con 0x7fe1c8153900 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1b80113f0 con 0x7fe1c80aac30 2024-05-08T20:46:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1a8066690 0x7fe1a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe1b8084ad0 con 0x7fe1c80aac30 2024-05-08T20:46:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c6d9d640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1a8066690 0x7fe1a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.348+0000 7fe1c6d9d640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1a8066690 0x7fe1a8068b50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00ae000 tx=0x7fe1c00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.552+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.552+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:46:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.552+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.552+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.552+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.956+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.956+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.956+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.956+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:31.956+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:32.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:32.760+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:32.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:32.760+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:46:32.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:32.760+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:46:32.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:32.760+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:32.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:32.760+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:32.926 INFO:tasks.workunit.client.0.smithi081.stdout:fs setup took 997 secs 2024-05-08T20:46:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1c8158e60 con 0x7fe1c8153900 2024-05-08T20:46:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80c8100 tx=0x7fe1b0014b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00050d0 con 0x7fe1c8153900 2024-05-08T20:46:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe1b0005230 con 0x7fe1c8153900 2024-05-08T20:46:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80c8100 tx=0x7fe1b0014b40 comp rx=0 tx=0).stop 2024-05-08T20:46:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 msgr2=0x7fe1c81eda60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.364+0000 7fe1beffd640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8153900 0x7fe1c81eda60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.372+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 0x7fe1c81469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.372+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8152fb0 con 0x7fe1c8156070 2024-05-08T20:46:34.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.372+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 0x7fe1c81469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.372+0000 7fe1bffff640 1 -- 172.21.15.81:0/2229142424 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe1c8074950 con 0x7fe1c8156070 2024-05-08T20:46:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1bffff640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 0x7fe1c81469e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8154540 tx=0x7fe1b0001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00069e0 con 0x7fe1c8156070 2024-05-08T20:46:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fe1b0006b40 con 0x7fe1c8156070 2024-05-08T20:46:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 msgr2=0x7fe1c81469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 0x7fe1c81469e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8154540 tx=0x7fe1b0001130 comp rx=0 tx=0).stop 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 msgr2=0x7fe1c81469e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1beffd640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1c8156070 0x7fe1c81469e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:34.379 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:34.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:34.382 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:34.388 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1a8066690 msgr2=0x7fe1a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe1a8066690 0x7fe1a8068b50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00ae000 tx=0x7fe1c00a7070 comp rx=0 tx=0).stop 2024-05-08T20:46:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 msgr2=0x7fe1c81583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7c0 tx=0x7fe1b800cc80 comp rx=0 tx=0).stop 2024-05-08T20:46:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1c6d9d640 1 -- 172.21.15.81:0/2229142424 reap_dead start 2024-05-08T20:46:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 shutdown_connections 2024-05-08T20:46:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 --2- 172.21.15.81:0/2229142424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c80aac30 0x7fe1c81583e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 >> 172.21.15.81:0/2229142424 conn(0x7fe1c80c4cc0 msgr2=0x7fe1c80a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 shutdown_connections 2024-05-08T20:46:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.376+0000 7fe1ccd68640 1 -- 172.21.15.81:0/2229142424 wait complete. 2024-05-08T20:46:34.399 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:34.399 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:46:34.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:46:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 Processor -- start 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 -- start start 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3600ab130 0x7ff3600c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff36006c250 0x7ff360151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600aba50 con 0x7ff3601524f0 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600c19d0 con 0x7ff3600ab130 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff367f07640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3601517d0 con 0x7ff36006c250 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3600ab130 0x7ff3600c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3600ab130 0x7ff3600c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56620/0 (socket says 172.21.15.81:56620) 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 -- 172.21.15.81:0/2408604460 learned_addr learned my addr 172.21.15.81:0/2408604460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff3654a2640 1 --2- 172.21.15.81:0/2408604460 >> v2:172.21.15.117:3300/0 conn(0x7ff36006c250 0x7ff360151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 -- 172.21.15.81:0/2408604460 >> v2:172.21.15.117:3300/0 conn(0x7ff36006c250 msgr2=0x7ff360151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 --2- 172.21.15.81:0/2408604460 >> v2:172.21.15.117:3300/0 conn(0x7ff36006c250 0x7ff360151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 -- 172.21.15.81:0/2408604460 >> v1:172.21.15.81:6789/0 conn(0x7ff3601524f0 legacy=0x7ff3600c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.528+0000 7ff365ca3640 1 -- 172.21.15.81:0/2408604460 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600c1c40 con 0x7ff3600ab130 2024-05-08T20:46:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff365ca3640 1 --2- 172.21.15.81:0/2408604460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3600ab130 0x7ff3600c2a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3600c7940 tx=0x7ff35c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d05c9115992802b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff364ca1640 1 -- 172.21.15.81:0/2408604460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0ab660 con 0x7ff3600ab130 2024-05-08T20:46:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff364ca1640 1 -- 172.21.15.81:0/2408604460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0ab7c0 con 0x7ff3600ab130 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff364ca1640 1 -- 172.21.15.81:0/2408604460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0abb50 con 0x7ff3600ab130 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- 172.21.15.81:0/2408604460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3600ab130 msgr2=0x7ff3600c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 --2- 172.21.15.81:0/2408604460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3600ab130 0x7ff3600c2a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3600c7940 tx=0x7ff35c01c460 comp rx=0 tx=0).stop 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- 172.21.15.81:0/2408604460 shutdown_connections 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 --2- 172.21.15.81:0/2408604460 >> v2:172.21.15.117:3300/0 conn(0x7ff36006c250 0x7ff360151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 --2- 172.21.15.81:0/2408604460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3600ab130 0x7ff3600c2a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- 172.21.15.81:0/2408604460 >> 172.21.15.81:0/2408604460 conn(0x7ff3600c68c0 msgr2=0x7ff3600c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- 172.21.15.81:0/2408604460 shutdown_connections 2024-05-08T20:46:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- 172.21.15.81:0/2408604460 wait complete. 2024-05-08T20:46:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 Processor -- start 2024-05-08T20:46:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.532+0000 7ff367f07640 1 -- start start 2024-05-08T20:46:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 0x7ff3600c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 0x7ff360145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360146d00 con 0x7ff360146e70 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360072060 con 0x7ff36006c250 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601efbf0 con 0x7ff3600ab130 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56622/0 (socket says 172.21.15.81:56622) 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 -- 172.21.15.81:0/223096249 learned_addr learned my addr 172.21.15.81:0/223096249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3654a2640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 0x7ff360145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff365ca3640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 0x7ff3600c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 -- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 msgr2=0x7ff360145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 0x7ff360145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 -- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 msgr2=0x7ff3600c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 0x7ff3600c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 -- 172.21.15.81:0/223096249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0094d0 con 0x7ff360146e70 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3654a2640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 0x7ff360145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff365ca3640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 0x7ff3600c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3664a4640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c730 tx=0x7ff35800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358003b80 con 0x7ff360146e70 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358003ce0 con 0x7ff360146e70 2024-05-08T20:46:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358005310 con 0x7ff360146e70 2024-05-08T20:46:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3601ef760 con 0x7ff360146e70 2024-05-08T20:46:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36014f1f0 con 0x7ff360146e70 2024-05-08T20:46:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3601ef8f0 con 0x7ff360146e70 2024-05-08T20:46:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff358005680 con 0x7ff360146e70 2024-05-08T20:46:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 0x7ff344068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff3580844d0 con 0x7ff360146e70 2024-05-08T20:46:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff365ca3640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 0x7ff344068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.536+0000 7ff365ca3640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 0x7ff344068b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af000 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.540+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff3580514a0 con 0x7ff360146e70 2024-05-08T20:46:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.760+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff360074950 con 0x7ff360146e70 2024-05-08T20:46:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.760+0000 7ff3567fc640 1 -- 172.21.15.81:0/223096249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff358054ac0 con 0x7ff360146e70 2024-05-08T20:46:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 msgr2=0x7ff344068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 0x7ff344068b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af000 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 msgr2=0x7ff3601461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c730 tx=0x7ff35800cbf0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 shutdown_connections 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff3440666c0 0x7ff344068b80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360146e70 0x7ff3601461d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3600ab130 0x7ff360145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 --2- 172.21.15.81:0/223096249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36006c250 0x7ff3600c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 >> 172.21.15.81:0/223096249 conn(0x7ff3600c68c0 msgr2=0x7ff3600c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 shutdown_connections 2024-05-08T20:46:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:34.764+0000 7ff367f07640 1 -- 172.21.15.81:0/223096249 wait complete. 2024-05-08T20:46:34.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:46:35.429 INFO:tasks.workunit.client.0.smithi081.stdout:Syncing()...2 sec 2024-05-08T20:46:35.430 INFO:tasks.workunit.client.0.smithi081.stdout:Starting Actual Benchmark At: Wed May 8 20:46:35 2024 2024-05-08T20:46:35.430 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:46:44.785 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:46:44.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:45.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 Processor -- start 2024-05-08T20:46:45.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 -- start start 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c153880 con 0x7ff72c0c3510 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c0c47c0 con 0x7ff72c0c38f0 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff73456c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0c6220 con 0x7ff72c0a9970 2024-05-08T20:46:45.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff732b09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36456/0 (socket says 172.21.15.81:36456) 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff732b09640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39544/0 (socket says 172.21.15.81:39544) 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 -- 172.21.15.81:0/1286322989 learned_addr learned my addr 172.21.15.81:0/1286322989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 -- 172.21.15.81:0/1286322989 >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 msgr2=0x7ff72c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 --2- 172.21.15.81:0/1286322989 >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 -- 172.21.15.81:0/1286322989 >> v1:172.21.15.117:6789/0 conn(0x7ff72c0c3510 legacy=0x7ff72c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff731b07640 1 -- 172.21.15.81:0/1286322989 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0c6500 con 0x7ff72c0a9970 2024-05-08T20:46:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.084+0000 7ff732b09640 1 --2- 172.21.15.81:0/1286322989 >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:46:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff731b07640 1 --2- 172.21.15.81:0/1286322989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009870 tx=0x7ff71c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e5333389747d72 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff731306640 1 -- 172.21.15.81:0/1286322989 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0a6040 con 0x7ff72c0a9970 2024-05-08T20:46:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff731306640 1 -- 172.21.15.81:0/1286322989 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0aa600 con 0x7ff72c0a9970 2024-05-08T20:46:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff731306640 1 -- 172.21.15.81:0/1286322989 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0aa990 con 0x7ff72c0a9970 2024-05-08T20:46:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 -- 172.21.15.81:0/1286322989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 msgr2=0x7ff72c0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 --2- 172.21.15.81:0/1286322989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009870 tx=0x7ff71c01c4a0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 -- 172.21.15.81:0/1286322989 shutdown_connections 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 --2- 172.21.15.81:0/1286322989 >> v2:172.21.15.117:3300/0 conn(0x7ff72c0c38f0 0x7ff72c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 --2- 172.21.15.81:0/1286322989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c0aaa80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.088+0000 7ff73456c640 1 -- 172.21.15.81:0/1286322989 >> 172.21.15.81:0/1286322989 conn(0x7ff72c0c68c0 msgr2=0x7ff72c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 -- 172.21.15.81:0/1286322989 shutdown_connections 2024-05-08T20:46:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 -- 172.21.15.81:0/1286322989 wait complete. 2024-05-08T20:46:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 Processor -- start 2024-05-08T20:46:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 -- start start 2024-05-08T20:46:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c1eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 0x7ff72c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff732308640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c1eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff732308640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c1eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36468/0 (socket says 172.21.15.81:36468) 2024-05-08T20:46:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff732308640 1 -- 172.21.15.81:0/2183113096 learned_addr learned my addr 172.21.15.81:0/2183113096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0c38f0 0x7ff72c071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff731b07640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 0x7ff72c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff73456c640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c070620 con 0x7ff72c0c3510 2024-05-08T20:46:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.092+0000 7ff732b09640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0c38f0 0x7ff72c071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff73456c640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c071860 con 0x7ff72c0c38f0 2024-05-08T20:46:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff73456c640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c1eb920 con 0x7ff72c0a9970 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 -- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 msgr2=0x7ff72c1eb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c1eb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 -- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0c38f0 msgr2=0x7ff72c071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0c38f0 0x7ff72c071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724009a70 con 0x7ff72c0c3510 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff731b07640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 0x7ff72c14a3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ab000 tx=0x7ff71c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0b3600 con 0x7ff72c0c3510 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0b3760 con 0x7ff72c0c3510 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0b3b10 con 0x7ff72c0c3510 2024-05-08T20:46:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff73456c640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0094d0 con 0x7ff72c0c3510 2024-05-08T20:46:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff73456c640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c1ebee0 con 0x7ff72c0c3510 2024-05-08T20:46:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff71c0b3c70 con 0x7ff72c0c3510 2024-05-08T20:46:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 0x7ff710068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff71c11eeb0 con 0x7ff72c0c3510 2024-05-08T20:46:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.096+0000 7ff732308640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 0x7ff710068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.100+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff708005260 con 0x7ff72c0c3510 2024-05-08T20:46:45.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.104+0000 7ff732308640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 0x7ff710068b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff7280018b0 tx=0x7ff728009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.108+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff71c0ebfc0 con 0x7ff72c0c3510 2024-05-08T20:46:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.627+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff708005510 con 0x7ff72c0c3510 2024-05-08T20:46:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.627+0000 7ff722ffd640 1 -- 172.21.15.81:0/2183113096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7ff71c0ef5e0 con 0x7ff72c0c3510 2024-05-08T20:46:45.630 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 msgr2=0x7ff710068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 0x7ff710068b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff7280018b0 tx=0x7ff728009040 comp rx=0 tx=0).stop 2024-05-08T20:46:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 msgr2=0x7ff72c14a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 0x7ff72c14a3f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ab000 tx=0x7ff71c01ace0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 shutdown_connections 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff710066690 0x7ff710068b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0c38f0 0x7ff72c071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff72c0c3510 0x7ff72c14a3f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2183113096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff72c0a9970 0x7ff72c1eb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.631+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 >> 172.21.15.81:0/2183113096 conn(0x7ff72c0c68c0 msgr2=0x7ff72c151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.635+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 shutdown_connections 2024-05-08T20:46:45.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.635+0000 7ff720ff9640 1 -- 172.21.15.81:0/2183113096 wait complete. 2024-05-08T20:46:45.674 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:46:45.674 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:46:45.674 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:46:45.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:46:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 Processor -- start 2024-05-08T20:46:45.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 -- start start 2024-05-08T20:46:45.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 0x7fb7a80c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a806fb50 0x7fb7a80a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a81486d0 con 0x7fb7a80aa150 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a8151bc0 con 0x7fb7a806fb50 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7ad032640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8154f60 con 0x7fb7a80c1bb0 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7a659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a806fb50 0x7fb7a80a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7a659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a806fb50 0x7fb7a80a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45780/0 (socket says 172.21.15.81:45780) 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7a659c640 1 -- 172.21.15.81:0/496195754 learned_addr learned my addr 172.21.15.81:0/496195754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.855+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 0x7fb7a80c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a659c640 1 -- 172.21.15.81:0/496195754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 msgr2=0x7fb7a80c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a659c640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 0x7fb7a80c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a659c640 1 -- 172.21.15.81:0/496195754 >> v1:172.21.15.81:6789/0 conn(0x7fb7a80aa150 legacy=0x7fb7a806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a659c640 1 -- 172.21.15.81:0/496195754 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8155240 con 0x7fb7a806fb50 2024-05-08T20:46:45.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 0x7fb7a80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:46:45.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a659c640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a806fb50 0x7fb7a80a9c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb798009870 tx=0x7fb79801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42b3ed4d5aa40a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a5d9b640 1 -- 172.21.15.81:0/496195754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980ac620 con 0x7fb7a806fb50 2024-05-08T20:46:45.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.859+0000 7fb7a5d9b640 1 -- 172.21.15.81:0/496195754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7980ac780 con 0x7fb7a806fb50 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7a5d9b640 1 -- 172.21.15.81:0/496195754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980ac620 con 0x7fb7a806fb50 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/496195754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a806fb50 msgr2=0x7fb7a80a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a806fb50 0x7fb7a80a9c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb798009870 tx=0x7fb79801c4d0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/496195754 shutdown_connections 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a806fb50 0x7fb7a80a9c10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- 172.21.15.81:0/496195754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a80c1bb0 0x7fb7a80c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/496195754 >> 172.21.15.81:0/496195754 conn(0x7fb7a80c2ca0 msgr2=0x7fb7a80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/496195754 shutdown_connections 2024-05-08T20:46:45.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/496195754 wait complete. 2024-05-08T20:46:45.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 Processor -- start 2024-05-08T20:46:45.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- start start 2024-05-08T20:46:45.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a806fb50 0x7fb7a806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 0x7fb7a80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7a6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a806fb50 0x7fb7a806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7a6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a806fb50 0x7fb7a806b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36482/0 (socket says 172.21.15.81:36482) 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c1bb0 0x7fb7a80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7a6d9d640 1 -- 172.21.15.81:0/3758328869 learned_addr learned my addr 172.21.15.81:0/3758328869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a814e4d0 con 0x7fb7a80c1bb0 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8146430 con 0x7fb7a80aa150 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.863+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a81469f0 con 0x7fb7a806fb50 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 0x7fb7a80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a759e640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c1bb0 0x7fb7a80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a806fb50 msgr2=0x7fb7a806b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7a806fb50 0x7fb7a806b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c1bb0 msgr2=0x7fb7a80c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c1bb0 0x7fb7a80c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0009a70 con 0x7fb7a80aa150 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a659c640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 0x7fb7a80c4e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7980ac000 tx=0x7fb798019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980acaf0 con 0x7fb7a80aa150 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7980acc50 con 0x7fb7a80aa150 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7980094d0 con 0x7fb7a80aa150 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980ac5a0 con 0x7fb7a80aa150 2024-05-08T20:46:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a81ebd20 con 0x7fb7a80aa150 2024-05-08T20:46:45.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7ad032640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 0x7fb7a8142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80696e0 con 0x7fb7a81465a0 2024-05-08T20:46:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 0x7fb7a8142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a6d9d640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7a8074950 con 0x7fb7a81465a0 2024-05-08T20:46:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 0x7fb7a8142bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0011400 tx=0x7fb7a00118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.867+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a000e030 con 0x7fb7a81465a0 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb7a00039a0 con 0x7fb7a81465a0 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 msgr2=0x7fb7a8142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 0x7fb7a8142bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0011400 tx=0x7fb7a00118c0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 msgr2=0x7fb7a8142bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a81465a0 0x7fb7a8142bb0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0011400 tx=0x7fb7a00118c0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7980b3040 con 0x7fb7a80aa150 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb794066460 0x7fb794068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.871+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb79811dd90 con 0x7fb7a80aa150 2024-05-08T20:46:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.875+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb794066460 0x7fb794068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.875+0000 7fb7a6d9d640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb794066460 0x7fb794068920 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f90 tx=0x7fb7a000f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb7ad032640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 0x7fb7a81430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80c3970 con 0x7fb7a80c58a0 2024-05-08T20:46:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb7a759e640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 0x7fb7a81430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb7a759e640 1 -- 172.21.15.81:0/3758328869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb7a80ab310 con 0x7fb7a80c58a0 2024-05-08T20:46:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb7a759e640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 0x7fb7a81430f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00f540 tx=0x7fb79c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c005320 con 0x7fb7a80c58a0 2024-05-08T20:46:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4809 (secure 0 0 0) 0x7fb79c005480 con 0x7fb7a80c58a0 2024-05-08T20:46:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 msgr2=0x7fb7a81430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 0x7fb7a81430f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00f540 tx=0x7fb79c00fa00 comp rx=0 tx=0).stop 2024-05-08T20:46:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 msgr2=0x7fb7a81430f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.883+0000 7fb78f7fe640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a80c58a0 0x7fb7a81430f0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00f540 tx=0x7fb79c00fa00 comp rx=0 tx=0).stop 2024-05-08T20:46:45.888 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:46:45.889 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:45.890 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:45.891 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:45.892 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:45.893 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:45.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:45.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:45.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:45.897 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:45.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:45.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.901 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:45.902 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:45.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:45.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:45.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:45.903 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:45.903 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb794066460 msgr2=0x7fb794068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb794066460 0x7fb794068920 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f90 tx=0x7fb7a000f000 comp rx=0 tx=0).stop 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7a759e640 1 -- 172.21.15.81:0/3758328869 reap_dead start 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 msgr2=0x7fb7a80c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 0x7fb7a80c4e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7980ac000 tx=0x7fb798019270 comp rx=0 tx=0).stop 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 shutdown_connections 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 --2- 172.21.15.81:0/3758328869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7a80aa150 0x7fb7a80c4e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 >> 172.21.15.81:0/3758328869 conn(0x7fb7a80c2ca0 msgr2=0x7fb7a80aa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 shutdown_connections 2024-05-08T20:46:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:45.887+0000 7fb7ad032640 1 -- 172.21.15.81:0/3758328869 wait complete. 2024-05-08T20:46:45.913 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:45.914 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:46:45.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:46:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 Processor -- start 2024-05-08T20:46:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 -- start start 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d54151f00 0x7f7d541588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d54155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d54158e20 con 0x7f7d54155690 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5406bb20 con 0x7f7d54151f00 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d5b3c8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541548e0 con 0x7f7d54154cf0 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d54151f00 0x7f7d541588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d54151f00 0x7f7d541588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45806/0 (socket says 172.21.15.81:45806) 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 -- 172.21.15.81:0/76798355 learned_addr learned my addr 172.21.15.81:0/76798355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d58963640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d54155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 -- 172.21.15.81:0/76798355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 msgr2=0x7f7d54155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d54155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 -- 172.21.15.81:0/76798355 >> v1:172.21.15.117:6789/0 conn(0x7f7d54155690 legacy=0x7f7d540ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.071+0000 7f7d59164640 1 -- 172.21.15.81:0/76798355 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d541522e0 con 0x7f7d54151f00 2024-05-08T20:46:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d59164640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54151f00 0x7f7d541588e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098a0 tx=0x7f7d5001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb8546dd47d6505 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d4bfff640 1 -- 172.21.15.81:0/76798355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500ac620 con 0x7f7d54151f00 2024-05-08T20:46:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d4bfff640 1 -- 172.21.15.81:0/76798355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d500ac780 con 0x7f7d54151f00 2024-05-08T20:46:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d4bfff640 1 -- 172.21.15.81:0/76798355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500acb10 con 0x7f7d54151f00 2024-05-08T20:46:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/76798355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54151f00 msgr2=0x7f7d541588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54151f00 0x7f7d541588e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098a0 tx=0x7f7d5001c3e0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/76798355 shutdown_connections 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d54155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 --2- 172.21.15.81:0/76798355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54151f00 0x7f7d541588e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/76798355 >> 172.21.15.81:0/76798355 conn(0x7f7d540715f0 msgr2=0x7f7d54071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/76798355 shutdown_connections 2024-05-08T20:46:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.075+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/76798355 wait complete. 2024-05-08T20:46:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 Processor -- start 2024-05-08T20:46:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 -- start start 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 0x7f7d54157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d540aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54157120 0x7f7d541f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541f12a0 con 0x7f7d54157120 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54157fd0 con 0x7f7d54151f00 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d59164640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 0x7f7d54157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d59164640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 0x7f7d54157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39570/0 (socket says 172.21.15.81:39570) 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d59164640 1 -- 172.21.15.81:0/2090308277 learned_addr learned my addr 172.21.15.81:0/2090308277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d540aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540af3f0 con 0x7f7d54154cf0 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d59965640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54157120 0x7f7d541f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 msgr2=0x7f7d54157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 0x7f7d54157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54157120 msgr2=0x7f7d541f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d54157120 0x7f7d541f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d58963640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500094d0 con 0x7f7d54154cf0 2024-05-08T20:46:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.079+0000 7f7d59164640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54151f00 0x7f7d54157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:46:46.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d58963640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d540aa700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400e8a0 tx=0x7f7d4400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400c940 con 0x7f7d54154cf0 2024-05-08T20:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d540ad660 con 0x7f7d54154cf0 2024-05-08T20:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540aac40 con 0x7f7d54154cf0 2024-05-08T20:46:46.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400caa0 con 0x7f7d54154cf0 2024-05-08T20:46:46.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400c940 con 0x7f7d54154cf0 2024-05-08T20:46:46.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d5b3c8640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 0x7f7d541486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d5b3c8640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54069600 con 0x7f7d54155690 2024-05-08T20:46:46.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d59164640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 0x7f7d541486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d59164640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d540adb80 con 0x7f7d54155690 2024-05-08T20:46:46.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.087+0000 7f7d59164640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 0x7f7d541486c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098a0 tx=0x7f7d50019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500ac620 con 0x7f7d54155690 2024-05-08T20:46:46.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7d500acca0 con 0x7f7d54155690 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 msgr2=0x7f7d541486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 0x7f7d541486c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098a0 tx=0x7f7d50019180 comp rx=0 tx=0).stop 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 msgr2=0x7f7d541486c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d54155690 0x7f7d541486c0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098a0 tx=0x7f7d50019180 comp rx=0 tx=0).stop 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d4400cc10 con 0x7f7d54154cf0 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d38066440 0x7f7d38068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.091+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7d44054b70 con 0x7f7d54154cf0 2024-05-08T20:46:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.095+0000 7f7d59164640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d38066440 0x7f7d38068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.095+0000 7f7d59164640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d38066440 0x7f7d38068900 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c6c20 tx=0x7f7d500c4040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 0x7f7d540c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540cab20 con 0x7f7d541f0c90 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d59965640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 0x7f7d540c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d59965640 1 -- 172.21.15.81:0/2090308277 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7d540c6820 con 0x7f7d541f0c90 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d59965640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 0x7f7d540c82b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00f8b0 tx=0x7f7d4c00fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c006b60 con 0x7f7d541f0c90 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f7d4c006cc0 con 0x7f7d541f0c90 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 msgr2=0x7f7d540c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 0x7f7d540c82b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00f8b0 tx=0x7f7d4c00fd70 comp rx=0 tx=0).stop 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 msgr2=0x7f7d540c82b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d541f0c90 0x7f7d540c82b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 17, 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:46.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.117 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.118 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:46.120 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d38066440 msgr2=0x7f7d38068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d38066440 0x7f7d38068900 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c6c20 tx=0x7f7d500c4040 comp rx=0 tx=0).stop 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 msgr2=0x7f7d540aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/2090308277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d54154cf0 0x7f7d540aa700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400e8a0 tx=0x7f7d4400ed60 comp rx=0 tx=0).stop 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d59965640 1 -- 172.21.15.81:0/2090308277 reap_dead start 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 shutdown_connections 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.103+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 >> 172.21.15.81:0/2090308277 conn(0x7f7d540715f0 msgr2=0x7f7d540719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.107+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 shutdown_connections 2024-05-08T20:46:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.107+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/2090308277 wait complete. 2024-05-08T20:46:46.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:46.148 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:46:46.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:46:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 Processor -- start 2024-05-08T20:46:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 -- start start 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d681555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d680c26e0 0x7f2d680c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d68155140 con 0x7f2d680aac30 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d680c4780 con 0x7f2d680c26e0 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d70524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68072650 con 0x7f2d68152220 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d6eac1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d680aac30 0x7f2d680c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47022/0 (socket says 172.21.15.81:47022) 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d6eac1640 1 -- 172.21.15.81:0/3903487311 learned_addr learned my addr 172.21.15.81:0/3903487311 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/3903487311 >> v2:172.21.15.117:3300/0 conn(0x7f2d680c26e0 0x7f2d680c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.331+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d681555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.335+0000 7f2d6dabf640 1 -- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 msgr2=0x7f2d681555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.335+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d681555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.335+0000 7f2d6d2be640 1 -- 172.21.15.81:0/3903487311 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266692160 0 0) 0x7f2d68155140 con 0x7f2d680aac30 2024-05-08T20:46:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.335+0000 7f2d6dabf640 1 -- 172.21.15.81:0/3903487311 >> v1:172.21.15.81:6789/0 conn(0x7f2d680aac30 legacy=0x7f2d680c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.335+0000 7f2d6dabf640 1 -- 172.21.15.81:0/3903487311 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68158b80 con 0x7f2d680c26e0 2024-05-08T20:46:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680c26e0 0x7f2d680c2bc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d580097c0 tx=0x7f2d5801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a3db1048782dff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d6d2be640 1 -- 172.21.15.81:0/3903487311 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ac640 con 0x7f2d680c26e0 2024-05-08T20:46:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d6d2be640 1 -- 172.21.15.81:0/3903487311 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580ac7a0 con 0x7f2d680c26e0 2024-05-08T20:46:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d6d2be640 1 -- 172.21.15.81:0/3903487311 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ac640 con 0x7f2d680c26e0 2024-05-08T20:46:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d70524640 1 -- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680c26e0 msgr2=0x7f2d680c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.339+0000 7f2d70524640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680c26e0 0x7f2d680c2bc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d580097c0 tx=0x7f2d5801c3e0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- 172.21.15.81:0/3903487311 shutdown_connections 2024-05-08T20:46:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680c26e0 0x7f2d680c2bc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 --2- 172.21.15.81:0/3903487311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d681555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- 172.21.15.81:0/3903487311 >> 172.21.15.81:0/3903487311 conn(0x7f2d680c4cc0 msgr2=0x7f2d680c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- 172.21.15.81:0/3903487311 shutdown_connections 2024-05-08T20:46:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- 172.21.15.81:0/3903487311 wait complete. 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 Processor -- start 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- start start 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680aac30 0x7f2d6814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 0x7f2d68150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d68150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681510b0 con 0x7f2d680c26e0 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6814f610 con 0x7f2d680aac30 2024-05-08T20:46:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.347+0000 7f2d70524640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681501a0 con 0x7f2d68152220 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 0x7f2d68150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 0x7f2d68150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45826/0 (socket says 172.21.15.81:45826) 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 -- 172.21.15.81:0/2149030541 learned_addr learned my addr 172.21.15.81:0/2149030541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680aac30 0x7f2d6814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 msgr2=0x7f2d68150b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d68152220 0x7f2d68150b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680aac30 msgr2=0x7f2d6814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d680aac30 0x7f2d6814cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58009420 con 0x7f2d680c26e0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6dabf640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 0x7f2d68150630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d5801c8c0 tx=0x7f2d58019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ac640 con 0x7f2d680c26e0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58004020 con 0x7f2d680c26e0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58004390 con 0x7f2d680c26e0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d681f9c40 con 0x7f2d680c26e0 2024-05-08T20:46:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6814fb50 con 0x7f2d680c26e0 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d70524640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 0x7f2d681fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68073ea0 con 0x7f2d6814fd40 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 0x7f2d681fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d580b3040 con 0x7f2d680c26e0 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6e2c0640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d680c3100 con 0x7f2d6814fd40 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 0x7f2d681fd1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d600070a0 tx=0x7f2d6000f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.351+0000 7f2d5effd640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d4c066690 0x7f2d4c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2d5811e6e0 con 0x7f2d680c26e0 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000e040 con 0x7f2d6814fd40 2024-05-08T20:46:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d6eac1640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d4c066690 0x7f2d4c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d6eac1640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d4c066690 0x7f2d4c068b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d640011f0 tx=0x7f2d640078c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f2d6000f040 con 0x7f2d6814fd40 2024-05-08T20:46:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 msgr2=0x7f2d681fd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 0x7f2d681fd1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d600070a0 tx=0x7f2d6000f580 comp rx=0 tx=0).stop 2024-05-08T20:46:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 msgr2=0x7f2d681fd1b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.355+0000 7f2d5effd640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6814fd40 0x7f2d681fd1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.363+0000 7f2d70524640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 0x7f2d681fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.363+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68074950 con 0x7f2d6806c190 2024-05-08T20:46:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.363+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 0x7f2d681fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.363+0000 7f2d6e2c0640 1 -- 172.21.15.81:0/2149030541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2d680aaa10 con 0x7f2d6806c190 2024-05-08T20:46:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.363+0000 7f2d6e2c0640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 0x7f2d681fd6f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d6806b570 tx=0x7f2d60004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6001e920 con 0x7f2d6806c190 2024-05-08T20:46:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f2d60024040 con 0x7f2d6806c190 2024-05-08T20:46:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 msgr2=0x7f2d681fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 146, 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:46:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 17, 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.370 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:46:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:46:46.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.374 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.375 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:46:46.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:46:46.378 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:46:46.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:46:46.380 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:46:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 0x7f2d681fd6f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d6806b570 tx=0x7f2d60004a50 comp rx=0 tx=0).stop 2024-05-08T20:46:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 msgr2=0x7f2d681fd6f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:46:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d5effd640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6806c190 0x7f2d681fd6f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d4c066690 msgr2=0x7f2d4c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d4c066690 0x7f2d4c068b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2d640011f0 tx=0x7f2d640078c0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 msgr2=0x7f2d68150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 --2- 172.21.15.81:0/2149030541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d680c26e0 0x7f2d68150630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d5801c8c0 tx=0x7f2d58019180 comp rx=0 tx=0).stop 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d6eac1640 1 -- 172.21.15.81:0/2149030541 reap_dead start 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d6eac1640 1 -- 172.21.15.81:0/2149030541 reap_dead start 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 shutdown_connections 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 >> 172.21.15.81:0/2149030541 conn(0x7f2d680c4cc0 msgr2=0x7f2d680a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 shutdown_connections 2024-05-08T20:46:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.367+0000 7f2d70524640 1 -- 172.21.15.81:0/2149030541 wait complete. 2024-05-08T20:46:46.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:46:46.401 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:46:46.401 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:46:46.401 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:46:46.401 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:46:46.402 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:46:46.402 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:46:46.414 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:46:46.415 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:46:46.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:46.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.583+0000 7fadd8457640 1 Processor -- start 2024-05-08T20:46:46.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd8457640 1 -- start start 2024-05-08T20:46:46.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd8457640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadd01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd8457640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd0155140 con 0x7fadd0152220 2024-05-08T20:46:46.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd8457640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd00c32d0 con 0x7fadd00aac30 2024-05-08T20:46:46.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd8457640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00c4780 con 0x7fadd00c26e0 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 msgr2=0x7fadd01555d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadd01555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd61f3640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fadd0152220 0x7fadd00c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47030/0 (socket says 172.21.15.81:47030) 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd61f3640 1 -- 172.21.15.81:0/1140964752 learned_addr learned my addr 172.21.15.81:0/1140964752 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034278583 0 0) 0x7fadd0155140 con 0x7fadd0152220 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadbc003530 con 0x7fadd0152220 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587264904 0 0) 0x7fadd00c32d0 con 0x7fadd00aac30 2024-05-08T20:46:46.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd0155140 con 0x7fadd00aac30 2024-05-08T20:46:46.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152256246 0 0) 0x7fadbc003530 con 0x7fadd0152220 2024-05-08T20:46:46.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 msgr2=0x7fadd01555d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:46.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadd01555d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 >> v1:172.21.15.117:6789/0 conn(0x7fadd00aac30 legacy=0x7fadd00c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0072650 con 0x7fadd0152220 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fadcc001680 con 0x7fadd0152220 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 >> v1:172.21.15.81:6789/0 conn(0x7fadd0152220 legacy=0x7fadd00c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadbc003b70 0x7fadbc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadbc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadbc005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80015a0 con 0x7fadbc003b70 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc00bb70 con 0x7fadbc0047d0 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc00bd30 con 0x7fadd00c26e0 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd69f4640 1 -- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 msgr2=0x7fadbc005280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd69f4640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadbc005280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadbc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 -- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 msgr2=0x7fadbc005280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:46.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd00c26e0 0x7fadbc005280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 -- 172.21.15.81:0/1140964752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadbc003b70 msgr2=0x7fadbc003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadbc003b70 0x7fadbc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.587+0000 7fadd59f2640 1 -- 172.21.15.81:0/1140964752 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0072650 con 0x7fadbc0047d0 2024-05-08T20:46:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd59f2640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadbc004c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003940 tx=0x7fadc001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4007dd1e889ec98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003bc0 con 0x7fadbc0047d0 2024-05-08T20:46:46.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00a7070 con 0x7fadbc0047d0 2024-05-08T20:46:46.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd51f1640 1 -- 172.21.15.81:0/1140964752 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0005070 con 0x7fadbc0047d0 2024-05-08T20:46:46.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd8457640 1 -- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 msgr2=0x7fadbc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd8457640 1 --2- 172.21.15.81:0/1140964752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadbc004c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003940 tx=0x7fadc001c410 comp rx=0 tx=0).stop 2024-05-08T20:46:46.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.591+0000 7fadd69f4640 1 -- 172.21.15.81:0/1140964752 reap_dead start 2024-05-08T20:46:46.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- 172.21.15.81:0/1140964752 shutdown_connections 2024-05-08T20:46:46.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- 172.21.15.81:0/1140964752 >> 172.21.15.81:0/1140964752 conn(0x7fadd00c4cc0 msgr2=0x7fadd00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:46.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- 172.21.15.81:0/1140964752 shutdown_connections 2024-05-08T20:46:46.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- 172.21.15.81:0/1140964752 wait complete. 2024-05-08T20:46:46.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 Processor -- start 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- start start 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadd01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 0x7fadd0158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0156d40 con 0x7fadd00c67e0 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01561e0 con 0x7fadbc0047d0 2024-05-08T20:46:46.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd8457640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00c7a40 con 0x7fadd014ad60 2024-05-08T20:46:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45838/0 (socket says 172.21.15.81:45838) 2024-05-08T20:46:46.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 -- 172.21.15.81:0/3300522464 learned_addr learned my addr 172.21.15.81:0/3300522464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd61f3640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadd01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd69f4640 1 -- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 msgr2=0x7fadd0158070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd69f4640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 0x7fadd0158070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 -- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 msgr2=0x7fadd0158070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 0x7fadd0158070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 -- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 msgr2=0x7fadd01f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadd01f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 -- 172.21.15.81:0/3300522464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00c7d20 con 0x7fadd00c67e0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.595+0000 7fadd59f2640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadc001c240 tx=0x7fadbc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00b3070 con 0x7fadd00c67e0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd01563f0 con 0x7fadd00c67e0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0153c10 con 0x7fadd00c67e0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0000c40 con 0x7fadd00c67e0 2024-05-08T20:46:46.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0005280 con 0x7fadd00c67e0 2024-05-08T20:46:46.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd00c7f10 con 0x7fadd00c67e0 2024-05-08T20:46:46.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadc00a9020 con 0x7fadd00c67e0 2024-05-08T20:46:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 0x7fadb4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.599+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fadc011d500 con 0x7fadd00c67e0 2024-05-08T20:46:46.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.603+0000 7fadd61f3640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 0x7fadb4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:46.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.603+0000 7fadd61f3640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 0x7fadb4068b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c10 tx=0x7fadcc001b30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:46.611+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fadc00ea5b0 con 0x7fadd00c67e0 2024-05-08T20:46:47.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.071+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fadd0074950 con 0x7fadd00c67e0 2024-05-08T20:46:47.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.071+0000 7fadc6ffd640 1 -- 172.21.15.81:0/3300522464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fadc00edbd0 con 0x7fadd00c67e0 2024-05-08T20:46:47.075 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:47.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 msgr2=0x7fadb4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:47.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 0x7fadb4068b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000c10 tx=0x7fadcc001b30 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 msgr2=0x7fadd00c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fadc001c240 tx=0x7fadbc005800 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 shutdown_connections 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fadb4066640 0x7fadb4068b00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadd014ad60 0x7fadd0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd00c67e0 0x7fadd00c6d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 --2- 172.21.15.81:0/3300522464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadbc0047d0 0x7fadd01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 >> 172.21.15.81:0/3300522464 conn(0x7fadd00c4cc0 msgr2=0x7fadd00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:47.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 shutdown_connections 2024-05-08T20:46:47.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:47.075+0000 7fadd8457640 1 -- 172.21.15.81:0/3300522464 wait complete. 2024-05-08T20:46:50.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 Processor -- start 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 -- start start 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc33806c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc33806f200 0x7fc3380a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33806afd0 con 0x7fc3380a9900 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3380728a0 con 0x7fc33806f200 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33e64b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33806b220 con 0x7fc33806cca0 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc337fff640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 msgr2=0x7fc33806c2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc337fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc33806c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33cbe8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3380a9900 0x7fc3381653c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54702/0 (socket says 172.21.15.81:54702) 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc33cbe8640 1 -- 172.21.15.81:0/2831411900 learned_addr learned my addr 172.21.15.81:0/2831411900 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736588619 0 0) 0x7fc33806afd0 con 0x7fc3380a9900 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.283+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc320003510 con 0x7fc3380a9900 2024-05-08T20:46:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.283+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635257114 0 0) 0x7fc320003510 con 0x7fc3380a9900 2024-05-08T20:46:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.283+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 msgr2=0x7fc33806c2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.283+0000 7fc336ffd640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc33806c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.283+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 >> v2:172.21.15.117:3300/0 conn(0x7fc33806f200 msgr2=0x7fc3380a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.275+0000 7fc3377fe640 1 --2- 172.21.15.81:0/2831411900 >> v2:172.21.15.117:3300/0 conn(0x7fc33806f200 0x7fc3380a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 --2- 172.21.15.81:0/2831411900 >> v2:172.21.15.117:3300/0 conn(0x7fc33806f200 0x7fc3380a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33806b500 con 0x7fc3380a9900 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc330001a00 con 0x7fc3380a9900 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 >> v1:172.21.15.81:6789/0 conn(0x7fc3380a9900 legacy=0x7fc3381653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc320004b70 0x7fc3200038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc320003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320004370 0x7fc32000f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380728a0 con 0x7fc320004b70 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33806b220 con 0x7fc320004370 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200100a0 con 0x7fc33806cca0 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc3377fe640 1 --2- 172.21.15.81:0/2831411900 >> v2:172.21.15.117:3300/0 conn(0x7fc33806f200 0x7fc3380a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc320004b70 0x7fc3200038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc3377fe640 1 -- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 msgr2=0x7fc320003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc3377fe640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc320003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc33cbe8640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320004370 0x7fc32000f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 -- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 msgr2=0x7fc320003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc33806cca0 0x7fc320003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 -- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320004370 msgr2=0x7fc32000f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320004370 0x7fc32000f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 -- 172.21.15.81:0/2831411900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320003510 con 0x7fc320004b70 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.287+0000 7fc337fff640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc320004b70 0x7fc3200038a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc32c003940 tx=0x7fc32c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b35ec65b5b09de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c003bc0 con 0x7fc320004b70 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0a7070 con 0x7fc320004b70 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc336ffd640 1 -- 172.21.15.81:0/2831411900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c005070 con 0x7fc320004b70 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- 172.21.15.81:0/2831411900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc320004b70 msgr2=0x7fc3200038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 --2- 172.21.15.81:0/2831411900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc320004b70 0x7fc3200038a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc32c003940 tx=0x7fc32c01c430 comp rx=0 tx=0).stop 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33cbe8640 1 -- 172.21.15.81:0/2831411900 reap_dead start 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- 172.21.15.81:0/2831411900 shutdown_connections 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- 172.21.15.81:0/2831411900 >> 172.21.15.81:0/2831411900 conn(0x7fc3380c2ca0 msgr2=0x7fc3380c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:50.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- 172.21.15.81:0/2831411900 shutdown_connections 2024-05-08T20:46:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- 172.21.15.81:0/2831411900 wait complete. 2024-05-08T20:46:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 Processor -- start 2024-05-08T20:46:50.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.291+0000 7fc33e64b640 1 -- start start 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33815e0a0 0x7fc33815e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 0x7fc33816a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338168a90 con 0x7fc33815e0a0 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3381fad60 con 0x7fc338071ac0 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc338168d30 con 0x7fc3381681f0 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc3377fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 msgr2=0x7fc33816a6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 0x7fc33816a6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54586/0 (socket says 172.21.15.81:54586) 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 -- 172.21.15.81:0/929257563 learned_addr learned my addr 172.21.15.81:0/929257563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:46:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc337fff640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33815e0a0 0x7fc33815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 -- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 msgr2=0x7fc33816a6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 0x7fc33816a6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 -- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33815e0a0 msgr2=0x7fc33815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33815e0a0 0x7fc33815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 -- 172.21.15.81:0/929257563 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338169010 con 0x7fc338071ac0 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33cbe8640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc330004bd0 tx=0x7fc330007c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000ab60 con 0x7fc338071ac0 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc338070050 con 0x7fc338071ac0 2024-05-08T20:46:50.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338070570 con 0x7fc338071ac0 2024-05-08T20:46:50.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33000acc0 con 0x7fc338071ac0 2024-05-08T20:46:50.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.295+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330013630 con 0x7fc338071ac0 2024-05-08T20:46:50.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc330013790 con 0x7fc338071ac0 2024-05-08T20:46:50.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc338070240 con 0x7fc338071ac0 2024-05-08T20:46:50.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc334ff9640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 0x7fc324068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:50.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc330084c20 con 0x7fc338071ac0 2024-05-08T20:46:50.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc337fff640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 0x7fc324068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:50.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.299+0000 7fc337fff640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 0x7fc324068b30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0aa000 tx=0x7fc32c005040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:46:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.307+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc330051be0 con 0x7fc338071ac0 2024-05-08T20:46:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc338074950 con 0x7fc338071ac0 2024-05-08T20:46:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc334ff9640 1 -- 172.21.15.81:0/929257563 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fc330017070 con 0x7fc338071ac0 2024-05-08T20:46:50.738 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:46:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 msgr2=0x7fc324068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 0x7fc324068b30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0aa000 tx=0x7fc32c005040 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 msgr2=0x7fc33816ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.735+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc330004bd0 tx=0x7fc330007c10 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 shutdown_connections 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc324066670 0x7fc324068b30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc338071ac0 0x7fc33816ac10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3381681f0 0x7fc33816a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 --2- 172.21.15.81:0/929257563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc33815e0a0 0x7fc33815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 >> 172.21.15.81:0/929257563 conn(0x7fc3380c2ca0 msgr2=0x7fc3380c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 shutdown_connections 2024-05-08T20:46:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:50.739+0000 7fc33e64b640 1 -- 172.21.15.81:0/929257563 wait complete. 2024-05-08T20:46:53.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:46:53.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.947+0000 7fc8d0922640 1 Processor -- start 2024-05-08T20:46:53.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.947+0000 7fc8d0922640 1 -- start start 2024-05-08T20:46:53.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8d0922640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8d0922640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc0706d0 con 0x7fc8cc156430 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8d0922640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc1598f0 con 0x7fc8cc0c31a0 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8d0922640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc158df0 con 0x7fc8cc15cdf0 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8cad9d640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 msgr2=0x7fc8cc071c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8cad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8ca59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc8cc156430 0x7fc8cc06d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54712/0 (socket says 172.21.15.81:54712) 2024-05-08T20:46:53.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:53.951+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 learned_addr learned my addr 172.21.15.81:0/2584815059 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:46:54.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:54.155+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 msgr2=0x7fc8cc071c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:54.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:54.155+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:46:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:54.559+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 msgr2=0x7fc8cc071c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:54.559+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:55.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:46:55.356 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:55.363+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 msgr2=0x7fc8cc071c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:55.363+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 msgr2=0x7fc8cc071c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc15cdf0 0x7fc8cc071c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 >> v1:172.21.15.117:6789/0 conn(0x7fc8cc0c31a0 legacy=0x7fc8cc071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 >> v1:172.21.15.81:6789/0 conn(0x7fc8cc156430 legacy=0x7fc8cc06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc158df0 con 0x7fc8ac0061f0 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac008d70 con 0x7fc8ac003720 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:56.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:57.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:57.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.155+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:57.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:57.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:57.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:57.559+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:46:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:46:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:58.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:58.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:58.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:58.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:58.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:58.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:58.363+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 msgr2=0x7fc8ac005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003720 0x7fc8ac005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 msgr2=0x7fc8ac0086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.81:3300/0 conn(0x7fc8ac0061f0 0x7fc8ac0086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 reap_dead start 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8ac00f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:46:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc159000 con 0x7fc8cc0c31a0 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc158df0 con 0x7fc8ac003b90 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8bbfff640 1 -- 172.21.15.81:0/2584815059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac008d70 con 0x7fc8ac00ce90 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8ac00f2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8ac00f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:46:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:46:59.951+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8ac00f2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8ac00f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.155+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8ac00f2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8ac00f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:00.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.559+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:47:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.839+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314654479 0 0) 0x7fc8cc159000 con 0x7fc8cc0c31a0 2024-05-08T20:47:00.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.839+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b4003530 con 0x7fc8cc0c31a0 2024-05-08T20:47:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840623631 0 0) 0x7fc8b4003530 con 0x7fc8cc0c31a0 2024-05-08T20:47:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8ac00f2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8ac00f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 msgr2=0x7fc8ac00c950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 --2- 172.21.15.81:0/2584815059 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac003b90 0x7fc8ac00c950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac010bb0 con 0x7fc8cc0c31a0 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc8bc0015b0 con 0x7fc8cc0c31a0 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 >> v1:172.21.15.117:6789/0 conn(0x7fc8cc0c31a0 legacy=0x7fc8ac00b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b4003980 0x7fc8b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b4004d10 0x7fc8b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc158df0 con 0x7fc8b4004d10 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac008d70 con 0x7fc8b4003980 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b400bbd0 con 0x7fc8ac00ce90 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8b40047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b4003980 0x7fc8b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8b40047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:00.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b4004d10 0x7fc8b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 msgr2=0x7fc8b40047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac00ce90 0x7fc8b40047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b4004d10 msgr2=0x7fc8b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b4004d10 0x7fc8b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8ca59c640 1 -- 172.21.15.81:0/2584815059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4003530 con 0x7fc8b4003980 2024-05-08T20:47:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.851+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8b4004d10 0x7fc8b4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:47:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b4003980 0x7fc8b4003da0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc000c10 tx=0x7fc8bc01d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e283218494123848 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:00.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0ae410 con 0x7fc8b4003980 2024-05-08T20:47:00.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0a8030 con 0x7fc8b4003980 2024-05-08T20:47:00.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8c959a640 1 -- 172.21.15.81:0/2584815059 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0ae5b0 con 0x7fc8b4003980 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 -- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b4003980 msgr2=0x7fc8b4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 --2- 172.21.15.81:0/2584815059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b4003980 0x7fc8b4003da0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc000c10 tx=0x7fc8bc01d430 comp rx=0 tx=0).stop 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8cad9d640 1 -- 172.21.15.81:0/2584815059 reap_dead start 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 -- 172.21.15.81:0/2584815059 shutdown_connections 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 -- 172.21.15.81:0/2584815059 >> 172.21.15.81:0/2584815059 conn(0x7fc8cc0c71b0 msgr2=0x7fc8cc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 -- 172.21.15.81:0/2584815059 shutdown_connections 2024-05-08T20:47:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.855+0000 7fc8d0922640 1 -- 172.21.15.81:0/2584815059 wait complete. 2024-05-08T20:47:00.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.859+0000 7fc8d0922640 1 Processor -- start 2024-05-08T20:47:00.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.859+0000 7fc8d0922640 1 -- start start 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 0x7fc8cc1efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 0x7fc8cc1f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0bd810 con 0x7fc8cc1f0030 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0bc300 con 0x7fc8cc15b6c0 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc15abe0 con 0x7fc8b4003980 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8cad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 0x7fc8cc1f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36466/0 (socket says 172.21.15.81:36466) 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/1963263058 learned_addr learned my addr 172.21.15.81:0/1963263058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:00.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8ca59c640 1 -- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 msgr2=0x7fc8cc1efaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 0x7fc8cc1efaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 msgr2=0x7fc8cc1efaf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 0x7fc8cc1efaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 msgr2=0x7fc8cc1f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 0x7fc8cc1f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 -- 172.21.15.81:0/1963263058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc15aec0 con 0x7fc8cc1f0030 2024-05-08T20:47:00.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8cad9d640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 0x7fc8cc1f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:47:00.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8c9d9b640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00156e0 tx=0x7fc8c0015ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:00.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00052e0 con 0x7fc8cc1f0030 2024-05-08T20:47:00.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc15b1a0 con 0x7fc8cc1f0030 2024-05-08T20:47:00.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.863+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc15be80 con 0x7fc8cc1f0030 2024-05-08T20:47:00.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0005440 con 0x7fc8cc1f0030 2024-05-08T20:47:00.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0001810 con 0x7fc8cc1f0030 2024-05-08T20:47:00.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b0005260 con 0x7fc8cc1f0030 2024-05-08T20:47:00.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8c0001970 con 0x7fc8cc1f0030 2024-05-08T20:47:00.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8baffd640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 0x7fc8ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:00.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc8c00852a0 con 0x7fc8cc1f0030 2024-05-08T20:47:00.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.867+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 0x7fc8ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.871+0000 7fc8ca59c640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 0x7fc8ac06d190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0000 tx=0x7fc8bc0011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:00.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:00.879+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc8c00523e0 con 0x7fc8cc1f0030 2024-05-08T20:47:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.255+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc8b00057e0 con 0x7fc8cc1f0030 2024-05-08T20:47:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.255+0000 7fc8baffd640 1 -- 172.21.15.81:0/1963263058 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fc8c0055a00 con 0x7fc8cc1f0030 2024-05-08T20:47:01.259 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 msgr2=0x7fc8ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 0x7fc8ac06d190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0000 tx=0x7fc8bc0011a0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 msgr2=0x7fc8cc14c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00156e0 tx=0x7fc8c0015ae0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 shutdown_connections 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc8ac06acd0 0x7fc8ac06d190 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc15b6c0 0x7fc8cc1f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8cc1f0030 0x7fc8cc14c7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 --2- 172.21.15.81:0/1963263058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b4003980 0x7fc8cc1efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 >> 172.21.15.81:0/1963263058 conn(0x7fc8cc0c71b0 msgr2=0x7fc8cc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 shutdown_connections 2024-05-08T20:47:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.259+0000 7fc8d0922640 1 -- 172.21.15.81:0/1963263058 wait complete. 2024-05-08T20:47:01.286 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:47:01.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:47:01.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.455+0000 7f718dd07640 1 Processor -- start 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.455+0000 7f718dd07640 1 -- start start 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718dd07640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f718000b500 0x7f71800dea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718dd07640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71800def90 0x7f71800e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718dd07640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718002e640 con 0x7f71800dc270 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718dd07640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7180046920 con 0x7f718000b500 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718dd07640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7180047f10 con 0x7f71800def90 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718d506640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71800def90 0x7f71800e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718cd05640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71800dc270 0x7f718003ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42760/0 (socket says 172.21.15.81:42760) 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718cd05640 1 -- 172.21.15.81:0/2638951313 learned_addr learned my addr 172.21.15.81:0/2638951313 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f71877fe640 1 -- 172.21.15.81:0/2638951313 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930137418 0 0) 0x7f718002e640 con 0x7f71800dc270 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f71877fe640 1 -- 172.21.15.81:0/2638951313 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7178003530 con 0x7f71800dc270 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718d506640 1 -- 172.21.15.81:0/2638951313 >> v2:172.21.15.81:3300/0 conn(0x7f718000b500 msgr2=0x7f71800dea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718d506640 1 --2- 172.21.15.81:0/2638951313 >> v2:172.21.15.81:3300/0 conn(0x7f718000b500 0x7f71800dea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718d506640 1 -- 172.21.15.81:0/2638951313 >> v1:172.21.15.81:6789/0 conn(0x7f71800dc270 legacy=0x7f718003ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.459+0000 7f718d506640 1 -- 172.21.15.81:0/2638951313 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800481b0 con 0x7f71800def90 2024-05-08T20:47:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718d506640 1 --2- 172.21.15.81:0/2638951313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800def90 0x7f71800e9180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7188063c00 tx=0x7f7188096e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cd9a3f015f8d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f71877fe640 1 -- 172.21.15.81:0/2638951313 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718811fc30 con 0x7f71800def90 2024-05-08T20:47:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f71877fe640 1 -- 172.21.15.81:0/2638951313 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718811fdd0 con 0x7f71800def90 2024-05-08T20:47:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f71877fe640 1 -- 172.21.15.81:0/2638951313 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188127640 con 0x7f71800def90 2024-05-08T20:47:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 -- 172.21.15.81:0/2638951313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800def90 msgr2=0x7f71800e9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 --2- 172.21.15.81:0/2638951313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800def90 0x7f71800e9180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7188063c00 tx=0x7f7188096e00 comp rx=0 tx=0).stop 2024-05-08T20:47:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 -- 172.21.15.81:0/2638951313 shutdown_connections 2024-05-08T20:47:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 --2- 172.21.15.81:0/2638951313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800def90 0x7f71800e9180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 --2- 172.21.15.81:0/2638951313 >> v2:172.21.15.81:3300/0 conn(0x7f718000b500 0x7f71800dea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.463+0000 7f718dd07640 1 -- 172.21.15.81:0/2638951313 >> 172.21.15.81:0/2638951313 conn(0x7f71800062c0 msgr2=0x7f71800066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- 172.21.15.81:0/2638951313 shutdown_connections 2024-05-08T20:47:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- 172.21.15.81:0/2638951313 wait complete. 2024-05-08T20:47:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 Processor -- start 2024-05-08T20:47:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- start start 2024-05-08T20:47:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800dc270 0x7f71800d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71800def90 0x7f71800d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718003fc00 con 0x7f718000b500 2024-05-08T20:47:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718003f6d0 con 0x7f71800dc270 2024-05-08T20:47:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718dd07640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7180030660 con 0x7f71800def90 2024-05-08T20:47:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718d506640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71800def90 msgr2=0x7f71800d62d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.467+0000 7f718d506640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71800def90 0x7f71800d62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36480/0 (socket says 172.21.15.81:36480) 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 -- 172.21.15.81:0/201702352 learned_addr learned my addr 172.21.15.81:0/201702352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71800def90 msgr2=0x7f71800d62d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71800def90 0x7f71800d62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800dc270 msgr2=0x7f71800d5d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:47:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71800dc270 0x7f71800d5d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188072040 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718cd05640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c3c0 tx=0x7f717c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c005cf0 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c005e50 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718003f920 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0072f0 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7180040210 con 0x7f718000b500 2024-05-08T20:47:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718dd07640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 0x7f7180040730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7180008ce0 con 0x7f718017adc0 2024-05-08T20:47:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f717c007450 con 0x7f718000b500 2024-05-08T20:47:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f71857fa640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f716c066640 0x7f716c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.471+0000 7f7187fff640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 0x7f7180040730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f717c083a70 con 0x7f718000b500 2024-05-08T20:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f718d506640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f716c066640 0x7f716c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f7187fff640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7180007910 con 0x7f718017adc0 2024-05-08T20:47:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f718d506640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f716c066640 0x7f716c068b00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7180048050 tx=0x7f7188123000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f7187fff640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 0x7f7180040730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7180031760 tx=0x7f717400b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174011830 con 0x7f718017adc0 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7174011990 con 0x7f718017adc0 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 msgr2=0x7f7180040730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 0x7f7180040730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7180031760 tx=0x7f717400b7a0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 msgr2=0x7f7180040730 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.475+0000 7f71857fa640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718017adc0 0x7f7180040730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f718dd07640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 0x7f7180040c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800057c0 con 0x7f71800e8ed0 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f7187fff640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 0x7f7180040c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f7187fff640 1 -- 172.21.15.81:0/201702352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f718002cb10 con 0x7f71800e8ed0 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f7187fff640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 0x7f7180040c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71800d9a70 tx=0x7f7174004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.487+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174025680 con 0x7f71800e8ed0 2024-05-08T20:47:01.493 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 150, 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:01.494 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:01.496 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.497 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:01.498 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:01.499 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.501 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:01.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:01.505 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4797 (secure 0 0 0) 0x7f717401c2e0 con 0x7f71800e8ed0 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 msgr2=0x7f7180040c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f71857fa640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 0x7f7180040c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71800d9a70 tx=0x7f7174004740 comp rx=0 tx=0).stop 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f71857fa640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 msgr2=0x7f7180040c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f71857fa640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71800e8ed0 0x7f7180040c70 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71800d9a70 tx=0x7f7174004740 comp rx=0 tx=0).stop 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f716c066640 msgr2=0x7f716c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f716c066640 0x7f716c068b00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7180048050 tx=0x7f7188123000 comp rx=0 tx=0).stop 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 msgr2=0x7f718017a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c3c0 tx=0x7f717c00c880 comp rx=0 tx=0).stop 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718d506640 1 -- 172.21.15.81:0/201702352 reap_dead start 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 shutdown_connections 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 --2- 172.21.15.81:0/201702352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f718000b500 0x7f718017a880 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.491+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 >> 172.21.15.81:0/201702352 conn(0x7f71800062c0 msgr2=0x7f718002c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.495+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 shutdown_connections 2024-05-08T20:47:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.495+0000 7f718dd07640 1 -- 172.21.15.81:0/201702352 wait complete. 2024-05-08T20:47:01.542 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:47:01.542 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:47:01.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:47:01.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 Processor -- start 2024-05-08T20:47:01.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 -- start start 2024-05-08T20:47:01.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd8c0c3350 0x7fbd8c0c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd8c0c6000 0x7fbd8c15c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c066000 con 0x7fbd8c15c890 2024-05-08T20:47:01.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c06d8a0 con 0x7fbd8c0c3350 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd9287e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8c1567d0 con 0x7fbd8c0c6000 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd8bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd8c0c3350 0x7fbd8c0c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd90e1b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd8c15c890 0x7fbd8c0c47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42766/0 (socket says 172.21.15.81:42766) 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd90e1b640 1 -- 172.21.15.81:0/3833924559 learned_addr learned my addr 172.21.15.81:0/3833924559 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/3833924559 >> v2:172.21.15.81:3300/0 conn(0x7fbd8c0c3350 0x7fbd8c0c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36506/0 (socket says 172.21.15.81:36506) 2024-05-08T20:47:01.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.719+0000 7fbd8b7fe640 1 --2- 172.21.15.81:0/3833924559 >> v2:172.21.15.117:3300/0 conn(0x7fbd8c0c6000 0x7fbd8c15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8affd640 1 -- 172.21.15.81:0/3833924559 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391134752 0 0) 0x7fbd8c066000 con 0x7fbd8c15c890 2024-05-08T20:47:01.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8affd640 1 -- 172.21.15.81:0/3833924559 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd74003530 con 0x7fbd8c15c890 2024-05-08T20:47:01.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8bfff640 1 -- 172.21.15.81:0/3833924559 >> v2:172.21.15.117:3300/0 conn(0x7fbd8c0c6000 msgr2=0x7fbd8c15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:01.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/3833924559 >> v2:172.21.15.117:3300/0 conn(0x7fbd8c0c6000 0x7fbd8c15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8bfff640 1 -- 172.21.15.81:0/3833924559 >> v1:172.21.15.81:6789/0 conn(0x7fbd8c15c890 legacy=0x7fbd8c0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.727+0000 7fbd8bfff640 1 -- 172.21.15.81:0/3833924559 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c06cb20 con 0x7fbd8c0c3350 2024-05-08T20:47:01.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/3833924559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0c3350 0x7fbd8c0c3730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0c2410 tx=0x7fbd7c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533f39176a7ee348 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd8affd640 1 -- 172.21.15.81:0/3833924559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84001a00 con 0x7fbd8c0c3350 2024-05-08T20:47:01.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd8affd640 1 -- 172.21.15.81:0/3833924559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c0a7050 con 0x7fbd8c0c3350 2024-05-08T20:47:01.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd8affd640 1 -- 172.21.15.81:0/3833924559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c0ab620 con 0x7fbd8c0c3350 2024-05-08T20:47:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 -- 172.21.15.81:0/3833924559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0c3350 msgr2=0x7fbd8c0c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 --2- 172.21.15.81:0/3833924559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0c3350 0x7fbd8c0c3730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0c2410 tx=0x7fbd7c01c490 comp rx=0 tx=0).stop 2024-05-08T20:47:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 -- 172.21.15.81:0/3833924559 shutdown_connections 2024-05-08T20:47:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 --2- 172.21.15.81:0/3833924559 >> v2:172.21.15.117:3300/0 conn(0x7fbd8c0c6000 0x7fbd8c15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 --2- 172.21.15.81:0/3833924559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c0c3350 0x7fbd8c0c3730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 -- 172.21.15.81:0/3833924559 >> 172.21.15.81:0/3833924559 conn(0x7fbd8c0c68c0 msgr2=0x7fbd8c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 -- 172.21.15.81:0/3833924559 shutdown_connections 2024-05-08T20:47:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.731+0000 7fbd9287e640 1 -- 172.21.15.81:0/3833924559 wait complete. 2024-05-08T20:47:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 Processor -- start 2024-05-08T20:47:01.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- start start 2024-05-08T20:47:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd8c0c6000 0x7fbd8c0a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 0x7fbd8c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd8c1496f0 0x7fbd8c1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c159d30 con 0x7fbd8c15c890 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c15c120 con 0x7fbd8c0c6000 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c0ab750 con 0x7fbd8c1496f0 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd90e1b640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd8c1496f0 msgr2=0x7fbd8c1f4f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd90e1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd8c1496f0 0x7fbd8c1f4f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 0x7fbd8c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 0x7fbd8c1491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36510/0 (socket says 172.21.15.81:36510) 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 -- 172.21.15.81:0/2926992594 learned_addr learned my addr 172.21.15.81:0/2926992594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd8c0c6000 0x7fbd8c0a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd8c1496f0 msgr2=0x7fbd8c1f4f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd8c1496f0 0x7fbd8c1f4f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd8c0c6000 msgr2=0x7fbd8c0a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd8c0c6000 0x7fbd8c0a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c009420 con 0x7fbd8c15c890 2024-05-08T20:47:01.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8b7fe640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 0x7fbd8c1491b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000d830 tx=0x7fbd8000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000b6c0 con 0x7fbd8c15c890 2024-05-08T20:47:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8000b820 con 0x7fbd8c15c890 2024-05-08T20:47:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c0aa210 con 0x7fbd8c15c890 2024-05-08T20:47:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000bb90 con 0x7fbd8c15c890 2024-05-08T20:47:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd9287e640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c14a3e0 con 0x7fbd8c15c890 2024-05-08T20:47:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd8000bcf0 con 0x7fbd8c15c890 2024-05-08T20:47:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd727fc640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 0x7fbd64004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64007e90 con 0x7fbd64002a40 2024-05-08T20:47:01.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.735+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 0x7fbd64004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd78066640 0x7fbd78068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd90e1b640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd78066640 0x7fbd78068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd8bfff640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd64008050 con 0x7fbd64002a40 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbd80084520 con 0x7fbd8c15c890 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 0x7fbd64004f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0c0c00 tx=0x7fbd7c019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd90e1b640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd78066640 0x7fbd78068b00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd84002240 tx=0x7fbd84001950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003820 con 0x7fbd64002a40 2024-05-08T20:47:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbd7c003980 con 0x7fbd64002a40 2024-05-08T20:47:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 msgr2=0x7fbd64004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 0x7fbd64004f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0c0c00 tx=0x7fbd7c019230 comp rx=0 tx=0).stop 2024-05-08T20:47:01.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 msgr2=0x7fbd64004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:01.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.739+0000 7fbd88ff9640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64002a40 0x7fbd64004f00 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0c0c00 tx=0x7fbd7c019230 comp rx=0 tx=0).stop 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd727fc640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 0x7fbd640073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6400a350 con 0x7fbd64006f70 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 0x7fbd640073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd8bfff640 1 -- 172.21.15.81:0/2926992594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbd6400a510 con 0x7fbd64006f70 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd8bfff640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 0x7fbd640073e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0ae040 tx=0x7fbd7c009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.751+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c0c2dd0 con 0x7fbd64006f70 2024-05-08T20:47:01.758 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:47:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 150, 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:01.770 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7fbd7c0b5440 con 0x7fbd64006f70 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 msgr2=0x7fbd640073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd88ff9640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 0x7fbd640073e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0ae040 tx=0x7fbd7c009190 comp rx=0 tx=0).stop 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd88ff9640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 msgr2=0x7fbd640073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd88ff9640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd64006f70 0x7fbd640073e0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0ae040 tx=0x7fbd7c009190 comp rx=0 tx=0).stop 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd78066640 msgr2=0x7fbd78068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbd78066640 0x7fbd78068b00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd84002240 tx=0x7fbd84001950 comp rx=0 tx=0).stop 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 msgr2=0x7fbd8c1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 --2- 172.21.15.81:0/2926992594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8c15c890 0x7fbd8c1491b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000d830 tx=0x7fbd8000dcf0 comp rx=0 tx=0).stop 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd90e1b640 1 -- 172.21.15.81:0/2926992594 reap_dead start 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd90e1b640 1 -- 172.21.15.81:0/2926992594 reap_dead start 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 shutdown_connections 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 >> 172.21.15.81:0/2926992594 conn(0x7fbd8c0c68c0 msgr2=0x7fbd8c159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 shutdown_connections 2024-05-08T20:47:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:01.755+0000 7fbd727fc640 1 -- 172.21.15.81:0/2926992594 wait complete. 2024-05-08T20:47:01.794 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:47:01.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:47:21.796 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:47:21.796 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:47:21.796 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:47:21.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:47:21.799 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:47:21.799 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:47:21.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 Processor -- start 2024-05-08T20:47:21.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 -- start start 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d1c047220 0x7f4d1c04ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c0d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0d76a0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c0476b0 con 0x7f4d1c047220 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d2a44d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c047990 con 0x7f4d1c0db120 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d29c4c640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 msgr2=0x7f4d1c0d7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d29c4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c0d7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d1c047220 0x7f4d1c04ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d1c047220 0x7f4d1c04ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:47138/0 (socket says 172.21.15.81:47138) 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 -- 172.21.15.81:0/2287660657 learned_addr learned my addr 172.21.15.81:0/2287660657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 -- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 msgr2=0x7f4d1c0d7b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 --2- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c0d7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 -- 172.21.15.81:0/2287660657 >> v1:172.21.15.117:6789/0 conn(0x7f4d1c04a9c0 legacy=0x7f4d1c007ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.955+0000 7f4d28c4a640 1 -- 172.21.15.81:0/2287660657 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c047c70 con 0x7f4d1c047220 2024-05-08T20:47:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d28c4a640 1 --2- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c047220 0x7f4d1c04ada0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009870 tx=0x7f4d1401e6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41890797107fc078 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d1bfff640 1 -- 172.21.15.81:0/2287660657 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d140ab680 con 0x7f4d1c047220 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d1bfff640 1 -- 172.21.15.81:0/2287660657 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d140ab7e0 con 0x7f4d1c047220 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d1bfff640 1 -- 172.21.15.81:0/2287660657 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d140abb70 con 0x7f4d1c047220 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 -- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c047220 msgr2=0x7f4d1c04ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 --2- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c047220 0x7f4d1c04ada0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009870 tx=0x7f4d1401e6b0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 -- 172.21.15.81:0/2287660657 shutdown_connections 2024-05-08T20:47:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 --2- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c0d7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 --2- 172.21.15.81:0/2287660657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c047220 0x7f4d1c04ada0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 -- 172.21.15.81:0/2287660657 >> 172.21.15.81:0/2287660657 conn(0x7f4d1c049320 msgr2=0x7f4d1c049730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.959+0000 7f4d2a44d640 1 -- 172.21.15.81:0/2287660657 shutdown_connections 2024-05-08T20:47:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 -- 172.21.15.81:0/2287660657 wait complete. 2024-05-08T20:47:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 Processor -- start 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 -- start start 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c045fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c043970 0x7f4d1c0d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c044840 con 0x7f4d1c043970 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0458c0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2a44d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c044280 con 0x7f4d1c0db120 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2944b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2944b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:47140/0 (socket says 172.21.15.81:47140) 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d2944b640 1 -- 172.21.15.81:0/3234021063 learned_addr learned my addr 172.21.15.81:0/3234021063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.963+0000 7f4d29c4c640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c043970 0x7f4d1c0d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d28c4a640 1 -- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 msgr2=0x7f4d1c045fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d28c4a640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c045fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 -- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 msgr2=0x7f4d1c045fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c045fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 -- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c043970 msgr2=0x7f4d1c0d94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c043970 0x7f4d1c0d94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 -- 172.21.15.81:0/3234021063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d140094d0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2944b640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c500 tx=0x7f4d2000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20005220 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2a44d640 1 -- 172.21.15.81:0/3234021063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0d4bd0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20005380 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20007270 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2a44d640 1 -- 172.21.15.81:0/3234021063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0da4b0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.967+0000 7f4d2a44d640 1 -- 172.21.15.81:0/3234021063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d04005260 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.971+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d200073d0 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.971+0000 7f4d19ffb640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 0x7f4d08068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.971+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4d20084b50 con 0x7f4d1c04a9c0 2024-05-08T20:47:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.971+0000 7f4d28c4a640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 0x7f4d08068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.971+0000 7f4d28c4a640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 0x7f4d08068b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d140b0000 tx=0x7f4d14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:21.975+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4d20051b10 con 0x7f4d1c04a9c0 2024-05-08T20:47:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.387+0000 7f4d2a44d640 1 -- 172.21.15.81:0/3234021063 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4d040057e0 con 0x7f4d1c04a9c0 2024-05-08T20:47:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.387+0000 7f4d19ffb640 1 -- 172.21.15.81:0/3234021063 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f4d20055130 con 0x7f4d1c04a9c0 2024-05-08T20:47:22.391 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 msgr2=0x7f4d08068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 0x7f4d08068b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d140b0000 tx=0x7f4d14008040 comp rx=0 tx=0).stop 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 msgr2=0x7f4d1c02bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c500 tx=0x7f4d2000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 shutdown_connections 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4d08066640 0x7f4d08068b00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c043970 0x7f4d1c0d94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0db120 0x7f4d1c045fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 --2- 172.21.15.81:0/3234021063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c04a9c0 0x7f4d1c02bfa0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c500 tx=0x7f4d2000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:47:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 >> 172.21.15.81:0/3234021063 conn(0x7f4d1c049320 msgr2=0x7f4d1c0e0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 shutdown_connections 2024-05-08T20:47:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:22.391+0000 7f4d0f7fe640 1 -- 172.21.15.81:0/3234021063 wait complete. 2024-05-08T20:47:25.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:25.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 Processor -- start 2024-05-08T20:47:25.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 -- start start 2024-05-08T20:47:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d4804b500 0x7f2d480e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480db1b0 con 0x7f2d48008440 2024-05-08T20:47:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480090a0 con 0x7f2d48006a70 2024-05-08T20:47:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d56ab9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d48009380 con 0x7f2d4804b500 2024-05-08T20:47:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d4804b500 0x7f2d480e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d4804b500 0x7f2d480e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58662/0 (socket says 172.21.15.81:58662) 2024-05-08T20:47:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 -- 172.21.15.81:0/1321958785 learned_addr learned my addr 172.21.15.81:0/1321958785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 -- 172.21.15.81:0/1321958785 >> v1:172.21.15.117:6789/0 conn(0x7f2d48006a70 legacy=0x7f2d4804adf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 -- 172.21.15.81:0/1321958785 >> v1:172.21.15.81:6789/0 conn(0x7f2d48008440 legacy=0x7f2d48008820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.590+0000 7f2d562b8640 1 -- 172.21.15.81:0/1321958785 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480daed0 con 0x7f2d4804b500 2024-05-08T20:47:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d562b8640 1 --2- 172.21.15.81:0/1321958785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4804b500 0x7f2d480e5c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d5002c980 tx=0x7f2d50096e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ef78562fcf8d8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d54ab5640 1 -- 172.21.15.81:0/1321958785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5011fc60 con 0x7f2d4804b500 2024-05-08T20:47:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d54ab5640 1 -- 172.21.15.81:0/1321958785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5011fdc0 con 0x7f2d4804b500 2024-05-08T20:47:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d54ab5640 1 -- 172.21.15.81:0/1321958785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50127640 con 0x7f2d4804b500 2024-05-08T20:47:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 -- 172.21.15.81:0/1321958785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4804b500 msgr2=0x7f2d480e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/1321958785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4804b500 0x7f2d480e5c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d5002c980 tx=0x7f2d50096e20 comp rx=0 tx=0).stop 2024-05-08T20:47:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 -- 172.21.15.81:0/1321958785 shutdown_connections 2024-05-08T20:47:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/1321958785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4804b500 0x7f2d480e5c40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 -- 172.21.15.81:0/1321958785 >> 172.21.15.81:0/1321958785 conn(0x7f2d48049320 msgr2=0x7f2d48049730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 -- 172.21.15.81:0/1321958785 shutdown_connections 2024-05-08T20:47:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.594+0000 7f2d56ab9640 1 -- 172.21.15.81:0/1321958785 wait complete. 2024-05-08T20:47:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 Processor -- start 2024-05-08T20:47:25.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- start start 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d48006a70 0x7f2d480d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 0x7f2d480db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480443c0 con 0x7f2d48008440 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480de070 con 0x7f2d4804b500 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48045510 con 0x7f2d48006a70 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d562b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d562b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:47152/0 (socket says 172.21.15.81:47152) 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d562b8640 1 -- 172.21.15.81:0/241433935 learned_addr learned my addr 172.21.15.81:0/241433935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 0x7f2d480db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 -- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d48006a70 msgr2=0x7f2d480d61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d48006a70 0x7f2d480d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 -- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 msgr2=0x7f2d480dba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 -- 172.21.15.81:0/241433935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50072040 con 0x7f2d48008440 2024-05-08T20:47:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d562b8640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d552b6640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 0x7f2d480db4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b440 tx=0x7f2d4000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011830 con 0x7f2d48008440 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d400119b0 con 0x7f2d48008440 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011d60 con 0x7f2d48008440 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d48043e00 con 0x7f2d48008440 2024-05-08T20:47:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.598+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d480ddd00 con 0x7f2d48008440 2024-05-08T20:47:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.602+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d480057c0 con 0x7f2d48008440 2024-05-08T20:47:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.606+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d4001a400 con 0x7f2d48008440 2024-05-08T20:47:25.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.606+0000 7f2d467fc640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 0x7f2d34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.606+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2d40084510 con 0x7f2d48008440 2024-05-08T20:47:25.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.606+0000 7f2d55ab7640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 0x7f2d34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:25.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.606+0000 7f2d55ab7640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 0x7f2d34068c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c000f70 tx=0x7f2d4c0079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:25.610+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2d40051550 con 0x7f2d48008440 2024-05-08T20:47:25.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:47:25.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:47:26.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.086+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2d48049f80 con 0x7f2d48008440 2024-05-08T20:47:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.086+0000 7f2d467fc640 1 -- 172.21.15.81:0/241433935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f2d40015620 con 0x7f2d48008440 2024-05-08T20:47:26.091 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:26.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 msgr2=0x7f2d34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:26.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 0x7f2d34068c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c000f70 tx=0x7f2d4c0079c0 comp rx=0 tx=0).stop 2024-05-08T20:47:26.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 msgr2=0x7f2d480db4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:26.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 0x7f2d480db4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b440 tx=0x7f2d4000b900 comp rx=0 tx=0).stop 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 shutdown_connections 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d34066760 0x7f2d34068c20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d4804b500 0x7f2d480dba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d48008440 0x7f2d480db4c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 --2- 172.21.15.81:0/241433935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d48006a70 0x7f2d480d61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 >> 172.21.15.81:0/241433935 conn(0x7f2d48049320 msgr2=0x7f2d4804adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 shutdown_connections 2024-05-08T20:47:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:26.090+0000 7f2d56ab9640 1 -- 172.21.15.81:0/241433935 wait complete. 2024-05-08T20:47:29.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:29.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 Processor -- start 2024-05-08T20:47:29.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 -- start start 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf00c3a50 con 0x7fdaf01519d0 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf00705e0 con 0x7fdaf006b230 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf7b9b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf0072940 con 0x7fdaf0070c00 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf6138640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdaf01519d0 0x7fdaf0151e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48526/0 (socket says 172.21.15.81:48526) 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf6138640 1 -- 172.21.15.81:0/3141336345 learned_addr learned my addr 172.21.15.81:0/3141336345 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.282+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.286+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:47:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.286+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.286+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.286+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.490+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.490+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.490+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.490+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.490+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:47:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.894+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.894+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:47:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.894+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.894+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:29.894+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:47:30.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:30.698+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:30.698+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:47:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:30.698+0000 7fdaf5136640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:30.698+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:30.698+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:47:31.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.898+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222153804 0 0) 0x7fdaf00c3a50 con 0x7fdaf01519d0 2024-05-08T20:47:31.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.898+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdadc003530 con 0x7fdaf01519d0 2024-05-08T20:47:31.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3425169188 0 0) 0x7fdadc003530 con 0x7fdaf01519d0 2024-05-08T20:47:31.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 msgr2=0x7fdaf00c2800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 --2- 172.21.15.81:0/3141336345 >> v2:172.21.15.117:3300/0 conn(0x7fdaf0070c00 0x7fdaf00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 >> v1:172.21.15.117:6789/0 conn(0x7fdaf006b230 legacy=0x7fdaf014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00708c0 con 0x7fdaf01519d0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fdae8001930 con 0x7fdaf01519d0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 >> v1:172.21.15.81:6789/0 conn(0x7fdaf01519d0 legacy=0x7fdaf0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 0x7fdadc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdadc0047d0 0x7fdadc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0052b0 0x7fdadc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0072940 con 0x7fdadc0039d0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00c1d0 con 0x7fdadc0052b0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc00c390 con 0x7fdadc0047d0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 0x7fdadc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf6138640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0052b0 0x7fdadc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5136640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdadc0047d0 0x7fdadc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 -- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdadc0047d0 msgr2=0x7fdadc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdadc0047d0 0x7fdadc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 -- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0052b0 msgr2=0x7fdadc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0052b0 0x7fdadc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf6138640 1 -- 172.21.15.81:0/3141336345 reap_dead start 2024-05-08T20:47:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.902+0000 7fdaf5937640 1 -- 172.21.15.81:0/3141336345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc003530 con 0x7fdadc0039d0 2024-05-08T20:47:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf5937640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 0x7fdadc003df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdae4001360 tx=0x7fdae403e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b91a3609eb44b62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40052d0 con 0x7fdadc0039d0 2024-05-08T20:47:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40c9050 con 0x7fdadc0039d0 2024-05-08T20:47:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf4935640 1 -- 172.21.15.81:0/3141336345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4003840 con 0x7fdadc0039d0 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 msgr2=0x7fdadc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 0x7fdadc003df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdae4001360 tx=0x7fdae403e410 comp rx=0 tx=0).stop 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/3141336345 shutdown_connections 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 --2- 172.21.15.81:0/3141336345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdadc0039d0 0x7fdadc003df0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/3141336345 >> 172.21.15.81:0/3141336345 conn(0x7fdaf00c71b0 msgr2=0x7fdaf00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/3141336345 shutdown_connections 2024-05-08T20:47:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.906+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/3141336345 wait complete. 2024-05-08T20:47:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 Processor -- start 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 -- start start 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 0x7fdaf0147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 0x7fdaf0148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf01ec900 0x7fdaf01ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0148580 con 0x7fdaf00aa4d0 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00aba10 con 0x7fdadc0039d0 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf7b9b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf01552f0 con 0x7fdaf01ec900 2024-05-08T20:47:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5136640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 0x7fdaf0148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf6138640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf01ec900 0x7fdaf01ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5136640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 0x7fdaf0148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46314/0 (socket says 172.21.15.81:46314) 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5136640 1 -- 172.21.15.81:0/1664373945 learned_addr learned my addr 172.21.15.81:0/1664373945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 0x7fdaf0147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 -- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf01ec900 msgr2=0x7fdaf01ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf01ec900 0x7fdaf01ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 -- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 msgr2=0x7fdaf0148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 0x7fdaf0148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 -- 172.21.15.81:0/1664373945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0155a60 con 0x7fdadc0039d0 2024-05-08T20:47:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.910+0000 7fdaf5937640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 0x7fdaf0147b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdae4007fd0 tx=0x7fdadc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.922+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40072f0 con 0x7fdadc0039d0 2024-05-08T20:47:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.922+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4007450 con 0x7fdadc0039d0 2024-05-08T20:47:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.922+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40067e0 con 0x7fdadc0039d0 2024-05-08T20:47:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.922+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/1664373945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf00abc10 con 0x7fdadc0039d0 2024-05-08T20:47:31.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.922+0000 7fdaf7b9b640 1 -- 172.21.15.81:0/1664373945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00ace20 con 0x7fdadc0039d0 2024-05-08T20:47:31.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.926+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf00675e0 con 0x7fdadc0039d0 2024-05-08T20:47:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.930+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdae4006940 con 0x7fdadc0039d0 2024-05-08T20:47:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.930+0000 7fdae27fc640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 0x7fdad4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.930+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fdae4140bf0 con 0x7fdadc0039d0 2024-05-08T20:47:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.930+0000 7fdaf5136640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 0x7fdad4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.930+0000 7fdaf5136640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 0x7fdad4068bd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0154d70 tx=0x7fdaec014040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:31.934+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fdae410de50 con 0x7fdadc0039d0 2024-05-08T20:47:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.362+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdaf0074950 con 0x7fdadc0039d0 2024-05-08T20:47:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.362+0000 7fdae27fc640 1 -- 172.21.15.81:0/1664373945 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fdae4111470 con 0x7fdadc0039d0 2024-05-08T20:47:32.366 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":154,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 msgr2=0x7fdad4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 0x7fdad4068bd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0154d70 tx=0x7fdaec014040 comp rx=0 tx=0).stop 2024-05-08T20:47:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 msgr2=0x7fdaf0147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 0x7fdaf0147b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdae4007fd0 tx=0x7fdadc005800 comp rx=0 tx=0).stop 2024-05-08T20:47:32.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 shutdown_connections 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdad4066710 0x7fdad4068bd0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdaf01ec900 0x7fdaf01ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf00aa4d0 0x7fdaf0148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 --2- 172.21.15.81:0/1664373945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdadc0039d0 0x7fdaf0147b00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 >> 172.21.15.81:0/1664373945 conn(0x7fdaf00c71b0 msgr2=0x7fdaf0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 shutdown_connections 2024-05-08T20:47:32.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:32.366+0000 7fdad3fff640 1 -- 172.21.15.81:0/1664373945 wait complete. 2024-05-08T20:47:35.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 Processor -- start 2024-05-08T20:47:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 -- start start 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff658155070 0x7ff6580c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65814e830 con 0x7ff6580c6410 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65806d6a0 con 0x7ff658155070 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65ce03640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff658151900 con 0x7ff65806b840 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff658155070 0x7ff6580c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff658155070 0x7ff6580c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39002/0 (socket says 172.21.15.81:39002) 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff65659c640 1 -- 172.21.15.81:0/2613004961 learned_addr learned my addr 172.21.15.81:0/2613004961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff656d9d640 1 -- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 msgr2=0x7ff65815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff656d9d640 1 -- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 msgr2=0x7ff65815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.566+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65559a640 1 -- 172.21.15.81:0/2613004961 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528130377 0 0) 0x7ff648001120 con 0x7ff6580c6410 2024-05-08T20:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65559a640 1 -- 172.21.15.81:0/2613004961 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff640005740 con 0x7ff6580c6410 2024-05-08T20:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65659c640 1 -- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 msgr2=0x7ff65815b6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65659c640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65659c640 1 -- 172.21.15.81:0/2613004961 >> v1:172.21.15.117:6789/0 conn(0x7ff6580c6410 legacy=0x7ff6580c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65659c640 1 -- 172.21.15.81:0/2613004961 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658151be0 con 0x7ff658155070 2024-05-08T20:47:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.570+0000 7ff65659c640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658155070 0x7ff6580c5ed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009870 tx=0x7ff64c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b056cd476448d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65559a640 1 -- 172.21.15.81:0/2613004961 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0ac410 con 0x7ff658155070 2024-05-08T20:47:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65559a640 1 -- 172.21.15.81:0/2613004961 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c0ac570 con 0x7ff658155070 2024-05-08T20:47:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65559a640 1 -- 172.21.15.81:0/2613004961 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0ac900 con 0x7ff658155070 2024-05-08T20:47:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65ce03640 1 -- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658155070 msgr2=0x7ff6580c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65ce03640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658155070 0x7ff6580c5ed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009870 tx=0x7ff64c01c560 comp rx=0 tx=0).stop 2024-05-08T20:47:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65ce03640 1 -- 172.21.15.81:0/2613004961 shutdown_connections 2024-05-08T20:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.574+0000 7ff65ce03640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff65806b840 0x7ff65815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 --2- 172.21.15.81:0/2613004961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff658155070 0x7ff6580c5ed0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 -- 172.21.15.81:0/2613004961 >> 172.21.15.81:0/2613004961 conn(0x7ff6580c68c0 msgr2=0x7ff6580c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 -- 172.21.15.81:0/2613004961 shutdown_connections 2024-05-08T20:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 -- 172.21.15.81:0/2613004961 wait complete. 2024-05-08T20:47:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 Processor -- start 2024-05-08T20:47:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.578+0000 7ff65ce03640 1 -- start start 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 0x7ff6580c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6580c6410 0x7ff65814aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 0x7ff6580c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 0x7ff6580c0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39014/0 (socket says 172.21.15.81:39014) 2024-05-08T20:47:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46328/0 (socket says 172.21.15.81:46328) 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65659c640 1 -- 172.21.15.81:0/2452354798 learned_addr learned my addr 172.21.15.81:0/2452354798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814b4a0 con 0x7ff658155070 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580a93a0 con 0x7ff65806b840 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580bc120 con 0x7ff6580c6410 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff655d9b640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6580c6410 0x7ff65814aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 -- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6580c6410 msgr2=0x7ff65814aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6580c6410 0x7ff65814aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 -- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 msgr2=0x7ff6580c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 0x7ff6580c0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c0094d0 con 0x7ff658155070 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff656d9d640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff650007a30 tx=0x7ff65000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000dda0 con 0x7ff658155070 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650012540 con 0x7ff658155070 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500128f0 con 0x7ff658155070 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.582+0000 7ff65ce03640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6581ed830 con 0x7ff658155070 2024-05-08T20:47:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.586+0000 7ff65ce03640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6581ecd50 con 0x7ff658155070 2024-05-08T20:47:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.586+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff658074950 con 0x7ff658155070 2024-05-08T20:47:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.586+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff650012a50 con 0x7ff658155070 2024-05-08T20:47:35.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.586+0000 7ff646ffd640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 0x7ff638068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:35.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.590+0000 7ff65659c640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 0x7ff638068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:35.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.590+0000 7ff65659c640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 0x7ff638068bd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009870 tx=0x7ff64c0a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:35.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.594+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff650059c80 con 0x7ff658155070 2024-05-08T20:47:35.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:35.594+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff6500558c0 con 0x7ff658155070 2024-05-08T20:47:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.042+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff6580c5cb0 con 0x7ff658155070 2024-05-08T20:47:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.042+0000 7ff646ffd640 1 -- 172.21.15.81:0/2452354798 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7ff65001f070 con 0x7ff658155070 2024-05-08T20:47:36.047 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 msgr2=0x7ff638068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 0x7ff638068bd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009870 tx=0x7ff64c0a6040 comp rx=0 tx=0).stop 2024-05-08T20:47:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 msgr2=0x7ff65814af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff650007a30 tx=0x7ff65000d490 comp rx=0 tx=0).stop 2024-05-08T20:47:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 shutdown_connections 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff638066710 0x7ff638068bd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff658155070 0x7ff65814af60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6580c6410 0x7ff65814aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 --2- 172.21.15.81:0/2452354798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff65806b840 0x7ff6580c0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 >> 172.21.15.81:0/2452354798 conn(0x7ff6580c68c0 msgr2=0x7ff6580c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 shutdown_connections 2024-05-08T20:47:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.046+0000 7ff644ff9640 1 -- 172.21.15.81:0/2452354798 wait complete. 2024-05-08T20:47:36.082 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:47:36.083 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:47:36.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 Processor -- start 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 -- start start 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd45806d5a0 0x7fd4580c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580a9e80 con 0x7fd4580a93c0 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580aa160 con 0x7fd45806d5a0 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45e637640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580aa440 con 0x7fd45814e4e0 2024-05-08T20:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd457fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd45806d5a0 0x7fd4580c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd457fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd45806d5a0 0x7fd4580c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39016/0 (socket says 172.21.15.81:39016) 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd457fff640 1 -- 172.21.15.81:0/3297908499 learned_addr learned my addr 172.21.15.81:0/3297908499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.246+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd45cbd4640 1 -- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 msgr2=0x7fd4580a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd45cbd4640 1 -- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 msgr2=0x7fd4580a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd457fff640 1 -- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 msgr2=0x7fd4580a9850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd457fff640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd457fff640 1 -- 172.21.15.81:0/3297908499 >> v1:172.21.15.117:6789/0 conn(0x7fd4580a93c0 legacy=0x7fd45814ddd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd457fff640 1 -- 172.21.15.81:0/3297908499 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580aa720 con 0x7fd45806d5a0 2024-05-08T20:47:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd457fff640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45806d5a0 0x7fd4580c1d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd448009870 tx=0x7fd44801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9bf73272948523c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd4577fe640 1 -- 172.21.15.81:0/3297908499 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480ab600 con 0x7fd45806d5a0 2024-05-08T20:47:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd4577fe640 1 -- 172.21.15.81:0/3297908499 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4480ab760 con 0x7fd45806d5a0 2024-05-08T20:47:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.250+0000 7fd4577fe640 1 -- 172.21.15.81:0/3297908499 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480abb30 con 0x7fd45806d5a0 2024-05-08T20:47:36.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 -- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45806d5a0 msgr2=0x7fd4580c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45806d5a0 0x7fd4580c1d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd448009870 tx=0x7fd44801c510 comp rx=0 tx=0).stop 2024-05-08T20:47:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 -- 172.21.15.81:0/3297908499 shutdown_connections 2024-05-08T20:47:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd45814e4e0 0x7fd4580a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 --2- 172.21.15.81:0/3297908499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45806d5a0 0x7fd4580c1d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.254+0000 7fd45e637640 1 -- 172.21.15.81:0/3297908499 >> 172.21.15.81:0/3297908499 conn(0x7fd4580c2ca0 msgr2=0x7fd4580c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 -- 172.21.15.81:0/3297908499 shutdown_connections 2024-05-08T20:47:36.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 -- 172.21.15.81:0/3297908499 wait complete. 2024-05-08T20:47:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 Processor -- start 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 -- start start 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd45e637640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45814e4e0 0x7fd458146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.258+0000 7fd457fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46338/0 (socket says 172.21.15.81:46338) 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:38826/0 (socket says 172.21.15.81:38826) 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4581451c0 con 0x7fd45806d5a0 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45806b5f0 con 0x7fd45814e4e0 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45806ce20 con 0x7fd4580a93c0 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 -- 172.21.15.81:0/4105539564 learned_addr learned my addr 172.21.15.81:0/4105539564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:36.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 msgr2=0x7fd458151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 msgr2=0x7fd458151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45814e4e0 0x7fd458146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 msgr2=0x7fd458151760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4580a93c0 0x7fd458151760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45814e4e0 msgr2=0x7fd458146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45814e4e0 0x7fd458146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480094d0 con 0x7fd45806d5a0 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd45814e4e0 0x7fd458146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd457fff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4480ad040 tx=0x7fd44801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480b4800 con 0x7fd45806d5a0 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4480b4960 con 0x7fd45806d5a0 2024-05-08T20:47:36.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480b4cf0 con 0x7fd45806d5a0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45806c510 con 0x7fd45806d5a0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45806c7d0 con 0x7fd45806d5a0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 0x7fd4581467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580696e0 con 0x7fd45806c9c0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 0x7fd4581467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4480c7390 con 0x7fd45806d5a0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4580c4af0 con 0x7fd45806c9c0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 0x7fd4581467d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4581459a0 tx=0x7fd44000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd4380666e0 0x7fd438068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd44811edb0 con 0x7fd45806d5a0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd4380666e0 0x7fd438068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400096e0 con 0x7fd45806c9c0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd44000ded0 con 0x7fd45806c9c0 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 msgr2=0x7fd4581467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 0x7fd4581467d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4581459a0 tx=0x7fd44000db90 comp rx=0 tx=0).stop 2024-05-08T20:47:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 msgr2=0x7fd4581467d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd4557fa640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806c9c0 0x7fd4581467d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.262+0000 7fd45cbd4640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd4380666e0 0x7fd438068ba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd45814e8f0 tx=0x7fd450016040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.278+0000 7fd45e637640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 0x7fd45814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.278+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458147c80 con 0x7fd458146d10 2024-05-08T20:47:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 0x7fd45814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd44ffff640 1 -- 172.21.15.81:0/4105539564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd45806cf60 con 0x7fd458146d10 2024-05-08T20:47:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd44ffff640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 0x7fd45814eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd440006fd0 tx=0x7fd440004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44001e2f0 con 0x7fd458146d10 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4808 (secure 0 0 0) 0x7fd44001eba0 con 0x7fd458146d10 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 msgr2=0x7fd45814eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 0x7fd45814eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd440006fd0 tx=0x7fd440004780 comp rx=0 tx=0).stop 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 msgr2=0x7fd45814eb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.282+0000 7fd4557fa640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd458146d10 0x7fd45814eb30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:36.306 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd4380666e0 msgr2=0x7fd438068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd4380666e0 0x7fd438068ba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd45814e8f0 tx=0x7fd450016040 comp rx=0 tx=0).stop 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45cbd4640 1 -- 172.21.15.81:0/4105539564 reap_dead start 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 msgr2=0x7fd458151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4480ad040 tx=0x7fd44801ad50 comp rx=0 tx=0).stop 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 shutdown_connections 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 --2- 172.21.15.81:0/4105539564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd45806d5a0 0x7fd458151220 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4480ad040 tx=0x7fd44801ad50 comp rx=0 tx=0).stop 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.290+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 >> 172.21.15.81:0/4105539564 conn(0x7fd4580c2ca0 msgr2=0x7fd45815eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.294+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 shutdown_connections 2024-05-08T20:47:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.294+0000 7fd45e637640 1 -- 172.21.15.81:0/4105539564 wait complete. 2024-05-08T20:47:36.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:36.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:47:36.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:47:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 Processor -- start 2024-05-08T20:47:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 -- start start 2024-05-08T20:47:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdedc158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdeda59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdedc0c1850 0x7fdedc151b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48530/0 (socket says 172.21.15.81:48530) 2024-05-08T20:47:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdeda59c640 1 -- 172.21.15.81:0/2175706217 learned_addr learned my addr 172.21.15.81:0/2175706217 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc158ec0 con 0x7fdedc0c1850 2024-05-08T20:47:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fded9d9b640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdedc158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0c28b0 con 0x7fdedc0c2bc0 2024-05-08T20:47:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0a9900 con 0x7fdedc0aacd0 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fded9d9b640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 msgr2=0x7fdedc158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fded9d9b640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 msgr2=0x7fdedc158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.506+0000 7fded9d9b640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdedc158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded9d9b640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdedc158270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467381241 0 0) 0x7fdedc158ec0 con 0x7fdedc0c1850 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003530 con 0x7fdedc0c1850 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716462082 0 0) 0x7fdedc0c28b0 con 0x7fdedc0c2bc0 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdedc158ec0 con 0x7fdedc0c2bc0 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651592346 0 0) 0x7fdec4003530 con 0x7fdedc0c1850 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 msgr2=0x7fdedc158270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdedc158270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 >> v1:172.21.15.117:6789/0 conn(0x7fdedc0c2bc0 legacy=0x7fdedc1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0c2330 con 0x7fdedc0c1850 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fdecc001680 con 0x7fdedc0c1850 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 >> v1:172.21.15.81:6789/0 conn(0x7fdedc0c1850 legacy=0x7fdedc151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdec4004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4005110 0x7fdec4003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4003cb0 0x7fdec4004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40015c0 con 0x7fdec4005110 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0a9900 con 0x7fdec4003cb0 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bca0 con 0x7fdedc0aacd0 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4003cb0 0x7fdec4004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 msgr2=0x7fdec4004bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc0aacd0 0x7fdec4004bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4005110 msgr2=0x7fdec4003770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4005110 0x7fdec4003770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.510+0000 7fdedad9d640 1 -- 172.21.15.81:0/2175706217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003530 con 0x7fdec4003cb0 2024-05-08T20:47:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedad9d640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4003cb0 0x7fdec4004110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fded400c4b0 tx=0x7fded401cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0434ba8c33ffee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40a5a00 con 0x7fdec4003cb0 2024-05-08T20:47:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40a5b80 con 0x7fdec4003cb0 2024-05-08T20:47:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fded959a640 1 -- 172.21.15.81:0/2175706217 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4003980 con 0x7fdec4003cb0 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4003cb0 msgr2=0x7fdec4004110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 --2- 172.21.15.81:0/2175706217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4003cb0 0x7fdec4004110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fded400c4b0 tx=0x7fded401cee0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedad9d640 1 -- 172.21.15.81:0/2175706217 reap_dead start 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 shutdown_connections 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 >> 172.21.15.81:0/2175706217 conn(0x7fdedc0c81c0 msgr2=0x7fdedc0c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 shutdown_connections 2024-05-08T20:47:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.514+0000 7fdedb59e640 1 -- 172.21.15.81:0/2175706217 wait complete. 2024-05-08T20:47:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.518+0000 7fdedb59e640 1 Processor -- start 2024-05-08T20:47:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.518+0000 7fdedb59e640 1 -- start start 2024-05-08T20:47:36.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 0x7fdedc1f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdeda59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 0x7fdedc1f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdeda59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 0x7fdedc1f7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46366/0 (socket says 172.21.15.81:46366) 2024-05-08T20:47:36.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:38844/0 (socket says 172.21.15.81:38844) 2024-05-08T20:47:36.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdeda59c640 1 -- 172.21.15.81:0/3884335404 learned_addr learned my addr 172.21.15.81:0/3884335404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc15d7c0 0x7fdedc1fc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc1fb500 con 0x7fdec4003cb0 2024-05-08T20:47:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15f120 con 0x7fdedc15d7c0 2024-05-08T20:47:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc1f7cd0 con 0x7fdedc147ec0 2024-05-08T20:47:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fdedad9d640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc15d7c0 0x7fdedc1fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 msgr2=0x7fdedc15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 msgr2=0x7fdedc15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.522+0000 7fded9d9b640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 msgr2=0x7fdedc15d280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdedc147ec0 0x7fdedc15d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc15d7c0 msgr2=0x7fdedc1fc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc15d7c0 0x7fdedc1fc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc152400 con 0x7fdec4003cb0 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdeda59c640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 0x7fdedc1f7790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c730 tx=0x7fdecc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0072d0 con 0x7fdec4003cb0 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc007430 con 0x7fdec4003cb0 2024-05-08T20:47:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0047f0 con 0x7fdec4003cb0 2024-05-08T20:47:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc15f390 con 0x7fdec4003cb0 2024-05-08T20:47:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.526+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdecc004950 con 0x7fdec4003cb0 2024-05-08T20:47:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdebc0666c0 0x7fdebc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fded9d9b640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdebc0666c0 0x7fdebc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fded9d9b640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdebc0666c0 0x7fdebc068b80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fded0006fd0 tx=0x7fded0006f40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc1fba30 con 0x7fdec4003cb0 2024-05-08T20:47:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fdecc054280 con 0x7fdec4003cb0 2024-05-08T20:47:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fdedb59e640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 0x7fdedc1fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.530+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc073df0 con 0x7fdedc1fbc20 2024-05-08T20:47:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdedad9d640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 0x7fdedc1fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdedad9d640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdedc152280 con 0x7fdedc1fbc20 2024-05-08T20:47:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdedad9d640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 0x7fdedc1fc770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fded4001bf0 tx=0x7fdec4005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40b3070 con 0x7fdedc1fbc20 2024-05-08T20:47:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fded40a5a00 con 0x7fdedc1fbc20 2024-05-08T20:47:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 msgr2=0x7fdedc1fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 0x7fdedc1fc770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fded4001bf0 tx=0x7fdec4005800 comp rx=0 tx=0).stop 2024-05-08T20:47:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 msgr2=0x7fdedc1fc770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:36.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.534+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fbc20 0x7fdedc1fc770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 0x7fdedc1fd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc1fc030 con 0x7fdedc1fccb0 2024-05-08T20:47:36.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedad9d640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 0x7fdedc1fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedad9d640 1 -- 172.21.15.81:0/3884335404 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdedc0c3180 con 0x7fdedc1fccb0 2024-05-08T20:47:36.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedad9d640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 0x7fdedc1fd5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fded401cd10 tx=0x7fded40a7070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40b7660 con 0x7fdedc1fccb0 2024-05-08T20:47:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:36.552 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:36.553 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:36.554 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:36.555 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:36.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:36.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:36.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:36.560 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.562 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:36.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.565 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.566 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:36.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fded40c2440 con 0x7fdedc1fccb0 2024-05-08T20:47:36.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 msgr2=0x7fdedc1fd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 0x7fdedc1fd5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fded401cd10 tx=0x7fded40a7070 comp rx=0 tx=0).stop 2024-05-08T20:47:36.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 msgr2=0x7fdedc1fd5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:36.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdedc1fccb0 0x7fdedc1fd5a0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fded401cd10 tx=0x7fded40a7070 comp rx=0 tx=0).stop 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdebc0666c0 msgr2=0x7fdebc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fdebc0666c0 0x7fdebc068b80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fded0006fd0 tx=0x7fded0006f40 comp rx=0 tx=0).stop 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 msgr2=0x7fdedc1f7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 --2- 172.21.15.81:0/3884335404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdec4003cb0 0x7fdedc1f7790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c730 tx=0x7fdecc00cbf0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedad9d640 1 -- 172.21.15.81:0/3884335404 reap_dead start 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 shutdown_connections 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 >> 172.21.15.81:0/3884335404 conn(0x7fdedc0c81c0 msgr2=0x7fdedc0a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 shutdown_connections 2024-05-08T20:47:36.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.546+0000 7fdedb59e640 1 -- 172.21.15.81:0/3884335404 wait complete. 2024-05-08T20:47:36.594 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:36.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:47:36.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:47:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 Processor -- start 2024-05-08T20:47:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 -- start start 2024-05-08T20:47:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 0x7f7adc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7adc06cb90 0x7f7adc06cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0c36f0 con 0x7f7adc0c2e80 2024-05-08T20:47:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae2faf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc151050 con 0x7f7adc0c3260 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.866+0000 7f7ae27ae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7adc06cb90 0x7f7adc06cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae1fad640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7adc0c2e80 0x7f7adc0c2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:34766/0 (socket says 172.21.15.81:34766) 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7adc06cb90 0x7f7adc06cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39070/0 (socket says 172.21.15.81:39070) 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae1fad640 1 -- 172.21.15.81:0/1095753438 learned_addr learned my addr 172.21.15.81:0/1095753438 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc151330 con 0x7f7adc06cb90 2024-05-08T20:47:36.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/1095753438 >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 0x7f7adc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 -- 172.21.15.81:0/1095753438 >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 msgr2=0x7f7adc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae0fab640 1 -- 172.21.15.81:0/1095753438 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181063280 0 0) 0x7f7ad8001120 con 0x7f7adc0c2e80 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 --2- 172.21.15.81:0/1095753438 >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 0x7f7adc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 -- 172.21.15.81:0/1095753438 >> v1:172.21.15.117:6789/0 conn(0x7f7adc0c2e80 legacy=0x7f7adc0c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 -- 172.21.15.81:0/1095753438 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc151610 con 0x7f7adc06cb90 2024-05-08T20:47:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/1095753438 >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 0x7f7adc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:47:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae27ae640 1 --2- 172.21.15.81:0/1095753438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc06cfa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7adc06b130 tx=0x7f7ad401eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f7bf652e8e3051f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae0fab640 1 -- 172.21.15.81:0/1095753438 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400a2d0 con 0x7f7adc06cb90 2024-05-08T20:47:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae0fab640 1 -- 172.21.15.81:0/1095753438 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad40039a0 con 0x7f7adc06cb90 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.870+0000 7f7ae0fab640 1 -- 172.21.15.81:0/1095753438 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4003d30 con 0x7f7adc06cb90 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 msgr2=0x7f7adc06cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/1095753438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc06cfa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7adc06b130 tx=0x7f7ad401eac0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 shutdown_connections 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/1095753438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc06cfa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/1095753438 >> v2:172.21.15.81:3300/0 conn(0x7f7adc0c3260 0x7f7adc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 >> 172.21.15.81:0/1095753438 conn(0x7f7adc06bb00 msgr2=0x7f7adc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 shutdown_connections 2024-05-08T20:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- 172.21.15.81:0/1095753438 wait complete. 2024-05-08T20:47:36.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 Processor -- start 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.874+0000 7f7ae2faf640 1 -- start start 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 0x7f7adc141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39076/0 (socket says 172.21.15.81:39076) 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 -- 172.21.15.81:0/22016319 learned_addr learned my addr 172.21.15.81:0/22016319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7adc0c3260 0x7f7adc141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0721f0 con 0x7f7adc0c3260 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc14cc40 con 0x7f7adc06cb90 2024-05-08T20:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc14d170 con 0x7f7adc0c2e80 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 0x7f7adc141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae27ae640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7adc0c3260 0x7f7adc141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 msgr2=0x7f7adc141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 msgr2=0x7f7adc141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 0x7f7adc141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 0x7f7adc141340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 msgr2=0x7f7adc141340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7adc0c2e80 0x7f7adc141340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7adc0c3260 msgr2=0x7f7adc141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7adc0c3260 0x7f7adc141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad400ab80 con 0x7f7adc06cb90 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae1fad640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c4b0 tx=0x7f7ad800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80074e0 con 0x7f7adc06cb90 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc141ed0 con 0x7f7adc06cb90 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc150200 con 0x7f7adc06cb90 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8007660 con 0x7f7adc06cb90 2024-05-08T20:47:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004a30 con 0x7f7adc06cb90 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4007e90 con 0x7f7ac4002a40 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.878+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ad8004b90 con 0x7f7adc06cb90 2024-05-08T20:47:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.882+0000 7f7ad27fc640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ac0066690 0x7f7ac0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.882+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7ad8083840 con 0x7f7adc06cb90 2024-05-08T20:47:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.886+0000 7f7ae27ae640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ac0066690 0x7f7ac0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:36.886+0000 7f7ae27ae640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ac0066690 0x7f7ac0068b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40af000 tx=0x7f7ad40a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.082+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.082+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-05-08T20:47:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.082+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:47:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.082+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:47:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.082+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:47:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.486+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.486+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ac4008050 con 0x7f7ac4002a40 2024-05-08T20:47:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.486+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0c0670 tx=0x7f7acc013d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.486+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc004030 con 0x7f7ac4002a40 2024-05-08T20:47:37.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.550+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7acc00c040 con 0x7f7ac4002a40 2024-05-08T20:47:37.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.550+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.550+0000 7f7ad27fc640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0c0670 tx=0x7f7acc013d10 comp rx=0 tx=0).stop 2024-05-08T20:47:37.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.550+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 msgr2=0x7f7ac4004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:37.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.550+0000 7f7ad27fc640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4002a40 0x7f7ac4004f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.562+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 0x7f7ac4007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.562+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac400a350 con 0x7f7ac4006f20 2024-05-08T20:47:37.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.562+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 0x7f7ac4007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.562+0000 7f7ae17ac640 1 -- 172.21.15.81:0/22016319 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7ac400a510 con 0x7f7ac4006f20 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ae17ac640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 0x7f7ac4007370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7adc13c820 tx=0x7f7acc0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc003820 con 0x7f7ac4006f20 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f7acc00feb0 con 0x7f7ac4006f20 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 msgr2=0x7f7ac4007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 0x7f7ac4007370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7adc13c820 tx=0x7f7acc0046d0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 msgr2=0x7f7ac4007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:37.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.566+0000 7f7ad27fc640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ac4006f20 0x7f7ac4007370 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.570 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:37.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:37.571 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:37.572 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:37.573 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:37.574 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:37.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:37.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:37.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:37.582 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:37.582 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ac0066690 msgr2=0x7f7ac0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ac0066690 0x7f7ac0068b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40af000 tx=0x7f7ad40a9070 comp rx=0 tx=0).stop 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 msgr2=0x7f7adc071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c4b0 tx=0x7f7ad800c970 comp rx=0 tx=0).stop 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae27ae640 1 -- 172.21.15.81:0/22016319 reap_dead start 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 shutdown_connections 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 --2- 172.21.15.81:0/22016319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7adc06cb90 0x7f7adc071750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 >> 172.21.15.81:0/22016319 conn(0x7f7adc06bb00 msgr2=0x7f7adc0aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 shutdown_connections 2024-05-08T20:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.570+0000 7f7ae2faf640 1 -- 172.21.15.81:0/22016319 wait complete. 2024-05-08T20:47:37.603 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:37.603 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:47:37.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:47:37.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 Processor -- start 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 -- start start 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14000a9bb0 0x7f1400072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1400072970 con 0x7f1400159cf0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1400072ba0 con 0x7f14000a8570 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f1405ba7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140006ce10 con 0x7f14000a9bb0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f13ff7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1400159cf0 0x7f14000c2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48538/0 (socket says 172.21.15.81:48538) 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.790+0000 7f13ff7fe640 1 -- 172.21.15.81:0/1797889308 learned_addr learned my addr 172.21.15.81:0/1797889308 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 --2- 172.21.15.81:0/1797889308 >> v2:172.21.15.117:3300/0 conn(0x7f14000a9bb0 0x7f1400072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757907233 0 0) 0x7f1400072970 con 0x7f1400159cf0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e8003530 con 0x7f1400159cf0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 865285441 0 0) 0x7f13e8003530 con 0x7f1400159cf0 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 >> v2:172.21.15.117:3300/0 conn(0x7f14000a9bb0 msgr2=0x7f1400072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:37.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 --2- 172.21.15.81:0/1797889308 >> v2:172.21.15.117:3300/0 conn(0x7f14000a9bb0 0x7f1400072430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 >> v1:172.21.15.117:6789/0 conn(0x7f14000a8570 legacy=0x7f14000a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140015a0d0 con 0x7f1400159cf0 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f13f4001680 con 0x7f1400159cf0 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 >> v1:172.21.15.81:6789/0 conn(0x7f1400159cf0 legacy=0x7f14000c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e8003a50 0x7f13e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80047d0 0x7f13e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 0x7f13e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13ff7fe640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e8003a50 0x7f13e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 0x7f13e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13feffd640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80047d0 0x7f13e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140006ce10 con 0x7f13e8005390 2024-05-08T20:47:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e800c2b0 con 0x7f13e8003a50 2024-05-08T20:47:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e800c470 con 0x7f13e80047d0 2024-05-08T20:47:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 -- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80047d0 msgr2=0x7f13e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e80047d0 0x7f13e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 -- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e8003a50 msgr2=0x7f13e8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13e8003a50 0x7f13e8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.794+0000 7f13fffff640 1 -- 172.21.15.81:0/1797889308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8003530 con 0x7f13e8005390 2024-05-08T20:47:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.798+0000 7f13fffff640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 0x7f13e800b9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007360 tx=0x7f13f801ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57eb7384e65a731 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.798+0000 7f13fffff640 1 -- 172.21.15.81:0/1797889308 reap_dead start 2024-05-08T20:47:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.798+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80a5b60 con 0x7f13e8005390 2024-05-08T20:47:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.798+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80a5ce0 con 0x7f13e8005390 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.798+0000 7f13fe7fc640 1 -- 172.21.15.81:0/1797889308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80ad680 con 0x7f13e8005390 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 -- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 msgr2=0x7f13e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 0x7f13e800b9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007360 tx=0x7f13f801ce80 comp rx=0 tx=0).stop 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 -- 172.21.15.81:0/1797889308 shutdown_connections 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 --2- 172.21.15.81:0/1797889308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e8005390 0x7f13e800b9d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 -- 172.21.15.81:0/1797889308 >> 172.21.15.81:0/1797889308 conn(0x7f140006a2f0 msgr2=0x7f140006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:37.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.802+0000 7f1405ba7640 1 -- 172.21.15.81:0/1797889308 shutdown_connections 2024-05-08T20:47:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 -- 172.21.15.81:0/1797889308 wait complete. 2024-05-08T20:47:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 Processor -- start 2024-05-08T20:47:37.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 -- start start 2024-05-08T20:47:37.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e8005390 0x7f14000bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f140015d280 0x7f14000bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000bd710 con 0x7f140015d280 2024-05-08T20:47:37.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1400143840 con 0x7f14000c0430 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f1405ba7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a76f0 con 0x7f13e8005390 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:39096/0 (socket says 172.21.15.81:39096) 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 -- 172.21.15.81:0/1235939906 learned_addr learned my addr 172.21.15.81:0/1235939906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13ff7fe640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e8005390 0x7f14000bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 -- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e8005390 msgr2=0x7f14000bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e8005390 0x7f14000bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.810+0000 7f13fffff640 1 -- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f140015d280 msgr2=0x7f14000bdb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13fffff640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f140015d280 0x7f14000bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13fffff640 1 -- 172.21.15.81:0/1235939906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400149fd0 con 0x7f14000c0430 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13fffff640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13f801c8f0 tx=0x7f13f8019c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8003ea0 con 0x7f14000c0430 2024-05-08T20:47:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80a6ef0 con 0x7f14000c0430 2024-05-08T20:47:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8004240 con 0x7f14000c0430 2024-05-08T20:47:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f1405ba7640 1 -- 172.21.15.81:0/1235939906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140014a2b0 con 0x7f14000c0430 2024-05-08T20:47:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f1405ba7640 1 -- 172.21.15.81:0/1235939906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14000be5e0 con 0x7f14000c0430 2024-05-08T20:47:37.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13f80043a0 con 0x7f14000c0430 2024-05-08T20:47:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 0x7f13ec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f13f811ebe0 con 0x7f14000c0430 2024-05-08T20:47:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13ff7fe640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 0x7f13ec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.814+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d8005260 con 0x7f14000c0430 2024-05-08T20:47:37.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.818+0000 7f13ff7fe640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 0x7f13ec068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f13f4001000 tx=0x7f13f400a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:37.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:37.822+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f13f811ce60 con 0x7f14000c0430 2024-05-08T20:47:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.382+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f13d8005d20 con 0x7f14000c0430 2024-05-08T20:47:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e7fff640 1 -- 172.21.15.81:0/1235939906 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f13f80ebc20 con 0x7f14000c0430 2024-05-08T20:47:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 msgr2=0x7f13ec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 0x7f13ec068c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f13f4001000 tx=0x7f13f400a040 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 msgr2=0x7f14000be0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13f801c8f0 tx=0x7f13f8019c20 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 shutdown_connections 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f13ec066760 0x7f13ec068c20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.386+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14000c0430 0x7f14000be0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.390+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f140015d280 0x7f14000bdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.390+0000 7f13e67fc640 1 --2- 172.21.15.81:0/1235939906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13e8005390 0x7f14000bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.390+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 >> 172.21.15.81:0/1235939906 conn(0x7f140006a2f0 msgr2=0x7f1400158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:38.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.390+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 shutdown_connections 2024-05-08T20:47:38.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:38.394+0000 7f13e67fc640 1 -- 172.21.15.81:0/1235939906 wait complete. 2024-05-08T20:47:38.427 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:47:48.428 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:47:48.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 Processor -- start 2024-05-08T20:47:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 -- start start 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45e40c1e10 0x7f45e4158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e40c2a00 con 0x7f45e40c21f0 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e40a94f0 con 0x7f45e40a8890 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e9429640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40aa950 con 0x7f45e40c1e10 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45dbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45e40c21f0 0x7f45e40a9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:44690/0 (socket says 172.21.15.81:44690) 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45dbfff640 1 -- 172.21.15.81:0/2800225721 learned_addr learned my addr 172.21.15.81:0/2800225721 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e2ffd640 1 --2- 172.21.15.81:0/2800225721 >> v2:172.21.15.117:3300/0 conn(0x7f45e40c1e10 0x7f45e4158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e2ffd640 1 -- 172.21.15.81:0/2800225721 >> v1:172.21.15.117:6789/0 conn(0x7f45e40a8890 legacy=0x7f45e40aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e2ffd640 1 -- 172.21.15.81:0/2800225721 >> v1:172.21.15.81:6789/0 conn(0x7f45e40c21f0 legacy=0x7f45e40a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.606+0000 7f45e2ffd640 1 -- 172.21.15.81:0/2800225721 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40c0850 con 0x7f45e40c1e10 2024-05-08T20:47:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.610+0000 7f45e2ffd640 1 --2- 172.21.15.81:0/2800225721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40c1e10 0x7f45e4158610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097c0 tx=0x7f45d401bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99794dccefe2cd3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.610+0000 7f45e27fc640 1 -- 172.21.15.81:0/2800225721 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40a8630 con 0x7f45e40c1e10 2024-05-08T20:47:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.610+0000 7f45e27fc640 1 -- 172.21.15.81:0/2800225721 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40a8790 con 0x7f45e40c1e10 2024-05-08T20:47:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.610+0000 7f45e27fc640 1 -- 172.21.15.81:0/2800225721 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40a8b20 con 0x7f45e40c1e10 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- 172.21.15.81:0/2800225721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40c1e10 msgr2=0x7f45e4158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 --2- 172.21.15.81:0/2800225721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40c1e10 0x7f45e4158610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097c0 tx=0x7f45d401bf80 comp rx=0 tx=0).stop 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- 172.21.15.81:0/2800225721 shutdown_connections 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 --2- 172.21.15.81:0/2800225721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40c1e10 0x7f45e4158610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- 172.21.15.81:0/2800225721 >> 172.21.15.81:0/2800225721 conn(0x7f45e40c2ca0 msgr2=0x7f45e40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- 172.21.15.81:0/2800225721 shutdown_connections 2024-05-08T20:47:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- 172.21.15.81:0/2800225721 wait complete. 2024-05-08T20:47:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 Processor -- start 2024-05-08T20:47:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 -- start start 2024-05-08T20:47:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 0x7f45e41f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 0x7f45e406c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e9429640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53546/0 (socket says 172.21.15.81:53546) 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.614+0000 7f45dbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 0x7f45e406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 0x7f45e41f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 0x7f45e41f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:40752/0 (socket says 172.21.15.81:40752) 2024-05-08T20:47:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 -- 172.21.15.81:0/3867498639 learned_addr learned my addr 172.21.15.81:0/3867498639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e414df50 con 0x7f45e4146f10 2024-05-08T20:47:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41f7020 con 0x7f45e40a8890 2024-05-08T20:47:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40c4c80 con 0x7f45e40c21f0 2024-05-08T20:47:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 -- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 msgr2=0x7f45e406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 0x7f45e406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 -- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 msgr2=0x7f45e41f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 0x7f45e41f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009420 con 0x7f45e4146f10 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45dbfff640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 0x7f45e406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e37fe640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00c790 tx=0x7f45dc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003b80 con 0x7f45e4146f10 2024-05-08T20:47:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc003d00 con 0x7f45e4146f10 2024-05-08T20:47:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc005310 con 0x7f45e4146f10 2024-05-08T20:47:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e40c3d90 con 0x7f45e4146f10 2024-05-08T20:47:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e40c4350 con 0x7f45e4146f10 2024-05-08T20:47:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.618+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e414bbf0 con 0x7f45e4146f10 2024-05-08T20:47:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.622+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45dc005470 con 0x7f45e4146f10 2024-05-08T20:47:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.622+0000 7f45db7fe640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 0x7f45c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.622+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f45dc0840a0 con 0x7f45e4146f10 2024-05-08T20:47:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.622+0000 7f45e2ffd640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 0x7f45c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.622+0000 7f45e2ffd640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 0x7f45c4068b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ad000 tx=0x7f45d40b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:48.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:48.626+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f45dc051100 con 0x7f45e4146f10 2024-05-08T20:47:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.126+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f45e4074950 con 0x7f45e4146f10 2024-05-08T20:47:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.130+0000 7f45db7fe640 1 -- 172.21.15.81:0/3867498639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f45dc054720 con 0x7f45e4146f10 2024-05-08T20:47:49.137 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 msgr2=0x7f45c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 0x7f45c4068b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ad000 tx=0x7f45d40b3040 comp rx=0 tx=0).stop 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 msgr2=0x7f45e41473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00c790 tx=0x7f45dc00cc50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 shutdown_connections 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45c40666c0 0x7f45c4068b80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e4146f10 0x7f45e41473a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45e40c21f0 0x7f45e406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 --2- 172.21.15.81:0/3867498639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45e40a8890 0x7f45e41f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 >> 172.21.15.81:0/3867498639 conn(0x7f45e40c2ca0 msgr2=0x7f45e41560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 shutdown_connections 2024-05-08T20:47:49.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.134+0000 7f45e9429640 1 -- 172.21.15.81:0/3867498639 wait complete. 2024-05-08T20:47:49.177 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:47:49.177 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:47:49.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:47:49.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 Processor -- start 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 -- start start 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbf700aa560 0x7fbf700a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf700c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf700ac870 con 0x7fbf700c2610 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7013dd20 con 0x7fbf700aa560 2024-05-08T20:47:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf779db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf701555c0 con 0x7fbf7013df00 2024-05-08T20:47:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf74f76640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbf700c2610 0x7fbf700acd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52376/0 (socket says 172.21.15.81:52376) 2024-05-08T20:47:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf74f76640 1 -- 172.21.15.81:0/3653588259 learned_addr learned my addr 172.21.15.81:0/3653588259 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75777640 1 --2- 172.21.15.81:0/3653588259 >> v2:172.21.15.117:3300/0 conn(0x7fbf700aa560 0x7fbf700a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75f78640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf700c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75777640 1 -- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 msgr2=0x7fbf700c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75777640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf700c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75777640 1 -- 172.21.15.81:0/3653588259 >> v1:172.21.15.81:6789/0 conn(0x7fbf700c2610 legacy=0x7fbf700acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.426+0000 7fbf75777640 1 -- 172.21.15.81:0/3653588259 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf701558a0 con 0x7fbf700aa560 2024-05-08T20:47:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.430+0000 7fbf75777640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf700a94b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097c0 tx=0x7fbf6401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2ffcccc83d6178 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.430+0000 7fbf6ffff640 1 -- 172.21.15.81:0/3653588259 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640ab5f0 con 0x7fbf700aa560 2024-05-08T20:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.430+0000 7fbf6ffff640 1 -- 172.21.15.81:0/3653588259 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640ab750 con 0x7fbf700aa560 2024-05-08T20:47:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.430+0000 7fbf6ffff640 1 -- 172.21.15.81:0/3653588259 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640abae0 con 0x7fbf700aa560 2024-05-08T20:47:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 msgr2=0x7fbf700a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf700a94b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf640097c0 tx=0x7fbf6401c410 comp rx=0 tx=0).stop 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- 172.21.15.81:0/3653588259 shutdown_connections 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf700c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- 172.21.15.81:0/3653588259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf700a94b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- 172.21.15.81:0/3653588259 >> 172.21.15.81:0/3653588259 conn(0x7fbf700c4cc0 msgr2=0x7fbf700c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- 172.21.15.81:0/3653588259 shutdown_connections 2024-05-08T20:47:49.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- 172.21.15.81:0/3653588259 wait complete. 2024-05-08T20:47:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 Processor -- start 2024-05-08T20:47:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- start start 2024-05-08T20:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf700c2610 0x7fbf70133370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf70138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70157d10 con 0x7fbf700c2610 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70158ca0 con 0x7fbf700aa560 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf779db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70156c20 con 0x7fbf7013df00 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf75777640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf75777640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:36964/0 (socket says 172.21.15.81:36964) 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf75777640 1 -- 172.21.15.81:0/591858680 learned_addr learned my addr 172.21.15.81:0/591858680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf700c2610 0x7fbf70133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 msgr2=0x7fbf70138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.434+0000 7fbf75f78640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf70138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf70138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf700c2610 msgr2=0x7fbf70133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf700c2610 0x7fbf70133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf64009420 con 0x7fbf700aa560 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75f78640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbf7013df00 0x7fbf70138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf700c2610 0x7fbf70133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf75777640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ad040 tx=0x7fbf6401ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640bf610 con 0x7fbf700aa560 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640bf770 con 0x7fbf700aa560 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640bfb20 con 0x7fbf700aa560 2024-05-08T20:47:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf779db640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf70158650 con 0x7fbf700aa560 2024-05-08T20:47:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.438+0000 7fbf779db640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7013d0d0 con 0x7fbf700aa560 2024-05-08T20:47:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf537fe640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 0x7fbf4c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c007e90 con 0x7fbf4c002a40 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 0x7fbf4c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf74f76640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf4c008050 con 0x7fbf4c002a40 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf640bfc80 con 0x7fbf700aa560 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 0x7fbf4c004f00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf700c5dc0 tx=0x7fbf6000df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf6dffb640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf540666e0 0x7fbf54068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbf640a8050 con 0x7fbf700aa560 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf75f78640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf540666e0 0x7fbf54068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60016070 con 0x7fbf4c002a40 2024-05-08T20:47:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.442+0000 7fbf75f78640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf540666e0 0x7fbf54068ba0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbf7013c6f0 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.446+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbf60004b70 con 0x7fbf4c002a40 2024-05-08T20:47:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.446+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 msgr2=0x7fbf4c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.446+0000 7fbf6dffb640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 0x7fbf4c004f00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf700c5dc0 tx=0x7fbf6000df50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.446+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 msgr2=0x7fbf4c004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.446+0000 7fbf6dffb640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c002a40 0x7fbf4c004f00 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf700c5dc0 tx=0x7fbf6000df50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf537fe640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 0x7fbf4c007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c00a350 con 0x7fbf4c006ee0 2024-05-08T20:47:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 0x7fbf4c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf74f76640 1 -- 172.21.15.81:0/591858680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbf4c00a510 con 0x7fbf4c006ee0 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf74f76640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 0x7fbf4c007370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf7006f460 tx=0x7fbf60001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf60021070 con 0x7fbf4c006ee0 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4809 (secure 0 0 0) 0x7fbf6001cce0 con 0x7fbf4c006ee0 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 msgr2=0x7fbf4c007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 0x7fbf4c007370 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf7006f460 tx=0x7fbf60001260 comp rx=0 tx=0).stop 2024-05-08T20:47:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 msgr2=0x7fbf4c007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.454+0000 7fbf6dffb640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf4c006ee0 0x7fbf4c007370 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf7006f460 tx=0x7fbf60001260 comp rx=0 tx=0).stop 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:49.461 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.462 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.463 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:49.464 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.465 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:49.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.467 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:49.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.473 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:49.474 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:49.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf540666e0 msgr2=0x7fbf54068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbf540666e0 0x7fbf54068ba0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbf7013c6f0 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2024-05-08T20:47:49.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf75f78640 1 -- 172.21.15.81:0/591858680 reap_dead start 2024-05-08T20:47:49.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 msgr2=0x7fbf701577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ad040 tx=0x7fbf6401ac50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 shutdown_connections 2024-05-08T20:47:49.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 --2- 172.21.15.81:0/591858680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf700aa560 0x7fbf701577d0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ad040 tx=0x7fbf6401ac50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 >> 172.21.15.81:0/591858680 conn(0x7fbf700c4cc0 msgr2=0x7fbf700c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 shutdown_connections 2024-05-08T20:47:49.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.458+0000 7fbf537fe640 1 -- 172.21.15.81:0/591858680 wait complete. 2024-05-08T20:47:49.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:49.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:47:49.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:47:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.714+0000 7f962f877640 1 Processor -- start 2024-05-08T20:47:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.714+0000 7f962f877640 1 -- start start 2024-05-08T20:47:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96280c3510 0x7f96280aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280a9970 0x7f9628153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96280c38f0 0x7f96280c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9628153880 con 0x7f96280c3510 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280c47c0 con 0x7f96280c38f0 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962f877640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280c6220 con 0x7f96280a9970 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96280c38f0 0x7f96280c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96280c38f0 0x7f96280c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:36972/0 (socket says 172.21.15.81:36972) 2024-05-08T20:47:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 -- 172.21.15.81:0/2701946943 learned_addr learned my addr 172.21.15.81:0/2701946943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 -- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280a9970 msgr2=0x7f9628153340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 --2- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280a9970 0x7f9628153340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 -- 172.21.15.81:0/2701946943 >> v2:172.21.15.81:3300/0 conn(0x7f96280c3510 msgr2=0x7f96280aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 --2- 172.21.15.81:0/2701946943 >> v2:172.21.15.81:3300/0 conn(0x7f96280c3510 0x7f96280aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.718+0000 7f962de14640 1 -- 172.21.15.81:0/2701946943 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280c6500 con 0x7f96280c38f0 2024-05-08T20:47:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962de14640 1 --2- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280c5210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9628065e10 tx=0x7f962401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47613c1763dcb51c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f961ffff640 1 -- 172.21.15.81:0/2701946943 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240ab640 con 0x7f96280c38f0 2024-05-08T20:47:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f961ffff640 1 -- 172.21.15.81:0/2701946943 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240a7070 con 0x7f96280c38f0 2024-05-08T20:47:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f961ffff640 1 -- 172.21.15.81:0/2701946943 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240ab9c0 con 0x7f96280c38f0 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 -- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 msgr2=0x7f96280c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 --2- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280c5210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9628065e10 tx=0x7f962401c4a0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 -- 172.21.15.81:0/2701946943 shutdown_connections 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 --2- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280a9970 0x7f9628153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 --2- 172.21.15.81:0/2701946943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280c5210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 --2- 172.21.15.81:0/2701946943 >> v2:172.21.15.81:3300/0 conn(0x7f96280c3510 0x7f96280aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.722+0000 7f962f877640 1 -- 172.21.15.81:0/2701946943 >> 172.21.15.81:0/2701946943 conn(0x7f96280c68c0 msgr2=0x7f96280c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- 172.21.15.81:0/2701946943 shutdown_connections 2024-05-08T20:47:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- 172.21.15.81:0/2701946943 wait complete. 2024-05-08T20:47:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 Processor -- start 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- start start 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96280a9970 0x7f96280bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280c3510 0x7f962806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96281efe50 con 0x7f96280a9970 2024-05-08T20:47:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96281ef8d0 con 0x7f96280c38f0 2024-05-08T20:47:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962f877640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280bd7e0 con 0x7f96280c3510 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962de14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962de14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:36980/0 (socket says 172.21.15.81:36980) 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 learned_addr learned my addr 172.21.15.81:0/2427006183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.726+0000 7f962d613640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96280a9970 0x7f96280bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280c3510 msgr2=0x7f962806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96280c3510 0x7f962806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96280a9970 msgr2=0x7f96280bd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96280a9970 0x7f96280bd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240094d0 con 0x7f96280c38f0 2024-05-08T20:47:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962de14640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280bdcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f96240ad040 tx=0x7f962401ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240abe90 con 0x7f96280c38f0 2024-05-08T20:47:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240be3f0 con 0x7f96280c38f0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96281efb70 con 0x7f96280c38f0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96280bcaa0 con 0x7f96280c38f0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962f877640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 0x7f962814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628069550 con 0x7f96280bb8e0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240be7a0 con 0x7f96280c38f0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.730+0000 7f962d613640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 0x7f962814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96240c7440 con 0x7f96280c38f0 2024-05-08T20:47:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f962d613640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9628074950 con 0x7f96280bb8e0 2024-05-08T20:47:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f962d613640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 0x7f962814abb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f962000e490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f960c0666e0 0x7f960c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f962ce12640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f960c0666e0 0x7f960c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f962411ee60 con 0x7f96280c38f0 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620010040 con 0x7f96280bb8e0 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9620014600 con 0x7f96280bb8e0 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 msgr2=0x7f962814abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 0x7f962814abb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f962000e490 comp rx=0 tx=0).stop 2024-05-08T20:47:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 msgr2=0x7f962814abb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f961dffb640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280bb8e0 0x7f962814abb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.734+0000 7f962ce12640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f960c0666e0 0x7f960c068ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f96281558f0 tx=0x7f9618006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.758+0000 7f962f877640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 0x7f962814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.758+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628073d20 con 0x7f9628155e30 2024-05-08T20:47:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.762+0000 7f962d613640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 0x7f962814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.762+0000 7f962d613640 1 -- 172.21.15.81:0/2427006183 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f96280677d0 con 0x7f9628155e30 2024-05-08T20:47:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.762+0000 7f962d613640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 0x7f962814b0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f9620004b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.762+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962001e430 con 0x7f9628155e30 2024-05-08T20:47:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.766+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f962001e590 con 0x7f9628155e30 2024-05-08T20:47:49.773 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 16, 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:47:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:49.786 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:49.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 msgr2=0x7f962814b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f961dffb640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 0x7f962814b0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9620009fd0 tx=0x7f9620004b60 comp rx=0 tx=0).stop 2024-05-08T20:47:49.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f961dffb640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 msgr2=0x7f962814b0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:49.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f961dffb640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9628155e30 0x7f962814b0f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f960c0666e0 msgr2=0x7f960c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f962f877640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f960c0666e0 0x7f960c068ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f96281558f0 tx=0x7f9618006c50 comp rx=0 tx=0).stop 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 msgr2=0x7f96280bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.770+0000 7f962f877640 1 --2- 172.21.15.81:0/2427006183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96280c38f0 0x7f96280bdcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f96240ad040 tx=0x7f962401ace0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 reap_dead start 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962de14640 1 -- 172.21.15.81:0/2427006183 reap_dead start 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 shutdown_connections 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 >> 172.21.15.81:0/2427006183 conn(0x7f96280c68c0 msgr2=0x7f962814eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 shutdown_connections 2024-05-08T20:47:49.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.774+0000 7f962f877640 1 -- 172.21.15.81:0/2427006183 wait complete. 2024-05-08T20:47:49.809 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:49.809 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:47:49.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:47:49.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 Processor -- start 2024-05-08T20:47:49.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 -- start start 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe308152140 0x7fe3080c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3080a5f10 0x7fe3080c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3081566d0 con 0x7fe3080ac460 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe308152cd0 con 0x7fe3080a5f10 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30d02b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe308156c00 con 0x7fe308152140 2024-05-08T20:47:49.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.974+0000 7fe30659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3080a5f10 0x7fe3080c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe3080a5f10 0x7fe3080c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60590/0 (socket says 172.21.15.81:60590) 2024-05-08T20:47:49.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 -- 172.21.15.81:0/941534044 learned_addr learned my addr 172.21.15.81:0/941534044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:49.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe306d9d640 1 --2- 172.21.15.81:0/941534044 >> v2:172.21.15.117:3300/0 conn(0x7fe308152140 0x7fe3080c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:49.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 -- 172.21.15.81:0/941534044 >> v2:172.21.15.117:3300/0 conn(0x7fe308152140 msgr2=0x7fe3080c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:49.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 --2- 172.21.15.81:0/941534044 >> v2:172.21.15.117:3300/0 conn(0x7fe308152140 0x7fe3080c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 -- 172.21.15.81:0/941534044 >> v1:172.21.15.81:6789/0 conn(0x7fe3080ac460 legacy=0x7fe3081530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 -- 172.21.15.81:0/941534044 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308156920 con 0x7fe3080a5f10 2024-05-08T20:47:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30659c640 1 --2- 172.21.15.81:0/941534044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3080a5f10 0x7fe3080c18d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3080662f0 tx=0x7fe2f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f5ae40e5316515 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe305d9b640 1 -- 172.21.15.81:0/941534044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80ac430 con 0x7fe3080a5f10 2024-05-08T20:47:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe305d9b640 1 -- 172.21.15.81:0/941534044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f80ac590 con 0x7fe3080a5f10 2024-05-08T20:47:49.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe305d9b640 1 -- 172.21.15.81:0/941534044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80ac920 con 0x7fe3080a5f10 2024-05-08T20:47:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 -- 172.21.15.81:0/941534044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3080a5f10 msgr2=0x7fe3080c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 --2- 172.21.15.81:0/941534044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3080a5f10 0x7fe3080c18d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3080662f0 tx=0x7fe2f801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 -- 172.21.15.81:0/941534044 shutdown_connections 2024-05-08T20:47:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 --2- 172.21.15.81:0/941534044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3080a5f10 0x7fe3080c18d0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3080662f0 tx=0x7fe2f801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 --2- 172.21.15.81:0/941534044 >> v2:172.21.15.117:3300/0 conn(0x7fe308152140 0x7fe3080c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:49.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.978+0000 7fe30d02b640 1 -- 172.21.15.81:0/941534044 >> 172.21.15.81:0/941534044 conn(0x7fe30806a090 msgr2=0x7fe30806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:49.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.986+0000 7fe30d02b640 1 -- 172.21.15.81:0/941534044 shutdown_connections 2024-05-08T20:47:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.986+0000 7fe30d02b640 1 -- 172.21.15.81:0/941534044 wait complete. 2024-05-08T20:47:49.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.990+0000 7fe30d02b640 1 Processor -- start 2024-05-08T20:47:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- start start 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 0x7fe3081537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe308152140 0x7fe3080a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe308153d20 0x7fe3080a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080a7340 con 0x7fe308152140 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080a64e0 con 0x7fe3080ac460 2024-05-08T20:47:50.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080a96b0 con 0x7fe308153d20 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 0x7fe3081537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 0x7fe3081537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:37032/0 (socket says 172.21.15.81:37032) 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 -- 172.21.15.81:0/3490549332 learned_addr learned my addr 172.21.15.81:0/3490549332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe308152140 0x7fe3080a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30c82a640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe308153d20 0x7fe3080a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe308153d20 msgr2=0x7fe3080a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe308153d20 0x7fe3080a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe308152140 msgr2=0x7fe3080a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe308152140 0x7fe3080a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80094d0 con 0x7fe3080ac460 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe308152140 0x7fe3080a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:47:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe306d9d640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 0x7fe3081537e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe300007e40 tx=0x7fe30000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300014620 con 0x7fe3080ac460 2024-05-08T20:47:50.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3080a93d0 con 0x7fe3080ac460 2024-05-08T20:47:50.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3081fa880 con 0x7fe3080ac460 2024-05-08T20:47:50.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:49.998+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000ee90 con 0x7fe3080ac460 2024-05-08T20:47:50.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe30d02b640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 0x7fe2e8004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8007e90 con 0x7fe2e8002a40 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000149c0 con 0x7fe3080ac460 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe300014ba0 con 0x7fe3080ac460 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe2ef7fe640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe2f4066690 0x7fe2f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe300084e00 con 0x7fe3080ac460 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe30c82a640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe2f4066690 0x7fe2f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 0x7fe2e8004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.002+0000 7fe30c82a640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe2f4066690 0x7fe2f4068b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe3081541d0 tx=0x7fe2fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe30659c640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2e8008050 con 0x7fe2e8002a40 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 0x7fe2e8004f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3080a9a00 tx=0x7fe2f801ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80ab950 con 0x7fe2e8002a40 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe2f80abab0 con 0x7fe2e8002a40 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 msgr2=0x7fe2e8004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 0x7fe2e8004f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3080a9a00 tx=0x7fe2f801ac10 comp rx=0 tx=0).stop 2024-05-08T20:47:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 msgr2=0x7fe2e8004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.006+0000 7fe2ef7fe640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8002a40 0x7fe2e8004f00 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3080a9a00 tx=0x7fe2f801ac10 comp rx=0 tx=0).stop 2024-05-08T20:47:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe30d02b640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 0x7fe2e8007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e800a350 con 0x7fe2e8006ee0 2024-05-08T20:47:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 0x7fe2e8007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe30659c640 1 -- 172.21.15.81:0/3490549332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe2e800a510 con 0x7fe2e8006ee0 2024-05-08T20:47:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe30659c640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 0x7fe2e8007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c10 tx=0x7fe2f8019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80bf8c0 con 0x7fe2e8006ee0 2024-05-08T20:47:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.018+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fe2f80c3070 con 0x7fe2e8006ee0 2024-05-08T20:47:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 msgr2=0x7fe2e8007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe2ef7fe640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 0x7fe2e8007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c10 tx=0x7fe2f8019170 comp rx=0 tx=0).stop 2024-05-08T20:47:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe2ef7fe640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 msgr2=0x7fe2e8007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:47:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe2ef7fe640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2e8006ee0 0x7fe2e8007370 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c10 tx=0x7fe2f8019170 comp rx=0 tx=0).stop 2024-05-08T20:47:50.028 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:47:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 156, 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:47:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 17, 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:47:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:47:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:47:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:47:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:47:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:47:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:47:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:47:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:47:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:47:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:47:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:47:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:47:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:47:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:47:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:47:50.048 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe2f4066690 msgr2=0x7fe2f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe2f4066690 0x7fe2f4068b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe3081541d0 tx=0x7fe2fc009040 comp rx=0 tx=0).stop 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 msgr2=0x7fe3081537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 --2- 172.21.15.81:0/3490549332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3080ac460 0x7fe3081537e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe300007e40 tx=0x7fe30000e4b0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30c82a640 1 -- 172.21.15.81:0/3490549332 reap_dead start 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30c82a640 1 -- 172.21.15.81:0/3490549332 reap_dead start 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 shutdown_connections 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 >> 172.21.15.81:0/3490549332 conn(0x7fe30806a090 msgr2=0x7fe3081559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 shutdown_connections 2024-05-08T20:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.022+0000 7fe30d02b640 1 -- 172.21.15.81:0/3490549332 wait complete. 2024-05-08T20:47:50.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:47:50.058 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-05-08T20:47:50.058 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:47:50.058 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-05-08T20:47:50.058 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:47:50.059 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:47:50.059 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:47:50.082 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:47:50.082 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:47:50.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 Processor -- start 2024-05-08T20:47:50.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 -- start start 2024-05-08T20:47:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00dac00 con 0x7f33d00db090 2024-05-08T20:47:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00071b0 con 0x7f33d0046390 2024-05-08T20:47:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33dcde1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0046f20 con 0x7f33d002ae70 2024-05-08T20:47:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33d7fff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f33d00db090 legacy=0x7f33d00e4d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:47:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33d6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33d6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35602/0 (socket says 172.21.15.81:35602) 2024-05-08T20:47:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.286+0000 7f33d6ffd640 1 -- 172.21.15.81:0/2068264181 learned_addr learned my addr 172.21.15.81:0/2068264181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.290+0000 7f33d6ffd640 1 -- 172.21.15.81:0/2068264181 >> v1:172.21.15.117:6789/0 conn(0x7f33d0046390 legacy=0x7f33d00db890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.290+0000 7f33d6ffd640 1 -- 172.21.15.81:0/2068264181 >> v1:172.21.15.81:6789/0 conn(0x7f33d00db090 legacy=0x7f33d00e4d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:47:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.290+0000 7f33d6ffd640 1 -- 172.21.15.81:0/2068264181 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00da5b0 con 0x7f33d002ae70 2024-05-08T20:47:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.290+0000 7f33d6ffd640 1 --2- 172.21.15.81:0/2068264181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f33d802c980 tx=0x7f33d8096dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480a6b1ba7d358f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33d67fc640 1 -- 172.21.15.81:0/2068264181 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d811fb80 con 0x7f33d002ae70 2024-05-08T20:47:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33d67fc640 1 -- 172.21.15.81:0/2068264181 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d811fd20 con 0x7f33d002ae70 2024-05-08T20:47:50.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33d67fc640 1 -- 172.21.15.81:0/2068264181 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8127640 con 0x7f33d002ae70 2024-05-08T20:47:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 -- 172.21.15.81:0/2068264181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 msgr2=0x7f33d00d75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 --2- 172.21.15.81:0/2068264181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f33d802c980 tx=0x7f33d8096dd0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 -- 172.21.15.81:0/2068264181 shutdown_connections 2024-05-08T20:47:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 --2- 172.21.15.81:0/2068264181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d002ae70 0x7f33d00d75a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 -- 172.21.15.81:0/2068264181 >> 172.21.15.81:0/2068264181 conn(0x7f33d0005e70 msgr2=0x7f33d0006280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 -- 172.21.15.81:0/2068264181 shutdown_connections 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 -- 172.21.15.81:0/2068264181 wait complete. 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.294+0000 7f33dcde1640 1 Processor -- start 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- start start 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d002ae70 0x7f33d0194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 0x7f33d00de2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0195240 con 0x7f33d0046390 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0198640 con 0x7f33d002ae70 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00de810 con 0x7f33d00db090 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d6ffd640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 msgr2=0x7f33d00de2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:47:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 0x7f33d00de2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35604/0 (socket says 172.21.15.81:35604) 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 -- 172.21.15.81:0/1293076264 learned_addr learned my addr 172.21.15.81:0/1293076264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d77fe640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d002ae70 0x7f33d0194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 -- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d002ae70 msgr2=0x7f33d0194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d002ae70 0x7f33d0194d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 -- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 msgr2=0x7f33d00de2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 0x7f33d00de2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 -- 172.21.15.81:0/1293076264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8072040 con 0x7f33d00db090 2024-05-08T20:47:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33d7fff640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00b440 tx=0x7f33cc00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003dd0 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00dd540 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00ddb00 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc0060d0 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.298+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc006480 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.302+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33cc0065e0 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.302+0000 7f33c3fff640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 0x7f33bc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.302+0000 7f33d77fe640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 0x7f33bc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.302+0000 7f33d77fe640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 0x7f33bc0acb40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f33d00cc4a0 tx=0x7f33c4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.302+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f33cc083b90 con 0x7f33d00db090 2024-05-08T20:47:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.306+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8005260 con 0x7f33d00db090 2024-05-08T20:47:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.310+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f33cc017020 con 0x7f33d00db090 2024-05-08T20:47:50.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.818+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f33b8005a90 con 0x7f33d00db090 2024-05-08T20:47:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.818+0000 7f33c3fff640 1 -- 172.21.15.81:0/1293076264 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f33cc054690 con 0x7f33d00db090 2024-05-08T20:47:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 msgr2=0x7f33bc0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 0x7f33bc0acb40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f33d00cc4a0 tx=0x7f33c4009060 comp rx=0 tx=0).stop 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 msgr2=0x7f33d0198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00b440 tx=0x7f33cc00b900 comp rx=0 tx=0).stop 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 shutdown_connections 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f33bc0aa680 0x7f33bc0acb40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33d00db090 0x7f33d0198ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0046390 0x7f33d00de2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 --2- 172.21.15.81:0/1293076264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33d002ae70 0x7f33d0194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 >> 172.21.15.81:0/1293076264 conn(0x7f33d0005e70 msgr2=0x7f33d00d8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 shutdown_connections 2024-05-08T20:47:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:50.822+0000 7f33dcde1640 1 -- 172.21.15.81:0/1293076264 wait complete. 2024-05-08T20:47:53.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.030+0000 7f6d4cbd8640 1 Processor -- start 2024-05-08T20:47:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.030+0000 7f6d4cbd8640 1 -- start start 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d4cbd8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d4cbd8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d4000aa30 0x7f6d4000aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d4cbd8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4002e770 con 0x7f6d400d7920 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d4cbd8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d400dda60 con 0x7f6d4000aa30 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d4cbd8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400ddd40 con 0x7f6d40007ac0 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35610/0 (socket says 172.21.15.81:35610) 2024-05-08T20:47:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 -- 172.21.15.81:0/2052753164 learned_addr learned my addr 172.21.15.81:0/2052753164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 -- 172.21.15.81:0/2052753164 >> v2:172.21.15.117:3300/0 conn(0x7f6d4000aa30 msgr2=0x7f6d4000aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 --2- 172.21.15.81:0/2052753164 >> v2:172.21.15.117:3300/0 conn(0x7f6d4000aa30 0x7f6d4000aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 -- 172.21.15.81:0/2052753164 >> v1:172.21.15.117:6789/0 conn(0x7f6d400d7920 legacy=0x7f6d4004b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.034+0000 7f6d46ffd640 1 -- 172.21.15.81:0/2052753164 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d400de020 con 0x7f6d40007ac0 2024-05-08T20:47:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d46ffd640 1 --2- 172.21.15.81:0/2052753164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009870 tx=0x7f6d3c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=804c141384461748 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d467fc640 1 -- 172.21.15.81:0/2052753164 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0ab620 con 0x7f6d40007ac0 2024-05-08T20:47:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d467fc640 1 -- 172.21.15.81:0/2052753164 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0ab780 con 0x7f6d40007ac0 2024-05-08T20:47:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d467fc640 1 -- 172.21.15.81:0/2052753164 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0abb10 con 0x7f6d40007ac0 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/2052753164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 msgr2=0x7f6d40007f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/2052753164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009870 tx=0x7f6d3c01c460 comp rx=0 tx=0).stop 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/2052753164 shutdown_connections 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/2052753164 >> v2:172.21.15.117:3300/0 conn(0x7f6d4000aa30 0x7f6d4000aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/2052753164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d40007ac0 0x7f6d40007f20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/2052753164 >> 172.21.15.81:0/2052753164 conn(0x7f6d4002db70 msgr2=0x7f6d4002df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/2052753164 shutdown_connections 2024-05-08T20:47:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.038+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/2052753164 wait complete. 2024-05-08T20:47:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.042+0000 7f6d4cbd8640 1 Processor -- start 2024-05-08T20:47:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.042+0000 7f6d4cbd8640 1 -- start start 2024-05-08T20:47:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 0x7f6d400d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 0x7f6d4002c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 0x7f6d400cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d477fe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 msgr2=0x7f6d400d8990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400cd7f0 con 0x7f6d40007ac0 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 0x7f6d400d8990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400dc750 con 0x7f6d4000aa30 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400cd1e0 con 0x7f6d400d7920 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 0x7f6d400cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 0x7f6d4002c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 0x7f6d400cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:35626/0 (socket says 172.21.15.81:35626) 2024-05-08T20:47:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d47fff640 1 -- 172.21.15.81:0/1297676952 learned_addr learned my addr 172.21.15.81:0/1297676952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 -- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 msgr2=0x7f6d400cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 0x7f6d400cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 -- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 msgr2=0x7f6d400d8990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 0x7f6d400d8990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 -- 172.21.15.81:0/1297676952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0094d0 con 0x7f6d4000aa30 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d46ffd640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 0x7f6d4002c140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0ac000 tx=0x7f6d3c01aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0be3f0 con 0x7f6d4000aa30 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0be590 con 0x7f6d4000aa30 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0be940 con 0x7f6d4000aa30 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d400dc9f0 con 0x7f6d4000aa30 2024-05-08T20:47:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.046+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4004ac90 con 0x7f6d4000aa30 2024-05-08T20:47:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.050+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d400057c0 con 0x7f6d4000aa30 2024-05-08T20:47:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.050+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d3c0c7440 con 0x7f6d4000aa30 2024-05-08T20:47:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.058+0000 7f6d33fff640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 0x7f6d2c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.058+0000 7f6d477fe640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 0x7f6d2c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.066+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6d3c11ed10 con 0x7f6d4000aa30 2024-05-08T20:47:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.066+0000 7f6d477fe640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 0x7f6d2c068b00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000fa0 tx=0x7f6d34007a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.066+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6d3c0eb5c0 con 0x7f6d4000aa30 2024-05-08T20:47:54.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.498+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d400cd960 con 0x7f6d4000aa30 2024-05-08T20:47:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.498+0000 7f6d33fff640 1 -- 172.21.15.81:0/1297676952 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f6d3c0ef310 con 0x7f6d4000aa30 2024-05-08T20:47:54.503 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 msgr2=0x7f6d2c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 0x7f6d2c068b00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000fa0 tx=0x7f6d34007a00 comp rx=0 tx=0).stop 2024-05-08T20:47:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 msgr2=0x7f6d4002c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 0x7f6d4002c140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0ac000 tx=0x7f6d3c01aca0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 shutdown_connections 2024-05-08T20:47:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d2c066640 0x7f6d2c068b00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d400d7920 0x7f6d400cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d4000aa30 0x7f6d4002c140 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 --2- 172.21.15.81:0/1297676952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d40007ac0 0x7f6d400d8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 >> 172.21.15.81:0/1297676952 conn(0x7f6d4002db70 msgr2=0x7f6d4004b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 shutdown_connections 2024-05-08T20:47:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:54.502+0000 7f6d4cbd8640 1 -- 172.21.15.81:0/1297676952 wait complete. 2024-05-08T20:47:55.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:47:55.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:47:57.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:47:57.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 Processor -- start 2024-05-08T20:47:57.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 -- start start 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f010400b310 0x7f0104046f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0104006990 0x7f01040d8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040d87d0 con 0x7f01040d5610 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0104007780 con 0x7f010400b310 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f0110e1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040dc840 con 0x7f0104006990 2024-05-08T20:47:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f010400b310 0x7f0104046f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f010400b310 0x7f0104046f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:37102/0 (socket says 172.21.15.81:37102) 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 -- 172.21.15.81:0/3659918037 learned_addr learned my addr 172.21.15.81:0/3659918037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010affd640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0104006990 0x7f01040d8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 -- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0104006990 msgr2=0x7f01040d8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0104006990 0x7f01040d8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 -- 172.21.15.81:0/3659918037 >> v1:172.21.15.117:6789/0 conn(0x7f01040d5610 legacy=0x7f01040d5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.702+0000 7f010b7fe640 1 -- 172.21.15.81:0/3659918037 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104047490 con 0x7f010400b310 2024-05-08T20:47:57.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.714+0000 7f010b7fe640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010400b310 0x7f0104046f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0100009870 tx=0x7f010001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde30f7d9492c464 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f010a7fc640 1 -- 172.21.15.81:0/3659918037 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000ab650 con 0x7f010400b310 2024-05-08T20:47:57.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f010a7fc640 1 -- 172.21.15.81:0/3659918037 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01000ab7b0 con 0x7f010400b310 2024-05-08T20:47:57.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 -- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010400b310 msgr2=0x7f0104046f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:57.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010400b310 0x7f0104046f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0100009870 tx=0x7f010001c560 comp rx=0 tx=0).stop 2024-05-08T20:47:57.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 -- 172.21.15.81:0/3659918037 shutdown_connections 2024-05-08T20:47:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0104006990 0x7f01040d8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 --2- 172.21.15.81:0/3659918037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f010400b310 0x7f0104046f50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.718+0000 7f0110e1c640 1 -- 172.21.15.81:0/3659918037 >> 172.21.15.81:0/3659918037 conn(0x7f0104005e70 msgr2=0x7f0104006280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:57.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- 172.21.15.81:0/3659918037 shutdown_connections 2024-05-08T20:47:57.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- 172.21.15.81:0/3659918037 wait complete. 2024-05-08T20:47:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 Processor -- start 2024-05-08T20:47:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- start start 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 0x7f0104044d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040db2c0 0x7f0104045240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104042c20 con 0x7f01040d5610 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104183cb0 con 0x7f0104006990 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f0110e1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010402ae70 con 0x7f01040db2c0 2024-05-08T20:47:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f010affd640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 msgr2=0x7f0104044d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:47:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f010affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 0x7f0104044d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:47:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f010b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f010b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:37108/0 (socket says 172.21.15.81:37108) 2024-05-08T20:47:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.730+0000 7f010b7fe640 1 -- 172.21.15.81:0/4290862751 learned_addr learned my addr 172.21.15.81:0/4290862751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 -- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040db2c0 msgr2=0x7f0104045240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040db2c0 0x7f0104045240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 -- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 msgr2=0x7f0104044d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 0x7f0104044d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 -- 172.21.15.81:0/4290862751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01000094d0 con 0x7f0104006990 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f010b7fe640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0100019170 tx=0x7f010001ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000aa8c0 con 0x7f0104006990 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01000aaa20 con 0x7f0104006990 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000aadd0 con 0x7f0104006990 2024-05-08T20:47:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01040da730 con 0x7f0104006990 2024-05-08T20:47:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.734+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0104183940 con 0x7f0104006990 2024-05-08T20:47:57.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec005260 con 0x7f0104006990 2024-05-08T20:47:57.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01000b43f0 con 0x7f0104006990 2024-05-08T20:47:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f00f7fff640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 0x7f00f0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:47:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f010011eb30 con 0x7f0104006990 2024-05-08T20:47:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f010affd640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 0x7f00f0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:47:57.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.738+0000 7f010affd640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 0x7f00f0068b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f01040dbe50 tx=0x7f00f8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:47:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:57.742+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f01000ebba0 con 0x7f0104006990 2024-05-08T20:47:58.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.242+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f00ec005a90 con 0x7f0104006990 2024-05-08T20:47:58.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.242+0000 7f00f7fff640 1 -- 172.21.15.81:0/4290862751 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f01000c4620 con 0x7f0104006990 2024-05-08T20:47:58.248 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":156,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:47:58.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 msgr2=0x7f00f0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:58.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 0x7f00f0068b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f01040dbe50 tx=0x7f00f8009190 comp rx=0 tx=0).stop 2024-05-08T20:47:58.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 msgr2=0x7f0104172e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:47:58.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0100019170 tx=0x7f010001ada0 comp rx=0 tx=0).stop 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 shutdown_connections 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00f0066640 0x7f00f0068b00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040db2c0 0x7f0104045240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040d5610 0x7f0104044d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 --2- 172.21.15.81:0/4290862751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0104006990 0x7f0104172e10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 >> 172.21.15.81:0/4290862751 conn(0x7f0104005e70 msgr2=0x7f0104006250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 shutdown_connections 2024-05-08T20:47:58.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:47:58.246+0000 7f0110e1c640 1 -- 172.21.15.81:0/4290862751 wait complete. 2024-05-08T20:48:01.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.494+0000 7fd871b88640 1 Processor -- start 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 -- start start 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd86affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd86affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40432/0 (socket says 172.21.15.81:40432) 2024-05-08T20:48:01.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 learned_addr learned my addr 172.21.15.81:0/1263533467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd86b7fe640 1 -- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 msgr2=0x7fd86c0c9570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86c0c49e0 con 0x7fd86c15c6a0 2024-05-08T20:48:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c0c6560 con 0x7fd86c0c9190 2024-05-08T20:48:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.498+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0c4f10 con 0x7fd86c0c5150 2024-05-08T20:48:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.502+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.502+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.502+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.502+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.702+0000 7fd86b7fe640 1 -- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 msgr2=0x7fd86c0c9570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.702+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.710+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.710+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.710+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.710+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:01.710+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:02.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.106+0000 7fd86b7fe640 1 -- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 msgr2=0x7fd86c0c9570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:02.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.106+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:02.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.114+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:02.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.114+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:02.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.114+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:02.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.114+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:02.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.114+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.909+0000 7fd86b7fe640 1 -- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 msgr2=0x7fd86c0c9570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.909+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.917+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.917+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.917+0000 7fd86affd640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.917+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:02.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:02.917+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.333+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216416861 0 0) 0x7fd86c0c49e0 con 0x7fd86c15c6a0 2024-05-08T20:48:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.333+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd85c003530 con 0x7fd86c15c6a0 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3490659528 0 0) 0x7fd85c003530 con 0x7fd86c15c6a0 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd86c15c160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd86c15c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 msgr2=0x7fd86c0c9570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 --2- 172.21.15.81:0/1263533467 >> v2:172.21.15.81:3300/0 conn(0x7fd86c0c9190 0x7fd86c0c9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c0c4c30 con 0x7fd86c15c6a0 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fd858001660 con 0x7fd86c15c6a0 2024-05-08T20:48:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 >> v1:172.21.15.117:6789/0 conn(0x7fd86c15c6a0 legacy=0x7fd86c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c003980 0x7fd85c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd85c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd85c004d10 0x7fd85c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0c6560 con 0x7fd85c003980 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0c4f10 con 0x7fd85c004d10 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c00ba70 con 0x7fd86c0c5150 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86b7fe640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c003980 msgr2=0x7fd85c003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c003980 0x7fd85c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd85c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd85c004d10 0x7fd85c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 msgr2=0x7fd85c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd85c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c003980 msgr2=0x7fd85c003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c003980 0x7fd85c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.337+0000 7fd86bfff640 1 -- 172.21.15.81:0/1263533467 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c003530 con 0x7fd85c004d10 2024-05-08T20:48:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.341+0000 7fd86affd640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c0c5150 0x7fd85c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.341+0000 7fd86bfff640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd85c004d10 0x7fd85c005190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd858007f90 tx=0x7fd85801cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12702cf4bb6ffab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.341+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580a58c0 con 0x7fd85c004d10 2024-05-08T20:48:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.341+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8580a5a40 con 0x7fd85c004d10 2024-05-08T20:48:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.341+0000 7fd86a7fc640 1 -- 172.21.15.81:0/1263533467 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580a5df0 con 0x7fd85c004d10 2024-05-08T20:48:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.345+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd85c004d10 msgr2=0x7fd85c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.345+0000 7fd871b88640 1 --2- 172.21.15.81:0/1263533467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd85c004d10 0x7fd85c005190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd858007f90 tx=0x7fd85801cad0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.345+0000 7fd86bfff640 1 -- 172.21.15.81:0/1263533467 reap_dead start 2024-05-08T20:48:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.345+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 shutdown_connections 2024-05-08T20:48:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.345+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 >> 172.21.15.81:0/1263533467 conn(0x7fd86c0ca060 msgr2=0x7fd86c0ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 shutdown_connections 2024-05-08T20:48:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- 172.21.15.81:0/1263533467 wait complete. 2024-05-08T20:48:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 Processor -- start 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- start start 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 0x7fd86c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c151880 0x7fd86c0bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1509e0 con 0x7fd85c004d10 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0c09e0 con 0x7fd86c0d3650 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd871b88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1527b0 con 0x7fd86c151880 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd86b7fe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 msgr2=0x7fd86c150e00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.349+0000 7fd86b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 0x7fd86c150e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:04.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c151880 0x7fd86c0bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43360/0 (socket says 172.21.15.81:43360) 2024-05-08T20:48:04.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 -- 172.21.15.81:0/1843116236 learned_addr learned my addr 172.21.15.81:0/1843116236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:04.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 -- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c151880 msgr2=0x7fd86c0bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c151880 0x7fd86c0bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 -- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 msgr2=0x7fd86c150e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 0x7fd86c150e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 -- 172.21.15.81:0/1843116236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c0c0700 con 0x7fd86c0d3650 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd86affd640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd860004630 tx=0x7fd860003ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860017af0 con 0x7fd86c0d3650 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86000c040 con 0x7fd86c0d3650 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860017e90 con 0x7fd86c0d3650 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c150600 con 0x7fd86c0d3650 2024-05-08T20:48:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.353+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c0bf980 con 0x7fd86c0d3650 2024-05-08T20:48:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.357+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd86001e070 con 0x7fd86c0d3650 2024-05-08T20:48:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.357+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c150b20 con 0x7fd86c0d3650 2024-05-08T20:48:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.357+0000 7fd857fff640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 0x7fd850068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.357+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd860085240 con 0x7fd86c0d3650 2024-05-08T20:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.361+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 0x7fd850068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.361+0000 7fd86b7fe640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 0x7fd850068b30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd864003d40 tx=0x7fd8640072f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.361+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd86c150b20 con 0x7fd86c0d3650 2024-05-08T20:48:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.733+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd86c150b20 con 0x7fd86c0d3650 2024-05-08T20:48:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.733+0000 7fd857fff640 1 -- 172.21.15.81:0/1843116236 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fd860026620 con 0x7fd86c0d3650 2024-05-08T20:48:04.740 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":158,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 msgr2=0x7fd850068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 0x7fd850068b30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd864003d40 tx=0x7fd8640072f0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 msgr2=0x7fd86c151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd860004630 tx=0x7fd860003ab0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 shutdown_connections 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd850066670 0x7fd850068b30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd86c151880 0x7fd86c0bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd86c0d3650 0x7fd86c151340 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd860004630 tx=0x7fd860003ab0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 --2- 172.21.15.81:0/1843116236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c004d10 0x7fd86c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 >> 172.21.15.81:0/1843116236 conn(0x7fd86c0ca060 msgr2=0x7fd86c153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 shutdown_connections 2024-05-08T20:48:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.737+0000 7fd871b88640 1 -- 172.21.15.81:0/1843116236 wait complete. 2024-05-08T20:48:04.767 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:48:04.767 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:48:04.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:48:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 Processor -- start 2024-05-08T20:48:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 -- start start 2024-05-08T20:48:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fec071be0 0x7f8fec0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec071750 con 0x7f8fec06fa30 2024-05-08T20:48:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0ab670 con 0x7f8fec06f650 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff2cb0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0704b0 con 0x7f8fec071be0 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8febfff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f8fec06fa30 legacy=0x7f8fec1528f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff124d640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f8fec071be0 msgr2=0x7f8fec0c1bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff124d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fec071be0 0x7f8fec0c1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff0a4c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8fec06f650 0x7f8fec06cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:55128/0 (socket says 172.21.15.81:55128) 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8ff0a4c640 1 -- 172.21.15.81:0/3564173789 learned_addr learned my addr 172.21.15.81:0/3564173789 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572418058 0 0) 0x7f8fec0ab670 con 0x7f8fec06f650 2024-05-08T20:48:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd8003530 con 0x7f8fec06f650 2024-05-08T20:48:04.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1553900683 0 0) 0x7f8fd8003530 con 0x7f8fec06f650 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 >> v2:172.21.15.81:3300/0 conn(0x7f8fec071be0 msgr2=0x7f8fec0c1bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 --2- 172.21.15.81:0/3564173789 >> v2:172.21.15.81:3300/0 conn(0x7f8fec071be0 0x7f8fec0c1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 >> v1:172.21.15.81:6789/0 conn(0x7f8fec06fa30 legacy=0x7f8fec1528f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0ab950 con 0x7f8fec06f650 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8fdc001680 con 0x7f8fec06f650 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 >> v1:172.21.15.117:6789/0 conn(0x7f8fec06f650 legacy=0x7f8fec06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fd8003980 0x7f8fd8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 0x7f8fd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd80052b0 0x7f8fd800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0704b0 con 0x7f8fd80052b0 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8010610 con 0x7f8fd80047d0 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80107d0 con 0x7f8fd8003980 2024-05-08T20:48:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.961+0000 7f8febfff640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 0x7f8fd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8febfff640 1 -- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fd8003980 msgr2=0x7f8fd8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8febfff640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fd8003980 0x7f8fd8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8febfff640 1 -- 172.21.15.81:0/3564173789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd80052b0 msgr2=0x7f8fd800fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:04.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8febfff640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fd80052b0 0x7f8fd800fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8febfff640 1 -- 172.21.15.81:0/3564173789 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0ab950 con 0x7f8fd80047d0 2024-05-08T20:48:04.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.965+0000 7f8ff124d640 1 -- 172.21.15.81:0/3564173789 reap_dead start 2024-05-08T20:48:04.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.973+0000 7f8febfff640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 0x7f8fd8004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4003d10 tx=0x7f8fe401cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7a08c521c4af0a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40a5770 con 0x7f8fd80047d0 2024-05-08T20:48:04.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe40a58d0 con 0x7f8fd80047d0 2024-05-08T20:48:04.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8feb7fe640 1 -- 172.21.15.81:0/3564173789 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40a5cc0 con 0x7f8fd80047d0 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 msgr2=0x7f8fd8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 0x7f8fd8004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4003d10 tx=0x7f8fe401cad0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/3564173789 shutdown_connections 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/3564173789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fd80047d0 0x7f8fd8004c50 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4003d10 tx=0x7f8fe401cad0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/3564173789 >> 172.21.15.81:0/3564173789 conn(0x7f8fec0c2ca0 msgr2=0x7f8fec0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:04.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/3564173789 shutdown_connections 2024-05-08T20:48:04.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/3564173789 wait complete. 2024-05-08T20:48:04.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 Processor -- start 2024-05-08T20:48:04.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.977+0000 7f8ff2cb0640 1 -- start start 2024-05-08T20:48:04.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 0x7f8fec154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec155b20 0x7f8fec156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec1554d0 0x7f8fec156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec1e1020 con 0x7f8fec1554d0 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec14b3d0 con 0x7f8fec155b20 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec153e70 con 0x7f8fec14e570 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff124d640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec1554d0 msgr2=0x7f8fec156890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff124d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec1554d0 0x7f8fec156890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 0x7f8fec154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 0x7f8fec154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40488/0 (socket says 172.21.15.81:40488) 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 -- 172.21.15.81:0/2521180355 learned_addr learned my addr 172.21.15.81:0/2521180355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec155b20 msgr2=0x7f8fec156350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec155b20 0x7f8fec156350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec1554d0 msgr2=0x7f8fec156890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fec1554d0 0x7f8fec156890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:04.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec1ea170 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff0a4c640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 0x7f8fec154300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c770 tx=0x7f8fdc00cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0074e0 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec1ea450 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc007640 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.981+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec14b620 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.989+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0074e0 con 0x7f8fec14e570 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.989+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 0x7f8fec143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.989+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec154c20 con 0x7f8fec154840 2024-05-08T20:48:04.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.989+0000 7f8febfff640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 0x7f8fec143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.989+0000 7f8febfff640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fec0ab6e0 con 0x7f8fec154840 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fdc0047f0 con 0x7f8fec14e570 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8fe97fa640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fcc0666d0 0x7f8fcc068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8fdc0834a0 con 0x7f8fec14e570 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8ff124d640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fcc0666d0 0x7f8fcc068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8ff124d640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fcc0666d0 0x7f8fcc068b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8fec072c40 tx=0x7f8fd4006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:04.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8febfff640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 0x7f8fec143ee0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80057b0 tx=0x7f8fd8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.993+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40b2070 con 0x7f8fec154840 2024-05-08T20:48:05.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.997+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8fe40b3040 con 0x7f8fec154840 2024-05-08T20:48:05.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.997+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 msgr2=0x7f8fec143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.997+0000 7f8fe97fa640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 0x7f8fec143ee0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80057b0 tx=0x7f8fd8005800 comp rx=0 tx=0).stop 2024-05-08T20:48:05.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.997+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 msgr2=0x7f8fec143ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:05.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:04.997+0000 7f8fe97fa640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec154840 0x7f8fec143ee0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80057b0 tx=0x7f8fd8005800 comp rx=0 tx=0).stop 2024-05-08T20:48:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 0x7f8fec144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0696e0 con 0x7f8fec144420 2024-05-08T20:48:05.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8febfff640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 0x7f8fec144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8febfff640 1 -- 172.21.15.81:0/2521180355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8fec0c2ac0 con 0x7f8fec144420 2024-05-08T20:48:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8febfff640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 0x7f8fec144830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000f90 tx=0x7f8fe4009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40c4070 con 0x7f8fec144420 2024-05-08T20:48:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f8fe40b8460 con 0x7f8fec144420 2024-05-08T20:48:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 msgr2=0x7f8fec144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 0x7f8fec144830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000f90 tx=0x7f8fe4009520 comp rx=0 tx=0).stop 2024-05-08T20:48:05.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 msgr2=0x7f8fec144830 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8fe97fa640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fec144420 0x7f8fec144830 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000f90 tx=0x7f8fe4009520 comp rx=0 tx=0).stop 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 158, 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:48:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:48:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:48:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:48:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:48:05.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:48:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fcc0666d0 msgr2=0x7f8fcc068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8fcc0666d0 0x7f8fcc068b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8fec072c40 tx=0x7f8fd4006c50 comp rx=0 tx=0).stop 2024-05-08T20:48:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 msgr2=0x7f8fec154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff2cb0640 1 --2- 172.21.15.81:0/2521180355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fec14e570 0x7f8fec154300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c770 tx=0x7f8fdc00cc30 comp rx=0 tx=0).stop 2024-05-08T20:48:05.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff124d640 1 -- 172.21.15.81:0/2521180355 reap_dead start 2024-05-08T20:48:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.013+0000 7f8ff124d640 1 -- 172.21.15.81:0/2521180355 reap_dead start 2024-05-08T20:48:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.017+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 shutdown_connections 2024-05-08T20:48:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.017+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 >> 172.21.15.81:0/2521180355 conn(0x7f8fec0c2ca0 msgr2=0x7f8fec0c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.021+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 shutdown_connections 2024-05-08T20:48:05.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.021+0000 7f8ff2cb0640 1 -- 172.21.15.81:0/2521180355 wait complete. 2024-05-08T20:48:05.078 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:48:05.078 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:48:05.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:48:05.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.321+0000 7f9a0a209640 1 Processor -- start 2024-05-08T20:48:05.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.321+0000 7f9a0a209640 1 -- start start 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a0a209640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a0414fcb0 0x7f9a04153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7f9a04069ec0 legacy=0x7f9a0415d000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a0a209640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0406cf90 con 0x7f9a04069ec0 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a0a209640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a04153640 con 0x7f9a040c1bb0 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a0a209640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0406d5c0 con 0x7f9a0414fcb0 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a037fe640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f9a0414fcb0 msgr2=0x7f9a04153100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a037fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a0414fcb0 0x7f9a04153100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a02ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9a040c1bb0 0x7f9a0406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:55138/0 (socket says 172.21.15.81:55138) 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a02ffd640 1 -- 172.21.15.81:0/2337264705 learned_addr learned my addr 172.21.15.81:0/2337264705 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594445680 0 0) 0x7f9a04153640 con 0x7f9a040c1bb0 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ec003530 con 0x7f9a040c1bb0 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520423989 0 0) 0x7f99ec003530 con 0x7f9a040c1bb0 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 >> v2:172.21.15.81:3300/0 conn(0x7f9a0414fcb0 msgr2=0x7f9a04153100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 --2- 172.21.15.81:0/2337264705 >> v2:172.21.15.81:3300/0 conn(0x7f9a0414fcb0 0x7f9a04153100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 >> v1:172.21.15.81:6789/0 conn(0x7f9a04069ec0 legacy=0x7f9a0415d000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04150090 con 0x7f9a040c1bb0 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f99fc001a00 con 0x7f9a040c1bb0 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 >> v1:172.21.15.117:6789/0 conn(0x7f9a040c1bb0 legacy=0x7f9a0406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ec003980 0x7f99ec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0047d0 0x7f99ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f99ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0406d5c0 con 0x7f99ec003980 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec00c160 con 0x7f99ec0047d0 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec00c320 con 0x7f99ec005200 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f99ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0047d0 0x7f99ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 -- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0047d0 msgr2=0x7f99ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0047d0 0x7f99ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 -- 172.21.15.81:0/2337264705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ec003980 msgr2=0x7f99ec003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ec003980 0x7f99ec003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.325+0000 7f9a03fff640 1 -- 172.21.15.81:0/2337264705 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04150090 con 0x7f99ec005200 2024-05-08T20:48:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a03fff640 1 -- 172.21.15.81:0/2337264705 reap_dead start 2024-05-08T20:48:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f99ec00b990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99f8003990 tx=0x7f99f801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c30c5399b0715ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8003bc0 con 0x7f99ec005200 2024-05-08T20:48:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80a7070 con 0x7f99ec005200 2024-05-08T20:48:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a027fc640 1 -- 172.21.15.81:0/2337264705 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8005070 con 0x7f99ec005200 2024-05-08T20:48:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 -- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 msgr2=0x7f99ec00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f99ec00b990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99f8003990 tx=0x7f99f801c410 comp rx=0 tx=0).stop 2024-05-08T20:48:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 -- 172.21.15.81:0/2337264705 shutdown_connections 2024-05-08T20:48:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2337264705 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f99ec00b990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 -- 172.21.15.81:0/2337264705 >> 172.21.15.81:0/2337264705 conn(0x7f9a040c3cb0 msgr2=0x7f9a040c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 -- 172.21.15.81:0/2337264705 shutdown_connections 2024-05-08T20:48:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.329+0000 7f9a0a209640 1 -- 172.21.15.81:0/2337264705 wait complete. 2024-05-08T20:48:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 Processor -- start 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 -- start start 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f9a0415f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a040c6050 0x7f9a041443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a04141a20 0x7f9a04141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04155c00 con 0x7f9a040c6050 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04143f50 con 0x7f9a04141a20 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a0a209640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041563f0 con 0x7f99ec005200 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a02ffd640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a040c6050 msgr2=0x7f9a041443e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a040c6050 0x7f9a041443e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f9a0415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f9a0415f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40510/0 (socket says 172.21.15.81:40510) 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.333+0000 7f9a037fe640 1 -- 172.21.15.81:0/2073167078 learned_addr learned my addr 172.21.15.81:0/2073167078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a04141a20 msgr2=0x7f9a04141ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a04141a20 0x7f9a04141ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a040c6050 msgr2=0x7f9a041443e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a040c6050 0x7f9a041443e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04143900 con 0x7f99ec005200 2024-05-08T20:48:05.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a037fe640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f9a0415f730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99f400b410 tx=0x7f99f400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4003dd0 con 0x7f99ec005200 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40060d0 con 0x7f99ec005200 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4006480 con 0x7f99ec005200 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a04143be0 con 0x7f99ec005200 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.337+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a04153540 con 0x7f99ec005200 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 0x7f9a041f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04069550 con 0x7f9a041423e0 2024-05-08T20:48:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 0x7f9a041f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99f40065e0 con 0x7f99ec005200 2024-05-08T20:48:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99f00666c0 0x7f99f0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f99f4083ab0 con 0x7f99ec005200 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99f00666c0 0x7f99f0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a02ffd640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a0406d1e0 con 0x7f9a041423e0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 0x7f9a041f50d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ad30 tx=0x7f99fc007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f9a03fff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99f00666c0 0x7f99f0068b80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c4b0 tx=0x7f99f8005a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0019a0 con 0x7f9a041423e0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f99fc00ae20 con 0x7f9a041423e0 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 msgr2=0x7f9a041f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 0x7f9a041f50d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ad30 tx=0x7f99fc007430 comp rx=0 tx=0).stop 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 msgr2=0x7f9a041f50d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.341+0000 7f99ebfff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a041423e0 0x7f9a041f50d0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ad30 tx=0x7f99fc007430 comp rx=0 tx=0).stop 2024-05-08T20:48:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.373+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 0x7f9a0402b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.373+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04143a90 con 0x7f9a0402b270 2024-05-08T20:48:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.373+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 0x7f9a0402b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.373+0000 7f9a02ffd640 1 -- 172.21.15.81:0/2073167078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a04144090 con 0x7f9a0402b270 2024-05-08T20:48:05.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.373+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 0x7f9a0402b680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ad30 tx=0x7f99fc001dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc023070 con 0x7f9a0402b270 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4795 (secure 0 0 0) 0x7f99fc013e60 con 0x7f9a0402b270 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 msgr2=0x7f9a0402b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 0x7f9a0402b680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00ad30 tx=0x7f99fc001dc0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 msgr2=0x7f9a0402b680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.381+0000 7f99ebfff640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a0402b270 0x7f9a0402b680 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.391 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:48:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 158, 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:48:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:48:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:48:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:48:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:48:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:48:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:48:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:48:05.410 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99f00666c0 msgr2=0x7f99f0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99f00666c0 0x7f99f0068b80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c4b0 tx=0x7f99f8005a90 comp rx=0 tx=0).stop 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 msgr2=0x7f9a0415f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 --2- 172.21.15.81:0/2073167078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec005200 0x7f9a0415f730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99f400b410 tx=0x7f99f400b8d0 comp rx=0 tx=0).stop 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a03fff640 1 -- 172.21.15.81:0/2073167078 reap_dead start 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a03fff640 1 -- 172.21.15.81:0/2073167078 reap_dead start 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 shutdown_connections 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.385+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 >> 172.21.15.81:0/2073167078 conn(0x7f9a040c3cb0 msgr2=0x7f9a0406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.389+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 shutdown_connections 2024-05-08T20:48:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:05.389+0000 7f9a0a209640 1 -- 172.21.15.81:0/2073167078 wait complete. 2024-05-08T20:48:05.435 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:48:05.435 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:48:25.435 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:48:25.436 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-05-08T20:48:25.436 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:48:25.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:48:25.439 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:48:25.439 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:48:25.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:25.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 Processor -- start 2024-05-08T20:48:25.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 -- start start 2024-05-08T20:48:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb578151f00 0x7fb5781588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb578158e20 con 0x7fb578155690 2024-05-08T20:48:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57806bb20 con 0x7fb578154cf0 2024-05-08T20:48:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57ff6e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5781548e0 con 0x7fb578151f00 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39688/0 (socket says 172.21.15.81:39688) 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 -- 172.21.15.81:0/3142621351 learned_addr learned my addr 172.21.15.81:0/3142621351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 -- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 msgr2=0x7fb578155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 -- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 msgr2=0x7fb578155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 --2- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57d509640 1 --2- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/3142621351 >> v2:172.21.15.117:3300/0 conn(0x7fb578151f00 0x7fb5781588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57dd0a640 1 -- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 msgr2=0x7fb578155150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57dd0a640 1 -- 172.21.15.81:0/3142621351 >> v1:172.21.15.117:6789/0 conn(0x7fb578155690 legacy=0x7fb5780ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.817+0000 7fb57dd0a640 1 -- 172.21.15.81:0/3142621351 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5781522e0 con 0x7fb578151f00 2024-05-08T20:48:25.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/3142621351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb578151f00 0x7fb5781588e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5780cb390 tx=0x7fb57402d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f024641a09f8a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57cd08640 1 -- 172.21.15.81:0/3142621351 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740ba620 con 0x7fb578151f00 2024-05-08T20:48:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57cd08640 1 -- 172.21.15.81:0/3142621351 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5740ba780 con 0x7fb578151f00 2024-05-08T20:48:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57cd08640 1 -- 172.21.15.81:0/3142621351 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740bab10 con 0x7fb578151f00 2024-05-08T20:48:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57ff6e640 1 -- 172.21.15.81:0/3142621351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb578151f00 msgr2=0x7fb5781588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.821+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/3142621351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb578151f00 0x7fb5781588e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5780cb390 tx=0x7fb57402d470 comp rx=0 tx=0).stop 2024-05-08T20:48:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 -- 172.21.15.81:0/3142621351 shutdown_connections 2024-05-08T20:48:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/3142621351 >> v2:172.21.15.81:3300/0 conn(0x7fb578154cf0 0x7fb578155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/3142621351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb578151f00 0x7fb5781588e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 -- 172.21.15.81:0/3142621351 >> 172.21.15.81:0/3142621351 conn(0x7fb5780715f0 msgr2=0x7fb578071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 -- 172.21.15.81:0/3142621351 shutdown_connections 2024-05-08T20:48:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.825+0000 7fb57ff6e640 1 -- 172.21.15.81:0/3142621351 wait complete. 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 Processor -- start 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- start start 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5781e8b90 0x7fb5781ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39690/0 (socket says 172.21.15.81:39690) 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58928/0 (socket says 172.21.15.81:58928) 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 -- 172.21.15.81:0/269006212 learned_addr learned my addr 172.21.15.81:0/269006212 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5781ec2a0 con 0x7fb578154cf0 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5781569d0 con 0x7fb5781e8b90 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb578158b30 con 0x7fb578151f00 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 msgr2=0x7fb5780c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 msgr2=0x7fb5780c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:25.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57d509640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5781e8b90 msgr2=0x7fb5781ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5781e8b90 0x7fb5781ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 msgr2=0x7fb5780c8510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57401a4c0 con 0x7fb578151f00 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57dd0a640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb578158fd0 tx=0x7fb57402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:25.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740c3920 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5740c3ae0 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740c3e90 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb578158290 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.829+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb578158850 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5780675e0 con 0x7fb578151f00 2024-05-08T20:48:25.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5740cd440 con 0x7fb578151f00 2024-05-08T20:48:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb56e7fc640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 0x7fb55c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb57412fdf0 con 0x7fb578151f00 2024-05-08T20:48:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb57d509640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 0x7fb55c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:25.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.833+0000 7fb57d509640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 0x7fb55c068b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb57814f380 tx=0x7fb568008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:25.841+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb5740fcee0 con 0x7fb578151f00 2024-05-08T20:48:25.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:48:25.961 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:48:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.377+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb5781ec510 con 0x7fb578151f00 2024-05-08T20:48:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.381+0000 7fb56e7fc640 1 -- 172.21.15.81:0/269006212 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fb5740be070 con 0x7fb578151f00 2024-05-08T20:48:26.381 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":158,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.381+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 msgr2=0x7fb55c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.381+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 0x7fb55c068b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb57814f380 tx=0x7fb568008040 comp rx=0 tx=0).stop 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.381+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 msgr2=0x7fb578156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.381+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb578158fd0 tx=0x7fb57402a210 comp rx=0 tx=0).stop 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 shutdown_connections 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb55c066690 0x7fb55c068b50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5781e8b90 0x7fb5781ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb578154cf0 0x7fb5780c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 --2- 172.21.15.81:0/269006212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb578151f00 0x7fb578156490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:26.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 >> 172.21.15.81:0/269006212 conn(0x7fb5780715f0 msgr2=0x7fb57814c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:26.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 shutdown_connections 2024-05-08T20:48:26.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:26.385+0000 7fb57ff6e640 1 -- 172.21.15.81:0/269006212 wait complete. 2024-05-08T20:48:29.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:29.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 Processor -- start 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 -- start start 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 0x7f1378158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f1378158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780aa950 con 0x7f13780a8890 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780c2a00 con 0x7f13780c1e10 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137cc25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780a94f0 con 0x7f13780c21f0 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57078/0 (socket says 172.21.15.81:57078) 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 -- 172.21.15.81:0/2363543686 learned_addr learned my addr 172.21.15.81:0/2363543686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137659c640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 0x7f1378158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 -- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 msgr2=0x7f13780a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 -- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 msgr2=0x7f13780a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1376d9d640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 --2- 172.21.15.81:0/2363543686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f1378158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 -- 172.21.15.81:0/2363543686 >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 msgr2=0x7f1378158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 0x7f1378158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 -- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 msgr2=0x7f13780a9980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f1375d9b640 1 -- 172.21.15.81:0/2363543686 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780c0850 con 0x7f13780c21f0 2024-05-08T20:48:29.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.617+0000 7f137659c640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 0x7f1378158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f1375d9b640 1 --2- 172.21.15.81:0/2363543686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f1378158b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f137806ec10 tx=0x7f136c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243be1601da3ee37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137559a640 1 -- 172.21.15.81:0/2363543686 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780aa6d0 con 0x7f13780c21f0 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137559a640 1 -- 172.21.15.81:0/2363543686 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0a7050 con 0x7f13780c21f0 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137559a640 1 -- 172.21.15.81:0/2363543686 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0ab820 con 0x7f13780c21f0 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 -- 172.21.15.81:0/2363543686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 msgr2=0x7f1378158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 --2- 172.21.15.81:0/2363543686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f1378158b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f137806ec10 tx=0x7f136c01c410 comp rx=0 tx=0).stop 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 -- 172.21.15.81:0/2363543686 shutdown_connections 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 --2- 172.21.15.81:0/2363543686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f1378158b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.81:3300/0 conn(0x7f13780a8890 0x7f13780a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 --2- 172.21.15.81:0/2363543686 >> v2:172.21.15.117:3300/0 conn(0x7f13780c1e10 0x7f1378158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 -- 172.21.15.81:0/2363543686 >> 172.21.15.81:0/2363543686 conn(0x7f13780c2ca0 msgr2=0x7f13780c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:29.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 -- 172.21.15.81:0/2363543686 shutdown_connections 2024-05-08T20:48:29.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.621+0000 7f137cc25640 1 -- 172.21.15.81:0/2363543686 wait complete. 2024-05-08T20:48:29.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.625+0000 7f137cc25640 1 Processor -- start 2024-05-08T20:48:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.625+0000 7f137cc25640 1 -- start start 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f13780c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54572/0 (socket says 172.21.15.81:54572) 2024-05-08T20:48:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1375d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 -- 172.21.15.81:0/4017632248 learned_addr learned my addr 172.21.15.81:0/4017632248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137806c770 con 0x7f13780c1e10 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137806ca50 con 0x7f13780a8890 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137806cd30 con 0x7f13780c21f0 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1376d9d640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f13780c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1375d9b640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 msgr2=0x7f1378147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1375d9b640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 msgr2=0x7f1378147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1375d9b640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1375d9b640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 msgr2=0x7f13780c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f13780c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 msgr2=0x7f1378147e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009420 con 0x7f13780a8890 2024-05-08T20:48:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1376d9d640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f13780c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f137659c640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f136800ebe0 tx=0x7f136800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800eee0 con 0x7f13780a8890 2024-05-08T20:48:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800cc30 con 0x7f13780a8890 2024-05-08T20:48:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.629+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368013470 con 0x7f13780a8890 2024-05-08T20:48:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.633+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c009420 con 0x7f13780a8890 2024-05-08T20:48:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.633+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13780709a0 con 0x7f13780a8890 2024-05-08T20:48:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.633+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1378074950 con 0x7f13780a8890 2024-05-08T20:48:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.633+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13680059a0 con 0x7f13780a8890 2024-05-08T20:48:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.637+0000 7f1366ffd640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 0x7f1358068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.637+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1368084bb0 con 0x7f13780a8890 2024-05-08T20:48:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.637+0000 7f1375d9b640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 0x7f1358068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.637+0000 7f1375d9b640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 0x7f1358068c20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ad000 tx=0x7f136c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:29.641+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1368051ca0 con 0x7f13780a8890 2024-05-08T20:48:30.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f137cc25640 1 -- 172.21.15.81:0/4017632248 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f137806cb90 con 0x7f13780a8890 2024-05-08T20:48:30.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1366ffd640 1 -- 172.21.15.81:0/4017632248 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f137806cb90 con 0x7f13780a8890 2024-05-08T20:48:30.148 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":158,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:30.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 msgr2=0x7f1358068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:30.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 0x7f1358068c20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f136c0ad000 tx=0x7f136c0a6000 comp rx=0 tx=0).stop 2024-05-08T20:48:30.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 msgr2=0x7f137806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f136800ebe0 tx=0x7f136800c520 comp rx=0 tx=0).stop 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 shutdown_connections 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1358066760 0x7f1358068c20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13780c21f0 0x7f13780c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13780c1e10 0x7f1378147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 --2- 172.21.15.81:0/4017632248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13780a8890 0x7f137806b880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 >> 172.21.15.81:0/4017632248 conn(0x7f13780c2ca0 msgr2=0x7f137815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 shutdown_connections 2024-05-08T20:48:30.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:30.145+0000 7f1364ff9640 1 -- 172.21.15.81:0/4017632248 wait complete. 2024-05-08T20:48:33.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.393+0000 7fe47eccc640 1 Processor -- start 2024-05-08T20:48:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.393+0000 7fe47eccc640 1 -- start start 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.393+0000 7fe47eccc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.393+0000 7fe47eccc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe478070370 0x7fe4780c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47eccc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47815c370 con 0x7fe4780c2ef0 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47eccc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47815cd10 con 0x7fe478156450 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47eccc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47815c650 con 0x7fe478070370 2024-05-08T20:48:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57092/0 (socket says 172.21.15.81:57092) 2024-05-08T20:48:33.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 -- 172.21.15.81:0/2580533123 learned_addr learned my addr 172.21.15.81:0/2580533123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47e4cb640 1 --1- 172.21.15.81:0/2580533123 >> v1:172.21.15.117:6789/0 conn(0x7fe4780c2ef0 0x7fe478158ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:44870/0 (socket says 172.21.15.81:44870) 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 -- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 msgr2=0x7fe47806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 -- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 msgr2=0x7fe47806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419158750 0 0) 0x7fe47815c370 con 0x7fe4780c2ef0 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.397+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe464003530 con 0x7fe4780c2ef0 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834690693 0 0) 0x7fe464003530 con 0x7fe4780c2ef0 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 >> v2:172.21.15.117:3300/0 conn(0x7fe478070370 msgr2=0x7fe4780c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 --2- 172.21.15.81:0/2580533123 >> v2:172.21.15.117:3300/0 conn(0x7fe478070370 0x7fe4780c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 msgr2=0x7fe47806bfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 --2- 172.21.15.81:0/2580533123 >> v2:172.21.15.81:3300/0 conn(0x7fe478156450 0x7fe47806bfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47815c930 con 0x7fe4780c2ef0 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe470001a00 con 0x7fe4780c2ef0 2024-05-08T20:48:33.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 >> v1:172.21.15.117:6789/0 conn(0x7fe4780c2ef0 legacy=0x7fe478158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4640039d0 0x7fe464003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 0x7fe464004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464005390 0x7fe46401c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815cd10 con 0x7fe464005390 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815c650 con 0x7fe4640047d0 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46401d300 con 0x7fe4640039d0 2024-05-08T20:48:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 0x7fe464004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 -- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4640039d0 msgr2=0x7fe464003df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4640039d0 0x7fe464003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 -- 172.21.15.81:0/2580533123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464005390 msgr2=0x7fe46401c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464005390 0x7fe46401c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.401+0000 7fe47d4c9640 1 -- 172.21.15.81:0/2580533123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464003530 con 0x7fe4640047d0 2024-05-08T20:48:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.405+0000 7fe47e4cb640 1 -- 172.21.15.81:0/2580533123 reap_dead start 2024-05-08T20:48:33.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.405+0000 7fe47d4c9640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 0x7fe464004c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe468009860 tx=0x7fe46801c060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abae5968d82950a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:33.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.405+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47806c730 con 0x7fe4640047d0 2024-05-08T20:48:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.405+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4680a8690 con 0x7fe4640047d0 2024-05-08T20:48:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.405+0000 7fe47ccc8640 1 -- 172.21.15.81:0/2580533123 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680a8a40 con 0x7fe4640047d0 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 msgr2=0x7fe464004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 0x7fe464004c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe468009860 tx=0x7fe46801c060 comp rx=0 tx=0).stop 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- 172.21.15.81:0/2580533123 shutdown_connections 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2580533123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4640047d0 0x7fe464004c50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- 172.21.15.81:0/2580533123 >> 172.21.15.81:0/2580533123 conn(0x7fe4780c3aa0 msgr2=0x7fe4780c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- 172.21.15.81:0/2580533123 shutdown_connections 2024-05-08T20:48:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- 172.21.15.81:0/2580533123 wait complete. 2024-05-08T20:48:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 Processor -- start 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.409+0000 7fe47eccc640 1 -- start start 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4781edb90 0x7fe4780abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780a9cc0 con 0x7fe4640047d0 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780ab970 con 0x7fe4780ac340 2024-05-08T20:48:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780a98f0 con 0x7fe4781edb90 2024-05-08T20:48:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54618/0 (socket says 172.21.15.81:54618) 2024-05-08T20:48:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 -- 172.21.15.81:0/2804051812 learned_addr learned my addr 172.21.15.81:0/2804051812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47d4c9640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4781edb90 0x7fe4780abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47dcca640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 msgr2=0x7fe4780c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-08T20:48:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47dcca640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 msgr2=0x7fe4780c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4781edb90 msgr2=0x7fe4780abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4781edb90 0x7fe4780abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 msgr2=0x7fe4780c4b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 -- 172.21.15.81:0/2804051812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780a9650 con 0x7fe4780ac340 2024-05-08T20:48:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47e4cb640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe47806af20 tx=0x7fe47000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000ce50 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000a610 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000a9a0 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4781ee4c0 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4781588a0 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4780abb20 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.413+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe47000ab00 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.417+0000 7fe46e7fc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 0x7fe45c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.417+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe470083cb0 con 0x7fe4780ac340 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.417+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 0x7fe45c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.417+0000 7fe47dcca640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 0x7fe45c068b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe4781509e0 tx=0x7fe474008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.421+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe4780abb20 con 0x7fe4780ac340 2024-05-08T20:48:33.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.981+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe4780abb20 con 0x7fe4780ac340 2024-05-08T20:48:33.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.981+0000 7fe46e7fc640 1 -- 172.21.15.81:0/2804051812 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fe4780abb20 con 0x7fe4780ac340 2024-05-08T20:48:33.982 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":158,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":29,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 msgr2=0x7fe45c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 0x7fe45c068b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe4781509e0 tx=0x7fe474008040 comp rx=0 tx=0).stop 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 msgr2=0x7fe478145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe47806af20 tx=0x7fe47000cc00 comp rx=0 tx=0).stop 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 shutdown_connections 2024-05-08T20:48:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe45c066690 0x7fe45c068b50 secure :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe4781509e0 tx=0x7fe474008040 comp rx=0 tx=0).stop 2024-05-08T20:48:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4780ac340 0x7fe478145900 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4781edb90 0x7fe4780abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 --2- 172.21.15.81:0/2804051812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4640047d0 0x7fe4780c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:33.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 >> 172.21.15.81:0/2804051812 conn(0x7fe4780c3aa0 msgr2=0x7fe47806df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 shutdown_connections 2024-05-08T20:48:33.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:33.993+0000 7fe47eccc640 1 -- 172.21.15.81:0/2804051812 wait complete. 2024-05-08T20:48:37.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:37.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.293+0000 7f7ca4903640 1 Processor -- start 2024-05-08T20:48:37.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.293+0000 7f7ca4903640 1 -- start start 2024-05-08T20:48:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7ca4903640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ca00c21f0 0x7f7ca00a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7ca4903640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ca00a8890 0x7f7ca00a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7ca4903640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00c2a00 con 0x7f7ca00c1e10 2024-05-08T20:48:37.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7ca4903640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00aa950 con 0x7f7ca00a8890 2024-05-08T20:48:37.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7ca4903640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00a94f0 con 0x7f7ca00c21f0 2024-05-08T20:48:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.297+0000 7f7c9e59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7ca00c1e10 0x7f7ca0158610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:44878/0 (socket says 172.21.15.81:44878) 2024-05-08T20:48:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c9e59c640 1 -- 172.21.15.81:0/3287676809 learned_addr learned my addr 172.21.15.81:0/3287676809 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 --2- 172.21.15.81:0/3287676809 >> v2:172.21.15.117:3300/0 conn(0x7f7ca00c21f0 0x7f7ca00a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c9ed9d640 1 --2- 172.21.15.81:0/3287676809 >> v2:172.21.15.81:3300/0 conn(0x7f7ca00a8890 0x7f7ca00a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 -- 172.21.15.81:0/3287676809 >> v2:172.21.15.81:3300/0 conn(0x7f7ca00a8890 msgr2=0x7f7ca00a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:37.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 --2- 172.21.15.81:0/3287676809 >> v2:172.21.15.81:3300/0 conn(0x7f7ca00a8890 0x7f7ca00a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 -- 172.21.15.81:0/3287676809 >> v1:172.21.15.117:6789/0 conn(0x7f7ca00c1e10 legacy=0x7f7ca0158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 -- 172.21.15.81:0/3287676809 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00c0850 con 0x7f7ca00c21f0 2024-05-08T20:48:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.301+0000 7f7c95d9b640 1 --2- 172.21.15.81:0/3287676809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a9980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0072a70 tx=0x7f7c8801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f2154c40e057d13 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:37.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7c9dd9b640 1 -- 172.21.15.81:0/3287676809 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880ab600 con 0x7f7ca00c21f0 2024-05-08T20:48:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7c9dd9b640 1 -- 172.21.15.81:0/3287676809 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c880a7050 con 0x7f7ca00c21f0 2024-05-08T20:48:37.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7c9dd9b640 1 -- 172.21.15.81:0/3287676809 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880ab980 con 0x7f7ca00c21f0 2024-05-08T20:48:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 -- 172.21.15.81:0/3287676809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00c21f0 msgr2=0x7f7ca00a9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3287676809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a9980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0072a70 tx=0x7f7c8801c3b0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 -- 172.21.15.81:0/3287676809 shutdown_connections 2024-05-08T20:48:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3287676809 >> v2:172.21.15.81:3300/0 conn(0x7f7ca00a8890 0x7f7ca00a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3287676809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a9980 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 -- 172.21.15.81:0/3287676809 >> 172.21.15.81:0/3287676809 conn(0x7f7ca00c2ca0 msgr2=0x7f7ca00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 -- 172.21.15.81:0/3287676809 shutdown_connections 2024-05-08T20:48:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 -- 172.21.15.81:0/3287676809 wait complete. 2024-05-08T20:48:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.305+0000 7f7ca4903640 1 Processor -- start 2024-05-08T20:48:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 -- start start 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 0x7f7ca00c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 0x7f7ca00a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0150c20 con 0x7f7ca00c21f0 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00a8160 con 0x7f7ca00a8890 2024-05-08T20:48:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7ca4903640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca006c320 con 0x7f7ca00c1e10 2024-05-08T20:48:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c95d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 0x7f7ca00a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c95d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 0x7f7ca00a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:40238/0 (socket says 172.21.15.81:40238) 2024-05-08T20:48:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c95d9b640 1 -- 172.21.15.81:0/3525693720 learned_addr learned my addr 172.21.15.81:0/3525693720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9e59c640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 0x7f7ca00c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9ed9d640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9ed9d640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 msgr2=0x7f7ca00a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T20:48:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9ed9d640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 msgr2=0x7f7ca00a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:48:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9ed9d640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.309+0000 7f7c9ed9d640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.313+0000 7f7c9e59c640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 msgr2=0x7f7ca00a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.313+0000 7f7c9e59c640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 0x7f7ca00a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.313+0000 7f7c9e59c640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 msgr2=0x7f7ca00a7c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.313+0000 7f7c9e59c640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.313+0000 7f7c9e59c640 1 -- 172.21.15.81:0/3525693720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009420 con 0x7f7ca00a8890 2024-05-08T20:48:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c9e59c640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 0x7f7ca00c5710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c410 tx=0x7f7c9000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90005cf0 con 0x7f7ca00a8890 2024-05-08T20:48:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca006c600 con 0x7f7ca00a8890 2024-05-08T20:48:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00c5c50 con 0x7f7ca00a8890 2024-05-08T20:48:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90005e50 con 0x7f7ca00a8890 2024-05-08T20:48:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90007310 con 0x7f7ca00a8890 2024-05-08T20:48:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c90007470 con 0x7f7ca00a8890 2024-05-08T20:48:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.317+0000 7f7c977fe640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 0x7f7c80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.321+0000 7f7c95d9b640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 0x7f7c80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.321+0000 7f7c95d9b640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 0x7f7c80068b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801c3f0 tx=0x7f7c880a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.325+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7c90083ab0 con 0x7f7ca00a8890 2024-05-08T20:48:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.325+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84005260 con 0x7f7ca00a8890 2024-05-08T20:48:37.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.337+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7c90050b20 con 0x7f7ca00a8890 2024-05-08T20:48:37.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.937+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7c84005a90 con 0x7f7ca00a8890 2024-05-08T20:48:37.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.937+0000 7f7c977fe640 1 -- 172.21.15.81:0/3525693720 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f7c90017020 con 0x7f7ca00a8890 2024-05-08T20:48:37.940 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":158,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":33,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.941+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 msgr2=0x7f7c80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.941+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 0x7f7c80068b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801c3f0 tx=0x7f7c880a6000 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.941+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 msgr2=0x7f7ca00c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.941+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 0x7f7ca00c5710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c410 tx=0x7f7c9000c8d0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 shutdown_connections 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7c80066690 0x7f7c80068b50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca00c21f0 0x7f7ca00a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ca00c1e10 0x7f7ca00a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 --2- 172.21.15.81:0/3525693720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ca00a8890 0x7f7ca00c5710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 >> 172.21.15.81:0/3525693720 conn(0x7f7ca00c2ca0 msgr2=0x7f7ca00a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:37.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 shutdown_connections 2024-05-08T20:48:37.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:37.945+0000 7f7ca4903640 1 -- 172.21.15.81:0/3525693720 wait complete. 2024-05-08T20:48:40.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:41.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 Processor -- start 2024-05-08T20:48:41.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 -- start start 2024-05-08T20:48:41.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3415a1a0 con 0x7f9c340c6fd0 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c34159ca0 con 0x7f9c3415bc20 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c38f3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c52f0 con 0x7f9c34159810 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c337fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9c3415bc20 0x7f9c34065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:54830/0 (socket says 172.21.15.81:54830) 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.241+0000 7f9c337fe640 1 -- 172.21.15.81:0/817989541 learned_addr learned my addr 172.21.15.81:0/817989541 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.245+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.245+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.245+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.245+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.245+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.449+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.453+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.453+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.453+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.453+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:41.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.857+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:41.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.857+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:41.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.857+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:41.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.857+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:41.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:41.857+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:42.661+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:42.661+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:42.661+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:42.661+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:42.661+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.421+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552836790 0 0) 0x7f9c34159ca0 con 0x7f9c3415bc20 2024-05-08T20:48:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.421+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c003530 con 0x7f9c3415bc20 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602487827 0 0) 0x7f9c1c003530 con 0x7f9c3415bc20 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 msgr2=0x7f9c34164640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c34159810 0x7f9c34164640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 >> v1:172.21.15.81:6789/0 conn(0x7f9c340c6fd0 legacy=0x7f9c34159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3415c000 con 0x7f9c3415bc20 2024-05-08T20:48:43.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9c2c001a00 con 0x7f9c3415bc20 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 >> v1:172.21.15.117:6789/0 conn(0x7f9c3415bc20 legacy=0x7f9c34065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c1c0039b0 0x7f9c1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c1c0047d0 0x7f9c1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c1c0051e0 0x7f9c1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c00c0b0 con 0x7f9c1c0051e0 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c00c220 con 0x7f9c1c0047d0 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c00c3e0 con 0x7f9c1c0039b0 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c32ffd640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c1c0047d0 0x7f9c1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c1c0051e0 0x7f9c1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c1c0039b0 msgr2=0x7f9c1c003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c1c0039b0 0x7f9c1c003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c1c0047d0 msgr2=0x7f9c1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c1c0047d0 0x7f9c1c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:43.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.425+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3415c000 con 0x7f9c1c0051e0 2024-05-08T20:48:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.429+0000 7f9c33fff640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c1c0051e0 0x7f9c1c00b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9c34159bf0 tx=0x7f9c2401d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc826d687bd6ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.433+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240ae410 con 0x7f9c1c0051e0 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.433+0000 7f9c327fc640 1 -- 172.21.15.81:0/817989541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c240a8030 con 0x7f9c1c0051e0 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.433+0000 7f9c38f3e640 1 -- 172.21.15.81:0/817989541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c1c0051e0 msgr2=0x7f9c1c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.433+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/817989541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c1c0051e0 0x7f9c1c00b990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9c34159bf0 tx=0x7f9c2401d030 comp rx=0 tx=0).stop 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c33fff640 1 -- 172.21.15.81:0/817989541 reap_dead start 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 -- 172.21.15.81:0/817989541 shutdown_connections 2024-05-08T20:48:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 -- 172.21.15.81:0/817989541 >> 172.21.15.81:0/817989541 conn(0x7f9c340abda0 msgr2=0x7f9c340ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 -- 172.21.15.81:0/817989541 shutdown_connections 2024-05-08T20:48:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 -- 172.21.15.81:0/817989541 wait complete. 2024-05-08T20:48:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 Processor -- start 2024-05-08T20:48:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.437+0000 7f9c38f3e640 1 -- start start 2024-05-08T20:48:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c341f1a00 0x7f9c34153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 0x7f9c3414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 0x7f9c3414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340cae80 con 0x7f9c341f2240 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34153b20 con 0x7f9c341f1de0 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c38f3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340ca8c0 con 0x7f9c341f1a00 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c341f1a00 0x7f9c34153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c32ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 0x7f9c3414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c32ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 0x7f9c3414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:49760/0 (socket says 172.21.15.81:49760) 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c32ffd640 1 -- 172.21.15.81:0/838023476 learned_addr learned my addr 172.21.15.81:0/838023476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 0x7f9c3414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 -- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c341f1a00 msgr2=0x7f9c34153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c341f1a00 0x7f9c34153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 -- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 msgr2=0x7f9c3414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 0x7f9c3414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 -- 172.21.15.81:0/838023476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340caba0 con 0x7f9c341f2240 2024-05-08T20:48:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.441+0000 7f9c33fff640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 0x7f9c3414d5a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9c240ad000 tx=0x7f9c1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240aeb40 con 0x7f9c341f2240 2024-05-08T20:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2400c040 con 0x7f9c341f2240 2024-05-08T20:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240aeea0 con 0x7f9c341f2240 2024-05-08T20:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c340c7f80 con 0x7f9c341f2240 2024-05-08T20:48:43.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34151640 con 0x7f9c341f2240 2024-05-08T20:48:43.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34067c60 con 0x7f9c341f2240 2024-05-08T20:48:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.449+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c240b5040 con 0x7f9c341f2240 2024-05-08T20:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.453+0000 7f9c1bfff640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 0x7f9c20068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.453+0000 7f9c337fe640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 0x7f9c20068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.453+0000 7f9c337fe640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 0x7f9c20068ba0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c001570 tx=0x7f9c2c00c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.453+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9c240efae0 con 0x7f9c341f2240 2024-05-08T20:48:43.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:43.465+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9c240ebe20 con 0x7f9c341f2240 2024-05-08T20:48:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.037+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9c340668c0 con 0x7f9c341f2240 2024-05-08T20:48:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.037+0000 7f9c1bfff640 1 -- 172.21.15.81:0/838023476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f9c240ef440 con 0x7f9c341f2240 2024-05-08T20:48:44.041 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":162,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 msgr2=0x7f9c20068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 0x7f9c20068ba0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c001570 tx=0x7f9c2c00c040 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 msgr2=0x7f9c3414d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 0x7f9c3414d5a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9c240ad000 tx=0x7f9c1c005800 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 shutdown_connections 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9c200666e0 0x7f9c20068ba0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c341f2240 0x7f9c3414d5a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c341f1de0 0x7f9c3414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 --2- 172.21.15.81:0/838023476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c341f1a00 0x7f9c34153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 >> 172.21.15.81:0/838023476 conn(0x7f9c340abda0 msgr2=0x7f9c34157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 shutdown_connections 2024-05-08T20:48:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:44.041+0000 7f9c38f3e640 1 -- 172.21.15.81:0/838023476 wait complete. 2024-05-08T20:48:47.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 Processor -- start 2024-05-08T20:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 -- start start 2024-05-08T20:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87900ae2a0 con 0x7f87900c2bc0 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87900ac3c0 con 0x7f87900abdd0 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f879502e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879015d200 con 0x7f87900ad520 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878e59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59176/0 (socket says 172.21.15.81:59176) 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 learned_addr learned my addr 172.21.15.81:0/2794904548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.304+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.308+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:48:47.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.512+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:48:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:48:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:47.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:47.916+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878e59c640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878e59c640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:48.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878ed9d640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:48:48.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:48.720+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:48:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f87900ab3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f87900ab3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 msgr2=0x7f87900ad900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.117:3300/0 conn(0x7f87900abdd0 0x7f87900ad900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 -- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 msgr2=0x7f87900c3160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 --2- 172.21.15.81:0/2794904548 >> v2:172.21.15.81:3300/0 conn(0x7f87900c2bc0 0x7f87900c3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 -- 172.21.15.81:0/2794904548 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879015cf20 con 0x7f8778007370 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878cd99640 1 -- 172.21.15.81:0/2794904548 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877800c0f0 con 0x7f87780036c0 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097162679 0 0) 0x7f877800c0f0 con 0x7f87780036c0 2024-05-08T20:48:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f877c003530 con 0x7f87780036c0 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506621747 0 0) 0x7f877c003530 con 0x7f87780036c0 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 >> v1:172.21.15.81:6789/0 conn(0x7f8778007370 legacy=0x7f8778009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877800d2f0 con 0x7f87780036c0 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f878000e510 con 0x7f87780036c0 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 >> v1:172.21.15.117:6789/0 conn(0x7f87780036c0 legacy=0x7f8778005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f877c003a20 0x7f877c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f877c0047d0 0x7f877c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f877c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c005660 con 0x7f877c0047d0 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c00bed0 con 0x7f877c003a20 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c00c090 con 0x7f87900ad520 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 reap_dead start 2024-05-08T20:48:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f877c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f877c003a20 msgr2=0x7f877c003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f877c003a20 0x7f877c003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f877c0047d0 msgr2=0x7f877c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f877c0047d0 0x7f877c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.308+0000 7f878f59e640 1 -- 172.21.15.81:0/2794904548 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c003530 con 0x7f87900ad520 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f878f59e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f877c00b990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f877800b070 tx=0x7f878801d140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69bc6b89fb82343 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880ae410 con 0x7f87900ad520 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880a8030 con 0x7f87900ad520 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f878dd9b640 1 -- 172.21.15.81:0/2794904548 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880ae5f0 con 0x7f87900ad520 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 -- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f877c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f877c00b990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f877800b070 tx=0x7f878801d140 comp rx=0 tx=0).stop 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 -- 172.21.15.81:0/2794904548 shutdown_connections 2024-05-08T20:48:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f877c00b990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f877c0047d0 0x7f877c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 --2- 172.21.15.81:0/2794904548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f877c003a20 0x7f877c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.312+0000 7f879502e640 1 -- 172.21.15.81:0/2794904548 >> 172.21.15.81:0/2794904548 conn(0x7f87900c4cc0 msgr2=0x7f87900c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:50.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.316+0000 7f879502e640 1 -- 172.21.15.81:0/2794904548 shutdown_connections 2024-05-08T20:48:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.316+0000 7f879502e640 1 -- 172.21.15.81:0/2794904548 wait complete. 2024-05-08T20:48:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 Processor -- start 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 -- start start 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f879014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f879014ef10 0x7f8790158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879014e8b0 con 0x7f8790159320 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879014e230 con 0x7f879014ef10 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f879502e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879014dba0 con 0x7f87900ad520 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34952/0 (socket says 172.21.15.81:34952) 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 -- 172.21.15.81:0/2066462910 learned_addr learned my addr 172.21.15.81:0/2066462910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 -- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 msgr2=0x7f879014b6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:48:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f879014b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 -- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f879014ef10 msgr2=0x7f8790158de0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f879014ef10 0x7f8790158de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 -- 172.21.15.81:0/2066462910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879014e4d0 con 0x7f8790159320 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.320+0000 7f878f59e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f878801cf70 tx=0x7f8788019ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.324+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880130b0 con 0x7f8790159320 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.324+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879014bc10 con 0x7f8790159320 2024-05-08T20:48:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.324+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879014d7c0 con 0x7f8790159320 2024-05-08T20:48:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.324+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879014e050 con 0x7f8790159320 2024-05-08T20:48:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800f040 con 0x7f8790159320 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880aebf0 con 0x7f8790159320 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87880b5040 con 0x7f8790159320 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f87777fe640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 0x7f8778069a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f878811efb0 con 0x7f8790159320 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.328+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 0x7f8778069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.332+0000 7f878ed9d640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 0x7f8778069a60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f87800046a0 tx=0x7f8780004630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.336+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f87880ebff0 con 0x7f8790159320 2024-05-08T20:48:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:50.948+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8790074950 con 0x7f8790159320 2024-05-08T20:48:51.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f87777fe640 1 -- 172.21.15.81:0/2066462910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f87880b3020 con 0x7f8790159320 2024-05-08T20:48:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:48:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 msgr2=0x7f8778069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 0x7f8778069a60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f87800046a0 tx=0x7f8780004630 comp rx=0 tx=0).stop 2024-05-08T20:48:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 msgr2=0x7f8790151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f878801cf70 tx=0x7f8788019ee0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 shutdown_connections 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f87780675a0 0x7f8778069a60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8790159320 0x7f8790151d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f879014ef10 0x7f8790158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 --2- 172.21.15.81:0/2066462910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87900ad520 0x7f879014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.192+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 >> 172.21.15.81:0/2066462910 conn(0x7f87900c4cc0 msgr2=0x7f879015bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.196+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 shutdown_connections 2024-05-08T20:48:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.196+0000 7f879502e640 1 -- 172.21.15.81:0/2066462910 wait complete. 2024-05-08T20:48:51.242 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:48:51.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:48:51.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.488+0000 7f5a29945640 1 Processor -- start 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29945640 1 -- start start 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29945640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a240c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29945640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24065e20 con 0x7f5a240c88a0 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29945640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24066100 con 0x7f5a24159640 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29945640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24159b90 con 0x7f5a24152c90 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29144640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5a24159640 0x7f5a240c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:33962/0 (socket says 172.21.15.81:33962) 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a29144640 1 -- 172.21.15.81:0/1310352796 learned_addr learned my addr 172.21.15.81:0/1310352796 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:51.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a28943640 1 --2- 172.21.15.81:0/1310352796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a240c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990789961 0 0) 0x7f5a24065e20 con 0x7f5a240c88a0 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a0c003530 con 0x7f5a240c88a0 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150421576 0 0) 0x7f5a24066100 con 0x7f5a24159640 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a24065e20 con 0x7f5a24159640 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a28943640 1 -- 172.21.15.81:0/1310352796 >> v1:172.21.15.117:6789/0 conn(0x7f5a24159640 legacy=0x7f5a240c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a28943640 1 -- 172.21.15.81:0/1310352796 >> v1:172.21.15.81:6789/0 conn(0x7f5a240c88a0 legacy=0x7f5a240c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.492+0000 7f5a28943640 1 -- 172.21.15.81:0/1310352796 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240663e0 con 0x7f5a24152c90 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.496+0000 7f5a28943640 1 --2- 172.21.15.81:0/1310352796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a240c4a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a140097f0 tx=0x7f5a1401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ab12a457ff5305 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.496+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140ab600 con 0x7f5a24152c90 2024-05-08T20:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.496+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a140a7050 con 0x7f5a24152c90 2024-05-08T20:48:51.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.500+0000 7f5a237fe640 1 -- 172.21.15.81:0/1310352796 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140ab980 con 0x7f5a24152c90 2024-05-08T20:48:51.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.500+0000 7f5a29945640 1 -- 172.21.15.81:0/1310352796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 msgr2=0x7f5a240c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.500+0000 7f5a29945640 1 --2- 172.21.15.81:0/1310352796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a240c4a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a140097f0 tx=0x7f5a1401c450 comp rx=0 tx=0).stop 2024-05-08T20:48:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.504+0000 7f5a29945640 1 -- 172.21.15.81:0/1310352796 shutdown_connections 2024-05-08T20:48:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.504+0000 7f5a29945640 1 --2- 172.21.15.81:0/1310352796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a240c4a70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.504+0000 7f5a29945640 1 -- 172.21.15.81:0/1310352796 >> 172.21.15.81:0/1310352796 conn(0x7f5a240ca0f0 msgr2=0x7f5a240ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.504+0000 7f5a29945640 1 -- 172.21.15.81:0/1310352796 shutdown_connections 2024-05-08T20:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.504+0000 7f5a29945640 1 -- 172.21.15.81:0/1310352796 wait complete. 2024-05-08T20:48:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.508+0000 7f5a29945640 1 Processor -- start 2024-05-08T20:48:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.508+0000 7f5a29945640 1 -- start start 2024-05-08T20:48:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.508+0000 7f5a29945640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240c88a0 0x7f5a240c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.508+0000 7f5a29945640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a24144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.508+0000 7f5a29945640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 0x7f5a2414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a23fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a24144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a23fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a24144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:37960/0 (socket says 172.21.15.81:37960) 2024-05-08T20:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a23fff640 1 -- 172.21.15.81:0/2741612518 learned_addr learned my addr 172.21.15.81:0/2741612518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29945640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240c1f10 con 0x7f5a240c88a0 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29945640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24158080 con 0x7f5a24159640 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 0x7f5a2414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29945640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241574e0 con 0x7f5a24152c90 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 msgr2=0x7f5a24144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a24152c90 0x7f5a24144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240c88a0 msgr2=0x7f5a240c19d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240c88a0 0x7f5a240c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14009420 con 0x7f5a24159640 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29144640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 0x7f5a2414c390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00cad0 tx=0x7f5a1c00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00ab70 con 0x7f5a24159640 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00acd0 con 0x7f5a24159640 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c012600 con 0x7f5a24159640 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29945640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a24157750 con 0x7f5a24159640 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a29945640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a24157d10 con 0x7f5a24159640 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a0affd640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 0x7f59fc004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc007e90 con 0x7f59fc002a40 2024-05-08T20:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.512+0000 7f5a28943640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 0x7f59fc004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a28943640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59fc008050 con 0x7f59fc002a40 2024-05-08T20:48:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a1c012760 con 0x7f5a24159640 2024-05-08T20:48:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a28943640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 0x7f59fc004f00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a24066d90 tx=0x7f5a140191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5a10066690 0x7f5a10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5a1c084220 con 0x7f5a24159640 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140bd400 con 0x7f59fc002a40 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5a140bd560 con 0x7f59fc002a40 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 msgr2=0x7f59fc004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 0x7f59fc004f00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5a24066d90 tx=0x7f5a140191f0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 msgr2=0x7f59fc004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a217fa640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc002a40 0x7f59fc004f00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a23fff640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5a10066690 0x7f5a10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.516+0000 7f5a23fff640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5a10066690 0x7f5a10068b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a2414ea60 tx=0x7f5a18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.528+0000 7f5a0affd640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 0x7f59fc007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.528+0000 7f5a28943640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 0x7f59fc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.528+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc00a3f0 con 0x7f59fc006f00 2024-05-08T20:48:51.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.528+0000 7f5a28943640 1 -- 172.21.15.81:0/2741612518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f59fc0078d0 con 0x7f59fc006f00 2024-05-08T20:48:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.528+0000 7f5a28943640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 0x7f59fc007390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009740 tx=0x7f5a14009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14003820 con 0x7f59fc006f00 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f5a14003980 con 0x7f59fc006f00 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 msgr2=0x7f59fc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 0x7f59fc007390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009740 tx=0x7f5a14009190 comp rx=0 tx=0).stop 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 msgr2=0x7f59fc007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:51.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.532+0000 7f5a217fa640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59fc006f00 0x7f59fc007390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.535 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:48:51.536 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:48:51.537 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.538 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.543 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:48:51.544 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:48:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5a10066690 msgr2=0x7f5a10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5a10066690 0x7f5a10068b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5a2414ea60 tx=0x7f5a18009040 comp rx=0 tx=0).stop 2024-05-08T20:48:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a29144640 1 -- 172.21.15.81:0/2741612518 reap_dead start 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 msgr2=0x7f5a2414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 0x7f5a2414c390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00cad0 tx=0x7f5a1c00ced0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 shutdown_connections 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 --2- 172.21.15.81:0/2741612518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a24159640 0x7f5a2414c390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.540+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 >> 172.21.15.81:0/2741612518 conn(0x7f5a240ca0f0 msgr2=0x7f5a24163aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.544+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 shutdown_connections 2024-05-08T20:48:51.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.544+0000 7f5a0affd640 1 -- 172.21.15.81:0/2741612518 wait complete. 2024-05-08T20:48:51.607 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:48:51.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:48:51.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:48:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 Processor -- start 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 -- start start 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0adc0c1e10 0x7f0adc158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0adc0a8890 0x7f0adc158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0c2a00 con 0x7f0adc0c21f0 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0aa950 con 0x7f0adc0a8890 2024-05-08T20:48:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0ae1c2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0a94f0 con 0x7f0adc0c1e10 2024-05-08T20:48:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adaffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0adc0c21f0 0x7f0adc0a9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60996/0 (socket says 172.21.15.81:60996) 2024-05-08T20:48:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adaffd640 1 -- 172.21.15.81:0/2307128868 learned_addr learned my addr 172.21.15.81:0/2307128868 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/2307128868 >> v2:172.21.15.117:3300/0 conn(0x7f0adc0c1e10 0x7f0adc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adbfff640 1 --2- 172.21.15.81:0/2307128868 >> v2:172.21.15.81:3300/0 conn(0x7f0adc0a8890 0x7f0adc158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adb7fe640 1 -- 172.21.15.81:0/2307128868 >> v2:172.21.15.81:3300/0 conn(0x7f0adc0a8890 msgr2=0x7f0adc158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:51.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/2307128868 >> v2:172.21.15.81:3300/0 conn(0x7f0adc0a8890 0x7f0adc158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adb7fe640 1 -- 172.21.15.81:0/2307128868 >> v1:172.21.15.81:6789/0 conn(0x7f0adc0c21f0 legacy=0x7f0adc0a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.904+0000 7f0adb7fe640 1 -- 172.21.15.81:0/2307128868 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0c0850 con 0x7f0adc0c1e10 2024-05-08T20:48:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/2307128868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c1e10 0x7f0adc158610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0adc06ec10 tx=0x7f0ad001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac953c97412786dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0ada7fc640 1 -- 172.21.15.81:0/2307128868 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00ab600 con 0x7f0adc0c1e10 2024-05-08T20:48:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0ada7fc640 1 -- 172.21.15.81:0/2307128868 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad00a7050 con 0x7f0adc0c1e10 2024-05-08T20:48:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0ada7fc640 1 -- 172.21.15.81:0/2307128868 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00ab980 con 0x7f0adc0c1e10 2024-05-08T20:48:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/2307128868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c1e10 msgr2=0x7f0adc158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.908+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/2307128868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c1e10 0x7f0adc158610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0adc06ec10 tx=0x7f0ad001c3f0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/2307128868 shutdown_connections 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/2307128868 >> v2:172.21.15.81:3300/0 conn(0x7f0adc0a8890 0x7f0adc158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/2307128868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c1e10 0x7f0adc158610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/2307128868 >> 172.21.15.81:0/2307128868 conn(0x7f0adc0c2ca0 msgr2=0x7f0adc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/2307128868 shutdown_connections 2024-05-08T20:48:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/2307128868 wait complete. 2024-05-08T20:48:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 Processor -- start 2024-05-08T20:48:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- start start 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc0a8890 0x7f0adc070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0adc0c1e10 0x7f0adc1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc070a10 con 0x7f0adc0a8890 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc06f200 con 0x7f0adc0c21f0 2024-05-08T20:48:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc06f730 con 0x7f0adc0c1e10 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:50072/0 (socket says 172.21.15.81:50072) 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 -- 172.21.15.81:0/776025493 learned_addr learned my addr 172.21.15.81:0/776025493 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adaffd640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0adc0c1e10 0x7f0adc1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc0a8890 0x7f0adc070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0adc0c1e10 msgr2=0x7f0adc1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0adc0c1e10 0x7f0adc1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc0a8890 msgr2=0x7f0adc070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc0a8890 0x7f0adc070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009420 con 0x7f0adc0c21f0 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adaffd640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0adc0c1e10 0x7f0adc1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0adc0a8890 0x7f0adc070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0adbfff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009e30 tx=0x7f0ad400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4014480 con 0x7f0adc0c21f0 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc071370 con 0x7f0adc0c21f0 2024-05-08T20:48:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.912+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc06f450 con 0x7f0adc0c21f0 2024-05-08T20:48:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400f040 con 0x7f0adc0c21f0 2024-05-08T20:48:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 0x7f0abc004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc007e90 con 0x7f0abc002a40 2024-05-08T20:48:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4014840 con 0x7f0adc0c21f0 2024-05-08T20:48:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 0x7f0abc004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0adb7fe640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0abc008050 con 0x7f0abc002a40 2024-05-08T20:48:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.916+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ad40149e0 con 0x7f0adc0c21f0 2024-05-08T20:48:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ac8066690 0x7f0ac8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 0x7f0abc004f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0adc072a70 tx=0x7f0ad0019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0adaffd640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ac8066690 0x7f0ac8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0adaffd640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ac8066690 0x7f0ac8068b50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0adc1523d0 tx=0x7f0acc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0ad40852b0 con 0x7f0adc0c21f0 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00b6800 con 0x7f0abc002a40 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f0ad00b6960 con 0x7f0abc002a40 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 msgr2=0x7f0abc004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 0x7f0abc004f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0adc072a70 tx=0x7f0ad0019190 comp rx=0 tx=0).stop 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 msgr2=0x7f0abc004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:51.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.920+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc002a40 0x7f0abc004f00 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0adc072a70 tx=0x7f0ad0019190 comp rx=0 tx=0).stop 2024-05-08T20:48:51.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.932+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 0x7f0abc0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:51.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.932+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc00a350 con 0x7f0abc006f30 2024-05-08T20:48:51.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.932+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 0x7f0abc0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:51.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.936+0000 7f0adb7fe640 1 -- 172.21.15.81:0/776025493 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0abc00a510 con 0x7f0abc006f30 2024-05-08T20:48:51.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.936+0000 7f0adb7fe640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 0x7f0abc0073c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ad001c430 tx=0x7f0ad0009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:51.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00c7070 con 0x7f0abc006f30 2024-05-08T20:48:51.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f0ad0003620 con 0x7f0abc006f30 2024-05-08T20:48:51.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 msgr2=0x7f0abc0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 0x7f0abc0073c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ad001c430 tx=0x7f0ad0009190 comp rx=0 tx=0).stop 2024-05-08T20:48:51.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 msgr2=0x7f0abc0073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:51.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.940+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0abc006f30 0x7f0abc0073c0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ad001c430 tx=0x7f0ad0009190 comp rx=0 tx=0).stop 2024-05-08T20:48:51.945 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:48:51.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.946 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.947 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:48:51.948 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:51.949 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:51.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:48:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:48:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:48:51.957 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ac8066690 msgr2=0x7f0ac8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0ac8066690 0x7f0ac8068b50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0adc1523d0 tx=0x7f0acc009040 comp rx=0 tx=0).stop 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0adbfff640 1 -- 172.21.15.81:0/776025493 reap_dead start 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 msgr2=0x7f0adc071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009e30 tx=0x7f0ad400c490 comp rx=0 tx=0).stop 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 shutdown_connections 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 --2- 172.21.15.81:0/776025493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0adc0c21f0 0x7f0adc071680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 >> 172.21.15.81:0/776025493 conn(0x7f0adc0c2ca0 msgr2=0x7f0adc1567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 shutdown_connections 2024-05-08T20:48:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:51.948+0000 7f0ae1c2c640 1 -- 172.21.15.81:0/776025493 wait complete. 2024-05-08T20:48:51.998 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:48:51.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:48:51.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:48:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 Processor -- start 2024-05-08T20:48:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 -- start start 2024-05-08T20:48:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19b8069ec0 0x7f19b806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b8159b40 con 0x7f19b815cbc0 2024-05-08T20:48:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b806e220 con 0x7f19b806e660 2024-05-08T20:48:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b7fff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b8070770 con 0x7f19b8069ec0 2024-05-08T20:48:52.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19b815cbc0 0x7f19b8163560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32780/0 (socket says 172.21.15.81:32780) 2024-05-08T20:48:52.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.264+0000 7f19b77fe640 1 -- 172.21.15.81:0/1893836823 learned_addr learned my addr 172.21.15.81:0/1893836823 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:52.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b6ffd640 1 --2- 172.21.15.81:0/1893836823 >> v2:172.21.15.81:3300/0 conn(0x7f19b8069ec0 0x7f19b806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b6ffd640 1 -- 172.21.15.81:0/1893836823 >> v1:172.21.15.117:6789/0 conn(0x7f19b806e660 legacy=0x7f19b815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:48:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b6ffd640 1 -- 172.21.15.81:0/1893836823 >> v1:172.21.15.81:6789/0 conn(0x7f19b815cbc0 legacy=0x7f19b8163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b6ffd640 1 -- 172.21.15.81:0/1893836823 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b815d030 con 0x7f19b8069ec0 2024-05-08T20:48:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b6ffd640 1 --2- 172.21.15.81:0/1893836823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b8069ec0 0x7f19b806a2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009a20 tx=0x7f19a001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b29f98cd4dd58c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.268+0000 7f19b5ffb640 1 -- 172.21.15.81:0/1893836823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00ab650 con 0x7f19b8069ec0 2024-05-08T20:48:52.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b5ffb640 1 -- 172.21.15.81:0/1893836823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00ab7b0 con 0x7f19b8069ec0 2024-05-08T20:48:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- 172.21.15.81:0/1893836823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b8069ec0 msgr2=0x7f19b806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 --2- 172.21.15.81:0/1893836823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b8069ec0 0x7f19b806a2a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009a20 tx=0x7f19a001c490 comp rx=0 tx=0).stop 2024-05-08T20:48:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- 172.21.15.81:0/1893836823 shutdown_connections 2024-05-08T20:48:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 --2- 172.21.15.81:0/1893836823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b8069ec0 0x7f19b806a2a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- 172.21.15.81:0/1893836823 >> 172.21.15.81:0/1893836823 conn(0x7f19b80c3c20 msgr2=0x7f19b80c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:52.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- 172.21.15.81:0/1893836823 shutdown_connections 2024-05-08T20:48:52.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- 172.21.15.81:0/1893836823 wait complete. 2024-05-08T20:48:52.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 Processor -- start 2024-05-08T20:48:52.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- start start 2024-05-08T20:48:52.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 0x7f19b8155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19b806e660 0x7f19b80c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b815cbc0 0x7f19b80aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81f1c80 con 0x7f19b815cbc0 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80aa5d0 con 0x7f19b8069ec0 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.272+0000 7f19b7fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81f2140 con 0x7f19b806e660 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 0x7f19b8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 0x7f19b8155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:50086/0 (socket says 172.21.15.81:50086) 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 -- 172.21.15.81:0/679726836 learned_addr learned my addr 172.21.15.81:0/679726836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19b806e660 0x7f19b80c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19b806e660 msgr2=0x7f19b80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19b806e660 0x7f19b80c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b815cbc0 msgr2=0x7f19b80aaa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19b815cbc0 0x7f19b80aaa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009420 con 0x7f19b8069ec0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19b806e660 0x7f19b80c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b6ffd640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 0x7f19b8155710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad040 tx=0x7f19a0019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004300 con 0x7f19b8069ec0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0004460 con 0x7f19b8069ec0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003840 con 0x7f19b8069ec0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b7fff640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b81f1e60 con 0x7f19b8069ec0 2024-05-08T20:48:52.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.276+0000 7f19b7fff640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b814f160 con 0x7f19b8069ec0 2024-05-08T20:48:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.280+0000 7f19ad7fa640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 0x7f1990004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.280+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1990007e90 con 0x7f1990002a40 2024-05-08T20:48:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 0x7f1990004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19b67fc640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1990008050 con 0x7f1990002a40 2024-05-08T20:48:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 0x7f1990004f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19b814cce0 tx=0x7f19a800ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80052e0 con 0x7f1990002a40 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19a00039a0 con 0x7f19b8069ec0 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1998066730 0x7f1998068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f19a012fdc0 con 0x7f19b8069ec0 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19b77fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1998066730 0x7f1998068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f19a8005440 con 0x7f1990002a40 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 msgr2=0x7f1990004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 0x7f1990004f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19b814cce0 tx=0x7f19a800ff70 comp rx=0 tx=0).stop 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 msgr2=0x7f1990004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:52.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.284+0000 7f19af7fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990002a40 0x7f1990004f00 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19b814cce0 tx=0x7f19a800ff70 comp rx=0 tx=0).stop 2024-05-08T20:48:52.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.292+0000 7f19b77fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1998066730 0x7f1998068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f19b0001d10 tx=0x7f19b0007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19ad7fa640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 0x7f1990007420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199000a350 con 0x7f1990006f90 2024-05-08T20:48:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 0x7f1990007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19b67fc640 1 -- 172.21.15.81:0/679726836 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f199000a510 con 0x7f1990006f90 2024-05-08T20:48:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19b67fc640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 0x7f1990007420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1990008020 tx=0x7f19a8001030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.308+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8023070 con 0x7f1990006f90 2024-05-08T20:48:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f19a800de70 con 0x7f1990006f90 2024-05-08T20:48:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 msgr2=0x7f1990007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19af7fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 0x7f1990007420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1990008020 tx=0x7f19a8001030 comp rx=0 tx=0).stop 2024-05-08T20:48:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19af7fe640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 msgr2=0x7f1990007420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:48:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19af7fe640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1990006f90 0x7f1990007420 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1990008020 tx=0x7f19a8001030 comp rx=0 tx=0).stop 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:48:52.314 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:52.315 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:52.316 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:48:52.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.318 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:48:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:48:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:48:52.325 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1998066730 msgr2=0x7f1998068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1998066730 0x7f1998068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f19b0001d10 tx=0x7f19b0007d30 comp rx=0 tx=0).stop 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 msgr2=0x7f19b8155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 --2- 172.21.15.81:0/679726836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19b8069ec0 0x7f19b8155710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad040 tx=0x7f19a0019230 comp rx=0 tx=0).stop 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19b77fe640 1 -- 172.21.15.81:0/679726836 reap_dead start 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19b77fe640 1 -- 172.21.15.81:0/679726836 reap_dead start 2024-05-08T20:48:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 shutdown_connections 2024-05-08T20:48:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.312+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 >> 172.21.15.81:0/679726836 conn(0x7f19b80c3c20 msgr2=0x7f19b80c2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.316+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 shutdown_connections 2024-05-08T20:48:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.316+0000 7f19ad7fa640 1 -- 172.21.15.81:0/679726836 wait complete. 2024-05-08T20:48:52.346 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:48:52.346 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:48:52.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.548+0000 7f4296a98640 1 Processor -- start 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.548+0000 7f4296a98640 1 -- start start 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296a98640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4288046390 0x7f42880f9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f42880f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296a98640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4288006990 con 0x7f42880f5150 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296a98640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4288046f30 con 0x7f4288046390 2024-05-08T20:48:52.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4288047c60 con 0x7f428802ae70 2024-05-08T20:48:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296297640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42880f5150 0x7f42880fb540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32786/0 (socket says 172.21.15.81:32786) 2024-05-08T20:48:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4296297640 1 -- 172.21.15.81:0/533236231 learned_addr learned my addr 172.21.15.81:0/533236231 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:48:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4295a96640 1 --2- 172.21.15.81:0/533236231 >> v2:172.21.15.81:3300/0 conn(0x7f4288046390 0x7f42880f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4295a96640 1 -- 172.21.15.81:0/533236231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 msgr2=0x7f42880f8920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:48:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4295a96640 1 --2- 172.21.15.81:0/533236231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f42880f8920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4295a96640 1 -- 172.21.15.81:0/533236231 >> v1:172.21.15.81:6789/0 conn(0x7f42880f5150 legacy=0x7f42880fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.552+0000 7f4295a96640 1 -- 172.21.15.81:0/533236231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880071a0 con 0x7f4288046390 2024-05-08T20:48:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4295a96640 1 --2- 172.21.15.81:0/533236231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288046390 0x7f42880f9470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f428c009fd0 tx=0x7f428c01e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79c3379e181cd54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4294a94640 1 -- 172.21.15.81:0/533236231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ad600 con 0x7f4288046390 2024-05-08T20:48:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4294a94640 1 -- 172.21.15.81:0/533236231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c0a9050 con 0x7f4288046390 2024-05-08T20:48:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4294a94640 1 -- 172.21.15.81:0/533236231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ad980 con 0x7f4288046390 2024-05-08T20:48:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4296a98640 1 -- 172.21.15.81:0/533236231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288046390 msgr2=0x7f42880f9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.556+0000 7f4296a98640 1 --2- 172.21.15.81:0/533236231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288046390 0x7f42880f9470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f428c009fd0 tx=0x7f428c01e680 comp rx=0 tx=0).stop 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- 172.21.15.81:0/533236231 shutdown_connections 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 --2- 172.21.15.81:0/533236231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f42880f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 --2- 172.21.15.81:0/533236231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288046390 0x7f42880f9470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- 172.21.15.81:0/533236231 >> 172.21.15.81:0/533236231 conn(0x7f4288005e70 msgr2=0x7f4288006280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- 172.21.15.81:0/533236231 shutdown_connections 2024-05-08T20:48:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- 172.21.15.81:0/533236231 wait complete. 2024-05-08T20:48:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 Processor -- start 2024-05-08T20:48:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- start start 2024-05-08T20:48:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f4288101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4288046390 0x7f42880e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288101fa0 con 0x7f42880f5150 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880e9700 con 0x7f4288046390 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42881021d0 con 0x7f428802ae70 2024-05-08T20:48:52.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35012/0 (socket says 172.21.15.81:35012) 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 -- 172.21.15.81:0/1234302613 learned_addr learned my addr 172.21.15.81:0/1234302613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4295295640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4288046390 0x7f42880e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 -- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 msgr2=0x7f4288101a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f4288101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 -- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4288046390 msgr2=0x7f42880e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4288046390 0x7f42880e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:52.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.560+0000 7f4296297640 1 -- 172.21.15.81:0/1234302613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009cb0 con 0x7f42880f5150 2024-05-08T20:48:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f4296297640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42900638e0 tx=0x7f4290067ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900721c0 con 0x7f42880f5150 2024-05-08T20:48:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290072340 con 0x7f42880f5150 2024-05-08T20:48:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880f6cf0 con 0x7f42880f5150 2024-05-08T20:48:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42880f72b0 con 0x7f42880f5150 2024-05-08T20:48:52.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.564+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42880f74a0 con 0x7f42880f5150 2024-05-08T20:48:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.572+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900726f0 con 0x7f42880f5150 2024-05-08T20:48:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.572+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4290072910 con 0x7f42880f5150 2024-05-08T20:48:52.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.576+0000 7f42867fc640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 0x7f4274068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:48:52.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.576+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f42900eca00 con 0x7f42880f5150 2024-05-08T20:48:52.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.576+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f42900ecce0 con 0x7f42880f5150 2024-05-08T20:48:52.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.576+0000 7f4295a96640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 0x7f4274068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:48:52.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:52.576+0000 7f4295a96640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 0x7f4274068ca0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f428c0af000 tx=0x7f428c004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:48:53.086 INFO:tasks.workunit.client.1.smithi117.stdout:fs setup took 1132 secs 2024-05-08T20:48:53.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.156+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f4288005370 con 0x7f42880f5150 2024-05-08T20:48:53.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.160+0000 7f42867fc640 1 -- 172.21.15.81:0/1234302613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f42900b9aa0 con 0x7f42880f5150 2024-05-08T20:48:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.164+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 msgr2=0x7f4274068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.164+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 0x7f4274068ca0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f428c0af000 tx=0x7f428c004740 comp rx=0 tx=0).stop 2024-05-08T20:48:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.164+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 msgr2=0x7f42880f0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:48:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.164+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42900638e0 tx=0x7f4290067ba0 comp rx=0 tx=0).stop 2024-05-08T20:48:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 shutdown_connections 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42740667e0 0x7f4274068ca0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42880f5150 0x7f42880f0b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4288046390 0x7f42880e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 --2- 172.21.15.81:0/1234302613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428802ae70 0x7f4288101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 >> 172.21.15.81:0/1234302613 conn(0x7f4288005e70 msgr2=0x7f42880f2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 shutdown_connections 2024-05-08T20:48:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:48:53.168+0000 7f4296a98640 1 -- 172.21.15.81:0/1234302613 wait complete. 2024-05-08T20:48:53.232 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:48:54.178 INFO:tasks.workunit.client.1.smithi117.stdout:Syncing()...1 sec 2024-05-08T20:48:54.179 INFO:tasks.workunit.client.1.smithi117.stdout:Starting Actual Benchmark At: Wed May 8 20:48:54 2024 2024-05-08T20:48:54.179 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:48:56.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:48:56.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:49:03.234 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:49:03.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.588+0000 7f2e1a136640 1 Processor -- start 2024-05-08T20:49:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.588+0000 7f2e1a136640 1 -- start start 2024-05-08T20:49:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.592+0000 7f2e1a136640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e0c0d1160 0x7f2e0c008c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.592+0000 7f2e1a136640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e0c0d7a30 0x7f2e0c00b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.592+0000 7f2e1a136640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c00c200 con 0x7f2e0c04a7f0 2024-05-08T20:49:03.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.592+0000 7f2e1a136640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c047310 con 0x7f2e0c0d7a30 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.592+0000 7f2e1a136640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0475b0 con 0x7f2e0c0d1160 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.596+0000 7f2e137fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e0c0d1160 0x7f2e0c008c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.596+0000 7f2e137fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e0c0d1160 0x7f2e0c008c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:38638/0 (socket says 172.21.15.81:38638) 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.596+0000 7f2e137fe640 1 -- 172.21.15.81:0/1535086928 learned_addr learned my addr 172.21.15.81:0/1535086928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.600+0000 7f2e137fe640 1 -- 172.21.15.81:0/1535086928 >> v2:172.21.15.81:3300/0 conn(0x7f2e0c0d7a30 msgr2=0x7f2e0c00b5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.600+0000 7f2e137fe640 1 --2- 172.21.15.81:0/1535086928 >> v2:172.21.15.81:3300/0 conn(0x7f2e0c0d7a30 0x7f2e0c00b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.600+0000 7f2e137fe640 1 -- 172.21.15.81:0/1535086928 >> v1:172.21.15.81:6789/0 conn(0x7f2e0c04a7f0 legacy=0x7f2e0c00baf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:03.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.600+0000 7f2e137fe640 1 -- 172.21.15.81:0/1535086928 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c047890 con 0x7f2e0c0d1160 2024-05-08T20:49:03.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e137fe640 1 --2- 172.21.15.81:0/1535086928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c008c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c3e0 tx=0x7f2e0801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8124d6b6ae87c444 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e127fc640 1 -- 172.21.15.81:0/1535086928 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080ab600 con 0x7f2e0c0d1160 2024-05-08T20:49:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e127fc640 1 -- 172.21.15.81:0/1535086928 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080a7050 con 0x7f2e0c0d1160 2024-05-08T20:49:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e127fc640 1 -- 172.21.15.81:0/1535086928 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080ab980 con 0x7f2e0c0d1160 2024-05-08T20:49:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e1a136640 1 -- 172.21.15.81:0/1535086928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d1160 msgr2=0x7f2e0c008c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.604+0000 7f2e1a136640 1 --2- 172.21.15.81:0/1535086928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c008c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c3e0 tx=0x7f2e0801c3e0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.612+0000 7f2e1a136640 1 -- 172.21.15.81:0/1535086928 shutdown_connections 2024-05-08T20:49:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.612+0000 7f2e1a136640 1 --2- 172.21.15.81:0/1535086928 >> v2:172.21.15.81:3300/0 conn(0x7f2e0c0d7a30 0x7f2e0c00b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.612+0000 7f2e1a136640 1 --2- 172.21.15.81:0/1535086928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c008c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.612+0000 7f2e1a136640 1 -- 172.21.15.81:0/1535086928 >> 172.21.15.81:0/1535086928 conn(0x7f2e0c049370 msgr2=0x7f2e0c049780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.632+0000 7f2e1a136640 1 -- 172.21.15.81:0/1535086928 shutdown_connections 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.632+0000 7f2e1a136640 1 -- 172.21.15.81:0/1535086928 wait complete. 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 Processor -- start 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- start start 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e0c04a7f0 0x7f2e0c0d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d7a30 0x7f2e0c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c199400 con 0x7f2e0c0d1160 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c199120 con 0x7f2e0c0d7a30 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0d2440 con 0x7f2e0c04a7f0 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58760/0 (socket says 172.21.15.81:58760) 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 -- 172.21.15.81:0/2829552662 learned_addr learned my addr 172.21.15.81:0/2829552662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e13fff640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d7a30 0x7f2e0c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e137fe640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e0c04a7f0 0x7f2e0c0d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 -- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e0c04a7f0 msgr2=0x7f2e0c0d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e0c04a7f0 0x7f2e0c0d2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 -- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d7a30 msgr2=0x7f2e0c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d7a30 0x7f2e0c0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 -- 172.21.15.81:0/2829552662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080094d0 con 0x7f2e0c0d1160 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e12ffd640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000b3e0 tx=0x7f2e0000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:03.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e0c0d1160 2024-05-08T20:49:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c0d2720 con 0x7f2e0c0d1160 2024-05-08T20:49:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.636+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0d4460 con 0x7f2e0c0d1160 2024-05-08T20:49:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.640+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011990 con 0x7f2e0c0d1160 2024-05-08T20:49:03.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.640+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011d60 con 0x7f2e0c0d1160 2024-05-08T20:49:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.644+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e0001a400 con 0x7f2e0c0d1160 2024-05-08T20:49:03.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.644+0000 7f2dfffff640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 0x7f2df8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:03.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.644+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2e00084510 con 0x7f2e0c0d1160 2024-05-08T20:49:03.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.644+0000 7f2e137fe640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 0x7f2df8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.656+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4005260 con 0x7f2e0c0d1160 2024-05-08T20:49:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.660+0000 7f2e137fe640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 0x7f2df8068bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2e080ad000 tx=0x7f2e08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:03.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:03.676+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2e00015080 con 0x7f2e0c0d1160 2024-05-08T20:49:04.451 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.448+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2df4005a90 con 0x7f2e0c0d1160 2024-05-08T20:49:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.448+0000 7f2dfffff640 1 -- 172.21.15.81:0/2829552662 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f2e00051550 con 0x7f2e0c0d1160 2024-05-08T20:49:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.452+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 msgr2=0x7f2df8068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.452+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 0x7f2df8068bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2e080ad000 tx=0x7f2e08008040 comp rx=0 tx=0).stop 2024-05-08T20:49:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.452+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 msgr2=0x7f2e0c198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.452+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000b3e0 tx=0x7f2e0000b8a0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 shutdown_connections 2024-05-08T20:49:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2df8066710 0x7f2df8068bd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e0c0d7a30 0x7f2e0c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0c0d1160 0x7f2e0c198720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 --2- 172.21.15.81:0/2829552662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e0c04a7f0 0x7f2e0c0d2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.456+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 >> 172.21.15.81:0/2829552662 conn(0x7f2e0c049370 msgr2=0x7f2e0c049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:04.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.460+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 shutdown_connections 2024-05-08T20:49:04.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.460+0000 7f2e1a136640 1 -- 172.21.15.81:0/2829552662 wait complete. 2024-05-08T20:49:04.521 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:49:04.521 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:49:04.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:49:04.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:49:04.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.864+0000 7f9959fee640 1 Processor -- start 2024-05-08T20:49:04.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.864+0000 7f9959fee640 1 -- start start 2024-05-08T20:49:04.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f9959fee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f9959fee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99540a93c0 0x7f995406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f9959fee640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954165dc0 con 0x7f99540aa290 2024-05-08T20:49:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f9959fee640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99540aace0 con 0x7f99540a93c0 2024-05-08T20:49:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f9959fee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540aa990 con 0x7f99541659e0 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36348/0 (socket says 172.21.15.81:36348) 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 -- 172.21.15.81:0/358878817 learned_addr learned my addr 172.21.15.81:0/358878817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 -- 172.21.15.81:0/358878817 >> v2:172.21.15.81:3300/0 conn(0x7f99540a93c0 msgr2=0x7f995406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 --2- 172.21.15.81:0/358878817 >> v2:172.21.15.81:3300/0 conn(0x7f99540a93c0 0x7f995406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.868+0000 7f99537fe640 1 -- 172.21.15.81:0/358878817 >> v1:172.21.15.81:6789/0 conn(0x7f99540aa290 legacy=0x7f995406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.872+0000 7f99537fe640 1 -- 172.21.15.81:0/358878817 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540a9980 con 0x7f99541659e0 2024-05-08T20:49:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.872+0000 7f99537fe640 1 --2- 172.21.15.81:0/358878817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c770 tx=0x7f994c01d500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e3702db825edf3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.872+0000 7f99527fc640 1 -- 172.21.15.81:0/358878817 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0ab410 con 0x7f99541659e0 2024-05-08T20:49:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.876+0000 7f99527fc640 1 -- 172.21.15.81:0/358878817 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c0a7040 con 0x7f99541659e0 2024-05-08T20:49:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.876+0000 7f99527fc640 1 -- 172.21.15.81:0/358878817 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0ab410 con 0x7f99541659e0 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 -- 172.21.15.81:0/358878817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 msgr2=0x7f995406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 --2- 172.21.15.81:0/358878817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c770 tx=0x7f994c01d500 comp rx=0 tx=0).stop 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 -- 172.21.15.81:0/358878817 shutdown_connections 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 --2- 172.21.15.81:0/358878817 >> v2:172.21.15.81:3300/0 conn(0x7f99540a93c0 0x7f995406cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 --2- 172.21.15.81:0/358878817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99541659e0 0x7f995406c9d0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c770 tx=0x7f994c01d500 comp rx=0 tx=0).stop 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 -- 172.21.15.81:0/358878817 >> 172.21.15.81:0/358878817 conn(0x7f99540c2ca0 msgr2=0x7f99540c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 -- 172.21.15.81:0/358878817 shutdown_connections 2024-05-08T20:49:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.880+0000 7f9959fee640 1 -- 172.21.15.81:0/358878817 wait complete. 2024-05-08T20:49:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.928+0000 7f9959fee640 1 Processor -- start 2024-05-08T20:49:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.928+0000 7f9959fee640 1 -- start start 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99540a93c0 0x7f9954086fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415d020 0x7f9954081650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995406c240 con 0x7f99540a93c0 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995415b380 con 0x7f99540aa290 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540a8250 con 0x7f995415d020 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9953fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415d020 0x7f9954081650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:38644/0 (socket says 172.21.15.81:38644) 2024-05-08T20:49:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 -- 172.21.15.81:0/223192908 learned_addr learned my addr 172.21.15.81:0/223192908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415d020 msgr2=0x7f9954081650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995415d020 0x7f9954081650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99540a93c0 msgr2=0x7f9954086fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99540a93c0 0x7f9954086fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c00c3d0 con 0x7f99540aa290 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9952ffd640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f994800c4c0 tx=0x7f9948001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948005480 con 0x7f99540aa290 2024-05-08T20:49:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540717a0 con 0x7f99540aa290 2024-05-08T20:49:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948003600 con 0x7f99540aa290 2024-05-08T20:49:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.932+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948003990 con 0x7f99540aa290 2024-05-08T20:49:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9954071d60 con 0x7f99540aa290 2024-05-08T20:49:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9948003af0 con 0x7f99540aa290 2024-05-08T20:49:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f9959fee640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 0x7f9934004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934007e90 con 0x7f9934002a40 2024-05-08T20:49:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f993bfff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9940066690 0x7f9940068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.936+0000 7f9953fff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9940066690 0x7f9940068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f9953fff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9940066690 0x7f9940068b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9944006fd0 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9948083700 con 0x7f99540aa290 2024-05-08T20:49:04.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f99537fe640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 0x7f9934004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f99537fe640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9934008050 con 0x7f9934002a40 2024-05-08T20:49:04.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f99537fe640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 0x7f9934004f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9954073fc0 tx=0x7f994c01a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.940+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0042c0 con 0x7f9934002a40 2024-05-08T20:49:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.944+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f994c0b9070 con 0x7f9934002a40 2024-05-08T20:49:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.944+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 msgr2=0x7f9934004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.944+0000 7f993bfff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 0x7f9934004f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9954073fc0 tx=0x7f994c01a2a0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.944+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 msgr2=0x7f9934004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.944+0000 7f993bfff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934002a40 0x7f9934004f00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.952+0000 7f9959fee640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 0x7f99340073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:04.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.952+0000 7f99537fe640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 0x7f99340073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:04.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.952+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993400a350 con 0x7f9934006f20 2024-05-08T20:49:04.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f99537fe640 1 -- 172.21.15.81:0/223192908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f993400a510 con 0x7f9934006f20 2024-05-08T20:49:04.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f99537fe640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 0x7f99340073b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c770 tx=0x7f994c00c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:04.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0c48f0 con 0x7f9934006f20 2024-05-08T20:49:04.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f994c0c4a50 con 0x7f9934006f20 2024-05-08T20:49:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 msgr2=0x7f99340073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 0x7f99340073b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c770 tx=0x7f994c00c110 comp rx=0 tx=0).stop 2024-05-08T20:49:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 msgr2=0x7f99340073b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:04.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.956+0000 7f993bfff640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9934006f20 0x7f99340073b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:04.973 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:49:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 13, 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:04.984 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:04.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9940066690 msgr2=0x7f9940068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9940066690 0x7f9940068b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9944006fd0 tx=0x7f9944008040 comp rx=0 tx=0).stop 2024-05-08T20:49:04.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9953fff640 1 -- 172.21.15.81:0/223192908 reap_dead start 2024-05-08T20:49:04.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 msgr2=0x7f99540a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:04.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f994800c4c0 tx=0x7f9948001e80 comp rx=0 tx=0).stop 2024-05-08T20:49:04.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 shutdown_connections 2024-05-08T20:49:04.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 --2- 172.21.15.81:0/223192908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99540aa290 0x7f99540a74b0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f994800c4c0 tx=0x7f9948001e80 comp rx=0 tx=0).stop 2024-05-08T20:49:04.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 >> 172.21.15.81:0/223192908 conn(0x7f99540c2ca0 msgr2=0x7f995406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:04.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 shutdown_connections 2024-05-08T20:49:04.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:04.976+0000 7f9959fee640 1 -- 172.21.15.81:0/223192908 wait complete. 2024-05-08T20:49:05.023 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:05.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:49:05.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:49:05.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.312+0000 7f1ccca48640 1 Processor -- start 2024-05-08T20:49:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 -- start start 2024-05-08T20:49:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cc00d3ab0 0x7f1cc00069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cc00496e0 0x7f1cc0049b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0046820 con 0x7f1cc00462f0 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc0046b90 con 0x7f1cc00496e0 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1ccca48640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00473c0 con 0x7f1cc00d3ab0 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cc00496e0 0x7f1cc0049b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1cc00496e0 0x7f1cc0049b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58796/0 (socket says 172.21.15.81:58796) 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/3167592101 learned_addr learned my addr 172.21.15.81:0/3167592101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc659c640 1 --2- 172.21.15.81:0/3167592101 >> v2:172.21.15.117:3300/0 conn(0x7f1cc00d3ab0 0x7f1cc00069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/3167592101 >> v2:172.21.15.117:3300/0 conn(0x7f1cc00d3ab0 msgr2=0x7f1cc00069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 --2- 172.21.15.81:0/3167592101 >> v2:172.21.15.117:3300/0 conn(0x7f1cc00d3ab0 0x7f1cc00069c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/3167592101 >> v1:172.21.15.117:6789/0 conn(0x7f1cc00462f0 legacy=0x7f1cc0006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.316+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/3167592101 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0046fb0 con 0x7f1cc00496e0 2024-05-08T20:49:05.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.324+0000 7f1cc6d9d640 1 --2- 172.21.15.81:0/3167592101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00496e0 0x7f1cc0049b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cc807ae30 tx=0x7f1cc8096f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cee8287c9f9e5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.324+0000 7f1cc559a640 1 -- 172.21.15.81:0/3167592101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc811fd80 con 0x7f1cc00496e0 2024-05-08T20:49:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.324+0000 7f1cc559a640 1 -- 172.21.15.81:0/3167592101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc8127440 con 0x7f1cc00496e0 2024-05-08T20:49:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.324+0000 7f1cc559a640 1 -- 172.21.15.81:0/3167592101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8127870 con 0x7f1cc00496e0 2024-05-08T20:49:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.328+0000 7f1ccca48640 1 -- 172.21.15.81:0/3167592101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00496e0 msgr2=0x7f1cc0049b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.328+0000 7f1ccca48640 1 --2- 172.21.15.81:0/3167592101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00496e0 0x7f1cc0049b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cc807ae30 tx=0x7f1cc8096f30 comp rx=0 tx=0).stop 2024-05-08T20:49:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.340+0000 7f1ccca48640 1 -- 172.21.15.81:0/3167592101 shutdown_connections 2024-05-08T20:49:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.340+0000 7f1ccca48640 1 --2- 172.21.15.81:0/3167592101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00496e0 0x7f1cc0049b10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.340+0000 7f1ccca48640 1 --2- 172.21.15.81:0/3167592101 >> v2:172.21.15.117:3300/0 conn(0x7f1cc00d3ab0 0x7f1cc00069c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.340+0000 7f1ccca48640 1 -- 172.21.15.81:0/3167592101 >> 172.21.15.81:0/3167592101 conn(0x7f1cc0005ea0 msgr2=0x7f1cc00062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.344+0000 7f1ccca48640 1 -- 172.21.15.81:0/3167592101 shutdown_connections 2024-05-08T20:49:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 -- 172.21.15.81:0/3167592101 wait complete. 2024-05-08T20:49:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 Processor -- start 2024-05-08T20:49:05.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 -- start start 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 0x7f1cc00d7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc00496e0 0x7f1cc0199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc00d3ab0 0x7f1cc00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00da240 con 0x7f1cc00462f0 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01993c0 con 0x7f1cc00d3ab0 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1ccca48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00d9150 con 0x7f1cc00496e0 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1cc6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc00d3ab0 0x7f1cc00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1cc6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc00d3ab0 0x7f1cc00cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:38660/0 (socket says 172.21.15.81:38660) 2024-05-08T20:49:05.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.348+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/2128764819 learned_addr learned my addr 172.21.15.81:0/2128764819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:05.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 0x7f1cc00d7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc00496e0 msgr2=0x7f1cc0199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cc00496e0 0x7f1cc0199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc00d3ab0 msgr2=0x7f1cc00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cc00d3ab0 0x7f1cc00cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80682a0 con 0x7f1cc00462f0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cc659c640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 0x7f1cc00d7af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00bb20 tx=0x7f1cbc00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00f950 con 0x7f1cc00462f0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00fab0 con 0x7f1cc00462f0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00fe20 con 0x7f1cc00462f0 2024-05-08T20:49:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1ccca48640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00d88b0 con 0x7f1cc00462f0 2024-05-08T20:49:05.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.352+0000 7f1ccca48640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00d8e70 con 0x7f1cc00462f0 2024-05-08T20:49:05.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.356+0000 7f1cb4ff9640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 0x7f1cac004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.356+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac007e90 con 0x7f1cac002a40 2024-05-08T20:49:05.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.360+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cbc014070 con 0x7f1cc00462f0 2024-05-08T20:49:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.360+0000 7f1cb6ffd640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ca80666e0 0x7f1ca8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.360+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1cbc083b00 con 0x7f1cc00462f0 2024-05-08T20:49:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.364+0000 7f1cc6d9d640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ca80666e0 0x7f1ca8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.364+0000 7f1cc6d9d640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ca80666e0 0x7f1ca8068ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80638e0 tx=0x7f1cc807c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cc5d9b640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 0x7f1cac004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cc5d9b640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cac008050 con 0x7f1cac002a40 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cc5d9b640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 0x7f1cac004f00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0030aa0 tx=0x7f1cb800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8005280 con 0x7f1cac002a40 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1cb80053e0 con 0x7f1cac002a40 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 msgr2=0x7f1cac004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 0x7f1cac004f00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0030aa0 tx=0x7f1cb800c7a0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 msgr2=0x7f1cac004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.376+0000 7f1cb6ffd640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac002a40 0x7f1cac004f00 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0030aa0 tx=0x7f1cb800c7a0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.388+0000 7f1cb4ff9640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 0x7f1cac0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.388+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac00a350 con 0x7f1cac006f70 2024-05-08T20:49:05.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.388+0000 7f1cc5d9b640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 0x7f1cac0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.392+0000 7f1cc5d9b640 1 -- 172.21.15.81:0/2128764819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1cac00a510 con 0x7f1cac006f70 2024-05-08T20:49:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cc5d9b640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 0x7f1cac0073e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007000 tx=0x7f1cb8001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb801e070 con 0x7f1cac006f70 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f1cb80076b0 con 0x7f1cac006f70 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 msgr2=0x7f1cac0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 0x7f1cac0073e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007000 tx=0x7f1cb8001090 comp rx=0 tx=0).stop 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 msgr2=0x7f1cac0073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.396+0000 7f1cb6ffd640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cac006f70 0x7f1cac0073e0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007000 tx=0x7f1cb8001090 comp rx=0 tx=0).stop 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:05.410 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ca80666e0 msgr2=0x7f1ca8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ca80666e0 0x7f1ca8068ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80638e0 tx=0x7f1cc807c040 comp rx=0 tx=0).stop 2024-05-08T20:49:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cc6d9d640 1 -- 172.21.15.81:0/2128764819 reap_dead start 2024-05-08T20:49:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 msgr2=0x7f1cc00d7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 0x7f1cc00d7af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00bb20 tx=0x7f1cbc00df80 comp rx=0 tx=0).stop 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 shutdown_connections 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 --2- 172.21.15.81:0/2128764819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cc00462f0 0x7f1cc00d7af0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00bb20 tx=0x7f1cbc00df80 comp rx=0 tx=0).stop 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 >> 172.21.15.81:0/2128764819 conn(0x7f1cc0005ea0 msgr2=0x7f1cc00d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 shutdown_connections 2024-05-08T20:49:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.404+0000 7f1cb4ff9640 1 -- 172.21.15.81:0/2128764819 wait complete. 2024-05-08T20:49:05.467 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:05.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:49:05.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:49:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.812+0000 7fe39c52b640 1 Processor -- start 2024-05-08T20:49:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.812+0000 7fe39c52b640 1 -- start start 2024-05-08T20:49:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39c52b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe39414e1c0 0x7fe3940aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39c52b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3940c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39c52b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe394150c50 con 0x7fe3940c2800 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39c52b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940aa8c0 con 0x7fe39414e1c0 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39c52b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe394150ef0 con 0x7fe3941516f0 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe39414e1c0 0x7fe3940aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe39414e1c0 0x7fe3940aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58818/0 (socket says 172.21.15.81:58818) 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 -- 172.21.15.81:0/612925868 learned_addr learned my addr 172.21.15.81:0/612925868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 -- 172.21.15.81:0/612925868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 msgr2=0x7fe3940c1bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 --2- 172.21.15.81:0/612925868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3940c1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 -- 172.21.15.81:0/612925868 >> v1:172.21.15.81:6789/0 conn(0x7fe3940c2800 legacy=0x7fe394151f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.816+0000 7fe39a2c7640 1 -- 172.21.15.81:0/612925868 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3941511d0 con 0x7fe39414e1c0 2024-05-08T20:49:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.820+0000 7fe39a2c7640 1 --2- 172.21.15.81:0/612925868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39414e1c0 0x7fe3940aa200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721ac8b8b0762c1e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe3992c5640 1 -- 172.21.15.81:0/612925868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900ab600 con 0x7fe39414e1c0 2024-05-08T20:49:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe3992c5640 1 -- 172.21.15.81:0/612925868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3900ab760 con 0x7fe39414e1c0 2024-05-08T20:49:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe3992c5640 1 -- 172.21.15.81:0/612925868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900abaf0 con 0x7fe39414e1c0 2024-05-08T20:49:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- 172.21.15.81:0/612925868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39414e1c0 msgr2=0x7fe3940aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 --2- 172.21.15.81:0/612925868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39414e1c0 0x7fe3940aa200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39001c480 comp rx=0 tx=0).stop 2024-05-08T20:49:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- 172.21.15.81:0/612925868 shutdown_connections 2024-05-08T20:49:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 --2- 172.21.15.81:0/612925868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3940c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 --2- 172.21.15.81:0/612925868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39414e1c0 0x7fe3940aa200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- 172.21.15.81:0/612925868 >> 172.21.15.81:0/612925868 conn(0x7fe3940c2ca0 msgr2=0x7fe3940c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- 172.21.15.81:0/612925868 shutdown_connections 2024-05-08T20:49:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- 172.21.15.81:0/612925868 wait complete. 2024-05-08T20:49:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 Processor -- start 2024-05-08T20:49:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.824+0000 7fe39c52b640 1 -- start start 2024-05-08T20:49:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 0x7fe3940720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3941f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394070500 0x7fe3941f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394072760 con 0x7fe3940c2800 2024-05-08T20:49:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 0x7fe3940720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 0x7fe3940720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58834/0 (socket says 172.21.15.81:58834) 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 -- 172.21.15.81:0/1932839776 learned_addr learned my addr 172.21.15.81:0/1932839776 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394070070 con 0x7fe394070500 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3941f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39406fd70 con 0x7fe3941516f0 2024-05-08T20:49:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39aac8640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394070500 0x7fe3941f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 msgr2=0x7fe3941f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3941f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394070500 msgr2=0x7fe3941f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394070500 0x7fe3941f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900094d0 con 0x7fe3940c2800 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39a2c7640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 0x7fe3940720b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3900ad040 tx=0x7fe39001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.828+0000 7fe39aac8640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe394070500 0x7fe3941f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:49:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.832+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900be5f0 con 0x7fe3940c2800 2024-05-08T20:49:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.832+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3900be770 con 0x7fe3940c2800 2024-05-08T20:49:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.832+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900beb20 con 0x7fe3940c2800 2024-05-08T20:49:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.832+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3941f3120 con 0x7fe3940c2800 2024-05-08T20:49:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.832+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39414b1f0 con 0x7fe3940c2800 2024-05-08T20:49:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.836+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3941516f0 0x7fe3941f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:49:05.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.840+0000 7fe39c52b640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 0x7fe37c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.840+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c007e90 con 0x7fe37c002a40 2024-05-08T20:49:05.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.840+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 0x7fe37c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.840+0000 7fe399ac6640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe37c008050 con 0x7fe37c002a40 2024-05-08T20:49:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.844+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 0x7fe37c004f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c00a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3900b43f0 con 0x7fe3940c2800 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3780666e0 0x7fe378068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00f620 con 0x7fe37c002a40 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe39011f1b0 con 0x7fe3940c2800 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe38c00ae90 con 0x7fe37c002a40 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 msgr2=0x7fe37c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 0x7fe37c004f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c00a5f0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 msgr2=0x7fe37c004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe38affd640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c002a40 0x7fe37c004f00 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c00a5f0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe39aac8640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3780666e0 0x7fe378068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.848+0000 7fe39aac8640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3780666e0 0x7fe378068ba0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe38400a850 tx=0x7fe384008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.860+0000 7fe39c52b640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 0x7fe37c007420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:05.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.860+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c00a350 con 0x7fe37c006f90 2024-05-08T20:49:05.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.860+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 0x7fe37c007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:05.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.860+0000 7fe399ac6640 1 -- 172.21.15.81:0/1932839776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe37c00a510 con 0x7fe37c006f90 2024-05-08T20:49:05.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.860+0000 7fe399ac6640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 0x7fe37c007420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c004b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c01c040 con 0x7fe37c006f90 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7fe38c027420 con 0x7fe37c006f90 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 msgr2=0x7fe37c007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 0x7fe37c007420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c004b00 comp rx=0 tx=0).stop 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 msgr2=0x7fe37c007420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.868+0000 7fe38affd640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe37c006f90 0x7fe37c007420 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe39415b320 tx=0x7fe38c004b00 comp rx=0 tx=0).stop 2024-05-08T20:49:05.871 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:05.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:05.871 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:05.871 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 170, 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:05.872 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.873 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:05.875 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:05.876 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:05.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:05.879 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:05.881 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.882 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.883 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:05.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:05.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3780666e0 msgr2=0x7fe378068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe3780666e0 0x7fe378068ba0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe38400a850 tx=0x7fe384008040 comp rx=0 tx=0).stop 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 msgr2=0x7fe3940720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 --2- 172.21.15.81:0/1932839776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3940c2800 0x7fe3940720b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3900ad040 tx=0x7fe39001acc0 comp rx=0 tx=0).stop 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39aac8640 1 -- 172.21.15.81:0/1932839776 reap_dead start 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39aac8640 1 -- 172.21.15.81:0/1932839776 reap_dead start 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 shutdown_connections 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 >> 172.21.15.81:0/1932839776 conn(0x7fe3940c2ca0 msgr2=0x7fe3940a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 shutdown_connections 2024-05-08T20:49:05.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:05.880+0000 7fe39c52b640 1 -- 172.21.15.81:0/1932839776 wait complete. 2024-05-08T20:49:05.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:05.933 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-05-08T20:49:05.933 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:49:05.933 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-05-08T20:49:05.933 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:49:05.933 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:49:05.933 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:49:05.950 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:49:05.950 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:49:05.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 Processor -- start 2024-05-08T20:49:06.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 -- start start 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0200ab1c0 0x7fe0200a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe01effd640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7fe0200ab1c0 msgr2=0x7fe0200a94b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe01effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0200ab1c0 0x7fe0200a94b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe020159610 0x7fe0200c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02006b7c0 con 0x7fe020156320 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200ab7a0 con 0x7fe0200ab1c0 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.396+0000 7fe024836640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02006b170 con 0x7fe020159610 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.400+0000 7fe01f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe020156320 0x7fe02006bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:37840/0 (socket says 172.21.15.81:37840) 2024-05-08T20:49:06.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.400+0000 7fe01f7fe640 1 -- 172.21.15.81:0/761214376 learned_addr learned my addr 172.21.15.81:0/761214376 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:49:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.400+0000 7fe01ffff640 1 --2- 172.21.15.81:0/761214376 >> v2:172.21.15.117:3300/0 conn(0x7fe020159610 0x7fe0200c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725194984 0 0) 0x7fe02006b7c0 con 0x7fe020156320 2024-05-08T20:49:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe008003530 con 0x7fe020156320 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584469448 0 0) 0x7fe008003530 con 0x7fe020156320 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 >> v2:172.21.15.117:3300/0 conn(0x7fe020159610 msgr2=0x7fe0200c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 --2- 172.21.15.81:0/761214376 >> v2:172.21.15.117:3300/0 conn(0x7fe020159610 0x7fe0200c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 >> v2:172.21.15.81:3300/0 conn(0x7fe0200ab1c0 msgr2=0x7fe0200a94b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 --2- 172.21.15.81:0/761214376 >> v2:172.21.15.81:3300/0 conn(0x7fe0200ab1c0 0x7fe0200a94b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02006b450 con 0x7fe020156320 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe018001680 con 0x7fe020156320 2024-05-08T20:49:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 >> v1:172.21.15.117:6789/0 conn(0x7fe020156320 legacy=0x7fe02006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 0x7fe008003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0080047d0 0x7fe008004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01effd640 1 -- 172.21.15.81:0/761214376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0080047d0 msgr2=0x7fe008004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01effd640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0080047d0 0x7fe008004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe008005190 0x7fe00800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200ab7a0 con 0x7fe0080047d0 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02006b170 con 0x7fe008005190 2024-05-08T20:49:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00800c160 con 0x7fe008003980 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 0x7fe008003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 -- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe008005190 msgr2=0x7fe00800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe008005190 0x7fe00800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 -- 172.21.15.81:0/761214376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0080047d0 msgr2=0x7fe008004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0080047d0 0x7fe008004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.404+0000 7fe01f7fe640 1 -- 172.21.15.81:0/761214376 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008003530 con 0x7fe008003980 2024-05-08T20:49:06.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.408+0000 7fe01ffff640 1 -- 172.21.15.81:0/761214376 reap_dead start 2024-05-08T20:49:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.412+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 0x7fe008003da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c110 tx=0x7fe01801f2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ae397901c6d506 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:06.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.416+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180058e0 con 0x7fe008003980 2024-05-08T20:49:06.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.416+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018005a40 con 0x7fe008003980 2024-05-08T20:49:06.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.416+0000 7fe01e7fc640 1 -- 172.21.15.81:0/761214376 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018005e70 con 0x7fe008003980 2024-05-08T20:49:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.420+0000 7fe024836640 1 -- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 msgr2=0x7fe008003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:06.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.420+0000 7fe024836640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 0x7fe008003da0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe01800c110 tx=0x7fe01801f2d0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- 172.21.15.81:0/761214376 shutdown_connections 2024-05-08T20:49:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 --2- 172.21.15.81:0/761214376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe008003980 0x7fe008003da0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- 172.21.15.81:0/761214376 >> 172.21.15.81:0/761214376 conn(0x7fe0200c2a90 msgr2=0x7fe0200c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- 172.21.15.81:0/761214376 shutdown_connections 2024-05-08T20:49:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- 172.21.15.81:0/761214376 wait complete. 2024-05-08T20:49:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 Processor -- start 2024-05-08T20:49:06.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- start start 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 0x7fe0200c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe01f7fe640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 msgr2=0x7fe0200c54c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe01f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 0x7fe0200c54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0201f1920 0x7fe0201f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02006fa80 con 0x7fe008003980 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015c150 con 0x7fe0201f1920 2024-05-08T20:49:06.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.424+0000 7fe024836640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015cd70 con 0x7fe02006f0c0 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:36424/0 (socket says 172.21.15.81:36424) 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 -- 172.21.15.81:0/30283776 learned_addr learned my addr 172.21.15.81:0/30283776 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 -- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0201f1920 msgr2=0x7fe0201f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0201f1920 0x7fe0201f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 -- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 msgr2=0x7fe0200c54c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 0x7fe0200c54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 -- 172.21.15.81:0/30283776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02015bb00 con 0x7fe02006f0c0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe01effd640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b5a0 tx=0x7fe01400ba60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014003e20 con 0x7fe02006f0c0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014005070 con 0x7fe02006f0c0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe024836640 1 -- 172.21.15.81:0/30283776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02015bde0 con 0x7fe02006f0c0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014005420 con 0x7fe02006f0c0 2024-05-08T20:49:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe024836640 1 -- 172.21.15.81:0/30283776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0201584c0 con 0x7fe02006f0c0 2024-05-08T20:49:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.428+0000 7fe024836640 1 -- 172.21.15.81:0/30283776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02015b960 con 0x7fe02006f0c0 2024-05-08T20:49:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.436+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe014005580 con 0x7fe02006f0c0 2024-05-08T20:49:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.436+0000 7fe007fff640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 0x7fe00c068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.436+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe014084720 con 0x7fe02006f0c0 2024-05-08T20:49:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.436+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe014051640 con 0x7fe02006f0c0 2024-05-08T20:49:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.440+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 0x7fe00c068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:06.440+0000 7fe01f7fe640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 0x7fe00c068b30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe0180ae000 tx=0x7fe0180aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.344+0000 7fe024836640 1 -- 172.21.15.81:0/30283776 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe02015b960 con 0x7fe02006f0c0 2024-05-08T20:49:07.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.344+0000 7fe007fff640 1 -- 172.21.15.81:0/30283776 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fe014013620 con 0x7fe02006f0c0 2024-05-08T20:49:07.349 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.352+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 msgr2=0x7fe00c068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.352+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 0x7fe00c068b30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe0180ae000 tx=0x7fe0180aa070 comp rx=0 tx=0).stop 2024-05-08T20:49:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.352+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 msgr2=0x7fe02006f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:07.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.352+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b5a0 tx=0x7fe01400ba60 comp rx=0 tx=0).stop 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 shutdown_connections 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe00c066670 0x7fe00c068b30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0201f1920 0x7fe0201f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe02006f0c0 0x7fe02006f540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 --2- 172.21.15.81:0/30283776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe008003980 0x7fe0200c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 >> 172.21.15.81:0/30283776 conn(0x7fe0200c2a90 msgr2=0x7fe0200c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 shutdown_connections 2024-05-08T20:49:07.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:07.356+0000 7fe005ffb640 1 -- 172.21.15.81:0/30283776 wait complete. 2024-05-08T20:49:10.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:10.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.736+0000 7fa827d42640 1 Processor -- start 2024-05-08T20:49:10.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.736+0000 7fa827d42640 1 -- start start 2024-05-08T20:49:10.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa827d42640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa82006b840 0x7fa8200c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8262df640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7fa8200c6410 legacy=0x7fa8200c3350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa82006b840 0x7fa8200c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa82006b840 0x7fa8200c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:59300/0 (socket says 172.21.15.81:59300) 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa825ade640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa820155070 0x7fa820065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:50636/0 (socket says 172.21.15.81:50636) 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 -- 172.21.15.81:0/1353852774 learned_addr learned my addr 172.21.15.81:0/1353852774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82014e830 con 0x7fa8200c6410 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82006d6a0 con 0x7fa820155070 2024-05-08T20:49:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa820066390 con 0x7fa82006b840 2024-05-08T20:49:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 -- 172.21.15.81:0/1353852774 >> v1:172.21.15.117:6789/0 conn(0x7fa820155070 legacy=0x7fa820065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 -- 172.21.15.81:0/1353852774 >> v1:172.21.15.81:6789/0 conn(0x7fa8200c6410 legacy=0x7fa8200c3350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.740+0000 7fa8252dd640 1 -- 172.21.15.81:0/1353852774 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820151900 con 0x7fa82006b840 2024-05-08T20:49:10.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.744+0000 7fa8252dd640 1 --2- 172.21.15.81:0/1353852774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa82006b840 0x7fa8200c5ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8100098a0 tx=0x7fa81001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147b0f116448a638 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.748+0000 7fa824adc640 1 -- 172.21.15.81:0/1353852774 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ac630 con 0x7fa82006b840 2024-05-08T20:49:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.748+0000 7fa824adc640 1 -- 172.21.15.81:0/1353852774 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100ac790 con 0x7fa82006b840 2024-05-08T20:49:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.748+0000 7fa824adc640 1 -- 172.21.15.81:0/1353852774 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100acb00 con 0x7fa82006b840 2024-05-08T20:49:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.748+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa82006b840 msgr2=0x7fa8200c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.748+0000 7fa827d42640 1 --2- 172.21.15.81:0/1353852774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa82006b840 0x7fa8200c5ed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8100098a0 tx=0x7fa81001c520 comp rx=0 tx=0).stop 2024-05-08T20:49:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.756+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 shutdown_connections 2024-05-08T20:49:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.756+0000 7fa827d42640 1 --2- 172.21.15.81:0/1353852774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa82006b840 0x7fa8200c5ed0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.756+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 >> 172.21.15.81:0/1353852774 conn(0x7fa8200c68c0 msgr2=0x7fa8200c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.756+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 shutdown_connections 2024-05-08T20:49:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.756+0000 7fa827d42640 1 -- 172.21.15.81:0/1353852774 wait complete. 2024-05-08T20:49:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.760+0000 7fa827d42640 1 Processor -- start 2024-05-08T20:49:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.760+0000 7fa827d42640 1 -- start start 2024-05-08T20:49:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.760+0000 7fa827d42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 0x7fa8200c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.760+0000 7fa825ade640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 msgr2=0x7fa8200c0d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.760+0000 7fa825ade640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 0x7fa8200c0d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa827d42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa827d42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 0x7fa82014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:47352/0 (socket says 172.21.15.81:47352) 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8262df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 0x7fa82014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8262df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 0x7fa82014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:59314/0 (socket says 172.21.15.81:59314) 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 -- 172.21.15.81:0/2033358383 learned_addr learned my addr 172.21.15.81:0/2033358383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201ebef0 con 0x7fa82006b840 2024-05-08T20:49:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82014dac0 con 0x7fa820155070 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8201ef8a0 con 0x7fa8200c6410 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 -- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 msgr2=0x7fa82014a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 0x7fa82014a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 -- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 msgr2=0x7fa8200c0d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 0x7fa8200c0d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100094d0 con 0x7fa8200c6410 2024-05-08T20:49:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.764+0000 7fa8252dd640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa8100af040 tx=0x7fa8100192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.768+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100acd10 con 0x7fa8200c6410 2024-05-08T20:49:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.768+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100ace70 con 0x7fa8200c6410 2024-05-08T20:49:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.768+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b5820 con 0x7fa8200c6410 2024-05-08T20:49:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.768+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8201eb5c0 con 0x7fa8200c6410 2024-05-08T20:49:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.768+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8201ebb80 con 0x7fa8200c6410 2024-05-08T20:49:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.772+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8201ec0a0 con 0x7fa8200c6410 2024-05-08T20:49:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.780+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8100bb070 con 0x7fa8200c6410 2024-05-08T20:49:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.780+0000 7fa8167fc640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 0x7fa804068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.780+0000 7fa825ade640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 0x7fa804068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.780+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa810122ba0 con 0x7fa8200c6410 2024-05-08T20:49:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.780+0000 7fa825ade640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 0x7fa804068b50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000fc0 tx=0x7fa81c007a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:10.784+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa8100efbe0 con 0x7fa8200c6410 2024-05-08T20:49:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.676+0000 7fa827d42640 1 -- 172.21.15.81:0/2033358383 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa8201ec0a0 con 0x7fa8200c6410 2024-05-08T20:49:11.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.680+0000 7fa8167fc640 1 -- 172.21.15.81:0/2033358383 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fa8201ec0a0 con 0x7fa8200c6410 2024-05-08T20:49:11.682 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":170,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 msgr2=0x7fa804068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 0x7fa804068b50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000fc0 tx=0x7fa81c007a90 comp rx=0 tx=0).stop 2024-05-08T20:49:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 msgr2=0x7fa82014d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa8100af040 tx=0x7fa8100192c0 comp rx=0 tx=0).stop 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 shutdown_connections 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa804066690 0x7fa804068b50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa820155070 0x7fa82014a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8200c6410 0x7fa82014d060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.684+0000 7fa803fff640 1 --2- 172.21.15.81:0/2033358383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82006b840 0x7fa8200c0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.688+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 >> 172.21.15.81:0/2033358383 conn(0x7fa8200c68c0 msgr2=0x7fa820065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.688+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 shutdown_connections 2024-05-08T20:49:11.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:11.688+0000 7fa803fff640 1 -- 172.21.15.81:0/2033358383 wait complete. 2024-05-08T20:49:14.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 Processor -- start 2024-05-08T20:49:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 -- start start 2024-05-08T20:49:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 0x7f61f4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61f40abcc0 0x7f61f4155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f40c31f0 con 0x7f61f40ab2c0 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f415c620 con 0x7f61f40abcc0 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40c2c30 con 0x7f61f40c44b0 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f2ffd640 1 -- >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 msgr2=0x7f61f4158b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 0x7f61f4158b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61f40abcc0 0x7f61f4155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61f40abcc0 0x7f61f4155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:59330/0 (socket says 172.21.15.81:59330) 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 -- 172.21.15.81:0/4122957075 learned_addr learned my addr 172.21.15.81:0/4122957075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 -- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 msgr2=0x7f61f415cab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 --2- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f415cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 -- 172.21.15.81:0/4122957075 >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 msgr2=0x7f61f4158b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 --2- 172.21.15.81:0/4122957075 >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 0x7f61f4158b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.176+0000 7f61f37fe640 1 -- 172.21.15.81:0/4122957075 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40c2f10 con 0x7f61f40abcc0 2024-05-08T20:49:15.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.180+0000 7f61f37fe640 1 --2- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f4155fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61f406ac00 tx=0x7f61ec01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a854c3f808e3e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.180+0000 7f61f1ffb640 1 -- 172.21.15.81:0/4122957075 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0a57f0 con 0x7f61f40abcc0 2024-05-08T20:49:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.180+0000 7f61f1ffb640 1 -- 172.21.15.81:0/4122957075 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec0a5950 con 0x7f61f40abcc0 2024-05-08T20:49:15.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.180+0000 7f61f1ffb640 1 -- 172.21.15.81:0/4122957075 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0a5ce0 con 0x7f61f40abcc0 2024-05-08T20:49:15.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 -- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 msgr2=0x7f61f4155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 --2- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f4155fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61f406ac00 tx=0x7f61ec01c970 comp rx=0 tx=0).stop 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 -- 172.21.15.81:0/4122957075 shutdown_connections 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 --2- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 --2- 172.21.15.81:0/4122957075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f4155fa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 --2- 172.21.15.81:0/4122957075 >> v2:172.21.15.81:3300/0 conn(0x7f61f40ab2c0 0x7f61f4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.184+0000 7f61f3fff640 1 -- 172.21.15.81:0/4122957075 >> 172.21.15.81:0/4122957075 conn(0x7f61f40c4c20 msgr2=0x7f61f40c5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.200+0000 7f61f3fff640 1 -- 172.21.15.81:0/4122957075 shutdown_connections 2024-05-08T20:49:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.204+0000 7f61f3fff640 1 -- 172.21.15.81:0/4122957075 wait complete. 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.208+0000 7f61f3fff640 1 Processor -- start 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.208+0000 7f61f3fff640 1 -- start start 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 0x7f61f40a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41fa530 con 0x7f61f40ab2c0 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f414b750 con 0x7f61f40abcc0 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f2ffd640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 msgr2=0x7f61f40a9bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f414aff0 con 0x7f61f40c44b0 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 0x7f61f40a9bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:47374/0 (socket says 172.21.15.81:47374) 2024-05-08T20:49:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 -- 172.21.15.81:0/3919585485 learned_addr learned my addr 172.21.15.81:0/3919585485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 -- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 msgr2=0x7f61f414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 -- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 msgr2=0x7f61f40a9bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 0x7f61f40a9bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 -- 172.21.15.81:0/3919585485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009b30 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f37fe640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0af040 tx=0x7f61ec019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0b8670 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec0b87d0 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0b8b80 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f4150380 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.212+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f414ac40 con 0x7f61f40c44b0 2024-05-08T20:49:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61ec0b8ce0 con 0x7f61f40c44b0 2024-05-08T20:49:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61dbfff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 0x7f61e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f61ec11fb40 con 0x7f61f40c44b0 2024-05-08T20:49:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f41fa670 con 0x7f61f40c44b0 2024-05-08T20:49:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61f2ffd640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 0x7f61e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.216+0000 7f61f2ffd640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 0x7f61e0068b50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61e4003990 tx=0x7f61e4006d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:15.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:15.248+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f61f41fa670 con 0x7f61f40c44b0 2024-05-08T20:49:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:16.104+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f61f41fa670 con 0x7f61f40c44b0 2024-05-08T20:49:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.888+0000 7f61dbfff640 1 -- 172.21.15.81:0/3919585485 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f61f41fa670 con 0x7f61f40c44b0 2024-05-08T20:49:20.893 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 msgr2=0x7f61e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 0x7f61e0068b50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61e4003990 tx=0x7f61e4006d90 comp rx=0 tx=0).stop 2024-05-08T20:49:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 msgr2=0x7f61f414a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0af040 tx=0x7f61ec019710 comp rx=0 tx=0).stop 2024-05-08T20:49:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 shutdown_connections 2024-05-08T20:49:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f61e0066690 0x7f61e0068b50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61f40c44b0 0x7f61f414a700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.904+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40abcc0 0x7f61f414a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.908+0000 7f61f3fff640 1 --2- 172.21.15.81:0/3919585485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f40ab2c0 0x7f61f40a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:20.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.908+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 >> 172.21.15.81:0/3919585485 conn(0x7f61f40c4c20 msgr2=0x7f61f40c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.912+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 shutdown_connections 2024-05-08T20:49:20.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:20.916+0000 7f61f3fff640 1 -- 172.21.15.81:0/3919585485 wait complete. 2024-05-08T20:49:20.954 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:49:20.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:49:20.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 Processor -- start 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 -- start start 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec6ffff640 1 -- >> v1:172.21.15.81:6789/0 conn(0x7fec7006cca0 legacy=0x7fec7006f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6789/0 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006c2c0 0x7fec700a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec700a9900 0x7fec701653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7006afd0 con 0x7fec7006cca0 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7006c720 con 0x7fec700a9900 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.352+0000 7fec76643640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7006f910 con 0x7fec7006c2c0 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec700a9900 0x7fec701653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec700a9900 0x7fec701653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43732/0 (socket says 172.21.15.81:43732) 2024-05-08T20:49:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 -- 172.21.15.81:0/1533186204 learned_addr learned my addr 172.21.15.81:0/1533186204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 -- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006c2c0 msgr2=0x7fec700a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 --2- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006c2c0 0x7fec700a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 -- 172.21.15.81:0/1533186204 >> v1:172.21.15.81:6789/0 conn(0x7fec7006cca0 legacy=0x7fec7006f200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.356+0000 7fec74be0640 1 -- 172.21.15.81:0/1533186204 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700728a0 con 0x7fec700a9900 2024-05-08T20:49:21.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec74be0640 1 --2- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701653c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec68007710 tx=0x7fec6801eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f709613535916b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec6f7fe640 1 -- 172.21.15.81:0/1533186204 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680a7c80 con 0x7fec700a9900 2024-05-08T20:49:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec6f7fe640 1 -- 172.21.15.81:0/1533186204 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680ab070 con 0x7fec700a9900 2024-05-08T20:49:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec6f7fe640 1 -- 172.21.15.81:0/1533186204 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680b1400 con 0x7fec700a9900 2024-05-08T20:49:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 -- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 msgr2=0x7fec701653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 --2- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701653c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec68007710 tx=0x7fec6801eb50 comp rx=0 tx=0).stop 2024-05-08T20:49:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 -- 172.21.15.81:0/1533186204 shutdown_connections 2024-05-08T20:49:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 --2- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701653c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 --2- 172.21.15.81:0/1533186204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006c2c0 0x7fec700a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.360+0000 7fec76643640 1 -- 172.21.15.81:0/1533186204 >> 172.21.15.81:0/1533186204 conn(0x7fec700c2ca0 msgr2=0x7fec700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- 172.21.15.81:0/1533186204 shutdown_connections 2024-05-08T20:49:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- 172.21.15.81:0/1533186204 wait complete. 2024-05-08T20:49:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 Processor -- start 2024-05-08T20:49:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- start start 2024-05-08T20:49:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006c2c0 0x7fec7008a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec6ffff640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006c2c0 msgr2=0x7fec7008a820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006c2c0 0x7fec7008a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 0x7fec701f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701fa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70162080 con 0x7fec7006c2c0 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700bb350 con 0x7fec700a9900 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec700719c0 con 0x7fec7006cca0 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 0x7fec701f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 0x7fec701f9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:60784/0 (socket says 172.21.15.81:60784) 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 -- 172.21.15.81:0/315523521 learned_addr learned my addr 172.21.15.81:0/315523521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec74be0640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 msgr2=0x7fec701fa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a9900 0x7fec701fa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006c2c0 msgr2=0x7fec7008a820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006c2c0 0x7fec7008a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680073f0 con 0x7fec7006cca0 2024-05-08T20:49:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec67fff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 0x7fec701f9e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec5800b440 tx=0x7fec5800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58011890 con 0x7fec7006cca0 2024-05-08T20:49:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58011a10 con 0x7fec7006cca0 2024-05-08T20:49:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec701fdf30 con 0x7fec7006cca0 2024-05-08T20:49:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58011dc0 con 0x7fec7006cca0 2024-05-08T20:49:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.368+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec701fe210 con 0x7fec7006cca0 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec76643640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 0x7fec7015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700696e0 con 0x7fec70162480 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec6ffff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 0x7fec7015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec6ffff640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec7006bda0 con 0x7fec70162480 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec6ffff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 0x7fec7015ee80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec60003990 tx=0x7fec6000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.372+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60003dd0 con 0x7fec70162480 2024-05-08T20:49:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fec60005070 con 0x7fec70162480 2024-05-08T20:49:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 msgr2=0x7fec7015ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 0x7fec7015ee80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec60003990 tx=0x7fec6000b8e0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 msgr2=0x7fec7015ee80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70162480 0x7fec7015ee80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec5801a400 con 0x7fec7006cca0 2024-05-08T20:49:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fec500663a0 0x7fec50068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fec58084690 con 0x7fec7006cca0 2024-05-08T20:49:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6ffff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fec500663a0 0x7fec50068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.376+0000 7fec6ffff640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fec500663a0 0x7fec50068860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fec60003990 tx=0x7fec60008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.384+0000 7fec76643640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 0x7fec7015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.384+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7006bac0 con 0x7fec70160270 2024-05-08T20:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.400+0000 7fec74be0640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 0x7fec7015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.400+0000 7fec74be0640 1 -- 172.21.15.81:0/315523521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fec70165d10 con 0x7fec70160270 2024-05-08T20:49:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.404+0000 7fec74be0640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 0x7fec7015f3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec680af000 tx=0x7fec6801d390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680a7a80 con 0x7fec70160270 2024-05-08T20:49:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7fec680a7be0 con 0x7fec70160270 2024-05-08T20:49:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 msgr2=0x7fec7015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 0x7fec7015f3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec680af000 tx=0x7fec6801d390 comp rx=0 tx=0).stop 2024-05-08T20:49:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 msgr2=0x7fec7015f3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.408+0000 7fec6d7fa640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70160270 0x7fec7015f3c0 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec680af000 tx=0x7fec6801d390 comp rx=0 tx=0).stop 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 172, 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:21.413 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:21.415 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:21.416 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:21.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.424 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.425 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:21.426 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:21.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fec500663a0 msgr2=0x7fec50068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fec500663a0 0x7fec50068860 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fec60003990 tx=0x7fec60008030 comp rx=0 tx=0).stop 2024-05-08T20:49:21.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 msgr2=0x7fec701f9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 --2- 172.21.15.81:0/315523521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec7006cca0 0x7fec701f9e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec5800b440 tx=0x7fec5800b900 comp rx=0 tx=0).stop 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec74be0640 1 -- 172.21.15.81:0/315523521 reap_dead start 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 shutdown_connections 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.412+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 >> 172.21.15.81:0/315523521 conn(0x7fec700c2ca0 msgr2=0x7fec700c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.416+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 shutdown_connections 2024-05-08T20:49:21.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.416+0000 7fec76643640 1 -- 172.21.15.81:0/315523521 wait complete. 2024-05-08T20:49:21.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:49:21.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:49:21.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:49:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.780+0000 7f7d98de2640 1 Processor -- start 2024-05-08T20:49:21.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.780+0000 7f7d98de2640 1 -- start start 2024-05-08T20:49:21.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d98de2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d9406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d98de2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 0x7f7d94071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d98de2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d940706d0 con 0x7f7d9406d7d0 2024-05-08T20:49:21.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d98de2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d94158df0 con 0x7f7d940c31a0 2024-05-08T20:49:21.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d98de2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9415d3b0 con 0x7f7d94156430 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d92d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 0x7f7d94071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d92d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 0x7f7d94071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43778/0 (socket says 172.21.15.81:43778) 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3105092194 learned_addr learned my addr 172.21.15.81:0/3105092194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3105092194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d9406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d9259c640 1 -- 172.21.15.81:0/3105092194 >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 msgr2=0x7f7d94071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3105092194 >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 0x7f7d94071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d9259c640 1 -- 172.21.15.81:0/3105092194 >> v1:172.21.15.117:6789/0 conn(0x7f7d9406d7d0 legacy=0x7f7d94071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.784+0000 7f7d9259c640 1 -- 172.21.15.81:0/3105092194 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d941598f0 con 0x7f7d94156430 2024-05-08T20:49:21.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.788+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3105092194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d9406d290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d880097c0 tx=0x7f7d8801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a32972ed5fed83d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.788+0000 7f7d9159a640 1 -- 172.21.15.81:0/3105092194 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880ab600 con 0x7f7d94156430 2024-05-08T20:49:21.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.788+0000 7f7d9159a640 1 -- 172.21.15.81:0/3105092194 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d880a7050 con 0x7f7d94156430 2024-05-08T20:49:21.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.788+0000 7f7d9159a640 1 -- 172.21.15.81:0/3105092194 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880ab980 con 0x7f7d94156430 2024-05-08T20:49:21.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.792+0000 7f7d98de2640 1 -- 172.21.15.81:0/3105092194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 msgr2=0x7f7d9406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.792+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3105092194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d9406d290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d880097c0 tx=0x7f7d8801c4e0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 -- 172.21.15.81:0/3105092194 shutdown_connections 2024-05-08T20:49:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3105092194 >> v2:172.21.15.117:3300/0 conn(0x7f7d940c31a0 0x7f7d94071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3105092194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d9406d290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 -- 172.21.15.81:0/3105092194 >> 172.21.15.81:0/3105092194 conn(0x7f7d940c71b0 msgr2=0x7f7d940c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 -- 172.21.15.81:0/3105092194 shutdown_connections 2024-05-08T20:49:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 -- 172.21.15.81:0/3105092194 wait complete. 2024-05-08T20:49:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.796+0000 7f7d98de2640 1 Processor -- start 2024-05-08T20:49:21.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 -- start start 2024-05-08T20:49:21.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d9406d7d0 0x7f7d941f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d940c31a0 0x7f7d941f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d940ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9406beb0 con 0x7f7d9406d7d0 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d941f5990 con 0x7f7d940c31a0 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d98de2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940aa990 con 0x7f7d94156430 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d9259c640 1 -- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d9406d7d0 msgr2=0x7f7d941f4f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:3300/0 2024-05-08T20:49:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.800+0000 7f7d9259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d9406d7d0 0x7f7d941f4f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d91d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d940c31a0 0x7f7d941f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d91d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d940c31a0 0x7f7d941f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43782/0 (socket says 172.21.15.81:43782) 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d91d9b640 1 -- 172.21.15.81:0/3399886687 learned_addr learned my addr 172.21.15.81:0/3399886687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d940ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d940c31a0 msgr2=0x7f7d941f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d940c31a0 0x7f7d941f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d9406d7d0 msgr2=0x7f7d941f4f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d9406d7d0 0x7f7d941f4f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.804+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009420 con 0x7f7d94156430 2024-05-08T20:49:21.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.808+0000 7f7d92d9d640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d940ab220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00efc0 tx=0x7f7d8c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.808+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00cd20 con 0x7f7d94156430 2024-05-08T20:49:21.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.808+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9406b2a0 con 0x7f7d94156430 2024-05-08T20:49:21.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.808+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9406b860 con 0x7f7d94156430 2024-05-08T20:49:21.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00f040 con 0x7f7d94156430 2024-05-08T20:49:21.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c003be0 con 0x7f7d94156430 2024-05-08T20:49:21.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 0x7f7d78004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78007e90 con 0x7f7d78002a40 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d8c003d40 con 0x7f7d94156430 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.812+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 0x7f7d78004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d82ffd640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d74066690 0x7f7d74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d91d9b640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d74066690 0x7f7d74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d91d9b640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d74066690 0x7f7d74068b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7d941f5d70 tx=0x7f7d84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7d8c084980 con 0x7f7d94156430 2024-05-08T20:49:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d9259c640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d78008050 con 0x7f7d78002a40 2024-05-08T20:49:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.816+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 0x7f7d78004f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406fe70 tx=0x7f7d88019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88004220 con 0x7f7d78002a40 2024-05-08T20:49:21.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7d880ab980 con 0x7f7d78002a40 2024-05-08T20:49:21.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 msgr2=0x7f7d78004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 0x7f7d78004f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d9406fe70 tx=0x7f7d88019280 comp rx=0 tx=0).stop 2024-05-08T20:49:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 msgr2=0x7f7d78004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.820+0000 7f7d82ffd640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78002a40 0x7f7d78004f00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.828+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 0x7f7d780073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.828+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800a350 con 0x7f7d78006f70 2024-05-08T20:49:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.828+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 0x7f7d780073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.832+0000 7f7d9259c640 1 -- 172.21.15.81:0/3399886687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7d7800a510 con 0x7f7d78006f70 2024-05-08T20:49:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.832+0000 7f7d9259c640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 0x7f7d780073e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d8801ab90 tx=0x7f7d88009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880c3070 con 0x7f7d78006f70 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4795 (secure 0 0 0) 0x7f7d880c7430 con 0x7f7d78006f70 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 msgr2=0x7f7d780073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 0x7f7d780073e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d8801ab90 tx=0x7f7d88009190 comp rx=0 tx=0).stop 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 msgr2=0x7f7d780073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d82ffd640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d78006f70 0x7f7d780073e0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d8801ab90 tx=0x7f7d88009190 comp rx=0 tx=0).stop 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 172, 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:21.853 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d74066690 msgr2=0x7f7d74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7d74066690 0x7f7d74068b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7d941f5d70 tx=0x7f7d84009040 comp rx=0 tx=0).stop 2024-05-08T20:49:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 msgr2=0x7f7d940ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:21.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d98de2640 1 --2- 172.21.15.81:0/3399886687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d94156430 0x7f7d940ab220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00efc0 tx=0x7f7d8c00c490 comp rx=0 tx=0).stop 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3399886687 reap_dead start 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.836+0000 7f7d92d9d640 1 -- 172.21.15.81:0/3399886687 reap_dead start 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.844+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 shutdown_connections 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.844+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 >> 172.21.15.81:0/3399886687 conn(0x7f7d940c71b0 msgr2=0x7f7d94157430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.844+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 shutdown_connections 2024-05-08T20:49:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:21.844+0000 7f7d98de2640 1 -- 172.21.15.81:0/3399886687 wait complete. 2024-05-08T20:49:21.887 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:49:21.887 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:49:26.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:49:26.469 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:49:41.888 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-05-08T20:49:41.888 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-05-08T20:49:41.888 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:49:41.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:49:41.891 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:49:41.891 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:49:41.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 Processor -- start 2024-05-08T20:49:42.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 -- start start 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff3140df2e0 0x7ff314040d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31400c560 con 0x7ff31400d6e0 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140df770 con 0x7ff3140409a0 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff322647640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff314049dc0 con 0x7ff3140df2e0 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff31bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff31bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59034/0 (socket says 172.21.15.81:59034) 2024-05-08T20:49:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff31bfff640 1 -- 172.21.15.81:0/4116522409 learned_addr learned my addr 172.21.15.81:0/4116522409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.435+0000 7ff320be4640 1 --2- 172.21.15.81:0/4116522409 >> v2:172.21.15.117:3300/0 conn(0x7ff3140df2e0 0x7ff314040d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff31bfff640 1 -- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 msgr2=0x7ff314049770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff31bfff640 1 -- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 msgr2=0x7ff314049770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff31bfff640 1 --2- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff31bfff640 1 --2- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff320be4640 1 -- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 msgr2=0x7ff314049770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff320be4640 1 --2- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff320be4640 1 -- 172.21.15.81:0/4116522409 >> v1:172.21.15.117:6789/0 conn(0x7ff31400d6e0 legacy=0x7ff31400be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:42.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff320be4640 1 -- 172.21.15.81:0/4116522409 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31404a0a0 con 0x7ff3140df2e0 2024-05-08T20:49:42.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff320be4640 1 --2- 172.21.15.81:0/4116522409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140df2e0 0x7ff314040d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff31c063c00 tx=0x7ff31c099730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef056f98dfd9141 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.439+0000 7ff31affd640 1 -- 172.21.15.81:0/4116522409 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c12a600 con 0x7ff3140df2e0 2024-05-08T20:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff31affd640 1 -- 172.21.15.81:0/4116522409 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c126050 con 0x7ff3140df2e0 2024-05-08T20:49:42.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff31affd640 1 -- 172.21.15.81:0/4116522409 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c12aa60 con 0x7ff3140df2e0 2024-05-08T20:49:42.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 -- 172.21.15.81:0/4116522409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140df2e0 msgr2=0x7ff314040d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:42.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 --2- 172.21.15.81:0/4116522409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140df2e0 0x7ff314040d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff31c063c00 tx=0x7ff31c099730 comp rx=0 tx=0).stop 2024-05-08T20:49:42.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 -- 172.21.15.81:0/4116522409 shutdown_connections 2024-05-08T20:49:42.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 --2- 172.21.15.81:0/4116522409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140df2e0 0x7ff314040d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:42.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 --2- 172.21.15.81:0/4116522409 >> v2:172.21.15.81:3300/0 conn(0x7ff3140409a0 0x7ff314049770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:42.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 -- 172.21.15.81:0/4116522409 >> 172.21.15.81:0/4116522409 conn(0x7ff31402f4c0 msgr2=0x7ff31402f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:42.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 -- 172.21.15.81:0/4116522409 shutdown_connections 2024-05-08T20:49:42.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.443+0000 7ff322647640 1 -- 172.21.15.81:0/4116522409 wait complete. 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 Processor -- start 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 -- start start 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff31400d6e0 0x7ff314044a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 0x7ff3140dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314045e20 con 0x7ff3140df2e0 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140db780 con 0x7ff3140409a0 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff322647640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141744d0 con 0x7ff31400d6e0 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59042/0 (socket says 172.21.15.81:59042) 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 -- 172.21.15.81:0/1806977610 learned_addr learned my addr 172.21.15.81:0/1806977610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 msgr2=0x7ff3140dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:49:42.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 msgr2=0x7ff3140dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff320be4640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 0x7ff3140dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31bfff640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff31400d6e0 0x7ff314044a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff31400d6e0 msgr2=0x7ff314044a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff31400d6e0 0x7ff314044a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 msgr2=0x7ff3140dad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 -- 172.21.15.81:0/1806977610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c072040 con 0x7ff3140409a0 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.447+0000 7ff31b7fe640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 0x7ff3140dfaa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff31000b410 tx=0x7ff31000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004020 con 0x7ff3140409a0 2024-05-08T20:49:42.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3141741c0 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3140db9d0 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310004180 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004020 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc005260 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff310004330 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 0x7ff300068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff310055840 con 0x7ff3140409a0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.451+0000 7ff31bfff640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 0x7ff300068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:42.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.455+0000 7ff31bfff640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 0x7ff300068c10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff3140466c0 tx=0x7ff308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:42.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:42.475+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff310051c10 con 0x7ff3140409a0 2024-05-08T20:49:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.319+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff2fc0057e0 con 0x7ff3140409a0 2024-05-08T20:49:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.319+0000 7ff318ff9640 1 -- 172.21.15.81:0/1806977610 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7ff310015620 con 0x7ff3140409a0 2024-05-08T20:49:43.328 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 msgr2=0x7ff300068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 0x7ff300068c10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff3140466c0 tx=0x7ff308008040 comp rx=0 tx=0).stop 2024-05-08T20:49:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 msgr2=0x7ff3140dfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 0x7ff3140dfaa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff31000b410 tx=0x7ff31000b8d0 comp rx=0 tx=0).stop 2024-05-08T20:49:43.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 shutdown_connections 2024-05-08T20:49:43.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff300066750 0x7ff300068c10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:43.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3140df2e0 0x7ff3140dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:43.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3140409a0 0x7ff3140dfaa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:43.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 --2- 172.21.15.81:0/1806977610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff31400d6e0 0x7ff314044a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:43.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 >> 172.21.15.81:0/1806977610 conn(0x7ff31402f4c0 msgr2=0x7ff31404b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:43.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 shutdown_connections 2024-05-08T20:49:43.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:43.331+0000 7ff322647640 1 -- 172.21.15.81:0/1806977610 wait complete. 2024-05-08T20:49:46.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.707+0000 7f510bc9a640 1 Processor -- start 2024-05-08T20:49:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.707+0000 7f510bc9a640 1 -- start start 2024-05-08T20:49:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50fc0d4b20 0x7f50fc0da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc02e830 con 0x7f50fc0dacf0 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc0d4f60 con 0x7f50fc0d4b20 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510bc9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc04b320 con 0x7f50fc047480 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:43694/0 (socket says 172.21.15.81:43694) 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 -- 172.21.15.81:0/1082420011 learned_addr learned my addr 172.21.15.81:0/1082420011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109235640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0d4b20 0x7f50fc0da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510a237640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510a237640 1 -- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 msgr2=0x7f50fc046130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510a237640 1 -- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 msgr2=0x7f50fc046130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510a237640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f510a237640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 -- 172.21.15.81:0/1082420011 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0d4b20 msgr2=0x7f50fc0da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0d4b20 0x7f50fc0da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 -- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 msgr2=0x7f50fc046130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 -- 172.21.15.81:0/1082420011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc04b040 con 0x7f50fc047480 2024-05-08T20:49:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.711+0000 7f5109a36640 1 --2- 172.21.15.81:0/1082420011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5104068520 tx=0x7f5104096c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c07df53018e54fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.715+0000 7f5108a34640 1 -- 172.21.15.81:0/1082420011 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510411f8e0 con 0x7f50fc047480 2024-05-08T20:49:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.715+0000 7f5108a34640 1 -- 172.21.15.81:0/1082420011 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510411fa40 con 0x7f50fc047480 2024-05-08T20:49:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.715+0000 7f5108a34640 1 -- 172.21.15.81:0/1082420011 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510411fe70 con 0x7f50fc047480 2024-05-08T20:49:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.715+0000 7f510bc9a640 1 -- 172.21.15.81:0/1082420011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 msgr2=0x7f50fc0d45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.715+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1082420011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5104068520 tx=0x7f5104096c40 comp rx=0 tx=0).stop 2024-05-08T20:49:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.719+0000 7f510bc9a640 1 -- 172.21.15.81:0/1082420011 shutdown_connections 2024-05-08T20:49:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.719+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.81:3300/0 conn(0x7f50fc0dacf0 0x7f50fc046130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.719+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1082420011 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0d4b20 0x7f50fc0da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.719+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1082420011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc047480 0x7f50fc0d45e0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5104068520 tx=0x7f5104096c40 comp rx=0 tx=0).stop 2024-05-08T20:49:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.719+0000 7f510bc9a640 1 -- 172.21.15.81:0/1082420011 >> 172.21.15.81:0/1082420011 conn(0x7f50fc005e70 msgr2=0x7f50fc006280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:46.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.743+0000 7f510bc9a640 1 -- 172.21.15.81:0/1082420011 shutdown_connections 2024-05-08T20:49:46.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.743+0000 7f510bc9a640 1 -- 172.21.15.81:0/1082420011 wait complete. 2024-05-08T20:49:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 Processor -- start 2024-05-08T20:49:46.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 -- start start 2024-05-08T20:49:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50fc0dacf0 0x7f50fc02f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc031420 0x7f50fc03e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc17b680 con 0x7f50fc0dacf0 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0426b0 con 0x7f50fc031420 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f510bc9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0dd030 con 0x7f50fc0d4b20 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:43696/0 (socket says 172.21.15.81:43696) 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 -- 172.21.15.81:0/1964057077 learned_addr learned my addr 172.21.15.81:0/1964057077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 -- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc031420 msgr2=0x7f50fc03e340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:49:46.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc031420 0x7f50fc03e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 -- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50fc0dacf0 msgr2=0x7f50fc02f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:46.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50fc0dacf0 0x7f50fc02f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:46.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.747+0000 7f5109a36640 1 -- 172.21.15.81:0/1964057077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104072040 con 0x7f50fc0d4b20 2024-05-08T20:49:46.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f5109a36640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f510402c980 tx=0x7f5104093a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104137070 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104060bb0 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104061040 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc0c42e0 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.751+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc00b0b0 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.755+0000 7f50e7fff640 1 -- 172.21.15.81:0/1964057077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc00af10 con 0x7f50fc0d4b20 2024-05-08T20:49:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.755+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f510412e040 con 0x7f50fc0d4b20 2024-05-08T20:49:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.755+0000 7f50fa7fc640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 0x7f50e8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.755+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f51041980c0 con 0x7f50fc0d4b20 2024-05-08T20:49:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.759+0000 7f5109235640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 0x7f50e8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.759+0000 7f5109235640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 0x7f50e8068ba0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0dac80 tx=0x7f5100009520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:46.771+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f50fc00af10 con 0x7f50fc0d4b20 2024-05-08T20:49:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.699+0000 7f50e7fff640 1 -- 172.21.15.81:0/1964057077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f50fc00af10 con 0x7f50fc0d4b20 2024-05-08T20:49:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.699+0000 7f50fa7fc640 1 -- 172.21.15.81:0/1964057077 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f510412c620 con 0x7f50fc0d4b20 2024-05-08T20:49:47.705 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 msgr2=0x7f50e8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 0x7f50e8068ba0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0dac80 tx=0x7f5100009520 comp rx=0 tx=0).stop 2024-05-08T20:49:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 msgr2=0x7f50fc17ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f510402c980 tx=0x7f5104093a80 comp rx=0 tx=0).stop 2024-05-08T20:49:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 shutdown_connections 2024-05-08T20:49:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f50e80666e0 0x7f50e8068ba0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc031420 0x7f50fc03e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50fc0dacf0 0x7f50fc02f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.703+0000 7f510bc9a640 1 --2- 172.21.15.81:0/1964057077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc0d4b20 0x7f50fc17ab50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.707+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 >> 172.21.15.81:0/1964057077 conn(0x7f50fc005e70 msgr2=0x7f50fc004910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.707+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 shutdown_connections 2024-05-08T20:49:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:47.707+0000 7f510bc9a640 1 -- 172.21.15.81:0/1964057077 wait complete. 2024-05-08T20:49:50.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:51.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 Processor -- start 2024-05-08T20:49:51.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 -- start start 2024-05-08T20:49:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe800a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe8046920 con 0x7f7fe8006e80 2024-05-08T20:49:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe80473c0 con 0x7f7fe80072e0 2024-05-08T20:49:51.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.183+0000 7f7ff4977640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe804b5b0 con 0x7f7fe80d3a80 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52936/0 (socket says 172.21.15.81:52936) 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 -- 172.21.15.81:0/2134671095 learned_addr learned my addr 172.21.15.81:0/2134671095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 -- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 msgr2=0x7f7fe80da300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 -- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 msgr2=0x7f7fe80da300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 --2- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:49:51.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7fef59e640 1 --2- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:51.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.187+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2134671095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe800a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.191+0000 7f7feed9d640 1 -- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 msgr2=0x7f7fe80da300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:51.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.191+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:51.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.191+0000 7f7feed9d640 1 -- 172.21.15.81:0/2134671095 >> v1:172.21.15.117:6789/0 conn(0x7f7fe8006e80 legacy=0x7f7fe80d9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.191+0000 7f7feed9d640 1 -- 172.21.15.81:0/2134671095 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe804b2d0 con 0x7f7fe80d3a80 2024-05-08T20:49:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2134671095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe800a960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009fd0 tx=0x7f7fe001d660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2557d3a23cafbc6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7fedd9b640 1 -- 172.21.15.81:0/2134671095 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a7650 con 0x7f7fe80d3a80 2024-05-08T20:49:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7fedd9b640 1 -- 172.21.15.81:0/2134671095 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe00a77b0 con 0x7f7fe80d3a80 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 -- 172.21.15.81:0/2134671095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 msgr2=0x7f7fe800a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 --2- 172.21.15.81:0/2134671095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe800a960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009fd0 tx=0x7f7fe001d660 comp rx=0 tx=0).stop 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 -- 172.21.15.81:0/2134671095 shutdown_connections 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 --2- 172.21.15.81:0/2134671095 >> v2:172.21.15.81:3300/0 conn(0x7f7fe80072e0 0x7f7fe80da300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 --2- 172.21.15.81:0/2134671095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe800a960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:51.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.195+0000 7f7ff4977640 1 -- 172.21.15.81:0/2134671095 >> 172.21.15.81:0/2134671095 conn(0x7f7fe8048230 msgr2=0x7f7fe8048640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.203+0000 7f7ff4977640 1 -- 172.21.15.81:0/2134671095 shutdown_connections 2024-05-08T20:49:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.203+0000 7f7ff4977640 1 -- 172.21.15.81:0/2134671095 wait complete. 2024-05-08T20:49:51.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.203+0000 7f7ff4977640 1 Processor -- start 2024-05-08T20:49:51.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.203+0000 7f7ff4977640 1 -- start start 2024-05-08T20:49:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52940/0 (socket says 172.21.15.81:52940) 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 -- 172.21.15.81:0/2161847617 learned_addr learned my addr 172.21.15.81:0/2161847617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 0x7f7fe802f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe802f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe816e8b0 con 0x7f7fe8006e80 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80d3180 con 0x7f7fe80072e0 2024-05-08T20:49:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8171e60 con 0x7f7fe80d3a80 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 msgr2=0x7f7fe80cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 msgr2=0x7f7fe80cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 0x7f7fe802f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fef59e640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe802f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 msgr2=0x7f7fe802f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe802f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 msgr2=0x7f7fe80cedc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.207+0000 7f7fee59c640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009cb0 con 0x7f7fe80072e0 2024-05-08T20:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fee59c640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 0x7f7fe802f1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0063c00 tx=0x7f7ff0067550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0069a80 con 0x7f7fe80072e0 2024-05-08T20:49:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe8172700 con 0x7f7fe80072e0 2024-05-08T20:49:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81720b0 con 0x7f7fe80072e0 2024-05-08T20:49:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00721d0 con 0x7f7fe80072e0 2024-05-08T20:49:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0072580 con 0x7f7fe80072e0 2024-05-08T20:49:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ff0091020 con 0x7f7fe80072e0 2024-05-08T20:49:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.211+0000 7f7fd77fe640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 0x7f7fdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.215+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 0x7f7fdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.215+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7ff00fe450 con 0x7f7fe80072e0 2024-05-08T20:49:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.215+0000 7f7feed9d640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 0x7f7fdc068c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009a60 tx=0x7f7fe00b4040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.239+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd0005260 con 0x7f7fe80072e0 2024-05-08T20:49:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:51.255+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7ff00cb490 con 0x7f7fe80072e0 2024-05-08T20:49:52.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.435+0000 7f7ff4977640 1 -- 172.21.15.81:0/2161847617 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7fd0005a90 con 0x7f7fe80072e0 2024-05-08T20:49:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.435+0000 7f7fd77fe640 1 -- 172.21.15.81:0/2161847617 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f7ff0099020 con 0x7f7fe80072e0 2024-05-08T20:49:52.443 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":172,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 msgr2=0x7f7fdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 0x7f7fdc068c20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009a60 tx=0x7f7fe00b4040 comp rx=0 tx=0).stop 2024-05-08T20:49:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 msgr2=0x7f7fe802f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 0x7f7fe802f1c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0063c00 tx=0x7f7ff0067550 comp rx=0 tx=0).stop 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 shutdown_connections 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7fdc066760 0x7f7fdc068c20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe80d3a80 0x7f7fe802f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80072e0 0x7f7fe802f1c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 --2- 172.21.15.81:0/2161847617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe8006e80 0x7f7fe80cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:52.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 >> 172.21.15.81:0/2161847617 conn(0x7f7fe8048230 msgr2=0x7f7fe80e0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:52.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 shutdown_connections 2024-05-08T20:49:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:52.443+0000 7f7fd57fa640 1 -- 172.21.15.81:0/2161847617 wait complete. 2024-05-08T20:49:55.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:49:55.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 Processor -- start 2024-05-08T20:49:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 -- start start 2024-05-08T20:49:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 0x7fe4c004b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c004b5b0 con 0x7fe4c00dc1b0 2024-05-08T20:49:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c00dc590 con 0x7fe4c0048720 2024-05-08T20:49:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4cd6a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c004ac70 con 0x7fe4c000c820 2024-05-08T20:49:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4c6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4c00dc1b0 0x7fe4c00e1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45480/0 (socket says 172.21.15.81:45480) 2024-05-08T20:49:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.987+0000 7fe4c6ffd640 1 -- 172.21.15.81:0/3792054973 learned_addr learned my addr 172.21.15.81:0/3792054973 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:49:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.991+0000 7fe4c67fc640 1 --2- 172.21.15.81:0/3792054973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 0x7fe4c004b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.991+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3792054973 >> v1:172.21.15.117:6789/0 conn(0x7fe4c0048720 legacy=0x7fe4c0008750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.991+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3792054973 >> v1:172.21.15.81:6789/0 conn(0x7fe4c00dc1b0 legacy=0x7fe4c00e1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.991+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3792054973 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c003fe50 con 0x7fe4c000c820 2024-05-08T20:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:55.999+0000 7fe4c67fc640 1 --2- 172.21.15.81:0/3792054973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 0x7fe4c004b070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097f0 tx=0x7fe4bc01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cbda3dcb9ad8f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:56.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.007+0000 7fe4c5ffb640 1 -- 172.21.15.81:0/3792054973 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ab600 con 0x7fe4c000c820 2024-05-08T20:49:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.007+0000 7fe4c5ffb640 1 -- 172.21.15.81:0/3792054973 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0a7050 con 0x7fe4c000c820 2024-05-08T20:49:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.007+0000 7fe4c5ffb640 1 -- 172.21.15.81:0/3792054973 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ab980 con 0x7fe4c000c820 2024-05-08T20:49:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3792054973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 msgr2=0x7fe4c004b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:56.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 --2- 172.21.15.81:0/3792054973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 0x7fe4c004b070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097f0 tx=0x7fe4bc01c340 comp rx=0 tx=0).stop 2024-05-08T20:49:56.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3792054973 shutdown_connections 2024-05-08T20:49:56.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 --2- 172.21.15.81:0/3792054973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c000c820 0x7fe4c004b070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:56.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3792054973 >> 172.21.15.81:0/3792054973 conn(0x7fe4c0049370 msgr2=0x7fe4c0049780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:56.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3792054973 shutdown_connections 2024-05-08T20:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3792054973 wait complete. 2024-05-08T20:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 Processor -- start 2024-05-08T20:49:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 -- start start 2024-05-08T20:49:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 0x7fe4c00dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.011+0000 7fe4cd6a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 0x7fe4c00dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 0x7fe4c00dde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:56972/0 (socket says 172.21.15.81:56972) 2024-05-08T20:49:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52950/0 (socket says 172.21.15.81:52950) 2024-05-08T20:49:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c6ffd640 1 -- 172.21.15.81:0/3409515033 learned_addr learned my addr 172.21.15.81:0/3409515033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4cd6a5640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c00dc1b0 0x7fe4c0040960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0042a80 con 0x7fe4c0048720 2024-05-08T20:49:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00df340 con 0x7fe4c000c820 2024-05-08T20:49:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0042ff0 con 0x7fe4c00dc1b0 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c00dc1b0 msgr2=0x7fe4c0040960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c00dc1b0 0x7fe4c0040960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 msgr2=0x7fe4c00dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 0x7fe4c00dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009420 con 0x7fe4c0048720 2024-05-08T20:49:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.015+0000 7fe4c67fc640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0ab000 tx=0x7fe4bc0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.019+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b4600 con 0x7fe4c0048720 2024-05-08T20:49:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.019+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00ea070 con 0x7fe4c0048720 2024-05-08T20:49:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.019+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c00df060 con 0x7fe4c0048720 2024-05-08T20:49:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.023+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c0036f20 con 0x7fe4c0048720 2024-05-08T20:49:56.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.027+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0b4760 con 0x7fe4c0048720 2024-05-08T20:49:56.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.027+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b4ad0 con 0x7fe4c0048720 2024-05-08T20:49:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.035+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4bc0b2040 con 0x7fe4c0048720 2024-05-08T20:49:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.035+0000 7fe4af7fe640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 0x7fe4b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.035+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe4bc11ec60 con 0x7fe4c0048720 2024-05-08T20:49:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.039+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe4bc11f0e0 con 0x7fe4c0048720 2024-05-08T20:49:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.039+0000 7fe4c6ffd640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 0x7fe4b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:56.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:56.051+0000 7fe4c6ffd640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 0x7fe4b4068b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe4c807a900 tx=0x7fe4c8066e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:56.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:49:56.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:49:57.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.335+0000 7fe4cd6a5640 1 -- 172.21.15.81:0/3409515033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe4c004b5b0 con 0x7fe4c0048720 2024-05-08T20:49:57.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.347+0000 7fe4af7fe640 1 -- 172.21.15.81:0/3409515033 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe4c004b5b0 con 0x7fe4c0048720 2024-05-08T20:49:57.357 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:49:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 msgr2=0x7fe4b4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 0x7fe4b4068b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe4c807a900 tx=0x7fe4c8066e70 comp rx=0 tx=0).stop 2024-05-08T20:49:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 msgr2=0x7fe4c0040420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0ab000 tx=0x7fe4bc0190e0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 shutdown_connections 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe4b40666c0 0x7fe4b4068b80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4c00dc1b0 0x7fe4c0040960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0048720 0x7fe4c0040420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 --2- 172.21.15.81:0/3409515033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4c000c820 0x7fe4c00dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.379+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 >> 172.21.15.81:0/3409515033 conn(0x7fe4c0049370 msgr2=0x7fe4c0005e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.383+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 shutdown_connections 2024-05-08T20:49:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.383+0000 7fe4ad7fa640 1 -- 172.21.15.81:0/3409515033 wait complete. 2024-05-08T20:49:57.470 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:49:57.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:49:57.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:49:57.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 Processor -- start 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 -- start start 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 0x7f7e18007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e1804dac0 0x7f7e1800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1800e140 con 0x7f7e180076d0 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e180db300 con 0x7f7e1804dac0 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1804a6c0 con 0x7f7e180d4330 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e180076d0 0x7f7e1800eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45486/0 (socket says 172.21.15.81:45486) 2024-05-08T20:49:57.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.915+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/2917005550 learned_addr learned my addr 172.21.15.81:0/2917005550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:49:57.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.919+0000 7f7e1effd640 1 --2- 172.21.15.81:0/2917005550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 0x7f7e18007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.919+0000 7f7e1effd640 1 -- 172.21.15.81:0/2917005550 >> v2:172.21.15.117:3300/0 conn(0x7f7e1804dac0 msgr2=0x7f7e1800e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:49:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.919+0000 7f7e1effd640 1 --2- 172.21.15.81:0/2917005550 >> v2:172.21.15.117:3300/0 conn(0x7f7e1804dac0 0x7f7e1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.919+0000 7f7e1effd640 1 -- 172.21.15.81:0/2917005550 >> v1:172.21.15.81:6789/0 conn(0x7f7e180076d0 legacy=0x7f7e1800eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.919+0000 7f7e1effd640 1 -- 172.21.15.81:0/2917005550 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1804a9a0 con 0x7f7e180d4330 2024-05-08T20:49:57.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.923+0000 7f7e1effd640 1 --2- 172.21.15.81:0/2917005550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 0x7f7e18007190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097c0 tx=0x7f7e1001bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42cafff12fa799c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.951+0000 7f7e1dffb640 1 -- 172.21.15.81:0/2917005550 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100a5040 con 0x7f7e180d4330 2024-05-08T20:49:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.951+0000 7f7e1dffb640 1 -- 172.21.15.81:0/2917005550 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e100a9600 con 0x7f7e180d4330 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- 172.21.15.81:0/2917005550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 msgr2=0x7f7e18007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 --2- 172.21.15.81:0/2917005550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 0x7f7e18007190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097c0 tx=0x7f7e1001bf50 comp rx=0 tx=0).stop 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- 172.21.15.81:0/2917005550 shutdown_connections 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 --2- 172.21.15.81:0/2917005550 >> v2:172.21.15.117:3300/0 conn(0x7f7e1804dac0 0x7f7e1800e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 --2- 172.21.15.81:0/2917005550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e180d4330 0x7f7e18007190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- 172.21.15.81:0/2917005550 >> 172.21.15.81:0/2917005550 conn(0x7f7e1804c640 msgr2=0x7f7e1804ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- 172.21.15.81:0/2917005550 shutdown_connections 2024-05-08T20:49:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- 172.21.15.81:0/2917005550 wait complete. 2024-05-08T20:49:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 Processor -- start 2024-05-08T20:49:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.955+0000 7f7e1ffff640 1 -- start start 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180076d0 0x7f7e18034ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1804dac0 0x7f7e180c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180dded0 con 0x7f7e180076d0 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18034190 con 0x7f7e180d4330 2024-05-08T20:49:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180d2cd0 con 0x7f7e1804dac0 2024-05-08T20:49:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:56984/0 (socket says 172.21.15.81:56984) 2024-05-08T20:49:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/1809388463 learned_addr learned my addr 172.21.15.81:0/1809388463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1effd640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180076d0 0x7f7e18034ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1e7fc640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1804dac0 0x7f7e180c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1804dac0 msgr2=0x7f7e180c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e1804dac0 0x7f7e180c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180076d0 msgr2=0x7f7e18034ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180076d0 0x7f7e18034ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10009420 con 0x7f7e180d4330 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1f7fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c570 tx=0x7f7e1400ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140074e0 con 0x7f7e180d4330 2024-05-08T20:49:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e14007640 con 0x7f7e180d4330 2024-05-08T20:49:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e18033610 con 0x7f7e180d4330 2024-05-08T20:49:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e1ffff640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e18033bd0 con 0x7f7e180d4330 2024-05-08T20:49:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.959+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140074e0 con 0x7f7e180d4330 2024-05-08T20:49:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.963+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e140047f0 con 0x7f7e180d4330 2024-05-08T20:49:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.963+0000 7f7e077fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e0c066750 0x7f7e0c068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.963+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7e14083380 con 0x7f7e180d4330 2024-05-08T20:49:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.967+0000 7f7e1effd640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e0c066750 0x7f7e0c068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.967+0000 7f7e1effd640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e0c066750 0x7f7e0c068c10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7e100ad000 tx=0x7f7e100b4040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.971+0000 7f7e1ffff640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 0x7f7e180dba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.971+0000 7f7e1ffff640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18008890 con 0x7f7e180e7e90 2024-05-08T20:49:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.971+0000 7f7e1e7fc640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 0x7f7e180dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e1e7fc640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e180057c0 con 0x7f7e180e7e90 2024-05-08T20:49:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e1e7fc640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 0x7f7e180dba90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e200687d0 tx=0x7f7e20067490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20069a20 con 0x7f7e180e7e90 2024-05-08T20:49:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7e20072240 con 0x7f7e180e7e90 2024-05-08T20:49:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 msgr2=0x7f7e180dba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 0x7f7e180dba90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e200687d0 tx=0x7f7e20067490 comp rx=0 tx=0).stop 2024-05-08T20:49:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 msgr2=0x7f7e180dba90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.975+0000 7f7e077fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180e7e90 0x7f7e180dba90 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e200687d0 tx=0x7f7e20067490 comp rx=0 tx=0).stop 2024-05-08T20:49:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.991+0000 7f7e1ffff640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 0x7f7e180dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.991+0000 7f7e1e7fc640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 0x7f7e180dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.991+0000 7f7e1ffff640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180314e0 con 0x7f7e180cab50 2024-05-08T20:49:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.991+0000 7f7e1e7fc640 1 -- 172.21.15.81:0/1809388463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7e180ca8f0 con 0x7f7e180cab50 2024-05-08T20:49:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.991+0000 7f7e1e7fc640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 0x7f7e180dbfd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e20000b70 tx=0x7f7e20068160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20097ba0 con 0x7f7e180cab50 2024-05-08T20:49:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f7e20097d00 con 0x7f7e180cab50 2024-05-08T20:49:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 msgr2=0x7f7e180dbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 0x7f7e180dbfd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e20000b70 tx=0x7f7e20068160 comp rx=0 tx=0).stop 2024-05-08T20:49:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 msgr2=0x7f7e180dbfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.995+0000 7f7e077fe640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e180cab50 0x7f7e180dbfd0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e20000b70 tx=0x7f7e20068160 comp rx=0 tx=0).stop 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:49:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:58.013 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.999+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e0c066750 msgr2=0x7f7e0c068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.999+0000 7f7e057fa640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7e0c066750 0x7f7e0c068c10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7e100ad000 tx=0x7f7e100b4040 comp rx=0 tx=0).stop 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.999+0000 7f7e1f7fe640 1 -- 172.21.15.81:0/1809388463 reap_dead start 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:57.999+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 msgr2=0x7f7e180ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c570 tx=0x7f7e1400ca30 comp rx=0 tx=0).stop 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 shutdown_connections 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 --2- 172.21.15.81:0/1809388463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e180d4330 0x7f7e180ca3b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 >> 172.21.15.81:0/1809388463 conn(0x7f7e1804c640 msgr2=0x7f7e180e4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 shutdown_connections 2024-05-08T20:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.003+0000 7f7e057fa640 1 -- 172.21.15.81:0/1809388463 wait complete. 2024-05-08T20:49:58.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:58.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:49:58.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 Processor -- start 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 -- start start 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10780aa290 0x7f107806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10780a93c0 0x7f107806f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1078165dc0 con 0x7f10781659e0 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10780aace0 con 0x7f10780aa290 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f107dbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10780aa990 con 0x7f10780a93c0 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f10777fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f10781659e0 0x7f107806c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:53898/0 (socket says 172.21.15.81:53898) 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f10777fe640 1 -- 172.21.15.81:0/1345491892 learned_addr learned my addr 172.21.15.81:0/1345491892 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:49:58.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f106effd640 1 --2- 172.21.15.81:0/1345491892 >> v2:172.21.15.81:3300/0 conn(0x7f10780aa290 0x7f107806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f106effd640 1 -- 172.21.15.81:0/1345491892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10780a93c0 msgr2=0x7f107806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:58.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f106effd640 1 --2- 172.21.15.81:0/1345491892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10780a93c0 0x7f107806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f106effd640 1 -- 172.21.15.81:0/1345491892 >> v1:172.21.15.117:6789/0 conn(0x7f10781659e0 legacy=0x7f107806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.479+0000 7f106effd640 1 -- 172.21.15.81:0/1345491892 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107806fc80 con 0x7f10780aa290 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.483+0000 7f106effd640 1 --2- 172.21.15.81:0/1345491892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f107806f200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10600097c0 tx=0x7f106001e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c51734e7da403b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.483+0000 7f1076ffd640 1 -- 172.21.15.81:0/1345491892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600ab5f0 con 0x7f10780aa290 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.483+0000 7f1076ffd640 1 -- 172.21.15.81:0/1345491892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10600ab750 con 0x7f10780aa290 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.483+0000 7f1076ffd640 1 -- 172.21.15.81:0/1345491892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600abae0 con 0x7f10780aa290 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 -- 172.21.15.81:0/1345491892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 msgr2=0x7f107806f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 --2- 172.21.15.81:0/1345491892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f107806f200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10600097c0 tx=0x7f106001e630 comp rx=0 tx=0).stop 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 -- 172.21.15.81:0/1345491892 shutdown_connections 2024-05-08T20:49:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 --2- 172.21.15.81:0/1345491892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10780a93c0 0x7f107806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 --2- 172.21.15.81:0/1345491892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f107806f200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 -- 172.21.15.81:0/1345491892 >> 172.21.15.81:0/1345491892 conn(0x7f10780c2ca0 msgr2=0x7f10780c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 -- 172.21.15.81:0/1345491892 shutdown_connections 2024-05-08T20:49:58.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.487+0000 7f107dbc2640 1 -- 172.21.15.81:0/1345491892 wait complete. 2024-05-08T20:49:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.491+0000 7f107dbc2640 1 Processor -- start 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.491+0000 7f107dbc2640 1 -- start start 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780a93c0 0x7f107815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f1078160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10781659e0 0x7f1078160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107806c240 con 0x7f10780aa290 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10781634e0 con 0x7f10780a93c0 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107815d6c0 con 0x7f10781659e0 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f106effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f1078160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f106effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f1078160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53000/0 (socket says 172.21.15.81:53000) 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f106effd640 1 -- 172.21.15.81:0/4267029272 learned_addr learned my addr 172.21.15.81:0/4267029272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f1077fff640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10781659e0 0x7f1078160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780a93c0 0x7f107815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10781659e0 msgr2=0x7f1078160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10781659e0 0x7f1078160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 msgr2=0x7f1078160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10780aa290 0x7f1078160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009420 con 0x7f10780a93c0 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f10777fe640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780a93c0 0x7f107815ae50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f106800b4e0 tx=0x7f106800b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800f710 con 0x7f10780a93c0 2024-05-08T20:49:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800f870 con 0x7f10780a93c0 2024-05-08T20:49:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800fc00 con 0x7f10780a93c0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107815eea0 con 0x7f10780a93c0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.495+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1078162e50 con 0x7f10780a93c0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.499+0000 7f107dbc2640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 0x7f107820ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.499+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780696e0 con 0x7f107815fba0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.499+0000 7f106effd640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 0x7f107820ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1068010420 con 0x7f10780a93c0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f1074ff9640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1064066920 0x7f1064068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1068009040 con 0x7f10780a93c0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f1077fff640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1064066920 0x7f1064068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f1077fff640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1064066920 0x7f1064068de0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1070009f50 tx=0x7f107000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.503+0000 7f106effd640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10780c47b0 con 0x7f107815fba0 2024-05-08T20:49:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f106effd640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 0x7f107820ea70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10600ad040 tx=0x7f106001b3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600b8070 con 0x7f107815fba0 2024-05-08T20:49:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f10600bc3f0 con 0x7f107815fba0 2024-05-08T20:49:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 msgr2=0x7f107820ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 0x7f107820ea70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10600ad040 tx=0x7f106001b3d0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 msgr2=0x7f107820ea70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.507+0000 7f1074ff9640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815fba0 0x7f107820ea70 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10600ad040 tx=0x7f106001b3d0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.547+0000 7f107dbc2640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 0x7f107820efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.547+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107808b7e0 con 0x7f107815d800 2024-05-08T20:49:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.547+0000 7f106effd640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 0x7f107820efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f106effd640 1 -- 172.21.15.81:0/4267029272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f107806c640 con 0x7f107815d800 2024-05-08T20:49:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f106effd640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 0x7f107820efb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c10 tx=0x7f1060009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10600c5c40 con 0x7f107815d800 2024-05-08T20:49:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f10600c9070 con 0x7f107815d800 2024-05-08T20:49:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 msgr2=0x7f107820efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 0x7f107820efb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c10 tx=0x7f1060009190 comp rx=0 tx=0).stop 2024-05-08T20:49:58.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 msgr2=0x7f107820efb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1074ff9640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f107815d800 0x7f107820efb0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c10 tx=0x7f1060009190 comp rx=0 tx=0).stop 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:58.555 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.556 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.557 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:58.558 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:58.559 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:58.561 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:58.562 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:58.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:58.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.566 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:58.567 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1064066920 msgr2=0x7f1064068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1064066920 0x7f1064068de0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1070009f50 tx=0x7f107000d040 comp rx=0 tx=0).stop 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780a93c0 msgr2=0x7f107815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 --2- 172.21.15.81:0/4267029272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10780a93c0 0x7f107815ae50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f106800b4e0 tx=0x7f106800b9a0 comp rx=0 tx=0).stop 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1077fff640 1 -- 172.21.15.81:0/4267029272 reap_dead start 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f1077fff640 1 -- 172.21.15.81:0/4267029272 reap_dead start 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 shutdown_connections 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 >> 172.21.15.81:0/4267029272 conn(0x7f10780c2ca0 msgr2=0x7f10780c57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 shutdown_connections 2024-05-08T20:49:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.551+0000 7f107dbc2640 1 -- 172.21.15.81:0/4267029272 wait complete. 2024-05-08T20:49:58.605 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:58.605 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:49:58.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:49:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 Processor -- start 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 -- start start 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8390152cc0 0x7f839015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8390072600 con 0x7f8390158cb0 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83900bbca0 con 0x7f83900bcbe0 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f839642e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900bbf80 con 0x7f8390152cc0 2024-05-08T20:49:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f838ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8390152cc0 0x7f839015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f838f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f83900bcbe0 0x7f839015a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:33262/0 (socket says 172.21.15.81:33262) 2024-05-08T20:49:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:58.999+0000 7f838f7fe640 1 -- 172.21.15.81:0/1203806390 learned_addr learned my addr 172.21.15.81:0/1203806390 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:49:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.003+0000 7f838ffff640 1 -- 172.21.15.81:0/1203806390 >> v1:172.21.15.117:6789/0 conn(0x7f83900bcbe0 legacy=0x7f839015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.003+0000 7f838ffff640 1 -- 172.21.15.81:0/1203806390 >> v1:172.21.15.81:6789/0 conn(0x7f8390158cb0 legacy=0x7f8390159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.003+0000 7f838ffff640 1 -- 172.21.15.81:0/1203806390 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900bc260 con 0x7f8390152cc0 2024-05-08T20:49:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f838ffff640 1 --2- 172.21.15.81:0/1203806390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390152cc0 0x7f839015a230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f83800097c0 tx=0x7f838001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db191f07304ae51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f838effd640 1 -- 172.21.15.81:0/1203806390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800ac620 con 0x7f8390152cc0 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f838effd640 1 -- 172.21.15.81:0/1203806390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800ac780 con 0x7f8390152cc0 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f838effd640 1 -- 172.21.15.81:0/1203806390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800acb10 con 0x7f8390152cc0 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f839642e640 1 -- 172.21.15.81:0/1203806390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390152cc0 msgr2=0x7f839015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.011+0000 7f839642e640 1 --2- 172.21.15.81:0/1203806390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390152cc0 0x7f839015a230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f83800097c0 tx=0x7f838001c3a0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.015+0000 7f839642e640 1 -- 172.21.15.81:0/1203806390 shutdown_connections 2024-05-08T20:49:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.015+0000 7f839642e640 1 --2- 172.21.15.81:0/1203806390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390152cc0 0x7f839015a230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.015+0000 7f839642e640 1 -- 172.21.15.81:0/1203806390 >> 172.21.15.81:0/1203806390 conn(0x7f83900c3e00 msgr2=0x7f83900c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.015+0000 7f839642e640 1 -- 172.21.15.81:0/1203806390 shutdown_connections 2024-05-08T20:49:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.027+0000 7f839642e640 1 -- 172.21.15.81:0/1203806390 wait complete. 2024-05-08T20:49:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.027+0000 7f839642e640 1 Processor -- start 2024-05-08T20:49:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.027+0000 7f839642e640 1 -- start start 2024-05-08T20:49:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83900bcbe0 0x7f83900ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83900aabf0 0x7f83900c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c04d0 con 0x7f8390158cb0 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c0210 con 0x7f83900bcbe0 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390141ca0 con 0x7f83900aabf0 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57524/0 (socket says 172.21.15.81:57524) 2024-05-08T20:49:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 -- 172.21.15.81:0/3956330588 learned_addr learned my addr 172.21.15.81:0/3956330588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83900aabf0 msgr2=0x7f83900c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83900aabf0 0x7f83900c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83900bcbe0 msgr2=0x7f83900ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83900bcbe0 0x7f83900ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380009420 con 0x7f8390158cb0 2024-05-08T20:49:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838f7fe640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f838800cc10 tx=0x7f838800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800ad40 con 0x7f8390158cb0 2024-05-08T20:49:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388012400 con 0x7f8390158cb0 2024-05-08T20:49:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880127b0 con 0x7f8390158cb0 2024-05-08T20:49:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8390141f80 con 0x7f8390158cb0 2024-05-08T20:49:59.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.031+0000 7f839642e640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83900ab080 con 0x7f8390158cb0 2024-05-08T20:49:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.035+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8388012910 con 0x7f8390158cb0 2024-05-08T20:49:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.035+0000 7f838cff9640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f837c066760 0x7f837c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.035+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8388084b20 con 0x7f8390158cb0 2024-05-08T20:49:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.035+0000 7f838ffff640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f837c066760 0x7f837c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.035+0000 7f838ffff640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f837c066760 0x7f837c068c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83800ae000 tx=0x7f8380004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.039+0000 7f839642e640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 0x7f8370004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.039+0000 7f839642e640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8370007e90 con 0x7f8370002a40 2024-05-08T20:49:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.039+0000 7f83949cb640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 0x7f8370004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.039+0000 7f83949cb640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8370008050 con 0x7f8370002a40 2024-05-08T20:49:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.039+0000 7f83949cb640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 0x7f8370004f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f838400c310 tx=0x7f838400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384005280 con 0x7f8370002a40 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f83840053e0 con 0x7f8370002a40 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 msgr2=0x7f8370004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 0x7f8370004f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f838400c310 tx=0x7f838400c7d0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 msgr2=0x7f8370004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.043+0000 7f838cff9640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370002a40 0x7f8370004f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f839642e640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 0x7f83700073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f839642e640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837000a350 con 0x7f8370006f70 2024-05-08T20:49:59.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f83949cb640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 0x7f83700073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f83949cb640 1 -- 172.21.15.81:0/3956330588 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f837000a510 con 0x7f8370006f70 2024-05-08T20:49:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f83949cb640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 0x7f83700073e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f838400c310 tx=0x7f8384000f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838401e070 con 0x7f8370006f70 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f8384007240 con 0x7f8370006f70 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 msgr2=0x7f83700073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 0x7f83700073e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f838400c310 tx=0x7f8384000f50 comp rx=0 tx=0).stop 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 msgr2=0x7f83700073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.063+0000 7f838cff9640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8370006f70 0x7f83700073e0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f838400c310 tx=0x7f8384000f50 comp rx=0 tx=0).stop 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:59.069 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:59.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:59.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:49:59.072 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:49:59.073 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:59.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:49:59.075 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:49:59.076 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:49:59.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:59.079 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:49:59.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.091+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f837c066760 msgr2=0x7f837c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.091+0000 7f83767fc640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f837c066760 0x7f837c068c20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83800ae000 tx=0x7f8380004740 comp rx=0 tx=0).stop 2024-05-08T20:49:59.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.091+0000 7f83949cb640 1 -- 172.21.15.81:0/3956330588 reap_dead start 2024-05-08T20:49:59.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.095+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 msgr2=0x7f839013a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.095+0000 7f83767fc640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f838800cc10 tx=0x7f838800a430 comp rx=0 tx=0).stop 2024-05-08T20:49:59.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.095+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 shutdown_connections 2024-05-08T20:49:59.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.095+0000 7f83767fc640 1 --2- 172.21.15.81:0/3956330588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8390158cb0 0x7f839013a270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.095+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 >> 172.21.15.81:0/3956330588 conn(0x7f83900c3e00 msgr2=0x7f8390157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:59.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.099+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 shutdown_connections 2024-05-08T20:49:59.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.099+0000 7f83767fc640 1 -- 172.21.15.81:0/3956330588 wait complete. 2024-05-08T20:49:59.196 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:49:59.196 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:49:59.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:49:59.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 Processor -- start 2024-05-08T20:49:59.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 -- start start 2024-05-08T20:49:59.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce840c6870 0x7fce840c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8406d4f0 con 0x7fce8406df80 2024-05-08T20:49:59.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840abc10 con 0x7fce8406cb20 2024-05-08T20:49:59.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.663+0000 7fce8b877640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840c1c50 con 0x7fce840c6870 2024-05-08T20:49:59.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce840c6870 0x7fce840c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce840c6870 0x7fce840c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54714/0 (socket says 172.21.15.81:54714) 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 -- 172.21.15.81:0/2319328069 learned_addr learned my addr 172.21.15.81:0/2319328069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 -- 172.21.15.81:0/2319328069 >> v1:172.21.15.117:6789/0 conn(0x7fce8406cb20 legacy=0x7fce840aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 -- 172.21.15.81:0/2319328069 >> v1:172.21.15.81:6789/0 conn(0x7fce8406df80 legacy=0x7fce840aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.667+0000 7fce89613640 1 -- 172.21.15.81:0/2319328069 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840c1210 con 0x7fce840c6870 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.671+0000 7fce89613640 1 --2- 172.21.15.81:0/2319328069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce840c6870 0x7fce840c6c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce8001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2df5b61c056f91f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.671+0000 7fce7bfff640 1 -- 172.21.15.81:0/2319328069 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800ac600 con 0x7fce840c6870 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.671+0000 7fce7bfff640 1 -- 172.21.15.81:0/2319328069 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce800a8050 con 0x7fce840c6870 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.675+0000 7fce8b877640 1 -- 172.21.15.81:0/2319328069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce840c6870 msgr2=0x7fce840c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.675+0000 7fce8b877640 1 --2- 172.21.15.81:0/2319328069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce840c6870 0x7fce840c6c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce8001c4b0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.675+0000 7fce8b877640 1 -- 172.21.15.81:0/2319328069 shutdown_connections 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.675+0000 7fce8b877640 1 --2- 172.21.15.81:0/2319328069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce840c6870 0x7fce840c6c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.675+0000 7fce8b877640 1 -- 172.21.15.81:0/2319328069 >> 172.21.15.81:0/2319328069 conn(0x7fce8406a090 msgr2=0x7fce8406a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:49:59.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- 172.21.15.81:0/2319328069 shutdown_connections 2024-05-08T20:49:59.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- 172.21.15.81:0/2319328069 wait complete. 2024-05-08T20:49:59.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 Processor -- start 2024-05-08T20:49:59.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- start start 2024-05-08T20:49:59.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 0x7fce84072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 0x7fce8414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8414e460 0x7fce8406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8414fa30 con 0x7fce840c6870 2024-05-08T20:49:59.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8414f750 con 0x7fce8406cb20 2024-05-08T20:49:59.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce8b877640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84147c50 con 0x7fce8414e460 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce89613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 0x7fce84072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce89613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 0x7fce84072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54724/0 (socket says 172.21.15.81:54724) 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.687+0000 7fce89613640 1 -- 172.21.15.81:0/2736441235 learned_addr learned my addr 172.21.15.81:0/2736441235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 0x7fce8414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 -- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8414e460 msgr2=0x7fce8406fa60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:49:59.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8414e460 0x7fce8406fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 -- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 msgr2=0x7fce84072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:49:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 0x7fce84072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:49:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 -- 172.21.15.81:0/2736441235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800094d0 con 0x7fce840c6870 2024-05-08T20:49:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.691+0000 7fce88e12640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 0x7fce8414df20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce8406b6b0 tx=0x7fce7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.699+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c003ba0 con 0x7fce840c6870 2024-05-08T20:49:59.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.699+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce84147f30 con 0x7fce840c6870 2024-05-08T20:49:59.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.699+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce841486a0 con 0x7fce840c6870 2024-05-08T20:49:59.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.703+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c003d20 con 0x7fce840c6870 2024-05-08T20:49:59.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.703+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce840670c0 con 0x7fce840c6870 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.707+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00a940 con 0x7fce840c6870 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.707+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce7c00ab20 con 0x7fce840c6870 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.707+0000 7fce79ffb640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 0x7fce70068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.707+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fce7c083d50 con 0x7fce840c6870 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.711+0000 7fce89613640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 0x7fce70068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:49:59.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.711+0000 7fce89613640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 0x7fce70068e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fce8001c4f0 tx=0x7fce800a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:49:59.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:49:59.711+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fce7c050e40 con 0x7fce840c6870 2024-05-08T20:50:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.655+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fce8406cfc0 con 0x7fce840c6870 2024-05-08T20:50:00.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.655+0000 7fce79ffb640 1 -- 172.21.15.81:0/2736441235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fce7c054460 con 0x7fce840c6870 2024-05-08T20:50:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 msgr2=0x7fce70068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 0x7fce70068e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fce8001c4f0 tx=0x7fce800a7000 comp rx=0 tx=0).stop 2024-05-08T20:50:00.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 msgr2=0x7fce8414df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 0x7fce8414df20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce8406b6b0 tx=0x7fce7c00cf50 comp rx=0 tx=0).stop 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 shutdown_connections 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fce70066980 0x7fce70068e40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce8414e460 0x7fce8406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce840c6870 0x7fce8414df20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 --2- 172.21.15.81:0/2736441235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce8406cb20 0x7fce84072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 >> 172.21.15.81:0/2736441235 conn(0x7fce8406a090 msgr2=0x7fce8406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 shutdown_connections 2024-05-08T20:50:00.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:00.663+0000 7fce8b877640 1 -- 172.21.15.81:0/2736441235 wait complete. 2024-05-08T20:50:00.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:50:10.784 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:50:10.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:11.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 Processor -- start 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 -- start start 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f597c0c6870 0x7f597c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 0x7f597c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c06d4f0 con 0x7f597c06df80 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0c1c50 con 0x7f597c0c6870 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f59826e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0aa080 con 0x7f597c06cb20 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f597bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f597c0c6870 0x7f597c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f597b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f597c06df80 0x7f597c0aa5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39288/0 (socket says 172.21.15.81:39288) 2024-05-08T20:50:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.191+0000 7f597b7fe640 1 -- 172.21.15.81:0/3226589327 learned_addr learned my addr 172.21.15.81:0/3226589327 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f5980c84640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 0x7f597c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f597bfff640 1 -- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 msgr2=0x7f597c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f597bfff640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 0x7f597c0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f597bfff640 1 -- 172.21.15.81:0/3226589327 >> v1:172.21.15.81:6789/0 conn(0x7f597c06df80 legacy=0x7f597c0aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f597bfff640 1 -- 172.21.15.81:0/3226589327 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0abc10 con 0x7f597c0c6870 2024-05-08T20:50:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.195+0000 7f5980c84640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 0x7f597c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:50:11.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.199+0000 7f597bfff640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c0c6c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59700097c0 tx=0x7f597001c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b707368e9903799f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f597affd640 1 -- 172.21.15.81:0/3226589327 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700ab600 con 0x7f597c0c6870 2024-05-08T20:50:11.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f597affd640 1 -- 172.21.15.81:0/3226589327 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59700a7050 con 0x7f597c0c6870 2024-05-08T20:50:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 -- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 msgr2=0x7f597c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c0c6c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59700097c0 tx=0x7f597001c270 comp rx=0 tx=0).stop 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 -- 172.21.15.81:0/3226589327 shutdown_connections 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06cb20 0x7f597c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 --2- 172.21.15.81:0/3226589327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c0c6c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 -- 172.21.15.81:0/3226589327 >> 172.21.15.81:0/3226589327 conn(0x7f597c06a090 msgr2=0x7f597c06a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 -- 172.21.15.81:0/3226589327 shutdown_connections 2024-05-08T20:50:11.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.219+0000 7f59826e7640 1 -- 172.21.15.81:0/3226589327 wait complete. 2024-05-08T20:50:11.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.223+0000 7f59826e7640 1 Processor -- start 2024-05-08T20:50:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.223+0000 7f59826e7640 1 -- start start 2024-05-08T20:50:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 0x7f597c14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06df80 0x7f597c14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c14f8c0 con 0x7f597c06cb20 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c150280 con 0x7f597c0c6870 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f59826e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c150770 con 0x7f597c06df80 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f597bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 0x7f597c14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f597bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 0x7f597c14e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40764/0 (socket says 172.21.15.81:40764) 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f597bfff640 1 -- 172.21.15.81:0/3762551251 learned_addr learned my addr 172.21.15.81:0/3762551251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f597b7fe640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06df80 0x7f597c14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 -- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06df80 msgr2=0x7f597c14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06df80 0x7f597c14ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 -- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 msgr2=0x7f597c14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 0x7f597c14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 -- 172.21.15.81:0/3762551251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009420 con 0x7f597c0c6870 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5980c84640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c071000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c5c0 tx=0x7f596c00ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011800 con 0x7f597c0c6870 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c011980 con 0x7f597c0c6870 2024-05-08T20:50:11.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.227+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011d30 con 0x7f597c0c6870 2024-05-08T20:50:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.231+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c14f370 con 0x7f597c0c6870 2024-05-08T20:50:11.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.231+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c14f5e0 con 0x7f597c0c6870 2024-05-08T20:50:11.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.231+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c0670c0 con 0x7f597c0c6870 2024-05-08T20:50:11.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.231+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f596c018360 con 0x7f597c0c6870 2024-05-08T20:50:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.231+0000 7f5978ff9640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 0x7f5968068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.235+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f596c084460 con 0x7f597c0c6870 2024-05-08T20:50:11.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.235+0000 7f597bfff640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 0x7f5968068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:11.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.239+0000 7f597bfff640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 0x7f5968068c50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f597001c2b0 tx=0x7f59700a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:11.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.247+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f596c0514d0 con 0x7f597c0c6870 2024-05-08T20:50:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.843+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f597c06dd60 con 0x7f597c0c6870 2024-05-08T20:50:11.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.843+0000 7f5978ff9640 1 -- 172.21.15.81:0/3762551251 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f596c054af0 con 0x7f597c0c6870 2024-05-08T20:50:11.852 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 msgr2=0x7f5968068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 0x7f5968068c50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f597001c2b0 tx=0x7f59700a6000 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 msgr2=0x7f597c071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c071000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f596c00c5c0 tx=0x7f596c00ca80 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 shutdown_connections 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5968066790 0x7f5968068c50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c0c6870 0x7f597c071000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f597c06df80 0x7f597c14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 --2- 172.21.15.81:0/3762551251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f597c06cb20 0x7f597c14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 >> 172.21.15.81:0/3762551251 conn(0x7f597c06a090 msgr2=0x7f597c153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 shutdown_connections 2024-05-08T20:50:11.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:11.855+0000 7f59826e7640 1 -- 172.21.15.81:0/3762551251 wait complete. 2024-05-08T20:50:11.927 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:50:11.928 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:50:11.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:50:11.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 Processor -- start 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 -- start start 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efdbc14e1c0 0x7efdbc0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efdbc0c2800 0x7efdbc151f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc150c50 con 0x7efdbc152460 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0aa8c0 con 0x7efdbc0c2800 2024-05-08T20:50:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc2874640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc150ef0 con 0x7efdbc14e1c0 2024-05-08T20:50:12.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc0e11640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7efdbc152460 0x7efdbc0c1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:54048/0 (socket says 172.21.15.81:54048) 2024-05-08T20:50:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdc0e11640 1 -- 172.21.15.81:0/2190491099 learned_addr learned my addr 172.21.15.81:0/2190491099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdb3fff640 1 --2- 172.21.15.81:0/2190491099 >> v2:172.21.15.81:3300/0 conn(0x7efdbc0c2800 0x7efdbc151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdbb7fe640 1 -- 172.21.15.81:0/2190491099 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610636603 0 0) 0x7efdbc150c50 con 0x7efdbc152460 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdbb7fe640 1 -- 172.21.15.81:0/2190491099 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda8005740 con 0x7efdbc152460 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdb3fff640 1 -- 172.21.15.81:0/2190491099 >> v2:172.21.15.117:3300/0 conn(0x7efdbc14e1c0 msgr2=0x7efdbc0aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdb3fff640 1 --2- 172.21.15.81:0/2190491099 >> v2:172.21.15.117:3300/0 conn(0x7efdbc14e1c0 0x7efdbc0aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdb3fff640 1 -- 172.21.15.81:0/2190491099 >> v1:172.21.15.117:6789/0 conn(0x7efdbc152460 legacy=0x7efdbc0c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.343+0000 7efdb3fff640 1 -- 172.21.15.81:0/2190491099 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc1511d0 con 0x7efdbc0c2800 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.351+0000 7efdb3fff640 1 --2- 172.21.15.81:0/2190491099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc0c2800 0x7efdbc151f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdbc072af0 tx=0x7efdac024c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e19acdcd6e16f69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.351+0000 7efdbb7fe640 1 -- 172.21.15.81:0/2190491099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0adb40 con 0x7efdbc0c2800 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.351+0000 7efdbb7fe640 1 -- 172.21.15.81:0/2190491099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0b1070 con 0x7efdbc0c2800 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.351+0000 7efdbb7fe640 1 -- 172.21.15.81:0/2190491099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0adea0 con 0x7efdbc0c2800 2024-05-08T20:50:12.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.355+0000 7efdc2874640 1 -- 172.21.15.81:0/2190491099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc0c2800 msgr2=0x7efdbc151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.355+0000 7efdc2874640 1 --2- 172.21.15.81:0/2190491099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc0c2800 0x7efdbc151f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdbc072af0 tx=0x7efdac024c40 comp rx=0 tx=0).stop 2024-05-08T20:50:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.359+0000 7efdc2874640 1 -- 172.21.15.81:0/2190491099 shutdown_connections 2024-05-08T20:50:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.359+0000 7efdc2874640 1 --2- 172.21.15.81:0/2190491099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc0c2800 0x7efdbc151f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.359+0000 7efdc2874640 1 --2- 172.21.15.81:0/2190491099 >> v2:172.21.15.117:3300/0 conn(0x7efdbc14e1c0 0x7efdbc0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.359+0000 7efdc2874640 1 -- 172.21.15.81:0/2190491099 >> 172.21.15.81:0/2190491099 conn(0x7efdbc0c2ca0 msgr2=0x7efdbc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:12.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.363+0000 7efdc2874640 1 -- 172.21.15.81:0/2190491099 shutdown_connections 2024-05-08T20:50:12.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 -- 172.21.15.81:0/2190491099 wait complete. 2024-05-08T20:50:12.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 Processor -- start 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 -- start start 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdbc0c2800 0x7efdbc144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdbc0c2800 0x7efdbc144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdb3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdb3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40790/0 (socket says 172.21.15.81:40790) 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdb3fff640 1 -- 172.21.15.81:0/3003616477 learned_addr learned my addr 172.21.15.81:0/3003616477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc152460 0x7efdbc20b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc148040 con 0x7efdbc14e1c0 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc146720 con 0x7efdbc0c2800 2024-05-08T20:50:12.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.371+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc144eb0 con 0x7efdbc152460 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdc0e11640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc152460 0x7efdbc20b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc152460 msgr2=0x7efdbc20b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdbc152460 0x7efdbc20b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdbc0c2800 msgr2=0x7efdbc144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdbc0c2800 0x7efdbc144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009420 con 0x7efdbc14e1c0 2024-05-08T20:50:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb3fff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efdac0b9040 tx=0x7efdac021a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0ada40 con 0x7efdbc14e1c0 2024-05-08T20:50:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00d040 con 0x7efdbc14e1c0 2024-05-08T20:50:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0adde0 con 0x7efdbc14e1c0 2024-05-08T20:50:12.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc145df0 con 0x7efdbc14e1c0 2024-05-08T20:50:12.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.375+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc1463b0 con 0x7efdbc14e1c0 2024-05-08T20:50:12.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.379+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdac003620 con 0x7efdbc14e1c0 2024-05-08T20:50:12.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.379+0000 7efdb27fc640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 0x7efd94004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.379+0000 7efdb27fc640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94007e90 con 0x7efd94002a40 2024-05-08T20:50:12.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdb97fa640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efd9c066760 0x7efd9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdc0e11640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efd9c066760 0x7efd9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdc0e11640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efd9c066760 0x7efd9c068c20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efdbc14c0a0 tx=0x7efdb400a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdbbfff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdbc0c2800 0x7efdbc144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:50:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7efdac11e470 con 0x7efdbc14e1c0 2024-05-08T20:50:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdbbfff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 0x7efd94004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.395+0000 7efdbbfff640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd94008050 con 0x7efd94002a40 2024-05-08T20:50:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.399+0000 7efdbbfff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 0x7efd94004f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4007890 con 0x7efd94002a40 2024-05-08T20:50:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7efda400ce90 con 0x7efd94002a40 2024-05-08T20:50:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 msgr2=0x7efd94004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 0x7efd94004f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda400cc40 comp rx=0 tx=0).stop 2024-05-08T20:50:12.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 msgr2=0x7efd94004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:12.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.407+0000 7efdb97fa640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94002a40 0x7efd94004f00 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda400cc40 comp rx=0 tx=0).stop 2024-05-08T20:50:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.427+0000 7efdb27fc640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 0x7efd940073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.427+0000 7efdb27fc640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400a350 con 0x7efd94006f30 2024-05-08T20:50:12.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.435+0000 7efdbbfff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 0x7efd940073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.435+0000 7efdbbfff640 1 -- 172.21.15.81:0/3003616477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efd9400a510 con 0x7efd94006f30 2024-05-08T20:50:12.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.435+0000 7efdbbfff640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 0x7efd940073c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda401ae60 con 0x7efd94006f30 2024-05-08T20:50:12.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7efda4020040 con 0x7efd94006f30 2024-05-08T20:50:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 msgr2=0x7efd940073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 0x7efd940073c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda40047e0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 msgr2=0x7efd940073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.439+0000 7efdb97fa640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94006f30 0x7efd940073c0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efda400c780 tx=0x7efda40047e0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.444 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 17, 2024-05-08T20:50:12.445 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.446 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.447 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:12.448 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:12.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:12.453 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:12.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:12.458 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efd9c066760 msgr2=0x7efd9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7efd9c066760 0x7efd9c068c20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efdbc14c0a0 tx=0x7efdb400a040 comp rx=0 tx=0).stop 2024-05-08T20:50:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc0e11640 1 -- 172.21.15.81:0/3003616477 reap_dead start 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 msgr2=0x7efdbc144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efdac0b9040 tx=0x7efdac021a40 comp rx=0 tx=0).stop 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 shutdown_connections 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 --2- 172.21.15.81:0/3003616477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdbc14e1c0 0x7efdbc144970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 >> 172.21.15.81:0/3003616477 conn(0x7efdbc0c2ca0 msgr2=0x7efdbc14d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 shutdown_connections 2024-05-08T20:50:12.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.443+0000 7efdc2874640 1 -- 172.21.15.81:0/3003616477 wait complete. 2024-05-08T20:50:12.529 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:12.529 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:50:12.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:50:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 Processor -- start 2024-05-08T20:50:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 -- start start 2024-05-08T20:50:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc584152cc0 0x7fc58415a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc5840a94b0 0x7fc58415a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840bc900 con 0x7fc58415c120 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5841530a0 con 0x7fc5840a94b0 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc588ec0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840725d0 con 0x7fc584152cc0 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc582d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc58415c120 0x7fc58415c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39298/0 (socket says 172.21.15.81:39298) 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc582d9d640 1 -- 172.21.15.81:0/3066260878 learned_addr learned my addr 172.21.15.81:0/3066260878 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.799+0000 7fc581d9b640 1 --2- 172.21.15.81:0/3066260878 >> v2:172.21.15.81:3300/0 conn(0x7fc5840a94b0 0x7fc58415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.803+0000 7fc581d9b640 1 -- 172.21.15.81:0/3066260878 >> v2:172.21.15.117:3300/0 conn(0x7fc584152cc0 msgr2=0x7fc58415a020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.803+0000 7fc581d9b640 1 --2- 172.21.15.81:0/3066260878 >> v2:172.21.15.117:3300/0 conn(0x7fc584152cc0 0x7fc58415a020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.803+0000 7fc581d9b640 1 -- 172.21.15.81:0/3066260878 >> v1:172.21.15.81:6789/0 conn(0x7fc58415c120 legacy=0x7fc58415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.803+0000 7fc581d9b640 1 -- 172.21.15.81:0/3066260878 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840bbb40 con 0x7fc5840a94b0 2024-05-08T20:50:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc581d9b640 1 --2- 172.21.15.81:0/3066260878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5840a94b0 0x7fc58415a560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5840c3ac0 tx=0x7fc57c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3273e12be35b51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc58159a640 1 -- 172.21.15.81:0/3066260878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0a5a10 con 0x7fc5840a94b0 2024-05-08T20:50:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc58159a640 1 -- 172.21.15.81:0/3066260878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0a5b70 con 0x7fc5840a94b0 2024-05-08T20:50:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc58159a640 1 -- 172.21.15.81:0/3066260878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0ad440 con 0x7fc5840a94b0 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc588ec0640 1 -- 172.21.15.81:0/3066260878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5840a94b0 msgr2=0x7fc58415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.807+0000 7fc588ec0640 1 --2- 172.21.15.81:0/3066260878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5840a94b0 0x7fc58415a560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5840c3ac0 tx=0x7fc57c01c9b0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- 172.21.15.81:0/3066260878 shutdown_connections 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 --2- 172.21.15.81:0/3066260878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5840a94b0 0x7fc58415a560 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc5840c3ac0 tx=0x7fc57c01c9b0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 --2- 172.21.15.81:0/3066260878 >> v2:172.21.15.117:3300/0 conn(0x7fc584152cc0 0x7fc58415a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- 172.21.15.81:0/3066260878 >> 172.21.15.81:0/3066260878 conn(0x7fc5840c3e00 msgr2=0x7fc5840c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:12.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- 172.21.15.81:0/3066260878 shutdown_connections 2024-05-08T20:50:12.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- 172.21.15.81:0/3066260878 wait complete. 2024-05-08T20:50:12.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 Processor -- start 2024-05-08T20:50:12.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- start start 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc584152cc0 0x7fc58414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58415c120 0x7fc5841518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 0x7fc58414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584159430 con 0x7fc584152cc0 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58414e3a0 con 0x7fc58415c120 2024-05-08T20:50:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.811+0000 7fc588ec0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58414efa0 con 0x7fc58406cd00 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 0x7fc58414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 0x7fc58414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:60754/0 (socket says 172.21.15.81:60754) 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 learned_addr learned my addr 172.21.15.81:0/637014167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc581d9b640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58415c120 0x7fc5841518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58415c120 msgr2=0x7fc5841518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58415c120 0x7fc5841518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc584152cc0 0x7fc58414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc584152cc0 msgr2=0x7fc58414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc584152cc0 0x7fc58414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009a70 con 0x7fc58406cd00 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc584152cc0 0x7fc58414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc582d9d640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 0x7fc58414c000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc574009d30 tx=0x7fc57400c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740078f0 con 0x7fc58406cd00 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574007a50 con 0x7fc58406cd00 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58414d5e0 con 0x7fc58406cd00 2024-05-08T20:50:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574007de0 con 0x7fc58406cd00 2024-05-08T20:50:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58414dba0 con 0x7fc58406cd00 2024-05-08T20:50:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc570ff9640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 0x7fc55c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.815+0000 7fc570ff9640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c007e90 con 0x7fc55c002a40 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc574009070 con 0x7fc58406cd00 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc564066760 0x7fc564068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc574086370 con 0x7fc58406cd00 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 0x7fc55c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc581d9b640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc564066760 0x7fc564068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc58259c640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc55c008050 con 0x7fc55c002a40 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 0x7fc55c004f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c6f0 tx=0x7fc57800cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc581d9b640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc564066760 0x7fc564068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0af000 tx=0x7fc57c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578007890 con 0x7fc55c002a40 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc5780079f0 con 0x7fc55c002a40 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 msgr2=0x7fc55c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 0x7fc55c004f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c6f0 tx=0x7fc57800cbb0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 msgr2=0x7fc55c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.819+0000 7fc572ffd640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc55c002a40 0x7fc55c004f00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.839+0000 7fc588ec0640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 0x7fc584151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.839+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584067660 con 0x7fc58414dd90 2024-05-08T20:50:12.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.843+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 0x7fc584151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.843+0000 7fc58259c640 1 -- 172.21.15.81:0/637014167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc5840c05d0 con 0x7fc58414dd90 2024-05-08T20:50:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.843+0000 7fc58259c640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 0x7fc584151e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c6f0 tx=0x7fc578004780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578028070 con 0x7fc58414dd90 2024-05-08T20:50:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7fc578020040 con 0x7fc58414dd90 2024-05-08T20:50:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 msgr2=0x7fc584151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 0x7fc584151e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c6f0 tx=0x7fc578004780 comp rx=0 tx=0).stop 2024-05-08T20:50:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 msgr2=0x7fc584151e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.851+0000 7fc572ffd640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58414dd90 0x7fc584151e30 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc57800c6f0 tx=0x7fc578004780 comp rx=0 tx=0).stop 2024-05-08T20:50:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 18, 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:50:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:12.876 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc564066760 msgr2=0x7fc564068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc564066760 0x7fc564068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0af000 tx=0x7fc57c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 msgr2=0x7fc58414c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 --2- 172.21.15.81:0/637014167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc58406cd00 0x7fc58414c000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc574009d30 tx=0x7fc57400c430 comp rx=0 tx=0).stop 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 reap_dead start 2024-05-08T20:50:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc582d9d640 1 -- 172.21.15.81:0/637014167 reap_dead start 2024-05-08T20:50:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 shutdown_connections 2024-05-08T20:50:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 >> 172.21.15.81:0/637014167 conn(0x7fc5840c3e00 msgr2=0x7fc5840c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 shutdown_connections 2024-05-08T20:50:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:12.859+0000 7fc588ec0640 1 -- 172.21.15.81:0/637014167 wait complete. 2024-05-08T20:50:12.981 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:12.981 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:50:12.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:50:13.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.459+0000 7f48bc551640 1 Processor -- start 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 -- start start 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48b415cb90 0x7f48b40c2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b40a8320 0x7f48b40aa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 0x7f48b40c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b40a9e40 con 0x7f48b415cb90 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b40ac500 con 0x7f48b406f4f0 2024-05-08T20:50:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48bc551640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c1a70 con 0x7f48b40a8320 2024-05-08T20:50:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.463+0000 7f48ba2ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48b415cb90 0x7f48b40c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48baaee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 0x7f48b40c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48baaee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 0x7f48b40c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:50622/0 (socket says 172.21.15.81:50622) 2024-05-08T20:50:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48baaee640 1 -- 172.21.15.81:0/2248928264 learned_addr learned my addr 172.21.15.81:0/2248928264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:13.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48b9aec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b40a8320 0x7f48b40aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48ba2ed640 1 -- 172.21.15.81:0/2248928264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b40a8320 msgr2=0x7f48b40aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2248928264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b40a8320 0x7f48b40aa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48ba2ed640 1 -- 172.21.15.81:0/2248928264 >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 msgr2=0x7f48b40c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:13.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2248928264 >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 0x7f48b40c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.471+0000 7f48ba2ed640 1 -- 172.21.15.81:0/2248928264 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40c1d50 con 0x7f48b415cb90 2024-05-08T20:50:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2248928264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b415cb90 0x7f48b40c2840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c1190 tx=0x7f48a401eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ffdca9abe34a4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48b92eb640 1 -- 172.21.15.81:0/2248928264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40a8b90 con 0x7f48b415cb90 2024-05-08T20:50:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48b92eb640 1 -- 172.21.15.81:0/2248928264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40a8cf0 con 0x7f48b415cb90 2024-05-08T20:50:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48bc551640 1 -- 172.21.15.81:0/2248928264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b415cb90 msgr2=0x7f48b40c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48b92eb640 1 -- 172.21.15.81:0/2248928264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40a8b90 con 0x7f48b415cb90 2024-05-08T20:50:13.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.475+0000 7f48bc551640 1 --2- 172.21.15.81:0/2248928264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b415cb90 0x7f48b40c2840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c1190 tx=0x7f48a401eed0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.479+0000 7f48bc551640 1 -- 172.21.15.81:0/2248928264 shutdown_connections 2024-05-08T20:50:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.479+0000 7f48bc551640 1 --2- 172.21.15.81:0/2248928264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b40a8320 0x7f48b40aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.479+0000 7f48bc551640 1 --2- 172.21.15.81:0/2248928264 >> v2:172.21.15.117:3300/0 conn(0x7f48b406f4f0 0x7f48b40c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.479+0000 7f48bc551640 1 --2- 172.21.15.81:0/2248928264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b415cb90 0x7f48b40c2840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.479+0000 7f48bc551640 1 -- 172.21.15.81:0/2248928264 >> 172.21.15.81:0/2248928264 conn(0x7f48b406a2c0 msgr2=0x7f48b406a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:13.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.511+0000 7f48bc551640 1 -- 172.21.15.81:0/2248928264 shutdown_connections 2024-05-08T20:50:13.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.527+0000 7f48bc551640 1 -- 172.21.15.81:0/2248928264 wait complete. 2024-05-08T20:50:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.527+0000 7f48bc551640 1 Processor -- start 2024-05-08T20:50:13.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.527+0000 7f48bc551640 1 -- start start 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b406f4f0 0x7f48b4072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40a8320 0x7f48b4149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b415d8a0 con 0x7f48b40a8320 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b414aee0 con 0x7f48b40c6190 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48bc551640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b414bc60 con 0x7f48b406f4f0 2024-05-08T20:50:13.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:50626/0 (socket says 172.21.15.81:50626) 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 -- 172.21.15.81:0/2007386625 learned_addr learned my addr 172.21.15.81:0/2007386625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b406f4f0 msgr2=0x7f48b4072490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48b406f4f0 0x7f48b4072490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40a8320 msgr2=0x7f48b4149970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48b40a8320 0x7f48b4149970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009420 con 0x7f48b40c6190 2024-05-08T20:50:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48baaee640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007a90 tx=0x7f48ac007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.531+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00dca0 con 0x7f48b40c6190 2024-05-08T20:50:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.535+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b414b180 con 0x7f48b40c6190 2024-05-08T20:50:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.535+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b414b740 con 0x7f48b40c6190 2024-05-08T20:50:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.535+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00f040 con 0x7f48b40c6190 2024-05-08T20:50:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.535+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0039a0 con 0x7f48b40c6190 2024-05-08T20:50:13.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48bc551640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 0x7f489c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c007e90 con 0x7f489c002a40 2024-05-08T20:50:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 0x7f489c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f48ac003b00 con 0x7f48b40c6190 2024-05-08T20:50:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48ba2ed640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f489c008050 con 0x7f489c002a40 2024-05-08T20:50:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48aaffd640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f48980666c0 0x7f4898068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.539+0000 7f48b9aec640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f48980666c0 0x7f4898068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.543+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f48ac084350 con 0x7f48b40c6190 2024-05-08T20:50:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.543+0000 7f48b9aec640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f48980666c0 0x7f4898068b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f48b40aaba0 tx=0x7f48b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 0x7f489c004f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c13e0 tx=0x7f48a401bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:13.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40bf070 con 0x7f489c002a40 2024-05-08T20:50:13.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f48a4006e20 con 0x7f489c002a40 2024-05-08T20:50:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 msgr2=0x7f489c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 0x7f489c004f00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c13e0 tx=0x7f48a401bc70 comp rx=0 tx=0).stop 2024-05-08T20:50:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 msgr2=0x7f489c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.555+0000 7f48aaffd640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c002a40 0x7f489c004f00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48a8ff9640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 0x7f489c00cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48a8ff9640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0023a0 con 0x7f489c001e10 2024-05-08T20:50:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 0x7f489c00cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48ba2ed640 1 -- 172.21.15.81:0/2007386625 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f489c00a230 con 0x7f489c001e10 2024-05-08T20:50:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48ba2ed640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 0x7f489c00cb40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f489c008020 tx=0x7f48a4009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4003d60 con 0x7f489c001e10 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4807 (secure 0 0 0) 0x7f48a40b0440 con 0x7f489c001e10 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 msgr2=0x7f489c00cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 0x7f489c00cb40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f489c008020 tx=0x7f48a4009190 comp rx=0 tx=0).stop 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 msgr2=0x7f489c00cb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48aaffd640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f489c001e10 0x7f489c00cb40 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f489c008020 tx=0x7f48a4009190 comp rx=0 tx=0).stop 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 176, 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:13.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 18, 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:13.590 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:13.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:13.592 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:13.593 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.595 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:13.597 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:13.598 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:13.599 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f48980666c0 msgr2=0x7f4898068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.583+0000 7f48bc551640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f48980666c0 0x7f4898068b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f48b40aaba0 tx=0x7f48b0008040 comp rx=0 tx=0).stop 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48baaee640 1 -- 172.21.15.81:0/2007386625 reap_dead start 2024-05-08T20:50:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 msgr2=0x7f48b4149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007a90 tx=0x7f48ac007f50 comp rx=0 tx=0).stop 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 shutdown_connections 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 --2- 172.21.15.81:0/2007386625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b40c6190 0x7f48b4149eb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 >> 172.21.15.81:0/2007386625 conn(0x7f48b406a2c0 msgr2=0x7f48b40c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.587+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 shutdown_connections 2024-05-08T20:50:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:13.591+0000 7f48bc551640 1 -- 172.21.15.81:0/2007386625 wait complete. 2024-05-08T20:50:13.652 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:13.652 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:50:13.652 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:50:13.652 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:50:13.653 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:50:13.653 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:50:13.653 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:50:13.686 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:50:13.686 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:50:13.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:14.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 Processor -- start 2024-05-08T20:50:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 -- start start 2024-05-08T20:50:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 0x7f354c0aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354c1516f0 0x7f354c0c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c150c50 con 0x7f354c14e1c0 2024-05-08T20:50:14.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0aa8c0 con 0x7f354c1516f0 2024-05-08T20:50:14.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f3553c5f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c150ef0 con 0x7f354c0c2800 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35511fa640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 msgr2=0x7f354c0aa200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35511fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 0x7f354c0aa200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35519fb640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f354c14e1c0 legacy=0x7f354c151f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354c1516f0 0x7f354c0c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354c1516f0 0x7f354c0c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40916/0 (socket says 172.21.15.81:40916) 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 -- 172.21.15.81:0/2160817835 learned_addr learned my addr 172.21.15.81:0/2160817835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:14.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 -- 172.21.15.81:0/2160817835 >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 msgr2=0x7f354c0aa200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 --2- 172.21.15.81:0/2160817835 >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 0x7f354c0aa200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 -- 172.21.15.81:0/2160817835 >> v1:172.21.15.117:6789/0 conn(0x7f354c14e1c0 legacy=0x7f354c151f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.223+0000 7f35521fc640 1 -- 172.21.15.81:0/2160817835 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c1511d0 con 0x7f354c1516f0 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f35521fc640 1 --2- 172.21.15.81:0/2160817835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c1516f0 0x7f354c0c1bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f354c0a8ff0 tx=0x7f3544025370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63db7adaad510155 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f35509f9640 1 -- 172.21.15.81:0/2160817835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440b6610 con 0x7f354c1516f0 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f35509f9640 1 -- 172.21.15.81:0/2160817835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35440b0070 con 0x7f354c1516f0 2024-05-08T20:50:14.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f35509f9640 1 -- 172.21.15.81:0/2160817835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440b6990 con 0x7f354c1516f0 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 -- 172.21.15.81:0/2160817835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c1516f0 msgr2=0x7f354c0c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 --2- 172.21.15.81:0/2160817835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c1516f0 0x7f354c0c1bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f354c0a8ff0 tx=0x7f3544025370 comp rx=0 tx=0).stop 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 -- 172.21.15.81:0/2160817835 shutdown_connections 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 --2- 172.21.15.81:0/2160817835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c1516f0 0x7f354c0c1bb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 --2- 172.21.15.81:0/2160817835 >> v2:172.21.15.117:3300/0 conn(0x7f354c0c2800 0x7f354c0aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 -- 172.21.15.81:0/2160817835 >> 172.21.15.81:0/2160817835 conn(0x7f354c0c2ca0 msgr2=0x7f354c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:14.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 -- 172.21.15.81:0/2160817835 shutdown_connections 2024-05-08T20:50:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.227+0000 7f3553c5f640 1 -- 172.21.15.81:0/2160817835 wait complete. 2024-05-08T20:50:14.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 Processor -- start 2024-05-08T20:50:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 -- start start 2024-05-08T20:50:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 0x7f354c06c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 0x7f354c14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 0x7f354c14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c06fae0 con 0x7f354c0c2800 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c14f3a0 con 0x7f354c1516f0 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.231+0000 7f3553c5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c1e9f00 con 0x7f354c14e1c0 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.235+0000 7f35511fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 0x7f354c14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:14.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.235+0000 7f35511fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 0x7f354c14e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:60868/0 (socket says 172.21.15.81:60868) 2024-05-08T20:50:14.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.235+0000 7f35511fa640 1 -- 172.21.15.81:0/1951501081 learned_addr learned my addr 172.21.15.81:0/1951501081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.235+0000 7f35521fc640 1 -- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 msgr2=0x7f354c14ee60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.235+0000 7f35521fc640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 0x7f354c14ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 0x7f354c06c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 -- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 msgr2=0x7f354c14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 0x7f354c14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 -- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 msgr2=0x7f354c14ee60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 0x7f354c14ee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 -- 172.21.15.81:0/1951501081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544007790 con 0x7f354c0c2800 2024-05-08T20:50:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35519fb640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 0x7f354c06c4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f354800b400 tx=0x7f354800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548003d00 con 0x7f354c0c2800 2024-05-08T20:50:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548003e80 con 0x7f354c0c2800 2024-05-08T20:50:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.239+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35480052b0 con 0x7f354c0c2800 2024-05-08T20:50:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.243+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c0c5d50 con 0x7f354c0c2800 2024-05-08T20:50:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.243+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c1e9420 con 0x7f354c0c2800 2024-05-08T20:50:14.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.247+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3548005410 con 0x7f354c0c2800 2024-05-08T20:50:14.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.255+0000 7f35427fc640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 0x7f3530068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:14.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.255+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f35480838d0 con 0x7f354c0c2800 2024-05-08T20:50:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.255+0000 7f35511fa640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 0x7f3530068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:14.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.271+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c074950 con 0x7f354c0c2800 2024-05-08T20:50:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.283+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f35480509c0 con 0x7f354c0c2800 2024-05-08T20:50:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.283+0000 7f35511fa640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 0x7f3530068b50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f353c009470 tx=0x7f353c009400 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:14.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.967+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f354c144c40 con 0x7f354c0c2800 2024-05-08T20:50:14.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.971+0000 7f35427fc640 1 -- 172.21.15.81:0/1951501081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f3548016080 con 0x7f354c0c2800 2024-05-08T20:50:14.973 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.971+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 msgr2=0x7f3530068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.971+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 0x7f3530068b50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f353c009470 tx=0x7f353c009400 comp rx=0 tx=0).stop 2024-05-08T20:50:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.971+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 msgr2=0x7f354c06c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.971+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 0x7f354c06c4c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f354800b400 tx=0x7f354800b8c0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 shutdown_connections 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3530066690 0x7f3530068b50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f354c1516f0 0x7f354c14ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f354c14e1c0 0x7f354c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 --2- 172.21.15.81:0/1951501081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c0c2800 0x7f354c06c4c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 >> 172.21.15.81:0/1951501081 conn(0x7f354c0c2ca0 msgr2=0x7f354c147650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 shutdown_connections 2024-05-08T20:50:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:14.975+0000 7f3553c5f640 1 -- 172.21.15.81:0/1951501081 wait complete. 2024-05-08T20:50:18.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.394+0000 7fad832e0640 1 Processor -- start 2024-05-08T20:50:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad832e0640 1 -- start start 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad832e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad832e0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad740d4240 con 0x7fad740da780 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad82adf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad740da780 0x7fad74007ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:39302/0 (socket says 172.21.15.81:39302) 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad82adf640 1 -- 172.21.15.81:0/1968508154 learned_addr learned my addr 172.21.15.81:0/1968508154 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad81add640 1 -- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 msgr2=0x7fad740d7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad81add640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.398+0000 7fad832e0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7400a9d0 con 0x7fad740318b0 2024-05-08T20:50:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.406+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7400bb50 con 0x7fad740469c0 2024-05-08T20:50:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.410+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.117:6789/0 conn(0x7fad740318b0 legacy=0x7fad7400b440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.602+0000 7fad81add640 1 -- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 msgr2=0x7fad740d7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.602+0000 7fad81add640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:50:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:18.614+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.117:6789/0 conn(0x7fad740318b0 legacy=0x7fad7400b440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.006+0000 7fad81add640 1 -- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 msgr2=0x7fad740d7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.006+0000 7fad81add640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:50:19.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.018+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.117:6789/0 conn(0x7fad740318b0 legacy=0x7fad7400b440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:19.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.810+0000 7fad81add640 1 -- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 msgr2=0x7fad740d7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:19.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.810+0000 7fad81add640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:50:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:19.822+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.117:6789/0 conn(0x7fad740318b0 legacy=0x7fad7400b440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 -- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 msgr2=0x7fad740d7c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.117:3300/0 conn(0x7fad740469c0 0x7fad740d7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.117:6789/0 conn(0x7fad740318b0 legacy=0x7fad7400b440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 -- 172.21.15.81:0/1968508154 >> v1:172.21.15.81:6789/0 conn(0x7fad740da780 legacy=0x7fad74007ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.81:3300/0 conn(0x7fad600036d0 0x7fad60005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 --2- 172.21.15.81:0/1968508154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad60006140 0x7fad60008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 -- 172.21.15.81:0/1968508154 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7400bb50 con 0x7fad600036d0 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad73fff640 1 -- 172.21.15.81:0/1968508154 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad60008d30 con 0x7fad60006140 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad822de640 1 --2- 172.21.15.81:0/1968508154 >> v2:172.21.15.81:3300/0 conn(0x7fad600036d0 0x7fad60005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad60006140 msgr2=0x7fad60008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad822de640 1 --2- 172.21.15.81:0/1968508154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad60006140 0x7fad60008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.398+0000 7fad822de640 1 -- 172.21.15.81:0/1968508154 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7400c310 con 0x7fad600036d0 2024-05-08T20:50:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad822de640 1 --2- 172.21.15.81:0/1968508154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad600036d0 0x7fad60005b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad6c003940 tx=0x7fad6c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdba4a4d4be2866b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad812dc640 1 -- 172.21.15.81:0/1968508154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0a5e40 con 0x7fad600036d0 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad812dc640 1 -- 172.21.15.81:0/1968508154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c0ae470 con 0x7fad600036d0 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad812dc640 1 -- 172.21.15.81:0/1968508154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0ae820 con 0x7fad600036d0 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad600036d0 msgr2=0x7fad60005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad832e0640 1 --2- 172.21.15.81:0/1968508154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad600036d0 0x7fad60005b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad6c003940 tx=0x7fad6c01cee0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.402+0000 7fad82adf640 1 -- 172.21.15.81:0/1968508154 reap_dead start 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 shutdown_connections 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 --2- 172.21.15.81:0/1968508154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad600036d0 0x7fad60005b50 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad6c003940 tx=0x7fad6c01cee0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 >> 172.21.15.81:0/1968508154 conn(0x7fad7402db70 msgr2=0x7fad7402df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 shutdown_connections 2024-05-08T20:50:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 -- 172.21.15.81:0/1968508154 wait complete. 2024-05-08T20:50:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.406+0000 7fad832e0640 1 Processor -- start 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 -- start start 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740d6a40 0x7fad740cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad740d3440 0x7fad740cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74040fd0 con 0x7fad74177500 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad740406b0 con 0x7fad740d6a40 2024-05-08T20:50:21.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad832e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad74177aa0 con 0x7fad740d3440 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52744/0 (socket says 172.21.15.81:52744) 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 -- 172.21.15.81:0/3511267935 learned_addr learned my addr 172.21.15.81:0/3511267935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad81add640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad740d3440 0x7fad740cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 -- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad740d3440 msgr2=0x7fad740cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:21.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad740d3440 0x7fad740cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 -- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740d6a40 msgr2=0x7fad740cf210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740d6a40 0x7fad740cf210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 -- 172.21.15.81:0/3511267935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0099d0 con 0x7fad74177500 2024-05-08T20:50:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.410+0000 7fad82adf640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad7c04f530 tx=0x7fad7c067ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:21.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.414+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c068310 con 0x7fad74177500 2024-05-08T20:50:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.418+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c0674b0 con 0x7fad74177500 2024-05-08T20:50:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.418+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c072630 con 0x7fad74177500 2024-05-08T20:50:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.418+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad740cfc90 con 0x7fad74177500 2024-05-08T20:50:21.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.418+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7403fff0 con 0x7fad74177500 2024-05-08T20:50:21.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.426+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad7c072790 con 0x7fad74177500 2024-05-08T20:50:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.430+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad740057c0 con 0x7fad74177500 2024-05-08T20:50:21.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.438+0000 7fad72ffd640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 0x7fad68068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.442+0000 7fad822de640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 0x7fad68068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.442+0000 7fad822de640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 0x7fad68068d50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ad000 tx=0x7fad6c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.442+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fad7c0fd690 con 0x7fad74177500 2024-05-08T20:50:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.446+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fad7c0ca6e0 con 0x7fad74177500 2024-05-08T20:50:21.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.946+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fad7400bfa0 con 0x7fad74177500 2024-05-08T20:50:21.953 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":176,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.946+0000 7fad72ffd640 1 -- 172.21.15.81:0/3511267935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fad7c08f620 con 0x7fad74177500 2024-05-08T20:50:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 msgr2=0x7fad68068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 0x7fad68068d50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ad000 tx=0x7fad6c0a7070 comp rx=0 tx=0).stop 2024-05-08T20:50:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 msgr2=0x7fad74043110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad7c04f530 tx=0x7fad7c067ba0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 shutdown_connections 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fad68066890 0x7fad68068d50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74177500 0x7fad74043110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad740d3440 0x7fad740cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 --2- 172.21.15.81:0/3511267935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad740d6a40 0x7fad740cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 >> 172.21.15.81:0/3511267935 conn(0x7fad7402db70 msgr2=0x7fad7402ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 shutdown_connections 2024-05-08T20:50:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:21.954+0000 7fad832e0640 1 -- 172.21.15.81:0/3511267935 wait complete. 2024-05-08T20:50:25.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:25.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 Processor -- start 2024-05-08T20:50:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 -- start start 2024-05-08T20:50:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d0150fe0 con 0x7fe5d00c1ee0 2024-05-08T20:50:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d00a94b0 con 0x7fe5d0150790 2024-05-08T20:50:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.390+0000 7fe5d5f11640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d01512c0 con 0x7fe5d0138fa0 2024-05-08T20:50:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52760/0 (socket says 172.21.15.81:52760) 2024-05-08T20:50:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 learned_addr learned my addr 172.21.15.81:0/2391349823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:50:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:50:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:50:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.394+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:25.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.406+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 msgr2=0x7fe5d00aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:25.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.406+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.598+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.598+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:50:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.598+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:50:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.598+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:50:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.598+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:50:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.610+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 msgr2=0x7fe5d00aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:25.610+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:50:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.002+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.002+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:50:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.002+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:50:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.002+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:50:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.002+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:50:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.018+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 msgr2=0x7fe5d00aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.018+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:50:26.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.806+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:26.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.806+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:50:26.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.806+0000 7fe5cffff640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:50:26.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.806+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:50:26.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.806+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:50:26.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.822+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 msgr2=0x7fe5d00aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:26.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:26.822+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:50:26.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:50:26.874 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:50:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.086+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426839424 0 0) 0x7fe5d0150fe0 con 0x7fe5d00c1ee0 2024-05-08T20:50:28.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.086+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b8003530 con 0x7fe5d00c1ee0 2024-05-08T20:50:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170139201 0 0) 0x7fe5b8003530 con 0x7fe5d00c1ee0 2024-05-08T20:50:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 msgr2=0x7fe5d00aadc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.117:3300/0 conn(0x7fe5d0138fa0 0x7fe5d00aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 msgr2=0x7fe5d00c19a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 --2- 172.21.15.81:0/2391349823 >> v2:172.21.15.81:3300/0 conn(0x7fe5d0150790 0x7fe5d00c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d01515a0 con 0x7fe5d00c1ee0 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fe5c0001660 con 0x7fe5d00c1ee0 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 >> v1:172.21.15.81:6789/0 conn(0x7fe5d00c1ee0 legacy=0x7fe5d00a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5b80047d0 0x7fe5b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80051e0 0x7fe5b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00a94b0 con 0x7fe5b80047d0 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d01512c0 con 0x7fe5b80051e0 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b800c1b0 con 0x7fe5b8003980 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5b80047d0 0x7fe5b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:28.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80051e0 msgr2=0x7fe5b800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b80051e0 0x7fe5b800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5b80047d0 msgr2=0x7fe5b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5b80047d0 0x7fe5b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d4f0f640 1 -- 172.21.15.81:0/2391349823 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d01515a0 con 0x7fe5b8003980 2024-05-08T20:50:28.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.098+0000 7fe5d5710640 1 -- 172.21.15.81:0/2391349823 reap_dead start 2024-05-08T20:50:28.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.102+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5b8003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400f230 tx=0x7fe5c4020bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bffc263686740305 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:28.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.106+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40ad030 con 0x7fe5b8003980 2024-05-08T20:50:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.106+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c400d2d0 con 0x7fe5b8003980 2024-05-08T20:50:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.106+0000 7fe5cf7fe640 1 -- 172.21.15.81:0/2391349823 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40a9af0 con 0x7fe5b8003980 2024-05-08T20:50:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.106+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 msgr2=0x7fe5b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:28.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.106+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5b8003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400f230 tx=0x7fe5c4020bb0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2391349823 shutdown_connections 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2391349823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5b8003da0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2391349823 >> 172.21.15.81:0/2391349823 conn(0x7fe5d00c2a90 msgr2=0x7fe5d00c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2391349823 shutdown_connections 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2391349823 wait complete. 2024-05-08T20:50:28.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 Processor -- start 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- start start 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5d01fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 0x7fe5d014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d01fe7e0 con 0x7fe5d014d400 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0152f00 con 0x7fe5d014c7e0 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5f11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0132430 con 0x7fe5b8003980 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52804/0 (socket says 172.21.15.81:52804) 2024-05-08T20:50:28.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5cffff640 1 -- 172.21.15.81:0/2099680743 learned_addr learned my addr 172.21.15.81:0/2099680743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5710640 1 -- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 msgr2=0x7fe5d014cc90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.110+0000 7fe5d5710640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 0x7fe5d014cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 -- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 msgr2=0x7fe5d01fe2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5d01fe2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 -- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 msgr2=0x7fe5d014cc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 0x7fe5d014cc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 -- 172.21.15.81:0/2099680743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d014d1d0 con 0x7fe5d014d400 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cffff640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8004350 tx=0x7fe5c8004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8010040 con 0x7fe5d014d400 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d014d890 con 0x7fe5d014d400 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d006f860 con 0x7fe5d014d400 2024-05-08T20:50:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800a0d0 con 0x7fe5d014d400 2024-05-08T20:50:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.114+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d006c8c0 con 0x7fe5d014d400 2024-05-08T20:50:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800a440 con 0x7fe5d014d400 2024-05-08T20:50:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5c8013040 con 0x7fe5d014d400 2024-05-08T20:50:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5cd7fa640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 0x7fe5bc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe5c80859a0 con 0x7fe5d014d400 2024-05-08T20:50:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 0x7fe5bc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.126+0000 7fe5d4f0f640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 0x7fe5bc068c00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40ad000 tx=0x7fe5c4005cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:28.130+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe5c8052950 con 0x7fe5d014d400 2024-05-08T20:50:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.186+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe5d00747d0 con 0x7fe5d014d400 2024-05-08T20:50:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.186+0000 7fe5cd7fa640 1 -- 172.21.15.81:0/2099680743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fe5c8055f70 con 0x7fe5d014d400 2024-05-08T20:50:29.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":180,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:29.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 msgr2=0x7fe5bc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 0x7fe5bc068c00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40ad000 tx=0x7fe5c4005cf0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 msgr2=0x7fe5d00c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8004350 tx=0x7fe5c8004810 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 shutdown_connections 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe5bc066740 0x7fe5bc068c00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5d014c7e0 0x7fe5d014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d014d400 0x7fe5d00c5500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 --2- 172.21.15.81:0/2099680743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5b8003980 0x7fe5d01fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 >> 172.21.15.81:0/2099680743 conn(0x7fe5d00c2a90 msgr2=0x7fe5d014ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 shutdown_connections 2024-05-08T20:50:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.190+0000 7fe5d5f11640 1 -- 172.21.15.81:0/2099680743 wait complete. 2024-05-08T20:50:29.258 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:50:29.258 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:50:29.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:50:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 Processor -- start 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 -- start start 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be003ea10 0x7f7be00312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7be000b0e0 0x7f7be004ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be0007220 con 0x7f7be004b190 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00469c0 con 0x7f7be000b0e0 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bf00c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00069c0 con 0x7f7be003ea10 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bee662640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7be004b190 0x7f7be00de9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60150/0 (socket says 172.21.15.81:60150) 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bee662640 1 -- 172.21.15.81:0/2520168008 learned_addr learned my addr 172.21.15.81:0/2520168008 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bed660640 1 --2- 172.21.15.81:0/2520168008 >> v2:172.21.15.81:3300/0 conn(0x7f7be000b0e0 0x7f7be004ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bed660640 1 -- 172.21.15.81:0/2520168008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be003ea10 msgr2=0x7f7be00312c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bed660640 1 --2- 172.21.15.81:0/2520168008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be003ea10 0x7f7be00312c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bed660640 1 -- 172.21.15.81:0/2520168008 >> v1:172.21.15.81:6789/0 conn(0x7f7be004b190 legacy=0x7f7be00de9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.706+0000 7f7bed660640 1 -- 172.21.15.81:0/2520168008 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0030fe0 con 0x7f7be000b0e0 2024-05-08T20:50:29.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.710+0000 7f7bed660640 1 --2- 172.21.15.81:0/2520168008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be000b0e0 0x7f7be004ac50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097c0 tx=0x7f7be401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27ad5d3d2efbd7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:29.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.714+0000 7f7bece5f640 1 -- 172.21.15.81:0/2520168008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40ab600 con 0x7f7be000b0e0 2024-05-08T20:50:29.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.714+0000 7f7bece5f640 1 -- 172.21.15.81:0/2520168008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40a7050 con 0x7f7be000b0e0 2024-05-08T20:50:29.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.714+0000 7f7bf00c5640 1 -- 172.21.15.81:0/2520168008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be000b0e0 msgr2=0x7f7be004ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.714+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/2520168008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be000b0e0 0x7f7be004ac50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097c0 tx=0x7f7be401c3c0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 -- 172.21.15.81:0/2520168008 shutdown_connections 2024-05-08T20:50:29.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/2520168008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be000b0e0 0x7f7be004ac50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/2520168008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be003ea10 0x7f7be00312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 -- 172.21.15.81:0/2520168008 >> 172.21.15.81:0/2520168008 conn(0x7f7be0005ea0 msgr2=0x7f7be00062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 -- 172.21.15.81:0/2520168008 shutdown_connections 2024-05-08T20:50:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.718+0000 7f7bf00c5640 1 -- 172.21.15.81:0/2520168008 wait complete. 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 Processor -- start 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 -- start start 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be000b0e0 0x7f7be00447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be003ea10 0x7f7be00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 0x7f7be01837c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be01833a0 con 0x7f7be004b190 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00dfdb0 con 0x7f7be003ea10 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bf00c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0183050 con 0x7f7be000b0e0 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bed660640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be003ea10 msgr2=0x7f7be00cfcd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bed660640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be003ea10 0x7f7be00cfcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 0x7f7be01837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 0x7f7be01837c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 learned_addr learned my addr 172.21.15.81:0/866808388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be000b0e0 msgr2=0x7f7be00447c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be000b0e0 0x7f7be00447c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be003ea10 msgr2=0x7f7be00cfcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be003ea10 0x7f7be00cfcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009420 con 0x7f7be004b190 2024-05-08T20:50:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.722+0000 7f7bee662640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 0x7f7be01837c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7be807acd0 tx=0x7f7be8067ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.726+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be804f1b0 con 0x7f7be004b190 2024-05-08T20:50:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.726+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80721c0 con 0x7f7be004b190 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80725b0 con 0x7f7be004b190 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00dfa00 con 0x7f7be004b190 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be00d0210 con 0x7f7be004b190 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 0x7f7be00031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00088c0 con 0x7f7be0183d00 2024-05-08T20:50:29.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7be8072710 con 0x7f7be004b190 2024-05-08T20:50:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bde7fc640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7bcc066690 0x7f7bcc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7be80fe1b0 con 0x7f7be004b190 2024-05-08T20:50:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.730+0000 7f7bed660640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7bcc066690 0x7f7bcc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.734+0000 7f7bed660640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7bcc066690 0x7f7bcc068b50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7be40ad000 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:29.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.738+0000 7f7bede61640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 0x7f7be00031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:29.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.738+0000 7f7bede61640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be00076b0 con 0x7f7be0183d00 2024-05-08T20:50:29.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.738+0000 7f7bede61640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 0x7f7be00031a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:29.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.742+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800c720 con 0x7f7be0183d00 2024-05-08T20:50:29.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.742+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7bd800be70 con 0x7f7be0183d00 2024-05-08T20:50:29.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.758+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 msgr2=0x7f7be00031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.758+0000 7f7bde7fc640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 0x7f7be00031a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd800bb40 comp rx=0 tx=0).stop 2024-05-08T20:50:29.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.758+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 msgr2=0x7f7be00031a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:29.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.758+0000 7f7bde7fc640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be0183d00 0x7f7be00031a0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd800bb40 comp rx=0 tx=0).stop 2024-05-08T20:50:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.786+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 0x7f7be00ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.786+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be004ac90 con 0x7f7be00e1010 2024-05-08T20:50:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.786+0000 7f7bede61640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 0x7f7be00ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.786+0000 7f7bede61640 1 -- 172.21.15.81:0/866808388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7be000b720 con 0x7f7be00e1010 2024-05-08T20:50:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bede61640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 0x7f7be00ce990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd80046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8015d90 con 0x7f7be00e1010 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f7bd8020070 con 0x7f7be00e1010 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 msgr2=0x7f7be00ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 0x7f7be00ce990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd80046f0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 msgr2=0x7f7be00ce990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.790+0000 7f7bde7fc640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be00e1010 0x7f7be00ce990 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b680 tx=0x7f7bd80046f0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 180, 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:29.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.798+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7bcc066690 msgr2=0x7f7bcc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.798+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7bcc066690 0x7f7bcc068b50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7be40ad000 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.798+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 msgr2=0x7f7be01837c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.798+0000 7f7bf00c5640 1 --2- 172.21.15.81:0/866808388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be004b190 0x7f7be01837c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7be807acd0 tx=0x7f7be8067ba0 comp rx=0 tx=0).stop 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.802+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 reap_dead start 2024-05-08T20:50:29.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.802+0000 7f7bee662640 1 -- 172.21.15.81:0/866808388 reap_dead start 2024-05-08T20:50:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.806+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 shutdown_connections 2024-05-08T20:50:29.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.806+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 >> 172.21.15.81:0/866808388 conn(0x7f7be0005ea0 msgr2=0x7f7be00495e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.806+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 shutdown_connections 2024-05-08T20:50:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:29.806+0000 7f7bf00c5640 1 -- 172.21.15.81:0/866808388 wait complete. 2024-05-08T20:50:29.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:50:29.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:50:29.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:50:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 Processor -- start 2024-05-08T20:50:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 -- start start 2024-05-08T20:50:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91140d4330 0x7f9114007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91140d4330 0x7f9114007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91140d4330 0x7f9114007190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48282/0 (socket says 172.21.15.81:48282) 2024-05-08T20:50:30.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 -- 172.21.15.81:0/4261451398 learned_addr learned my addr 172.21.15.81:0/4261451398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911a59c640 1 -- 172.21.15.81:0/4261451398 >> v1:172.21.15.117:6789/0 conn(0x7f911404dac0 legacy=0x7f911400e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911400e140 con 0x7f91140076d0 2024-05-08T20:50:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911404a6c0 con 0x7f911404dac0 2024-05-08T20:50:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140db300 con 0x7f91140d4330 2024-05-08T20:50:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 -- 172.21.15.81:0/4261451398 >> v1:172.21.15.117:6789/0 conn(0x7f911404dac0 legacy=0x7f911400e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 -- 172.21.15.81:0/4261451398 >> v1:172.21.15.81:6789/0 conn(0x7f91140076d0 legacy=0x7f911400ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.570+0000 7f911ad9d640 1 -- 172.21.15.81:0/4261451398 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911404a9a0 con 0x7f91140d4330 2024-05-08T20:50:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.574+0000 7f911ad9d640 1 --2- 172.21.15.81:0/4261451398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91140d4330 0x7f9114007190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f910c009870 tx=0x7f910c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ad2ec46aff6479 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.574+0000 7f9119d9b640 1 -- 172.21.15.81:0/4261451398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0ab600 con 0x7f91140d4330 2024-05-08T20:50:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.574+0000 7f9119d9b640 1 -- 172.21.15.81:0/4261451398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c0a7050 con 0x7f91140d4330 2024-05-08T20:50:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f9119d9b640 1 -- 172.21.15.81:0/4261451398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c0ab980 con 0x7f91140d4330 2024-05-08T20:50:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91140d4330 msgr2=0x7f9114007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f91208c0640 1 --2- 172.21.15.81:0/4261451398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91140d4330 0x7f9114007190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f910c009870 tx=0x7f910c01c370 comp rx=0 tx=0).stop 2024-05-08T20:50:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 shutdown_connections 2024-05-08T20:50:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f91208c0640 1 --2- 172.21.15.81:0/4261451398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91140d4330 0x7f9114007190 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f910c009870 tx=0x7f910c01c370 comp rx=0 tx=0).stop 2024-05-08T20:50:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.578+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 >> 172.21.15.81:0/4261451398 conn(0x7f911404c640 msgr2=0x7f911404ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.582+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 shutdown_connections 2024-05-08T20:50:30.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.582+0000 7f91208c0640 1 -- 172.21.15.81:0/4261451398 wait complete. 2024-05-08T20:50:30.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.582+0000 7f91208c0640 1 Processor -- start 2024-05-08T20:50:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.582+0000 7f91208c0640 1 -- start start 2024-05-08T20:50:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140076d0 0x7f911417d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 0x7f9114030e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140ccef0 0x7f9114182d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114035920 con 0x7f911404dac0 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140cca60 con 0x7f91140ccef0 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f91208c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91140cbe50 con 0x7f91140076d0 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 0x7f9114030e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 0x7f9114030e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48292/0 (socket says 172.21.15.81:48292) 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 -- 172.21.15.81:0/724665810 learned_addr learned my addr 172.21.15.81:0/724665810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911b59e640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140ccef0 msgr2=0x7f9114182d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911b59e640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140ccef0 0x7f9114182d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:30.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140076d0 msgr2=0x7f911417d800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:50:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140076d0 0x7f911417d800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140ccef0 msgr2=0x7f9114182d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140ccef0 0x7f9114182d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0094d0 con 0x7f911404dac0 2024-05-08T20:50:30.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.586+0000 7f911a59c640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 0x7f9114030e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f911000b550 tx=0x7f911000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.594+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110003d00 con 0x7f911404dac0 2024-05-08T20:50:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.594+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110003e80 con 0x7f911404dac0 2024-05-08T20:50:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.594+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110005330 con 0x7f911404dac0 2024-05-08T20:50:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.594+0000 7f91208c0640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91140cc130 con 0x7f911404dac0 2024-05-08T20:50:30.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.594+0000 7f91208c0640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91140cc6f0 con 0x7f911404dac0 2024-05-08T20:50:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9110005490 con 0x7f911404dac0 2024-05-08T20:50:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f91037fe640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9108066690 0x7f9108068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9110084270 con 0x7f911404dac0 2024-05-08T20:50:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f91208c0640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 0x7f90fc004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f91208c0640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc007e90 con 0x7f90fc002a40 2024-05-08T20:50:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f911b59e640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 0x7f90fc004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f911ad9d640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9108066690 0x7f9108068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f911b59e640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90fc008050 con 0x7f90fc002a40 2024-05-08T20:50:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.598+0000 7f911ad9d640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9108066690 0x7f9108068b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ad000 tx=0x7f910c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f911b59e640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 0x7f90fc004f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f911c063c00 tx=0x7f911c067490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0721c0 con 0x7f90fc002a40 2024-05-08T20:50:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f911c072340 con 0x7f90fc002a40 2024-05-08T20:50:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 msgr2=0x7f90fc004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 0x7f90fc004f00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f911c063c00 tx=0x7f911c067490 comp rx=0 tx=0).stop 2024-05-08T20:50:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 msgr2=0x7f90fc004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.602+0000 7f91037fe640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc002a40 0x7f90fc004f00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:30.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.614+0000 7f91208c0640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 0x7f90fc007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:30.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.614+0000 7f91208c0640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc00a3a0 con 0x7f90fc006f00 2024-05-08T20:50:30.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.614+0000 7f911b59e640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 0x7f90fc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.618+0000 7f911b59e640 1 -- 172.21.15.81:0/724665810 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f90fc0078d0 con 0x7f90fc006f00 2024-05-08T20:50:30.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.618+0000 7f911b59e640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 0x7f90fc007390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f911c000b70 tx=0x7f911c068080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:30.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c09d070 con 0x7f90fc006f00 2024-05-08T20:50:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4965 (secure 0 0 0) 0x7f911c098320 con 0x7f90fc006f00 2024-05-08T20:50:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 msgr2=0x7f90fc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 0x7f90fc007390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f911c000b70 tx=0x7f911c068080 comp rx=0 tx=0).stop 2024-05-08T20:50:30.632 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:50:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 180, 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:30.645 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 msgr2=0x7f90fc007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91037fe640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90fc006f00 0x7f90fc007390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9108066690 msgr2=0x7f9108068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9108066690 0x7f9108068b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f910c0ad000 tx=0x7f910c0a6000 comp rx=0 tx=0).stop 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 msgr2=0x7f9114030e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 --2- 172.21.15.81:0/724665810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f911404dac0 0x7f9114030e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f911000b550 tx=0x7f911000ba10 comp rx=0 tx=0).stop 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f911b59e640 1 -- 172.21.15.81:0/724665810 reap_dead start 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 shutdown_connections 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 >> 172.21.15.81:0/724665810 conn(0x7f911404c640 msgr2=0x7f91140d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 shutdown_connections 2024-05-08T20:50:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:30.626+0000 7f91017fa640 1 -- 172.21.15.81:0/724665810 wait complete. 2024-05-08T20:50:30.667 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:50:30.667 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:50:50.668 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:50:50.668 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:50:50.669 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:50:50.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:50:50.671 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:50:50.671 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:50:50.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.234+0000 7f08b2f77640 1 Processor -- start 2024-05-08T20:50:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.234+0000 7f08b2f77640 1 -- start start 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2f77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08ac152fd0 0x7f08ac0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2f77640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 0x7f08ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2f77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0c21f0 con 0x7f08ac158db0 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2f77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac1533b0 con 0x7f08ac152fd0 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2f77640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac06bb00 con 0x7f08ac06afd0 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1774640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 msgr2=0x7f08ac06b410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1774640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 0x7f08ac06b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b2776640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f08ac158db0 legacy=0x7f08ac159200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:50:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08ac152fd0 0x7f08ac0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08ac152fd0 0x7f08ac0c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48206/0 (socket says 172.21.15.81:48206) 2024-05-08T20:50:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 -- 172.21.15.81:0/1140970022 learned_addr learned my addr 172.21.15.81:0/1140970022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 -- 172.21.15.81:0/1140970022 >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 msgr2=0x7f08ac06b410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 --2- 172.21.15.81:0/1140970022 >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 0x7f08ac06b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 -- 172.21.15.81:0/1140970022 >> v1:172.21.15.117:6789/0 conn(0x7f08ac158db0 legacy=0x7f08ac159200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.238+0000 7f08b1f75640 1 -- 172.21.15.81:0/1140970022 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac06bde0 con 0x7f08ac152fd0 2024-05-08T20:50:51.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b1f75640 1 --2- 172.21.15.81:0/1140970022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac152fd0 0x7f08ac0c19a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08ac06ae60 tx=0x7f089c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363abd64bbe6291f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b0f73640 1 -- 172.21.15.81:0/1140970022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0ab640 con 0x7f08ac152fd0 2024-05-08T20:50:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b0f73640 1 -- 172.21.15.81:0/1140970022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c0a7070 con 0x7f08ac152fd0 2024-05-08T20:50:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 -- 172.21.15.81:0/1140970022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac152fd0 msgr2=0x7f08ac0c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b0f73640 1 -- 172.21.15.81:0/1140970022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0ab640 con 0x7f08ac152fd0 2024-05-08T20:50:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 --2- 172.21.15.81:0/1140970022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac152fd0 0x7f08ac0c19a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08ac06ae60 tx=0x7f089c01c440 comp rx=0 tx=0).stop 2024-05-08T20:50:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 -- 172.21.15.81:0/1140970022 shutdown_connections 2024-05-08T20:50:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 --2- 172.21.15.81:0/1140970022 >> v2:172.21.15.117:3300/0 conn(0x7f08ac06afd0 0x7f08ac06b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 --2- 172.21.15.81:0/1140970022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac152fd0 0x7f08ac0c19a0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08ac06ae60 tx=0x7f089c01c440 comp rx=0 tx=0).stop 2024-05-08T20:50:51.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.246+0000 7f08b2f77640 1 -- 172.21.15.81:0/1140970022 >> 172.21.15.81:0/1140970022 conn(0x7f08ac0c2a90 msgr2=0x7f08ac0c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.306+0000 7f08b2f77640 1 -- 172.21.15.81:0/1140970022 shutdown_connections 2024-05-08T20:50:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.306+0000 7f08b2f77640 1 -- 172.21.15.81:0/1140970022 wait complete. 2024-05-08T20:50:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.306+0000 7f08b2f77640 1 Processor -- start 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 -- start start 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08ac158db0 0x7f08ac157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08ac0c44b0 0x7f08ac0c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c4ea0 con 0x7f08ac06afd0 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c5ca0 con 0x7f08ac158db0 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b2f77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c5070 con 0x7f08ac0c44b0 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48214/0 (socket says 172.21.15.81:48214) 2024-05-08T20:50:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 -- 172.21.15.81:0/3815059693 learned_addr learned my addr 172.21.15.81:0/3815059693 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 -- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08ac0c44b0 msgr2=0x7f08ac0c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08ac0c44b0 0x7f08ac0c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 -- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08ac158db0 msgr2=0x7f08ac157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08ac158db0 0x7f08ac157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 -- 172.21.15.81:0/3815059693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0094d0 con 0x7f08ac06afd0 2024-05-08T20:50:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.310+0000 7f08b1f75640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cce0 tx=0x7f089c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.314+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c003c80 con 0x7f08ac06afd0 2024-05-08T20:50:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.314+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c003de0 con 0x7f08ac06afd0 2024-05-08T20:50:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.314+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0be660 con 0x7f08ac06afd0 2024-05-08T20:50:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.314+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac0c59c0 con 0x7f08ac06afd0 2024-05-08T20:50:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.314+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac14d000 con 0x7f08ac06afd0 2024-05-08T20:50:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.318+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac0c0700 con 0x7f08ac06afd0 2024-05-08T20:50:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.322+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f089c0ab440 con 0x7f08ac06afd0 2024-05-08T20:50:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.322+0000 7f08a27fc640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 0x7f0890068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:51.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.322+0000 7f08b1774640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 0x7f0890068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.322+0000 7f08b1774640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 0x7f0890068c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08ac158cf0 tx=0x7f08a4009230 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.322+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f089c11efd0 con 0x7f08ac06afd0 2024-05-08T20:50:51.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:51.330+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f089c0ebf80 con 0x7f08ac06afd0 2024-05-08T20:50:52.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.710+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f08ac0747d0 con 0x7f08ac06afd0 2024-05-08T20:50:52.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.714+0000 7f08a27fc640 1 -- 172.21.15.81:0/3815059693 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f089c0ef5a0 con 0x7f08ac06afd0 2024-05-08T20:50:52.721 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":180,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.718+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 msgr2=0x7f0890068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.718+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 0x7f0890068c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08ac158cf0 tx=0x7f08a4009230 comp rx=0 tx=0).stop 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.718+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 msgr2=0x7f08ac15c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.718+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cce0 tx=0x7f089c0191e0 comp rx=0 tx=0).stop 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 shutdown_connections 2024-05-08T20:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0890066790 0x7f0890068c50 secure :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08ac158cf0 tx=0x7f08a4009230 comp rx=0 tx=0).stop 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08ac0c44b0 0x7f08ac0c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08ac158db0 0x7f08ac157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 --2- 172.21.15.81:0/3815059693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08ac06afd0 0x7f08ac15c970 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cce0 tx=0x7f089c0191e0 comp rx=0 tx=0).stop 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 >> 172.21.15.81:0/3815059693 conn(0x7f08ac0c2a90 msgr2=0x7f08ac1506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 shutdown_connections 2024-05-08T20:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:52.722+0000 7f08b2f77640 1 -- 172.21.15.81:0/3815059693 wait complete. 2024-05-08T20:50:55.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:50:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.134+0000 7fbe9d84e640 1 Processor -- start 2024-05-08T20:50:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.134+0000 7fbe9d84e640 1 -- start start 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe9d84e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe9d84e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe9815c320 0x7fbe980c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe9d84e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9815c7b0 con 0x7fbe98159b30 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe9d84e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9815ca90 con 0x7fbe9815c320 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe9d84e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9815cd70 con 0x7fbe98159750 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe967fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe98159b30 0x7fbe980c3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47244/0 (socket says 172.21.15.81:47244) 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe967fc640 1 -- 172.21.15.81:0/2547357493 learned_addr learned my addr 172.21.15.81:0/2547357493 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe977fe640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.81:3300/0 conn(0x7fbe9815c320 0x7fbe980c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe96ffd640 1 -- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 msgr2=0x7fbe980c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe96ffd640 1 -- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 msgr2=0x7fbe980c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe977fe640 1 -- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 msgr2=0x7fbe980c68a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe977fe640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe977fe640 1 -- 172.21.15.81:0/2547357493 >> v1:172.21.15.81:6789/0 conn(0x7fbe98159b30 legacy=0x7fbe980c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.138+0000 7fbe977fe640 1 -- 172.21.15.81:0/2547357493 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9815d050 con 0x7fbe9815c320 2024-05-08T20:50:56.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.142+0000 7fbe977fe640 1 --2- 172.21.15.81:0/2547357493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9815c320 0x7fbe980c3c30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe980a9450 tx=0x7fbe9001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c598ff5068f6125 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:56.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.142+0000 7fbe95ffb640 1 -- 172.21.15.81:0/2547357493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a58c0 con 0x7fbe9815c320 2024-05-08T20:50:56.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.142+0000 7fbe95ffb640 1 -- 172.21.15.81:0/2547357493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900a5a20 con 0x7fbe9815c320 2024-05-08T20:50:56.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.142+0000 7fbe95ffb640 1 -- 172.21.15.81:0/2547357493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a5db0 con 0x7fbe9815c320 2024-05-08T20:50:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.146+0000 7fbe9d84e640 1 -- 172.21.15.81:0/2547357493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9815c320 msgr2=0x7fbe980c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.146+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/2547357493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9815c320 0x7fbe980c3c30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe980a9450 tx=0x7fbe9001c8f0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 -- 172.21.15.81:0/2547357493 shutdown_connections 2024-05-08T20:50:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/2547357493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9815c320 0x7fbe980c3c30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/2547357493 >> v2:172.21.15.117:3300/0 conn(0x7fbe98159750 0x7fbe980c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 -- 172.21.15.81:0/2547357493 >> 172.21.15.81:0/2547357493 conn(0x7fbe9806a090 msgr2=0x7fbe9806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 -- 172.21.15.81:0/2547357493 shutdown_connections 2024-05-08T20:50:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 -- 172.21.15.81:0/2547357493 wait complete. 2024-05-08T20:50:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 Processor -- start 2024-05-08T20:50:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.150+0000 7fbe9d84e640 1 -- start start 2024-05-08T20:50:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe98159b30 0x7fbe9814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe980c4470 0x7fbe9814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9814bba0 con 0x7fbe98159750 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9814bdd0 con 0x7fbe980c4470 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe9d84e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98146c30 con 0x7fbe98159b30 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48228/0 (socket says 172.21.15.81:48228) 2024-05-08T20:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 -- 172.21.15.81:0/1477777724 learned_addr learned my addr 172.21.15.81:0/1477777724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 -- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe98159b30 msgr2=0x7fbe9814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe98159b30 0x7fbe9814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 -- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe980c4470 msgr2=0x7fbe9814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe980c4470 0x7fbe9814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 -- 172.21.15.81:0/1477777724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90009a70 con 0x7fbe98159750 2024-05-08T20:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.154+0000 7fbe96ffd640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e7e0 tx=0x7fbe8800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.162+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800c650 con 0x7fbe98159750 2024-05-08T20:50:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.166+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe98146f10 con 0x7fbe98159750 2024-05-08T20:50:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.166+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe980c60b0 con 0x7fbe98159750 2024-05-08T20:50:56.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.166+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe980c62d0 con 0x7fbe98159750 2024-05-08T20:50:56.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.166+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800c7b0 con 0x7fbe98159750 2024-05-08T20:50:56.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.166+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cb60 con 0x7fbe98159750 2024-05-08T20:50:56.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.170+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe8800cd40 con 0x7fbe98159750 2024-05-08T20:50:56.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.170+0000 7fbe7ffff640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 0x7fbe84068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:56.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.170+0000 7fbe967fc640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 0x7fbe84068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:56.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.170+0000 7fbe967fc640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 0x7fbe84068ca0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe98159270 tx=0x7fbe8c007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:56.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.170+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbe880845a0 con 0x7fbe98159750 2024-05-08T20:50:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.182+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe880515e0 con 0x7fbe98159750 2024-05-08T20:50:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbe98069550 con 0x7fbe98159750 2024-05-08T20:50:56.946 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe7ffff640 1 -- 172.21.15.81:0/1477777724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fbe88017620 con 0x7fbe98159750 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 msgr2=0x7fbe84068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 0x7fbe84068ca0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbe98159270 tx=0x7fbe8c007ab0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 msgr2=0x7fbe9815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e7e0 tx=0x7fbe8800eca0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 shutdown_connections 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe840667e0 0x7fbe84068ca0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe980c4470 0x7fbe9814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe98159b30 0x7fbe9814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 --2- 172.21.15.81:0/1477777724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe98159750 0x7fbe9815ab30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 >> 172.21.15.81:0/1477777724 conn(0x7fbe9806a090 msgr2=0x7fbe9806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 shutdown_connections 2024-05-08T20:50:56.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:56.942+0000 7fbe9d84e640 1 -- 172.21.15.81:0/1477777724 wait complete. 2024-05-08T20:50:56.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:50:56.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:50:57.051 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:50:57.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:50:57.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:50:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 Processor -- start 2024-05-08T20:50:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 -- start start 2024-05-08T20:50:57.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f2815edc0 0x7f7f280aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280a96d0 con 0x7f7f2815e9e0 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2808b480 con 0x7f7f2815edc0 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.462+0000 7f7f2cba7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2808b690 con 0x7f7f280bcc50 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58402/0 (socket says 172.21.15.81:58402) 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 -- 172.21.15.81:0/2801318058 learned_addr learned my addr 172.21.15.81:0/2801318058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:57.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f26d9d640 1 --2- 172.21.15.81:0/2801318058 >> v2:172.21.15.117:3300/0 conn(0x7f7f2815edc0 0x7f7f280aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 -- 172.21.15.81:0/2801318058 >> v2:172.21.15.117:3300/0 conn(0x7f7f2815edc0 msgr2=0x7f7f280aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/2801318058 >> v2:172.21.15.117:3300/0 conn(0x7f7f2815edc0 0x7f7f280aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 -- 172.21.15.81:0/2801318058 >> v1:172.21.15.117:6789/0 conn(0x7f7f2815e9e0 legacy=0x7f7f280ab580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:50:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 -- 172.21.15.81:0/2801318058 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2808b970 con 0x7f7f280bcc50 2024-05-08T20:50:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.466+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/2801318058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57cb2193d2e7d16f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.470+0000 7f7f2559a640 1 -- 172.21.15.81:0/2801318058 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280ab190 con 0x7f7f280bcc50 2024-05-08T20:50:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.470+0000 7f7f2559a640 1 -- 172.21.15.81:0/2801318058 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180a7050 con 0x7f7f280bcc50 2024-05-08T20:50:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.470+0000 7f7f2559a640 1 -- 172.21.15.81:0/2801318058 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180ab820 con 0x7f7f280bcc50 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 -- 172.21.15.81:0/2801318058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 msgr2=0x7f7f281653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 --2- 172.21.15.81:0/2801318058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1801c400 comp rx=0 tx=0).stop 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 -- 172.21.15.81:0/2801318058 shutdown_connections 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 --2- 172.21.15.81:0/2801318058 >> v2:172.21.15.117:3300/0 conn(0x7f7f2815edc0 0x7f7f280aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 --2- 172.21.15.81:0/2801318058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f280bcc50 0x7f7f281653c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 -- 172.21.15.81:0/2801318058 >> 172.21.15.81:0/2801318058 conn(0x7f7f280c3e00 msgr2=0x7f7f280c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 -- 172.21.15.81:0/2801318058 shutdown_connections 2024-05-08T20:50:57.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.474+0000 7f7f2cba7640 1 -- 172.21.15.81:0/2801318058 wait complete. 2024-05-08T20:50:57.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 Processor -- start 2024-05-08T20:50:57.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 -- start start 2024-05-08T20:50:57.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f280bcc50 0x7f7f28153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2815e9e0 0x7f7f28162530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 0x7f7f28161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f280bcc50 0x7f7f28153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c1ff0 con 0x7f7f2815e9e0 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28206370 con 0x7f7f280bcc50 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f280bcc50 0x7f7f28153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:40492/0 (socket says 172.21.15.81:40492) 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2659c640 1 -- 172.21.15.81:0/3165812307 learned_addr learned my addr 172.21.15.81:0/3165812307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2815e9e0 0x7f7f28162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f2cba7640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c16c0 con 0x7f7f2815edc0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.478+0000 7f7f26d9d640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 0x7f7f28161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f280bcc50 msgr2=0x7f7f28153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f280bcc50 0x7f7f28153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2815e9e0 msgr2=0x7f7f28162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2815e9e0 0x7f7f28162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180094d0 con 0x7f7f2815edc0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.482+0000 7f7f26d9d640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 0x7f7f28161090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000cc80 tx=0x7f7f2000a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.486+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2815e9e0 0x7f7f28162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.486+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000ce30 con 0x7f7f2815edc0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.486+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f200039a0 con 0x7f7f2815edc0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.486+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20003d30 con 0x7f7f2815edc0 2024-05-08T20:50:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.494+0000 7f7f2cba7640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280c19a0 con 0x7f7f2815edc0 2024-05-08T20:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.494+0000 7f7f2cba7640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f28154290 con 0x7f7f2815edc0 2024-05-08T20:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.498+0000 7f7f2cba7640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 0x7f7f281615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.498+0000 7f7f2cba7640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28069550 con 0x7f7f28162a70 2024-05-08T20:50:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.498+0000 7f7f2659c640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 0x7f7f281615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.498+0000 7f7f2659c640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f280c2160 con 0x7f7f28162a70 2024-05-08T20:50:57.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.502+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f20003e90 con 0x7f7f2815edc0 2024-05-08T20:50:57.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.506+0000 7f7f2659c640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 0x7f7f281615d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00d730 tx=0x7f7f1c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7f080777a0 0x7f7f08079c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7f200848b0 con 0x7f7f2815edc0 2024-05-08T20:50:57.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00b730 con 0x7f7f28162a70 2024-05-08T20:50:57.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7f1c00b890 con 0x7f7f28162a70 2024-05-08T20:50:57.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 msgr2=0x7f7f281615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 0x7f7f281615d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00d730 tx=0x7f7f1c00dbf0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 msgr2=0x7f7f281615d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:57.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f16ffd640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28162a70 0x7f7f281615d0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00d730 tx=0x7f7f1c00dbf0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7f080777a0 0x7f7f08079c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.510+0000 7f7f25d9b640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7f080777a0 0x7f7f08079c60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7f180ad000 tx=0x7f7f18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.530+0000 7f7f2cba7640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 0x7f7f28155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.530+0000 7f7f2cba7640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c1b30 con 0x7f7f28205e70 2024-05-08T20:50:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.530+0000 7f7f2659c640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 0x7f7f28155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.530+0000 7f7f2659c640 1 -- 172.21.15.81:0/3165812307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7f280c1800 con 0x7f7f28205e70 2024-05-08T20:50:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f2659c640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 0x7f7f28155a20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00d730 tx=0x7f7f1c004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c01e2f0 con 0x7f7f28205e70 2024-05-08T20:50:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f7f1c01e890 con 0x7f7f28205e70 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 msgr2=0x7f7f28155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 0x7f7f28155a20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00d730 tx=0x7f7f1c004780 comp rx=0 tx=0).stop 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 msgr2=0x7f7f28155a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.534+0000 7f7f16ffd640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f28205e70 0x7f7f28155a20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:57.539 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:57.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:57.542 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:57.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:57.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:57.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:57.547 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:57.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.549 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:57.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:50:57.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:57.552 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.538+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7f080777a0 msgr2=0x7f7f08079c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.538+0000 7f7f14ff9640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7f080777a0 0x7f7f08079c60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7f180ad000 tx=0x7f7f18008040 comp rx=0 tx=0).stop 2024-05-08T20:50:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.538+0000 7f7f26d9d640 1 -- 172.21.15.81:0/3165812307 reap_dead start 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.538+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 msgr2=0x7f7f28161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.538+0000 7f7f14ff9640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 0x7f7f28161090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000cc80 tx=0x7f7f2000a5c0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.546+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 shutdown_connections 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.546+0000 7f7f14ff9640 1 --2- 172.21.15.81:0/3165812307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f2815edc0 0x7f7f28161090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.546+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 >> 172.21.15.81:0/3165812307 conn(0x7f7f280c3e00 msgr2=0x7f7f2815de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.550+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 shutdown_connections 2024-05-08T20:50:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.550+0000 7f7f14ff9640 1 -- 172.21.15.81:0/3165812307 wait complete. 2024-05-08T20:50:57.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:57.598 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:50:57.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:50:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 Processor -- start 2024-05-08T20:50:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 -- start start 2024-05-08T20:50:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30580c37c0 0x7f30580aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 0x7f305814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3058150c50 con 0x7f30581516f0 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305814e700 con 0x7f30580c37c0 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f305dea6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580aa8c0 con 0x7f30580c2800 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f3057fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f30581516f0 0x7f30580c1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:47180/0 (socket says 172.21.15.81:47180) 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.926+0000 7f3057fff640 1 -- 172.21.15.81:0/2498865229 learned_addr learned my addr 172.21.15.81:0/2498865229 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235793326 0 0) 0x7f3058150c50 con 0x7f30581516f0 2024-05-08T20:50:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3040003530 con 0x7f30581516f0 2024-05-08T20:50:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f3056ffd640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 0x7f305814e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790750179 0 0) 0x7f3040003530 con 0x7f30581516f0 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 msgr2=0x7f305814e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 0x7f305814e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 >> v2:172.21.15.81:3300/0 conn(0x7f30580c37c0 msgr2=0x7f30580aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30577fe640 1 --2- 172.21.15.81:0/2498865229 >> v2:172.21.15.81:3300/0 conn(0x7f30580c37c0 0x7f30580aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 --2- 172.21.15.81:0/2498865229 >> v2:172.21.15.81:3300/0 conn(0x7f30580c37c0 0x7f30580aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058150ef0 con 0x7f30581516f0 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3050001a00 con 0x7f30581516f0 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30577fe640 1 --2- 172.21.15.81:0/2498865229 >> v2:172.21.15.81:3300/0 conn(0x7f30580c37c0 0x7f30580aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 >> v1:172.21.15.117:6789/0 conn(0x7f30581516f0 legacy=0x7f30580c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 0x7f3040003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3040004d10 0x7f3040005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305814e700 con 0x7f3040003fb0 2024-05-08T20:50:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580aa8c0 con 0x7f3040004d10 2024-05-08T20:50:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304000bba0 con 0x7f30580c2800 2024-05-08T20:50:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.930+0000 7f3057fff640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3040004d10 0x7f3040005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 -- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 msgr2=0x7f3040003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30580c2800 0x7f3040003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 -- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3040004d10 msgr2=0x7f3040005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3040004d10 0x7f3040005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 -- 172.21.15.81:0/2498865229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058150ef0 con 0x7f3040003fb0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.934+0000 7f3056ffd640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30400047d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f304c00ba10 tx=0x7f304c01c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440eb8eb34e30156 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0aa630 con 0x7f3040003fb0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0aa790 con 0x7f3040003fb0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f30567fc640 1 -- 172.21.15.81:0/2498865229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0aab40 con 0x7f3040003fb0 2024-05-08T20:50:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f305dea6640 1 -- 172.21.15.81:0/2498865229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 msgr2=0x7f30400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f305dea6640 1 --2- 172.21.15.81:0/2498865229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30400047d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f304c00ba10 tx=0x7f304c01c6c0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.938+0000 7f3057fff640 1 -- 172.21.15.81:0/2498865229 reap_dead start 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 -- 172.21.15.81:0/2498865229 shutdown_connections 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 -- 172.21.15.81:0/2498865229 >> 172.21.15.81:0/2498865229 conn(0x7f30580c2ca0 msgr2=0x7f30580c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 -- 172.21.15.81:0/2498865229 shutdown_connections 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 -- 172.21.15.81:0/2498865229 wait complete. 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 Processor -- start 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.942+0000 7f305dea6640 1 -- start start 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30581e9fb0 0x7f3058141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f305814f5b0 0x7f305814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30581ea520 con 0x7f3040003fb0 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30581e6050 con 0x7f30581e9fb0 2024-05-08T20:50:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30581e7020 con 0x7f305814f5b0 2024-05-08T20:50:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48274/0 (socket says 172.21.15.81:48274) 2024-05-08T20:50:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 -- 172.21.15.81:0/458905492 learned_addr learned my addr 172.21.15.81:0/458905492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f305814f5b0 msgr2=0x7f305814fa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:50:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f305814f5b0 0x7f305814fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30581e9fb0 msgr2=0x7f3058141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30581e9fb0 0x7f3058141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30581e6260 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f30577fe640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f304800c7f0 tx=0x7f304800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800cea0 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048007a30 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30581e6540 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.946+0000 7f305dea6640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30581e6b00 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048007da0 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30480113f0 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f303ffff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f30440667e0 0x7f3044068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f30480846b0 con 0x7f3040003fb0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f3056ffd640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f30440667e0 0x7f3044068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.954+0000 7f3056ffd640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f30440667e0 0x7f3044068ca0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f304c00ba10 tx=0x7f304c0ac040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.974+0000 7f305dea6640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 0x7f3038004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f305dea6640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038007e90 con 0x7f3038002a40 2024-05-08T20:50:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f3057fff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 0x7f3038004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f3057fff640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3038008050 con 0x7f3038002a40 2024-05-08T20:50:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f3057fff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 0x7f3038004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30580aafa0 tx=0x7f305000fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000fea0 con 0x7f3038002a40 2024-05-08T20:50:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f30500070d0 con 0x7f3038002a40 2024-05-08T20:50:57.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 msgr2=0x7f3038004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:57.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 0x7f3038004f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30580aafa0 tx=0x7f305000fc50 comp rx=0 tx=0).stop 2024-05-08T20:50:57.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 msgr2=0x7f3038004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:57.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.978+0000 7f303ffff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3038002a40 0x7f3038004f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.990+0000 7f303dffb640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 0x7f3030004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.990+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030007d20 con 0x7f30300028f0 2024-05-08T20:50:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.990+0000 7f3057fff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 0x7f3030004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f3057fff640 1 -- 172.21.15.81:0/458905492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3030007ee0 con 0x7f30300028f0 2024-05-08T20:50:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f3057fff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 0x7f3030004d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3038008020 tx=0x7f3048004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050022070 con 0x7f30300028f0 2024-05-08T20:50:57.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f3050007a00 con 0x7f30300028f0 2024-05-08T20:50:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 msgr2=0x7f3030004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 0x7f3030004d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3038008020 tx=0x7f3048004740 comp rx=0 tx=0).stop 2024-05-08T20:50:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 msgr2=0x7f3030004d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:57.994+0000 7f303ffff640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30300028f0 0x7f3030004d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.002 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:58.014 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f30440667e0 msgr2=0x7f3044068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f30440667e0 0x7f3044068ca0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f304c00ba10 tx=0x7f304c0ac040 comp rx=0 tx=0).stop 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f3057fff640 1 -- 172.21.15.81:0/458905492 reap_dead start 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 msgr2=0x7f30580a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f304800c7f0 tx=0x7f304800ccb0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 shutdown_connections 2024-05-08T20:50:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 --2- 172.21.15.81:0/458905492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3040003fb0 0x7f30580a7c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 >> 172.21.15.81:0/458905492 conn(0x7f30580c2ca0 msgr2=0x7f30580c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 shutdown_connections 2024-05-08T20:50:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.006+0000 7f303dffb640 1 -- 172.21.15.81:0/458905492 wait complete. 2024-05-08T20:50:58.050 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:58.050 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:50:58.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:50:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 Processor -- start 2024-05-08T20:50:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 -- start start 2024-05-08T20:50:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa93c151f00 0x7fa93c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa93c154cf0 0x7fa93c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c06bb20 con 0x7fa93c151f00 2024-05-08T20:50:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c1548e0 con 0x7fa93c154cf0 2024-05-08T20:50:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa943612640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c158e20 con 0x7fa93c155690 2024-05-08T20:50:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa93c151f00 0x7fa93c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa93c151f00 0x7fa93c1588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48288/0 (socket says 172.21.15.81:48288) 2024-05-08T20:50:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 -- 172.21.15.81:0/1509392160 learned_addr learned my addr 172.21.15.81:0/1509392160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa940bad640 1 --2- 172.21.15.81:0/1509392160 >> v2:172.21.15.117:3300/0 conn(0x7fa93c154cf0 0x7fa93c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 -- 172.21.15.81:0/1509392160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 msgr2=0x7fa93c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1509392160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 -- 172.21.15.81:0/1509392160 >> v2:172.21.15.117:3300/0 conn(0x7fa93c154cf0 msgr2=0x7fa93c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1509392160 >> v2:172.21.15.117:3300/0 conn(0x7fa93c154cf0 0x7fa93c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.466+0000 7fa9413ae640 1 -- 172.21.15.81:0/1509392160 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c1522e0 con 0x7fa93c151f00 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.470+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1509392160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c151f00 0x7fa93c1588e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa93c08c580 tx=0x7fa92c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4d6169fb3b2d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.474+0000 7fa933fff640 1 -- 172.21.15.81:0/1509392160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0ad660 con 0x7fa93c151f00 2024-05-08T20:50:58.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.474+0000 7fa933fff640 1 -- 172.21.15.81:0/1509392160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c0ad7c0 con 0x7fa93c151f00 2024-05-08T20:50:58.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.474+0000 7fa933fff640 1 -- 172.21.15.81:0/1509392160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0adb50 con 0x7fa93c151f00 2024-05-08T20:50:58.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.478+0000 7fa943612640 1 -- 172.21.15.81:0/1509392160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c151f00 msgr2=0x7fa93c1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.478+0000 7fa943612640 1 --2- 172.21.15.81:0/1509392160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c151f00 0x7fa93c1588e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa93c08c580 tx=0x7fa92c01c400 comp rx=0 tx=0).stop 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.486+0000 7fa943612640 1 -- 172.21.15.81:0/1509392160 shutdown_connections 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.486+0000 7fa943612640 1 --2- 172.21.15.81:0/1509392160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.486+0000 7fa943612640 1 --2- 172.21.15.81:0/1509392160 >> v2:172.21.15.117:3300/0 conn(0x7fa93c154cf0 0x7fa93c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.486+0000 7fa943612640 1 --2- 172.21.15.81:0/1509392160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c151f00 0x7fa93c1588e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.486+0000 7fa943612640 1 -- 172.21.15.81:0/1509392160 >> 172.21.15.81:0/1509392160 conn(0x7fa93c0715f0 msgr2=0x7fa93c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.490+0000 7fa943612640 1 -- 172.21.15.81:0/1509392160 shutdown_connections 2024-05-08T20:50:58.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.490+0000 7fa943612640 1 -- 172.21.15.81:0/1509392160 wait complete. 2024-05-08T20:50:58.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.490+0000 7fa943612640 1 Processor -- start 2024-05-08T20:50:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.494+0000 7fa943612640 1 -- start start 2024-05-08T20:50:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa93c151f00 0x7fa93c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 0x7fa93c1fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c1fd610 0x7fa93c0aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0ae590 con 0x7fa93c1fd610 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0702b0 con 0x7fa93c151f00 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa943612640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0aefb0 con 0x7fa93c154cf0 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 0x7fa93c1fd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 0x7fa93c1fd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58470/0 (socket says 172.21.15.81:58470) 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 -- 172.21.15.81:0/1807805880 learned_addr learned my addr 172.21.15.81:0/1807805880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa941baf640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c1fd610 0x7fa93c0aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa93c151f00 msgr2=0x7fa93c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa93c151f00 0x7fa93c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c1fd610 msgr2=0x7fa93c0aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93c1fd610 0x7fa93c0aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0094d0 con 0x7fa93c154cf0 2024-05-08T20:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa940bad640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 0x7fa93c1fd0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa934007ef0 tx=0x7fa93400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.498+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934014620 con 0x7fa93c154cf0 2024-05-08T20:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa943612640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c0abb90 con 0x7fa93c154cf0 2024-05-08T20:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa943612640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c0af4e0 con 0x7fa93c154cf0 2024-05-08T20:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa943612640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa943612640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c069600 con 0x7fa93c155690 2024-05-08T20:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934014780 con 0x7fa93c154cf0 2024-05-08T20:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.502+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934014b30 con 0x7fa93c154cf0 2024-05-08T20:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa9413ae640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa93c0c6820 con 0x7fa93c155690 2024-05-08T20:50:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0aae80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0cb390 tx=0x7fa92c0adf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa934014c90 con 0x7fa93c154cf0 2024-05-08T20:50:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa931ffb640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9200666c0 0x7fa920068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.506+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa934084df0 con 0x7fa93c154cf0 2024-05-08T20:50:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.510+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0b7600 con 0x7fa93c155690 2024-05-08T20:50:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.510+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa92c0b7760 con 0x7fa93c155690 2024-05-08T20:50:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.510+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 msgr2=0x7fa93c0aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.510+0000 7fa931ffb640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0aae80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0cb390 tx=0x7fa92c0adf40 comp rx=0 tx=0).stop 2024-05-08T20:50:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.514+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 msgr2=0x7fa93c0aae80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.514+0000 7fa931ffb640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c155690 0x7fa93c0aae80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.514+0000 7fa941baf640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9200666c0 0x7fa920068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.526+0000 7fa9277fe640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 0x7fa914004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.526+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa914007d20 con 0x7fa9140028f0 2024-05-08T20:50:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.526+0000 7fa941baf640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9200666c0 0x7fa920068b80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa938009870 tx=0x7fa938006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.534+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 0x7fa914004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.534+0000 7fa9413ae640 1 -- 172.21.15.81:0/1807805880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa914007ee0 con 0x7fa9140028f0 2024-05-08T20:50:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.534+0000 7fa9413ae640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 0x7fa914004d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c0a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0c6070 con 0x7fa9140028f0 2024-05-08T20:50:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fa92c003a60 con 0x7fa9140028f0 2024-05-08T20:50:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 msgr2=0x7fa914004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 0x7fa914004d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c0a9000 comp rx=0 tx=0).stop 2024-05-08T20:50:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 msgr2=0x7fa914004d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa931ffb640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9140028f0 0x7fa914004d90 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c0a9000 comp rx=0 tx=0).stop 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:50:58.542 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.543 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.544 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:50:58.545 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:50:58.546 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.548 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:50:58.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:50:58.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:50:58.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:50:58.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:50:58.554 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:50:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9200666c0 msgr2=0x7fa920068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa9277fe640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa9200666c0 0x7fa920068b80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa938009870 tx=0x7fa938006f90 comp rx=0 tx=0).stop 2024-05-08T20:50:58.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 msgr2=0x7fa93c1fd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.538+0000 7fa9277fe640 1 --2- 172.21.15.81:0/1807805880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa93c154cf0 0x7fa93c1fd0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa934007ef0 tx=0x7fa93400e4b0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.546+0000 7fa941baf640 1 -- 172.21.15.81:0/1807805880 reap_dead start 2024-05-08T20:50:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.546+0000 7fa941baf640 1 -- 172.21.15.81:0/1807805880 reap_dead start 2024-05-08T20:50:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.546+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 shutdown_connections 2024-05-08T20:50:58.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.550+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 >> 172.21.15.81:0/1807805880 conn(0x7fa93c0715f0 msgr2=0x7fa93c0c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.554+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 shutdown_connections 2024-05-08T20:50:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.554+0000 7fa9277fe640 1 -- 172.21.15.81:0/1807805880 wait complete. 2024-05-08T20:50:58.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:50:58.626 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:50:58.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:50:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.850+0000 7f442c1ec640 1 Processor -- start 2024-05-08T20:50:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.850+0000 7f442c1ec640 1 -- start start 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442c1ec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f442406b230 0x7f44240c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442c1ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240c3a50 con 0x7f44241519d0 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442c1ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240705e0 con 0x7f4424070c00 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442c1ec640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4424072940 con 0x7f442406b230 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442a789640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f44241519d0 0x7f4424151e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57434/0 (socket says 172.21.15.81:57434) 2024-05-08T20:50:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f442a789640 1 -- 172.21.15.81:0/3956601468 learned_addr learned my addr 172.21.15.81:0/3956601468 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:50:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f4429f88640 1 --2- 172.21.15.81:0/3956601468 >> v2:172.21.15.81:3300/0 conn(0x7f442406b230 0x7f44240c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f4429f88640 1 -- 172.21.15.81:0/3956601468 >> v1:172.21.15.117:6789/0 conn(0x7f4424070c00 legacy=0x7f442414e8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:50:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f4429f88640 1 -- 172.21.15.81:0/3956601468 >> v1:172.21.15.81:6789/0 conn(0x7f44241519d0 legacy=0x7f4424151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.854+0000 7f4429f88640 1 -- 172.21.15.81:0/3956601468 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240708c0 con 0x7f442406b230 2024-05-08T20:50:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.858+0000 7f4429f88640 1 --2- 172.21.15.81:0/3956601468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f44240c2800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f441800bac0 tx=0x7f4418020b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22cbe0f463350e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f4428f86640 1 -- 172.21.15.81:0/3956601468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180a9bf0 con 0x7f442406b230 2024-05-08T20:50:58.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f4428f86640 1 -- 172.21.15.81:0/3956601468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180a9d50 con 0x7f442406b230 2024-05-08T20:50:58.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f4428f86640 1 -- 172.21.15.81:0/3956601468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180b1660 con 0x7f442406b230 2024-05-08T20:50:58.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 -- 172.21.15.81:0/3956601468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 msgr2=0x7f44240c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 --2- 172.21.15.81:0/3956601468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f44240c2800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f441800bac0 tx=0x7f4418020b40 comp rx=0 tx=0).stop 2024-05-08T20:50:58.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 -- 172.21.15.81:0/3956601468 shutdown_connections 2024-05-08T20:50:58.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 --2- 172.21.15.81:0/3956601468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f44240c2800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 -- 172.21.15.81:0/3956601468 >> 172.21.15.81:0/3956601468 conn(0x7f44240c71b0 msgr2=0x7f44240c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:58.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 -- 172.21.15.81:0/3956601468 shutdown_connections 2024-05-08T20:50:58.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.874+0000 7f442c1ec640 1 -- 172.21.15.81:0/3956601468 wait complete. 2024-05-08T20:50:58.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 Processor -- start 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 -- start start 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4424070c00 0x7f44241548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44241519d0 0x7f4424154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442414dd30 con 0x7f442406b230 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44241f76a0 con 0x7f44241519d0 2024-05-08T20:50:58.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f442c1ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44241f8670 con 0x7f4424070c00 2024-05-08T20:50:58.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48444/0 (socket says 172.21.15.81:48444) 2024-05-08T20:50:58.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 -- 172.21.15.81:0/2154055298 learned_addr learned my addr 172.21.15.81:0/2154055298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 -- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4424070c00 msgr2=0x7f44241548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4424070c00 0x7f44241548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 -- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44241519d0 msgr2=0x7f4424154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44241519d0 0x7f4424154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.878+0000 7f4429f88640 1 -- 172.21.15.81:0/2154055298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441800b6c0 con 0x7f442406b230 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f4429f88640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441801d750 tx=0x7f441801d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418012480 con 0x7f442406b230 2024-05-08T20:50:58.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f442c1ec640 1 -- 172.21.15.81:0/2154055298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44241f81e0 con 0x7f442406b230 2024-05-08T20:50:58.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f442c1ec640 1 -- 172.21.15.81:0/2154055298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44241f7b90 con 0x7f442406b230 2024-05-08T20:50:58.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4418012600 con 0x7f442406b230 2024-05-08T20:50:58.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.882+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180bc6a0 con 0x7f442406b230 2024-05-08T20:50:58.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.886+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc005260 con 0x7f442406b230 2024-05-08T20:50:58.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.886+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4418011450 con 0x7f442406b230 2024-05-08T20:50:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.894+0000 7f44167fc640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 0x7f4408068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:50:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.898+0000 7f4429787640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 0x7f4408068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:50:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.898+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f441811fd80 con 0x7f442406b230 2024-05-08T20:50:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.898+0000 7f4429787640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 0x7f4408068b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f44240c6e90 tx=0x7f4420006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:50:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:58.898+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4418125020 con 0x7f442406b230 2024-05-08T20:50:59.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.690+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f43fc005260 con 0x7f442406b230 2024-05-08T20:50:59.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.690+0000 7f44167fc640 1 -- 172.21.15.81:0/2154055298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f44180b6080 con 0x7f442406b230 2024-05-08T20:50:59.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.702+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 msgr2=0x7f4408068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:59.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.702+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 0x7f4408068b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f44240c6e90 tx=0x7f4420006c50 comp rx=0 tx=0).stop 2024-05-08T20:50:59.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.702+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 msgr2=0x7f442414d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:50:59.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.702+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f441801d750 tx=0x7f441801d8e0 comp rx=0 tx=0).stop 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 shutdown_connections 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4408066690 0x7f4408068b50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44241519d0 0x7f4424154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4424070c00 0x7f44241548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 --2- 172.21.15.81:0/2154055298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442406b230 0x7f442414d120 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 >> 172.21.15.81:0/2154055298 conn(0x7f44240c71b0 msgr2=0x7f4424151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 shutdown_connections 2024-05-08T20:50:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:50:59.706+0000 7f440ffff640 1 -- 172.21.15.81:0/2154055298 wait complete. 2024-05-08T20:50:59.898 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:51:09.899 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:51:09.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:10.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.237+0000 7fb340ede640 1 Processor -- start 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb340ede640 1 -- start start 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb340ede640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb33c0c1f90 0x7fb33c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb340ede640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c06c3b0 con 0x7fb33c1473c0 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb340ede640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0c0ae0 con 0x7fb33c151e20 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb340ede640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c1518f0 con 0x7fb33c0c1f90 2024-05-08T20:51:10.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb33ad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb33c151e20 0x7fb33c0c3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:57016/0 (socket says 172.21.15.81:57016) 2024-05-08T20:51:10.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb33ad9d640 1 -- 172.21.15.81:0/2764940286 learned_addr learned my addr 172.21.15.81:0/2764940286 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:10.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638627149 0 0) 0x7fb33c0c0ae0 con 0x7fb33c151e20 2024-05-08T20:51:10.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.241+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb324003510 con 0x7fb33c151e20 2024-05-08T20:51:10.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696499401 0 0) 0x7fb33c06c3b0 con 0x7fb33c1473c0 2024-05-08T20:51:10.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c0c0ae0 con 0x7fb33c1473c0 2024-05-08T20:51:10.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930200306 0 0) 0x7fb33c0c0ae0 con 0x7fb33c1473c0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 >> v2:172.21.15.117:3300/0 conn(0x7fb33c0c1f90 msgr2=0x7fb33c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 --2- 172.21.15.81:0/2764940286 >> v2:172.21.15.117:3300/0 conn(0x7fb33c0c1f90 0x7fb33c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 >> v1:172.21.15.117:6789/0 conn(0x7fb33c151e20 legacy=0x7fb33c0c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c1477a0 con 0x7fb33c1473c0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb330001680 con 0x7fb33c1473c0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 >> v1:172.21.15.81:6789/0 conn(0x7fb33c1473c0 legacy=0x7fb33c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb324003d10 0x7fb324008780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb324008cc0 0x7fb32400b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb32400dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1518f0 con 0x7fb32400b6f0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400e490 con 0x7fb324008cc0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32400e650 con 0x7fb324003d10 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb32400dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:10.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 -- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb324003d10 msgr2=0x7fb324008780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:10.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb324003d10 0x7fb324008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 -- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb324008cc0 msgr2=0x7fb32400b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:10.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb324008cc0 0x7fb32400b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.245+0000 7fb33ad9d640 1 -- 172.21.15.81:0/2764940286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0c0ae0 con 0x7fb32400b6f0 2024-05-08T20:51:10.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.249+0000 7fb33ad9d640 1 -- 172.21.15.81:0/2764940286 reap_dead start 2024-05-08T20:51:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb33ad9d640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb32400dbb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0018e0 tx=0x7fb32c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b120f66f11a4cbf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0a5c90 con 0x7fb32400b6f0 2024-05-08T20:51:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c006030 con 0x7fb32400b6f0 2024-05-08T20:51:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb33959a640 1 -- 172.21.15.81:0/2764940286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0ae420 con 0x7fb32400b6f0 2024-05-08T20:51:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb340ede640 1 -- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 msgr2=0x7fb32400dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb340ede640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb32400dbb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0018e0 tx=0x7fb32c01cc80 comp rx=0 tx=0).stop 2024-05-08T20:51:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb340ede640 1 -- 172.21.15.81:0/2764940286 shutdown_connections 2024-05-08T20:51:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb340ede640 1 --2- 172.21.15.81:0/2764940286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb32400dbb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.253+0000 7fb340ede640 1 -- 172.21.15.81:0/2764940286 >> 172.21.15.81:0/2764940286 conn(0x7fb33c06a2f0 msgr2=0x7fb33c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.257+0000 7fb340ede640 1 -- 172.21.15.81:0/2764940286 shutdown_connections 2024-05-08T20:51:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.257+0000 7fb340ede640 1 -- 172.21.15.81:0/2764940286 wait complete. 2024-05-08T20:51:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 Processor -- start 2024-05-08T20:51:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 -- start start 2024-05-08T20:51:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb33c147990 0x7fb33c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 0x7fb33c14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1e6bb0 con 0x7fb32400b6f0 2024-05-08T20:51:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c14c8c0 con 0x7fb33c14cd50 2024-05-08T20:51:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb340ede640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c14bfb0 con 0x7fb33c147990 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33ad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 0x7fb33c14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33ad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 0x7fb33c14d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:37624/0 (socket says 172.21.15.81:37624) 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33ad9d640 1 -- 172.21.15.81:0/781297647 learned_addr learned my addr 172.21.15.81:0/781297647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44112/0 (socket says 172.21.15.81:44112) 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb339d9b640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb33c147990 0x7fb33c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 -- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb33c147990 msgr2=0x7fb33c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb33c147990 0x7fb33c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 -- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 msgr2=0x7fb33c14d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 0x7fb33c14d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 -- 172.21.15.81:0/781297647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c14d710 con 0x7fb32400b6f0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.261+0000 7fb33a59c640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33000f400 tx=0x7fb33000f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300255a0 con 0x7fb32400b6f0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330025720 con 0x7fb32400b6f0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c147f00 con 0x7fb32400b6f0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330025b10 con 0x7fb32400b6f0 2024-05-08T20:51:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c14c550 con 0x7fb32400b6f0 2024-05-08T20:51:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb330025c70 con 0x7fb32400b6f0 2024-05-08T20:51:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.265+0000 7fb32affd640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 0x7fb31c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.269+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb330097870 con 0x7fb32400b6f0 2024-05-08T20:51:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.269+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c14c710 con 0x7fb32400b6f0 2024-05-08T20:51:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.269+0000 7fb339d9b640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 0x7fb31c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.273+0000 7fb339d9b640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 0x7fb31c068b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0c0ab0 tx=0x7fb334004b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.277+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb3300648f0 con 0x7fb32400b6f0 2024-05-08T20:51:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.981+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb33c074950 con 0x7fb32400b6f0 2024-05-08T20:51:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.981+0000 7fb32affd640 1 -- 172.21.15.81:0/781297647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fb330067f10 con 0x7fb32400b6f0 2024-05-08T20:51:10.988 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 msgr2=0x7fb31c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 0x7fb31c068b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0c0ab0 tx=0x7fb334004b60 comp rx=0 tx=0).stop 2024-05-08T20:51:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 msgr2=0x7fb33c1e6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33000f400 tx=0x7fb33000f8c0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 shutdown_connections 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb31c0666c0 0x7fb31c068b80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb33c14cd50 0x7fb33c14d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb33c147990 0x7fb33c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 --2- 172.21.15.81:0/781297647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32400b6f0 0x7fb33c1e6670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.985+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 >> 172.21.15.81:0/781297647 conn(0x7fb33c06a2f0 msgr2=0x7fb33c0c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.989+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 shutdown_connections 2024-05-08T20:51:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:10.989+0000 7fb340ede640 1 -- 172.21.15.81:0/781297647 wait complete. 2024-05-08T20:51:11.168 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:51:11.168 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:51:11.168 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:51:11.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:51:11.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.641+0000 7fa43c2f1640 1 Processor -- start 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.645+0000 7fa43c2f1640 1 -- start start 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43c2f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa42c02b040 0x7fa42c0d6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43c2f1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa42c00ba00 0x7fa42c0d6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43c2f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c046510 con 0x7fa42c0d3c50 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43c2f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c046300 con 0x7fa42c02b040 2024-05-08T20:51:11.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43c2f1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c031720 con 0x7fa42c00ba00 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43b08f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa42c00ba00 0x7fa42c0d6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43a08d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa42c0d3c50 0x7fa42c006b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:57020/0 (socket says 172.21.15.81:57020) 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43a08d640 1 -- 172.21.15.81:0/4157338225 learned_addr learned my addr 172.21.15.81:0/4157338225 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43908b640 1 -- 172.21.15.81:0/4157338225 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513905216 0 0) 0x7fa42c046510 con 0x7fa42c0d3c50 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43b08f640 1 -- 172.21.15.81:0/4157338225 >> v2:172.21.15.81:3300/0 conn(0x7fa42c02b040 msgr2=0x7fa42c0d6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43b08f640 1 --2- 172.21.15.81:0/4157338225 >> v2:172.21.15.81:3300/0 conn(0x7fa42c02b040 0x7fa42c0d6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43b08f640 1 -- 172.21.15.81:0/4157338225 >> v1:172.21.15.117:6789/0 conn(0x7fa42c0d3c50 legacy=0x7fa42c006b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.649+0000 7fa43b08f640 1 -- 172.21.15.81:0/4157338225 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c007830 con 0x7fa42c00ba00 2024-05-08T20:51:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.673+0000 7fa43b08f640 1 --2- 172.21.15.81:0/4157338225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c00ba00 0x7fa42c0d6ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4340638e0 tx=0x7fa434097740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253a0e30780b9501 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.673+0000 7fa43908b640 1 -- 172.21.15.81:0/4157338225 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434125720 con 0x7fa42c00ba00 2024-05-08T20:51:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.673+0000 7fa43908b640 1 -- 172.21.15.81:0/4157338225 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434125880 con 0x7fa42c00ba00 2024-05-08T20:51:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.673+0000 7fa43c2f1640 1 -- 172.21.15.81:0/4157338225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c00ba00 msgr2=0x7fa42c0d6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.673+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/4157338225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c00ba00 0x7fa42c0d6ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4340638e0 tx=0x7fa434097740 comp rx=0 tx=0).stop 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- 172.21.15.81:0/4157338225 shutdown_connections 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/4157338225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c00ba00 0x7fa42c0d6ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/4157338225 >> v2:172.21.15.81:3300/0 conn(0x7fa42c02b040 0x7fa42c0d6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- 172.21.15.81:0/4157338225 >> 172.21.15.81:0/4157338225 conn(0x7fa42c006040 msgr2=0x7fa42c006450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- 172.21.15.81:0/4157338225 shutdown_connections 2024-05-08T20:51:11.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- 172.21.15.81:0/4157338225 wait complete. 2024-05-08T20:51:11.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 Processor -- start 2024-05-08T20:51:11.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- start start 2024-05-08T20:51:11.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c00ba00 0x7fa42c0440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c02b040 0x7fa42c041700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.677+0000 7fa43c2f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c042890 con 0x7fa42c0d3c50 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43c2f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0e5fe0 con 0x7fa42c02b040 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43c2f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c042360 con 0x7fa42c00ba00 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44136/0 (socket says 172.21.15.81:44136) 2024-05-08T20:51:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 -- 172.21.15.81:0/1997181188 learned_addr learned my addr 172.21.15.81:0/1997181188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c00ba00 msgr2=0x7fa42c0440f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa42c00ba00 0x7fa42c0440f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c02b040 msgr2=0x7fa42c041700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa42c02b040 0x7fa42c041700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434072040 con 0x7fa42c0d3c50 2024-05-08T20:51:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.681+0000 7fa43b08f640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa434063da0 tx=0x7fa434094530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:11.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.685+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434073690 con 0x7fa42c0d3c50 2024-05-08T20:51:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.685+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c043970 con 0x7fa42c0d3c50 2024-05-08T20:51:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.685+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c043600 con 0x7fa42c0d3c50 2024-05-08T20:51:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340737f0 con 0x7fa42c0d3c50 2024-05-08T20:51:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434061240 con 0x7fa42c0d3c50 2024-05-08T20:51:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa434125a70 con 0x7fa42c0d3c50 2024-05-08T20:51:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa42affd640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa4180667e0 0x7fa418068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa43a08d640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa4180667e0 0x7fa418068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa43a08d640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa4180667e0 0x7fa418068ca0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa430001530 tx=0x7fa430007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.689+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa434121040 con 0x7fa42c0d3c50 2024-05-08T20:51:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.693+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 0x7fa41c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.693+0000 7fa43988c640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 0x7fa41c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:11.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.693+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c007e90 con 0x7fa41c002a40 2024-05-08T20:51:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.693+0000 7fa43988c640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa41c008050 con 0x7fa41c002a40 2024-05-08T20:51:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.693+0000 7fa43988c640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 0x7fa41c004f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005f80 tx=0x7fa424009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011830 con 0x7fa41c002a40 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fa424011990 con 0x7fa41c002a40 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 msgr2=0x7fa41c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 0x7fa41c004f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005f80 tx=0x7fa424009f90 comp rx=0 tx=0).stop 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 msgr2=0x7fa41c004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.697+0000 7fa42affd640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c002a40 0x7fa41c004f00 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005f80 tx=0x7fa424009f90 comp rx=0 tx=0).stop 2024-05-08T20:51:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa428ff9640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 0x7fa41c00cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa43988c640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 0x7fa41c00cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:11.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa428ff9640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c002360 con 0x7fa41c001d30 2024-05-08T20:51:11.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa43988c640 1 -- 172.21.15.81:0/1997181188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa41c00a230 con 0x7fa41c001d30 2024-05-08T20:51:11.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa43988c640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 0x7fa41c00cb40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa424013000 tx=0x7fa4240047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424025680 con 0x7fa41c001d30 2024-05-08T20:51:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7fa42401ce70 con 0x7fa41c001d30 2024-05-08T20:51:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 msgr2=0x7fa41c00cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 0x7fa41c00cb40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa424013000 tx=0x7fa4240047e0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 msgr2=0x7fa41c00cb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.709+0000 7fa42affd640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c001d30 0x7fa41c00cb40 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa424013000 tx=0x7fa4240047e0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:51:11.717 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 17, 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:51:11.718 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:51:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:11.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:11.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:11.727 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:11.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:51:11.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:51:11.730 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa4180667e0 msgr2=0x7fa418068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa4180667e0 0x7fa418068ca0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa430001530 tx=0x7fa430007970 comp rx=0 tx=0).stop 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43b08f640 1 -- 172.21.15.81:0/1997181188 reap_dead start 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 msgr2=0x7fa42c0e4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa434063da0 tx=0x7fa434094530 comp rx=0 tx=0).stop 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 shutdown_connections 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 --2- 172.21.15.81:0/1997181188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42c0d3c50 0x7fa42c0e4740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 >> 172.21.15.81:0/1997181188 conn(0x7fa42c006040 msgr2=0x7fa42c009f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 shutdown_connections 2024-05-08T20:51:11.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:11.717+0000 7fa43c2f1640 1 -- 172.21.15.81:0/1997181188 wait complete. 2024-05-08T20:51:11.829 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:51:11.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:51:11.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:51:12.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 Processor -- start 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 -- start start 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006cca0 0x7f886006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f886006f200 0x7f88600a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886006afd0 con 0x7f88600a9900 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88600728a0 con 0x7f886006f200 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f88675ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886006b220 con 0x7f886006cca0 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f8864b55640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f886006f200 0x7f88600a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f8864b55640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f886006f200 0x7f88600a93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44160/0 (socket says 172.21.15.81:44160) 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f8864b55640 1 -- 172.21.15.81:0/3129454270 learned_addr learned my addr 172.21.15.81:0/3129454270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f8865356640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006cca0 0x7f886006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.185+0000 7f8857fff640 1 -- 172.21.15.81:0/3129454270 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830303489 0 0) 0x7f886006afd0 con 0x7f88600a9900 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.201+0000 7f8857fff640 1 -- 172.21.15.81:0/3129454270 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c007940 con 0x7f88600a9900 2024-05-08T20:51:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.201+0000 7f8864b55640 1 -- 172.21.15.81:0/3129454270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006cca0 msgr2=0x7f886006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:12.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.201+0000 7f8864b55640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006cca0 0x7f886006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.201+0000 7f8864b55640 1 -- 172.21.15.81:0/3129454270 >> v1:172.21.15.117:6789/0 conn(0x7f88600a9900 legacy=0x7f88601653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.201+0000 7f8864b55640 1 -- 172.21.15.81:0/3129454270 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886006b500 con 0x7f886006f200 2024-05-08T20:51:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.205+0000 7f8864b55640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886006f200 0x7f88600a93c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8850007860 tx=0x7f885001c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131f75d4a091c7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.217+0000 7f8857fff640 1 -- 172.21.15.81:0/3129454270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500a6620 con 0x7f886006f200 2024-05-08T20:51:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.217+0000 7f8857fff640 1 -- 172.21.15.81:0/3129454270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88500a6780 con 0x7f886006f200 2024-05-08T20:51:12.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.217+0000 7f8857fff640 1 -- 172.21.15.81:0/3129454270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500a6b10 con 0x7f886006f200 2024-05-08T20:51:12.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.237+0000 7f88675ba640 1 -- 172.21.15.81:0/3129454270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886006f200 msgr2=0x7f88600a93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.237+0000 7f88675ba640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886006f200 0x7f88600a93c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8850007860 tx=0x7f885001c570 comp rx=0 tx=0).stop 2024-05-08T20:51:12.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.245+0000 7f88675ba640 1 -- 172.21.15.81:0/3129454270 shutdown_connections 2024-05-08T20:51:12.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.245+0000 7f88675ba640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886006f200 0x7f88600a93c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.245+0000 7f88675ba640 1 --2- 172.21.15.81:0/3129454270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006cca0 0x7f886006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.245+0000 7f88675ba640 1 -- 172.21.15.81:0/3129454270 >> 172.21.15.81:0/3129454270 conn(0x7f88600c2ca0 msgr2=0x7f88600c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:12.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.249+0000 7f88675ba640 1 -- 172.21.15.81:0/3129454270 shutdown_connections 2024-05-08T20:51:12.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.249+0000 7f88675ba640 1 -- 172.21.15.81:0/3129454270 wait complete. 2024-05-08T20:51:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 Processor -- start 2024-05-08T20:51:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 -- start start 2024-05-08T20:51:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886006cca0 0x7f8860159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006f200 0x7f8860161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f88675ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886015ac90 con 0x7f88600a9900 2024-05-08T20:51:12.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.261+0000 7f8865b57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44162/0 (socket says 172.21.15.81:44162) 2024-05-08T20:51:12.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 -- 172.21.15.81:0/3626531338 learned_addr learned my addr 172.21.15.81:0/3626531338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:12.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601fa870 con 0x7f886006cca0 2024-05-08T20:51:12.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88601fada0 con 0x7f886006f200 2024-05-08T20:51:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006f200 msgr2=0x7f8860161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f886006f200 0x7f8860161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886006cca0 msgr2=0x7f8860159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886006cca0 0x7f8860159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850007540 con 0x7f88600a9900 2024-05-08T20:51:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8865b57640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f885800c680 tx=0x7f885800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858003b80 con 0x7f88600a9900 2024-05-08T20:51:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8858003ce0 con 0x7f88600a9900 2024-05-08T20:51:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858005310 con 0x7f88600a9900 2024-05-08T20:51:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88601617c0 con 0x7f88600a9900 2024-05-08T20:51:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.265+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88601faac0 con 0x7f88600a9900 2024-05-08T20:51:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.269+0000 7f88675ba640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 0x7f8840004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.269+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840007e90 con 0x7f8840002a40 2024-05-08T20:51:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.269+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8858005470 con 0x7f88600a9900 2024-05-08T20:51:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.269+0000 7f8855ffb640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88440666e0 0x7f8844068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.269+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8858084260 con 0x7f88600a9900 2024-05-08T20:51:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8865356640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 0x7f8840004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8864b55640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88440666e0 0x7f8844068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8865356640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8840008050 con 0x7f8840002a40 2024-05-08T20:51:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8864b55640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88440666e0 0x7f8844068ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f88500ad000 tx=0x7f8850004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8865356640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 0x7f8840004f00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d680 tx=0x7f885c00db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c007970 con 0x7f8840002a40 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f885c007ad0 con 0x7f8840002a40 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 msgr2=0x7f8840004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 0x7f8840004f00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d680 tx=0x7f885c00db40 comp rx=0 tx=0).stop 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 msgr2=0x7f8840004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:12.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.273+0000 7f8855ffb640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840002a40 0x7f8840004f00 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d680 tx=0x7f885c00db40 comp rx=0 tx=0).stop 2024-05-08T20:51:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.293+0000 7f88675ba640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 0x7f88400072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.293+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000a3f0 con 0x7f8840006e40 2024-05-08T20:51:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.293+0000 7f8865356640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 0x7f88400072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.293+0000 7f8865356640 1 -- 172.21.15.81:0/3626531338 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f88400077f0 con 0x7f8840006e40 2024-05-08T20:51:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8865356640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 0x7f88400072b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f885c017000 tx=0x7f885c0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c004220 con 0x7f8840006e40 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f885c020040 con 0x7f8840006e40 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 msgr2=0x7f88400072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 0x7f88400072b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f885c017000 tx=0x7f885c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 msgr2=0x7f88400072b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.297+0000 7f8855ffb640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8840006e40 0x7f88400072b0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f885c017000 tx=0x7f885c0046d0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.308 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 18, 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:51:12.310 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:12.311 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.312 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.316 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:51:12.317 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.318 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:51:12.319 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:51:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.305+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88440666e0 msgr2=0x7f8844068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.305+0000 7f88675ba640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f88440666e0 0x7f8844068ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f88500ad000 tx=0x7f8850004740 comp rx=0 tx=0).stop 2024-05-08T20:51:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.305+0000 7f8865b57640 1 -- 172.21.15.81:0/3626531338 reap_dead start 2024-05-08T20:51:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.305+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 msgr2=0x7f8860162190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.305+0000 7f88675ba640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f885800c680 tx=0x7f885800cb40 comp rx=0 tx=0).stop 2024-05-08T20:51:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.313+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 shutdown_connections 2024-05-08T20:51:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.313+0000 7f88675ba640 1 --2- 172.21.15.81:0/3626531338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88600a9900 0x7f8860162190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.313+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 >> 172.21.15.81:0/3626531338 conn(0x7f88600c2ca0 msgr2=0x7f88600c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.317+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 shutdown_connections 2024-05-08T20:51:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.317+0000 7f88675ba640 1 -- 172.21.15.81:0/3626531338 wait complete. 2024-05-08T20:51:12.423 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:51:12.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:51:12.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.697+0000 7f093091e640 1 Processor -- start 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.697+0000 7f093091e640 1 -- start start 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.697+0000 7f093091e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f092c151f00 0x7f092c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f093091e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 0x7f092c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f093091e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c158e20 con 0x7f092c154cf0 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f093091e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c06bb20 con 0x7f092c151f00 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f093091e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1548e0 con 0x7f092c0ca000 2024-05-08T20:51:12.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f092c151f00 0x7f092c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f092c151f00 0x7f092c1588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44168/0 (socket says 172.21.15.81:44168) 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 -- 172.21.15.81:0/4214972570 learned_addr learned my addr 172.21.15.81:0/4214972570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092ad9d640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 0x7f092c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 -- 172.21.15.81:0/4214972570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 msgr2=0x7f092c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092959a640 1 -- 172.21.15.81:0/4214972570 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762937617 0 0) 0x7f092c158e20 con 0x7f092c154cf0 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 0x7f092c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 -- 172.21.15.81:0/4214972570 >> v1:172.21.15.117:6789/0 conn(0x7f092c154cf0 legacy=0x7f092c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092a59c640 1 -- 172.21.15.81:0/4214972570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c155860 con 0x7f092c151f00 2024-05-08T20:51:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.701+0000 7f092ad9d640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 0x7f092c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:51:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.705+0000 7f092a59c640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c1588e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0920009870 tx=0x7f092001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22943191d4346f53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.705+0000 7f092959a640 1 -- 172.21.15.81:0/4214972570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200ab660 con 0x7f092c151f00 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.705+0000 7f092959a640 1 -- 172.21.15.81:0/4214972570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09200ab7c0 con 0x7f092c151f00 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.705+0000 7f092959a640 1 -- 172.21.15.81:0/4214972570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200abb50 con 0x7f092c151f00 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.709+0000 7f093091e640 1 -- 172.21.15.81:0/4214972570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 msgr2=0x7f092c1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.709+0000 7f093091e640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c1588e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0920009870 tx=0x7f092001c440 comp rx=0 tx=0).stop 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 -- 172.21.15.81:0/4214972570 shutdown_connections 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c0ca000 0x7f092c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 --2- 172.21.15.81:0/4214972570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c1588e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 -- 172.21.15.81:0/4214972570 >> 172.21.15.81:0/4214972570 conn(0x7f092c0715f0 msgr2=0x7f092c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 -- 172.21.15.81:0/4214972570 shutdown_connections 2024-05-08T20:51:12.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 -- 172.21.15.81:0/4214972570 wait complete. 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 Processor -- start 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.753+0000 7f093091e640 1 -- start start 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0ca000 0x7f092c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c154cf0 0x7f092c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c158bd0 con 0x7f092c151f00 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1fa3a0 con 0x7f092c0ca000 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c1f9ae0 con 0x7f092c154cf0 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44172/0 (socket says 172.21.15.81:44172) 2024-05-08T20:51:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 -- 172.21.15.81:0/996426852 learned_addr learned my addr 172.21.15.81:0/996426852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f092a59c640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0ca000 0x7f092c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f092ad9d640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c154cf0 0x7f092c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c154cf0 msgr2=0x7f092c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f092c154cf0 0x7f092c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0ca000 msgr2=0x7f092c070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0ca000 0x7f092c070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200094d0 con 0x7f092c151f00 2024-05-08T20:51:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f0929d9b640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c4b0 tx=0x7f091c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0052d0 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c005430 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c012830 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c1588f0 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.757+0000 7f093091e640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c1fa030 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f093091e640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 0x7f0910004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f093091e640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910007e90 con 0x7f0910002a40 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f092a59c640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 0x7f0910004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f091c012990 con 0x7f092c151f00 2024-05-08T20:51:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f092a59c640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0910008050 con 0x7f0910002a40 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f090c066790 0x7f090c068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f091c083fc0 con 0x7f092c151f00 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f092a59c640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 0x7f0910004f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f092c08c580 tx=0x7f09200191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f092ad9d640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f090c066790 0x7f090c068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200be3f0 con 0x7f0910002a40 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f09200b43f0 con 0x7f0910002a40 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 msgr2=0x7f0910004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 0x7f0910004f00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f092c08c580 tx=0x7f09200191e0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 msgr2=0x7f0910004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.761+0000 7f091affd640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910002a40 0x7f0910004f00 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f092c08c580 tx=0x7f09200191e0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.765+0000 7f092ad9d640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f090c066790 0x7f090c068c50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0924008e60 tx=0x7f0924008390 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.821+0000 7f0918ff9640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 0x7f091000cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.821+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100023a0 con 0x7f0910001e10 2024-05-08T20:51:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.821+0000 7f092a59c640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 0x7f091000cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.829+0000 7f092a59c640 1 -- 172.21.15.81:0/996426852 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f091000a230 con 0x7f0910001e10 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f092a59c640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 0x7f091000cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f092001c480 tx=0x7f0920009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200c5a90 con 0x7f0910001e10 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4977 (secure 0 0 0) 0x7f0920003620 con 0x7f0910001e10 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 msgr2=0x7f091000cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 0x7f091000cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f092001c480 tx=0x7f0920009240 comp rx=0 tx=0).stop 2024-05-08T20:51:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 msgr2=0x7f091000cb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.833+0000 7f091affd640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0910001e10 0x7f091000cb40 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f092001c480 tx=0x7f0920009240 comp rx=0 tx=0).stop 2024-05-08T20:51:12.845 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:51:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 182, 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 18, 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:51:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:51:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:51:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:51:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:51:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f090c066790 msgr2=0x7f090c068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f090c066790 0x7f090c068c50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0924008e60 tx=0x7f0924008390 comp rx=0 tx=0).stop 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 msgr2=0x7f092c0ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c4b0 tx=0x7f091c00c970 comp rx=0 tx=0).stop 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f092ad9d640 1 -- 172.21.15.81:0/996426852 reap_dead start 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 shutdown_connections 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 --2- 172.21.15.81:0/996426852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f092c151f00 0x7f092c0ae210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:12.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 >> 172.21.15.81:0/996426852 conn(0x7f092c0715f0 msgr2=0x7f092c152750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:12.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 shutdown_connections 2024-05-08T20:51:12.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:12.845+0000 7f0918ff9640 1 -- 172.21.15.81:0/996426852 wait complete. 2024-05-08T20:51:12.923 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:51:12.923 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-05-08T20:51:12.923 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:51:12.923 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-05-08T20:51:12.924 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:51:12.924 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:51:12.924 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:51:12.954 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:51:12.954 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:51:12.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 Processor -- start 2024-05-08T20:51:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 -- start start 2024-05-08T20:51:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32880d4330 0x7f3288007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 0x7f328800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328800e140 con 0x7f32880076d0 2024-05-08T20:51:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880db300 con 0x7f328804dac0 2024-05-08T20:51:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.433+0000 7f3297d72640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328804a6c0 con 0x7f32880d4330 2024-05-08T20:51:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.437+0000 7f329630f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f32880076d0 0x7f328800eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:57036/0 (socket says 172.21.15.81:57036) 2024-05-08T20:51:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.437+0000 7f329630f640 1 -- 172.21.15.81:0/3802911627 learned_addr learned my addr 172.21.15.81:0/3802911627 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.437+0000 7f3295b0e640 1 --2- 172.21.15.81:0/3802911627 >> v2:172.21.15.117:3300/0 conn(0x7f32880d4330 0x7f3288007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.437+0000 7f329530d640 1 --2- 172.21.15.81:0/3802911627 >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 0x7f328800e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:13.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.437+0000 7f3295b0e640 1 -- 172.21.15.81:0/3802911627 >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 msgr2=0x7f328800e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.441+0000 7f3295b0e640 1 --2- 172.21.15.81:0/3802911627 >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 0x7f328800e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.441+0000 7f3295b0e640 1 -- 172.21.15.81:0/3802911627 >> v1:172.21.15.117:6789/0 conn(0x7f32880076d0 legacy=0x7f328800eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.441+0000 7f3295b0e640 1 -- 172.21.15.81:0/3802911627 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328804a9a0 con 0x7f32880d4330 2024-05-08T20:51:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.441+0000 7f329530d640 1 --2- 172.21.15.81:0/3802911627 >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 0x7f328800e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:51:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.445+0000 7f3295b0e640 1 --2- 172.21.15.81:0/3802911627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f3288007190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3288050c40 tx=0x7f328001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff5caf303e7a753 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3294b0c640 1 -- 172.21.15.81:0/3802911627 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800ab600 con 0x7f32880d4330 2024-05-08T20:51:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3294b0c640 1 -- 172.21.15.81:0/3802911627 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800a7050 con 0x7f32880d4330 2024-05-08T20:51:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3294b0c640 1 -- 172.21.15.81:0/3802911627 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800ab9c0 con 0x7f32880d4330 2024-05-08T20:51:13.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 -- 172.21.15.81:0/3802911627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 msgr2=0x7f3288007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:13.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 --2- 172.21.15.81:0/3802911627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f3288007190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3288050c40 tx=0x7f328001c350 comp rx=0 tx=0).stop 2024-05-08T20:51:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 -- 172.21.15.81:0/3802911627 shutdown_connections 2024-05-08T20:51:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 --2- 172.21.15.81:0/3802911627 >> v2:172.21.15.81:3300/0 conn(0x7f328804dac0 0x7f328800e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 --2- 172.21.15.81:0/3802911627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f3288007190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:13.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.453+0000 7f3297d72640 1 -- 172.21.15.81:0/3802911627 >> 172.21.15.81:0/3802911627 conn(0x7f328804c640 msgr2=0x7f328804ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:13.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.457+0000 7f3297d72640 1 -- 172.21.15.81:0/3802911627 shutdown_connections 2024-05-08T20:51:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.457+0000 7f3297d72640 1 -- 172.21.15.81:0/3802911627 wait complete. 2024-05-08T20:51:13.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 Processor -- start 2024-05-08T20:51:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 -- start start 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 0x7f32880d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f32880cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880dd920 con 0x7f328804dac0 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328817d7e0 con 0x7f32880d4330 2024-05-08T20:51:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3297d72640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32881801a0 con 0x7f32880076d0 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329530d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329530d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44264/0 (socket says 172.21.15.81:44264) 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329530d640 1 -- 172.21.15.81:0/1952783698 learned_addr learned my addr 172.21.15.81:0/1952783698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329630f640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f32880cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3295b0e640 1 -- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 msgr2=0x7f32880d0d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f3295b0e640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 0x7f32880d0d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329630f640 1 -- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 msgr2=0x7f32880d0d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329630f640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 0x7f32880d0d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329630f640 1 -- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 msgr2=0x7f3288180630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.461+0000 7f329630f640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f329630f640 1 -- 172.21.15.81:0/1952783698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009420 con 0x7f32880d4330 2024-05-08T20:51:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f329530d640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:51:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f329630f640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f32880cb1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32900731a0 tx=0x7f3290067490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900698e0 con 0x7f32880d4330 2024-05-08T20:51:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f3297d72640 1 -- 172.21.15.81:0/1952783698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32880d1370 con 0x7f32880d4330 2024-05-08T20:51:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f3297d72640 1 -- 172.21.15.81:0/1952783698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328817fe30 con 0x7f32880d4330 2024-05-08T20:51:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3290069a40 con 0x7f32880d4330 2024-05-08T20:51:13.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.465+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32900723c0 con 0x7f32880d4330 2024-05-08T20:51:13.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.469+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3290072520 con 0x7f32880d4330 2024-05-08T20:51:13.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.469+0000 7f32867fc640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 0x7f3274068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:13.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.473+0000 7f3295b0e640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 0x7f3274068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:13.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.473+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f32900fde20 con 0x7f32880d4330 2024-05-08T20:51:13.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.473+0000 7f3295b0e640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 0x7f3274068c20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32800ad000 tx=0x7f3280008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:13.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.497+0000 7f3297d72640 1 -- 172.21.15.81:0/1952783698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278005260 con 0x7f32880d4330 2024-05-08T20:51:13.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:13.505+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f329008f080 con 0x7f32880d4330 2024-05-08T20:51:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.437+0000 7f3297d72640 1 -- 172.21.15.81:0/1952783698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3278005a90 con 0x7f32880d4330 2024-05-08T20:51:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.437+0000 7f32867fc640 1 -- 172.21.15.81:0/1952783698 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f32900cae60 con 0x7f32880d4330 2024-05-08T20:51:14.445 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.441+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 msgr2=0x7f3274068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.441+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 0x7f3274068c20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32800ad000 tx=0x7f3280008040 comp rx=0 tx=0).stop 2024-05-08T20:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.441+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 msgr2=0x7f32880cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.441+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f32880cb1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32900731a0 tx=0x7f3290067490 comp rx=0 tx=0).stop 2024-05-08T20:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.441+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 shutdown_connections 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3274066760 0x7f3274068c20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32880d4330 0x7f32880cb1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328804dac0 0x7f3288180630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 --2- 172.21.15.81:0/1952783698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32880076d0 0x7f32880d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 >> 172.21.15.81:0/1952783698 conn(0x7f328804c640 msgr2=0x7f328800e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 shutdown_connections 2024-05-08T20:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:14.445+0000 7f3273fff640 1 -- 172.21.15.81:0/1952783698 wait complete. 2024-05-08T20:51:17.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.777+0000 7fb209be0640 1 Processor -- start 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.777+0000 7fb209be0640 1 -- start start 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb209be0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb209be0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040bdb80 con 0x7fb20414ddd0 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb209be0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040bd590 con 0x7fb204153ec0 2024-05-08T20:51:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb209be0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040bf6a0 con 0x7fb2040a9830 2024-05-08T20:51:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb2037fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb20414ddd0 0x7fb2040bea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47910/0 (socket says 172.21.15.81:47910) 2024-05-08T20:51:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb2037fe640 1 -- 172.21.15.81:0/3946732536 learned_addr learned my addr 172.21.15.81:0/3946732536 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb202ffd640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 msgr2=0x7fb2040bf160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.781+0000 7fb202ffd640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.985+0000 7fb202ffd640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 msgr2=0x7fb2040bf160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:17.985+0000 7fb202ffd640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:51:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:18.389+0000 7fb202ffd640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 msgr2=0x7fb2040bf160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:18.389+0000 7fb202ffd640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:51:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:19.193+0000 7fb202ffd640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 msgr2=0x7fb2040bf160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:19.193+0000 7fb202ffd640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:51:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 msgr2=0x7fb2040bf160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2040a9830 0x7fb2040bf160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 -- 172.21.15.81:0/3946732536 >> v1:172.21.15.117:6789/0 conn(0x7fb204153ec0 legacy=0x7fb2041542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 -- 172.21.15.81:0/3946732536 >> v1:172.21.15.81:6789/0 conn(0x7fb20414ddd0 legacy=0x7fb2040bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 --2- 172.21.15.81:0/3946732536 >> v2:172.21.15.81:3300/0 conn(0x7fb1f0003720 0x7fb1f0005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 --2- 172.21.15.81:0/3946732536 >> v2:172.21.15.117:3300/0 conn(0x7fb1f00061f0 0x7fb1f00086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 -- 172.21.15.81:0/3946732536 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f0008d30 con 0x7fb1f0003720 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2017fa640 1 -- 172.21.15.81:0/3946732536 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f000d2b0 con 0x7fb1f00061f0 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2037fe640 1 --2- 172.21.15.81:0/3946732536 >> v2:172.21.15.81:3300/0 conn(0x7fb1f0003720 0x7fb1f0005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2037fe640 1 -- 172.21.15.81:0/3946732536 >> v2:172.21.15.117:3300/0 conn(0x7fb1f00061f0 msgr2=0x7fb1f00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2037fe640 1 --2- 172.21.15.81:0/3946732536 >> v2:172.21.15.117:3300/0 conn(0x7fb1f00061f0 0x7fb1f00086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.785+0000 7fb2037fe640 1 -- 172.21.15.81:0/3946732536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040ab060 con 0x7fb1f0003720 2024-05-08T20:51:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb2037fe640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0003720 0x7fb1f0005ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00061c0 tx=0x7fb1fc01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f263dd0c2afed43c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb2027fc640 1 -- 172.21.15.81:0/3946732536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0a5b70 con 0x7fb1f0003720 2024-05-08T20:51:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb2027fc640 1 -- 172.21.15.81:0/3946732536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0a5cd0 con 0x7fb1f0003720 2024-05-08T20:51:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb2027fc640 1 -- 172.21.15.81:0/3946732536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0ae670 con 0x7fb1f0003720 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 -- 172.21.15.81:0/3946732536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0003720 msgr2=0x7fb1f0005ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0003720 0x7fb1f0005ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00061c0 tx=0x7fb1fc01cbb0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb203fff640 1 -- 172.21.15.81:0/3946732536 reap_dead start 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 -- 172.21.15.81:0/3946732536 shutdown_connections 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 --2- 172.21.15.81:0/3946732536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0003720 0x7fb1f0005ba0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00061c0 tx=0x7fb1fc01cbb0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 -- 172.21.15.81:0/3946732536 >> 172.21.15.81:0/3946732536 conn(0x7fb2040c3e00 msgr2=0x7fb2040c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 -- 172.21.15.81:0/3946732536 shutdown_connections 2024-05-08T20:51:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.789+0000 7fb209be0640 1 -- 172.21.15.81:0/3946732536 wait complete. 2024-05-08T20:51:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 Processor -- start 2024-05-08T20:51:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 -- start start 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb204145790 0x7fb2041ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 0x7fb2040709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 0x7fb20413e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041ed7e0 con 0x7fb204070f10 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20413fe70 con 0x7fb20413dc10 2024-05-08T20:51:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb209be0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204140150 con 0x7fb204145790 2024-05-08T20:51:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb202ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 0x7fb2040709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb202ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 0x7fb2040709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:37008/0 (socket says 172.21.15.81:37008) 2024-05-08T20:51:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb202ffd640 1 -- 172.21.15.81:0/1917295210 learned_addr learned my addr 172.21.15.81:0/1917295210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 0x7fb20413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 -- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb204145790 msgr2=0x7fb2041ed2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:51:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb204145790 0x7fb2041ed2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 -- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 msgr2=0x7fb2040709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 0x7fb2040709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.793+0000 7fb203fff640 1 -- 172.21.15.81:0/1917295210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc001eb0 con 0x7fb204070f10 2024-05-08T20:51:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb203fff640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 0x7fb20413e850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb20406eb50 tx=0x7fb1f800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80074e0 con 0x7fb204070f10 2024-05-08T20:51:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb209be0640 1 -- 172.21.15.81:0/1917295210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb204140430 con 0x7fb204070f10 2024-05-08T20:51:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb209be0640 1 -- 172.21.15.81:0/1917295210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040701b0 con 0x7fb204070f10 2024-05-08T20:51:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb209be0640 1 -- 172.21.15.81:0/1917295210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20413ffb0 con 0x7fb204070f10 2024-05-08T20:51:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f8007640 con 0x7fb204070f10 2024-05-08T20:51:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.797+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8004260 con 0x7fb204070f10 2024-05-08T20:51:20.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.805+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1f80057d0 con 0x7fb204070f10 2024-05-08T20:51:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.805+0000 7fb1ebfff640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 0x7fb1f006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.805+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb1f80837a0 con 0x7fb204070f10 2024-05-08T20:51:20.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.805+0000 7fb2037fe640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 0x7fb1f006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.809+0000 7fb2037fe640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 0x7fb1f006dee0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ad000 tx=0x7fb1fc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:20.821+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb1f8054270 con 0x7fb204070f10 2024-05-08T20:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.797+0000 7fb209be0640 1 -- 172.21.15.81:0/1917295210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb2040706f0 con 0x7fb204070f10 2024-05-08T20:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.797+0000 7fb1ebfff640 1 -- 172.21.15.81:0/1917295210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fb2040706f0 con 0x7fb204070f10 2024-05-08T20:51:21.801 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":182,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.801+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 msgr2=0x7fb1f006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.801+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 0x7fb1f006dee0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ad000 tx=0x7fb1fc0a7070 comp rx=0 tx=0).stop 2024-05-08T20:51:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 msgr2=0x7fb20413e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 0x7fb20413e850 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb20406eb50 tx=0x7fb1f800c820 comp rx=0 tx=0).stop 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 shutdown_connections 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb1f006ba20 0x7fb1f006dee0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb204070f10 0x7fb20413e850 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb20413dc10 0x7fb2040709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 --2- 172.21.15.81:0/1917295210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb204145790 0x7fb2041ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 >> 172.21.15.81:0/1917295210 conn(0x7fb2040c3e00 msgr2=0x7fb204146eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 shutdown_connections 2024-05-08T20:51:21.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:21.805+0000 7fb1e9ffb640 1 -- 172.21.15.81:0/1917295210 wait complete. 2024-05-08T20:51:24.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:25.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.289+0000 7fa39a8c5640 1 Processor -- start 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.289+0000 7fa39a8c5640 1 -- start start 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a8c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a8c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a8c5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa394150fe0 con 0x7fa3940c1ee0 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a8c5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940a94b0 con 0x7fa394150790 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a8c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941512c0 con 0x7fa394138fa0 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa3998c3640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa3940aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa3998c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a0c4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3940c1ee0 0x7fa3940a9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43804/0 (socket says 172.21.15.81:43804) 2024-05-08T20:51:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.293+0000 7fa39a0c4640 1 -- 172.21.15.81:0/1468365824 learned_addr learned my addr 172.21.15.81:0/1468365824 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.297+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.297+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:51:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.297+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:51:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.297+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:51:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.297+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:25.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.497+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa3940aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:25.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.497+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:51:25.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.501+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:25.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.501+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:51:25.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.501+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:51:25.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.501+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:51:25.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.501+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:51:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.901+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa3940aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.901+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:51:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.905+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.905+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:51:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.905+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:51:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.905+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:51:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:25.905+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:51:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.705+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa3940aadc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.705+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:51:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.709+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.709+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:51:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.709+0000 7fa3990c2640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:51:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.709+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:51:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:26.709+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:51:27.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:51:27.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:51:27.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616092997 0 0) 0x7fa394150fe0 con 0x7fa3940c1ee0 2024-05-08T20:51:27.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa380003530 con 0x7fa3940c1ee0 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526140308 0 0) 0x7fa380003530 con 0x7fa3940c1ee0 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa3940aadc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa3940aadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 msgr2=0x7fa3940c19a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 --2- 172.21.15.81:0/1468365824 >> v2:172.21.15.81:3300/0 conn(0x7fa394150790 0x7fa3940c19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3941515a0 con 0x7fa3940c1ee0 2024-05-08T20:51:27.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.481+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fa38c0051d0 con 0x7fa3940c1ee0 2024-05-08T20:51:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 >> v1:172.21.15.81:6789/0 conn(0x7fa3940c1ee0 legacy=0x7fa3940a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa380003980 0x7fa380003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800047d0 0x7fa380004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa380005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940a94b0 con 0x7fa380003980 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941512c0 con 0x7fa3800047d0 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380009980 con 0x7fa394138fa0 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa39a0c4640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa380005260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa39a0c4640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa380005260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800047d0 0x7fa380004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa380003980 0x7fa380003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 msgr2=0x7fa380005260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa394138fa0 0x7fa380005260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800047d0 msgr2=0x7fa380004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800047d0 0x7fa380004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 -- 172.21.15.81:0/1468365824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380003530 con 0x7fa380003980 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3990c2640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800047d0 0x7fa380004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.485+0000 7fa3998c3640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa380003980 0x7fa380003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e30 tx=0x7fa38401cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0b6d5460434813 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384006ea0 con 0x7fa380003980 2024-05-08T20:51:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3840a5a10 con 0x7fa380003980 2024-05-08T20:51:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa3988c1640 1 -- 172.21.15.81:0/1468365824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a5dc0 con 0x7fa380003980 2024-05-08T20:51:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa39a8c5640 1 -- 172.21.15.81:0/1468365824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa380003980 msgr2=0x7fa380003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa39a8c5640 1 --2- 172.21.15.81:0/1468365824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa380003980 0x7fa380003da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e30 tx=0x7fa38401cb10 comp rx=0 tx=0).stop 2024-05-08T20:51:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.489+0000 7fa39a0c4640 1 -- 172.21.15.81:0/1468365824 reap_dead start 2024-05-08T20:51:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- 172.21.15.81:0/1468365824 shutdown_connections 2024-05-08T20:51:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- 172.21.15.81:0/1468365824 >> 172.21.15.81:0/1468365824 conn(0x7fa3940c2a90 msgr2=0x7fa3940c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- 172.21.15.81:0/1468365824 shutdown_connections 2024-05-08T20:51:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- 172.21.15.81:0/1468365824 wait complete. 2024-05-08T20:51:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 Processor -- start 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- start start 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 0x7fa39406c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 0x7fa3941e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 0x7fa3941e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa394159c30 con 0x7fa39406beb0 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941e9440 con 0x7fa394072050 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa39a8c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941ece20 con 0x7fa3941ec940 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa3990c2640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 msgr2=0x7fa3941e6690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:27.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.497+0000 7fa3990c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 0x7fa3941e6690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa3998c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 0x7fa39406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa3998c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 0x7fa39406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52724/0 (socket says 172.21.15.81:52724) 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa3998c3640 1 -- 172.21.15.81:0/2597629767 learned_addr learned my addr 172.21.15.81:0/2597629767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 0x7fa3941e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 -- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 msgr2=0x7fa3941e6690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 0x7fa3941e6690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 -- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 msgr2=0x7fa39406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 0x7fa39406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:27.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 -- 172.21.15.81:0/2597629767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3941ed100 con 0x7fa394072050 2024-05-08T20:51:27.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a0c4640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 0x7fa3941e6bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa394072c30 tx=0x7fa38c001ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:27.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0082d0 con 0x7fa394072050 2024-05-08T20:51:27.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a8c5640 1 -- 172.21.15.81:0/2597629767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3941ed3e0 con 0x7fa394072050 2024-05-08T20:51:27.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00d690 con 0x7fa394072050 2024-05-08T20:51:27.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa39a8c5640 1 -- 172.21.15.81:0/2597629767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3941570f0 con 0x7fa394072050 2024-05-08T20:51:27.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.501+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00da40 con 0x7fa394072050 2024-05-08T20:51:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.505+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa38c00dba0 con 0x7fa394072050 2024-05-08T20:51:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.513+0000 7fa38a7fc640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 0x7fa38006a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.517+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa38c0840b0 con 0x7fa394072050 2024-05-08T20:51:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.517+0000 7fa3998c3640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 0x7fa38006a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:27.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.525+0000 7fa39a8c5640 1 -- 172.21.15.81:0/2597629767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3940747d0 con 0x7fa394072050 2024-05-08T20:51:27.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.525+0000 7fa3998c3640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 0x7fa38006a360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa38401cb50 tx=0x7fa384005dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:27.533+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa38c051110 con 0x7fa394072050 2024-05-08T20:51:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.365+0000 7fa39a8c5640 1 -- 172.21.15.81:0/2597629767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa3941e9580 con 0x7fa394072050 2024-05-08T20:51:28.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.365+0000 7fa38a7fc640 1 -- 172.21.15.81:0/2597629767 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fa38c054730 con 0x7fa394072050 2024-05-08T20:51:28.370 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":186,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.373+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 msgr2=0x7fa38006a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.373+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 0x7fa38006a360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa38401cb50 tx=0x7fa384005dc0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 msgr2=0x7fa3941e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 0x7fa3941e6bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa394072c30 tx=0x7fa38c001ea0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 shutdown_connections 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa380067ea0 0x7fa38006a360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa394072050 0x7fa3941e6bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3941ec940 0x7fa3941e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 --2- 172.21.15.81:0/2597629767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39406beb0 0x7fa39406c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 >> 172.21.15.81:0/2597629767 conn(0x7fa3940c2a90 msgr2=0x7fa3940c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 shutdown_connections 2024-05-08T20:51:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.381+0000 7fa377fff640 1 -- 172.21.15.81:0/2597629767 wait complete. 2024-05-08T20:51:28.471 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:51:28.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:51:28.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:51:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.929+0000 7f082ca7b640 1 Processor -- start 2024-05-08T20:51:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.929+0000 7f082ca7b640 1 -- start start 2024-05-08T20:51:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f082ca7b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f08200070a0 0x7f0820049dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f082ca7b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08200467f0 con 0x7f08200462c0 2024-05-08T20:51:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f082ca7b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0820046f80 con 0x7f08200d3a80 2024-05-08T20:51:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f082ca7b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0820046b60 con 0x7f08200070a0 2024-05-08T20:51:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0825d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08200462c0 0x7f08200496b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43824/0 (socket says 172.21.15.81:43824) 2024-05-08T20:51:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0825d9b640 1 -- 172.21.15.81:0/3687550502 learned_addr learned my addr 172.21.15.81:0/3687550502 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3687550502 >> v2:172.21.15.117:3300/0 conn(0x7f08200070a0 0x7f0820049dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0826d9d640 1 -- 172.21.15.81:0/3687550502 >> v1:172.21.15.117:6789/0 conn(0x7f08200d3a80 legacy=0x7f0820006990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0826d9d640 1 -- 172.21.15.81:0/3687550502 >> v1:172.21.15.81:6789/0 conn(0x7f08200462c0 legacy=0x7f08200496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.933+0000 7f0826d9d640 1 -- 172.21.15.81:0/3687550502 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200076f0 con 0x7f08200070a0 2024-05-08T20:51:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.937+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3687550502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 0x7f0820049dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08280638e0 tx=0x7f0828098f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2298c3a42c73c5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.937+0000 7f082559a640 1 -- 172.21.15.81:0/3687550502 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828121ba0 con 0x7f08200070a0 2024-05-08T20:51:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.937+0000 7f082559a640 1 -- 172.21.15.81:0/3687550502 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828121d00 con 0x7f08200070a0 2024-05-08T20:51:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.937+0000 7f082ca7b640 1 -- 172.21.15.81:0/3687550502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 msgr2=0x7f0820049dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.937+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3687550502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 0x7f0820049dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08280638e0 tx=0x7f0828098f40 comp rx=0 tx=0).stop 2024-05-08T20:51:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 -- 172.21.15.81:0/3687550502 shutdown_connections 2024-05-08T20:51:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3687550502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 0x7f0820049dc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 -- 172.21.15.81:0/3687550502 >> 172.21.15.81:0/3687550502 conn(0x7f0820005e70 msgr2=0x7f0820006280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 -- 172.21.15.81:0/3687550502 shutdown_connections 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 -- 172.21.15.81:0/3687550502 wait complete. 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 Processor -- start 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.941+0000 7f082ca7b640 1 -- start start 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 0x7f08200cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08200448e0 0x7f0820043120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0820042c90 con 0x7f08200462c0 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0820041e30 con 0x7f08200070a0 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08200cbc10 con 0x7f08200448e0 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0826d9d640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08200448e0 msgr2=0x7f0820043120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0826d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08200448e0 0x7f0820043120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53326/0 (socket says 172.21.15.81:53326) 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 -- 172.21.15.81:0/3523021210 learned_addr learned my addr 172.21.15.81:0/3523021210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08200448e0 msgr2=0x7f0820043120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08200448e0 0x7f0820043120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 msgr2=0x7f08200cb6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08200070a0 0x7f08200cb6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828072040 con 0x7f08200462c0 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0825d9b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c900 tx=0x7f081c00cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c0072d0 con 0x7f08200462c0 2024-05-08T20:51:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08200420a0 con 0x7f08200462c0 2024-05-08T20:51:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0820045a80 con 0x7f08200462c0 2024-05-08T20:51:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c007430 con 0x7f08200462c0 2024-05-08T20:51:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.945+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c0047f0 con 0x7f08200462c0 2024-05-08T20:51:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.949+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f081c004950 con 0x7f08200462c0 2024-05-08T20:51:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.949+0000 7f0816ffd640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f08100667d0 0x7f0810068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.949+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f081c083910 con 0x7f08200462c0 2024-05-08T20:51:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.949+0000 7f082659c640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f08100667d0 0x7f0810068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.949+0000 7f082659c640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f08100667d0 0x7f0810068c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f08200097c0 tx=0x7f0818006be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.953+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 0x7f080c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.953+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c007e90 con 0x7f080c002a40 2024-05-08T20:51:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.953+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 0x7f080c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.965+0000 7f0826d9d640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f080c008050 con 0x7f080c002a40 2024-05-08T20:51:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.965+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 0x7f080c004f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0828065ab0 tx=0x7f0828095d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.969+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828129640 con 0x7f080c002a40 2024-05-08T20:51:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.969+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f082808f170 con 0x7f080c002a40 2024-05-08T20:51:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.969+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 msgr2=0x7f080c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.969+0000 7f0816ffd640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 0x7f080c004f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0828065ab0 tx=0x7f0828095d80 comp rx=0 tx=0).stop 2024-05-08T20:51:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.973+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 msgr2=0x7f080c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.973+0000 7f0816ffd640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c002a40 0x7f080c004f00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.989+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 0x7f080c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.993+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 0x7f080c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.993+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c00a350 con 0x7f080c006f70 2024-05-08T20:51:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.993+0000 7f0826d9d640 1 -- 172.21.15.81:0/3523021210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f080c00a510 con 0x7f080c006f70 2024-05-08T20:51:28.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.997+0000 7f0826d9d640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 0x7f080c0073e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f082807ac20 tx=0x7f08280693d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:28.997+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828141070 con 0x7f080c006f70 2024-05-08T20:51:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.013+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f08281336d0 con 0x7f080c006f70 2024-05-08T20:51:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.013+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 msgr2=0x7f080c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.013+0000 7f0816ffd640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 0x7f080c0073e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f082807ac20 tx=0x7f08280693d0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.017+0000 7f0816ffd640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 msgr2=0x7f080c0073e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.017+0000 7f0816ffd640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c006f70 0x7f080c0073e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.019 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:51:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:51:29.019 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 186, 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.021 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:51:29.022 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.023 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.024 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.027 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:51:29.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:51:29.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:51:29.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:51:29.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:51:29.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f08100667d0 msgr2=0x7f0810068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f08100667d0 0x7f0810068c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f08200097c0 tx=0x7f0818006be0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f0826d9d640 1 -- 172.21.15.81:0/3523021210 reap_dead start 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 msgr2=0x7f0820045540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c900 tx=0x7f081c00cdc0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 shutdown_connections 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 --2- 172.21.15.81:0/3523021210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200462c0 0x7f0820045540 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.029+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 >> 172.21.15.81:0/3523021210 conn(0x7f0820005e70 msgr2=0x7f082002c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:29.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.037+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 shutdown_connections 2024-05-08T20:51:29.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.037+0000 7f082ca7b640 1 -- 172.21.15.81:0/3523021210 wait complete. 2024-05-08T20:51:29.171 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:51:29.171 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-05-08T20:51:29.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:51:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.541+0000 7fb458070640 1 Processor -- start 2024-05-08T20:51:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.541+0000 7fb458070640 1 -- start start 2024-05-08T20:51:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 0x7fb45015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4500bcbe0 0x7fb45015a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb455e0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 0x7fb45015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 0x7fb45015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb455e0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 0x7fb45015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:53072/0 (socket says 172.21.15.81:53072) 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb455e0c640 1 -- 172.21.15.81:0/2684830943 learned_addr learned my addr 172.21.15.81:0/2684830943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb450072600 con 0x7fb4500bcbe0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500bbca0 con 0x7fb450152cc0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45660d640 1 -- 172.21.15.81:0/2684830943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 msgr2=0x7fb45015c2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45660d640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 0x7fb45015c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500bbf80 con 0x7fb45015acb0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 --2- 172.21.15.81:0/2684830943 >> v2:172.21.15.81:3300/0 conn(0x7fb4500bcbe0 0x7fb45015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 -- 172.21.15.81:0/2684830943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 msgr2=0x7fb45015c2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 0x7fb45015c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 -- 172.21.15.81:0/2684830943 >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 msgr2=0x7fb45015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 --2- 172.21.15.81:0/2684830943 >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 0x7fb45015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.549+0000 7fb45560b640 1 -- 172.21.15.81:0/2684830943 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500bc260 con 0x7fb4500bcbe0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb45560b640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4500bcbe0 0x7fb45015a770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c3aa0 tx=0x7fb44001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153aafdb2af43dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb454e0a640 1 -- 172.21.15.81:0/2684830943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4400ad680 con 0x7fb4500bcbe0 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb454e0a640 1 -- 172.21.15.81:0/2684830943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4400ad7e0 con 0x7fb4500bcbe0 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb454e0a640 1 -- 172.21.15.81:0/2684830943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4400adb70 con 0x7fb4500bcbe0 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4500bcbe0 msgr2=0x7fb45015a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.553+0000 7fb458070640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4500bcbe0 0x7fb45015a770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c3aa0 tx=0x7fb44001c400 comp rx=0 tx=0).stop 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 shutdown_connections 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb45015acb0 0x7fb45015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 --2- 172.21.15.81:0/2684830943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4500bcbe0 0x7fb45015a770 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c3aa0 tx=0x7fb44001c400 comp rx=0 tx=0).stop 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 --2- 172.21.15.81:0/2684830943 >> v2:172.21.15.117:3300/0 conn(0x7fb450152cc0 0x7fb45015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 >> 172.21.15.81:0/2684830943 conn(0x7fb4500c3e00 msgr2=0x7fb4500c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:29.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 shutdown_connections 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 -- 172.21.15.81:0/2684830943 wait complete. 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.557+0000 7fb458070640 1 Processor -- start 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 -- start start 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb450152cc0 0x7fb4500aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45015acb0 0x7fb45006a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45006c510 con 0x7fb450162c30 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450150e20 con 0x7fb45015acb0 2024-05-08T20:51:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501630c0 con 0x7fb450152cc0 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb455e0c640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb450152cc0 msgr2=0x7fb4500aac70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb455e0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb450152cc0 0x7fb4500aac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53380/0 (socket says 172.21.15.81:53380) 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 -- 172.21.15.81:0/3511188893 learned_addr learned my addr 172.21.15.81:0/3511188893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb450152cc0 msgr2=0x7fb4500aac70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb450152cc0 0x7fb4500aac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45015acb0 msgr2=0x7fb45006a740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45015acb0 0x7fb45006a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440009420 con 0x7fb450162c30 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb45660d640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb44800bb50 tx=0x7fb44800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800c8e0 con 0x7fb450162c30 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800ca60 con 0x7fb450162c30 2024-05-08T20:51:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800ce90 con 0x7fb450162c30 2024-05-08T20:51:29.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.561+0000 7fb458070640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4501504f0 con 0x7fb450162c30 2024-05-08T20:51:29.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.565+0000 7fb458070640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb450150ab0 con 0x7fb450162c30 2024-05-08T20:51:29.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.565+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb448012070 con 0x7fb450162c30 2024-05-08T20:51:29.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.565+0000 7fb4467fc640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb434066690 0x7fb434068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.565+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb448010220 con 0x7fb450162c30 2024-05-08T20:51:29.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb455e0c640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb434066690 0x7fb434068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb455e0c640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb434066690 0x7fb434068b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb44c006c30 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb433fff640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 0x7fb45020e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450067660 con 0x7fb45014e9d0 2024-05-08T20:51:29.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb45560b640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 0x7fb45020e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.569+0000 7fb45560b640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb450163230 con 0x7fb45014e9d0 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb45560b640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 0x7fb45020e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c0780 tx=0x7fb4400191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4400adb50 con 0x7fb45014e9d0 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb4400adcb0 con 0x7fb45014e9d0 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 msgr2=0x7fb45020e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 0x7fb45020e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c0780 tx=0x7fb4400191a0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 msgr2=0x7fb45020e4f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.573+0000 7fb4467fc640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb45014e9d0 0x7fb45020e4f0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4500c0780 tx=0x7fb4400191a0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.605+0000 7fb433fff640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 0x7fb45020ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.605+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450069550 con 0x7fb450158cb0 2024-05-08T20:51:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb45560b640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 0x7fb45020ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb45560b640 1 -- 172.21.15.81:0/3511188893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb4500747d0 con 0x7fb450158cb0 2024-05-08T20:51:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb45560b640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 0x7fb45020ea30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c10 tx=0x7fb440009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440003e20 con 0x7fb450158cb0 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4625 (secure 0 0 0) 0x7fb440000e90 con 0x7fb450158cb0 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 msgr2=0x7fb45020ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 0x7fb45020ea30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c10 tx=0x7fb440009190 comp rx=0 tx=0).stop 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 msgr2=0x7fb45020ea30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:51:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.609+0000 7fb4467fc640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb450158cb0 0x7fb45020ea30 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c10 tx=0x7fb440009190 comp rx=0 tx=0).stop 2024-05-08T20:51:29.615 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 186, 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: 1 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:51:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:51:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:51:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:51:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:51:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:51:29.627 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb434066690 msgr2=0x7fb434068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb434066690 0x7fb434068b50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb44c006c30 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 msgr2=0x7fb45006ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb45660d640 1 -- 172.21.15.81:0/3511188893 reap_dead start 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb44800bb50 tx=0x7fb44800bc40 comp rx=0 tx=0).stop 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 shutdown_connections 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 --2- 172.21.15.81:0/3511188893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb450162c30 0x7fb45006ac80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 >> 172.21.15.81:0/3511188893 conn(0x7fb4500c3e00 msgr2=0x7fb450157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 shutdown_connections 2024-05-08T20:51:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:29.617+0000 7fb433fff640 1 -- 172.21.15.81:0/3511188893 wait complete. 2024-05-08T20:51:29.682 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:51:29.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout:Syncing()...1 sec 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout:FFSB benchmark finished at: Wed May 8 20:51:42 2024 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout:Results: 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout:Benchmark took 306.99 sec 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.419 INFO:tasks.workunit.client.0.smithi081.stdout:Total Results 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:=============== 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout: ======= ============ ========= ======= =========== ========== 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout: write : 1845760 6012.47 100.000% 100.000% 23.5MB/sec 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:- 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:6012.47 Transactions per Second 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:Throughput Results 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:=================== 2024-05-08T20:51:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:Write Throughput: 23.5MB/sec 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout:System Call Latency statistics in millisecs 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout:===== 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: Min Avg Max Total Calls 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: ======== ======== ======== ============ 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout:[ open] 0.527000 46.011698 2314.351074 1442 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 3 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 17 2024-05-08T20:51:42.429 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 8 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 15 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 13 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 30 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 334 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 635 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 253 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 91 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 30 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 13 2024-05-08T20:51:42.430 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout:[ write] 0.082000 5.225470 874.116028 1845760 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:51:42.431 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 4 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 18 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 208 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 6771 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 79495 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 176039 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 335758 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 492446 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 192638 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 69722 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 238690 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 244897 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 9074 2024-05-08T20:51:42.432 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout:[ lseek] 0.000000 0.000989 2.423000 1845760 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-05-08T20:51:42.433 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 9 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 25 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 52 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 57 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 480 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 1266 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 1843865 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout:[ close] 0.019000 2.608569 81.491997 1442 2024-05-08T20:51:42.434 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[7] 20.000000 - 50.000000 : 37 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[8] 10.000000 - 20.000000 : 60 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[9] 5.000000 - 10.000000 : 100 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[10] 2.000000 - 5.000000 : 184 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[11] 1.000000 - 2.000000 : 167 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[12] 0.500000 - 1.000000 : 123 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[13] 0.200000 - 0.500000 : 54 2024-05-08T20:51:42.435 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[14] 0.100000 - 0.200000 : 165 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[15] 0.050000 - 0.100000 : 138 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[16] 0.020000 - 0.050000 : 409 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[17] 0.010000 - 0.020000 : 3 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout:0.7% User Time 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout:53.6% System Time 2024-05-08T20:51:42.436 INFO:tasks.workunit.client.0.smithi081.stdout:54.2% CPU Utilization 2024-05-08T20:51:49.683 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-05-08T20:51:49.684 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-05-08T20:51:49.684 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:51:49.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:51:49.687 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:51:49.687 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:51:49.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:49.753 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T20:51:49.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T20:51:49.789 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-05-08T20:51:49.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T20:51:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 Processor -- start 2024-05-08T20:51:49.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 -- start start 2024-05-08T20:51:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f321c150110 0x7f321c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c0c47c0 con 0x7f321c0a9970 2024-05-08T20:51:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c0c6220 con 0x7f321c0c3510 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3222622640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c0c6500 con 0x7f321c150110 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f321c0a9970 0x7f321c14fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35976/0 (socket says 172.21.15.81:35976) 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321b7fe640 1 -- 172.21.15.81:0/1310516264 learned_addr learned my addr 172.21.15.81:0/1310516264 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919340450 0 0) 0x7f321c0c47c0 con 0x7f321c0a9970 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3204003530 con 0x7f321c0a9970 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187833494 0 0) 0x7f3204003530 con 0x7f321c0a9970 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 >> v2:172.21.15.117:3300/0 conn(0x7f321c150110 msgr2=0x7f321c0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 --2- 172.21.15.81:0/1310516264 >> v2:172.21.15.117:3300/0 conn(0x7f321c150110 0x7f321c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 >> v1:172.21.15.117:6789/0 conn(0x7f321c0c3510 legacy=0x7f321c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c0c4a10 con 0x7f321c0a9970 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3210001680 con 0x7f321c0a9970 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 >> v1:172.21.15.81:6789/0 conn(0x7f321c0a9970 legacy=0x7f321c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204003980 0x7f3204003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32040047d0 0x7f3204004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f320400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c0c6500 con 0x7f3204005390 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320400c230 con 0x7f3204003980 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320400c3f0 con 0x7f32040047d0 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f320400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321b7fe640 1 -- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32040047d0 msgr2=0x7f3204004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f321b7fe640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32040047d0 0x7f3204004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 -- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32040047d0 msgr2=0x7f3204004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32040047d0 0x7f3204004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 -- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204003980 msgr2=0x7f3204003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204003980 0x7f3204003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.840+0000 7f3220bbf640 1 -- 172.21.15.81:0/1310516264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204003530 con 0x7f3204005390 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3220bbf640 1 -- 172.21.15.81:0/1310516264 reap_dead start 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3220bbf640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f320400b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3214009c70 tx=0x7f321401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989b62a7a068e4a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140a5c60 con 0x7f3204005390 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32140a5dc0 con 0x7f3204005390 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f321affd640 1 -- 172.21.15.81:0/1310516264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214003be0 con 0x7f3204005390 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 -- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 msgr2=0x7f320400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f320400b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3214009c70 tx=0x7f321401cc50 comp rx=0 tx=0).stop 2024-05-08T20:51:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 -- 172.21.15.81:0/1310516264 shutdown_connections 2024-05-08T20:51:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 --2- 172.21.15.81:0/1310516264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f320400b990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 -- 172.21.15.81:0/1310516264 >> 172.21.15.81:0/1310516264 conn(0x7f321c0c68c0 msgr2=0x7f321c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 -- 172.21.15.81:0/1310516264 shutdown_connections 2024-05-08T20:51:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.844+0000 7f3222622640 1 -- 172.21.15.81:0/1310516264 wait complete. 2024-05-08T20:51:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.848+0000 7f3222622640 1 Processor -- start 2024-05-08T20:51:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- start start 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f321c1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 0x7f321c0bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06bb50 con 0x7f3204005390 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c06cb30 con 0x7f321c153c30 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c1ed5a0 con 0x7f321c1ea990 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321b7fe640 1 -- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 msgr2=0x7f321c0bff50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3301/0 2024-05-08T20:51:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 0x7f321c0bff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3220bbf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f321c1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3220bbf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:59574/0 (socket says 172.21.15.81:59574) 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3220bbf640 1 -- 172.21.15.81:0/2889434964 learned_addr learned my addr 172.21.15.81:0/2889434964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 -- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 msgr2=0x7f321c0bff50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 0x7f321c0bff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 -- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 msgr2=0x7f321c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 -- 172.21.15.81:0/2889434964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c1ed880 con 0x7f3204005390 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3220bbf640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f321bfff640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f321c1ee080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c410 tx=0x7f320c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c003600 con 0x7f3204005390 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c003760 con 0x7f3204005390 2024-05-08T20:51:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c003b50 con 0x7f3204005390 2024-05-08T20:51:49.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c1edb60 con 0x7f3204005390 2024-05-08T20:51:49.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c0c0490 con 0x7f3204005390 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.852+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c074950 con 0x7f3204005390 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.856+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f320c003cb0 con 0x7f3204005390 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.856+0000 7f3218ff9640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 0x7f3208068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.856+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f320c0833e0 con 0x7f3204005390 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.856+0000 7f321b7fe640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 0x7f3208068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.856+0000 7f321b7fe640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 0x7f3208068b30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3210004880 tx=0x7f3210001540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:49.860+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f320c0504f0 con 0x7f3204005390 2024-05-08T20:51:50.152 DEBUG:teuthology.parallel:result is None 2024-05-08T20:51:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f321c0c5ec0 con 0x7f3204005390 2024-05-08T20:51:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3218ff9640 1 -- 172.21.15.81:0/2889434964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f320c053b10 con 0x7f3204005390 2024-05-08T20:51:50.198 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":186,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 msgr2=0x7f3208068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 0x7f3208068b30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3210004880 tx=0x7f3210001540 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 msgr2=0x7f321c1ee080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f321c1ee080 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c410 tx=0x7f320c00c8d0 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 shutdown_connections 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3208066670 0x7f3208068b30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f321c153c30 0x7f321c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f321c1ea990 0x7f321c0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 --2- 172.21.15.81:0/2889434964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204005390 0x7f321c1ee080 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 >> 172.21.15.81:0/2889434964 conn(0x7f321c0c68c0 msgr2=0x7f321c0c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 shutdown_connections 2024-05-08T20:51:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:50.196+0000 7f3222622640 1 -- 172.21.15.81:0/2889434964 wait complete. 2024-05-08T20:51:53.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:51:53.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 Processor -- start 2024-05-08T20:51:53.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 -- start start 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e28151f00 0x7f4e281588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e280ca000 0x7f4e280ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e28158e20 con 0x7f4e28154cf0 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2806bb20 con 0x7f4e28151f00 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e3005f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281548e0 con 0x7f4e280ca000 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2d5fa640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e28154cf0 0x7f4e28155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35988/0 (socket says 172.21.15.81:35988) 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2d5fa640 1 -- 172.21.15.81:0/3646260352 learned_addr learned my addr 172.21.15.81:0/3646260352 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/3646260352 >> v2:172.21.15.81:3300/0 conn(0x7f4e28151f00 0x7f4e281588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2ddfb640 1 -- 172.21.15.81:0/3646260352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e280ca000 msgr2=0x7f4e280ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/3646260352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e280ca000 0x7f4e280ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2ddfb640 1 -- 172.21.15.81:0/3646260352 >> v1:172.21.15.81:6789/0 conn(0x7f4e28154cf0 legacy=0x7f4e28155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.360+0000 7f4e2ddfb640 1 -- 172.21.15.81:0/3646260352 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28155860 con 0x7f4e28151f00 2024-05-08T20:51:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/3646260352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e281588e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e240097c0 tx=0x7f4e2401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af5b40b4629b432 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e2cdf9640 1 -- 172.21.15.81:0/3646260352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240ac600 con 0x7f4e28151f00 2024-05-08T20:51:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e2cdf9640 1 -- 172.21.15.81:0/3646260352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e240a8050 con 0x7f4e28151f00 2024-05-08T20:51:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e2cdf9640 1 -- 172.21.15.81:0/3646260352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240ac980 con 0x7f4e28151f00 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 -- 172.21.15.81:0/3646260352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 msgr2=0x7f4e281588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 --2- 172.21.15.81:0/3646260352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e281588e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e240097c0 tx=0x7f4e2401c380 comp rx=0 tx=0).stop 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 -- 172.21.15.81:0/3646260352 shutdown_connections 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 --2- 172.21.15.81:0/3646260352 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e280ca000 0x7f4e280ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 --2- 172.21.15.81:0/3646260352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e281588e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 -- 172.21.15.81:0/3646260352 >> 172.21.15.81:0/3646260352 conn(0x7f4e280715f0 msgr2=0x7f4e28071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 -- 172.21.15.81:0/3646260352 shutdown_connections 2024-05-08T20:51:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.364+0000 7f4e3005f640 1 -- 172.21.15.81:0/3646260352 wait complete. 2024-05-08T20:51:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 Processor -- start 2024-05-08T20:51:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- start start 2024-05-08T20:51:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e280ca000 0x7f4e2820e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e28154cf0 0x7f4e2814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28158750 con 0x7f4e28151f00 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2814e970 con 0x7f4e280ca000 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2814ebc0 con 0x7f4e28154cf0 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51348/0 (socket says 172.21.15.81:51348) 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 -- 172.21.15.81:0/1601712363 learned_addr learned my addr 172.21.15.81:0/1601712363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e280ca000 0x7f4e2820e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2e5fc640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e28154cf0 0x7f4e2814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 -- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e28154cf0 msgr2=0x7f4e2814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e28154cf0 0x7f4e2814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 -- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e280ca000 msgr2=0x7f4e2820e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e280ca000 0x7f4e2820e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 -- 172.21.15.81:0/1601712363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009420 con 0x7f4e28151f00 2024-05-08T20:51:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e2d5fa640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e18005890 tx=0x7f4e1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18005cf0 con 0x7f4e28151f00 2024-05-08T20:51:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18005e50 con 0x7f4e28151f00 2024-05-08T20:51:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180072b0 con 0x7f4e28151f00 2024-05-08T20:51:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2820ee00 con 0x7f4e28151f00 2024-05-08T20:51:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.368+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e28155f50 con 0x7f4e28151f00 2024-05-08T20:51:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2814f0a0 con 0x7f4e28151f00 2024-05-08T20:51:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e18007410 con 0x7f4e28151f00 2024-05-08T20:51:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e1e7fc640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 0x7f4e0c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:51:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 0x7f4e0c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:51:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4e18083900 con 0x7f4e28151f00 2024-05-08T20:51:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.372+0000 7f4e2ddfb640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 0x7f4e0c068ba0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ae000 tx=0x7f4e240a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:51:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.376+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4e2814f0a0 con 0x7f4e28151f00 2024-05-08T20:51:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:53.688+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4e28155db0 con 0x7f4e28151f00 2024-05-08T20:51:57.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:51:57.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:51:58.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.416+0000 7f4e1e7fc640 1 -- 172.21.15.81:0/1601712363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f4e28155db0 con 0x7f4e28151f00 2024-05-08T20:51:58.420 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":190,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 msgr2=0x7f4e0c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 0x7f4e0c068ba0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ae000 tx=0x7f4e240a7000 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 msgr2=0x7f4e2820e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e18005890 tx=0x7f4e1800c960 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 shutdown_connections 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4e0c0666e0 0x7f4e0c068ba0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e28154cf0 0x7f4e2814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e28151f00 0x7f4e2820e8c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 --2- 172.21.15.81:0/1601712363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e280ca000 0x7f4e2820e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 >> 172.21.15.81:0/1601712363 conn(0x7f4e280715f0 msgr2=0x7f4e281530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 shutdown_connections 2024-05-08T20:51:58.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:51:58.420+0000 7f4e3005f640 1 -- 172.21.15.81:0/1601712363 wait complete. 2024-05-08T20:52:01.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:52:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.588+0000 7f26ccef9640 1 Processor -- start 2024-05-08T20:52:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.588+0000 7f26ccef9640 1 -- start start 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26ccef9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c806b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26ccef9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c806c4a0 con 0x7f26c80aba10 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26ccef9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c80c3120 con 0x7f26c80c58d0 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26ccef9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8152640 con 0x7f26c80c19a0 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26c80aba10 0x7f26c8159fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47152/0 (socket says 172.21.15.81:47152) 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c5d9b640 1 -- 172.21.15.81:0/80287306 learned_addr learned my addr 172.21.15.81:0/80287306 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c6d9d640 1 --2- 172.21.15.81:0/80287306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c806b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c559a640 1 -- 172.21.15.81:0/80287306 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170559128 0 0) 0x7f26c806c4a0 con 0x7f26c80aba10 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c559a640 1 -- 172.21.15.81:0/80287306 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b0003530 con 0x7f26c80aba10 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c6d9d640 1 -- 172.21.15.81:0/80287306 >> v1:172.21.15.117:6789/0 conn(0x7f26c80c58d0 legacy=0x7f26c80c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c6d9d640 1 -- 172.21.15.81:0/80287306 >> v1:172.21.15.81:6789/0 conn(0x7f26c80aba10 legacy=0x7f26c8159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c6d9d640 1 -- 172.21.15.81:0/80287306 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c806c1c0 con 0x7f26c80c19a0 2024-05-08T20:52:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c6d9d640 1 --2- 172.21.15.81:0/80287306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c806b9f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009dc0 tx=0x7f26c001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526a484d35b9a864 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c559a640 1 -- 172.21.15.81:0/80287306 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a58d0 con 0x7f26c80c19a0 2024-05-08T20:52:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c559a640 1 -- 172.21.15.81:0/80287306 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00a5a30 con 0x7f26c80c19a0 2024-05-08T20:52:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.592+0000 7f26c559a640 1 -- 172.21.15.81:0/80287306 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a5dc0 con 0x7f26c80c19a0 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/80287306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 msgr2=0x7f26c806b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 --2- 172.21.15.81:0/80287306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c806b9f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009dc0 tx=0x7f26c001c900 comp rx=0 tx=0).stop 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/80287306 shutdown_connections 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 --2- 172.21.15.81:0/80287306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c806b9f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/80287306 >> 172.21.15.81:0/80287306 conn(0x7f26c80c68c0 msgr2=0x7f26c80c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/80287306 shutdown_connections 2024-05-08T20:52:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/80287306 wait complete. 2024-05-08T20:52:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 Processor -- start 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- start start 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c80aba10 0x7f26c8070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c8150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80712c0 con 0x7f26c80c58d0 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8157b10 con 0x7f26c80aba10 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80c0b40 con 0x7f26c80c19a0 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45906/0 (socket says 172.21.15.81:45906) 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c659c640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c80aba10 0x7f26c8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 -- 172.21.15.81:0/2191039037 learned_addr learned my addr 172.21.15.81:0/2191039037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c5d9b640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c8150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 -- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 msgr2=0x7f26c8150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c8150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 -- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c80aba10 msgr2=0x7f26c8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c80aba10 0x7f26c8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 -- 172.21.15.81:0/2191039037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009a70 con 0x7f26c80c58d0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26c6d9d640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26c001a530 tx=0x7f26c00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b9860 con 0x7f26c80c58d0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00b99e0 con 0x7f26c80c58d0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b9d90 con 0x7f26c80c58d0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c81ec080 con 0x7f26c80c58d0 2024-05-08T20:52:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.596+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c80c0860 con 0x7f26c80c58d0 2024-05-08T20:52:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c8074950 con 0x7f26c80c58d0 2024-05-08T20:52:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26c00ad440 con 0x7f26c80c58d0 2024-05-08T20:52:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26b6ffd640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 0x7f26a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f26c011fa40 con 0x7f26c80c58d0 2024-05-08T20:52:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26c659c640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 0x7f26a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.600+0000 7f26c659c640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 0x7f26a8068b50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f26b8007fd0 tx=0x7f26b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.604+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f26c0121e60 con 0x7f26c80c58d0 2024-05-08T20:52:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.908+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f26c8072b30 con 0x7f26c80c58d0 2024-05-08T20:52:01.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.908+0000 7f26b6ffd640 1 -- 172.21.15.81:0/2191039037 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f26c00bd620 con 0x7f26c80c58d0 2024-05-08T20:52:01.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:52:01.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 msgr2=0x7f26a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 0x7f26a8068b50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f26b8007fd0 tx=0x7f26b8009040 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 msgr2=0x7f26c8151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26c001a530 tx=0x7f26c00196a0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 shutdown_connections 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f26a8066690 0x7f26a8068b50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c80c58d0 0x7f26c8151510 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26c80c19a0 0x7f26c8150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 --2- 172.21.15.81:0/2191039037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26c80aba10 0x7f26c8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 >> 172.21.15.81:0/2191039037 conn(0x7f26c80c68c0 msgr2=0x7f26c80a9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 shutdown_connections 2024-05-08T20:52:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:01.912+0000 7f26ccef9640 1 -- 172.21.15.81:0/2191039037 wait complete. 2024-05-08T20:52:01.945 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:52:01.945 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:52:01.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:52:02.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.080+0000 7f502c0a9640 1 Processor -- start 2024-05-08T20:52:02.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.080+0000 7f502c0a9640 1 -- start start 2024-05-08T20:52:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502c0a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502c0a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50240c2bc0 0x7f50240c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502c0a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5024155e10 con 0x7f50240a94b0 2024-05-08T20:52:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502c0a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406e790 con 0x7f50240c2bc0 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502c0a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502406f460 con 0x7f50240c30d0 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029e45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50240c2bc0 0x7f50240c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50240c2bc0 0x7f50240c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:54010/0 (socket says 172.21.15.81:54010) 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f502a646640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f50240a94b0 0x7f50240a9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:60468/0 (socket says 172.21.15.81:60468) 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029e45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:58582/0 (socket says 172.21.15.81:58582) 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 -- 172.21.15.81:0/3985683086 learned_addr learned my addr 172.21.15.81:0/3985683086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 -- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 msgr2=0x7f50240c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 -- 172.21.15.81:0/3985683086 >> v1:172.21.15.117:6789/0 conn(0x7f50240a94b0 legacy=0x7f50240a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029644640 1 -- 172.21.15.81:0/3985683086 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024156080 con 0x7f50240c2bc0 2024-05-08T20:52:02.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.084+0000 7f5029e45640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:52:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.088+0000 7f5029644640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c2bc0 0x7f50240c4120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50140098a0 tx=0x7f501401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81665308c413aa3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.092+0000 7f5028e43640 1 -- 172.21.15.81:0/3985683086 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140ab680 con 0x7f50240c2bc0 2024-05-08T20:52:02.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.092+0000 7f5028e43640 1 -- 172.21.15.81:0/3985683086 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50140ab7e0 con 0x7f50240c2bc0 2024-05-08T20:52:02.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.092+0000 7f5028e43640 1 -- 172.21.15.81:0/3985683086 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140abb70 con 0x7f50240c2bc0 2024-05-08T20:52:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c2bc0 msgr2=0x7f50240c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c2bc0 0x7f50240c4120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50140098a0 tx=0x7f501401c480 comp rx=0 tx=0).stop 2024-05-08T20:52:02.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- 172.21.15.81:0/3985683086 shutdown_connections 2024-05-08T20:52:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c2bc0 0x7f50240c4120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- 172.21.15.81:0/3985683086 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c30d0 0x7f50240c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- 172.21.15.81:0/3985683086 >> 172.21.15.81:0/3985683086 conn(0x7f50240c4cc0 msgr2=0x7f50240c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- 172.21.15.81:0/3985683086 shutdown_connections 2024-05-08T20:52:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- 172.21.15.81:0/3985683086 wait complete. 2024-05-08T20:52:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 Processor -- start 2024-05-08T20:52:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- start start 2024-05-08T20:52:02.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2bc0 0x7f5024146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c30d0 0x7f5024147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024149c00 con 0x7f50240a94b0 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240c2990 con 0x7f50240c30d0 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.096+0000 7f502c0a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024149640 con 0x7f50240c2bc0 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45918/0 (socket says 172.21.15.81:45918) 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 -- 172.21.15.81:0/868342480 learned_addr learned my addr 172.21.15.81:0/868342480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029644640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2bc0 0x7f5024146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2bc0 msgr2=0x7f5024146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50240c2bc0 0x7f5024146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c30d0 msgr2=0x7f5024147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50240c30d0 0x7f5024147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009420 con 0x7f50240a94b0 2024-05-08T20:52:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f5029e45640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f502000ebe0 tx=0x7f502000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000eee0 con 0x7f50240a94b0 2024-05-08T20:52:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000cc30 con 0x7f50240a94b0 2024-05-08T20:52:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020013470 con 0x7f50240a94b0 2024-05-08T20:52:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50140094d0 con 0x7f50240a94b0 2024-05-08T20:52:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50241476b0 con 0x7f50240a94b0 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50200135d0 con 0x7f50240a94b0 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5008066690 0x7f5008068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f502c0a9640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 0x7f5024148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024073ea0 con 0x7f50240c2440 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.100+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5020084760 con 0x7f50240a94b0 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f502a646640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 0x7f5024148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f5029644640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5008066690 0x7f5008068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f502a646640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5024148650 con 0x7f50240c2440 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f5029644640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5008066690 0x7f5008068b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f50140af000 tx=0x7f50140b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f502a646640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 0x7f5024148110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c6b0 tx=0x7f501c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c004d70 con 0x7f50240c2440 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f501c00a660 con 0x7f50240c2440 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 msgr2=0x7f5024148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 0x7f5024148110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c6b0 tx=0x7f501c00cb70 comp rx=0 tx=0).stop 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 msgr2=0x7f5024148110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.104+0000 7f501a7fc640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240c2440 0x7f5024148110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.108+0000 7f502c0a9640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 0x7f50241ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.108+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50241478a0 con 0x7f50241ee3f0 2024-05-08T20:52:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.108+0000 7f502a646640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 0x7f50241ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502a646640 1 -- 172.21.15.81:0/868342480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f50240c4970 con 0x7f50241ee3f0 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502a646640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 0x7f50241ee7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f501c014000 tx=0x7f501c001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c01f070 con 0x7f50241ee3f0 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f501c01a300 con 0x7f50241ee3f0 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 msgr2=0x7f50241ee7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 0x7f50241ee7d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f501c014000 tx=0x7f501c001410 comp rx=0 tx=0).stop 2024-05-08T20:52:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 msgr2=0x7f50241ee7d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f501a7fc640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50241ee3f0 0x7f50241ee7d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:02.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:52:02.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:02.128 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5008066690 msgr2=0x7f5008068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5008066690 0x7f5008068b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f50140af000 tx=0x7f50140b6040 comp rx=0 tx=0).stop 2024-05-08T20:52:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 msgr2=0x7f5024146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f502000ebe0 tx=0x7f502000c520 comp rx=0 tx=0).stop 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502a646640 1 -- 172.21.15.81:0/868342480 reap_dead start 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 shutdown_connections 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 --2- 172.21.15.81:0/868342480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50240a94b0 0x7f5024146020 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f502000ebe0 tx=0x7f502000c520 comp rx=0 tx=0).stop 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 >> 172.21.15.81:0/868342480 conn(0x7f50240c4cc0 msgr2=0x7f502414ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 shutdown_connections 2024-05-08T20:52:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.112+0000 7f502c0a9640 1 -- 172.21.15.81:0/868342480 wait complete. 2024-05-08T20:52:02.133 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:02.133 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:52:02.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:52:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.272+0000 7fe82c262640 1 Processor -- start 2024-05-08T20:52:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.272+0000 7fe82c262640 1 -- start start 2024-05-08T20:52:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82c262640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe82414fdd0 0x7fe8240c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82c262640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe824065c80 0x7fe8240ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82c262640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240c12c0 con 0x7fe824155c80 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82c262640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8240c1880 con 0x7fe82414fdd0 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82c262640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8240c20c0 con 0x7fe824065c80 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe82414fdd0 0x7fe8240c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82a7ff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe824155c80 0x7fe8241560b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47166/0 (socket says 172.21.15.81:47166) 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe82a7ff640 1 -- 172.21.15.81:0/3906572315 learned_addr learned my addr 172.21.15.81:0/3906572315 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3906572315 >> v2:172.21.15.117:3300/0 conn(0x7fe824065c80 0x7fe8240ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe828ffc640 1 -- 172.21.15.81:0/3906572315 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736198243 0 0) 0x7fe8240c12c0 con 0x7fe824155c80 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe828ffc640 1 -- 172.21.15.81:0/3906572315 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe810003530 con 0x7fe824155c80 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 -- 172.21.15.81:0/3906572315 >> v2:172.21.15.117:3300/0 conn(0x7fe824065c80 msgr2=0x7fe8240ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 --2- 172.21.15.81:0/3906572315 >> v2:172.21.15.117:3300/0 conn(0x7fe824065c80 0x7fe8240ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 -- 172.21.15.81:0/3906572315 >> v1:172.21.15.81:6789/0 conn(0x7fe824155c80 legacy=0x7fe8241560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 -- 172.21.15.81:0/3906572315 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240a9b10 con 0x7fe82414fdd0 2024-05-08T20:52:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.276+0000 7fe829ffe640 1 --2- 172.21.15.81:0/3906572315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82414fdd0 0x7fe8240c1b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe82406f5d0 tx=0x7fe82001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09b1681895c1bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe828ffc640 1 -- 172.21.15.81:0/3906572315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200ab400 con 0x7fe82414fdd0 2024-05-08T20:52:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe828ffc640 1 -- 172.21.15.81:0/3906572315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200a7050 con 0x7fe82414fdd0 2024-05-08T20:52:02.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe828ffc640 1 -- 172.21.15.81:0/3906572315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200ab780 con 0x7fe82414fdd0 2024-05-08T20:52:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3906572315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82414fdd0 msgr2=0x7fe8240c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- 172.21.15.81:0/3906572315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82414fdd0 0x7fe8240c1b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe82406f5d0 tx=0x7fe82001c3b0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3906572315 shutdown_connections 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- 172.21.15.81:0/3906572315 >> v2:172.21.15.117:3300/0 conn(0x7fe824065c80 0x7fe8240ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- 172.21.15.81:0/3906572315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe82414fdd0 0x7fe8240c1b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3906572315 >> 172.21.15.81:0/3906572315 conn(0x7fe8240a8670 msgr2=0x7fe8240a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3906572315 shutdown_connections 2024-05-08T20:52:02.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3906572315 wait complete. 2024-05-08T20:52:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 Processor -- start 2024-05-08T20:52:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- start start 2024-05-08T20:52:02.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 0x7fe824148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82414fdd0 0x7fe824154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe824155c80 0x7fe8241e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241e8de0 con 0x7fe824065c80 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824148400 con 0x7fe82414fdd0 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240c0f60 con 0x7fe824155c80 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 0x7fe824148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 0x7fe824148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45968/0 (socket says 172.21.15.81:45968) 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 -- 172.21.15.81:0/3096914713 learned_addr learned my addr 172.21.15.81:0/3096914713 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82414fdd0 0x7fe824154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82a7ff640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe824155c80 0x7fe8241e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe824155c80 msgr2=0x7fe8241e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe824155c80 0x7fe8241e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82414fdd0 msgr2=0x7fe824154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe82414fdd0 0x7fe824154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009420 con 0x7fe824065c80 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82a7ff640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe824155c80 0x7fe8241e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe829ffe640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 0x7fe824148f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8200ae040 tx=0x7fe820019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b4410 con 0x7fe824065c80 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200b4570 con 0x7fe824065c80 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8241e8a20 con 0x7fe824065c80 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200b4920 con 0x7fe824065c80 2024-05-08T20:52:02.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.280+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8241521f0 con 0x7fe824065c80 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe82c262640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 0x7fe824140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824148130 con 0x7fe824147780 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 0x7fe824140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe8297fd640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe82415d820 con 0x7fe824147780 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8200b2040 con 0x7fe824065c80 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 0x7fe824140b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe814013580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe808066690 0x7fe808068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe82a7ff640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe808066690 0x7fe808068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe82011e310 con 0x7fe824065c80 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe82a7ff640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe808066690 0x7fe808068b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000f90 tx=0x7fe81c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814012040 con 0x7fe824147780 2024-05-08T20:52:02.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe814013040 con 0x7fe824147780 2024-05-08T20:52:02.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 msgr2=0x7fe824140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 0x7fe824140b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe814013580 comp rx=0 tx=0).stop 2024-05-08T20:52:02.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 msgr2=0x7fe824140b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.284+0000 7fe81a7fc640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe824147780 0x7fe824140b10 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe814013580 comp rx=0 tx=0).stop 2024-05-08T20:52:02.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.296+0000 7fe82c262640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 0x7fe824141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.296+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe824141590 con 0x7fe8241e9740 2024-05-08T20:52:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.296+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 0x7fe824141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.296+0000 7fe8297fd640 1 -- 172.21.15.81:0/3096914713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe8241e8bb0 con 0x7fe8241e9740 2024-05-08T20:52:02.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.296+0000 7fe8297fd640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 0x7fe824141050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe8140046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814029070 con 0x7fe8241e9740 2024-05-08T20:52:02.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7fe8140242e0 con 0x7fe8241e9740 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 msgr2=0x7fe824141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 0x7fe824141050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe8140046d0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 msgr2=0x7fe824141050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe81a7fc640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8241e9740 0x7fe824141050 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8241e9b50 tx=0x7fe8140046d0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:02.304 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.305 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.306 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.307 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:02.308 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.311 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:02.313 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.315 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.317 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:02.317 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe808066690 msgr2=0x7fe808068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe808066690 0x7fe808068b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000f90 tx=0x7fe81c007e30 comp rx=0 tx=0).stop 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 msgr2=0x7fe824148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 --2- 172.21.15.81:0/3096914713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe824065c80 0x7fe824148f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8200ae040 tx=0x7fe820019150 comp rx=0 tx=0).stop 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82a7ff640 1 -- 172.21.15.81:0/3096914713 reap_dead start 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82a7ff640 1 -- 172.21.15.81:0/3096914713 reap_dead start 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 shutdown_connections 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 >> 172.21.15.81:0/3096914713 conn(0x7fe8240a8670 msgr2=0x7fe8240a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 shutdown_connections 2024-05-08T20:52:02.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.300+0000 7fe82c262640 1 -- 172.21.15.81:0/3096914713 wait complete. 2024-05-08T20:52:02.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:02.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:52:02.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:52:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 Processor -- start 2024-05-08T20:52:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 -- start start 2024-05-08T20:52:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff86806c930 0x7ff8680a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c28b0 0x7ff8680c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868159fa0 con 0x7ff8680c20f0 2024-05-08T20:52:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680aacb0 con 0x7ff86806c930 2024-05-08T20:52:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86cb56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff868159ab0 con 0x7ff8680c28b0 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff86806c930 0x7ff8680a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff866d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8680c20f0 0x7ff8680a99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47174/0 (socket says 172.21.15.81:47174) 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff866d9d640 1 -- 172.21.15.81:0/2586653497 learned_addr learned my addr 172.21.15.81:0/2586653497 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff865d9b640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c28b0 0x7ff8680c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86659c640 1 -- 172.21.15.81:0/2586653497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c28b0 msgr2=0x7ff8680c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86659c640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c28b0 0x7ff8680c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86659c640 1 -- 172.21.15.81:0/2586653497 >> v1:172.21.15.81:6789/0 conn(0x7ff8680c20f0 legacy=0x7ff8680a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86659c640 1 -- 172.21.15.81:0/2586653497 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680a84e0 con 0x7ff86806c930 2024-05-08T20:52:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.460+0000 7ff86559a640 1 -- 172.21.15.81:0/2586653497 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518258947 0 0) 0x7ff868159fa0 con 0x7ff8680c20f0 2024-05-08T20:52:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86659c640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86806c930 0x7ff8680a87c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8580097c0 tx=0x7ff85801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338ee28f853da42a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86559a640 1 -- 172.21.15.81:0/2586653497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580ab600 con 0x7ff86806c930 2024-05-08T20:52:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86559a640 1 -- 172.21.15.81:0/2586653497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8580a7050 con 0x7ff86806c930 2024-05-08T20:52:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86559a640 1 -- 172.21.15.81:0/2586653497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580ab980 con 0x7ff86806c930 2024-05-08T20:52:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 -- 172.21.15.81:0/2586653497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86806c930 msgr2=0x7ff8680a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86806c930 0x7ff8680a87c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8580097c0 tx=0x7ff85801c380 comp rx=0 tx=0).stop 2024-05-08T20:52:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 -- 172.21.15.81:0/2586653497 shutdown_connections 2024-05-08T20:52:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c28b0 0x7ff8680c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2586653497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86806c930 0x7ff8680a87c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.464+0000 7ff86cb56640 1 -- 172.21.15.81:0/2586653497 >> 172.21.15.81:0/2586653497 conn(0x7ff8680c2ca0 msgr2=0x7ff8680c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- 172.21.15.81:0/2586653497 shutdown_connections 2024-05-08T20:52:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- 172.21.15.81:0/2586653497 wait complete. 2024-05-08T20:52:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 Processor -- start 2024-05-08T20:52:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- start start 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86806c930 0x7ff8680a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 0x7ff86815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8680a7c70 0x7ff868154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868070530 con 0x7ff8680c20f0 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680a3c70 con 0x7ff8680a7c70 2024-05-08T20:52:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff86cb56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680a3f50 con 0x7ff86806c930 2024-05-08T20:52:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 0x7ff86815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 0x7ff86815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45996/0 (socket says 172.21.15.81:45996) 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 -- 172.21.15.81:0/2044692651 learned_addr learned my addr 172.21.15.81:0/2044692651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff866d9d640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8680a7c70 0x7ff868154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86806c930 msgr2=0x7ff8680a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff86806c930 0x7ff8680a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8680a7c70 msgr2=0x7ff868154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8680a7c70 0x7ff868154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009420 con 0x7ff8680c20f0 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff865d9b640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 0x7ff86815c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e870 tx=0x7ff85c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c009510 con 0x7ff8680c20f0 2024-05-08T20:52:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c00eec0 con 0x7ff8680c20f0 2024-05-08T20:52:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.468+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00cb40 con 0x7ff8680c20f0 2024-05-08T20:52:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8680707d0 con 0x7ff8680c20f0 2024-05-08T20:52:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8680a4230 con 0x7ff8680c20f0 2024-05-08T20:52:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 0x7ff8681552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680696e0 con 0x7ff8680c2650 2024-05-08T20:52:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86659c640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 0x7ff8681552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff85c00cca0 con 0x7ff8680c20f0 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff856ffd640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8480666c0 0x7ff848068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff85c0849c0 con 0x7ff8680c20f0 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.472+0000 7ff86659c640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8681636c0 con 0x7ff8680c2650 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff866d9d640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8480666c0 0x7ff848068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff86659c640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 0x7ff8681552f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff868066da0 tx=0x7ff8580aba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff866d9d640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8480666c0 0x7ff848068b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff8680a8080 tx=0x7ff860005b80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580bd400 con 0x7ff8680c2650 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff8580bd560 con 0x7ff8680c2650 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 msgr2=0x7ff8681552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 0x7ff8681552f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff868066da0 tx=0x7ff8580aba30 comp rx=0 tx=0).stop 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 msgr2=0x7ff8681552f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.476+0000 7ff856ffd640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8680c2650 0x7ff8681552f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.484+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 0x7ff8681f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.484+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681660f0 con 0x7ff8681f27d0 2024-05-08T20:52:02.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.484+0000 7ff86659c640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 0x7ff8681f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86659c640 1 -- 172.21.15.81:0/2044692651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff868070960 con 0x7ff8681f27d0 2024-05-08T20:52:02.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86659c640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 0x7ff8681f2be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff8580097c0 tx=0x7ff8580a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580c1050 con 0x7ff8681f27d0 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7ff858000e90 con 0x7ff8681f27d0 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 msgr2=0x7ff8681f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 0x7ff8681f2be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff8580097c0 tx=0x7ff8580a8000 comp rx=0 tx=0).stop 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 msgr2=0x7ff8681f2be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff856ffd640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8681f27d0 0x7ff8681f2be0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.491 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.492 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.493 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:02.496 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:02.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.503 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:02.504 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:02.505 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8480666c0 msgr2=0x7ff848068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff8480666c0 0x7ff848068b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff8680a8080 tx=0x7ff860005b80 comp rx=0 tx=0).stop 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 msgr2=0x7ff86815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 --2- 172.21.15.81:0/2044692651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8680c20f0 0x7ff86815c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00e870 tx=0x7ff85c00ec70 comp rx=0 tx=0).stop 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff866d9d640 1 -- 172.21.15.81:0/2044692651 reap_dead start 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff866d9d640 1 -- 172.21.15.81:0/2044692651 reap_dead start 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 shutdown_connections 2024-05-08T20:52:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 >> 172.21.15.81:0/2044692651 conn(0x7ff8680c2ca0 msgr2=0x7ff8680711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 shutdown_connections 2024-05-08T20:52:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.488+0000 7ff86cb56640 1 -- 172.21.15.81:0/2044692651 wait complete. 2024-05-08T20:52:02.517 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:02.517 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:52:02.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:52:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 Processor -- start 2024-05-08T20:52:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 -- start start 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16f8152340 0x7f16f806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f8158080 con 0x7f16f80c2570 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f806a890 con 0x7f16f806d7d0 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16fdb27640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f806ab70 con 0x7f16f8152340 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f16f80c2570 0x7f16f8154f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47186/0 (socket says 172.21.15.81:47186) 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f6ffd640 1 -- 172.21.15.81:0/3273863059 learned_addr learned my addr 172.21.15.81:0/3273863059 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f77fe640 1 --2- 172.21.15.81:0/3273863059 >> v2:172.21.15.117:3300/0 conn(0x7f16f8152340 0x7f16f806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258521492 0 0) 0x7f16f8158080 con 0x7f16f80c2570 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e0003530 con 0x7f16f80c2570 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179040884 0 0) 0x7f16e0003530 con 0x7f16f80c2570 2024-05-08T20:52:02.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f77fe640 1 -- 172.21.15.81:0/3273863059 >> v1:172.21.15.117:6789/0 conn(0x7f16f806d7d0 legacy=0x7f16f815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f77fe640 1 -- 172.21.15.81:0/3273863059 >> v1:172.21.15.81:6789/0 conn(0x7f16f80c2570 legacy=0x7f16f8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.652+0000 7f16f77fe640 1 -- 172.21.15.81:0/3273863059 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f80c2d70 con 0x7f16f8152340 2024-05-08T20:52:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16f77fe640 1 --2- 172.21.15.81:0/3273863059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f8152340 0x7f16f806d290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097c0 tx=0x7f16e801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56b1a873788f2b69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec001680 con 0x7f16f8152340 2024-05-08T20:52:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80a7050 con 0x7f16f8152340 2024-05-08T20:52:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16f67fc640 1 -- 172.21.15.81:0/3273863059 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80ab620 con 0x7f16f8152340 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- 172.21.15.81:0/3273863059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f8152340 msgr2=0x7f16f806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3273863059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f8152340 0x7f16f806d290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097c0 tx=0x7f16e801c330 comp rx=0 tx=0).stop 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- 172.21.15.81:0/3273863059 shutdown_connections 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3273863059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f8152340 0x7f16f806d290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- 172.21.15.81:0/3273863059 >> 172.21.15.81:0/3273863059 conn(0x7f16f80c71b0 msgr2=0x7f16f80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- 172.21.15.81:0/3273863059 shutdown_connections 2024-05-08T20:52:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- 172.21.15.81:0/3273863059 wait complete. 2024-05-08T20:52:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 Processor -- start 2024-05-08T20:52:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.656+0000 7f16fdb27640 1 -- start start 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f806d7d0 0x7f16f81f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f80c2570 0x7f16f8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815ffd0 con 0x7f16f8152340 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81602b0 con 0x7f16f806d7d0 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81f21a0 con 0x7f16f80c2570 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46006/0 (socket says 172.21.15.81:46006) 2024-05-08T20:52:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 -- 172.21.15.81:0/3211971508 learned_addr learned my addr 172.21.15.81:0/3211971508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 -- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f80c2570 msgr2=0x7f16f8144b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f80c2570 0x7f16f8144b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 -- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f806d7d0 msgr2=0x7f16f81f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f806d7d0 0x7f16f81f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 -- 172.21.15.81:0/3211971508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009420 con 0x7f16f8152340 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16f7fff640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c730 tx=0x7f16f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003b80 con 0x7f16f8152340 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f81f2480 con 0x7f16f8152340 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f81f1e50 con 0x7f16f8152340 2024-05-08T20:52:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f000ce40 con 0x7f16f8152340 2024-05-08T20:52:02.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000a7f0 con 0x7f16f8152340 2024-05-08T20:52:02.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.660+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8005260 con 0x7f16f8152340 2024-05-08T20:52:02.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.664+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16f000a9d0 con 0x7f16f8152340 2024-05-08T20:52:02.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.664+0000 7f16dffff640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 0x7f16e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:02.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.664+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f16f0084320 con 0x7f16f8152340 2024-05-08T20:52:02.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.664+0000 7f16f77fe640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 0x7f16e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:02.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.664+0000 7f16f77fe640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 0x7f16e4068b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ad000 tx=0x7f16e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.668+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f16f0051250 con 0x7f16f8152340 2024-05-08T20:52:02.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.996+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f16d8005d20 con 0x7f16f8152340 2024-05-08T20:52:02.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:02.996+0000 7f16dffff640 1 -- 172.21.15.81:0/3211971508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f16f0054870 con 0x7f16f8152340 2024-05-08T20:52:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 msgr2=0x7f16e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 0x7f16e4068b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ad000 tx=0x7f16e8008040 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 msgr2=0x7f16f80c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c730 tx=0x7f16f000cbf0 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 shutdown_connections 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f16e4066690 0x7f16e4068b50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16f8152340 0x7f16f80c4d70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16f80c2570 0x7f16f8144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 --2- 172.21.15.81:0/3211971508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16f806d7d0 0x7f16f81f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 >> 172.21.15.81:0/3211971508 conn(0x7f16f80c71b0 msgr2=0x7f16f80c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 shutdown_connections 2024-05-08T20:52:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:03.000+0000 7f16fdb27640 1 -- 172.21.15.81:0/3211971508 wait complete. 2024-05-08T20:52:03.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:52:13.033 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:52:13.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:52:13.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.168+0000 7f7f01ccc640 1 Processor -- start 2024-05-08T20:52:13.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.168+0000 7f7f01ccc640 1 -- start start 2024-05-08T20:52:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.168+0000 7f7f01ccc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7efc0c2800 0x7f7efc1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.168+0000 7f7f01ccc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0c3a50 con 0x7f7efc06b230 2024-05-08T20:52:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.168+0000 7f7f01ccc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0705e0 con 0x7f7efc070c00 2024-05-08T20:52:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7f01ccc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0c2c70 con 0x7f7efc0c2800 2024-05-08T20:52:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7efc06b230 0x7f7efc14e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40252/0 (socket says 172.21.15.81:40252) 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efb7fe640 1 -- 172.21.15.81:0/1025598747 learned_addr learned my addr 172.21.15.81:0/1025598747 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140516082 0 0) 0x7f7efc0c3a50 con 0x7f7efc06b230 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee400bd40 con 0x7f7efc06b230 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119939730 0 0) 0x7f7ee400bd40 con 0x7f7efc06b230 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 >> v2:172.21.15.117:3300/0 conn(0x7f7efc0c2800 msgr2=0x7f7efc1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 --2- 172.21.15.81:0/1025598747 >> v2:172.21.15.117:3300/0 conn(0x7f7efc0c2800 0x7f7efc1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 >> v1:172.21.15.117:6789/0 conn(0x7f7efc070c00 legacy=0x7f7efc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0708c0 con 0x7f7efc06b230 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f7eec001a00 con 0x7f7efc06b230 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 >> v1:172.21.15.81:6789/0 conn(0x7f7efc06b230 legacy=0x7f7efc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee400c190 0x7f7ee400c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7ee400d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee400dba0 0x7f7ee4009480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c2c70 con 0x7f7ee400cfe0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4009d60 con 0x7f7ee400dba0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4009f20 con 0x7f7ee400c190 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7ee400d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 -- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee400c190 msgr2=0x7f7ee400c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee400c190 0x7f7ee400c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 -- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee400dba0 msgr2=0x7f7ee4009480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee400dba0 0x7f7ee4009480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efaffd640 1 -- 172.21.15.81:0/1025598747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee400bd40 con 0x7f7ee400cfe0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.172+0000 7f7efbfff640 1 -- 172.21.15.81:0/1025598747 reap_dead start 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7efaffd640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7ee400d460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4001650 tx=0x7f7ef403e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40c2d4a46b4fce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40c6c40 con 0x7f7ee400cfe0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40c6da0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7efa7fc640 1 -- 172.21.15.81:0/1025598747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4005310 con 0x7f7ee400cfe0 2024-05-08T20:52:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 msgr2=0x7f7ee400d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7ee400d460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4001650 tx=0x7f7ef403e050 comp rx=0 tx=0).stop 2024-05-08T20:52:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- 172.21.15.81:0/1025598747 shutdown_connections 2024-05-08T20:52:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/1025598747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7ee400d460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- 172.21.15.81:0/1025598747 >> 172.21.15.81:0/1025598747 conn(0x7f7efc0c71b0 msgr2=0x7f7efc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- 172.21.15.81:0/1025598747 shutdown_connections 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- 172.21.15.81:0/1025598747 wait complete. 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 Processor -- start 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.176+0000 7f7f01ccc640 1 -- start start 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7efc0ad120 0x7f7efc0ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 0x7f7efc0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc155b30 con 0x7f7ee400cfe0 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0ac030 con 0x7f7efc0ad120 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1548c0 con 0x7f7efc1ec1b0 2024-05-08T20:52:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37106/0 (socket says 172.21.15.81:37106) 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 -- 172.21.15.81:0/720862017 learned_addr learned my addr 172.21.15.81:0/720862017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efaffd640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7efc0ad120 0x7f7efc0ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 -- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 msgr2=0x7f7efc0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efbfff640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 0x7f7efc0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 0x7f7efc0ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 -- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7efc0ad120 msgr2=0x7f7efc0ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7efc0ad120 0x7f7efc0ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 -- 172.21.15.81:0/720862017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc1e98b0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efbfff640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 0x7f7efc0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7efb7fe640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00cb90 tx=0x7f7eec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec004d70 con 0x7f7ee400cfe0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00ab40 con 0x7f7ee400cfe0 2024-05-08T20:52:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc154b60 con 0x7f7ee400cfe0 2024-05-08T20:52:13.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0070d0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc1557c0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.180+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0675e0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.184+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7eec007230 con 0x7f7ee400cfe0 2024-05-08T20:52:13.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.184+0000 7f7ee3fff640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 0x7f7ee8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.184+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7eec0555c0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.184+0000 7f7efaffd640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 0x7f7ee8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.184+0000 7f7efaffd640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 0x7f7ee8068b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cb000 tx=0x7f7ef4001030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.192+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7eec051990 con 0x7f7ee400cfe0 2024-05-08T20:52:13.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.524+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7efc0c2db0 con 0x7f7ee400cfe0 2024-05-08T20:52:13.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.524+0000 7f7ee3fff640 1 -- 172.21.15.81:0/720862017 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f7eec051990 con 0x7f7ee400cfe0 2024-05-08T20:52:13.528 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":192,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:52:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 msgr2=0x7f7ee8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 0x7f7ee8068b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40cb000 tx=0x7f7ef4001030 comp rx=0 tx=0).stop 2024-05-08T20:52:13.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 msgr2=0x7f7efc14bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00cb90 tx=0x7f7eec00a430 comp rx=0 tx=0).stop 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 shutdown_connections 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7ee8066690 0x7f7ee8068b50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7efc1ec1b0 0x7f7efc0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7efc0ad120 0x7f7efc0ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 --2- 172.21.15.81:0/720862017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee400cfe0 0x7f7efc14bef0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 >> 172.21.15.81:0/720862017 conn(0x7f7efc0c71b0 msgr2=0x7f7efc14cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 shutdown_connections 2024-05-08T20:52:13.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.528+0000 7f7f01ccc640 1 -- 172.21.15.81:0/720862017 wait complete. 2024-05-08T20:52:13.560 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:52:13.560 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:52:13.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:52:13.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:52:13.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.724+0000 7f0573a98640 1 Processor -- start 2024-05-08T20:52:13.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.724+0000 7f0573a98640 1 -- start start 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f056c152340 0x7f056c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c0c2570 0x7f056c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06ab70 con 0x7f056c0c2570 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c154b10 con 0x7f056c152340 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0573a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c158080 con 0x7f056c06d7d0 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c0c2570 0x7f056c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c0c2570 0x7f056c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37118/0 (socket says 172.21.15.81:37118) 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 -- 172.21.15.81:0/3776521891 learned_addr learned my addr 172.21.15.81:0/3776521891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571834640 1 --2- 172.21.15.81:0/3776521891 >> v2:172.21.15.117:3300/0 conn(0x7f056c152340 0x7f056c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0572035640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 -- 172.21.15.81:0/3776521891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 msgr2=0x7f056c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 -- 172.21.15.81:0/3776521891 >> v2:172.21.15.117:3300/0 conn(0x7f056c152340 msgr2=0x7f056c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 --2- 172.21.15.81:0/3776521891 >> v2:172.21.15.117:3300/0 conn(0x7f056c152340 0x7f056c06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 -- 172.21.15.81:0/3776521891 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c06a890 con 0x7f056c0c2570 2024-05-08T20:52:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0571033640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c2570 0x7f056c154f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f056c06fd50 tx=0x7f055c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80016505b71acfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0570832640 1 -- 172.21.15.81:0/3776521891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0ab620 con 0x7f056c0c2570 2024-05-08T20:52:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0570832640 1 -- 172.21.15.81:0/3776521891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0ab780 con 0x7f056c0c2570 2024-05-08T20:52:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.728+0000 7f0570832640 1 -- 172.21.15.81:0/3776521891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0abb10 con 0x7f056c0c2570 2024-05-08T20:52:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/3776521891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c2570 msgr2=0x7f056c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c2570 0x7f056c154f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f056c06fd50 tx=0x7f055c01c460 comp rx=0 tx=0).stop 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/3776521891 shutdown_connections 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- 172.21.15.81:0/3776521891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c2570 0x7f056c154f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- 172.21.15.81:0/3776521891 >> v2:172.21.15.117:3300/0 conn(0x7f056c152340 0x7f056c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/3776521891 >> 172.21.15.81:0/3776521891 conn(0x7f056c0c71b0 msgr2=0x7f056c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/3776521891 shutdown_connections 2024-05-08T20:52:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/3776521891 wait complete. 2024-05-08T20:52:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 Processor -- start 2024-05-08T20:52:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- start start 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c0c2570 0x7f056c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 0x7f056c0c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0c5ce0 con 0x7f056c152340 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c13cd90 con 0x7f056c0c2570 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c13d070 con 0x7f056c06d7d0 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 0x7f056c0c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 0x7f056c0c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37130/0 (socket says 172.21.15.81:37130) 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 learned_addr learned my addr 172.21.15.81:0/1962784193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0571033640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c0c2570 0x7f056c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 msgr2=0x7f056c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c06d7d0 0x7f056c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c0c2570 msgr2=0x7f056c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c0c2570 0x7f056c1f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0094d0 con 0x7f056c152340 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0572035640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 0x7f056c0c4da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0564007d20 tx=0x7f056400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564014420 con 0x7f056c152340 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640145a0 con 0x7f056c152340 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c1f1110 con 0x7f056c152340 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564014950 con 0x7f056c152340 2024-05-08T20:52:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.732+0000 7f0573a98640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1f0e00 con 0x7f056c152340 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0573a98640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 0x7f056c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0573a98640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c069550 con 0x7f056c0c52e0 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0571834640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 0x7f056c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0571834640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f056c1559e0 con 0x7f056c0c52e0 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0564014ab0 con 0x7f056c152340 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0571834640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 0x7f056c1503a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f056800d4e0 tx=0x7f056800d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f05627fc640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0550066690 0x7f0550068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0564084d30 con 0x7f056c152340 2024-05-08T20:52:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568018070 con 0x7f056c0c52e0 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.736+0000 7f0571033640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0550066690 0x7f0550068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f0568004020 con 0x7f056c0c52e0 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 msgr2=0x7f056c1503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f05627fc640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 0x7f056c1503a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f056800d4e0 tx=0x7f056800d9a0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 msgr2=0x7f056c1503a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f05627fc640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c0c52e0 0x7f056c1503a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.740+0000 7f0571033640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0550066690 0x7f0550068b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f055c0af000 tx=0x7f055c0b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f054ffff640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 0x7f0548004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548007d20 con 0x7f05480028f0 2024-05-08T20:52:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f0571834640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 0x7f0548004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f0571834640 1 -- 172.21.15.81:0/1962784193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0548007ee0 con 0x7f05480028f0 2024-05-08T20:52:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f0571834640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 0x7f0548004d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0568017000 tx=0x7f05680046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.748+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568003a10 con 0x7f05480028f0 2024-05-08T20:52:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.752+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7f0568003b70 con 0x7f05480028f0 2024-05-08T20:52:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.752+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 msgr2=0x7f0548004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.752+0000 7f05627fc640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 0x7f0548004d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0568017000 tx=0x7f05680046d0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.752+0000 7f05627fc640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 msgr2=0x7f0548004d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.752+0000 7f05627fc640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05480028f0 0x7f0548004d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:52:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:13.771 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0550066690 msgr2=0x7f0550068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0550066690 0x7f0550068b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f055c0af000 tx=0x7f055c0b6040 comp rx=0 tx=0).stop 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 msgr2=0x7f056c0c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 --2- 172.21.15.81:0/1962784193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c152340 0x7f056c0c4da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0564007d20 tx=0x7f056400e4b0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 reap_dead start 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f0572035640 1 -- 172.21.15.81:0/1962784193 reap_dead start 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 shutdown_connections 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 >> 172.21.15.81:0/1962784193 conn(0x7f056c0c71b0 msgr2=0x7f056c145df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 shutdown_connections 2024-05-08T20:52:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.756+0000 7f054ffff640 1 -- 172.21.15.81:0/1962784193 wait complete. 2024-05-08T20:52:13.778 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:13.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:52:13.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:52:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.916+0000 7ffbc7bdd640 1 Processor -- start 2024-05-08T20:52:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.916+0000 7ffbc7bdd640 1 -- start start 2024-05-08T20:52:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.916+0000 7ffbc7bdd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c30d0 0x7ffbc00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.916+0000 7ffbc7bdd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffbc00a94b0 0x7ffbc00a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.916+0000 7ffbc7bdd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc0155e10 con 0x7ffbc00c2bc0 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc7bdd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc006e790 con 0x7ffbc00a94b0 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc7bdd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc006f460 con 0x7ffbc00c30d0 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffbc00a94b0 0x7ffbc00a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffbc00a94b0 0x7ffbc00a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:52366/0 (socket says 172.21.15.81:52366) 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 -- 172.21.15.81:0/1372406588 learned_addr learned my addr 172.21.15.81:0/1372406588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc5178640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffbc00c2bc0 0x7ffbc00c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:38434/0 (socket says 172.21.15.81:38434) 2024-05-08T20:52:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 -- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c30d0 msgr2=0x7ffbc00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 --2- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c30d0 0x7ffbc00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 -- 172.21.15.81:0/1372406588 >> v1:172.21.15.117:6789/0 conn(0x7ffbc00c2bc0 legacy=0x7ffbc00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 -- 172.21.15.81:0/1372406588 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00a9e60 con 0x7ffbc00a94b0 2024-05-08T20:52:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.920+0000 7ffbc617a640 1 --2- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc00a9920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e80 tx=0x7ffbb801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da9238d7815e257b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc4977640 1 -- 172.21.15.81:0/1372406588 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80a5810 con 0x7ffbc00a94b0 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc4977640 1 -- 172.21.15.81:0/1372406588 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80a5970 con 0x7ffbc00a94b0 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc4977640 1 -- 172.21.15.81:0/1372406588 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80a5d00 con 0x7ffbc00a94b0 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 msgr2=0x7ffbc00a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc00a9920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009e80 tx=0x7ffbb801c950 comp rx=0 tx=0).stop 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/1372406588 shutdown_connections 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc00a9920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/1372406588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c30d0 0x7ffbc00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.924+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/1372406588 >> 172.21.15.81:0/1372406588 conn(0x7ffbc00c4cc0 msgr2=0x7ffbc00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/1372406588 shutdown_connections 2024-05-08T20:52:13.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/1372406588 wait complete. 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 Processor -- start 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- start start 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc014d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c2bc0 0x7ffbc014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 0x7ffbc00abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc013d8c0 con 0x7ffbc00c30d0 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc014ad70 con 0x7ffbc00a94b0 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc7bdd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc014b050 con 0x7ffbc00c2bc0 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 0x7ffbc00abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 0x7ffbc00abb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37152/0 (socket says 172.21.15.81:37152) 2024-05-08T20:52:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 learned_addr learned my addr 172.21.15.81:0/757462370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc5979640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc014d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c2bc0 msgr2=0x7ffbc014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc00c2bc0 0x7ffbc014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 msgr2=0x7ffbc014d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc00a94b0 0x7ffbc014d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8009b30 con 0x7ffbc00c30d0 2024-05-08T20:52:13.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbc617a640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 0x7ffbc00abb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffbb801a580 tx=0x7ffbb80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.928+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80b8670 con 0x7ffbc00c30d0 2024-05-08T20:52:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80b8810 con 0x7ffbc00c30d0 2024-05-08T20:52:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80b8bc0 con 0x7ffbc00c30d0 2024-05-08T20:52:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc00ab340 con 0x7ffbc00c30d0 2024-05-08T20:52:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc0140100 con 0x7ffbc00c30d0 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 0x7ffbc014a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0073ea0 con 0x7ffbc014a320 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffbb80b8d20 con 0x7ffbc00c30d0 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc5979640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 0x7ffbc014a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffba4066690 0x7ffba4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ffbb811fc10 con 0x7ffbc00c30d0 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc5178640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffba4066690 0x7ffba4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc5979640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbc00c4970 con 0x7ffbc014a320 2024-05-08T20:52:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc5178640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffba4066690 0x7ffba4068b50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffbc006deb0 tx=0x7ffbbc0079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbc5979640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 0x7ffbc014a700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e7a0 tx=0x7ffbb000ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.932+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00093d0 con 0x7ffbc014a320 2024-05-08T20:52:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.936+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ffbb000c7a0 con 0x7ffbc014a320 2024-05-08T20:52:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.936+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 msgr2=0x7ffbc014a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.936+0000 7ffbb67fc640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 0x7ffbc014a700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e7a0 tx=0x7ffbb000ec60 comp rx=0 tx=0).stop 2024-05-08T20:52:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.936+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 msgr2=0x7ffbc014a700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.936+0000 7ffbb67fc640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc014a320 0x7ffbc014a700 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e7a0 tx=0x7ffbb000ec60 comp rx=0 tx=0).stop 2024-05-08T20:52:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 0x7ffbc0142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc00ab4d0 con 0x7ffbc0142930 2024-05-08T20:52:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc5979640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 0x7ffbc0142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc5979640 1 -- 172.21.15.81:0/757462370 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ffbc00ab1a0 con 0x7ffbc0142930 2024-05-08T20:52:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc5979640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 0x7ffbc0142d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e7a0 tx=0x7ffbb0004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0023070 con 0x7ffbc0142930 2024-05-08T20:52:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4637 (secure 0 0 0) 0x7ffbb00063d0 con 0x7ffbc0142930 2024-05-08T20:52:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 msgr2=0x7ffbc0142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 0x7ffbc0142d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e7a0 tx=0x7ffbb0004740 comp rx=0 tx=0).stop 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 msgr2=0x7ffbc0142d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbb67fc640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc0142930 0x7ffbc0142d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:13.949 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:13.952 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:13.953 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:13.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:13.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.959 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:13.960 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffba4066690 msgr2=0x7ffba4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffba4066690 0x7ffba4068b50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffbc006deb0 tx=0x7ffbbc0079d0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 msgr2=0x7ffbc00abb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 --2- 172.21.15.81:0/757462370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc00c30d0 0x7ffbc00abb40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffbb801a580 tx=0x7ffbb80196f0 comp rx=0 tx=0).stop 2024-05-08T20:52:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 reap_dead start 2024-05-08T20:52:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc617a640 1 -- 172.21.15.81:0/757462370 reap_dead start 2024-05-08T20:52:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 shutdown_connections 2024-05-08T20:52:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 >> 172.21.15.81:0/757462370 conn(0x7ffbc00c4cc0 msgr2=0x7ffbc006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 shutdown_connections 2024-05-08T20:52:13.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:13.944+0000 7ffbc7bdd640 1 -- 172.21.15.81:0/757462370 wait complete. 2024-05-08T20:52:13.965 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:13.965 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:52:13.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:52:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 Processor -- start 2024-05-08T20:52:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 -- start start 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafcc1519d0 0x7fafcc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0c3a50 con 0x7fafcc070c00 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc072940 con 0x7fafcc1519d0 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd2a86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0705e0 con 0x7fafcc06b230 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd1023640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fafcc1519d0 0x7fafcc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:33696/0 (socket says 172.21.15.81:33696) 2024-05-08T20:52:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 -- 172.21.15.81:0/536712489 learned_addr learned my addr 172.21.15.81:0/536712489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 -- 172.21.15.81:0/536712489 >> v2:172.21.15.117:3300/0 conn(0x7fafcc1519d0 msgr2=0x7fafcc151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 --2- 172.21.15.81:0/536712489 >> v2:172.21.15.117:3300/0 conn(0x7fafcc1519d0 0x7fafcc151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 -- 172.21.15.81:0/536712489 >> v1:172.21.15.117:6789/0 conn(0x7fafcc070c00 legacy=0x7fafcc14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.116+0000 7fafd0822640 1 -- 172.21.15.81:0/536712489 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0708c0 con 0x7fafcc06b230 2024-05-08T20:52:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd0822640 1 --2- 172.21.15.81:0/536712489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009870 tx=0x7fafc001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be029ea743f46303 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafcb7fe640 1 -- 172.21.15.81:0/536712489 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00aa430 con 0x7fafcc06b230 2024-05-08T20:52:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafcb7fe640 1 -- 172.21.15.81:0/536712489 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc00aa590 con 0x7fafcc06b230 2024-05-08T20:52:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafcb7fe640 1 -- 172.21.15.81:0/536712489 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00aa920 con 0x7fafcc06b230 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- 172.21.15.81:0/536712489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 msgr2=0x7fafcc0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 --2- 172.21.15.81:0/536712489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009870 tx=0x7fafc001c4d0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- 172.21.15.81:0/536712489 shutdown_connections 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 --2- 172.21.15.81:0/536712489 >> v2:172.21.15.117:3300/0 conn(0x7fafcc1519d0 0x7fafcc151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 --2- 172.21.15.81:0/536712489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc06b230 0x7fafcc0c2800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- 172.21.15.81:0/536712489 >> 172.21.15.81:0/536712489 conn(0x7fafcc0c71b0 msgr2=0x7fafcc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- 172.21.15.81:0/536712489 shutdown_connections 2024-05-08T20:52:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- 172.21.15.81:0/536712489 wait complete. 2024-05-08T20:52:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 Processor -- start 2024-05-08T20:52:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.120+0000 7fafd2a86640 1 -- start start 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc070c00 0x7fafcc0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafcc1519d0 0x7fafcc147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1ef590 con 0x7fafcc06b230 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1ecc30 con 0x7fafcc1519d0 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd2a86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0c5a90 con 0x7fafcc070c00 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37154/0 (socket says 172.21.15.81:37154) 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 -- 172.21.15.81:0/2974915704 learned_addr learned my addr 172.21.15.81:0/2974915704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd1023640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafcc1519d0 0x7fafcc147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafcbfff640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc070c00 0x7fafcc0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc070c00 msgr2=0x7fafcc0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc070c00 0x7fafcc0c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafcc1519d0 msgr2=0x7fafcc147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafcc1519d0 0x7fafcc147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.124+0000 7fafd0822640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00094d0 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafd0822640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ac040 tx=0x7fafc001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00aa430 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc00b3820 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc150300 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00b3bd0 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc1ec8c0 con 0x7fafcc06b230 2024-05-08T20:52:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafb6ffd640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 0x7fafcc148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.132+0000 7fafb6ffd640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc069550 con 0x7fafcc14fe00 2024-05-08T20:52:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafcbfff640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 0x7fafcc148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafc00b3d30 con 0x7fafcc06b230 2024-05-08T20:52:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafcbfff640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafcc15e8a0 con 0x7fafcc14fe00 2024-05-08T20:52:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafc97fa640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fafb0066690 0x7fafb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fafc011ec60 con 0x7fafcc06b230 2024-05-08T20:52:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafcbfff640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 0x7fafcc148030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafcc15ad60 tx=0x7fafb800fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.136+0000 7fafd1023640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fafb0066690 0x7fafb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafd1023640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fafb0066690 0x7fafb0068b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fafc4011340 tx=0x7fafc400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80050d0 con 0x7fafcc14fe00 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fafb8005230 con 0x7fafcc14fe00 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 msgr2=0x7fafcc148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 0x7fafcc148030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fafcc15ad60 tx=0x7fafb800fc00 comp rx=0 tx=0).stop 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 msgr2=0x7fafcc148030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.140+0000 7fafc97fa640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc14fe00 0x7fafcc148030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafd2a86640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 0x7fafcc1f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1ecda0 con 0x7fafcc1ed860 2024-05-08T20:52:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafcbfff640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 0x7fafcc1f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafcbfff640 1 -- 172.21.15.81:0/2974915704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fafcc14e350 con 0x7fafcc1ed860 2024-05-08T20:52:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafcbfff640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 0x7fafcc1f9090 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fafb8017000 tx=0x7fafb8001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8027070 con 0x7fafcc1ed860 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fafb8003b40 con 0x7fafcc1ed860 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 msgr2=0x7fafcc1f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 0x7fafcc1f9090 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fafb8017000 tx=0x7fafb8001130 comp rx=0 tx=0).stop 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 msgr2=0x7fafcc1f9090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.172+0000 7fafc97fa640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fafcc1ed860 0x7fafcc1f9090 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fafb8017000 tx=0x7fafb8001130 comp rx=0 tx=0).stop 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:14.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 192, 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 14, 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:14.178 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:14.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:14.180 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:14.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:14.182 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.185 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:14.187 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:14.188 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:14.189 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fafb0066690 msgr2=0x7fafb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fafb0066690 0x7fafb0068b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fafc4011340 tx=0x7fafc400b040 comp rx=0 tx=0).stop 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 msgr2=0x7fafcc1ef050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd1023640 1 -- 172.21.15.81:0/2974915704 reap_dead start 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ac040 tx=0x7fafc001ad10 comp rx=0 tx=0).stop 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 shutdown_connections 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 --2- 172.21.15.81:0/2974915704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc06b230 0x7fafcc1ef050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 >> 172.21.15.81:0/2974915704 conn(0x7fafcc0c71b0 msgr2=0x7fafcc0c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 shutdown_connections 2024-05-08T20:52:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:14.176+0000 7fafd2a86640 1 -- 172.21.15.81:0/2974915704 wait complete. 2024-05-08T20:52:14.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:52:14.214 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:52:14.214 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-05-08T20:52:14.214 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:52:14.214 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:52:14.215 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:52:14.215 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:52:14.234 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:52:14.235 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-05-08T20:52:14.235 INFO:tasks.ceph.mon.a:Sent signal 19 2024-05-08T20:52:14.235 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:52:27.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:52:27.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:52:29.236 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-05-08T20:52:29.236 INFO:tasks.ceph.mon.a:Sent signal 18 2024-05-08T20:52:29.236 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:52:29.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:52:29.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.380+0000 7fcfe6313640 1 Processor -- start 2024-05-08T20:52:29.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.380+0000 7fcfe6313640 1 -- start start 2024-05-08T20:52:29.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe6313640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe6313640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe0155e10 con 0x7fcfe00c2bc0 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe6313640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe0156080 con 0x7fcfe00c30d0 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe6313640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006e790 con 0x7fcfe00a9bc0 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfdffff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fcfe00c30d0 legacy=0x7fcfe00c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe48b0640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfe00c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfe48b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:29.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfdf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcfe00c2bc0 0x7fcfe00a94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46986/0 (socket says 172.21.15.81:46986) 2024-05-08T20:52:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.384+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 learned_addr learned my addr 172.21.15.81:0/3096240392 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.588+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v1:172.21.15.117:6789/0 conn(0x7fcfe00c30d0 legacy=0x7fcfe00c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.588+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfe00c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.588+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:52:29.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.992+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v1:172.21.15.117:6789/0 conn(0x7fcfe00c30d0 legacy=0x7fcfe00c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.992+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfe00c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:29.992+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:52:30.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:30.796+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfe00c34b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:30.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:30.796+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:52:30.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:30.796+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v1:172.21.15.117:6789/0 conn(0x7fcfe00c30d0 legacy=0x7fcfe00c4120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfe00c34b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfe00c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 >> v1:172.21.15.117:6789/0 conn(0x7fcfe00c30d0 legacy=0x7fcfe00c4120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 >> v1:172.21.15.81:6789/0 conn(0x7fcfe00c2bc0 legacy=0x7fcfe00a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006e790 con 0x7fcfcc0036d0 2024-05-08T20:52:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc008d30 con 0x7fcfcc006140 2024-05-08T20:52:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.384+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:32.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:52:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.588+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:52:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:52:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:32.992+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:52:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:52:33.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:33.796+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:52:35.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 msgr2=0x7fcfcc008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:35.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc006140 0x7fcfcc008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 msgr2=0x7fcfcc005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:35.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc0036d0 0x7fcfcc005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 reap_dead start 2024-05-08T20:52:35.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfcc00b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc0065f0 0x7fcfcc003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc003ff0 0x7fcfcc004470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006e790 con 0x7fcfcc003ff0 2024-05-08T20:52:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc008d30 con 0x7fcfe00a9bc0 2024-05-08T20:52:35.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfddffb640 1 -- 172.21.15.81:0/3096240392 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc004bb0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfdffff640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfcc00b100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfdffff640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfcc00b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:35.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.81:3300/0 conn(0x7fcfcc003ff0 0x7fcfcc004470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc0065f0 0x7fcfcc003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc0065f0 msgr2=0x7fcfcc003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc0065f0 0x7fcfcc003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 msgr2=0x7fcfcc00b100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfcc00b100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.384+0000 7fcfe48b0640 1 -- 172.21.15.81:0/3096240392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0156360 con 0x7fcfcc003ff0 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe48b0640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc003ff0 0x7fcfcc004470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcfe006fe40 tx=0x7fcfd801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5853472a257eb2fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfdeffd640 1 -- 172.21.15.81:0/3096240392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80a57c0 con 0x7fcfcc003ff0 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfdeffd640 1 -- 172.21.15.81:0/3096240392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80a5940 con 0x7fcfcc003ff0 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfdeffd640 1 -- 172.21.15.81:0/3096240392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80a5cf0 con 0x7fcfcc003ff0 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 -- 172.21.15.81:0/3096240392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc003ff0 msgr2=0x7fcfcc004470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc003ff0 0x7fcfcc004470 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcfe006fe40 tx=0x7fcfd801c800 comp rx=0 tx=0).stop 2024-05-08T20:52:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 -- 172.21.15.81:0/3096240392 shutdown_connections 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc0065f0 0x7fcfcc003ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 --2- 172.21.15.81:0/3096240392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc003ff0 0x7fcfcc004470 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 --2- 172.21.15.81:0/3096240392 >> v2:172.21.15.117:3300/0 conn(0x7fcfe00a9bc0 0x7fcfcc00b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 -- 172.21.15.81:0/3096240392 >> 172.21.15.81:0/3096240392 conn(0x7fcfe00c4cc0 msgr2=0x7fcfe00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 -- 172.21.15.81:0/3096240392 shutdown_connections 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.388+0000 7fcfe6313640 1 -- 172.21.15.81:0/3096240392 wait complete. 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 Processor -- start 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- start start 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003ff0 0x7fcfe00aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 0x7fcfe01513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01eb8d0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0142420 con 0x7fcfe00a9bc0 2024-05-08T20:52:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01535b0 con 0x7fcfcc003ff0 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe48b0640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 msgr2=0x7fcfe01513c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe48b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 0x7fcfe01513c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40888/0 (socket says 172.21.15.81:40888) 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/1982497027 learned_addr learned my addr 172.21.15.81:0/1982497027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdffff640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003ff0 0x7fcfe00aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003ff0 msgr2=0x7fcfe00aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003ff0 0x7fcfe00aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 msgr2=0x7fcfe01513c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 0x7fcfe01513c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 -- 172.21.15.81:0/1982497027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009910 con 0x7fcfcc0065f0 2024-05-08T20:52:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdf7fe640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0001520 tx=0x7fcfd0001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0005d50 con 0x7fcfcc0065f0 2024-05-08T20:52:35.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00047f0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0004b80 con 0x7fcfcc0065f0 2024-05-08T20:52:35.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe01426a0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.392+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe01e8d70 con 0x7fcfcc0065f0 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe01eba40 con 0x7fcfcc0065f0 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcfd0004ce0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfdcff9640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 0x7fcfcc06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfdffff640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 0x7fcfcc06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcfd001d020 con 0x7fcfcc0065f0 2024-05-08T20:52:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.396+0000 7fcfdffff640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 0x7fcfcc06ced0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4003940 tx=0x7fcfd400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.400+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcfd0052290 con 0x7fcfcc0065f0 2024-05-08T20:52:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.724+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcfe0074950 con 0x7fcfcc0065f0 2024-05-08T20:52:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.724+0000 7fcfdcff9640 1 -- 172.21.15.81:0/1982497027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fcfd00558b0 con 0x7fcfcc0065f0 2024-05-08T20:52:35.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":196,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:52:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 msgr2=0x7fcfcc06ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 0x7fcfcc06ced0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4003940 tx=0x7fcfd400d040 comp rx=0 tx=0).stop 2024-05-08T20:52:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 msgr2=0x7fcfe01ebd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0001520 tx=0x7fcfd0001920 comp rx=0 tx=0).stop 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 shutdown_connections 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcfcc06aa10 0x7fcfcc06ced0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe00a9bc0 0x7fcfe01513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfcc0065f0 0x7fcfe01ebd60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 --2- 172.21.15.81:0/1982497027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003ff0 0x7fcfe00aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.728+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 >> 172.21.15.81:0/1982497027 conn(0x7fcfe00c4cc0 msgr2=0x7fcfe00c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.732+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 shutdown_connections 2024-05-08T20:52:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.732+0000 7fcfe6313640 1 -- 172.21.15.81:0/1982497027 wait complete. 2024-05-08T20:52:35.757 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:52:35.757 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:52:35.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:52:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 Processor -- start 2024-05-08T20:52:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 -- start start 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ecc152220 0x7f5ecc1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc0aac30 0x7f5ecc0c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc155140 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c4780 con 0x7f5ecc152220 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.916+0000 7f5ed193b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c32d0 con 0x7f5ecc0aac30 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5eca7fc640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f5ecc0c26e0 legacy=0x7f5ecc0c2bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ecc152220 0x7f5ecc1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ecc152220 0x7f5ecc1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40896/0 (socket says 172.21.15.81:40896) 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 -- 172.21.15.81:0/1340612159 learned_addr learned my addr 172.21.15.81:0/1340612159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecb7fe640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc0aac30 0x7f5ecc0c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 -- 172.21.15.81:0/1340612159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc0aac30 msgr2=0x7f5ecc0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:52:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc0aac30 0x7f5ecc0c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 -- 172.21.15.81:0/1340612159 >> v1:172.21.15.117:6789/0 conn(0x7f5ecc0c26e0 legacy=0x7f5ecc0c2bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 -- 172.21.15.81:0/1340612159 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc072650 con 0x7f5ecc152220 2024-05-08T20:52:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc152220 0x7f5ecc1555d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009870 tx=0x7f5ebc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efd1774f82a0842 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ec9ffb640 1 -- 172.21.15.81:0/1340612159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0ab620 con 0x7f5ecc152220 2024-05-08T20:52:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ec9ffb640 1 -- 172.21.15.81:0/1340612159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0ab780 con 0x7f5ecc152220 2024-05-08T20:52:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.920+0000 7f5ec9ffb640 1 -- 172.21.15.81:0/1340612159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0abb10 con 0x7f5ecc152220 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- 172.21.15.81:0/1340612159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc152220 msgr2=0x7f5ecc1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc152220 0x7f5ecc1555d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009870 tx=0x7f5ebc01c460 comp rx=0 tx=0).stop 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- 172.21.15.81:0/1340612159 shutdown_connections 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc0aac30 0x7f5ecc0c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- 172.21.15.81:0/1340612159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc152220 0x7f5ecc1555d0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009870 tx=0x7f5ebc01c460 comp rx=0 tx=0).stop 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- 172.21.15.81:0/1340612159 >> 172.21.15.81:0/1340612159 conn(0x7f5ecc0c4cc0 msgr2=0x7f5ecc0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- 172.21.15.81:0/1340612159 shutdown_connections 2024-05-08T20:52:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- 172.21.15.81:0/1340612159 wait complete. 2024-05-08T20:52:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 Processor -- start 2024-05-08T20:52:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- start start 2024-05-08T20:52:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ecc0aac30 0x7f5ecc149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 0x7f5ecc150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc155dd0 0x7f5ecc144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1583e0 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc156370 con 0x7f5ecc0aac30 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ed193b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14ec10 con 0x7f5ecc155dd0 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ecaffd640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ecc0aac30 msgr2=0x7f5ecc149390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ecaffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ecc0aac30 0x7f5ecc149390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5eca7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 0x7f5ecc150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5eca7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 0x7f5ecc150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40900/0 (socket says 172.21.15.81:40900) 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5eca7fc640 1 -- 172.21.15.81:0/3851065337 learned_addr learned my addr 172.21.15.81:0/3851065337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.924+0000 7f5ecb7fe640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc155dd0 0x7f5ecc144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc155dd0 msgr2=0x7f5ecc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ecc155dd0 0x7f5ecc144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ecc0aac30 msgr2=0x7f5ecc149390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:52:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ecc0aac30 0x7f5ecc149390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0094d0 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eca7fc640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 0x7f5ecc150d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000b530 tx=0x7f5ec000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0003dd0 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0005070 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc14eef0 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0005420 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.928+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc151240 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5ed193b640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 0x7f5ecc1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc073ea0 con 0x7f5ecc144ab0 2024-05-08T20:52:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ec0005580 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 0x7f5ecc1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5eb3fff640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5eb8066670 0x7f5eb8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.932+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5ec0084330 con 0x7f5ecc0c26e0 2024-05-08T20:52:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.936+0000 7f5ecb7fe640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5eb8066670 0x7f5eb8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.936+0000 7f5ecaffd640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ecc158e60 con 0x7f5ecc144ab0 2024-05-08T20:52:35.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.936+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 0x7f5ecc1ed790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc066bb0 tx=0x7f5ebc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.936+0000 7f5ecb7fe640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5eb8066670 0x7f5eb8068b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40113e0 tx=0x7f5ec400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0abaf0 con 0x7f5ecc144ab0 2024-05-08T20:52:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5ebc0b8070 con 0x7f5ecc144ab0 2024-05-08T20:52:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 msgr2=0x7f5ecc1ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 0x7f5ecc1ed790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc066bb0 tx=0x7f5ebc01aca0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 msgr2=0x7f5ecc1ed790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:35.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.940+0000 7f5eb3fff640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc144ab0 0x7f5ecc1ed790 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc066bb0 tx=0x7f5ebc01aca0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5ed193b640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 0x7f5ecc1f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14f080 con 0x7f5ecc1edcd0 2024-05-08T20:52:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 0x7f5ecc1f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5ecaffd640 1 -- 172.21.15.81:0/3851065337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5ecc074950 con 0x7f5ecc1edcd0 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5ecaffd640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 0x7f5ecc1f09b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc01cd00 tx=0x7f5ebc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.948+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0beca0 con 0x7f5ecc1edcd0 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f5ebc0bee00 con 0x7f5ecc1edcd0 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 msgr2=0x7f5ecc1f09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5eb3fff640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 0x7f5ecc1f09b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc01cd00 tx=0x7f5ebc009240 comp rx=0 tx=0).stop 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5eb3fff640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 msgr2=0x7f5ecc1f09b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5eb3fff640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc1edcd0 0x7f5ecc1f09b0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc01cd00 tx=0x7f5ebc009240 comp rx=0 tx=0).stop 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 196, 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:35.955 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:35.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:35.957 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:35.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.959 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:35.962 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:35.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:35.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:35.967 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5eb8066670 msgr2=0x7f5eb8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5eb8066670 0x7f5eb8068b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40113e0 tx=0x7f5ec400b040 comp rx=0 tx=0).stop 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 msgr2=0x7f5ecc150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 --2- 172.21.15.81:0/3851065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ecc0c26e0 0x7f5ecc150d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000b530 tx=0x7f5ec000b9f0 comp rx=0 tx=0).stop 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ecb7fe640 1 -- 172.21.15.81:0/3851065337 reap_dead start 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ecb7fe640 1 -- 172.21.15.81:0/3851065337 reap_dead start 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 shutdown_connections 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 >> 172.21.15.81:0/3851065337 conn(0x7f5ecc0c4cc0 msgr2=0x7f5ecc15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 shutdown_connections 2024-05-08T20:52:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:35.952+0000 7f5ed193b640 1 -- 172.21.15.81:0/3851065337 wait complete. 2024-05-08T20:52:35.984 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:52:35.984 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:52:35.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:52:36.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.144+0000 7f023ca28640 1 Processor -- start 2024-05-08T20:52:36.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.144+0000 7f023ca28640 1 -- start start 2024-05-08T20:52:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f023ca28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02380c5900 0x7f02380c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f023ca28640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380c9a30 con 0x7f02380bd9c0 2024-05-08T20:52:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f023ca28640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02380c5000 con 0x7f02380afb60 2024-05-08T20:52:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f023ca28640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380c9d10 con 0x7f02380c5900 2024-05-08T20:52:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f023659c640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f02380afb60 legacy=0x7f02381591c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f0235d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f02380bd9c0 0x7f02381598d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46988/0 (socket says 172.21.15.81:46988) 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f0235d9b640 1 -- 172.21.15.81:0/1975788143 learned_addr learned my addr 172.21.15.81:0/1975788143 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f0236d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02380c5900 0x7f02380c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.148+0000 7f0236d9d640 1 -- 172.21.15.81:0/1975788143 >> v1:172.21.15.117:6789/0 conn(0x7f02380afb60 legacy=0x7f02381591c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f0236d9d640 1 -- 172.21.15.81:0/1975788143 >> v1:172.21.15.81:6789/0 conn(0x7f02380bd9c0 legacy=0x7f02381598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f0236d9d640 1 -- 172.21.15.81:0/1975788143 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380c52e0 con 0x7f02380c5900 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1975788143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380c5900 0x7f02380c5d70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097c0 tx=0x7f022c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22684e285225b627 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023559a640 1 -- 172.21.15.81:0/1975788143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0ab600 con 0x7f02380c5900 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023559a640 1 -- 172.21.15.81:0/1975788143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c0a7050 con 0x7f02380c5900 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023559a640 1 -- 172.21.15.81:0/1975788143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0ab9c0 con 0x7f02380c5900 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023ca28640 1 -- 172.21.15.81:0/1975788143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380c5900 msgr2=0x7f02380c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023ca28640 1 --2- 172.21.15.81:0/1975788143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380c5900 0x7f02380c5d70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097c0 tx=0x7f022c01c360 comp rx=0 tx=0).stop 2024-05-08T20:52:36.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023ca28640 1 -- 172.21.15.81:0/1975788143 shutdown_connections 2024-05-08T20:52:36.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023ca28640 1 --2- 172.21.15.81:0/1975788143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380c5900 0x7f02380c5d70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.152+0000 7f023ca28640 1 -- 172.21.15.81:0/1975788143 >> 172.21.15.81:0/1975788143 conn(0x7f02380abe20 msgr2=0x7f02380ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- 172.21.15.81:0/1975788143 shutdown_connections 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- 172.21.15.81:0/1975788143 wait complete. 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 Processor -- start 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- start start 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380bd9c0 0x7f023814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380c5900 0x7f023808b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c56c0 con 0x7f02380afb60 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c3e20 con 0x7f02380c5900 2024-05-08T20:52:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c0d40 con 0x7f02380bd9c0 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40936/0 (socket says 172.21.15.81:40936) 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 -- 172.21.15.81:0/1867088305 learned_addr learned my addr 172.21.15.81:0/1867088305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0236d9d640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380c5900 msgr2=0x7f023808b2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380c5900 0x7f023808b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0235d9b640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380bd9c0 0x7f023814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380bd9c0 msgr2=0x7f023814bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380bd9c0 0x7f023814bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380c5900 msgr2=0x7f023808b2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380c5900 0x7f023808b2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c009420 con 0x7f02380afb60 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023659c640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f023000b530 tx=0x7f023000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230003dd0 con 0x7f02380afb60 2024-05-08T20:52:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230005070 con 0x7f02380afb60 2024-05-08T20:52:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230005420 con 0x7f02380afb60 2024-05-08T20:52:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c36b0 con 0x7f02380afb60 2024-05-08T20:52:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.156+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023814c440 con 0x7f02380afb60 2024-05-08T20:52:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.160+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0230005580 con 0x7f02380afb60 2024-05-08T20:52:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.160+0000 7f0226ffd640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0218066640 0x7f0218068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.160+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f02300843a0 con 0x7f02380afb60 2024-05-08T20:52:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.164+0000 7f0235d9b640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0218066640 0x7f0218068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.164+0000 7f023ca28640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 0x7f02380bf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.164+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0238069550 con 0x7f02380c3960 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.164+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 0x7f02380bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.164+0000 7f0236d9d640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02380675e0 con 0x7f02380c3960 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 0x7f02380bf890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f02380acf20 tx=0x7f022c01aba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c004220 con 0x7f02380c3960 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f02380ca1c0 con 0x7f02380c3960 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 msgr2=0x7f02380bf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 0x7f02380bf890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f02380acf20 tx=0x7f022c01aba0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0235d9b640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0218066640 0x7f0218068b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f02280017e0 tx=0x7f0228009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 msgr2=0x7f02380bf890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.168+0000 7f0226ffd640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c3960 0x7f02380bf890 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f02380acf20 tx=0x7f022c01aba0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.176+0000 7f023ca28640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 0x7f02380bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:52:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.176+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0238074950 con 0x7f023808bb70 2024-05-08T20:52:36.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.176+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 0x7f02380bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:52:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0236d9d640 1 -- 172.21.15.81:0/1867088305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0238156ec0 con 0x7f023808bb70 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0236d9d640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 0x7f02380bfdd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f022c019f90 tx=0x7f022c019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0b59b0 con 0x7f023808bb70 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4455 (secure 0 0 0) 0x7f022c000e90 con 0x7f023808bb70 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 msgr2=0x7f02380bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 0x7f02380bfdd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f022c019f90 tx=0x7f022c019100 comp rx=0 tx=0).stop 2024-05-08T20:52:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 msgr2=0x7f02380bfdd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.180+0000 7f0226ffd640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f023808bb70 0x7f02380bfdd0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f022c019f90 tx=0x7f022c019100 comp rx=0 tx=0).stop 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 196, 2024-05-08T20:52:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:52:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:52:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:52:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:52:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:52:36.197 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0218066640 msgr2=0x7f0218068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0218066640 0x7f0218068b00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f02280017e0 tx=0x7f0228009040 comp rx=0 tx=0).stop 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 msgr2=0x7f023814b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f023000b530 tx=0x7f023000b9f0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f0236d9d640 1 -- 172.21.15.81:0/1867088305 reap_dead start 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 shutdown_connections 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 --2- 172.21.15.81:0/1867088305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02380afb60 0x7f023814b890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 >> 172.21.15.81:0/1867088305 conn(0x7f02380abe20 msgr2=0x7f0238158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 shutdown_connections 2024-05-08T20:52:36.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:52:36.184+0000 7f023ca28640 1 -- 172.21.15.81:0/1867088305 wait complete. 2024-05-08T20:52:36.205 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:52:36.205 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:52:56.206 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:52:56.206 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:52:56.206 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:52:56.206 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:52:56.209 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:52:56.209 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-05-08T20:52:56.210 INFO:tasks.ceph.mon.a:Sent signal 19 2024-05-08T20:52:56.210 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-05-08T20:52:58.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:52:58.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:11.211 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-05-08T20:53:11.212 INFO:tasks.ceph.mon.a:Sent signal 18 2024-05-08T20:53:11.212 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:53:11.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 Processor -- start 2024-05-08T20:53:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 -- start start 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff98154cf0 0x7eff98155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff981522e0 con 0x7eff98155690 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980c5f80 con 0x7eff98151f00 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff9d9ec640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9806bb20 con 0x7eff98154cf0 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff8ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff98154cf0 0x7eff98155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff977fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7eff98155690 0x7eff980ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46644/0 (socket says 172.21.15.81:46644) 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff977fe640 1 -- 172.21.15.81:0/2273397181 learned_addr learned my addr 172.21.15.81:0/2273397181 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.355+0000 7eff8ffff640 1 --2- 172.21.15.81:0/2273397181 >> v2:172.21.15.81:3300/0 conn(0x7eff98154cf0 0x7eff98155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2024-05-08T20:53:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff8ffff640 1 -- 172.21.15.81:0/2273397181 >> v1:172.21.15.117:6789/0 conn(0x7eff98151f00 legacy=0x7eff981588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff8ffff640 1 -- 172.21.15.81:0/2273397181 >> v1:172.21.15.81:6789/0 conn(0x7eff98155690 legacy=0x7eff980ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff8ffff640 1 -- 172.21.15.81:0/2273397181 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980c6260 con 0x7eff98154cf0 2024-05-08T20:53:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff967fc640 1 -- 172.21.15.81:0/2273397181 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409554996 0 0) 0x7eff981522e0 con 0x7eff98155690 2024-05-08T20:53:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff8ffff640 1 --2- 172.21.15.81:0/2273397181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98154cf0 0x7eff98155150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff800097c0 tx=0x7eff8001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dae748cda133e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff967fc640 1 -- 172.21.15.81:0/2273397181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff800ad660 con 0x7eff98154cf0 2024-05-08T20:53:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff967fc640 1 -- 172.21.15.81:0/2273397181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff800ad7c0 con 0x7eff98154cf0 2024-05-08T20:53:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff967fc640 1 -- 172.21.15.81:0/2273397181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff800adb50 con 0x7eff98154cf0 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 -- 172.21.15.81:0/2273397181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98154cf0 msgr2=0x7eff98155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/2273397181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98154cf0 0x7eff98155150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff800097c0 tx=0x7eff8001c340 comp rx=0 tx=0).stop 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 -- 172.21.15.81:0/2273397181 shutdown_connections 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/2273397181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98154cf0 0x7eff98155150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 -- 172.21.15.81:0/2273397181 >> 172.21.15.81:0/2273397181 conn(0x7eff980715f0 msgr2=0x7eff98071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 -- 172.21.15.81:0/2273397181 shutdown_connections 2024-05-08T20:53:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.359+0000 7eff9d9ec640 1 -- 172.21.15.81:0/2273397181 wait complete. 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 Processor -- start 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 -- start start 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff98154cf0 0x7eff98155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98156320 0x7eff981f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff98158300 con 0x7eff98156320 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9814c2a0 con 0x7eff98154cf0 2024-05-08T20:53:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff9d9ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9814c4b0 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:42238/0 (socket says 172.21.15.81:42238) 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 -- 172.21.15.81:0/1966181545 learned_addr learned my addr 172.21.15.81:0/1966181545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 -- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff98154cf0 msgr2=0x7eff98155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff98154cf0 0x7eff98155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 -- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98156320 msgr2=0x7eff981f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.363+0000 7eff96ffd640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98156320 0x7eff981f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.367+0000 7eff96ffd640 1 -- 172.21.15.81:0/1966181545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80009420 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.367+0000 7eff96ffd640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c490 tx=0x7eff88001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.371+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88003600 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.371+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88003780 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.371+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9814c750 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.371+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff980aed20 con 0x7eff98151f00 2024-05-08T20:53:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.371+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88003b70 con 0x7eff98151f00 2024-05-08T20:53:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.375+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff88003cd0 con 0x7eff98151f00 2024-05-08T20:53:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.375+0000 7eff94ff9640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 0x7eff78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.375+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7eff880837c0 con 0x7eff98151f00 2024-05-08T20:53:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.375+0000 7eff8ffff640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 0x7eff78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.375+0000 7eff8ffff640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 0x7eff78068b80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7eff800af000 tx=0x7eff80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.379+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c005260 con 0x7eff98151f00 2024-05-08T20:53:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.403+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7eff88050740 con 0x7eff98151f00 2024-05-08T20:53:11.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.723+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7eff7c005a90 con 0x7eff98151f00 2024-05-08T20:53:11.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.723+0000 7eff94ff9640 1 -- 172.21.15.81:0/1966181545 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7eff88017070 con 0x7eff98151f00 2024-05-08T20:53:11.727 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":200,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 msgr2=0x7eff78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 0x7eff78068b80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7eff800af000 tx=0x7eff80008040 comp rx=0 tx=0).stop 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 msgr2=0x7eff980ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c490 tx=0x7eff88001e80 comp rx=0 tx=0).stop 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 shutdown_connections 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7eff780666c0 0x7eff78068b80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff98156320 0x7eff981f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff98154cf0 0x7eff98155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 --2- 172.21.15.81:0/1966181545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff98151f00 0x7eff980ae7e0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c490 tx=0x7eff88001e80 comp rx=0 tx=0).stop 2024-05-08T20:53:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.727+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 >> 172.21.15.81:0/1966181545 conn(0x7eff980715f0 msgr2=0x7eff980c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.731+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 shutdown_connections 2024-05-08T20:53:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.731+0000 7eff9d9ec640 1 -- 172.21.15.81:0/1966181545 wait complete. 2024-05-08T20:53:11.754 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:53:11.755 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:53:11.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:53:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 Processor -- start 2024-05-08T20:53:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 -- start start 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff55406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff554155e90 0x7ff554069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 0x7ff55406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5541528a0 con 0x7ff554155e90 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff554152ab0 con 0x7ff55406d7d0 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff55b118640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff554152d90 con 0x7ff55414fe70 2024-05-08T20:53:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff554155e90 0x7ff554069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff554155e90 0x7ff554069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36856/0 (socket says 172.21.15.81:36856) 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 -- 172.21.15.81:0/44566697 learned_addr learned my addr 172.21.15.81:0/44566697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff558eb4640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff55406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff5596b5640 1 --2- 172.21.15.81:0/44566697 >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 0x7ff55406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 -- 172.21.15.81:0/44566697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 msgr2=0x7ff55406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff55406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 -- 172.21.15.81:0/44566697 >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 msgr2=0x7ff55406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 --2- 172.21.15.81:0/44566697 >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 0x7ff55406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff553fff640 1 -- 172.21.15.81:0/44566697 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554153070 con 0x7ff554155e90 2024-05-08T20:53:11.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.899+0000 7ff5596b5640 1 --2- 172.21.15.81:0/44566697 >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 0x7ff55406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:53:11.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.907+0000 7ff553fff640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff554155e90 0x7ff554069fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff5540669d0 tx=0x7ff54801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0595b2893b116 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.907+0000 7ff5537fe640 1 -- 172.21.15.81:0/44566697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480ad640 con 0x7ff554155e90 2024-05-08T20:53:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.907+0000 7ff5537fe640 1 -- 172.21.15.81:0/44566697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480ad7a0 con 0x7ff554155e90 2024-05-08T20:53:11.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.907+0000 7ff5537fe640 1 -- 172.21.15.81:0/44566697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480adb30 con 0x7ff554155e90 2024-05-08T20:53:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 -- 172.21.15.81:0/44566697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff554155e90 msgr2=0x7ff554069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff554155e90 0x7ff554069fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff5540669d0 tx=0x7ff54801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 -- 172.21.15.81:0/44566697 shutdown_connections 2024-05-08T20:53:11.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 --2- 172.21.15.81:0/44566697 >> v2:172.21.15.117:3300/0 conn(0x7ff55406d7d0 0x7ff55406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff554155e90 0x7ff554069fc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 --2- 172.21.15.81:0/44566697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff55406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 -- 172.21.15.81:0/44566697 >> 172.21.15.81:0/44566697 conn(0x7ff5540c71b0 msgr2=0x7ff5540c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 -- 172.21.15.81:0/44566697 shutdown_connections 2024-05-08T20:53:11.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.911+0000 7ff55b118640 1 -- 172.21.15.81:0/44566697 wait complete. 2024-05-08T20:53:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 Processor -- start 2024-05-08T20:53:11.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 -- start start 2024-05-08T20:53:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 0x7ff55414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff554148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff554155e90 0x7ff5540c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540acef0 con 0x7ff55406d7d0 2024-05-08T20:53:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55414aa70 con 0x7ff554155e90 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff55b118640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55414af60 con 0x7ff55414fe70 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff558eb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 0x7ff55414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff558eb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 0x7ff55414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36858/0 (socket says 172.21.15.81:36858) 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff558eb4640 1 -- 172.21.15.81:0/4010165687 learned_addr learned my addr 172.21.15.81:0/4010165687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.915+0000 7ff5596b5640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff554155e90 0x7ff5540c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 msgr2=0x7ff554148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff55414fe70 0x7ff554148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff554155e90 msgr2=0x7ff5540c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff554155e90 0x7ff5540c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480094d0 con 0x7ff55406d7d0 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff558eb4640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 0x7ff55414a530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e870 tx=0x7ff54000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540009510 con 0x7ff55406d7d0 2024-05-08T20:53:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000eec0 con 0x7ff55406d7d0 2024-05-08T20:53:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000cb40 con 0x7ff55406d7d0 2024-05-08T20:53:11.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5541eea80 con 0x7ff55406d7d0 2024-05-08T20:53:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.919+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55414ac80 con 0x7ff55406d7d0 2024-05-08T20:53:11.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff55b118640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 0x7ff55414d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554069550 con 0x7ff5540c5620 2024-05-08T20:53:11.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff54000cca0 con 0x7ff55406d7d0 2024-05-08T20:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff5517fa640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5380666c0 0x7ff538068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff540084670 con 0x7ff55406d7d0 2024-05-08T20:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.923+0000 7ff5596b5640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5380666c0 0x7ff538068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5596b5640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5380666c0 0x7ff538068b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff55414a100 tx=0x7ff54c0096b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff553fff640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 0x7ff55414d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff553fff640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5540675e0 con 0x7ff5540c5620 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff553fff640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 0x7ff55414d4e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff554072920 tx=0x7ff5480adf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480b6820 con 0x7ff5540c5620 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff5480a6050 con 0x7ff5540c5620 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 msgr2=0x7ff55414d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 0x7ff55414d4e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff554072920 tx=0x7ff5480adf00 comp rx=0 tx=0).stop 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 msgr2=0x7ff55414d4e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.927+0000 7ff5517fa640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5540c5620 0x7ff55414d4e0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff554072920 tx=0x7ff5480adf00 comp rx=0 tx=0).stop 2024-05-08T20:53:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff55b118640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 0x7ff55414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:11.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554072220 con 0x7ff5541eeef0 2024-05-08T20:53:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff553fff640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 0x7ff55414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:11.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff553fff640 1 -- 172.21.15.81:0/4010165687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff554074950 con 0x7ff5541eeef0 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff553fff640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 0x7ff55414da20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c10 tx=0x7ff5480a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480bebb0 con 0x7ff5541eeef0 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7ff548000e90 con 0x7ff5541eeef0 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 msgr2=0x7ff55414da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 0x7ff55414da20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c10 tx=0x7ff5480a7000 comp rx=0 tx=0).stop 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 msgr2=0x7ff55414da20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:11.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.939+0000 7ff5517fa640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541eeef0 0x7ff55414da20 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff548000c10 tx=0x7ff5480a7000 comp rx=0 tx=0).stop 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:11.961 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5380666c0 msgr2=0x7ff538068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5380666c0 0x7ff538068b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff55414a100 tx=0x7ff54c0096b0 comp rx=0 tx=0).stop 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 msgr2=0x7ff55414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 --2- 172.21.15.81:0/4010165687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff55406d7d0 0x7ff55414a530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e870 tx=0x7ff54000ec70 comp rx=0 tx=0).stop 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff5596b5640 1 -- 172.21.15.81:0/4010165687 reap_dead start 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff5596b5640 1 -- 172.21.15.81:0/4010165687 reap_dead start 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 shutdown_connections 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 >> 172.21.15.81:0/4010165687 conn(0x7ff5540c71b0 msgr2=0x7ff5540ab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 shutdown_connections 2024-05-08T20:53:11.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:11.943+0000 7ff55b118640 1 -- 172.21.15.81:0/4010165687 wait complete. 2024-05-08T20:53:11.967 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:11.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:53:11.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:53:12.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 Processor -- start 2024-05-08T20:53:12.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 -- start start 2024-05-08T20:53:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd814fe70 0x7f8bd806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8bd8155e90 0x7f8bd8069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd806d7d0 0x7f8bd806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd81528a0 con 0x7f8bd806d7d0 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd8152ab0 con 0x7f8bd8155e90 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bdd60b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8152d90 con 0x7f8bd814fe70 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bd77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd806d7d0 0x7f8bd806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bd77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd806d7d0 0x7f8bd806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36886/0 (socket says 172.21.15.81:36886) 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1231076482 learned_addr learned my addr 172.21.15.81:0/1231076482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.115+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd814fe70 0x7f8bd806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1231076482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd814fe70 msgr2=0x7f8bd806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd814fe70 0x7f8bd806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1231076482 >> v2:172.21.15.117:3300/0 conn(0x7f8bd8155e90 msgr2=0x7f8bd8069fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:12.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 --2- 172.21.15.81:0/1231076482 >> v2:172.21.15.117:3300/0 conn(0x7f8bd8155e90 0x7f8bd8069fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1231076482 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8153070 con 0x7f8bd806d7d0 2024-05-08T20:53:12.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd77fe640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd806d7d0 0x7f8bd806a500 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8072920 tx=0x7f8bc801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b7ed7fdbb3e060 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd5ffb640 1 -- 172.21.15.81:0/1231076482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80ac410 con 0x7f8bd806d7d0 2024-05-08T20:53:12.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd5ffb640 1 -- 172.21.15.81:0/1231076482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc80ac570 con 0x7f8bd806d7d0 2024-05-08T20:53:12.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.119+0000 7f8bd5ffb640 1 -- 172.21.15.81:0/1231076482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80ac900 con 0x7f8bd806d7d0 2024-05-08T20:53:12.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1231076482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd806d7d0 msgr2=0x7f8bd806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd806d7d0 0x7f8bd806a500 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8072920 tx=0x7f8bc801c3f0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1231076482 shutdown_connections 2024-05-08T20:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd806d7d0 0x7f8bd806a500 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1231076482 >> v2:172.21.15.117:3300/0 conn(0x7f8bd8155e90 0x7f8bd8069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1231076482 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd814fe70 0x7f8bd806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1231076482 >> 172.21.15.81:0/1231076482 conn(0x7f8bd80c71b0 msgr2=0x7f8bd80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1231076482 shutdown_connections 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.123+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1231076482 wait complete. 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 Processor -- start 2024-05-08T20:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 -- start start 2024-05-08T20:53:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd806d7d0 0x7f8bd8147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 0x7f8bd81ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd8155e90 0x7f8bd80c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd80c5910 con 0x7f8bd814fe70 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8149cc0 con 0x7f8bd806d7d0 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8149870 con 0x7f8bd8155e90 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 0x7f8bd81ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 0x7f8bd81ebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36894/0 (socket says 172.21.15.81:36894) 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 -- 172.21.15.81:0/1061411383 learned_addr learned my addr 172.21.15.81:0/1061411383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd8155e90 msgr2=0x7f8bd80c4d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd806d7d0 0x7f8bd8147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bd8155e90 0x7f8bd80c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd806d7d0 msgr2=0x7f8bd8147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd806d7d0 0x7f8bd8147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80094d0 con 0x7f8bd814fe70 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd806d7d0 0x7f8bd8147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bd67fc640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 0x7f8bd81ebb40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b4a0 tx=0x7f8bcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc021610 con 0x7f8bd814fe70 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc021770 con 0x7f8bd814fe70 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd8145ba0 con 0x7f8bd814fe70 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.127+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc021b60 con 0x7f8bd814fe70 2024-05-08T20:53:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd8072220 con 0x7f8bd814fe70 2024-05-08T20:53:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 0x7f8bd81ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8069550 con 0x7f8bd8153c60 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 0x7f8bd81ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8bcc021cc0 con 0x7f8bd814fe70 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bd6ffd640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bd80675e0 con 0x7f8bd8153c60 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 0x7f8bd81ef1f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009f80 tx=0x7f8bd000f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8bc4066690 0x7f8bc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8bcc0946c0 con 0x7f8bd814fe70 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd001a070 con 0x7f8bd8153c60 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8bd00039a0 con 0x7f8bd8153c60 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 msgr2=0x7f8bd81ef1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 0x7f8bd81ef1f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009f80 tx=0x7f8bd000f520 comp rx=0 tx=0).stop 2024-05-08T20:53:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 msgr2=0x7f8bd81ef1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bbf7fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd8153c60 0x7f8bd81ef1f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bd77fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8bc4066690 0x7f8bc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.131+0000 7f8bd77fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8bc4066690 0x7f8bc4068b50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ae000 tx=0x7f8bc80a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.139+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 0x7f8bd8149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.139+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd81499e0 con 0x7f8bd80c52c0 2024-05-08T20:53:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.143+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 0x7f8bd8149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.143+0000 7f8bd6ffd640 1 -- 172.21.15.81:0/1061411383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8bd8074950 con 0x7f8bd80c52c0 2024-05-08T20:53:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.147+0000 7f8bd6ffd640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 0x7f8bd8149e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0019000 tx=0x7f8bd0004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.147+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0004230 con 0x7f8bd80c52c0 2024-05-08T20:53:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f8bd0004390 con 0x7f8bd80c52c0 2024-05-08T20:53:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 msgr2=0x7f8bd8149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bbf7fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 0x7f8bd8149e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0019000 tx=0x7f8bd0004a50 comp rx=0 tx=0).stop 2024-05-08T20:53:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bbf7fe640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 msgr2=0x7f8bd8149e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bbf7fe640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bd80c52c0 0x7f8bd8149e40 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0019000 tx=0x7f8bd0004a50 comp rx=0 tx=0).stop 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:12.154 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.155 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:12.157 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.158 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:12.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.162 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:12.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.164 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:12.165 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8bc4066690 msgr2=0x7f8bc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8bc4066690 0x7f8bc4068b50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ae000 tx=0x7f8bc80a6040 comp rx=0 tx=0).stop 2024-05-08T20:53:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 msgr2=0x7f8bd81ebb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 --2- 172.21.15.81:0/1061411383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd814fe70 0x7f8bd81ebb40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b4a0 tx=0x7f8bcc00b960 comp rx=0 tx=0).stop 2024-05-08T20:53:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1061411383 reap_dead start 2024-05-08T20:53:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bd77fe640 1 -- 172.21.15.81:0/1061411383 reap_dead start 2024-05-08T20:53:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 shutdown_connections 2024-05-08T20:53:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 >> 172.21.15.81:0/1061411383 conn(0x7f8bd80c71b0 msgr2=0x7f8bd81508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 shutdown_connections 2024-05-08T20:53:12.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.151+0000 7f8bdd60b640 1 -- 172.21.15.81:0/1061411383 wait complete. 2024-05-08T20:53:12.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:12.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:53:12.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:53:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 Processor -- start 2024-05-08T20:53:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 -- start start 2024-05-08T20:53:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f565015cdf0 0x7f5650071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500706d0 con 0x7f56500c31a0 2024-05-08T20:53:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56501598f0 con 0x7f5650156430 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f56573f3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5650158df0 con 0x7f565015cdf0 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f565498e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56500c31a0 0x7f5650071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46652/0 (socket says 172.21.15.81:46652) 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f565498e640 1 -- 172.21.15.81:0/433194898 learned_addr learned my addr 172.21.15.81:0/433194898 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5655990640 1 --2- 172.21.15.81:0/433194898 >> v2:172.21.15.117:3300/0 conn(0x7f565015cdf0 0x7f5650071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009613912 0 0) 0x7f5640001120 con 0x7f56500c31a0 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c003530 con 0x7f56500c31a0 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914073947 0 0) 0x7f563c003530 con 0x7f56500c31a0 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5655990640 1 -- 172.21.15.81:0/433194898 >> v1:172.21.15.117:6789/0 conn(0x7f5650156430 legacy=0x7f565006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5655990640 1 -- 172.21.15.81:0/433194898 >> v1:172.21.15.81:6789/0 conn(0x7f56500c31a0 legacy=0x7f5650071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.311+0000 7f5655990640 1 -- 172.21.15.81:0/433194898 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650159000 con 0x7f565015cdf0 2024-05-08T20:53:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.315+0000 7f5655990640 1 --2- 172.21.15.81:0/433194898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f565015cdf0 0x7f5650071c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c2afa9622bee5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.315+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640001810 con 0x7f565015cdf0 2024-05-08T20:53:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480a5530 con 0x7f565015cdf0 2024-05-08T20:53:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f5647fff640 1 -- 172.21.15.81:0/433194898 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480a58a0 con 0x7f565015cdf0 2024-05-08T20:53:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 -- 172.21.15.81:0/433194898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f565015cdf0 msgr2=0x7f5650071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 --2- 172.21.15.81:0/433194898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f565015cdf0 0x7f5650071c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5648009d90 tx=0x7f564801c800 comp rx=0 tx=0).stop 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 -- 172.21.15.81:0/433194898 shutdown_connections 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 --2- 172.21.15.81:0/433194898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f565015cdf0 0x7f5650071c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 -- 172.21.15.81:0/433194898 >> 172.21.15.81:0/433194898 conn(0x7f56500c71b0 msgr2=0x7f56500c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 -- 172.21.15.81:0/433194898 shutdown_connections 2024-05-08T20:53:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.319+0000 7f56573f3640 1 -- 172.21.15.81:0/433194898 wait complete. 2024-05-08T20:53:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 Processor -- start 2024-05-08T20:53:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- start start 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56500c31a0 0x7f56500aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650156430 0x7f565015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 0x7f565015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56501579c0 con 0x7f565015cdf0 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565015a330 con 0x7f56500c31a0 2024-05-08T20:53:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5650157400 con 0x7f5650156430 2024-05-08T20:53:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 0x7f565015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 0x7f565015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36902/0 (socket says 172.21.15.81:36902) 2024-05-08T20:53:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 learned_addr learned my addr 172.21.15.81:0/2024867967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650156430 msgr2=0x7f565015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650156430 0x7f565015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56500c31a0 msgr2=0x7f56500aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56500c31a0 0x7f56500aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009a70 con 0x7f565015cdf0 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5655990640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 0x7f565015bc20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5648019410 tx=0x7f56480195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648009450 con 0x7f565015cdf0 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648004040 con 0x7f565015cdf0 2024-05-08T20:53:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56501576e0 con 0x7f565015cdf0 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480043d0 con 0x7f565015cdf0 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565015b1c0 con 0x7f565015cdf0 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 0x7f56501f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.323+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5650069550 con 0x7f565015c160 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f565518f640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 0x7f56501f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56480b4070 con 0x7f565015cdf0 2024-05-08T20:53:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f565518f640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56500c1810 con 0x7f565015c160 2024-05-08T20:53:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5634066690 0x7f5634068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f564811ed70 con 0x7f565015cdf0 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f565518f640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 0x7f56501f45a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c380 tx=0x7f564c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c005280 con 0x7f565015c160 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f564c0053e0 con 0x7f565015c160 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 msgr2=0x7f56501f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 0x7f56501f45a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c380 tx=0x7f564c00c840 comp rx=0 tx=0).stop 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 msgr2=0x7f56501f45a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.327+0000 7f5645ffb640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f565015c160 0x7f56501f45a0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c380 tx=0x7f564c00c840 comp rx=0 tx=0).stop 2024-05-08T20:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.335+0000 7f565498e640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5634066690 0x7f5634068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f56573f3640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 0x7f56501f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500675e0 con 0x7f5650164320 2024-05-08T20:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f565518f640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 0x7f56501f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f565518f640 1 -- 172.21.15.81:0/2024867967 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f565015b3e0 con 0x7f5650164320 2024-05-08T20:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f565518f640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 0x7f56501f4ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f564c005000 tx=0x7f564c001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f565498e640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5634066690 0x7f5634068b50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5640001ec0 tx=0x7f5640001dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c01e070 con 0x7f5650164320 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f564c007660 con 0x7f5650164320 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 msgr2=0x7f56501f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 0x7f56501f4ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f564c005000 tx=0x7f564c001130 comp rx=0 tx=0).stop 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 msgr2=0x7f56501f4ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.339+0000 7f5645ffb640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5650164320 0x7f56501f4ae0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f564c005000 tx=0x7f564c001130 comp rx=0 tx=0).stop 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:12.345 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.346 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.347 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:12.348 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:12.349 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:12.354 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:12.356 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5634066690 msgr2=0x7f5634068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5634066690 0x7f5634068b50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5640001ec0 tx=0x7f5640001dd0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 msgr2=0x7f565015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 --2- 172.21.15.81:0/2024867967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565015cdf0 0x7f565015bc20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5648019410 tx=0x7f56480195a0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 reap_dead start 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f5655990640 1 -- 172.21.15.81:0/2024867967 reap_dead start 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 shutdown_connections 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.343+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 >> 172.21.15.81:0/2024867967 conn(0x7f56500c71b0 msgr2=0x7f56501584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.347+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 shutdown_connections 2024-05-08T20:53:12.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.347+0000 7f56573f3640 1 -- 172.21.15.81:0/2024867967 wait complete. 2024-05-08T20:53:12.367 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:12.367 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:53:12.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:53:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 Processor -- start 2024-05-08T20:53:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 -- start start 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 0x7f6790069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6790152ab0 con 0x7f679014fe70 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67901528a0 con 0x7f6790155e90 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6796c83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6790152d90 con 0x7f679006a500 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:42316/0 (socket says 172.21.15.81:42316) 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f678ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 0x7f6790069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 -- 172.21.15.81:0/3233925905 learned_addr learned my addr 172.21.15.81:0/3233925905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 -- 172.21.15.81:0/3233925905 >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 msgr2=0x7f6790069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 --2- 172.21.15.81:0/3233925905 >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 0x7f6790069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 -- 172.21.15.81:0/3233925905 >> v1:172.21.15.117:6789/0 conn(0x7f679014fe70 legacy=0x7f679006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.495+0000 7f6795220640 1 -- 172.21.15.81:0/3233925905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790153070 con 0x7f679006a500 2024-05-08T20:53:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.499+0000 7f678ffff640 1 --2- 172.21.15.81:0/3233925905 >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 0x7f6790069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:53:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.499+0000 7f6795220640 1 --2- 172.21.15.81:0/3233925905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e50 tx=0x7f678801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794cf6fa72a35894 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.499+0000 7f678f7fe640 1 -- 172.21.15.81:0/3233925905 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880a57a0 con 0x7f679006a500 2024-05-08T20:53:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.499+0000 7f678f7fe640 1 -- 172.21.15.81:0/3233925905 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880a5900 con 0x7f679006a500 2024-05-08T20:53:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.499+0000 7f678f7fe640 1 -- 172.21.15.81:0/3233925905 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880a5c90 con 0x7f679006a500 2024-05-08T20:53:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 -- 172.21.15.81:0/3233925905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 msgr2=0x7f679015d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 --2- 172.21.15.81:0/3233925905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e50 tx=0x7f678801c8e0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 -- 172.21.15.81:0/3233925905 shutdown_connections 2024-05-08T20:53:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 --2- 172.21.15.81:0/3233925905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f679015d220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 --2- 172.21.15.81:0/3233925905 >> v2:172.21.15.117:3300/0 conn(0x7f6790155e90 0x7f6790069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 -- 172.21.15.81:0/3233925905 >> 172.21.15.81:0/3233925905 conn(0x7f67900c71b0 msgr2=0x7f67900c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.503+0000 7f6796c83640 1 -- 172.21.15.81:0/3233925905 shutdown_connections 2024-05-08T20:53:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 -- 172.21.15.81:0/3233925905 wait complete. 2024-05-08T20:53:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 Processor -- start 2024-05-08T20:53:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 -- start start 2024-05-08T20:53:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f67901edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 0x7f6790141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67901eda90 con 0x7f679014fe70 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790071e40 con 0x7f6790155e90 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6796c83640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6790072120 con 0x7f679006a500 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36906/0 (socket says 172.21.15.81:36906) 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 -- 172.21.15.81:0/2342326717 learned_addr learned my addr 172.21.15.81:0/2342326717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6795220640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 0x7f6790141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 -- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 msgr2=0x7f67901edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f67901edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 -- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 msgr2=0x7f6790141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 0x7f6790141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 -- 172.21.15.81:0/2342326717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c009420 con 0x7f679014fe70 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f6795220640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 0x7f6790141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.507+0000 7f678ffff640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b3f0 tx=0x7f677c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c019070 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c01a480 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788009b30 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c01a7f0 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67901ed3f0 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f677c01a950 con 0x7f679014fe70 2024-05-08T20:53:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 0x7f6774068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f677c08c3d0 con 0x7f679014fe70 2024-05-08T20:53:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.511+0000 7f6794a1f640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 0x7f6774068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.519+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67900675e0 con 0x7f679014fe70 2024-05-08T20:53:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.519+0000 7f6794a1f640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 0x7f6774068ba0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6784000f70 tx=0x7f67840079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.527+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f677c059510 con 0x7f679014fe70 2024-05-08T20:53:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.871+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f6790074950 con 0x7f679014fe70 2024-05-08T20:53:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.871+0000 7f678d7fa640 1 -- 172.21.15.81:0/2342326717 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f677c022070 con 0x7f679014fe70 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 msgr2=0x7f6774068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 0x7f6774068ba0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6784000f70 tx=0x7f67840079c0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 msgr2=0x7f6790153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b3f0 tx=0x7f677c00b8b0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 shutdown_connections 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f67740666e0 0x7f6774068ba0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6790155e90 0x7f6790141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f679014fe70 0x7f6790153c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 --2- 172.21.15.81:0/2342326717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f679006a500 0x7f67901edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 >> 172.21.15.81:0/2342326717 conn(0x7f67900c71b0 msgr2=0x7f679006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 shutdown_connections 2024-05-08T20:53:12.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:12.875+0000 7f6796c83640 1 -- 172.21.15.81:0/2342326717 wait complete. 2024-05-08T20:53:12.901 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:53:22.902 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:53:22.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 Processor -- start 2024-05-08T20:53:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 -- start start 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed481563b0 0x7fed480ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4806b7b0 0x7fed480ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480c67e0 con 0x7fed4815ccd0 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed48156790 con 0x7fed481563b0 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ec86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c5ef0 con 0x7fed4806b7b0 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed481563b0 0x7fed480ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed481563b0 0x7fed480ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:55620/0 (socket says 172.21.15.81:55620) 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 -- 172.21.15.81:0/1954784845 learned_addr learned my addr 172.21.15.81:0/1954784845 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4d223640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fed4815ccd0 0x7fed48158dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:56050/0 (socket says 172.21.15.81:56050) 2024-05-08T20:53:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed47fff640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4806b7b0 0x7fed480ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 -- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4806b7b0 msgr2=0x7fed480ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4806b7b0 0x7fed480ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 -- 172.21.15.81:0/1954784845 >> v1:172.21.15.117:6789/0 conn(0x7fed4815ccd0 legacy=0x7fed48158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.051+0000 7fed4ca22640 1 -- 172.21.15.81:0/1954784845 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480c6190 con 0x7fed481563b0 2024-05-08T20:53:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ca22640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed480ca000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f240a0871c2753 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed477fe640 1 -- 172.21.15.81:0/1954784845 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380aa620 con 0x7fed481563b0 2024-05-08T20:53:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed477fe640 1 -- 172.21.15.81:0/1954784845 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380aa780 con 0x7fed481563b0 2024-05-08T20:53:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed477fe640 1 -- 172.21.15.81:0/1954784845 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380aab10 con 0x7fed481563b0 2024-05-08T20:53:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 -- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 msgr2=0x7fed480ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed480ca000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3801c4a0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 -- 172.21.15.81:0/1954784845 shutdown_connections 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4806b7b0 0x7fed480ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 --2- 172.21.15.81:0/1954784845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed480ca000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 -- 172.21.15.81:0/1954784845 >> 172.21.15.81:0/1954784845 conn(0x7fed480715f0 msgr2=0x7fed48071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 -- 172.21.15.81:0/1954784845 shutdown_connections 2024-05-08T20:53:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.055+0000 7fed4ec86640 1 -- 172.21.15.81:0/1954784845 wait complete. 2024-05-08T20:53:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 Processor -- start 2024-05-08T20:53:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- start start 2024-05-08T20:53:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed4815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4815ccd0 0x7fed481517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480abe80 con 0x7fed4806b7b0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed48150f80 con 0x7fed481563b0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed48151360 con 0x7fed4815ccd0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39248/0 (socket says 172.21.15.81:39248) 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 -- 172.21.15.81:0/2398701532 learned_addr learned my addr 172.21.15.81:0/2398701532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed47fff640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed4815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4d223640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4815ccd0 0x7fed481517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 -- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4815ccd0 msgr2=0x7fed481517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4815ccd0 0x7fed481517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 -- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 msgr2=0x7fed4815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed4815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 -- 172.21.15.81:0/2398701532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380094d0 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed47fff640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed4815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ca22640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fed380ac040 tx=0x7fed3801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380aae80 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380bd3f0 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed480af6c0 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380bd7a0 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed48150ca0 con 0x7fed4806b7b0 2024-05-08T20:53:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48074950 con 0x7fed4806b7b0 2024-05-08T20:53:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.059+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed380bd900 con 0x7fed4806b7b0 2024-05-08T20:53:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.063+0000 7fed457fa640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 0x7fed34068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.063+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fed3811edd0 con 0x7fed4806b7b0 2024-05-08T20:53:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.063+0000 7fed47fff640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 0x7fed34068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.063+0000 7fed47fff640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 0x7fed34068b80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fed4814f5b0 tx=0x7fed4000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.067+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fed380ebee0 con 0x7fed4806b7b0 2024-05-08T20:53:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fed48071100 con 0x7fed4806b7b0 2024-05-08T20:53:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed457fa640 1 -- 172.21.15.81:0/2398701532 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fed38120080 con 0x7fed4806b7b0 2024-05-08T20:53:23.387 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":200,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 msgr2=0x7fed34068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 0x7fed34068b80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fed4814f5b0 tx=0x7fed4000b040 comp rx=0 tx=0).stop 2024-05-08T20:53:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 msgr2=0x7fed480af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fed380ac040 tx=0x7fed3801ace0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 shutdown_connections 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fed340666c0 0x7fed34068b80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed4815ccd0 0x7fed481517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed481563b0 0x7fed4815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 --2- 172.21.15.81:0/2398701532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed4806b7b0 0x7fed480af050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 >> 172.21.15.81:0/2398701532 conn(0x7fed480715f0 msgr2=0x7fed48155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.383+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 shutdown_connections 2024-05-08T20:53:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.387+0000 7fed4ec86640 1 -- 172.21.15.81:0/2398701532 wait complete. 2024-05-08T20:53:23.411 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:53:23.411 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-05-08T20:53:23.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:53:23.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:53:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 Processor -- start 2024-05-08T20:53:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 -- start start 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b60150110 0x7f1b600aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600c47c0 con 0x7f1b600a9970 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600c6220 con 0x7f1b600c3510 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b674e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600c6500 con 0x7f1b60150110 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b64a81640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1b600a9970 0x7f1b6014fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40094/0 (socket says 172.21.15.81:40094) 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b64a81640 1 -- 172.21.15.81:0/1011189398 learned_addr learned my addr 172.21.15.81:0/1011189398 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b65a83640 1 --2- 172.21.15.81:0/1011189398 >> v2:172.21.15.117:3300/0 conn(0x7f1b60150110 0x7f1b600aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182763372 0 0) 0x7f1b600c47c0 con 0x7f1b600a9970 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c003530 con 0x7f1b600a9970 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b65a83640 1 -- 172.21.15.81:0/1011189398 >> v1:172.21.15.117:6789/0 conn(0x7f1b600c3510 legacy=0x7f1b600c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b65a83640 1 -- 172.21.15.81:0/1011189398 >> v1:172.21.15.81:6789/0 conn(0x7f1b600a9970 legacy=0x7f1b6014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1400791375 0 0) 0x7f1b4c003530 con 0x7f1b600a9970 2024-05-08T20:53:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.543+0000 7f1b65a83640 1 -- 172.21.15.81:0/1011189398 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600c4a10 con 0x7f1b60150110 2024-05-08T20:53:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.547+0000 7f1b65a83640 1 --2- 172.21.15.81:0/1011189398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 0x7f1b600aaa80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5801c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14764872716d6a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.551+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50001680 con 0x7f1b60150110 2024-05-08T20:53:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.551+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b580a55b0 con 0x7f1b60150110 2024-05-08T20:53:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.551+0000 7f1b57fff640 1 -- 172.21.15.81:0/1011189398 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580a5940 con 0x7f1b60150110 2024-05-08T20:53:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- 172.21.15.81:0/1011189398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 msgr2=0x7f1b600aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1011189398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 0x7f1b600aaa80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5801c7d0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- 172.21.15.81:0/1011189398 shutdown_connections 2024-05-08T20:53:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1011189398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 0x7f1b600aaa80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- 172.21.15.81:0/1011189398 >> 172.21.15.81:0/1011189398 conn(0x7f1b600c68c0 msgr2=0x7f1b600c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- 172.21.15.81:0/1011189398 shutdown_connections 2024-05-08T20:53:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- 172.21.15.81:0/1011189398 wait complete. 2024-05-08T20:53:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 Processor -- start 2024-05-08T20:53:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- start start 2024-05-08T20:53:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b600a9970 0x7f1b601351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 0x7f1b60155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6014df30 con 0x7f1b600c3510 2024-05-08T20:53:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60151150 con 0x7f1b60150110 2024-05-08T20:53:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.555+0000 7f1b674e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6014d2b0 con 0x7f1b600a9970 2024-05-08T20:53:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39254/0 (socket says 172.21.15.81:39254) 2024-05-08T20:53:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b65282640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b600a9970 0x7f1b601351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 -- 172.21.15.81:0/1163746852 learned_addr learned my addr 172.21.15.81:0/1163746852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b600a9970 msgr2=0x7f1b601351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b600a9970 0x7f1b601351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 msgr2=0x7f1b60155a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b60150110 0x7f1b60155a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009a70 con 0x7f1b600c3510 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b65282640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b600a9970 0x7f1b601351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b64a81640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000c750 tx=0x7f1b5000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50005ae0 con 0x7f1b600c3510 2024-05-08T20:53:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6014d590 con 0x7f1b600c3510 2024-05-08T20:53:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6014db50 con 0x7f1b600c3510 2024-05-08T20:53:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50005c40 con 0x7f1b600c3510 2024-05-08T20:53:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50007070 con 0x7f1b600c3510 2024-05-08T20:53:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b500071f0 con 0x7f1b600c3510 2024-05-08T20:53:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.559+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 0x7f1b40004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b65282640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 0x7f1b40004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40007e90 con 0x7f1b40002a40 2024-05-08T20:53:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b440666e0 0x7f1b44068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1b50083a20 con 0x7f1b600c3510 2024-05-08T20:53:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b65a83640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b440666e0 0x7f1b44068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b65a83640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b440666e0 0x7f1b44068ba0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1b580af000 tx=0x7f1b580a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b65282640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b40008050 con 0x7f1b40002a40 2024-05-08T20:53:23.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b65282640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 0x7f1b40004f00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f70 tx=0x7f1b5c0015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c013070 con 0x7f1b40002a40 2024-05-08T20:53:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f1b5c014040 con 0x7f1b40002a40 2024-05-08T20:53:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 msgr2=0x7f1b40004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 0x7f1b40004f00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000f70 tx=0x7f1b5c0015a0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 msgr2=0x7f1b40004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.563+0000 7f1b55ffb640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40002a40 0x7f1b40004f00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 0x7f1b40007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4000a350 con 0x7f1b40006f20 2024-05-08T20:53:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b65282640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 0x7f1b40007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b65282640 1 -- 172.21.15.81:0/1163746852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1b4000a510 con 0x7f1b40006f20 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b65282640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 0x7f1b40007390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c01a000 tx=0x7f1b5c001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c026070 con 0x7f1b40006f20 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7f1b5c00c660 con 0x7f1b40006f20 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 msgr2=0x7f1b40007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 0x7f1b40007390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c01a000 tx=0x7f1b5c001130 comp rx=0 tx=0).stop 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 msgr2=0x7f1b40007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.571+0000 7f1b55ffb640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b40006f20 0x7f1b40007390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.578 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:23.581 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:23.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.583 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:53:23.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:23.590 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b440666e0 msgr2=0x7f1b44068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1b440666e0 0x7f1b44068ba0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1b580af000 tx=0x7f1b580a7070 comp rx=0 tx=0).stop 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 msgr2=0x7f1b60147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000c750 tx=0x7f1b5000cc10 comp rx=0 tx=0).stop 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b65a83640 1 -- 172.21.15.81:0/1163746852 reap_dead start 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 shutdown_connections 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 --2- 172.21.15.81:0/1163746852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b600c3510 0x7f1b60147c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 >> 172.21.15.81:0/1163746852 conn(0x7f1b600c68c0 msgr2=0x7f1b60150730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 shutdown_connections 2024-05-08T20:53:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.575+0000 7f1b674e6640 1 -- 172.21.15.81:0/1163746852 wait complete. 2024-05-08T20:53:23.595 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:23.595 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:53:23.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:53:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 Processor -- start 2024-05-08T20:53:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 -- start start 2024-05-08T20:53:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b4155e90 0x7fe9b4069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b4152ab0 con 0x7fe9b406a500 2024-05-08T20:53:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b4152d90 con 0x7fe9b414fe70 2024-05-08T20:53:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b8ac8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b41528a0 con 0x7fe9b4155e90 2024-05-08T20:53:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b1d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b4155e90 0x7fe9b4069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe9b406a500 0x7fe9b415d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40106/0 (socket says 172.21.15.81:40106) 2024-05-08T20:53:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/3695758302 learned_addr learned my addr 172.21.15.81:0/3695758302 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b1d9b640 1 -- 172.21.15.81:0/3695758302 >> v1:172.21.15.117:6789/0 conn(0x7fe9b414fe70 legacy=0x7fe9b406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b1d9b640 1 -- 172.21.15.81:0/3695758302 >> v1:172.21.15.81:6789/0 conn(0x7fe9b406a500 legacy=0x7fe9b415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.727+0000 7fe9b1d9b640 1 -- 172.21.15.81:0/3695758302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4153070 con 0x7fe9b4155e90 2024-05-08T20:53:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b1d9b640 1 --2- 172.21.15.81:0/3695758302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4155e90 0x7fe9b4069fc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80097c0 tx=0x7fe9a8020760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51c337b88827f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b159a640 1 -- 172.21.15.81:0/3695758302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80aa440 con 0x7fe9b4155e90 2024-05-08T20:53:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b159a640 1 -- 172.21.15.81:0/3695758302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a80aa5a0 con 0x7fe9b4155e90 2024-05-08T20:53:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b159a640 1 -- 172.21.15.81:0/3695758302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80aa930 con 0x7fe9b4155e90 2024-05-08T20:53:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/3695758302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4155e90 msgr2=0x7fe9b4069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.731+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/3695758302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4155e90 0x7fe9b4069fc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80097c0 tx=0x7fe9a8020760 comp rx=0 tx=0).stop 2024-05-08T20:53:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.735+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/3695758302 shutdown_connections 2024-05-08T20:53:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.735+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/3695758302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b4155e90 0x7fe9b4069fc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.735+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/3695758302 >> 172.21.15.81:0/3695758302 conn(0x7fe9b40c71b0 msgr2=0x7fe9b40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.735+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/3695758302 shutdown_connections 2024-05-08T20:53:23.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.735+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/3695758302 wait complete. 2024-05-08T20:53:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 Processor -- start 2024-05-08T20:53:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- start start 2024-05-08T20:53:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406a500 0x7fe9b40c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414fe70 0x7fe9b4147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 0x7fe9b4148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40c0610 con 0x7fe9b406a500 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b41e99a0 con 0x7fe9b414fe70 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b41e9ed0 con 0x7fe9b4155e90 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406a500 0x7fe9b40c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 0x7fe9b4148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406a500 0x7fe9b40c0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39286/0 (socket says 172.21.15.81:39286) 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 0x7fe9b4148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:49724/0 (socket says 172.21.15.81:49724) 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b259c640 1 -- 172.21.15.81:0/2108025125 learned_addr learned my addr 172.21.15.81:0/2108025125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414fe70 msgr2=0x7fe9b4147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414fe70 0x7fe9b4147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406a500 msgr2=0x7fe9b40c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b406a500 0x7fe9b40c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8009420 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b2d9d640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 0x7fe9b4148030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00cad0 tx=0x7fe9ac00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00ab70 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00acd0 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b40bc870 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac012600 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.739+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b40c16c0 con 0x7fe9b4155e90 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.743+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 0x7fe9b414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.743+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b4069550 con 0x7fe9b40c1200 2024-05-08T20:53:23.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.743+0000 7fe9b259c640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 0x7fe9b414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.743+0000 7fe9b259c640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9b406dd10 con 0x7fe9b40c1200 2024-05-08T20:53:23.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.743+0000 7fe9b259c640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 0x7fe9b414d850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400e4e0 tx=0x7fe9a400e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4017070 con 0x7fe9b40c1200 2024-05-08T20:53:23.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe9a40052e0 con 0x7fe9b40c1200 2024-05-08T20:53:23.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 msgr2=0x7fe9b414d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 0x7fe9b414d850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400e4e0 tx=0x7fe9a400e9a0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 msgr2=0x7fe9b414d850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b40c1200 0x7fe9b414d850 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400e4e0 tx=0x7fe9a400e9a0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9ac012760 con 0x7fe9b4155e90 2024-05-08T20:53:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe994066410 0x7fe9940688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe9ac084100 con 0x7fe9b4155e90 2024-05-08T20:53:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9b259c640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe994066410 0x7fe9940688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.747+0000 7fe9b259c640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe994066410 0x7fe9940688d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400eef0 tx=0x7fe9a4005000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.751+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 0x7fe9b414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.751+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b40675e0 con 0x7fe9b414bca0 2024-05-08T20:53:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b1d9b640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 0x7fe9b414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b1d9b640 1 -- 172.21.15.81:0/2108025125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe9b40bca00 con 0x7fe9b414bca0 2024-05-08T20:53:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b1d9b640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 0x7fe9b414dd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4072c70 tx=0x7fe9a8006f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80b8040 con 0x7fe9b414bca0 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fe9a80aad10 con 0x7fe9b414bca0 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 msgr2=0x7fe9b414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 0x7fe9b414dd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4072c70 tx=0x7fe9a8006f50 comp rx=0 tx=0).stop 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 msgr2=0x7fe9b414dd90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9a2ffd640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9b414bca0 0x7fe9b414dd90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:23.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:23.763 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.764 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.766 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.768 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.769 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:23.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:23.771 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe994066410 msgr2=0x7fe9940688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe994066410 0x7fe9940688d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400eef0 tx=0x7fe9a4005000 comp rx=0 tx=0).stop 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 msgr2=0x7fe9b4148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 --2- 172.21.15.81:0/2108025125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9b4155e90 0x7fe9b4148030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00cad0 tx=0x7fe9ac00cf90 comp rx=0 tx=0).stop 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/2108025125 reap_dead start 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b2d9d640 1 -- 172.21.15.81:0/2108025125 reap_dead start 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 shutdown_connections 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.755+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 >> 172.21.15.81:0/2108025125 conn(0x7fe9b40c71b0 msgr2=0x7fe9b40c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.759+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 shutdown_connections 2024-05-08T20:53:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.759+0000 7fe9b8ac8640 1 -- 172.21.15.81:0/2108025125 wait complete. 2024-05-08T20:53:23.785 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:23.785 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:53:23.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:53:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 Processor -- start 2024-05-08T20:53:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 -- start start 2024-05-08T20:53:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40c8280 0x7f3ee4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ee4155020 0x7f3ee415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40c4d00 con 0x7f3ee4152120 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40c5bd0 con 0x7f3ee4155020 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee99f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c52c0 con 0x7f3ee40c8280 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ee4152120 0x7f3ee40c6d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40110/0 (socket says 172.21.15.81:40110) 2024-05-08T20:53:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee2ffd640 1 -- 172.21.15.81:0/3221112253 learned_addr learned my addr 172.21.15.81:0/3221112253 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee37fe640 1 --2- 172.21.15.81:0/3221112253 >> v2:172.21.15.117:3300/0 conn(0x7f3ee4155020 0x7f3ee415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145047000 0 0) 0x7f3ee40c4d00 con 0x7f3ee4152120 2024-05-08T20:53:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ecc003530 con 0x7f3ee4152120 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40c8280 0x7f3ee4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009085890 0 0) 0x7f3ecc003530 con 0x7f3ee4152120 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40c8280 msgr2=0x7f3ee4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40c8280 0x7f3ee4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 >> v2:172.21.15.117:3300/0 conn(0x7f3ee4155020 msgr2=0x7f3ee415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 --2- 172.21.15.81:0/3221112253 >> v2:172.21.15.117:3300/0 conn(0x7f3ee4155020 0x7f3ee415f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee406a970 con 0x7f3ee4152120 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3ed4001680 con 0x7f3ee4152120 2024-05-08T20:53:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 >> v1:172.21.15.81:6789/0 conn(0x7f3ee4152120 legacy=0x7f3ee40c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ecc003980 0x7f3ecc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ecc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ecc005190 0x7f3ecc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c52c0 con 0x7f3ecc0047d0 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc00bf80 con 0x7f3ecc005190 2024-05-08T20:53:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc00c110 con 0x7f3ecc003980 2024-05-08T20:53:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ecc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 -- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ecc003980 msgr2=0x7f3ecc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ecc003980 0x7f3ecc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 -- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ecc005190 msgr2=0x7f3ecc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:53:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ecc005190 0x7f3ecc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.915+0000 7f3ee27fc640 1 -- 172.21.15.81:0/3221112253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc003530 con 0x7f3ecc0047d0 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ecc004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800bb40 tx=0x7f3ed801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfd0a2a275b1d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a66c0 con 0x7f3ecc0047d0 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed80a6820 con 0x7f3ecc0047d0 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee1ffb640 1 -- 172.21.15.81:0/3221112253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a6bd0 con 0x7f3ecc0047d0 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee99f9640 1 -- 172.21.15.81:0/3221112253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 msgr2=0x7f3ecc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee99f9640 1 --2- 172.21.15.81:0/3221112253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ecc004c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800bb40 tx=0x7f3ed801c7c0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.919+0000 7f3ee37fe640 1 -- 172.21.15.81:0/3221112253 reap_dead start 2024-05-08T20:53:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.923+0000 7f3ee99f9640 1 -- 172.21.15.81:0/3221112253 shutdown_connections 2024-05-08T20:53:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.923+0000 7f3ee99f9640 1 -- 172.21.15.81:0/3221112253 >> 172.21.15.81:0/3221112253 conn(0x7f3ee40abfb0 msgr2=0x7f3ee40ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- 172.21.15.81:0/3221112253 shutdown_connections 2024-05-08T20:53:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- 172.21.15.81:0/3221112253 wait complete. 2024-05-08T20:53:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 Processor -- start 2024-05-08T20:53:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- start start 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ee41ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4153a90 0x7f3ee414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee414c200 0x7f3ee40af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40ade50 con 0x7f3ecc0047d0 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee414c680 con 0x7f3ee414c200 2024-05-08T20:53:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee99f9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40af070 con 0x7f3ee4153a90 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ee41ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ee41ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39300/0 (socket says 172.21.15.81:39300) 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee2ffd640 1 -- 172.21.15.81:0/377870959 learned_addr learned my addr 172.21.15.81:0/377870959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.927+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4153a90 0x7f3ee414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee37fe640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee414c200 0x7f3ee40af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4153a90 msgr2=0x7f3ee414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4153a90 0x7f3ee414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee414c200 msgr2=0x7f3ee40af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee414c200 0x7f3ee40af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4155d60 con 0x7f3ecc0047d0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee2ffd640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ee41ea610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f430 tx=0x7f3ed400f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4007d00 con 0x7f3ecc0047d0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4007e60 con 0x7f3ecc0047d0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400a310 con 0x7f3ecc0047d0 2024-05-08T20:53:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee40ad060 con 0x7f3ecc0047d0 2024-05-08T20:53:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40ad620 con 0x7f3ecc0047d0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee99f9640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 0x7f3ee40afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.931+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4069670 con 0x7f3ee40ad840 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 0x7f3ee40afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ed400a470 con 0x7f3ecc0047d0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ee27fc640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ee406ba80 con 0x7f3ee40ad840 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ecbfff640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ed0066710 0x7f3ed0068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3ed4087060 con 0x7f3ecc0047d0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 0x7f3ee40afa60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee406b9f0 tx=0x7f3ecc005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ee37fe640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ed0066710 0x7f3ed0068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80bb470 con 0x7f3ee40ad840 2024-05-08T20:53:23.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.935+0000 7f3ee37fe640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ed0066710 0x7f3ed0068bd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40c7ad0 tx=0x7f3edc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.939+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f3ed80bb5d0 con 0x7f3ee40ad840 2024-05-08T20:53:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.939+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 msgr2=0x7f3ee40afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.939+0000 7f3ecbfff640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 0x7f3ee40afa60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee406b9f0 tx=0x7f3ecc005800 comp rx=0 tx=0).stop 2024-05-08T20:53:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.939+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 msgr2=0x7f3ee40afa60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.939+0000 7f3ecbfff640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee40ad840 0x7f3ee40afa60 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee406b9f0 tx=0x7f3ecc005800 comp rx=0 tx=0).stop 2024-05-08T20:53:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.947+0000 7f3ee99f9640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 0x7f3ee41ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.947+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c4f50 con 0x7f3ee4154b80 2024-05-08T20:53:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.947+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 0x7f3ee41ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.947+0000 7f3ee27fc640 1 -- 172.21.15.81:0/377870959 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3ee40c8710 con 0x7f3ee4154b80 2024-05-08T20:53:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.947+0000 7f3ee27fc640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 0x7f3ee41ed100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ed801c5f0 tx=0x7f3ed80a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80c79d0 con 0x7f3ee4154b80 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f3ed80c7b30 con 0x7f3ee4154b80 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 msgr2=0x7f3ee41ed100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 0x7f3ee41ed100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3ed801c5f0 tx=0x7f3ed80a7000 comp rx=0 tx=0).stop 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 msgr2=0x7f3ee41ed100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ecbfff640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ee4154b80 0x7f3ee41ed100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.954 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 200, 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 12, 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:23.955 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.957 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:23.958 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:23.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:23.960 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:23.962 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:23.964 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ed0066710 msgr2=0x7f3ed0068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3ed0066710 0x7f3ed0068bd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40c7ad0 tx=0x7f3edc00b040 comp rx=0 tx=0).stop 2024-05-08T20:53:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 msgr2=0x7f3ee41ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 --2- 172.21.15.81:0/377870959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ecc0047d0 0x7f3ee41ea610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400f430 tx=0x7f3ed400f8f0 comp rx=0 tx=0).stop 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee37fe640 1 -- 172.21.15.81:0/377870959 reap_dead start 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee37fe640 1 -- 172.21.15.81:0/377870959 reap_dead start 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 shutdown_connections 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 >> 172.21.15.81:0/377870959 conn(0x7f3ee40abfb0 msgr2=0x7f3ee40c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 shutdown_connections 2024-05-08T20:53:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:23.951+0000 7f3ee99f9640 1 -- 172.21.15.81:0/377870959 wait complete. 2024-05-08T20:53:23.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:53:23.974 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-05-08T20:53:23.974 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-05-08T20:53:23.974 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-05-08T20:53:23.974 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:53:23.974 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:53:23.974 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:53:23.999 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:53:23.999 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-05-08T20:53:23.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:24.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 Processor -- start 2024-05-08T20:53:24.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 -- start start 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 0x7ff4d00c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d0070c00 0x7ff4d014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00c3a50 con 0x7ff4d014edf0 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0072940 con 0x7ff4d0070c00 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d76c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d00705e0 con 0x7ff4d006b230 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d5463640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 msgr2=0x7ff4d00c2800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d5463640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 0x7ff4d00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d0070c00 0x7ff4d014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:24.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d5c64640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7ff4d014edf0 legacy=0x7ff4d01519d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d0070c00 0x7ff4d014e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39308/0 (socket says 172.21.15.81:39308) 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 -- 172.21.15.81:0/819892908 learned_addr learned my addr 172.21.15.81:0/819892908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 -- 172.21.15.81:0/819892908 >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 msgr2=0x7ff4d00c2800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 --2- 172.21.15.81:0/819892908 >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 0x7ff4d00c2800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 -- 172.21.15.81:0/819892908 >> v1:172.21.15.117:6789/0 conn(0x7ff4d014edf0 legacy=0x7ff4d01519d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.127+0000 7ff4d4c62640 1 -- 172.21.15.81:0/819892908 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00708c0 con 0x7ff4d0070c00 2024-05-08T20:53:24.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d4c62640 1 --2- 172.21.15.81:0/819892908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d0070c00 0x7ff4d014e8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00c4d70 tx=0x7ff4c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89fdb9f2b9bebc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:24.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4c7fff640 1 -- 172.21.15.81:0/819892908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00aa5f0 con 0x7ff4d0070c00 2024-05-08T20:53:24.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4c7fff640 1 -- 172.21.15.81:0/819892908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00aa750 con 0x7ff4d0070c00 2024-05-08T20:53:24.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4c7fff640 1 -- 172.21.15.81:0/819892908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00aaae0 con 0x7ff4d0070c00 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- 172.21.15.81:0/819892908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d0070c00 msgr2=0x7ff4d014e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 --2- 172.21.15.81:0/819892908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d0070c00 0x7ff4d014e8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00c4d70 tx=0x7ff4c001c470 comp rx=0 tx=0).stop 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- 172.21.15.81:0/819892908 shutdown_connections 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 --2- 172.21.15.81:0/819892908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d0070c00 0x7ff4d014e8b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 --2- 172.21.15.81:0/819892908 >> v2:172.21.15.117:3300/0 conn(0x7ff4d006b230 0x7ff4d00c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- 172.21.15.81:0/819892908 >> 172.21.15.81:0/819892908 conn(0x7ff4d00c71b0 msgr2=0x7ff4d00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:24.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- 172.21.15.81:0/819892908 shutdown_connections 2024-05-08T20:53:24.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- 172.21.15.81:0/819892908 wait complete. 2024-05-08T20:53:24.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 Processor -- start 2024-05-08T20:53:24.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.131+0000 7ff4d76c7640 1 -- start start 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 0x7ff4d01eee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d014edf0 0x7ff4d01505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d013da00 con 0x7ff4d006b230 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00c5b80 con 0x7ff4d0070c00 2024-05-08T20:53:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01ef720 con 0x7ff4d014edf0 2024-05-08T20:53:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d4c62640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 msgr2=0x7ff4d01eee40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d4c62640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 0x7ff4d01eee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39316/0 (socket says 172.21.15.81:39316) 2024-05-08T20:53:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 -- 172.21.15.81:0/2869657117 learned_addr learned my addr 172.21.15.81:0/2869657117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:24.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 -- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d014edf0 msgr2=0x7ff4d01505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d014edf0 0x7ff4d01505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 -- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 msgr2=0x7ff4d01eee40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 0x7ff4d01eee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 -- 172.21.15.81:0/2869657117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00094d0 con 0x7ff4d006b230 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d5463640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00b530 tx=0x7ff4cc00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003dd0 con 0x7ff4d006b230 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 -- 172.21.15.81:0/2869657117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d01efa00 con 0x7ff4d006b230 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc010780 con 0x7ff4d006b230 2024-05-08T20:53:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc010b30 con 0x7ff4d006b230 2024-05-08T20:53:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4d76c7640 1 -- 172.21.15.81:0/2869657117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d013d690 con 0x7ff4d006b230 2024-05-08T20:53:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.135+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a8005260 con 0x7ff4d006b230 2024-05-08T20:53:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.139+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4cc016070 con 0x7ff4d006b230 2024-05-08T20:53:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.139+0000 7ff4c5ffb640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 0x7ff4b4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.139+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff4cc088330 con 0x7ff4d006b230 2024-05-08T20:53:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.139+0000 7ff4d4c62640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 0x7ff4b4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:24.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.139+0000 7ff4d4c62640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 0x7ff4b4068b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00ae000 tx=0x7ff4c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.143+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff4cc0553a0 con 0x7ff4d006b230 2024-05-08T20:53:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.447+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff4a80057e0 con 0x7ff4d006b230 2024-05-08T20:53:24.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.447+0000 7ff4c5ffb640 1 -- 172.21.15.81:0/2869657117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7ff4cc0589c0 con 0x7ff4d006b230 2024-05-08T20:53:24.453 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":200,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 msgr2=0x7ff4b4068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 0x7ff4b4068b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00ae000 tx=0x7ff4c0008040 comp rx=0 tx=0).stop 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 msgr2=0x7ff4d014fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00b530 tx=0x7ff4cc00b9f0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 shutdown_connections 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4b4066640 0x7ff4b4068b00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4d014edf0 0x7ff4d01505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4d0070c00 0x7ff4d01eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 --2- 172.21.15.81:0/2869657117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d006b230 0x7ff4d014fcf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:24.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 >> 172.21.15.81:0/2869657117 conn(0x7ff4d00c71b0 msgr2=0x7ff4d006a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:24.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 shutdown_connections 2024-05-08T20:53:24.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:24.451+0000 7ff4bb7fe640 1 -- 172.21.15.81:0/2869657117 wait complete. 2024-05-08T20:53:27.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 Processor -- start 2024-05-08T20:53:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 -- start start 2024-05-08T20:53:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 0x7f867c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c158080 con 0x7f867c06d7d0 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c06ab70 con 0x7f867c152340 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f8680d26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c154b10 con 0x7f867c0c2570 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f867ad9d640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f867c06d7d0 legacy=0x7f867c1554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f867a59c640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 msgr2=0x7f867c06d290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.606+0000 7f867a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 0x7f867c06d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:49822/0 (socket says 172.21.15.81:49822) 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 -- 172.21.15.81:0/3935531339 learned_addr learned my addr 172.21.15.81:0/3935531339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 -- 172.21.15.81:0/3935531339 >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 msgr2=0x7f867c06d290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 --2- 172.21.15.81:0/3935531339 >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 0x7f867c06d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 -- 172.21.15.81:0/3935531339 >> v1:172.21.15.117:6789/0 conn(0x7f867c06d7d0 legacy=0x7f867c1554a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.610+0000 7f8679d9b640 1 -- 172.21.15.81:0/3935531339 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c06a890 con 0x7f867c0c2570 2024-05-08T20:53:27.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.614+0000 7f8679d9b640 1 --2- 172.21.15.81:0/3935531339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8670009870 tx=0x7f867001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0190cec38f30e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:27.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.614+0000 7f867959a640 1 -- 172.21.15.81:0/3935531339 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700ab640 con 0x7f867c0c2570 2024-05-08T20:53:27.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.614+0000 7f867959a640 1 -- 172.21.15.81:0/3935531339 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86700a7070 con 0x7f867c0c2570 2024-05-08T20:53:27.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.614+0000 7f867959a640 1 -- 172.21.15.81:0/3935531339 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700ab9c0 con 0x7f867c0c2570 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 -- 172.21.15.81:0/3935531339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 msgr2=0x7f867c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 --2- 172.21.15.81:0/3935531339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8670009870 tx=0x7f867001c480 comp rx=0 tx=0).stop 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 -- 172.21.15.81:0/3935531339 shutdown_connections 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 --2- 172.21.15.81:0/3935531339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c0c2570 0x7f867c154f60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 --2- 172.21.15.81:0/3935531339 >> v2:172.21.15.117:3300/0 conn(0x7f867c152340 0x7f867c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 -- 172.21.15.81:0/3935531339 >> 172.21.15.81:0/3935531339 conn(0x7f867c0c71b0 msgr2=0x7f867c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:27.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 -- 172.21.15.81:0/3935531339 shutdown_connections 2024-05-08T20:53:27.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.618+0000 7f8680d26640 1 -- 172.21.15.81:0/3935531339 wait complete. 2024-05-08T20:53:27.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 Processor -- start 2024-05-08T20:53:27.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- start start 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 0x7f867c1ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 0x7f867c1ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c071d10 con 0x7f867c06d7d0 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1f1790 con 0x7f867c0c2570 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c072150 con 0x7f867c152340 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8679d9b640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 msgr2=0x7f867c1ed2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8679d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 0x7f867c1ed2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39326/0 (socket says 172.21.15.81:39326) 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 -- 172.21.15.81:0/744063720 learned_addr learned my addr 172.21.15.81:0/744063720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867ad9d640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 0x7f867c1ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 -- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 msgr2=0x7f867c1ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 0x7f867c1ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 -- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 msgr2=0x7f867c1ed2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 0x7f867c1ed2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 -- 172.21.15.81:0/744063720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700094d0 con 0x7f867c06d7d0 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867ad9d640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 0x7f867c1ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f867a59c640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b550 tx=0x7f866c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c003b00 con 0x7f867c06d7d0 2024-05-08T20:53:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c003c80 con 0x7f867c06d7d0 2024-05-08T20:53:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1f09d0 con 0x7f867c06d7d0 2024-05-08T20:53:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0050f0 con 0x7f867c06d7d0 2024-05-08T20:53:27.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c1f0f90 con 0x7f867c06d7d0 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0675e0 con 0x7f867c06d7d0 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.622+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f866c005250 con 0x7f867c06d7d0 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.626+0000 7f866affd640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 0x7f8664068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.626+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f866c083e70 con 0x7f867c06d7d0 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.626+0000 7f8679d9b640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 0x7f8664068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.626+0000 7f8679d9b640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 0x7f8664068cd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f86700af000 tx=0x7f8670008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:27.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.634+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f866c050fb0 con 0x7f867c06d7d0 2024-05-08T20:53:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f867c074950 con 0x7f867c06d7d0 2024-05-08T20:53:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f866affd640 1 -- 172.21.15.81:0/744063720 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f866c0545d0 con 0x7f867c06d7d0 2024-05-08T20:53:27.943 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":200,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 msgr2=0x7f8664068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 0x7f8664068cd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f86700af000 tx=0x7f8670008040 comp rx=0 tx=0).stop 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 msgr2=0x7f867c0c0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b550 tx=0x7f866c00ba10 comp rx=0 tx=0).stop 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 shutdown_connections 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8664066810 0x7f8664068cd0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f867c152340 0x7f867c1ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c0c2570 0x7f867c1ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 --2- 172.21.15.81:0/744063720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f867c06d7d0 0x7f867c0c0840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.938+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 >> 172.21.15.81:0/744063720 conn(0x7f867c0c71b0 msgr2=0x7f867c152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.942+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 shutdown_connections 2024-05-08T20:53:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:27.942+0000 7f8680d26640 1 -- 172.21.15.81:0/744063720 wait complete. 2024-05-08T20:53:28.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:28.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:30.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 Processor -- start 2024-05-08T20:53:31.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 -- start start 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1000c2bc0 0x7fe1000c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100155e10 con 0x7fe1000c30d0 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100156080 con 0x7fe1000a94b0 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe105c4c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10006e790 con 0x7fe1000c2bc0 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0fffff640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7fe1000a94b0 legacy=0x7fe1000a98c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1000c2bc0 0x7fe1000c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1000c2bc0 0x7fe1000c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55458/0 (socket says 172.21.15.81:55458) 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 -- 172.21.15.81:0/2510359582 learned_addr learned my addr 172.21.15.81:0/2510359582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0ff7fe640 1 --1- 172.21.15.81:0/2510359582 >> v1:172.21.15.81:6789/0 conn(0x7fe1000c30d0 0x7fe1000c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41554/0 (socket says 172.21.15.81:41554) 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 -- 172.21.15.81:0/2510359582 >> v1:172.21.15.117:6789/0 conn(0x7fe1000a94b0 legacy=0x7fe1000a98c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 -- 172.21.15.81:0/2510359582 >> v1:172.21.15.81:6789/0 conn(0x7fe1000c30d0 legacy=0x7fe1000c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:31.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.098+0000 7fe0f7fff640 1 -- 172.21.15.81:0/2510359582 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100156360 con 0x7fe1000c2bc0 2024-05-08T20:53:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0f7fff640 1 --2- 172.21.15.81:0/2510359582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000c2bc0 0x7fe1000c34b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f364f67b08ad44 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0feffd640 1 -- 172.21.15.81:0/2510359582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80ac600 con 0x7fe1000c2bc0 2024-05-08T20:53:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0feffd640 1 -- 172.21.15.81:0/2510359582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80a8050 con 0x7fe1000c2bc0 2024-05-08T20:53:31.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0feffd640 1 -- 172.21.15.81:0/2510359582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80ac980 con 0x7fe1000c2bc0 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- 172.21.15.81:0/2510359582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000c2bc0 msgr2=0x7fe1000c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 --2- 172.21.15.81:0/2510359582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000c2bc0 0x7fe1000c34b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e801c4b0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- 172.21.15.81:0/2510359582 shutdown_connections 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 --2- 172.21.15.81:0/2510359582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000c2bc0 0x7fe1000c34b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- 172.21.15.81:0/2510359582 >> 172.21.15.81:0/2510359582 conn(0x7fe1000c4cc0 msgr2=0x7fe1000c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- 172.21.15.81:0/2510359582 shutdown_connections 2024-05-08T20:53:31.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- 172.21.15.81:0/2510359582 wait complete. 2024-05-08T20:53:31.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 Processor -- start 2024-05-08T20:53:31.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- start start 2024-05-08T20:53:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 0x7fe10013c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1000c30d0 0x7fe10013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe100140f00 con 0x7fe1000a94b0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c7060 con 0x7fe1000c2bc0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe105c4c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1001efb50 con 0x7fe1000c30d0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0f7fff640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 msgr2=0x7fe10013c9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 0x7fe10013c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55466/0 (socket says 172.21.15.81:55466) 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 -- 172.21.15.81:0/1468744007 learned_addr learned my addr 172.21.15.81:0/1468744007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0fffff640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1000c30d0 0x7fe10013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 -- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1000c30d0 msgr2=0x7fe10013cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1000c30d0 0x7fe10013cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 -- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 msgr2=0x7fe10013c9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 0x7fe10013c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 -- 172.21.15.81:0/1468744007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80094d0 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.102+0000 7fe0ff7fe640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c490 tx=0x7fe0f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0007480 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f00075e0 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10013d450 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00049f0 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1001543d0 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100074950 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0f0004b50 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 0x7fe0e0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe0f0083970 con 0x7fe1000a94b0 2024-05-08T20:53:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0f7fff640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 0x7fe0e0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.106+0000 7fe0f7fff640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 0x7fe0e0068b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80ae000 tx=0x7fe0e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.110+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe0f0050a60 con 0x7fe1000a94b0 2024-05-08T20:53:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.414+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe100149ba0 con 0x7fe1000a94b0 2024-05-08T20:53:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.414+0000 7fe0fcff9640 1 -- 172.21.15.81:0/1468744007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fe0f0018080 con 0x7fe1000a94b0 2024-05-08T20:53:31.421 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":200,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:31.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 msgr2=0x7fe0e0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:31.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 0x7fe0e0068b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80ae000 tx=0x7fe0e8008040 comp rx=0 tx=0).stop 2024-05-08T20:53:31.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 msgr2=0x7fe10013fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c490 tx=0x7fe0f000c950 comp rx=0 tx=0).stop 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 shutdown_connections 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fe0e0066640 0x7fe0e0068b00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1000c30d0 0x7fe10013cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1000c2bc0 0x7fe10013c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 --2- 172.21.15.81:0/1468744007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1000a94b0 0x7fe10013fdb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 >> 172.21.15.81:0/1468744007 conn(0x7fe1000c4cc0 msgr2=0x7fe10014ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 shutdown_connections 2024-05-08T20:53:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:31.418+0000 7fe105c4c640 1 -- 172.21.15.81:0/1468744007 wait complete. 2024-05-08T20:53:34.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:53:34.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.594+0000 7ff6ac4e1640 1 Processor -- start 2024-05-08T20:53:34.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.594+0000 7ff6ac4e1640 1 -- start start 2024-05-08T20:53:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6ac4e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6ac4e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:34.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6ac4e1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a4158e20 con 0x7ff6a4154cf0 2024-05-08T20:53:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6ac4e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a406bb20 con 0x7ff6a4151f00 2024-05-08T20:53:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6ac4e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41548e0 con 0x7ff6a40ca000 2024-05-08T20:53:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6a9a7c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6a4154cf0 0x7ff6a4155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41568/0 (socket says 172.21.15.81:41568) 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 learned_addr learned my addr 172.21.15.81:0/3584115928 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55478/0 (socket says 172.21.15.81:55478) 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.598+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:34.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.602+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:34.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.602+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:34.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.602+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:34.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.602+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.802+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.802+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.802+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.802+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:34.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.802+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:53:34.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.806+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:34.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.806+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:34.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.806+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:34.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.806+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:34.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:34.806+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:53:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.206+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.206+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.206+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.206+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.206+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:53:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.210+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.210+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.210+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.210+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:35.210+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:53:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.010+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.010+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.010+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.010+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:36.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.010+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:53:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.014+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.014+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:53:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.014+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:53:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.014+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:53:36.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:36.014+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 msgr2=0x7ff6a40ca490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a40ca000 0x7ff6a40ca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 msgr2=0x7ff6a41588e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff6a4151f00 0x7ff6a41588e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.81:6789/0 conn(0x7ff6a4154cf0 legacy=0x7ff6a4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a4155860 con 0x7ff688006220 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68800af80 con 0x7ff6880036b0 2024-05-08T20:53:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:37.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.598+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.117:6789/0 conn(0x7ff688006220 legacy=0x7ff6880086c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.802+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.802+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.117:6789/0 conn(0x7ff688006220 legacy=0x7ff6880086c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:37.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:37.802+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:53:38.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:38.206+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.117:6789/0 conn(0x7ff688006220 legacy=0x7ff6880086c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:38.206+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:38.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:38.206+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:53:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:39.010+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:39.010+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:53:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:39.010+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.117:6789/0 conn(0x7ff688006220 legacy=0x7ff6880086c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:40.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.117:6789/0 conn(0x7ff688006220 legacy=0x7ff6880086c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6aaa7e640 1 -- 172.21.15.81:0/3584115928 reap_dead start 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff688008e90 0x7ff688008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68800b0f0 con 0x7ff688009310 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68800af80 con 0x7ff688008e90 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff69bfff640 1 -- 172.21.15.81:0/3584115928 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68800e550 con 0x7ff6880036b0 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6aa27d640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:40.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.81:3300/0 conn(0x7ff688008e90 0x7ff688008610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a927b640 1 -- 172.21.15.81:0/3584115928 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659486445 0 0) 0x7ff68800b0f0 con 0x7ff688009310 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a927b640 1 -- 172.21.15.81:0/3584115928 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff690003530 con 0x7ff688009310 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 msgr2=0x7ff688005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 >> v1:172.21.15.81:6789/0 conn(0x7ff688009310 legacy=0x7ff6880097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.598+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/3584115928 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4155860 con 0x7ff688008e90 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff688008610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6880061c0 tx=0x7ff6a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6f559b24ff6d73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6a927b640 1 -- 172.21.15.81:0/3584115928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004ab0 con 0x7ff688008e90 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6a927b640 1 -- 172.21.15.81:0/3584115928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0004c30 con 0x7ff688008e90 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6a927b640 1 -- 172.21.15.81:0/3584115928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0007070 con 0x7ff688008e90 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/3584115928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 msgr2=0x7ff688008610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:40.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff688008610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6880061c0 tx=0x7ff6a001c4a0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/3584115928 shutdown_connections 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/3584115928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff688008610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/3584115928 >> v2:172.21.15.117:3300/0 conn(0x7ff6880036b0 0x7ff688005b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/3584115928 >> 172.21.15.81:0/3584115928 conn(0x7ff6a40715f0 msgr2=0x7ff6a4071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/3584115928 shutdown_connections 2024-05-08T20:53:40.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.602+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/3584115928 wait complete. 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 Processor -- start 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- start start 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 0x7ff6a40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff688009310 0x7ff6a41ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41f0ae0 con 0x7ff688008e90 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41f0d80 con 0x7ff6880036b0 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41f1060 con 0x7ff688009310 2024-05-08T20:53:40.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6aa27d640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 msgr2=0x7ff6a40af320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6aa27d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 0x7ff6a40af320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45792/0 (socket says 172.21.15.81:45792) 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/1107989767 learned_addr learned my addr 172.21.15.81:0/1107989767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6aaa7e640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff688009310 0x7ff6a41ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff688009310 msgr2=0x7ff6a41ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff688009310 0x7ff6a41ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 msgr2=0x7ff6a40af320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 0x7ff6a40af320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 -- 172.21.15.81:0/1107989767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4158e20 con 0x7ff688008e90 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6a9a7c640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000c10 tx=0x7ff6a0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0007480 con 0x7ff688008e90 2024-05-08T20:53:40.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a00075e0 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a41f1340 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004e20 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41576a0 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.606+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a4074950 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.610+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6a00b2070 con 0x7ff688008e90 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.610+0000 7ff69affd640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 0x7ff68806a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.610+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 0x7ff68806a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.610+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff6a011e160 con 0x7ff688008e90 2024-05-08T20:53:40.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.610+0000 7ff6aa27d640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 0x7ff68806a1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c5420 tx=0x7ff69c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:40.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.614+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff6a00eb3c0 con 0x7ff688008e90 2024-05-08T20:53:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff6a406ab10 con 0x7ff688008e90 2024-05-08T20:53:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff69affd640 1 -- 172.21.15.81:0/1107989767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7ff6a00b0620 con 0x7ff688008e90 2024-05-08T20:53:40.999 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":204,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:53:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 msgr2=0x7ff68806a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 0x7ff68806a1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c5420 tx=0x7ff69c00b040 comp rx=0 tx=0).stop 2024-05-08T20:53:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 msgr2=0x7ff6a4156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.994+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000c10 tx=0x7ff6a0019240 comp rx=0 tx=0).stop 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 shutdown_connections 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff688067cf0 0x7ff68806a1b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff688009310 0x7ff6a41ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688008e90 0x7ff6a4156880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 --2- 172.21.15.81:0/1107989767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6880036b0 0x7ff6a40af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 >> 172.21.15.81:0/1107989767 conn(0x7ff6a40715f0 msgr2=0x7ff6a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 shutdown_connections 2024-05-08T20:53:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:40.998+0000 7ff6ac4e1640 1 -- 172.21.15.81:0/1107989767 wait complete. 2024-05-08T20:53:41.023 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-05-08T20:53:41.023 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-05-08T20:53:41.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:53:41.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.162+0000 7f5b10cc2640 1 Processor -- start 2024-05-08T20:53:41.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.162+0000 7f5b10cc2640 1 -- start start 2024-05-08T20:53:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b10cc2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b0c0c3510 0x7f5b0c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b10cc2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b0c0c38f0 0x7f5b0c153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b10cc2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c153880 con 0x7f5b0c0a9970 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b10cc2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c47c0 con 0x7f5b0c0c38f0 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b10cc2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c6220 con 0x7f5b0c0c3510 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f5b0c0c3510 msgr2=0x7f5b0c0aaa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b0c0c3510 0x7f5b0c0aaa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b09d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5b0c0a9970 0x7f5b0c0c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34346/0 (socket says 172.21.15.81:34346) 2024-05-08T20:53:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b09d9b640 1 -- 172.21.15.81:0/231292434 learned_addr learned my addr 172.21.15.81:0/231292434 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930576074 0 0) 0x7f5b00001120 con 0x7f5b0c0a9970 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af4003530 con 0x7f5b0c0a9970 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060835166 0 0) 0x7f5af4003530 con 0x7f5b0c0a9970 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 >> v2:172.21.15.117:3300/0 conn(0x7f5b0c0c3510 msgr2=0x7f5b0c0aaa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 --2- 172.21.15.81:0/231292434 >> v2:172.21.15.117:3300/0 conn(0x7f5b0c0c3510 0x7f5b0c0aaa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 >> v2:172.21.15.81:3300/0 conn(0x7f5b0c0c38f0 msgr2=0x7f5b0c153340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 --2- 172.21.15.81:0/231292434 >> v2:172.21.15.81:3300/0 conn(0x7f5b0c0c38f0 0x7f5b0c153340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0c6500 con 0x7f5b0c0a9970 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f5b00001810 con 0x7f5b0c0a9970 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 >> v1:172.21.15.81:6789/0 conn(0x7f5b0c0a9970 legacy=0x7f5b0c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 0x7f5af4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af40047d0 0x7f5af4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af4005190 0x7f5af4014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c47c0 con 0x7f5af4005190 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c6220 con 0x7f5af40047d0 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4014ad0 con 0x7f5af4003980 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b09d9b640 1 -- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af40047d0 msgr2=0x7f5af4004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b09d9b640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af40047d0 0x7f5af4004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 0x7f5af4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 -- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af40047d0 msgr2=0x7f5af4004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af40047d0 0x7f5af4004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 -- 172.21.15.81:0/231292434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af4005190 msgr2=0x7f5af4014590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af4005190 0x7f5af4014590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0a59c640 1 -- 172.21.15.81:0/231292434 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0c6500 con 0x7f5af4003980 2024-05-08T20:53:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.166+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/231292434 reap_dead start 2024-05-08T20:53:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 0x7f5af4003da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5afc003940 tx=0x7f5afc01c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e0886ae4b8f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc003bc0 con 0x7f5af4003980 2024-05-08T20:53:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0a7070 con 0x7f5af4003980 2024-05-08T20:53:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b0959a640 1 -- 172.21.15.81:0/231292434 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc005070 con 0x7f5af4003980 2024-05-08T20:53:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 -- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 msgr2=0x7f5af4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 0x7f5af4003da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5afc003940 tx=0x7f5afc01c260 comp rx=0 tx=0).stop 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 -- 172.21.15.81:0/231292434 shutdown_connections 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 --2- 172.21.15.81:0/231292434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af4003980 0x7f5af4003da0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 -- 172.21.15.81:0/231292434 >> 172.21.15.81:0/231292434 conn(0x7f5b0c0c68c0 msgr2=0x7f5b0c0c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 -- 172.21.15.81:0/231292434 shutdown_connections 2024-05-08T20:53:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.170+0000 7f5b10cc2640 1 -- 172.21.15.81:0/231292434 wait complete. 2024-05-08T20:53:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 Processor -- start 2024-05-08T20:53:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- start start 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af4003980 0x7f5b0c1e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b0c071500 0x7f5b0c0bc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 0x7f5b0c0bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0bc360 con 0x7f5b0c1e9900 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0bd200 con 0x7f5af4003980 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c06f950 con 0x7f5b0c071500 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0a59c640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af4003980 msgr2=0x7f5b0c1e93c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af4003980 0x7f5b0c1e93c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 0x7f5b0c0bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 0x7f5b0c0bccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45802/0 (socket says 172.21.15.81:45802) 2024-05-08T20:53:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 learned_addr learned my addr 172.21.15.81:0/1149696073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b0c071500 msgr2=0x7f5b0c0bc780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b0c071500 0x7f5b0c0bc780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af4003980 msgr2=0x7f5b0c1e93c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af4003980 0x7f5b0c1e93c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c1e9e80 con 0x7f5b0c1e9900 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b0ad9d640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 0x7f5b0c0bccc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5af4004750 tx=0x7f5b04009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400c900 con 0x7f5b0c1e9900 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400ca80 con 0x7f5b0c1e9900 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c0724c0 con 0x7f5b0c1e9900 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400ce30 con 0x7f5b0c1e9900 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.174+0000 7f5b10cc2640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c071970 con 0x7f5b0c1e9900 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5b10cc2640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 0x7f5b0c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5b10cc2640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c069550 con 0x7f5b0c14c9d0 2024-05-08T20:53:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 0x7f5b0c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5b0a59c640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b0c072340 con 0x7f5b0c14c9d0 2024-05-08T20:53:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b04012020 con 0x7f5b0c1e9900 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5afaffd640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5aec066640 0x7f5aec068b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5b04083dd0 con 0x7f5b0c1e9900 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 0x7f5b0c14cdb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5afc006fd0 tx=0x7f5af4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.178+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b2070 con 0x7f5b0c14c9d0 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5afc006de0 con 0x7f5b0c14c9d0 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 msgr2=0x7f5b0c14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5afaffd640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 0x7f5b0c14cdb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5afc006fd0 tx=0x7f5af4005800 comp rx=0 tx=0).stop 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 msgr2=0x7f5b0c14cdb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:41.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5afaffd640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14c9d0 0x7f5b0c14cdb0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5afc006fd0 tx=0x7f5af4005800 comp rx=0 tx=0).stop 2024-05-08T20:53:41.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.182+0000 7f5b09d9b640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5aec066640 0x7f5aec068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.190+0000 7f5b09d9b640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5aec066640 0x7f5aec068b00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5b000012c0 tx=0x7f5b000011d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.190+0000 7f5b10cc2640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 0x7f5b0c1e5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.190+0000 7f5b10cc2640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c5ef0 con 0x7f5b0c14d2f0 2024-05-08T20:53:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 0x7f5b0c1e5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5b0a59c640 1 -- 172.21.15.81:0/1149696073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5b0c0c4cf0 con 0x7f5b0c14d2f0 2024-05-08T20:53:41.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5b0a59c640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 0x7f5b0c1e5bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c10 tx=0x7f5afc0090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0bdb90 con 0x7f5b0c14d2f0 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4967 (secure 0 0 0) 0x7f5afc0bdcf0 con 0x7f5b0c14d2f0 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 msgr2=0x7f5b0c1e5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 0x7f5b0c1e5bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c10 tx=0x7f5afc0090e0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 msgr2=0x7f5b0c1e5bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.194+0000 7f5afaffd640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c14d2f0 0x7f5b0c1e5bf0 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c10 tx=0x7f5afc0090e0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 204, 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:41.213 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5aec066640 msgr2=0x7f5aec068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5aec066640 0x7f5aec068b00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5b000012c0 tx=0x7f5b000011d0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 msgr2=0x7f5b0c0bccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 --2- 172.21.15.81:0/1149696073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b0c1e9900 0x7f5b0c0bccc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5af4004750 tx=0x7f5b04009e70 comp rx=0 tx=0).stop 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 reap_dead start 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5b0ad9d640 1 -- 172.21.15.81:0/1149696073 reap_dead start 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 shutdown_connections 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 >> 172.21.15.81:0/1149696073 conn(0x7f5b0c0c68c0 msgr2=0x7f5b0c14dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 shutdown_connections 2024-05-08T20:53:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.198+0000 7f5af8ff9640 1 -- 172.21.15.81:0/1149696073 wait complete. 2024-05-08T20:53:41.229 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:53:41.229 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-05-08T20:53:41.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:53:41.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.370+0000 7f9d17eef640 1 Processor -- start 2024-05-08T20:53:41.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.370+0000 7f9d17eef640 1 -- start start 2024-05-08T20:53:41.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d17eef640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d101653c0 0x7f9d101657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d17eef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1006afd0 con 0x7f9d1006c2c0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d17eef640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1006c720 con 0x7f9d1006cca0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d17eef640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1006f910 con 0x7f9d101653c0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d1648c640 1 -- >> v2:172.21.15.117:3300/0 conn(0x7f9d101653c0 msgr2=0x7f9d101657f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d1648c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d101653c0 0x7f9d101657f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d15c8b640 1 -- >> v1:172.21.15.117:6789/0 conn(0x7f9d1006cca0 legacy=0x7f9d1006f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.117:6789/0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d1548a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d1006c2c0 0x7f9d100a93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34350/0 (socket says 172.21.15.81:34350) 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d1548a640 1 -- 172.21.15.81:0/3087250189 learned_addr learned my addr 172.21.15.81:0/3087250189 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753364124 0 0) 0x7f9d1006afd0 con 0x7f9d1006c2c0 2024-05-08T20:53:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.374+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cfc003530 con 0x7f9d1006c2c0 2024-05-08T20:53:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134703319 0 0) 0x7f9cfc003530 con 0x7f9d1006c2c0 2024-05-08T20:53:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 >> v2:172.21.15.117:3300/0 conn(0x7f9d101653c0 msgr2=0x7f9d101657f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 --2- 172.21.15.81:0/3087250189 >> v2:172.21.15.117:3300/0 conn(0x7f9d101653c0 0x7f9d101657f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 >> v1:172.21.15.117:6789/0 conn(0x7f9d1006cca0 legacy=0x7f9d1006f200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100728a0 con 0x7f9d1006c2c0 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9d0c001680 con 0x7f9d1006c2c0 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 >> v1:172.21.15.81:6789/0 conn(0x7f9d1006c2c0 legacy=0x7f9d100a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc003b50 0x7f9cfc008460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0089a0 0x7f9cfc00adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 0x7f9cfc00db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1006f910 con 0x7f9cfc00b650 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc00e3f0 con 0x7f9cfc0089a0 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc00e5b0 con 0x7f9cfc003b50 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1548a640 1 -- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0089a0 msgr2=0x7f9cfc00adb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 0x7f9cfc00db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1548a640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0089a0 0x7f9cfc00adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 -- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc003b50 msgr2=0x7f9cfc008460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc003b50 0x7f9cfc008460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 -- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0089a0 msgr2=0x7f9cfc00adb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:53:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cfc0089a0 0x7f9cfc00adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.378+0000 7f9d1648c640 1 -- 172.21.15.81:0/3087250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc003530 con 0x7f9cfc00b650 2024-05-08T20:53:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d1648c640 1 -- 172.21.15.81:0/3087250189 reap_dead start 2024-05-08T20:53:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d1648c640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 0x7f9cfc00db10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d00003940 tx=0x7f9d0001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bfb03a8e9a9915 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00003bc0 con 0x7f9cfc00b650 2024-05-08T20:53:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00003d20 con 0x7f9cfc00b650 2024-05-08T20:53:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d14c89640 1 -- 172.21.15.81:0/3087250189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000052b0 con 0x7f9cfc00b650 2024-05-08T20:53:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 -- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 msgr2=0x7f9cfc00db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 0x7f9cfc00db10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d00003940 tx=0x7f9d0001c440 comp rx=0 tx=0).stop 2024-05-08T20:53:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 -- 172.21.15.81:0/3087250189 shutdown_connections 2024-05-08T20:53:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 --2- 172.21.15.81:0/3087250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cfc00b650 0x7f9cfc00db10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 -- 172.21.15.81:0/3087250189 >> 172.21.15.81:0/3087250189 conn(0x7f9d100c2ca0 msgr2=0x7f9d100c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 -- 172.21.15.81:0/3087250189 shutdown_connections 2024-05-08T20:53:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.382+0000 7f9d17eef640 1 -- 172.21.15.81:0/3087250189 wait complete. 2024-05-08T20:53:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 Processor -- start 2024-05-08T20:53:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- start start 2024-05-08T20:53:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc00b650 0x7f9d10071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 0x7f9d1006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d1008a510 0x7f9d1008a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100bc210 con 0x7f9d100bbb80 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100bb1c0 con 0x7f9d1008a510 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10071d80 con 0x7f9cfc00b650 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1648c640 1 -- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d1008a510 msgr2=0x7f9d1008a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:3300/0 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1648c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d1008a510 0x7f9d1008a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 0x7f9d1006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 0x7f9d1006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45834/0 (socket says 172.21.15.81:45834) 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 -- 172.21.15.81:0/1050562452 learned_addr learned my addr 172.21.15.81:0/1050562452 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d15c8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc00b650 0x7f9d10071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc00b650 msgr2=0x7f9d10071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cfc00b650 0x7f9d10071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d1008a510 msgr2=0x7f9d1008a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d1008a510 0x7f9d1008a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10160050 con 0x7f9d100bbb80 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d1548a640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 0x7f9d1006fd40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00f4b0 tx=0x7f9d0c00f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c007d00 con 0x7f9d100bbb80 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c007e60 con 0x7f9d100bbb80 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00a310 con 0x7f9d100bbb80 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d10160330 con 0x7f9d100bbb80 2024-05-08T20:53:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.386+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100bb6f0 con 0x7f9d100bbb80 2024-05-08T20:53:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d17eef640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 0x7f9d10160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100696e0 con 0x7f9d10160b30 2024-05-08T20:53:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d15c8b640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 0x7f9d10160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d15c8b640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d1006b7e0 con 0x7f9d10160b30 2024-05-08T20:53:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d15c8b640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 0x7f9d10160f10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08007660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.390+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d0c00a470 con 0x7f9d100bbb80 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9cf4066670 0x7f9cf4068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08010040 con 0x7f9d10160b30 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9d0c0866f0 con 0x7f9d100bbb80 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9d08015680 con 0x7f9d10160b30 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 msgr2=0x7f9d10160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 0x7f9d10160f10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08007660 comp rx=0 tx=0).stop 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 msgr2=0x7f9d10160f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d067fc640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10160b30 0x7f9d10160f10 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08007660 comp rx=0 tx=0).stop 2024-05-08T20:53:41.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.394+0000 7f9d1648c640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9cf4066670 0x7f9cf4068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.398+0000 7f9d1648c640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9cf4066670 0x7f9cf4068b30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e3c0 tx=0x7f9d00005a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.402+0000 7f9d17eef640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 0x7f9d101f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:53:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.402+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1006b500 con 0x7f9d10161450 2024-05-08T20:53:41.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.402+0000 7f9d15c8b640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 0x7f9d101f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:53:41.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d15c8b640 1 -- 172.21.15.81:0/1050562452 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9d1006bac0 con 0x7f9d10161450 2024-05-08T20:53:41.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d15c8b640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 0x7f9d101f9ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08005d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:53:41.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0801d8d0 con 0x7f9d10161450 2024-05-08T20:53:41.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4455 (secure 0 0 0) 0x7f9d0801da30 con 0x7f9d10161450 2024-05-08T20:53:41.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 msgr2=0x7f9d101f9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 0x7f9d101f9ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08005d10 comp rx=0 tx=0).stop 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 msgr2=0x7f9d101f9ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d067fc640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d10161450 0x7f9d101f9ed0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d08003cc0 tx=0x7f9d08005d10 comp rx=0 tx=0).stop 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 204, 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:53:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.412 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:53:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:53:41.415 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:53:41.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:53:41.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:53:41.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:53:41.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:53:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:53:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:53:41.422 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:53:41.422 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9cf4066670 msgr2=0x7f9cf4068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9cf4066670 0x7f9cf4068b30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e3c0 tx=0x7f9d00005a90 comp rx=0 tx=0).stop 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 msgr2=0x7f9d1006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 --2- 172.21.15.81:0/1050562452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d100bbb80 0x7f9d1006fd40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00f4b0 tx=0x7f9d0c00f970 comp rx=0 tx=0).stop 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d1648c640 1 -- 172.21.15.81:0/1050562452 reap_dead start 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d1648c640 1 -- 172.21.15.81:0/1050562452 reap_dead start 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 shutdown_connections 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 >> 172.21.15.81:0/1050562452 conn(0x7f9d100c2ca0 msgr2=0x7f9d101646e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 shutdown_connections 2024-05-08T20:53:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:53:41.406+0000 7f9d17eef640 1 -- 172.21.15.81:0/1050562452 wait complete. 2024-05-08T20:53:41.429 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-05-08T20:53:41.429 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-05-08T20:53:58.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:58.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:01.430 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-05-08T20:54:01.430 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-05-08T20:54:01.430 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:54:01.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:54:01.433 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:54:01.433 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:54:01.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:54:01.493 INFO:tasks.workunit.client.1.smithi117.stdout:Syncing()...3 sec 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:FFSB benchmark finished at: Wed May 8 20:54:01 2024 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:Results: 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:Benchmark took 307.31 sec 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:Total Results 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:=============== 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout: ======= ============ ========= ======= =========== ========== 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout: write : 1552640 5052.28 100.000% 100.000% 19.7MB/sec 2024-05-08T20:54:01.494 INFO:tasks.workunit.client.1.smithi117.stdout:- 2024-05-08T20:54:01.495 INFO:tasks.workunit.client.1.smithi117.stdout:5052.28 Transactions per Second 2024-05-08T20:54:01.495 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.495 INFO:tasks.workunit.client.1.smithi117.stdout:Throughput Results 2024-05-08T20:54:01.495 INFO:tasks.workunit.client.1.smithi117.stdout:=================== 2024-05-08T20:54:01.495 INFO:tasks.workunit.client.1.smithi117.stdout:Write Throughput: 19.7MB/sec 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout:System Call Latency statistics in millisecs 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout:===== 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: Min Avg Max Total Calls 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: ======== ======== ======== ============ 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout:[ open] 0.463000 176.804429 8036.688965 1213 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[0] 5000.000000 - 10000.000000 : 21 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[1] 2000.000000 - 5000.000000 : 12 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[3] 500.000000 - 1000.000000 : 4 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[4] 200.000000 - 500.000000 : 5 2024-05-08T20:54:01.502 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[5] 100.000000 - 200.000000 : 7 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[6] 50.000000 - 100.000000 : 39 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[7] 20.000000 - 50.000000 : 406 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[8] 10.000000 - 20.000000 : 411 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[9] 5.000000 - 10.000000 : 165 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[10] 2.000000 - 5.000000 : 88 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[11] 1.000000 - 2.000000 : 43 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[12] 0.500000 - 1.000000 : 10 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.503 INFO:tasks.workunit.client.1.smithi117.stdout:[ write] 0.085000 6.084853 978.851990 1552640 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[3] 500.000000 - 1000.000000 : 3 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[4] 200.000000 - 500.000000 : 35 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[5] 100.000000 - 200.000000 : 634 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[6] 50.000000 - 100.000000 : 14186 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[7] 20.000000 - 50.000000 : 104688 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[8] 10.000000 - 20.000000 : 176472 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[9] 5.000000 - 10.000000 : 236289 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[10] 2.000000 - 5.000000 : 238919 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[11] 1.000000 - 2.000000 : 103079 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[12] 0.500000 - 1.000000 : 83648 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[13] 0.200000 - 0.500000 : 313954 2024-05-08T20:54:01.504 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[14] 0.100000 - 0.200000 : 271569 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[15] 0.050000 - 0.100000 : 9164 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout:[ lseek] 0.000000 0.000983 18.716000 1552640 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-05-08T20:54:01.505 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[9] 5.000000 - 10.000000 : 3 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[12] 0.500000 - 1.000000 : 12 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[13] 0.200000 - 0.500000 : 19 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[14] 0.100000 - 0.200000 : 42 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[15] 0.050000 - 0.100000 : 36 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[16] 0.020000 - 0.050000 : 317 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[17] 0.010000 - 0.020000 : 716 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[18] 0.000000 - 0.010000 : 1551493 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout:[ close] 0.019000 3.118808 82.819000 1213 2024-05-08T20:54:01.506 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[6] 50.000000 - 100.000000 : 7 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[7] 20.000000 - 50.000000 : 48 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[8] 10.000000 - 20.000000 : 54 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[9] 5.000000 - 10.000000 : 84 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[10] 2.000000 - 5.000000 : 128 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[11] 1.000000 - 2.000000 : 73 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[12] 0.500000 - 1.000000 : 40 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[13] 0.200000 - 0.500000 : 92 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[14] 0.100000 - 0.200000 : 210 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[15] 0.050000 - 0.100000 : 125 2024-05-08T20:54:01.507 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[16] 0.020000 - 0.050000 : 350 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout:0.4% User Time 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout:69.0% System Time 2024-05-08T20:54:01.508 INFO:tasks.workunit.client.1.smithi117.stdout:69.4% CPU Utilization 2024-05-08T20:54:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 Processor -- start 2024-05-08T20:54:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 -- start start 2024-05-08T20:54:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1bb0 0x7f1da8151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1da81535a0 0x7f1da815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80c23f0 con 0x7f1da80c1f90 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da8155060 con 0x7f1da81535a0 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1daea3c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8155340 con 0x7f1da80c1bb0 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1da81535a0 0x7f1da815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1da81535a0 0x7f1da815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53132/0 (socket says 172.21.15.81:53132) 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 -- 172.21.15.81:0/1406799502 learned_addr learned my addr 172.21.15.81:0/1406799502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1da77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1da80c1f90 0x7f1da8152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58618/0 (socket says 172.21.15.81:58618) 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1da7fff640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1bb0 0x7f1da8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 -- 172.21.15.81:0/1406799502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1bb0 msgr2=0x7f1da8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1bb0 0x7f1da8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 -- 172.21.15.81:0/1406799502 >> v1:172.21.15.81:6789/0 conn(0x7f1da80c1f90 legacy=0x7f1da8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1da6ffd640 1 -- 172.21.15.81:0/1406799502 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752651423 0 0) 0x7f1da80c23f0 con 0x7f1da80c1f90 2024-05-08T20:54:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.558+0000 7f1dacfd9640 1 -- 172.21.15.81:0/1406799502 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da8155620 con 0x7f1da81535a0 2024-05-08T20:54:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1dacfd9640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da81535a0 0x7f1da815c080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009e50 tx=0x7f1da001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d313b59c99a4fdbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1da6ffd640 1 -- 172.21.15.81:0/1406799502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00a5810 con 0x7f1da81535a0 2024-05-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1da6ffd640 1 -- 172.21.15.81:0/1406799502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00a5970 con 0x7f1da81535a0 2024-05-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1da6ffd640 1 -- 172.21.15.81:0/1406799502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00a5d00 con 0x7f1da81535a0 2024-05-08T20:54:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 -- 172.21.15.81:0/1406799502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da81535a0 msgr2=0x7f1da815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da81535a0 0x7f1da815c080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009e50 tx=0x7f1da001c970 comp rx=0 tx=0).stop 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 -- 172.21.15.81:0/1406799502 shutdown_connections 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da81535a0 0x7f1da815c080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 --2- 172.21.15.81:0/1406799502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1bb0 0x7f1da8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 -- 172.21.15.81:0/1406799502 >> 172.21.15.81:0/1406799502 conn(0x7f1da80c2ca0 msgr2=0x7f1da80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 -- 172.21.15.81:0/1406799502 shutdown_connections 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.562+0000 7f1daea3c640 1 -- 172.21.15.81:0/1406799502 wait complete. 2024-05-08T20:54:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 Processor -- start 2024-05-08T20:54:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- start start 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1f90 0x7f1da81f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da81535a0 0x7f1da81ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da815ad10 con 0x7f1da80c1bb0 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da81ece90 con 0x7f1da81535a0 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8156b20 con 0x7f1da80c1f90 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53134/0 (socket says 172.21.15.81:53134) 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 -- 172.21.15.81:0/3566677747 learned_addr learned my addr 172.21.15.81:0/3566677747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da77fe640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1f90 0x7f1da81f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1dacfd9640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da81535a0 0x7f1da81ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 -- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1f90 msgr2=0x7f1da81f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1f90 0x7f1da81f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 -- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da81535a0 msgr2=0x7f1da81ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da81535a0 0x7f1da81ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 -- 172.21.15.81:0/3566677747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0009b30 con 0x7f1da80c1bb0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da7fff640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d5f0 tx=0x7f1d9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980125f0 con 0x7f1da80c1bb0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d98012750 con 0x7f1da80c1bb0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da8156e00 con 0x7f1da80c1bb0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98012ae0 con 0x7f1da80c1bb0 2024-05-08T20:54:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da81ed150 con 0x7f1da80c1bb0 2024-05-08T20:54:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8154c70 con 0x7f1da80c1bb0 2024-05-08T20:54:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d98012c40 con 0x7f1da80c1bb0 2024-05-08T20:54:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 0x7f1d88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1d980848d0 con 0x7f1da80c1bb0 2024-05-08T20:54:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.566+0000 7f1da77fe640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 0x7f1d88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.570+0000 7f1da77fe640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 0x7f1d88068b50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1da81ead40 tx=0x7f1d90007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.574+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1d98051930 con 0x7f1da80c1bb0 2024-05-08T20:54:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1da8074950 con 0x7f1da80c1bb0 2024-05-08T20:54:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1da4ff9640 1 -- 172.21.15.81:0/3566677747 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f1d98054f50 con 0x7f1da80c1bb0 2024-05-08T20:54:01.795 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":204,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:54:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 msgr2=0x7f1d88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 0x7f1d88068b50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1da81ead40 tx=0x7f1d90007df0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 msgr2=0x7f1da815b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800d5f0 tx=0x7f1d9800dab0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 shutdown_connections 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1d88066690 0x7f1d88068b50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1da81535a0 0x7f1da81ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1da80c1f90 0x7f1da81f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 --2- 172.21.15.81:0/3566677747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1da80c1bb0 0x7f1da815b110 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 >> 172.21.15.81:0/3566677747 conn(0x7f1da80c2ca0 msgr2=0x7f1da80c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 shutdown_connections 2024-05-08T20:54:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:01.790+0000 7f1daea3c640 1 -- 172.21.15.81:0/3566677747 wait complete. 2024-05-08T20:54:04.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:54:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.922+0000 7f1c1e775640 1 Processor -- start 2024-05-08T20:54:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.922+0000 7f1c1e775640 1 -- start start 2024-05-08T20:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1e775640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c1815cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1e775640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180abc50 con 0x7f1c1814e410 2024-05-08T20:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1e775640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180c2900 con 0x7f1c1806afd0 2024-05-08T20:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1e775640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180aa320 con 0x7f1c1815a7a0 2024-05-08T20:54:04.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c17fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c1814e410 0x7f1c180aa6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58634/0 (socket says 172.21.15.81:58634) 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c17fff640 1 -- 172.21.15.81:0/3800785108 learned_addr learned my addr 172.21.15.81:0/3800785108 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c1815cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772410838 0 0) 0x7f1c180abc50 con 0x7f1c1814e410 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c00003530 con 0x7f1c1814e410 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726711454 0 0) 0x7f1c00003530 con 0x7f1c1814e410 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 msgr2=0x7f1c1815cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c1815cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 >> v1:172.21.15.117:6789/0 conn(0x7f1c1806afd0 legacy=0x7f1c1806b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180a9560 con 0x7f1c1814e410 2024-05-08T20:54:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1c0c001a00 con 0x7f1c1814e410 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 >> v1:172.21.15.81:6789/0 conn(0x7f1c1814e410 legacy=0x7f1c180aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c000039b0 0x7f1c00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180aa320 con 0x7f1c00004d10 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000cc00 con 0x7f1c000039b0 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0000cdc0 con 0x7f1c1815a7a0 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c177fe640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c17fff640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c000039b0 0x7f1c00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 -- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 msgr2=0x7f1c000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c1815a7a0 0x7f1c000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 -- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c000039b0 msgr2=0x7f1c00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c000039b0 0x7f1c00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c1cd12640 1 -- 172.21.15.81:0/3800785108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00003530 con 0x7f1c00004d10 2024-05-08T20:54:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.926+0000 7f1c17fff640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c000039b0 0x7f1c00003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c00005190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c18069b50 tx=0x7f1c1001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a73d5002bb7530 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100a5600 con 0x7f1c00004d10 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c002100 con 0x7f1c00004d10 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c16ffd640 1 -- 172.21.15.81:0/3800785108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100a59a0 con 0x7f1c00004d10 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- 172.21.15.81:0/3800785108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 msgr2=0x7f1c00005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 --2- 172.21.15.81:0/3800785108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c00005190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c18069b50 tx=0x7f1c1001ca10 comp rx=0 tx=0).stop 2024-05-08T20:54:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1cd12640 1 -- 172.21.15.81:0/3800785108 reap_dead start 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- 172.21.15.81:0/3800785108 shutdown_connections 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- 172.21.15.81:0/3800785108 >> 172.21.15.81:0/3800785108 conn(0x7f1c180c2ca0 msgr2=0x7f1c180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- 172.21.15.81:0/3800785108 shutdown_connections 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- 172.21.15.81:0/3800785108 wait complete. 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 Processor -- start 2024-05-08T20:54:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- start start 2024-05-08T20:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c181ee510 0x7f1c180aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18153ce0 0x7f1c181ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181ee080 con 0x7f1c00004d10 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181548d0 con 0x7f1c18153ce0 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1e775640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181545f0 con 0x7f1c181ee510 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 -- 172.21.15.81:0/1841699581 learned_addr learned my addr 172.21.15.81:0/1841699581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c177fe640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c181ee510 0x7f1c180aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c1cd12640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18153ce0 0x7f1c181ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 -- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c181ee510 msgr2=0x7f1c180aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c181ee510 0x7f1c180aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 -- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18153ce0 msgr2=0x7f1c181ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18153ce0 0x7f1c181ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.930+0000 7f1c17fff640 1 -- 172.21.15.81:0/1841699581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c181eda30 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c17fff640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c010ad0 tx=0x7f1c0c010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00ecd0 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00ee30 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c181edd10 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0145c0 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c18154160 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1814de20 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c0c014720 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1c0c087460 con 0x7f1c00004d10 2024-05-08T20:54:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c177fe640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:04.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.934+0000 7f1c177fe640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 0x7f1c04068b50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1c18155460 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:04.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:04.938+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1c0c054580 con 0x7f1c00004d10 2024-05-08T20:54:05.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.158+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1c180a9db0 con 0x7f1c00004d10 2024-05-08T20:54:05.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.158+0000 7f1c14ff9640 1 -- 172.21.15.81:0/1841699581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1c0c057ba0 con 0x7f1c00004d10 2024-05-08T20:54:05.164 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":210,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 msgr2=0x7f1c04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 0x7f1c04068b50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1c18155460 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 msgr2=0x7f1c18155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c010ad0 tx=0x7f1c0c010f90 comp rx=0 tx=0).stop 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 shutdown_connections 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1c04066690 0x7f1c04068b50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c18153ce0 0x7f1c181ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c181ee510 0x7f1c180aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 --2- 172.21.15.81:0/1841699581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c00004d10 0x7f1c18155850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 >> 172.21.15.81:0/1841699581 conn(0x7f1c180c2ca0 msgr2=0x7f1c18159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 shutdown_connections 2024-05-08T20:54:05.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.162+0000 7f1c1e775640 1 -- 172.21.15.81:0/1841699581 wait complete. 2024-05-08T20:54:05.183 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:54:05.183 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-05-08T20:54:05.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-05-08T20:54:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 Processor -- start 2024-05-08T20:54:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 -- start start 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f9a04155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a041522e0 con 0x7f9a04151f00 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040c5f80 con 0x7f9a04155690 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.294+0000 7f9a09c74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0406bb20 con 0x7f9a04154cf0 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a037fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a04151f00 0x7f9a041588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58640/0 (socket says 172.21.15.81:58640) 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a037fe640 1 -- 172.21.15.81:0/458972659 learned_addr learned my addr 172.21.15.81:0/458972659 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269403716 0 0) 0x7f9a041522e0 con 0x7f9a04151f00 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f0003530 con 0x7f9a04151f00 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f9a04155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49492038 0 0) 0x7f99f0003530 con 0x7f9a04151f00 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 msgr2=0x7f9a04155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f9a04155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 >> v1:172.21.15.117:6789/0 conn(0x7f9a04155690 legacy=0x7f9a040ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040c6260 con 0x7f9a04151f00 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f99f4001680 con 0x7f9a04151f00 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 >> v1:172.21.15.81:6789/0 conn(0x7f9a04151f00 legacy=0x7f9a041588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f99f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f99f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00055a0 con 0x7f99f00047d0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000bed0 con 0x7f99f00039b0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000c010 con 0x7f9a04154cf0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f99f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a037fe640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f9a03fff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f99f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 -- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 msgr2=0x7f99f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04154cf0 0x7f99f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 -- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f00039b0 msgr2=0x7f99f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99f00039b0 0x7f99f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 -- 172.21.15.81:0/458972659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0003530 con 0x7f99f00047d0 2024-05-08T20:54:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.298+0000 7f99fbfff640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f99f0004c50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00ba30 tx=0x7f99ec01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ff048b6f1e072 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0a9680 con 0x7f99f00047d0 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec0a97e0 con 0x7f99f00047d0 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a02ffd640 1 -- 172.21.15.81:0/458972659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0a9b90 con 0x7f99f00047d0 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- 172.21.15.81:0/458972659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 msgr2=0x7f99f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 --2- 172.21.15.81:0/458972659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f99f0004c50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00ba30 tx=0x7f99ec01c6a0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a03fff640 1 -- 172.21.15.81:0/458972659 reap_dead start 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- 172.21.15.81:0/458972659 shutdown_connections 2024-05-08T20:54:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- 172.21.15.81:0/458972659 >> 172.21.15.81:0/458972659 conn(0x7f9a040715f0 msgr2=0x7f9a04071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- 172.21.15.81:0/458972659 shutdown_connections 2024-05-08T20:54:05.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- 172.21.15.81:0/458972659 wait complete. 2024-05-08T20:54:05.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 Processor -- start 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- start start 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04156340 0x7f9a0415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0415a550 0x7f9a041f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041f1c60 con 0x7f99f00047d0 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040af1e0 con 0x7f9a0415a550 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a09c74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040af4c0 con 0x7f9a04156340 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53188/0 (socket says 172.21.15.81:53188) 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 -- 172.21.15.81:0/369787385 learned_addr learned my addr 172.21.15.81:0/369787385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04156340 0x7f9a0415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a03fff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0415a550 0x7f9a041f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04156340 msgr2=0x7f9a0415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04156340 0x7f9a0415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0415a550 msgr2=0x7f9a041f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a0415a550 0x7f9a041f0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f9a037fe640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041f1980 con 0x7f99f00047d0 2024-05-08T20:54:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.302+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a04156340 0x7f9a0415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a037fe640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99f400e7b0 tx=0x7f99f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400ee60 con 0x7f99f00047d0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400c8d0 con 0x7f99f00047d0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a041567c0 con 0x7f99f00047d0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400cc60 con 0x7f99f00047d0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a041f14c0 con 0x7f99f00047d0 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a09c74640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 0x7f9a041482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0414c3b0 con 0x7f9a04147e30 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 0x7f9a041482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f99fbfff640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a041554e0 con 0x7f9a04147e30 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 0x7f9a041482b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00ba00 tx=0x7f99ec019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99f401d460 con 0x7f99f00047d0 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99e4066690 0x7f99e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec004020 con 0x7f9a04147e30 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f99f4084450 con 0x7f99f00047d0 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a03fff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99e4066690 0x7f99e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f99ec004180 con 0x7f9a04147e30 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 msgr2=0x7f9a041482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 0x7f9a041482b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00ba00 tx=0x7f99ec019440 comp rx=0 tx=0).stop 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 msgr2=0x7f9a041482b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a00ff9640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a04147e30 0x7f9a041482b0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00ba00 tx=0x7f99ec019440 comp rx=0 tx=0).stop 2024-05-08T20:54:05.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.306+0000 7f9a03fff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99e4066690 0x7f99e4068b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9a0408c580 tx=0x7f99fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 0x7f9a04149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04069600 con 0x7f9a041487f0 2024-05-08T20:54:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 0x7f9a04149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f99fbfff640 1 -- 172.21.15.81:0/369787385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a04148c00 con 0x7f9a041487f0 2024-05-08T20:54:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f99fbfff640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 0x7f9a04149740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c10 tx=0x7f99f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0c1040 con 0x7f9a041487f0 2024-05-08T20:54:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4978 (secure 0 0 0) 0x7f99ec003a50 con 0x7f9a041487f0 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 msgr2=0x7f9a04149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 0x7f9a04149740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c10 tx=0x7f99f0005800 comp rx=0 tx=0).stop 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 msgr2=0x7f9a04149740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a00ff9640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a041487f0 0x7f9a04149740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 210, 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:54:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:54:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": [ 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:54:05.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99e4066690 msgr2=0x7f99e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f99e4066690 0x7f99e4068b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9a0408c580 tx=0x7f99fc009040 comp rx=0 tx=0).stop 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 msgr2=0x7f9a0414d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f99f400e7b0 tx=0x7f99f400ec70 comp rx=0 tx=0).stop 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a03fff640 1 -- 172.21.15.81:0/369787385 reap_dead start 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 shutdown_connections 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 --2- 172.21.15.81:0/369787385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f00047d0 0x7f9a0414d1a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 >> 172.21.15.81:0/369787385 conn(0x7f9a040715f0 msgr2=0x7f9a040ab680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 shutdown_connections 2024-05-08T20:54:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.314+0000 7f9a09c74640 1 -- 172.21.15.81:0/369787385 wait complete. 2024-05-08T20:54:05.337 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:54:05.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-05-08T20:54:05.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-05-08T20:54:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.494+0000 7f4f1ebcc640 1 Processor -- start 2024-05-08T20:54:05.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.494+0000 7f4f1ebcc640 1 -- start start 2024-05-08T20:54:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1ebcc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 0x7f4f18154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1ebcc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f1806afd0 0x7f4f18154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1ebcc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f18152030 con 0x7f4f1814ea20 2024-05-08T20:54:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1ebcc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1806fc70 con 0x7f4f180ab800 2024-05-08T20:54:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1ebcc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f18152310 con 0x7f4f1806afd0 2024-05-08T20:54:05.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1d3c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 0x7f4f18154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1e3cb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f1806afd0 0x7f4f18154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1d3c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 0x7f4f18154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53198/0 (socket says 172.21.15.81:53198) 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1d3c9640 1 -- 172.21.15.81:0/952715274 learned_addr learned my addr 172.21.15.81:0/952715274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1e3cb640 1 -- 172.21.15.81:0/952715274 >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 msgr2=0x7f4f18154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1e3cb640 1 --2- 172.21.15.81:0/952715274 >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 0x7f4f18154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1e3cb640 1 -- 172.21.15.81:0/952715274 >> v1:172.21.15.117:6789/0 conn(0x7f4f1814ea20 legacy=0x7f4f1806cec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:54:05.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.498+0000 7f4f1e3cb640 1 -- 172.21.15.81:0/952715274 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180c19a0 con 0x7f4f1806afd0 2024-05-08T20:54:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.502+0000 7f4f1e3cb640 1 --2- 172.21.15.81:0/952715274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f18154fd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c2780 tx=0x7f4f10020c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973dc92bd5d01166 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1cbc8640 1 -- 172.21.15.81:0/952715274 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000d2d0 con 0x7f4f1806afd0 2024-05-08T20:54:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1cbc8640 1 -- 172.21.15.81:0/952715274 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000d430 con 0x7f4f1806afd0 2024-05-08T20:54:05.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1cbc8640 1 -- 172.21.15.81:0/952715274 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100a9b40 con 0x7f4f1806afd0 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/952715274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 msgr2=0x7f4f18154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 --2- 172.21.15.81:0/952715274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f18154fd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c2780 tx=0x7f4f10020c60 comp rx=0 tx=0).stop 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/952715274 shutdown_connections 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 --2- 172.21.15.81:0/952715274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f18154fd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 --2- 172.21.15.81:0/952715274 >> v2:172.21.15.81:3300/0 conn(0x7f4f180ab800 0x7f4f18154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/952715274 >> 172.21.15.81:0/952715274 conn(0x7f4f180c2a90 msgr2=0x7f4f180c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/952715274 shutdown_connections 2024-05-08T20:54:05.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.506+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/952715274 wait complete. 2024-05-08T20:54:05.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.510+0000 7f4f1ebcc640 1 Processor -- start 2024-05-08T20:54:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- start start 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f181e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1814ea20 0x7f4f180c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1814d300 con 0x7f4f180ab800 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180721d0 con 0x7f4f1806afd0 2024-05-08T20:54:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180724b0 con 0x7f4f1814ea20 2024-05-08T20:54:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53204/0 (socket says 172.21.15.81:53204) 2024-05-08T20:54:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 -- 172.21.15.81:0/2275664196 learned_addr learned my addr 172.21.15.81:0/2275664196 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1dbca640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f181e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1814ea20 msgr2=0x7f4f180c5380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f1814ea20 0x7f4f180c5380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 msgr2=0x7f4f181e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f1806afd0 0x7f4f181e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1000f050 con 0x7f4f180ab800 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1d3c9640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400fad0 tx=0x7f4f1400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14018440 con 0x7f4f180ab800 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140185a0 con 0x7f4f180ab800 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14018910 con 0x7f4f180ab800 2024-05-08T20:54:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f181e8f60 con 0x7f4f180ab800 2024-05-08T20:54:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.514+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18145180 con 0x7f4f180ab800 2024-05-08T20:54:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1ebcc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 0x7f4f18070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1ebcc640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18069550 con 0x7f4f18071d40 2024-05-08T20:54:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1dbca640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 0x7f4f18070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f14018a70 con 0x7f4f180ab800 2024-05-08T20:54:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1dbca640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f1814f170 con 0x7f4f18071d40 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4efc066690 0x7f4efc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4f14084d00 con 0x7f4f180ab800 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1e3cb640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4efc066690 0x7f4efc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1dbca640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 0x7f4f18070260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800d500 tx=0x7f4f0800d9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014620 con 0x7f4f18071d40 2024-05-08T20:54:05.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f1e3cb640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4efc066690 0x7f4efc068b50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4f100b2000 tx=0x7f4f100ab070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f4f08014780 con 0x7f4f18071d40 2024-05-08T20:54:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 msgr2=0x7f4f18070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 0x7f4f18070260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800d500 tx=0x7f4f0800d9c0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 msgr2=0x7f4f18070260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.518+0000 7f4f0e7fc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f18071d40 0x7f4f18070260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.526+0000 7f4efbfff640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 0x7f4ef4004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.526+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4007d20 con 0x7f4ef40028f0 2024-05-08T20:54:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.526+0000 7f4f1dbca640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 0x7f4ef4004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.526+0000 7f4f1dbca640 1 -- 172.21.15.81:0/2275664196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4ef4007ee0 con 0x7f4ef40028f0 2024-05-08T20:54:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f1dbca640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 0x7f4ef4004d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800d500 tx=0x7f4f08004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003bd0 con 0x7f4ef40028f0 2024-05-08T20:54:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 <== mon.1 v2:172.21.15.117:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f4f08003d30 con 0x7f4ef40028f0 2024-05-08T20:54:05.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 msgr2=0x7f4ef4004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 0x7f4ef4004d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800d500 tx=0x7f4f08004700 comp rx=0 tx=0).stop 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 msgr2=0x7f4ef4004d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f0e7fc640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ef40028f0 0x7f4ef4004d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 210, 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:54:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:54:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:54:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:54:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4efc066690 msgr2=0x7f4efc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4efc066690 0x7f4efc068b50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4f100b2000 tx=0x7f4f100ab070 comp rx=0 tx=0).stop 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 msgr2=0x7f4f18144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400fad0 tx=0x7f4f1400ff90 comp rx=0 tx=0).stop 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4f1e3cb640 1 -- 172.21.15.81:0/2275664196 reap_dead start 2024-05-08T20:54:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 shutdown_connections 2024-05-08T20:54:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 --2- 172.21.15.81:0/2275664196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f180ab800 0x7f4f18144c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 >> 172.21.15.81:0/2275664196 conn(0x7f4f180c2a90 msgr2=0x7f4f180aa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 shutdown_connections 2024-05-08T20:54:05.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.530+0000 7f4efbfff640 1 -- 172.21.15.81:0/2275664196 wait complete. 2024-05-08T20:54:05.570 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:54:05.570 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-05-08T20:54:05.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-05-08T20:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.750+0000 7fc32a5d7640 1 Processor -- start 2024-05-08T20:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.750+0000 7fc32a5d7640 1 -- start start 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc32a5d7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 0x7fc3240c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc32a5d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc32a5d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3240c4d00 con 0x7fc3240c72d0 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc32a5d7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240c5bd0 con 0x7fc324152120 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc32a5d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240c52c0 con 0x7fc3240c8280 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:48922/0 (socket says 172.21.15.81:48922) 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 -- 172.21.15.81:0/2694251262 learned_addr learned my addr 172.21.15.81:0/2694251262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc323fff640 1 --2- 172.21.15.81:0/2694251262 >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 0x7fc3240c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 -- 172.21.15.81:0/2694251262 >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 msgr2=0x7fc3240c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 --2- 172.21.15.81:0/2694251262 >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 0x7fc3240c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 -- 172.21.15.81:0/2694251262 >> v1:172.21.15.117:6789/0 conn(0x7fc3240c72d0 legacy=0x7fc324155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc322ffd640 1 -- 172.21.15.81:0/2694251262 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676701131 0 0) 0x7fc3240c4d00 con 0x7fc3240c72d0 2024-05-08T20:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc3237fe640 1 -- 172.21.15.81:0/2694251262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32406a970 con 0x7fc3240c8280 2024-05-08T20:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.754+0000 7fc323fff640 1 --2- 172.21.15.81:0/2694251262 >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 0x7fc3240c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.758+0000 7fc3237fe640 1 --2- 172.21.15.81:0/2694251262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc314009870 tx=0x7fc31401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a21c026b31b70a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.758+0000 7fc322ffd640 1 -- 172.21.15.81:0/2694251262 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140a95f0 con 0x7fc3240c8280 2024-05-08T20:54:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.758+0000 7fc322ffd640 1 -- 172.21.15.81:0/2694251262 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140a9750 con 0x7fc3240c8280 2024-05-08T20:54:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.758+0000 7fc322ffd640 1 -- 172.21.15.81:0/2694251262 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140a9ae0 con 0x7fc3240c8280 2024-05-08T20:54:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 -- 172.21.15.81:0/2694251262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 msgr2=0x7fc324154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/2694251262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc314009870 tx=0x7fc31401c530 comp rx=0 tx=0).stop 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 -- 172.21.15.81:0/2694251262 shutdown_connections 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/2694251262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c8280 0x7fc324154ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/2694251262 >> v2:172.21.15.117:3300/0 conn(0x7fc324152120 0x7fc3240c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 -- 172.21.15.81:0/2694251262 >> 172.21.15.81:0/2694251262 conn(0x7fc3240abfb0 msgr2=0x7fc3240ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 -- 172.21.15.81:0/2694251262 shutdown_connections 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.766+0000 7fc32a5d7640 1 -- 172.21.15.81:0/2694251262 wait complete. 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.770+0000 7fc32a5d7640 1 Processor -- start 2024-05-08T20:54:05.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.770+0000 7fc32a5d7640 1 -- start start 2024-05-08T20:54:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c72d0 0x7fc324150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3240c8280 0x7fc324148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 0x7fc324148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240aba20 con 0x7fc324152120 2024-05-08T20:54:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240a9fb0 con 0x7fc3240c8280 2024-05-08T20:54:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.782+0000 7fc32a5d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240abc70 con 0x7fc3240c72d0 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 0x7fc324148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 0x7fc324148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53216/0 (socket says 172.21.15.81:53216) 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 learned_addr learned my addr 172.21.15.81:0/782227253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc3237fe640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3240c8280 0x7fc324148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc323fff640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c72d0 0x7fc324150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c72d0 msgr2=0x7fc324150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3240c72d0 0x7fc324150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3240c8280 msgr2=0x7fc324148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3240c8280 0x7fc324148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140094d0 con 0x7fc324152120 2024-05-08T20:54:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.786+0000 7fc328b74640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 0x7fc324148ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c750 tx=0x7fc31c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.794+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c003db0 con 0x7fc324152120 2024-05-08T20:54:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00ce60 con 0x7fc324152120 2024-05-08T20:54:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3241ed510 con 0x7fc324152120 2024-05-08T20:54:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc324151390 con 0x7fc324152120 2024-05-08T20:54:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c005270 con 0x7fc324152120 2024-05-08T20:54:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc31c0053d0 con 0x7fc324152120 2024-05-08T20:54:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.798+0000 7fc320ff9640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3100666e0 0x7fc310068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc323fff640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3100666e0 0x7fc310068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc31c083ac0 con 0x7fc324152120 2024-05-08T20:54:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc323fff640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3100666e0 0x7fc310068ba0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc3240ab9b0 tx=0x7fc318008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 0x7fc304004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc304007e90 con 0x7fc304002a40 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc3237fe640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 0x7fc304004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc3237fe640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc304008050 con 0x7fc304002a40 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc3237fe640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 0x7fc304004f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3240c6760 tx=0x7fc31401ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140bf070 con 0x7fc304002a40 2024-05-08T20:54:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc3140bb400 con 0x7fc304002a40 2024-05-08T20:54:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.802+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 msgr2=0x7fc304004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.806+0000 7fc320ff9640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 0x7fc304004f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3240c6760 tx=0x7fc31401ad70 comp rx=0 tx=0).stop 2024-05-08T20:54:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.806+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 msgr2=0x7fc304004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.806+0000 7fc320ff9640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304002a40 0x7fc304004f00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 0x7fc304007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30400a3f0 con 0x7fc304006f00 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc3237fe640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 0x7fc304007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc3237fe640 1 -- 172.21.15.81:0/782227253 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc3040078d0 con 0x7fc304006f00 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc3237fe640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 0x7fc304007390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc31401abe0 tx=0x7fc3140192d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140c3b40 con 0x7fc304006f00 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 <== mon.2 v2:172.21.15.117:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fc314003e50 con 0x7fc304006f00 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 msgr2=0x7fc304007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 0x7fc304007390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc31401abe0 tx=0x7fc3140192d0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 msgr2=0x7fc304007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc320ff9640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc304006f00 0x7fc304007390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 210, 2024-05-08T20:54:05.820 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2449958758054445060", 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.821 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540138322906710015", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.822 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-05-08T20:54:05.823 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "d71bfc5b-5bc0-431a-b162-ebb87bd62ea5", 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-05-08T20:26:20.143236Z", 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 18, 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "reef", 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 1, 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-05-08T20:54:05.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-05-08T20:54:05.826 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "reef" 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:3300", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.828 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3300", 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789", 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6789/0", 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-05-08T20:54:05.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:3301", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.117:6790/0", 2024-05-08T20:54:05.831 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.832 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f01cfbffffdffff", 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "luminous", 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-05-08T20:54:05.833 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3100666e0 msgr2=0x7fc310068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc3100666e0 0x7fc310068ba0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc3240ab9b0 tx=0x7fc318008040 comp rx=0 tx=0).stop 2024-05-08T20:54:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 msgr2=0x7fc324148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 --2- 172.21.15.81:0/782227253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc324152120 0x7fc324148ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c750 tx=0x7fc31c00cc10 comp rx=0 tx=0).stop 2024-05-08T20:54:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 reap_dead start 2024-05-08T20:54:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc328b74640 1 -- 172.21.15.81:0/782227253 reap_dead start 2024-05-08T20:54:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 shutdown_connections 2024-05-08T20:54:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 >> 172.21.15.81:0/782227253 conn(0x7fc3240abfb0 msgr2=0x7fc3240c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 shutdown_connections 2024-05-08T20:54:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.810+0000 7fc32a5d7640 1 -- 172.21.15.81:0/782227253 wait complete. 2024-05-08T20:54:05.836 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-05-08T20:54:05.836 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-05-08T20:54:05.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-05-08T20:54:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 Processor -- start 2024-05-08T20:54:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 -- start start 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94301501e0 0x7f943006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94300725f0 0x7f94300c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94300c0650 con 0x7f943006f400 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943006fd60 con 0x7f94300725f0 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f9435e1e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9430072180 con 0x7f94301501e0 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f942effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94300725f0 0x7f94300c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f942effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94300725f0 0x7f94300c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53232/0 (socket says 172.21.15.81:53232) 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.954+0000 7f942effd640 1 -- 172.21.15.81:0/1557625711 learned_addr learned my addr 172.21.15.81:0/1557625711 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942effd640 1 -- 172.21.15.81:0/1557625711 >> v2:172.21.15.117:3300/0 conn(0x7f94301501e0 msgr2=0x7f943006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942effd640 1 --2- 172.21.15.81:0/1557625711 >> v2:172.21.15.117:3300/0 conn(0x7f94301501e0 0x7f943006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942effd640 1 -- 172.21.15.81:0/1557625711 >> v1:172.21.15.117:6789/0 conn(0x7f943006f400 legacy=0x7f94300c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942effd640 1 -- 172.21.15.81:0/1557625711 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943006fa80 con 0x7f94300725f0 2024-05-08T20:54:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942effd640 1 --2- 172.21.15.81:0/1557625711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94300725f0 0x7f94300c1c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f943006ae70 tx=0x7f942401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe36f8239d189c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942e7fc640 1 -- 172.21.15.81:0/1557625711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240ac410 con 0x7f94300725f0 2024-05-08T20:54:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942e7fc640 1 -- 172.21.15.81:0/1557625711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94240ac570 con 0x7f94300725f0 2024-05-08T20:54:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f942e7fc640 1 -- 172.21.15.81:0/1557625711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240ac900 con 0x7f94300725f0 2024-05-08T20:54:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 -- 172.21.15.81:0/1557625711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94300725f0 msgr2=0x7f94300c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1557625711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94300725f0 0x7f94300c1c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f943006ae70 tx=0x7f942401c390 comp rx=0 tx=0).stop 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 -- 172.21.15.81:0/1557625711 shutdown_connections 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1557625711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94300725f0 0x7f94300c1c40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1557625711 >> v2:172.21.15.117:3300/0 conn(0x7f94301501e0 0x7f943006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 -- 172.21.15.81:0/1557625711 >> 172.21.15.81:0/1557625711 conn(0x7f94300c2ca0 msgr2=0x7f94300c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 -- 172.21.15.81:0/1557625711 shutdown_connections 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.958+0000 7f9435e1e640 1 -- 172.21.15.81:0/1557625711 wait complete. 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 Processor -- start 2024-05-08T20:54:05.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- start start 2024-05-08T20:54:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 0x7f94300aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94300725f0 0x7f94300bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94300ab170 con 0x7f94301501e0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94300ab3a0 con 0x7f943006f400 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943014a130 con 0x7f94300725f0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53246/0 (socket says 172.21.15.81:53246) 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 -- 172.21.15.81:0/1520873842 learned_addr learned my addr 172.21.15.81:0/1520873842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942f7fe640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 0x7f94300aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942effd640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94300725f0 0x7f94300bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 -- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94300725f0 msgr2=0x7f94300bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94300725f0 0x7f94300bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 -- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 msgr2=0x7f94300aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 0x7f94300aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 -- 172.21.15.81:0/1520873842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240094d0 con 0x7f94301501e0 2024-05-08T20:54:05.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942f7fe640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 0x7f94300aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942ffff640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f942800b990 tx=0x7f942800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800cba0 con 0x7f94301501e0 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800cd00 con 0x7f94301501e0 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430150740 con 0x7f94301501e0 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428014680 con 0x7f94301501e0 2024-05-08T20:54:05.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9430148190 con 0x7f94301501e0 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943014a2a0 con 0x7f94301501e0 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94280147e0 con 0x7f94301501e0 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 0x7f941c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9428084480 con 0x7f94301501e0 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.962+0000 7f942f7fe640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 0x7f941c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:05.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.966+0000 7f942f7fe640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 0x7f941c068b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f942000a8b0 tx=0x7f9420008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:05.966+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9428051450 con 0x7f94301501e0 2024-05-08T20:54:06.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.286+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f9430074950 con 0x7f94301501e0 2024-05-08T20:54:06.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.290+0000 7f9417fff640 1 -- 172.21.15.81:0/1520873842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f9428059e60 con 0x7f94301501e0 2024-05-08T20:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 msgr2=0x7f941c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 0x7f941c068b50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f942000a8b0 tx=0x7f9420008040 comp rx=0 tx=0).stop 2024-05-08T20:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 msgr2=0x7f943013f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f942800b990 tx=0x7f942800be50 comp rx=0 tx=0).stop 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 shutdown_connections 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f941c066690 0x7f941c068b50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301501e0 0x7f943013f610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94300725f0 0x7f94300bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 --2- 172.21.15.81:0/1520873842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f943006f400 0x7f94300aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 >> 172.21.15.81:0/1520873842 conn(0x7f94300c2ca0 msgr2=0x7f943006c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 shutdown_connections 2024-05-08T20:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:06.294+0000 7f9435e1e640 1 -- 172.21.15.81:0/1520873842 wait complete. 2024-05-08T20:54:06.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-05-08T20:54:09.294 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T20:54:09.294 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-08T20:54:09.382 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-05-08T20:54:09.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-08T20:54:09.754 DEBUG:teuthology.parallel:result is None 2024-05-08T20:54:09.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:54:09.776 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:54:09.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-08T20:54:09.804 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-08T20:54:09.804 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-05-08T20:54:09.813 INFO:tasks.mon_thrash:joining mon_thrasher 2024-05-08T20:54:16.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:54:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.450+0000 7f0993aaf640 1 Processor -- start 2024-05-08T20:54:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.450+0000 7f0993aaf640 1 -- start start 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0993aaf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f098c0725f0 0x7f098c0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0993aaf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0993aaf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c0650 con 0x7f098c1501e0 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0993aaf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c06fd60 con 0x7f098c0725f0 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0993aaf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c072180 con 0x7f098c06f400 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f098c0725f0 0x7f098c0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099184b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f098c1501e0 0x7f098c06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54542/0 (socket says 172.21.15.81:54542) 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099184b640 1 -- 172.21.15.81:0/754139579 learned_addr learned my addr 172.21.15.81:0/754139579 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099204c640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 -- 172.21.15.81:0/754139579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 msgr2=0x7f098c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c0c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 -- 172.21.15.81:0/754139579 >> v1:172.21.15.81:6789/0 conn(0x7f098c1501e0 legacy=0x7f098c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0990849640 1 -- 172.21.15.81:0/754139579 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032019189 0 0) 0x7f098c0c0650 con 0x7f098c1501e0 2024-05-08T20:54:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 -- 172.21.15.81:0/754139579 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c06fa80 con 0x7f098c0725f0 2024-05-08T20:54:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f099104a640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c0c1c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09880097c0 tx=0x7f098801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1f51b647de712a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0990849640 1 -- 172.21.15.81:0/754139579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880ab600 con 0x7f098c0725f0 2024-05-08T20:54:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0990849640 1 -- 172.21.15.81:0/754139579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880a7050 con 0x7f098c0725f0 2024-05-08T20:54:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.454+0000 7f0990849640 1 -- 172.21.15.81:0/754139579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880ab980 con 0x7f098c0725f0 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/754139579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 msgr2=0x7f098c0c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c0c1c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09880097c0 tx=0x7f098801c350 comp rx=0 tx=0).stop 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/754139579 shutdown_connections 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- 172.21.15.81:0/754139579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c0c1c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/754139579 >> 172.21.15.81:0/754139579 conn(0x7f098c0c2ca0 msgr2=0x7f098c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/754139579 shutdown_connections 2024-05-08T20:54:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/754139579 wait complete. 2024-05-08T20:54:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 Processor -- start 2024-05-08T20:54:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- start start 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 0x7f098c0bf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0ab2d0 con 0x7f098c0725f0 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1ee150 con 0x7f098c1501e0 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1ed5d0 con 0x7f098c06f400 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36924/0 (socket says 172.21.15.81:36924) 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 -- 172.21.15.81:0/2226274353 learned_addr learned my addr 172.21.15.81:0/2226274353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099204c640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 0x7f098c0bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099184b640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 -- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 msgr2=0x7f098c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 -- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 msgr2=0x7f098c0bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 0x7f098c0bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 -- 172.21.15.81:0/2226274353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009420 con 0x7f098c0725f0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099204c640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 0x7f098c0bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099184b640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f099104a640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09880ae040 tx=0x7f09880190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880b4840 con 0x7f098c0725f0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880b49a0 con 0x7f098c0725f0 2024-05-08T20:54:16.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880b4d50 con 0x7f098c0725f0 2024-05-08T20:54:16.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c150740 con 0x7f098c0725f0 2024-05-08T20:54:16.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.458+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c1edb90 con 0x7f098c0725f0 2024-05-08T20:54:16.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c1f0780 con 0x7f098c0725f0 2024-05-08T20:54:16.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09880b2040 con 0x7f098c0725f0 2024-05-08T20:54:16.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f09827fc640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 0x7f0970068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f098811e7e0 con 0x7f098c0725f0 2024-05-08T20:54:16.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f099184b640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 0x7f0970068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.462+0000 7f099184b640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 0x7f0970068b50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f097c000f70 tx=0x7f097c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.466+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f098c1f0780 con 0x7f098c0725f0 2024-05-08T20:54:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.658+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f098c1f0780 con 0x7f098c0725f0 2024-05-08T20:54:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.658+0000 7f09827fc640 1 -- 172.21.15.81:0/2226274353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f098c1f0780 con 0x7f098c0725f0 2024-05-08T20:54:16.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:16.665 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:54:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 msgr2=0x7f0970068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 0x7f0970068b50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f097c000f70 tx=0x7f097c009040 comp rx=0 tx=0).stop 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 msgr2=0x7f098c14b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09880ae040 tx=0x7f09880190f0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 shutdown_connections 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0970066690 0x7f0970068b50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f098c1501e0 0x7f098c0bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c0725f0 0x7f098c14b200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 --2- 172.21.15.81:0/2226274353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f098c06f400 0x7f098c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 >> 172.21.15.81:0/2226274353 conn(0x7f098c0c2ca0 msgr2=0x7f098c140f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 shutdown_connections 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.662+0000 7f0993aaf640 1 -- 172.21.15.81:0/2226274353 wait complete. 2024-05-08T20:54:16.684 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-05-08T20:54:16.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-05-08T20:54:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 Processor -- start 2024-05-08T20:54:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 -- start start 2024-05-08T20:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 0x7f36b00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b006f400 0x7f36b00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b006fd60 con 0x7f36b006f400 2024-05-08T20:54:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b0072180 con 0x7f36b00725f0 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36b54e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00c0650 con 0x7f36b01501e0 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b006f400 0x7f36b00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36b006f400 0x7f36b00c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36926/0 (socket says 172.21.15.81:36926) 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 -- 172.21.15.81:0/892661906 learned_addr learned my addr 172.21.15.81:0/892661906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36aeffd640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36ae7fc640 1 --2- 172.21.15.81:0/892661906 >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 0x7f36b00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 -- 172.21.15.81:0/892661906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 msgr2=0x7f36b006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 -- 172.21.15.81:0/892661906 >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 msgr2=0x7f36b00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 --2- 172.21.15.81:0/892661906 >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 0x7f36b00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36af7fe640 1 -- 172.21.15.81:0/892661906 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b006fa80 con 0x7f36b006f400 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36ae7fc640 1 --2- 172.21.15.81:0/892661906 >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 0x7f36b00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.794+0000 7f36aeffd640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36af7fe640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b006f400 0x7f36b00c2180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36b006eed0 tx=0x7f36a801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbf6955183daeee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36adffb640 1 -- 172.21.15.81:0/892661906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80a5650 con 0x7f36b006f400 2024-05-08T20:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36adffb640 1 -- 172.21.15.81:0/892661906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80a57b0 con 0x7f36b006f400 2024-05-08T20:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36adffb640 1 -- 172.21.15.81:0/892661906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80a5b40 con 0x7f36b006f400 2024-05-08T20:54:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 -- 172.21.15.81:0/892661906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b006f400 msgr2=0x7f36b00c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b006f400 0x7f36b00c2180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36b006eed0 tx=0x7f36a801c8a0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 -- 172.21.15.81:0/892661906 shutdown_connections 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b006f400 0x7f36b00c2180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 --2- 172.21.15.81:0/892661906 >> v2:172.21.15.117:3300/0 conn(0x7f36b00725f0 0x7f36b00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 --2- 172.21.15.81:0/892661906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 -- 172.21.15.81:0/892661906 >> 172.21.15.81:0/892661906 conn(0x7f36b00c2ca0 msgr2=0x7f36b00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 -- 172.21.15.81:0/892661906 shutdown_connections 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.798+0000 7f36b54e2640 1 -- 172.21.15.81:0/892661906 wait complete. 2024-05-08T20:54:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 Processor -- start 2024-05-08T20:54:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- start start 2024-05-08T20:54:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36b006f400 0x7f36b00c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b00bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0147150 con 0x7f36b00725f0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00a9dc0 con 0x7f36b006f400 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00aa0a0 con 0x7f36b01501e0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36936/0 (socket says 172.21.15.81:36936) 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 -- 172.21.15.81:0/2730511029 learned_addr learned my addr 172.21.15.81:0/2730511029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36af7fe640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b00bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 -- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 msgr2=0x7f36b00bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36aeffd640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36b006f400 0x7f36b00c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b00bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 -- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36b006f400 msgr2=0x7f36b00c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36b006f400 0x7f36b00c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 -- 172.21.15.81:0/2730511029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8009b30 con 0x7f36b00725f0 2024-05-08T20:54:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36ae7fc640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e810 tx=0x7f36a000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004030 con 0x7f36b00725f0 2024-05-08T20:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0004190 con 0x7f36b00725f0 2024-05-08T20:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b00aa380 con 0x7f36b00725f0 2024-05-08T20:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004520 con 0x7f36b00725f0 2024-05-08T20:54:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00c01b0 con 0x7f36b00725f0 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b0074950 con 0x7f36b00725f0 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36a000c6d0 con 0x7f36b00725f0 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.802+0000 7f36977fe640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 0x7f369c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.806+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f36a0084120 con 0x7f36b00725f0 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.806+0000 7f36aeffd640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 0x7f369c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.806+0000 7f36aeffd640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 0x7f369c068b50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36b00c4500 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:16.810+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f36a00510f0 con 0x7f36b00725f0 2024-05-08T20:54:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.034+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f36b00ab3b0 con 0x7f36b00725f0 2024-05-08T20:54:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.034+0000 7f36977fe640 1 -- 172.21.15.81:0/2730511029 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f36a0020620 con 0x7f36b00725f0 2024-05-08T20:54:17.041 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":210,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","modified":"2024-05-08T20:26:20.143236Z","created":"2024-05-08T20:26:20.143236Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3301","nonce":0},{"type":"v1","addr":"172.21.15.117:6790","nonce":0}]},"addr":"172.21.15.117:6790/0","public_addr":"172.21.15.117:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 msgr2=0x7f369c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 0x7f369c068b50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36b00c4500 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 msgr2=0x7f36b00aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e810 tx=0x7f36a000ecd0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 shutdown_connections 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f369c066690 0x7f369c068b50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36b01501e0 0x7f36b00bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b00725f0 0x7f36b00aab80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 --2- 172.21.15.81:0/2730511029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36b006f400 0x7f36b00c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 >> 172.21.15.81:0/2730511029 conn(0x7f36b00c2ca0 msgr2=0x7f36b01400b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 shutdown_connections 2024-05-08T20:54:17.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.038+0000 7f36b54e2640 1 -- 172.21.15.81:0/2730511029 wait complete. 2024-05-08T20:54:17.059 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-05-08T20:54:17.059 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-08T20:54:17.068 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T20:54:17.069 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:54:17.069 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:17.083 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:54:17.084 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:17.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.290+0000 7fc321281640 1 Processor -- start 2024-05-08T20:54:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 -- start start 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc31c0725f0 0x7fc31c0c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c0c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0c0650 con 0x7fc31c1501e0 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c06fd60 con 0x7fc31c0725f0 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc321281640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c072180 con 0x7fc31c06f400 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c0c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc31c0725f0 0x7fc31c0c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c0c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:33096/0 (socket says 172.21.15.81:33096) 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31b7fe640 1 -- 172.21.15.81:0/1991684233 learned_addr learned my addr 172.21.15.81:0/1991684233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31affd640 1 --1- 172.21.15.81:0/1991684233 >> v1:172.21.15.117:6789/0 conn(0x7fc31c1501e0 0x7fc31c06c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:56868/0 (socket says 172.21.15.81:56868) 2024-05-08T20:54:17.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31a7fc640 1 -- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 msgr2=0x7fc31c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:17.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31a7fc640 1 --2- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c0c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31a7fc640 1 -- 172.21.15.81:0/1991684233 >> v1:172.21.15.117:6789/0 conn(0x7fc31c1501e0 legacy=0x7fc31c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.294+0000 7fc31a7fc640 1 -- 172.21.15.81:0/1991684233 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c06fa80 con 0x7fc31c0725f0 2024-05-08T20:54:17.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc31a7fc640 1 --2- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c0725f0 0x7fc31c0c1c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097c0 tx=0x7fc30401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ffac1edcfe63c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc319ffb640 1 -- 172.21.15.81:0/1991684233 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040ab600 con 0x7fc31c0725f0 2024-05-08T20:54:17.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc319ffb640 1 -- 172.21.15.81:0/1991684233 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040a7050 con 0x7fc31c0725f0 2024-05-08T20:54:17.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc319ffb640 1 -- 172.21.15.81:0/1991684233 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040ab980 con 0x7fc31c0725f0 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c0725f0 msgr2=0x7fc31c0c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 --2- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c0725f0 0x7fc31c0c1c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc3040097c0 tx=0x7fc30401c350 comp rx=0 tx=0).stop 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- 172.21.15.81:0/1991684233 shutdown_connections 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 --2- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c0c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 --2- 172.21.15.81:0/1991684233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c0725f0 0x7fc31c0c1c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- 172.21.15.81:0/1991684233 >> 172.21.15.81:0/1991684233 conn(0x7fc31c0c2ca0 msgr2=0x7fc31c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- 172.21.15.81:0/1991684233 shutdown_connections 2024-05-08T20:54:17.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- 172.21.15.81:0/1991684233 wait complete. 2024-05-08T20:54:17.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 Processor -- start 2024-05-08T20:54:17.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.298+0000 7fc321281640 1 -- start start 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c13b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 0x7fc31c142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c143c60 con 0x7fc31c0725f0 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c13cfd0 con 0x7fc31c1501e0 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c13d810 con 0x7fc31c06f400 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36946/0 (socket says 172.21.15.81:36946) 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 -- 172.21.15.81:0/612275053 learned_addr learned my addr 172.21.15.81:0/612275053 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31b7fe640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 0x7fc31c142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31affd640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c13b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 -- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 msgr2=0x7fc31c13b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c13b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 -- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 msgr2=0x7fc31c142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 0x7fc31c142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 -- 172.21.15.81:0/612275053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009420 con 0x7fc31c0725f0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31b7fe640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 0x7fc31c142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31a7fc640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3040ae040 tx=0x7fc3040190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040b4840 con 0x7fc31c0725f0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040b49a0 con 0x7fc31c0725f0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c150740 con 0x7fc31c0725f0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040b4d50 con 0x7fc31c0725f0 2024-05-08T20:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c13c4a0 con 0x7fc31c0725f0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c074950 con 0x7fc31c0725f0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3040b2040 con 0x7fc31c0725f0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 0x7fc2fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc30411e7a0 con 0x7fc31c0725f0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31affd640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 0x7fc2fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.302+0000 7fc31affd640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 0x7fc2fc068b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc30c005fd0 tx=0x7fc30c005ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.306+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc3040eb800 con 0x7fc31c0725f0 2024-05-08T20:54:17.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.466+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31c0670c0 con 0x7fc31c0725f0 2024-05-08T20:54:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc3137fe640 1 -- 172.21.15.81:0/612275053 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7fc3040eee20 con 0x7fc31c0725f0 2024-05-08T20:54:17.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:17.475 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 msgr2=0x7fc2fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 0x7fc2fc068b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc30c005fd0 tx=0x7fc30c005ba0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 msgr2=0x7fc31c1423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3040ae040 tx=0x7fc3040190f0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 shutdown_connections 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc2fc066690 0x7fc2fc068b50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc31c1501e0 0x7fc31c142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0725f0 0x7fc31c1423d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 --2- 172.21.15.81:0/612275053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc31c06f400 0x7fc31c13b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 >> 172.21.15.81:0/612275053 conn(0x7fc31c0c2ca0 msgr2=0x7fc31c0c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 shutdown_connections 2024-05-08T20:54:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.470+0000 7fc321281640 1 -- 172.21.15.81:0/612275053 wait complete. 2024-05-08T20:54:17.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:17.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 Processor -- start 2024-05-08T20:54:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 -- start start 2024-05-08T20:54:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46340c3510 0x7f46340aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46340c38f0 0x7f4634153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4634153880 con 0x7f46340a9970 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46340c47c0 con 0x7f46340c38f0 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463bfc7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46340c6220 con 0x7f46340c3510 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f4639562640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46340a9970 0x7f46340c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54554/0 (socket says 172.21.15.81:54554) 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f4639562640 1 -- 172.21.15.81:0/2324746855 learned_addr learned my addr 172.21.15.81:0/2324746855 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463a564640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46340c38f0 0x7f4634153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f4639d63640 1 --2- 172.21.15.81:0/2324746855 >> v2:172.21.15.117:3300/0 conn(0x7f46340c3510 0x7f46340aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463a564640 1 -- 172.21.15.81:0/2324746855 >> v2:172.21.15.117:3300/0 conn(0x7f46340c3510 msgr2=0x7f46340aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463a564640 1 --2- 172.21.15.81:0/2324746855 >> v2:172.21.15.117:3300/0 conn(0x7f46340c3510 0x7f46340aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463a564640 1 -- 172.21.15.81:0/2324746855 >> v1:172.21.15.81:6789/0 conn(0x7f46340a9970 legacy=0x7f46340c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f463a564640 1 -- 172.21.15.81:0/2324746855 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340c6500 con 0x7f46340c38f0 2024-05-08T20:54:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.610+0000 7f4638d61640 1 -- 172.21.15.81:0/2324746855 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332205035 0 0) 0x7f4624001120 con 0x7f46340a9970 2024-05-08T20:54:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463a564640 1 --2- 172.21.15.81:0/2324746855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340c38f0 0x7f4634153340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f46340c3e80 tx=0x7f462c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3972d64a5f0418b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4638d61640 1 -- 172.21.15.81:0/2324746855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0a5930 con 0x7f46340c38f0 2024-05-08T20:54:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4638d61640 1 -- 172.21.15.81:0/2324746855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c0a5a90 con 0x7f46340c38f0 2024-05-08T20:54:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4638d61640 1 -- 172.21.15.81:0/2324746855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0a5e20 con 0x7f46340c38f0 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- 172.21.15.81:0/2324746855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340c38f0 msgr2=0x7f4634153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- 172.21.15.81:0/2324746855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340c38f0 0x7f4634153340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f46340c3e80 tx=0x7f462c01c870 comp rx=0 tx=0).stop 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- 172.21.15.81:0/2324746855 shutdown_connections 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- 172.21.15.81:0/2324746855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340c38f0 0x7f4634153340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- 172.21.15.81:0/2324746855 >> v2:172.21.15.117:3300/0 conn(0x7f46340c3510 0x7f46340aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- 172.21.15.81:0/2324746855 >> 172.21.15.81:0/2324746855 conn(0x7f46340c68c0 msgr2=0x7f46340c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- 172.21.15.81:0/2324746855 shutdown_connections 2024-05-08T20:54:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- 172.21.15.81:0/2324746855 wait complete. 2024-05-08T20:54:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 Processor -- start 2024-05-08T20:54:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- start start 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 0x7f46341486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46340c38f0 0x7f4634148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634149120 con 0x7f46340a9970 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46341f14a0 con 0x7f46340c3510 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f463bfc7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46341f19d0 con 0x7f46340c38f0 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36960/0 (socket says 172.21.15.81:36960) 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 -- 172.21.15.81:0/3947315399 learned_addr learned my addr 172.21.15.81:0/3947315399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 -- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46340c38f0 msgr2=0x7f4634148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46340c38f0 0x7f4634148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 -- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 msgr2=0x7f46341486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639562640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 0x7f46341486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 0x7f46341486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639d63640 1 -- 172.21.15.81:0/3947315399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009a70 con 0x7f46340a9970 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.614+0000 7f4639562640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 0x7f46341486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f4639d63640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f463000d830 tx=0x7f463000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000b6c0 con 0x7f46340a9970 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000b820 con 0x7f46340a9970 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46341f16f0 con 0x7f46340a9970 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000bb90 con 0x7f46340a9970 2024-05-08T20:54:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463406d820 con 0x7f46340a9970 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634074950 con 0x7f46340a9970 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f463001e460 con 0x7f46340a9970 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4630084cb0 con 0x7f46340a9970 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f4639562640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.618+0000 7f4639562640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 0x7f4618068b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4624007fd0 tx=0x7f4624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.622+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4630051c80 con 0x7f46340a9970 2024-05-08T20:54:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4634073840 con 0x7f46340a9970 2024-05-08T20:54:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f462a7fc640 1 -- 172.21.15.81:0/3947315399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46300552a0 con 0x7f46340a9970 2024-05-08T20:54:17.782 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 msgr2=0x7f4618068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 0x7f4618068b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4624007fd0 tx=0x7f4624009040 comp rx=0 tx=0).stop 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 msgr2=0x7f463414dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f463000d830 tx=0x7f463000dcf0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 shutdown_connections 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46340c38f0 0x7f4634148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46340c3510 0x7f46341486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 --2- 172.21.15.81:0/3947315399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46340a9970 0x7f463414dbc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 >> 172.21.15.81:0/3947315399 conn(0x7f46340c68c0 msgr2=0x7f46341521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 shutdown_connections 2024-05-08T20:54:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.778+0000 7f463bfc7640 1 -- 172.21.15.81:0/3947315399 wait complete. 2024-05-08T20:54:17.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:54:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 Processor -- start 2024-05-08T20:54:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 -- start start 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda601588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda60154cf0 0x7fda60155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda60158e20 con 0x7fda60155690 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6006bb20 con 0x7fda60154cf0 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda64ab6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda601548e0 con 0x7fda60151f00 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda60154cf0 0x7fda60155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fda60155690 0x7fda600ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54564/0 (socket says 172.21.15.81:54564) 2024-05-08T20:54:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5ed9d640 1 -- 172.21.15.81:0/2352264360 learned_addr learned my addr 172.21.15.81:0/2352264360 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5e59c640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda601588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 -- 172.21.15.81:0/2352264360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 msgr2=0x7fda601588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda601588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 -- 172.21.15.81:0/2352264360 >> v1:172.21.15.81:6789/0 conn(0x7fda60155690 legacy=0x7fda600ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 -- 172.21.15.81:0/2352264360 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda601522e0 con 0x7fda60154cf0 2024-05-08T20:54:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5d59a640 1 -- 172.21.15.81:0/2352264360 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368786867 0 0) 0x7fda60158e20 con 0x7fda60155690 2024-05-08T20:54:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.906+0000 7fda5dd9b640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60154cf0 0x7fda60155150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda540097f0 tx=0x7fda5401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a481cf387a9285c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5d59a640 1 -- 172.21.15.81:0/2352264360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ac600 con 0x7fda60154cf0 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5d59a640 1 -- 172.21.15.81:0/2352264360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540a8050 con 0x7fda60154cf0 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5d59a640 1 -- 172.21.15.81:0/2352264360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ac980 con 0x7fda60154cf0 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2352264360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60154cf0 msgr2=0x7fda60155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60154cf0 0x7fda60155150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda540097f0 tx=0x7fda5401c380 comp rx=0 tx=0).stop 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2352264360 shutdown_connections 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60154cf0 0x7fda60155150 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2352264360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda601588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2352264360 >> 172.21.15.81:0/2352264360 conn(0x7fda600715f0 msgr2=0x7fda60071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2352264360 shutdown_connections 2024-05-08T20:54:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2352264360 wait complete. 2024-05-08T20:54:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 Processor -- start 2024-05-08T20:54:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- start start 2024-05-08T20:54:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda6014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda60154cf0 0x7fda60151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60150570 con 0x7fda60155c00 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6014f930 con 0x7fda60154cf0 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6014fbd0 con 0x7fda60151f00 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36986/0 (socket says 172.21.15.81:36986) 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 -- 172.21.15.81:0/2821868871 learned_addr learned my addr 172.21.15.81:0/2821868871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5dd9b640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda60154cf0 0x7fda60151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5e59c640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda6014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 -- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 msgr2=0x7fda6014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda6014b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 -- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda60154cf0 msgr2=0x7fda60151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda60154cf0 0x7fda60151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 -- 172.21.15.81:0/2821868871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009420 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda5ed9d640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c6d0 tx=0x7fda5800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58004d70 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800a640 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6014feb0 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800aa30 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.910+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6014be30 con 0x7fda60155c00 2024-05-08T20:54:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda601506b0 con 0x7fda60155c00 2024-05-08T20:54:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda580070d0 con 0x7fda60155c00 2024-05-08T20:54:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda4effd640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 0x7fda40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda5e59c640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 0x7fda40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fda58083de0 con 0x7fda60155c00 2024-05-08T20:54:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.914+0000 7fda5e59c640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 0x7fda40068b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fda50009790 tx=0x7fda50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:17.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:17.918+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fda58050e40 con 0x7fda60155c00 2024-05-08T20:54:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.062+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda60074950 con 0x7fda60155c00 2024-05-08T20:54:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.062+0000 7fda4effd640 1 -- 172.21.15.81:0/2821868871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fda58018020 con 0x7fda60155c00 2024-05-08T20:54:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 msgr2=0x7fda40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 0x7fda40068b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fda50009790 tx=0x7fda50008040 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 msgr2=0x7fda601560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda5800c6d0 tx=0x7fda5800cb90 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 shutdown_connections 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fda40066690 0x7fda40068b50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda60155c00 0x7fda601560b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda60154cf0 0x7fda60151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 --2- 172.21.15.81:0/2821868871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda60151f00 0x7fda6014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 >> 172.21.15.81:0/2821868871 conn(0x7fda600715f0 msgr2=0x7fda600abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 shutdown_connections 2024-05-08T20:54:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.066+0000 7fda64ab6640 1 -- 172.21.15.81:0/2821868871 wait complete. 2024-05-08T20:54:18.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 Processor -- start 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 -- start start 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f03700c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f037006f400 0x7f03700c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700c0650 con 0x7f03701501e0 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037006fd60 con 0x7f037006f400 2024-05-08T20:54:18.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f037792c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0370072180 con 0x7f03700725f0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f03756c8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03701501e0 0x7f037006c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54572/0 (socket says 172.21.15.81:54572) 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f03756c8640 1 -- 172.21.15.81:0/364438333 learned_addr learned my addr 172.21.15.81:0/364438333 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0374ec7640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f03700c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119481927 0 0) 0x7f03700c0650 con 0x7f03701501e0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0375ec9640 1 --2- 172.21.15.81:0/364438333 >> v2:172.21.15.117:3300/0 conn(0x7f037006f400 0x7f03700c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f035c003530 con 0x7f03701501e0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886283783 0 0) 0x7f035c003530 con 0x7f03701501e0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 msgr2=0x7f03700c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f03700c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 >> v2:172.21.15.117:3300/0 conn(0x7f037006f400 msgr2=0x7f03700c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 --2- 172.21.15.81:0/364438333 >> v2:172.21.15.117:3300/0 conn(0x7f037006f400 0x7f03700c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037006fa80 con 0x7f03701501e0 2024-05-08T20:54:18.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f036c001680 con 0x7f03701501e0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0374ec7640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f03700c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 >> v1:172.21.15.81:6789/0 conn(0x7f03701501e0 legacy=0x7f037006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f035c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f035c003ec0 0x7f035c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c004d10 0x7f035c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037006fd60 con 0x7f035c004d10 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370072180 con 0x7f035c003ec0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.194+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c00baf0 con 0x7f03700725f0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c004d10 0x7f035c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f03756c8640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f035c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0374ec7640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f035c003ec0 0x7f035c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 -- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 msgr2=0x7f035c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03700725f0 0x7f035c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 -- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f035c003ec0 msgr2=0x7f035c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f035c003ec0 0x7f035c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 -- 172.21.15.81:0/364438333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c003530 con 0x7f035c004d10 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c004d10 0x7f035c005190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0368009fc0 tx=0x7f036801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c89ffe9fdfd0dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680a5bb0 con 0x7f035c004d10 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800f040 con 0x7f035c004d10 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0367fff640 1 -- 172.21.15.81:0/364438333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680ad440 con 0x7f035c004d10 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 -- 172.21.15.81:0/364438333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c004d10 msgr2=0x7f035c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 --2- 172.21.15.81:0/364438333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c004d10 0x7f035c005190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0368009fc0 tx=0x7f036801cc90 comp rx=0 tx=0).stop 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f0375ec9640 1 -- 172.21.15.81:0/364438333 reap_dead start 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 -- 172.21.15.81:0/364438333 shutdown_connections 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 -- 172.21.15.81:0/364438333 >> 172.21.15.81:0/364438333 conn(0x7f03700c2ca0 msgr2=0x7f03700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 -- 172.21.15.81:0/364438333 shutdown_connections 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.198+0000 7f037792c640 1 -- 172.21.15.81:0/364438333 wait complete. 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 Processor -- start 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- start start 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 0x7f03700c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701467d0 0x7f03700c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c4a00 con 0x7f0370141660 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c4f80 con 0x7f03701467d0 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03701486a0 con 0x7f0370141f80 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37006/0 (socket says 172.21.15.81:37006) 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 -- 172.21.15.81:0/962526446 learned_addr learned my addr 172.21.15.81:0/962526446 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0374ec7640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 0x7f03700c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0375ec9640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701467d0 0x7f03700c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 -- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 msgr2=0x7f03700c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 0x7f03700c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 -- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701467d0 msgr2=0x7f03700c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701467d0 0x7f03700c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 -- 172.21.15.81:0/962526446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370150740 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0374ec7640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 0x7f03700c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f03756c8640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036c00e8d0 tx=0x7f036c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00c870 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00c9f0 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0370148980 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00cda0 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0370148310 con 0x7f0370141660 2024-05-08T20:54:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370074950 con 0x7f0370141660 2024-05-08T20:54:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f036c01d460 con 0x7f0370141660 2024-05-08T20:54:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 0x7f0354068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f036c084530 con 0x7f0370141660 2024-05-08T20:54:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.202+0000 7f0374ec7640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 0x7f0354068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.206+0000 7f0374ec7640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 0x7f0354068b80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f037006c8c0 tx=0x7f0360008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.206+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f036c051590 con 0x7f0370141660 2024-05-08T20:54:18.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.354+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f037014de20 con 0x7f0370141660 2024-05-08T20:54:18.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f0365ffb640 1 -- 172.21.15.81:0/962526446 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f036c054bb0 con 0x7f0370141660 2024-05-08T20:54:18.362 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 msgr2=0x7f0354068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 0x7f0354068b80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f037006c8c0 tx=0x7f0360008040 comp rx=0 tx=0).stop 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 msgr2=0x7f0370141a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f036c00e8d0 tx=0x7f036c00ed90 comp rx=0 tx=0).stop 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 shutdown_connections 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f03540666c0 0x7f0354068b80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03701467d0 0x7f03700c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0370141f80 0x7f03700c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 --2- 172.21.15.81:0/962526446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0370141660 0x7f0370141a40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 >> 172.21.15.81:0/962526446 conn(0x7f03700c2ca0 msgr2=0x7f0370149340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 shutdown_connections 2024-05-08T20:54:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.358+0000 7f037792c640 1 -- 172.21.15.81:0/962526446 wait complete. 2024-05-08T20:54:18.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:54:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.486+0000 7f2c6f2a6640 1 Processor -- start 2024-05-08T20:54:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.486+0000 7f2c6f2a6640 1 -- start start 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6f2a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c680c2e30 0x7f2c680c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6f2a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c680c2b60 con 0x7f2c6814ff20 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6f2a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c68065f00 con 0x7f2c68155cc0 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6f2a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680661e0 con 0x7f2c680c2e30 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6c841640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c680c2e30 0x7f2c680c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6d042640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c6814ff20 0x7f2c680c2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54586/0 (socket says 172.21.15.81:54586) 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6d042640 1 -- 172.21.15.81:0/1878783091 learned_addr learned my addr 172.21.15.81:0/1878783091 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6c841640 1 -- 172.21.15.81:0/1878783091 >> v1:172.21.15.117:6789/0 conn(0x7f2c68155cc0 legacy=0x7f2c6815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6c841640 1 -- 172.21.15.81:0/1878783091 >> v1:172.21.15.81:6789/0 conn(0x7f2c6814ff20 legacy=0x7f2c680c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6c841640 1 -- 172.21.15.81:0/1878783091 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680a9970 con 0x7f2c680c2e30 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c6c841640 1 --2- 172.21.15.81:0/1878783091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c680c2e30 0x7f2c680c12c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c5801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed1c0f5fe6380a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c5ffff640 1 -- 172.21.15.81:0/1878783091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580ac620 con 0x7f2c680c2e30 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c5ffff640 1 -- 172.21.15.81:0/1878783091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580ac780 con 0x7f2c680c2e30 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.490+0000 7f2c5ffff640 1 -- 172.21.15.81:0/1878783091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580acb10 con 0x7f2c680c2e30 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/1878783091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c680c2e30 msgr2=0x7f2c680c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/1878783091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c680c2e30 0x7f2c680c12c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c5801c3a0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/1878783091 shutdown_connections 2024-05-08T20:54:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/1878783091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c680c2e30 0x7f2c680c12c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/1878783091 >> 172.21.15.81:0/1878783091 conn(0x7f2c680a8670 msgr2=0x7f2c680a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/1878783091 shutdown_connections 2024-05-08T20:54:18.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/1878783091 wait complete. 2024-05-08T20:54:18.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 Processor -- start 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- start start 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 0x7f2c681ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c68150a60 0x7f2c6814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6814cf20 con 0x7f2c68155cc0 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681ef6e0 con 0x7f2c68150a60 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6f2a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6814a360 con 0x7f2c680c2e30 2024-05-08T20:54:18.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37022/0 (socket says 172.21.15.81:37022) 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 -- 172.21.15.81:0/2197373251 learned_addr learned my addr 172.21.15.81:0/2197373251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6d843640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c68150a60 0x7f2c6814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6d042640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 0x7f2c681ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 -- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 msgr2=0x7f2c681ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 0x7f2c681ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 -- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c68150a60 msgr2=0x7f2c6814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c68150a60 0x7f2c6814a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 -- 172.21.15.81:0/2197373251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c58009420 con 0x7f2c68155cc0 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6d042640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 0x7f2c681ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c6c841640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c58019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b5410 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580b5570 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.494+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580b5920 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c68156c30 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c681ef400 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6814a4f0 con 0x7f2c68155cc0 2024-05-08T20:54:18.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c580b3040 con 0x7f2c68155cc0 2024-05-08T20:54:18.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c5dffb640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 0x7f2c4c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c6d042640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 0x7f2c4c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2c5811e5c0 con 0x7f2c68155cc0 2024-05-08T20:54:18.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.498+0000 7f2c6d042640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 0x7f2c4c068b50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2c60005890 tx=0x7f2c60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.502+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2c580eb620 con 0x7f2c68155cc0 2024-05-08T20:54:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.654+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c68074950 con 0x7f2c68155cc0 2024-05-08T20:54:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.654+0000 7f2c5dffb640 1 -- 172.21.15.81:0/2197373251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f2c580eec40 con 0x7f2c68155cc0 2024-05-08T20:54:18.661 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 msgr2=0x7f2c4c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 0x7f2c4c068b50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2c60005890 tx=0x7f2c60009040 comp rx=0 tx=0).stop 2024-05-08T20:54:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 msgr2=0x7f2c681edf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c58019140 comp rx=0 tx=0).stop 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 shutdown_connections 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2c4c066690 0x7f2c4c068b50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c68150a60 0x7f2c6814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c68155cc0 0x7f2c681edf60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 --2- 172.21.15.81:0/2197373251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2c680c2e30 0x7f2c681ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 >> 172.21.15.81:0/2197373251 conn(0x7f2c680a8670 msgr2=0x7f2c680a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 shutdown_connections 2024-05-08T20:54:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.658+0000 7f2c6f2a6640 1 -- 172.21.15.81:0/2197373251 wait complete. 2024-05-08T20:54:18.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:54:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.782+0000 7f731c666640 1 Processor -- start 2024-05-08T20:54:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.782+0000 7f731c666640 1 -- start start 2024-05-08T20:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73140afb00 0x7f73140c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f731406b890 0x7f731406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7314155340 0x7f731406aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731406a080 con 0x7f7314155340 2024-05-08T20:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7314155870 con 0x7f731406b890 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c4de0 con 0x7f73140afb00 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7314155340 0x7f731406aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7314155340 0x7f731406aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55450/0 (socket says 172.21.15.81:55450) 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 -- 172.21.15.81:0/3546886763 learned_addr learned my addr 172.21.15.81:0/3546886763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 -- 172.21.15.81:0/3546886763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73140afb00 msgr2=0x7f73140c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 --2- 172.21.15.81:0/3546886763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73140afb00 0x7f73140c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 -- 172.21.15.81:0/3546886763 >> v2:172.21.15.117:3300/0 conn(0x7f731406b890 msgr2=0x7f731406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 --2- 172.21.15.81:0/3546886763 >> v2:172.21.15.117:3300/0 conn(0x7f731406b890 0x7f731406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 -- 172.21.15.81:0/3546886763 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140c50c0 con 0x7f7314155340 2024-05-08T20:54:18.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731ac03640 1 --2- 172.21.15.81:0/3546886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314155340 0x7f731406aa10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73140acc10 tx=0x7f730c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97019ac578e314d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f7319400640 1 -- 172.21.15.81:0/3546886763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0a56f0 con 0x7f7314155340 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f7319400640 1 -- 172.21.15.81:0/3546886763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c0a5850 con 0x7f7314155340 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f7319400640 1 -- 172.21.15.81:0/3546886763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0a5be0 con 0x7f7314155340 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- 172.21.15.81:0/3546886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314155340 msgr2=0x7f731406aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- 172.21.15.81:0/3546886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314155340 0x7f731406aa10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73140acc10 tx=0x7f730c01c8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- 172.21.15.81:0/3546886763 shutdown_connections 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- 172.21.15.81:0/3546886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314155340 0x7f731406aa10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- 172.21.15.81:0/3546886763 >> v2:172.21.15.117:3300/0 conn(0x7f731406b890 0x7f731406a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 --2- 172.21.15.81:0/3546886763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73140afb00 0x7f73140c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- 172.21.15.81:0/3546886763 >> 172.21.15.81:0/3546886763 conn(0x7f73140abfb0 msgr2=0x7f73140ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- 172.21.15.81:0/3546886763 shutdown_connections 2024-05-08T20:54:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.786+0000 7f731c666640 1 -- 172.21.15.81:0/3546886763 wait complete. 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 Processor -- start 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- start start 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731406b890 0x7f731414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 0x7f7314156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731414c640 con 0x7f73140afb00 2024-05-08T20:54:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73141f1be0 con 0x7f7314155340 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731414f230 con 0x7f731406b890 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55454/0 (socket says 172.21.15.81:55454) 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 -- 172.21.15.81:0/2697729745 learned_addr learned my addr 172.21.15.81:0/2697729745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731a402640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731406b890 0x7f731414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731ac03640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 0x7f7314156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 -- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731406b890 msgr2=0x7f731414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731406b890 0x7f731414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 -- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 msgr2=0x7f7314156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 0x7f7314156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 -- 172.21.15.81:0/2697729745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c009b30 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731ac03640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 0x7f7314156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f7319c01640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f730400b440 tx=0x7f730400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304011890 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304011a10 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731414fd20 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304011dc0 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731414fa40 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7314074950 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f730401a400 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.790+0000 7f730affd640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 0x7f72f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.794+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f73040847f0 con 0x7f73140afb00 2024-05-08T20:54:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.794+0000 7f731a402640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 0x7f72f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.794+0000 7f731a402640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 0x7f72f8068b80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7310006fd0 tx=0x7f7310008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:18.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.798+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7304051850 con 0x7f73140afb00 2024-05-08T20:54:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.946+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f731406b5e0 con 0x7f73140afb00 2024-05-08T20:54:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.946+0000 7f730affd640 1 -- 172.21.15.81:0/2697729745 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f73040150a0 con 0x7f73140afb00 2024-05-08T20:54:18.952 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 msgr2=0x7f72f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 0x7f72f8068b80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7310006fd0 tx=0x7f7310008040 comp rx=0 tx=0).stop 2024-05-08T20:54:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 msgr2=0x7f73141f16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f730400b440 tx=0x7f730400b900 comp rx=0 tx=0).stop 2024-05-08T20:54:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 shutdown_connections 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f72f80666c0 0x7f72f8068b80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7314155340 0x7f7314156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140afb00 0x7f73141f16a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 --2- 172.21.15.81:0/2697729745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731406b890 0x7f731414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 >> 172.21.15.81:0/2697729745 conn(0x7f73140abfb0 msgr2=0x7f731414ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 shutdown_connections 2024-05-08T20:54:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:18.950+0000 7f731c666640 1 -- 172.21.15.81:0/2697729745 wait complete. 2024-05-08T20:54:18.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:54:19.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 Processor -- start 2024-05-08T20:54:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 -- start start 2024-05-08T20:54:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86a406b230 0x7f86a40c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a4070c00 0x7f86a414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a40c3a50 con 0x7f86a414edf0 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a4072940 con 0x7f86a4070c00 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86aa246640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40705e0 con 0x7f86a406b230 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a4070c00 0x7f86a414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86a4070c00 0x7f86a414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55470/0 (socket says 172.21.15.81:55470) 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 -- 172.21.15.81:0/3458429271 learned_addr learned my addr 172.21.15.81:0/3458429271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a37fe640 1 --2- 172.21.15.81:0/3458429271 >> v2:172.21.15.117:3300/0 conn(0x7f86a406b230 0x7f86a40c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 -- 172.21.15.81:0/3458429271 >> v2:172.21.15.117:3300/0 conn(0x7f86a406b230 msgr2=0x7f86a40c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 --2- 172.21.15.81:0/3458429271 >> v2:172.21.15.117:3300/0 conn(0x7f86a406b230 0x7f86a40c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 -- 172.21.15.81:0/3458429271 >> v1:172.21.15.117:6789/0 conn(0x7f86a414edf0 legacy=0x7f86a41519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.082+0000 7f86a2ffd640 1 -- 172.21.15.81:0/3458429271 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40708c0 con 0x7f86a4070c00 2024-05-08T20:54:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a2ffd640 1 --2- 172.21.15.81:0/3458429271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a4070c00 0x7f86a414e8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f86a40c4d70 tx=0x7f869401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e324a5e56af811 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a27fc640 1 -- 172.21.15.81:0/3458429271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940ab670 con 0x7f86a4070c00 2024-05-08T20:54:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a27fc640 1 -- 172.21.15.81:0/3458429271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940ab7d0 con 0x7f86a4070c00 2024-05-08T20:54:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a27fc640 1 -- 172.21.15.81:0/3458429271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940abb60 con 0x7f86a4070c00 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- 172.21.15.81:0/3458429271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a4070c00 msgr2=0x7f86a414e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- 172.21.15.81:0/3458429271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a4070c00 0x7f86a414e8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f86a40c4d70 tx=0x7f869401c450 comp rx=0 tx=0).stop 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- 172.21.15.81:0/3458429271 shutdown_connections 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- 172.21.15.81:0/3458429271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a4070c00 0x7f86a414e8b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- 172.21.15.81:0/3458429271 >> v2:172.21.15.117:3300/0 conn(0x7f86a406b230 0x7f86a40c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- 172.21.15.81:0/3458429271 >> 172.21.15.81:0/3458429271 conn(0x7f86a40c71b0 msgr2=0x7f86a40c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- 172.21.15.81:0/3458429271 shutdown_connections 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- 172.21.15.81:0/3458429271 wait complete. 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 Processor -- start 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- start start 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a4070c00 0x7f86a4140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a414edf0 0x7f86a414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a414ccb0 con 0x7f86a406b230 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40c5e70 con 0x7f86a414edf0 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86aa246640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40c6150 con 0x7f86a4070c00 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55484/0 (socket says 172.21.15.81:55484) 2024-05-08T20:54:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.086+0000 7f86a37fe640 1 -- 172.21.15.81:0/673132252 learned_addr learned my addr 172.21.15.81:0/673132252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 -- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a4070c00 msgr2=0x7f86a4140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a2ffd640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a4070c00 0x7f86a4140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a4070c00 0x7f86a4140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 -- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a414edf0 msgr2=0x7f86a414d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a414edf0 0x7f86a414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 -- 172.21.15.81:0/673132252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940094d0 con 0x7f86a406b230 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a37fe640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f869c007ef0 tx=0x7f869c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c014620 con 0x7f86a406b230 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c014780 con 0x7f86a406b230 2024-05-08T20:54:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c014b30 con 0x7f86a406b230 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a414cf50 con 0x7f86a406b230 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a41416e0 con 0x7f86a406b230 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a40675e0 con 0x7f86a406b230 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f869c014c90 con 0x7f86a406b230 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 0x7f8684068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f869c084f30 con 0x7f86a406b230 2024-05-08T20:54:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a2ffd640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 0x7f8684068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.090+0000 7f86a2ffd640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 0x7f8684068b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f86940af000 tx=0x7f8694008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.094+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f869c051f00 con 0x7f86a406b230 2024-05-08T20:54:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.250+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f86a4074950 con 0x7f86a406b230 2024-05-08T20:54:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.250+0000 7f869bfff640 1 -- 172.21.15.81:0/673132252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f869c055520 con 0x7f86a406b230 2024-05-08T20:54:19.256 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 msgr2=0x7f8684068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 0x7f8684068b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f86940af000 tx=0x7f8694008040 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 msgr2=0x7f86a40c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f869c007ef0 tx=0x7f869c00e4b0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 shutdown_connections 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f86840666c0 0x7f8684068b80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a414edf0 0x7f86a414d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86a4070c00 0x7f86a4140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 --2- 172.21.15.81:0/673132252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86a406b230 0x7f86a40c5760 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 >> 172.21.15.81:0/673132252 conn(0x7f86a40c71b0 msgr2=0x7f86a41519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 shutdown_connections 2024-05-08T20:54:19.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.254+0000 7f86aa246640 1 -- 172.21.15.81:0/673132252 wait complete. 2024-05-08T20:54:19.274 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T20:54:19.274 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:19.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.422+0000 7ff060759640 1 Processor -- start 2024-05-08T20:54:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.422+0000 7ff060759640 1 -- start start 2024-05-08T20:54:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0580c2c30 0x7ff0580bd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580c39e0 con 0x7ff0581549e0 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580c3c30 con 0x7ff0580bd250 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580bee60 con 0x7ff0580c2c30 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05ecf6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0580c2c30 0x7ff0580bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05dcf4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff0581549e0 0x7ff05815d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51952/0 (socket says 172.21.15.81:51952) 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05dcf4640 1 -- 172.21.15.81:0/1414995472 learned_addr learned my addr 172.21.15.81:0/1414995472 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05ecf6640 1 -- 172.21.15.81:0/1414995472 >> v1:172.21.15.117:6789/0 conn(0x7ff0580bd250 legacy=0x7ff0580a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05ecf6640 1 -- 172.21.15.81:0/1414995472 >> v1:172.21.15.81:6789/0 conn(0x7ff0581549e0 legacy=0x7ff05815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05d4f3640 1 -- 172.21.15.81:0/1414995472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980478990 0 0) 0x7ff0580c39e0 con 0x7ff0581549e0 2024-05-08T20:54:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05ecf6640 1 -- 172.21.15.81:0/1414995472 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580c3f10 con 0x7ff0580c2c30 2024-05-08T20:54:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05ecf6640 1 --2- 172.21.15.81:0/1414995472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580c2c30 0x7ff0580bd630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097c0 tx=0x7ff05001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbd289098726cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05d4f3640 1 -- 172.21.15.81:0/1414995472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500ab600 con 0x7ff0580c2c30 2024-05-08T20:54:19.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05d4f3640 1 -- 172.21.15.81:0/1414995472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500a7050 con 0x7ff0580c2c30 2024-05-08T20:54:19.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff05d4f3640 1 -- 172.21.15.81:0/1414995472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500ab980 con 0x7ff0580c2c30 2024-05-08T20:54:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- 172.21.15.81:0/1414995472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580c2c30 msgr2=0x7ff0580bd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 --2- 172.21.15.81:0/1414995472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580c2c30 0x7ff0580bd630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097c0 tx=0x7ff05001c340 comp rx=0 tx=0).stop 2024-05-08T20:54:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- 172.21.15.81:0/1414995472 shutdown_connections 2024-05-08T20:54:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 --2- 172.21.15.81:0/1414995472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580c2c30 0x7ff0580bd630 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- 172.21.15.81:0/1414995472 >> 172.21.15.81:0/1414995472 conn(0x7ff0580c4d30 msgr2=0x7ff0580c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- 172.21.15.81:0/1414995472 shutdown_connections 2024-05-08T20:54:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.426+0000 7ff060759640 1 -- 172.21.15.81:0/1414995472 wait complete. 2024-05-08T20:54:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 Processor -- start 2024-05-08T20:54:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- start start 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0580c2c30 0x7ff05814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0581549e0 0x7ff05814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05814f440 con 0x7ff0580bd250 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05814fa00 con 0x7ff0580c2c30 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581f2360 con 0x7ff0581549e0 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55510/0 (socket says 172.21.15.81:55510) 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 -- 172.21.15.81:0/4180288682 learned_addr learned my addr 172.21.15.81:0/4180288682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05dcf4640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0580c2c30 0x7ff05814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 -- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0581549e0 msgr2=0x7ff05814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0581549e0 0x7ff05814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 -- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0580c2c30 msgr2=0x7ff05814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0580c2c30 0x7ff05814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 -- 172.21.15.81:0/4180288682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009420 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff05e4f5640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c7c0 tx=0x7ff05400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400aa50 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400abb0 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0580c4b70 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff054012420 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05814f690 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058074950 con 0x7ff0580bd250 2024-05-08T20:54:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.430+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff054012580 con 0x7ff0580bd250 2024-05-08T20:54:19.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.434+0000 7ff04effd640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 0x7ff03c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.434+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff054084ad0 con 0x7ff0580bd250 2024-05-08T20:54:19.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.434+0000 7ff05dcf4640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 0x7ff03c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.434+0000 7ff05dcf4640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 0x7ff03c068b50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff05814bbc0 tx=0x7ff048009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.438+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff054051b30 con 0x7ff0580bd250 2024-05-08T20:54:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.586+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0580c7e40 con 0x7ff0580bd250 2024-05-08T20:54:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff04effd640 1 -- 172.21.15.81:0/4180288682 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7ff054016090 con 0x7ff0580bd250 2024-05-08T20:54:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:19.595 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 msgr2=0x7ff03c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 0x7ff03c068b50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff05814bbc0 tx=0x7ff048009040 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 msgr2=0x7ff05806b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c7c0 tx=0x7ff05400cc80 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 shutdown_connections 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff03c066690 0x7ff03c068b50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0581549e0 0x7ff05814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0580c2c30 0x7ff05814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.590+0000 7ff060759640 1 --2- 172.21.15.81:0/4180288682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580bd250 0x7ff05806b440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.594+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 >> 172.21.15.81:0/4180288682 conn(0x7ff0580c4d30 msgr2=0x7ff05806dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.594+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 shutdown_connections 2024-05-08T20:54:19.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.594+0000 7ff060759640 1 -- 172.21.15.81:0/4180288682 wait complete. 2024-05-08T20:54:19.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:19.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 Processor -- start 2024-05-08T20:54:19.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 -- start start 2024-05-08T20:54:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad40c1bb0 0x7f1ad4151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ad40c1f90 0x7f1ad4152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad41533d0 0x7f1ad406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40c23f0 con 0x7f1ad41533d0 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad4155060 con 0x7f1ad40c1f90 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad9dd1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4155340 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad41533d0 0x7f1ad406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad41533d0 0x7f1ad406c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55514/0 (socket says 172.21.15.81:55514) 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 -- 172.21.15.81:0/2596866360 learned_addr learned my addr 172.21.15.81:0/2596866360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad2ffd640 1 --2- 172.21.15.81:0/2596866360 >> v2:172.21.15.117:3300/0 conn(0x7f1ad40c1f90 0x7f1ad4152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad37fe640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad40c1bb0 0x7f1ad4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 -- 172.21.15.81:0/2596866360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad40c1bb0 msgr2=0x7f1ad4151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad40c1bb0 0x7f1ad4151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 -- 172.21.15.81:0/2596866360 >> v2:172.21.15.117:3300/0 conn(0x7f1ad40c1f90 msgr2=0x7f1ad4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 --2- 172.21.15.81:0/2596866360 >> v2:172.21.15.117:3300/0 conn(0x7f1ad40c1f90 0x7f1ad4152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 -- 172.21.15.81:0/2596866360 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4155620 con 0x7f1ad41533d0 2024-05-08T20:54:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.734+0000 7f1ad3fff640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad41533d0 0x7f1ad406c0e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406eed0 tx=0x7f1acc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96f2a72fcdef03c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad27fc640 1 -- 172.21.15.81:0/2596866360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0a5790 con 0x7f1ad41533d0 2024-05-08T20:54:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad27fc640 1 -- 172.21.15.81:0/2596866360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc0a58f0 con 0x7f1ad41533d0 2024-05-08T20:54:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad27fc640 1 -- 172.21.15.81:0/2596866360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0a5c80 con 0x7f1ad41533d0 2024-05-08T20:54:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2596866360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad41533d0 msgr2=0x7f1ad406c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad41533d0 0x7f1ad406c0e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406eed0 tx=0x7f1acc01c930 comp rx=0 tx=0).stop 2024-05-08T20:54:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2596866360 shutdown_connections 2024-05-08T20:54:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad41533d0 0x7f1ad406c0e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2596866360 >> v2:172.21.15.117:3300/0 conn(0x7f1ad40c1f90 0x7f1ad4152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2596866360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad40c1bb0 0x7f1ad4151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2596866360 >> 172.21.15.81:0/2596866360 conn(0x7f1ad40c2ca0 msgr2=0x7f1ad40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2596866360 shutdown_connections 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2596866360 wait complete. 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 Processor -- start 2024-05-08T20:54:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- start start 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad40c1f90 0x7f1ad414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 0x7f1ad414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41ee640 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad415a700 con 0x7f1ad40c1f90 2024-05-08T20:54:19.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad414eb10 con 0x7f1ad41533d0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55516/0 (socket says 172.21.15.81:55516) 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 -- 172.21.15.81:0/2912000487 learned_addr learned my addr 172.21.15.81:0/2912000487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad2ffd640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad40c1f90 0x7f1ad414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad3fff640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 0x7f1ad414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 -- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 msgr2=0x7f1ad414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 0x7f1ad414d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 -- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad40c1f90 msgr2=0x7f1ad414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad40c1f90 0x7f1ad414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 -- 172.21.15.81:0/2912000487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009b30 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad3fff640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 0x7f1ad414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad37fe640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400d620 tx=0x7f1ac400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400b620 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400b780 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400bb10 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.738+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41ee0a0 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41ee360 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4074950 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ac400bc70 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1abbfff640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 0x7f1ac0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1ad2ffd640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 0x7f1ac0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1ac40849d0 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.742+0000 7f1ad2ffd640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 0x7f1ac0068b50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4071dd0 tx=0x7f1ac8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:19.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.746+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1ac40519a0 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ad40c0800 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1abbfff640 1 -- 172.21.15.81:0/2912000487 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ac4007380 con 0x7f1ad40c1bb0 2024-05-08T20:54:19.910 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:54:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 msgr2=0x7f1ac0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 0x7f1ac0068b50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4071dd0 tx=0x7f1ac8008040 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 msgr2=0x7f1ad40a85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400d620 tx=0x7f1ac400dae0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 shutdown_connections 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1ac0066690 0x7f1ac0068b50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ad41533d0 0x7f1ad414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad40c1f90 0x7f1ad414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 --2- 172.21.15.81:0/2912000487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad40c1bb0 0x7f1ad40a85b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 >> 172.21.15.81:0/2912000487 conn(0x7f1ad40c2ca0 msgr2=0x7f1ad415b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 shutdown_connections 2024-05-08T20:54:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:19.905+0000 7f1ad9dd1640 1 -- 172.21.15.81:0/2912000487 wait complete. 2024-05-08T20:54:19.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:54:20.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 Processor -- start 2024-05-08T20:54:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 -- start start 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef01501e0 0x7faef006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faef00725f0 0x7faef00c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef006f400 0x7faef00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef006fd60 con 0x7faef01501e0 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef0072180 con 0x7faef00725f0 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faef56d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00c0650 con 0x7faef006f400 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef01501e0 0x7faef006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faef01501e0 0x7faef006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55524/0 (socket says 172.21.15.81:55524) 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 -- 172.21.15.81:0/1511143841 learned_addr learned my addr 172.21.15.81:0/1511143841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeee7fc640 1 --2- 172.21.15.81:0/1511143841 >> v2:172.21.15.117:3300/0 conn(0x7faef00725f0 0x7faef00c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeef7fe640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef006f400 0x7faef00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 -- 172.21.15.81:0/1511143841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef006f400 msgr2=0x7faef00c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef006f400 0x7faef00c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 -- 172.21.15.81:0/1511143841 >> v2:172.21.15.117:3300/0 conn(0x7faef00725f0 msgr2=0x7faef00c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1511143841 >> v2:172.21.15.117:3300/0 conn(0x7faef00725f0 0x7faef00c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.045+0000 7faeeeffd640 1 -- 172.21.15.81:0/1511143841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef006fa80 con 0x7faef01501e0 2024-05-08T20:54:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef01501e0 0x7faef006c930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faef006f1b0 tx=0x7faee001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4972f897147df3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faeedffb640 1 -- 172.21.15.81:0/1511143841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00ab600 con 0x7faef01501e0 2024-05-08T20:54:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faeedffb640 1 -- 172.21.15.81:0/1511143841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee00a7050 con 0x7faef01501e0 2024-05-08T20:54:20.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faeedffb640 1 -- 172.21.15.81:0/1511143841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00ab980 con 0x7faef01501e0 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- 172.21.15.81:0/1511143841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef01501e0 msgr2=0x7faef006c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef01501e0 0x7faef006c930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faef006f1b0 tx=0x7faee001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- 172.21.15.81:0/1511143841 shutdown_connections 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef006f400 0x7faef00c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 --2- 172.21.15.81:0/1511143841 >> v2:172.21.15.117:3300/0 conn(0x7faef00725f0 0x7faef00c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 --2- 172.21.15.81:0/1511143841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef01501e0 0x7faef006c930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- 172.21.15.81:0/1511143841 >> 172.21.15.81:0/1511143841 conn(0x7faef00c2ca0 msgr2=0x7faef00c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- 172.21.15.81:0/1511143841 shutdown_connections 2024-05-08T20:54:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- 172.21.15.81:0/1511143841 wait complete. 2024-05-08T20:54:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 Processor -- start 2024-05-08T20:54:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.049+0000 7faef56d8640 1 -- start start 2024-05-08T20:54:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faef00725f0 0x7faef0147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef01501e0 0x7faef01eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef014e450 con 0x7faef006f400 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00c6020 con 0x7faef00725f0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00c4a70 con 0x7faef01501e0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55534/0 (socket says 172.21.15.81:55534) 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 -- 172.21.15.81:0/1181516564 learned_addr learned my addr 172.21.15.81:0/1181516564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeee7fc640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faef00725f0 0x7faef0147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeef7fe640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef01501e0 0x7faef01eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 -- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef01501e0 msgr2=0x7faef01eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef01501e0 0x7faef01eb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 -- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faef00725f0 msgr2=0x7faef0147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faef00725f0 0x7faef0147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 -- 172.21.15.81:0/1181516564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00094d0 con 0x7faef006f400 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeeeffd640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faee001cc70 tx=0x7faee0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00b4420 con 0x7faef006f400 2024-05-08T20:54:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee00b4580 con 0x7faef006f400 2024-05-08T20:54:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee00b4910 con 0x7faef006f400 2024-05-08T20:54:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef00c5a80 con 0x7faef006f400 2024-05-08T20:54:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef00c5d40 con 0x7faef006f400 2024-05-08T20:54:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef00c48d0 con 0x7faef006f400 2024-05-08T20:54:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faee00b2070 con 0x7faef006f400 2024-05-08T20:54:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 0x7faedc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faeee7fc640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 0x7faedc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.053+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7faee011dfe0 con 0x7faef006f400 2024-05-08T20:54:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.057+0000 7faeee7fc640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 0x7faedc068b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7faef006b730 tx=0x7faee4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.057+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7faef00c48d0 con 0x7faef006f400 2024-05-08T20:54:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.217+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7faef00c48d0 con 0x7faef006f400 2024-05-08T20:54:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.217+0000 7faed77fe640 1 -- 172.21.15.81:0/1181516564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7faef00c48d0 con 0x7faef006f400 2024-05-08T20:54:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 msgr2=0x7faedc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 0x7faedc068b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7faef006b730 tx=0x7faee4008040 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 msgr2=0x7faef00bfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faee001cc70 tx=0x7faee0019170 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 shutdown_connections 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faedc0666c0 0x7faedc068b80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faef01501e0 0x7faef01eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faef00725f0 0x7faef0147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 --2- 172.21.15.81:0/1181516564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef006f400 0x7faef00bfcc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 >> 172.21.15.81:0/1181516564 conn(0x7faef00c2ca0 msgr2=0x7faef006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 shutdown_connections 2024-05-08T20:54:20.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.221+0000 7faef56d8640 1 -- 172.21.15.81:0/1181516564 wait complete. 2024-05-08T20:54:20.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:54:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 Processor -- start 2024-05-08T20:54:20.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 -- start start 2024-05-08T20:54:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 0x7f010415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040c23f0 con 0x7f01040c1f90 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0104155060 con 0x7f01041535a0 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010c2bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0104155340 con 0x7f01040c1bb0 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010a057640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f010a858640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 0x7f010415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f0109856640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f01040c1f90 0x7f0104152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:46692/0 (socket says 172.21.15.81:46692) 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.357+0000 7f0109856640 1 -- 172.21.15.81:0/39220224 learned_addr learned my addr 172.21.15.81:0/39220224 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:20.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f0109055640 1 -- 172.21.15.81:0/39220224 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251799140 0 0) 0x7f01040c23f0 con 0x7f01040c1f90 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f0109055640 1 -- 172.21.15.81:0/39220224 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0005740 con 0x7f01040c1f90 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a057640 1 -- 172.21.15.81:0/39220224 >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 msgr2=0x7f010415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a057640 1 --2- 172.21.15.81:0/39220224 >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 0x7f010415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a057640 1 -- 172.21.15.81:0/39220224 >> v1:172.21.15.117:6789/0 conn(0x7f01040c1f90 legacy=0x7f0104152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a057640 1 -- 172.21.15.81:0/39220224 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104155620 con 0x7f01040c1bb0 2024-05-08T20:54:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a858640 1 --2- 172.21.15.81:0/39220224 >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 0x7f010415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010a057640 1 --2- 172.21.15.81:0/39220224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104151740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097c0 tx=0x7f00fc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7539c2347114c12a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f0109055640 1 -- 172.21.15.81:0/39220224 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0ab600 con 0x7f01040c1bb0 2024-05-08T20:54:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f0109055640 1 -- 172.21.15.81:0/39220224 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc0a7050 con 0x7f01040c1bb0 2024-05-08T20:54:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f0109055640 1 -- 172.21.15.81:0/39220224 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0ab960 con 0x7f01040c1bb0 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 -- 172.21.15.81:0/39220224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 msgr2=0x7f0104151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 --2- 172.21.15.81:0/39220224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104151740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097c0 tx=0x7f00fc01c3e0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 -- 172.21.15.81:0/39220224 shutdown_connections 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 --2- 172.21.15.81:0/39220224 >> v2:172.21.15.117:3300/0 conn(0x7f01041535a0 0x7f010415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 --2- 172.21.15.81:0/39220224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104151740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 -- 172.21.15.81:0/39220224 >> 172.21.15.81:0/39220224 conn(0x7f01040c2ca0 msgr2=0x7f01040c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 -- 172.21.15.81:0/39220224 shutdown_connections 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.361+0000 7f010c2bb640 1 -- 172.21.15.81:0/39220224 wait complete. 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 Processor -- start 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- start start 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01041535a0 0x7f01040be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040bef10 con 0x7f01040c1f90 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01041ed100 con 0x7f01041535a0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01041ed630 con 0x7f01040c1bb0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55544/0 (socket says 172.21.15.81:55544) 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 -- 172.21.15.81:0/1032662037 learned_addr learned my addr 172.21.15.81:0/1032662037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010a057640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010a858640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01041535a0 0x7f01040be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 -- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 msgr2=0x7f0104150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 -- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01041535a0 msgr2=0x7f01040be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01041535a0 0x7f01040be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 -- 172.21.15.81:0/1032662037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100009420 con 0x7f01040c1f90 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f0109856640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00f800cad0 tx=0x7f00f800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f800ac30 con 0x7f01040c1f90 2024-05-08T20:54:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f800ad90 con 0x7f01040c1f90 2024-05-08T20:54:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc009420 con 0x7f01040c1f90 2024-05-08T20:54:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8012620 con 0x7f01040c1f90 2024-05-08T20:54:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010414df10 con 0x7f01040c1f90 2024-05-08T20:54:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010414e0a0 con 0x7f01040c1f90 2024-05-08T20:54:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.365+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00f8007070 con 0x7f01040c1f90 2024-05-08T20:54:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.369+0000 7f00f6ffd640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 0x7f00e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.369+0000 7f010a057640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 0x7f00e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.369+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f00f8084450 con 0x7f01040c1f90 2024-05-08T20:54:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.369+0000 7f010a057640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 0x7f00e8068b50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.373+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f00f80514b0 con 0x7f01040c1f90 2024-05-08T20:54:20.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f0104154c70 con 0x7f01040c1f90 2024-05-08T20:54:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f00f6ffd640 1 -- 172.21.15.81:0/1032662037 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f00f8017020 con 0x7f01040c1f90 2024-05-08T20:54:20.535 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 msgr2=0x7f00e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 0x7f00e8068b50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0a6000 comp rx=0 tx=0).stop 2024-05-08T20:54:20.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 msgr2=0x7f01040be490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00f800cad0 tx=0x7f00f800cf90 comp rx=0 tx=0).stop 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 shutdown_connections 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f00e8066690 0x7f00e8068b50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01041535a0 0x7f01040be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01040c1f90 0x7f01040be490 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 --2- 172.21.15.81:0/1032662037 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f01040c1bb0 0x7f0104150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 >> 172.21.15.81:0/1032662037 conn(0x7f01040c2ca0 msgr2=0x7f010414b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 shutdown_connections 2024-05-08T20:54:20.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.529+0000 7f010c2bb640 1 -- 172.21.15.81:0/1032662037 wait complete. 2024-05-08T20:54:20.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:54:20.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 Processor -- start 2024-05-08T20:54:20.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 -- start start 2024-05-08T20:54:20.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d2414e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d24152110 0x7f5d241525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2414e770 con 0x7f5d240c1e10 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d240a9e80 con 0x7f5d24152110 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2b182640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240aa160 con 0x7f5d2414ddd0 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d24152110 0x7f5d241525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d24152110 0x7f5d241525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55558/0 (socket says 172.21.15.81:55558) 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 -- 172.21.15.81:0/3904256283 learned_addr learned my addr 172.21.15.81:0/3904256283 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 -- 172.21.15.81:0/3904256283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 msgr2=0x7f5d2414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d23fff640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d2414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d2414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 -- 172.21.15.81:0/3904256283 >> v1:172.21.15.117:6789/0 conn(0x7f5d240c1e10 legacy=0x7f5d240a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d2971f640 1 -- 172.21.15.81:0/3904256283 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d240aa440 con 0x7f5d24152110 2024-05-08T20:54:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.657+0000 7f5d23fff640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d2414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:20.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241525a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098a0 tx=0x7f5d1c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f333b67fc40288 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d237fe640 1 -- 172.21.15.81:0/3904256283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0ab600 con 0x7f5d24152110 2024-05-08T20:54:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d237fe640 1 -- 172.21.15.81:0/3904256283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0ab760 con 0x7f5d24152110 2024-05-08T20:54:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d237fe640 1 -- 172.21.15.81:0/3904256283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0abaf0 con 0x7f5d24152110 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/3904256283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 msgr2=0x7f5d241525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241525a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098a0 tx=0x7f5d1c01c440 comp rx=0 tx=0).stop 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/3904256283 shutdown_connections 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241525a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- 172.21.15.81:0/3904256283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d2414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/3904256283 >> 172.21.15.81:0/3904256283 conn(0x7f5d240c2ca0 msgr2=0x7f5d240c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/3904256283 shutdown_connections 2024-05-08T20:54:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/3904256283 wait complete. 2024-05-08T20:54:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 Processor -- start 2024-05-08T20:54:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- start start 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 0x7f5d24071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d24071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240715b0 con 0x7f5d24152110 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d241ec320 con 0x7f5d240c1e10 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240705d0 con 0x7f5d2414ddd0 2024-05-08T20:54:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55574/0 (socket says 172.21.15.81:55574) 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 -- 172.21.15.81:0/1343844891 learned_addr learned my addr 172.21.15.81:0/1343844891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d23fff640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d24071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d28f1e640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 0x7f5d24071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 -- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 msgr2=0x7f5d24071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d24071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 -- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 msgr2=0x7f5d24071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 0x7f5d24071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 -- 172.21.15.81:0/1343844891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0094d0 con 0x7f5d24152110 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d28f1e640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 0x7f5d24071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2971f640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01aaf0 tx=0x7f5d1c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b4800 con 0x7f5d24152110 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0b4980 con 0x7f5d24152110 2024-05-08T20:54:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d240a9c50 con 0x7f5d24152110 2024-05-08T20:54:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b4d30 con 0x7f5d24152110 2024-05-08T20:54:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.661+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2415dc10 con 0x7f5d24152110 2024-05-08T20:54:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24074950 con 0x7f5d24152110 2024-05-08T20:54:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d1c0c7440 con 0x7f5d24152110 2024-05-08T20:54:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d217fa640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 0x7f5d04068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5d1c11f3e0 con 0x7f5d24152110 2024-05-08T20:54:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d28f1e640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 0x7f5d04068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.665+0000 7f5d28f1e640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 0x7f5d04068b80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00a830 tx=0x7f5d0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.669+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5d1c0ec520 con 0x7f5d24152110 2024-05-08T20:54:20.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.825+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d24072240 con 0x7f5d24152110 2024-05-08T20:54:20.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.825+0000 7f5d217fa640 1 -- 172.21.15.81:0/1343844891 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f5d1c0efb40 con 0x7f5d24152110 2024-05-08T20:54:20.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 msgr2=0x7f5d04068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 0x7f5d04068b80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00a830 tx=0x7f5d0c008040 comp rx=0 tx=0).stop 2024-05-08T20:54:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 msgr2=0x7f5d241ebde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01aaf0 tx=0x7f5d1c01ac80 comp rx=0 tx=0).stop 2024-05-08T20:54:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 shutdown_connections 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f5d040666c0 0x7f5d04068b80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d24152110 0x7f5d241ebde0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d2414ddd0 0x7f5d24071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 --2- 172.21.15.81:0/1343844891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d240c1e10 0x7f5d24071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 >> 172.21.15.81:0/1343844891 conn(0x7f5d240c2ca0 msgr2=0x7f5d24148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 shutdown_connections 2024-05-08T20:54:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.829+0000 7f5d2b182640 1 -- 172.21.15.81:0/1343844891 wait complete. 2024-05-08T20:54:20.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:54:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 Processor -- start 2024-05-08T20:54:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 -- start start 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5c014fe70 0x7fa5c006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c006d7d0 0x7fa5c006a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c0152ab0 con 0x7fa5c0155e90 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c01528a0 con 0x7fa5c014fe70 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5c52e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0152d90 con 0x7fa5c006d7d0 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5c014fe70 0x7fa5c006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5c014fe70 0x7fa5c006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55590/0 (socket says 172.21.15.81:55590) 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 -- 172.21.15.81:0/3321026146 learned_addr learned my addr 172.21.15.81:0/3321026146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 -- 172.21.15.81:0/3321026146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c006d7d0 msgr2=0x7fa5c006a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 --2- 172.21.15.81:0/3321026146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c006d7d0 0x7fa5c006a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 -- 172.21.15.81:0/3321026146 >> v1:172.21.15.117:6789/0 conn(0x7fa5c0155e90 legacy=0x7fa5c0069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.965+0000 7fa5beffd640 1 -- 172.21.15.81:0/3321026146 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0153070 con 0x7fa5c014fe70 2024-05-08T20:54:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5beffd640 1 --2- 172.21.15.81:0/3321026146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c014fe70 0x7fa5c006d290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009e50 tx=0x7fa5b801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96a039cb884f62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bdffb640 1 -- 172.21.15.81:0/3321026146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80a5720 con 0x7fa5c014fe70 2024-05-08T20:54:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bdffb640 1 -- 172.21.15.81:0/3321026146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80a5880 con 0x7fa5c014fe70 2024-05-08T20:54:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bdffb640 1 -- 172.21.15.81:0/3321026146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80a5c10 con 0x7fa5c014fe70 2024-05-08T20:54:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3321026146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c014fe70 msgr2=0x7fa5c006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3321026146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c014fe70 0x7fa5c006d290 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009e50 tx=0x7fa5b801c8a0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3321026146 shutdown_connections 2024-05-08T20:54:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3321026146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c006d7d0 0x7fa5c006a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3321026146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c014fe70 0x7fa5c006d290 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3321026146 >> 172.21.15.81:0/3321026146 conn(0x7fa5c00c71b0 msgr2=0x7fa5c00c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3321026146 shutdown_connections 2024-05-08T20:54:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3321026146 wait complete. 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 Processor -- start 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- start start 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c006d7d0 0x7fa5c01eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 0x7fa5c0151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0158970 con 0x7fa5c0155e90 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c4d70 con 0x7fa5c006d7d0 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5c52e1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01eb430 con 0x7fa5c014fe70 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55596/0 (socket says 172.21.15.81:55596) 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 -- 172.21.15.81:0/3392383460 learned_addr learned my addr 172.21.15.81:0/3392383460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5be7fc640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 0x7fa5c0151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5beffd640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c006d7d0 0x7fa5c01eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 -- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 msgr2=0x7fa5c0151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 0x7fa5c0151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 -- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c006d7d0 msgr2=0x7fa5c01eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c006d7d0 0x7fa5c01eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5bf7fe640 1 -- 172.21.15.81:0/3392383460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009b30 con 0x7fa5c0155e90 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.969+0000 7fa5be7fc640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 0x7fa5c0151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:20.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5bf7fe640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b430 tx=0x7fa5b000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0011830 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0011990 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c01eb710 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0011d40 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c01523e0 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c00675e0 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5b001a400 con 0x7fa5c0155e90 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 0x7fa5a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa5b00846b0 con 0x7fa5c0155e90 2024-05-08T20:54:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5beffd640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 0x7fa5a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.973+0000 7fa5beffd640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 0x7fa5a0068b50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80ae000 tx=0x7fa5b80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:20.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:20.977+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa5b0051680 con 0x7fa5c0155e90 2024-05-08T20:54:21.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.129+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fa5c00c4ee0 con 0x7fa5c0155e90 2024-05-08T20:54:21.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.129+0000 7fa5b77fe640 1 -- 172.21.15.81:0/3392383460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fa5b0054ca0 con 0x7fa5c0155e90 2024-05-08T20:54:21.134 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 msgr2=0x7fa5a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 0x7fa5a0068b50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80ae000 tx=0x7fa5b80a7070 comp rx=0 tx=0).stop 2024-05-08T20:54:21.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 msgr2=0x7fa5c00c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b430 tx=0x7fa5b000b8f0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 shutdown_connections 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa5a0066690 0x7fa5a0068b50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0155e90 0x7fa5c00c5200 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5c014fe70 0x7fa5c0151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 --2- 172.21.15.81:0/3392383460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c006d7d0 0x7fa5c01eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 >> 172.21.15.81:0/3392383460 conn(0x7fa5c00c71b0 msgr2=0x7fa5c014c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 shutdown_connections 2024-05-08T20:54:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.133+0000 7fa5c52e1640 1 -- 172.21.15.81:0/3392383460 wait complete. 2024-05-08T20:54:21.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:54:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 Processor -- start 2024-05-08T20:54:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 -- start start 2024-05-08T20:54:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 0x7f8ca80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca80c0650 con 0x7f8ca80725f0 2024-05-08T20:54:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca806fa80 con 0x7f8ca81501e0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8caeee1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca806fd60 con 0x7f8ca806f400 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ca80725f0 0x7f8ca80c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51968/0 (socket says 172.21.15.81:51968) 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 -- 172.21.15.81:0/4144914605 learned_addr learned my addr 172.21.15.81:0/4144914605 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8cad47e640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 0x7f8ca80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278985545 0 0) 0x7f8ca80c0650 con 0x7f8ca80725f0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c90003530 con 0x7f8ca80725f0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148771609 0 0) 0x7f8c90003530 con 0x7f8ca80725f0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 msgr2=0x7f8ca80c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 0x7f8ca80c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 >> v1:172.21.15.117:6789/0 conn(0x7f8ca81501e0 legacy=0x7f8ca806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8071ea0 con 0x7f8ca80725f0 2024-05-08T20:54:21.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8c9c001680 con 0x7f8ca80725f0 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 >> v1:172.21.15.81:6789/0 conn(0x7f8ca80725f0 legacy=0x7f8ca80c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 0x7f8c900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c90003f30 0x7f8c900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90004d10 0x7f8c90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca806fd60 con 0x7f8c90003f30 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9000bbd0 con 0x7f8c90004d10 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9000bd90 con 0x7f8ca806f400 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c90003f30 0x7f8c900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 -- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 msgr2=0x7f8c900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca806f400 0x7f8c900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8cad47e640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90004d10 0x7f8c90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 -- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90004d10 msgr2=0x7f8c90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90004d10 0x7f8c90005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.269+0000 7f8ca7fff640 1 -- 172.21.15.81:0/4144914605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90003530 con 0x7f8c90003f30 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c90003f30 0x7f8c900047d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c240 tx=0x7f8c9c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc8a907f680b4ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c005ae0 con 0x7f8c90003f30 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c005c40 con 0x7f8c90003f30 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8ca77fe640 1 -- 172.21.15.81:0/4144914605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0a59d0 con 0x7f8c90003f30 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- 172.21.15.81:0/4144914605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c90003f30 msgr2=0x7f8c900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 --2- 172.21.15.81:0/4144914605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c90003f30 0x7f8c900047d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c240 tx=0x7f8c9c01cc60 comp rx=0 tx=0).stop 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8cad47e640 1 -- 172.21.15.81:0/4144914605 reap_dead start 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- 172.21.15.81:0/4144914605 shutdown_connections 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- 172.21.15.81:0/4144914605 >> 172.21.15.81:0/4144914605 conn(0x7f8ca80c2ca0 msgr2=0x7f8ca80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:21.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- 172.21.15.81:0/4144914605 shutdown_connections 2024-05-08T20:54:21.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- 172.21.15.81:0/4144914605 wait complete. 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 Processor -- start 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- start start 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 0x7f8ca815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 0x7f8ca814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8072180 con 0x7f8ca814bb20 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80c3e20 con 0x7f8c90003f30 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8caeee1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81574a0 con 0x7f8ca8140eb0 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8cad47e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8cad47e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55616/0 (socket says 172.21.15.81:55616) 2024-05-08T20:54:21.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.273+0000 7f8cad47e640 1 -- 172.21.15.81:0/3204558278 learned_addr learned my addr 172.21.15.81:0/3204558278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cacc7d640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 0x7f8ca815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 0x7f8ca814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 -- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 msgr2=0x7f8ca814b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 0x7f8ca814b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 -- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 msgr2=0x7f8ca815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 0x7f8ca815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 -- 172.21.15.81:0/3204558278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca81473a0 con 0x7f8ca814bb20 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cacc7d640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 0x7f8ca815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca7fff640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 0x7f8ca814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cad47e640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80c2b80 tx=0x7f8ca000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000fe60 con 0x7f8ca814bb20 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0011040 con 0x7f8ca814bb20 2024-05-08T20:54:21.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0003be0 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca81ec240 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80c5710 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca80c3f90 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ca0017400 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 0x7f8c94068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8ca00847a0 con 0x7f8ca814bb20 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cacc7d640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 0x7f8c94068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:21.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.277+0000 7f8cacc7d640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 0x7f8c94068b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8c980016c0 tx=0x7f8c98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:21.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.281+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8ca80c3f90 con 0x7f8ca814bb20 2024-05-08T20:54:21.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ca80c3f90 con 0x7f8ca814bb20 2024-05-08T20:54:21.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8ca57fa640 1 -- 172.21.15.81:0/3204558278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8ca80c3f90 con 0x7f8ca814bb20 2024-05-08T20:54:21.447 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 msgr2=0x7f8c94068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 0x7f8c94068b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8c980016c0 tx=0x7f8c98009040 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 msgr2=0x7f8ca80c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80c2b80 tx=0x7f8ca000f4a0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 shutdown_connections 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8c940666c0 0x7f8c94068b80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca814bb20 0x7f8ca80c4270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ca8140eb0 0x7f8ca814b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 --2- 172.21.15.81:0/3204558278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c90003f30 0x7f8ca815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 >> 172.21.15.81:0/3204558278 conn(0x7f8ca80c2ca0 msgr2=0x7f8ca806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 shutdown_connections 2024-05-08T20:54:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:21.441+0000 7f8caeee1640 1 -- 172.21.15.81:0/3204558278 wait complete. 2024-05-08T20:54:21.465 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-05-08T20:54:21.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:21.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T20:54:21.574 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:54:21.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[36000]: fuse finished with error 0 and tester_r 0 2024-05-08T20:54:27.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:54:27.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:27.676 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T20:54:27.694 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:54:27.694 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:27.831 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:54:27.831 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:27.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 Processor -- start 2024-05-08T20:54:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 -- start start 2024-05-08T20:54:28.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974154cf0 0x7fb974155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb974155690 0x7fb9740ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9741522e0 con 0x7fb974151f00 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97406bb20 con 0x7fb974155690 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97be7b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9741548e0 con 0x7fb974154cf0 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb974155690 0x7fb9740ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb974155690 0x7fb9740ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55632/0 (socket says 172.21.15.81:55632) 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 -- 172.21.15.81:0/3508916740 learned_addr learned my addr 172.21.15.81:0/3508916740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb979416640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974154cf0 0x7fb974155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 -- 172.21.15.81:0/3508916740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974154cf0 msgr2=0x7fb974155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974154cf0 0x7fb974155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 -- 172.21.15.81:0/3508916740 >> v1:172.21.15.117:6789/0 conn(0x7fb974151f00 legacy=0x7fb9741588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.005+0000 7fb97a418640 1 -- 172.21.15.81:0/3508916740 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740c5f80 con 0x7fb974155690 2024-05-08T20:54:28.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb974155690 0x7fb9740ca000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9680098a0 tx=0x7fb96801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e604033b0ad3de21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb978c15640 1 -- 172.21.15.81:0/3508916740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680ac620 con 0x7fb974155690 2024-05-08T20:54:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb978c15640 1 -- 172.21.15.81:0/3508916740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9680ac780 con 0x7fb974155690 2024-05-08T20:54:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb978c15640 1 -- 172.21.15.81:0/3508916740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680acb10 con 0x7fb974155690 2024-05-08T20:54:28.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3508916740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb974155690 msgr2=0x7fb9740ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb974155690 0x7fb9740ca000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9680098a0 tx=0x7fb96801c420 comp rx=0 tx=0).stop 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3508916740 shutdown_connections 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb974155690 0x7fb9740ca000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3508916740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974154cf0 0x7fb974155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3508916740 >> 172.21.15.81:0/3508916740 conn(0x7fb9740715f0 msgr2=0x7fb974071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3508916740 shutdown_connections 2024-05-08T20:54:28.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3508916740 wait complete. 2024-05-08T20:54:28.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 Processor -- start 2024-05-08T20:54:28.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- start start 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 0x7fb9740ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb974154cf0 0x7fb9741f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974155cb0 con 0x7fb9741514d0 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974069ff0 con 0x7fb974154cf0 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974158b10 con 0x7fb974151f00 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55636/0 (socket says 172.21.15.81:55636) 2024-05-08T20:54:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 -- 172.21.15.81:0/3851641809 learned_addr learned my addr 172.21.15.81:0/3851641809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb979c17640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 0x7fb9740ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb979416640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb974154cf0 0x7fb9741f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 -- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 msgr2=0x7fb9740ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 0x7fb9740ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 -- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb974154cf0 msgr2=0x7fb9741f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb974154cf0 0x7fb9741f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 -- 172.21.15.81:0/3851641809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680094d0 con 0x7fb9741514d0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb979c17640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 0x7fb9740ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97a418640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9680af040 tx=0x7fb9680191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680b7470 con 0x7fb9741514d0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9680b75d0 con 0x7fb9741514d0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb974155e90 con 0x7fb9741514d0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680b7940 con 0x7fb9741514d0 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.009+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9740ae750 con 0x7fb9741514d0 2024-05-08T20:54:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9740675e0 con 0x7fb9741514d0 2024-05-08T20:54:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9680b3070 con 0x7fb9741514d0 2024-05-08T20:54:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb9667fc640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 0x7fb958068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb979c17640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 0x7fb958068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb96811ea70 con 0x7fb9741514d0 2024-05-08T20:54:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.013+0000 7fb979c17640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 0x7fb958068b50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb96c000f70 tx=0x7fb96c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.017+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb9680ebbf0 con 0x7fb9741514d0 2024-05-08T20:54:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.173+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb974074950 con 0x7fb9741514d0 2024-05-08T20:54:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb9667fc640 1 -- 172.21.15.81:0/3851641809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7fb9680b1020 con 0x7fb9741514d0 2024-05-08T20:54:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:28.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 msgr2=0x7fb958068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 0x7fb958068b50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb96c000f70 tx=0x7fb96c009040 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 msgr2=0x7fb9741f07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9680af040 tx=0x7fb9680191c0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 shutdown_connections 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb958066690 0x7fb958068b50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9741514d0 0x7fb9741f07f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb974154cf0 0x7fb9741f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 --2- 172.21.15.81:0/3851641809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb974151f00 0x7fb9740ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 >> 172.21.15.81:0/3851641809 conn(0x7fb9740715f0 msgr2=0x7fb974152550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 shutdown_connections 2024-05-08T20:54:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.177+0000 7fb97be7b640 1 -- 172.21.15.81:0/3851641809 wait complete. 2024-05-08T20:54:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:28.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 Processor -- start 2024-05-08T20:54:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 -- start start 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 0x7fa0801588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa080154cf0 0x7fa080155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa080158e20 con 0x7fa080155690 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08006bb20 con 0x7fa080154cf0 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.309+0000 7fa086df0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0801548e0 con 0x7fa080151f00 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa080154cf0 0x7fa080155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa080154cf0 0x7fa080155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55644/0 (socket says 172.21.15.81:55644) 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa08538d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa080155690 0x7fa0800ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51970/0 (socket says 172.21.15.81:51970) 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 -- 172.21.15.81:0/2387719508 learned_addr learned my addr 172.21.15.81:0/2387719508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa084b8c640 1 --2- 172.21.15.81:0/2387719508 >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 0x7fa0801588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 -- 172.21.15.81:0/2387719508 >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 msgr2=0x7fa0801588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 --2- 172.21.15.81:0/2387719508 >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 0x7fa0801588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 -- 172.21.15.81:0/2387719508 >> v1:172.21.15.81:6789/0 conn(0x7fa080155690 legacy=0x7fa0800ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 -- 172.21.15.81:0/2387719508 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0801522e0 con 0x7fa080154cf0 2024-05-08T20:54:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa084b8c640 1 --2- 172.21.15.81:0/2387719508 >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 0x7fa0801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07ffff640 1 --2- 172.21.15.81:0/2387719508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa080154cf0 0x7fa080155150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa0800cb390 tx=0x7fa06c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e188ed9cc32f7e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07f7fe640 1 -- 172.21.15.81:0/2387719508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0ab620 con 0x7fa080154cf0 2024-05-08T20:54:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07f7fe640 1 -- 172.21.15.81:0/2387719508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c0ab780 con 0x7fa080154cf0 2024-05-08T20:54:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa07f7fe640 1 -- 172.21.15.81:0/2387719508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0abb10 con 0x7fa080154cf0 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 -- 172.21.15.81:0/2387719508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa080154cf0 msgr2=0x7fa080155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 --2- 172.21.15.81:0/2387719508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa080154cf0 0x7fa080155150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa0800cb390 tx=0x7fa06c01c400 comp rx=0 tx=0).stop 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 -- 172.21.15.81:0/2387719508 shutdown_connections 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 --2- 172.21.15.81:0/2387719508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa080154cf0 0x7fa080155150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 --2- 172.21.15.81:0/2387719508 >> v2:172.21.15.117:3300/0 conn(0x7fa080151f00 0x7fa0801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 -- 172.21.15.81:0/2387719508 >> 172.21.15.81:0/2387719508 conn(0x7fa0800715f0 msgr2=0x7fa080071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 -- 172.21.15.81:0/2387719508 shutdown_connections 2024-05-08T20:54:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.313+0000 7fa086df0640 1 -- 172.21.15.81:0/2387719508 wait complete. 2024-05-08T20:54:28.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 Processor -- start 2024-05-08T20:54:28.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- start start 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa080151f00 0x7fa0800ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa080154cf0 0x7fa0801498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa080149e10 con 0x7fa08014dfd0 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08014fef0 con 0x7fa080151f00 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0801501d0 con 0x7fa080154cf0 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55652/0 (socket says 172.21.15.81:55652) 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 -- 172.21.15.81:0/4137705807 learned_addr learned my addr 172.21.15.81:0/4137705807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07ffff640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa080154cf0 0x7fa0801498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa084b8c640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa080151f00 0x7fa0800ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 -- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa080154cf0 msgr2=0x7fa0801498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa080154cf0 0x7fa0801498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 -- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa080151f00 msgr2=0x7fa0800ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa080151f00 0x7fa0800ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 -- 172.21.15.81:0/4137705807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0094d0 con 0x7fa08014dfd0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa08538d640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa07800c7a0 tx=0x7fa07800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800a640 con 0x7fa08014dfd0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07800a7a0 con 0x7fa08014dfd0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0801504b0 con 0x7fa08014dfd0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800ab10 con 0x7fa08014dfd0 2024-05-08T20:54:28.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0800ac580 con 0x7fa08014dfd0 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0800675e0 con 0x7fa08014dfd0 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa07800ac70 con 0x7fa08014dfd0 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.317+0000 7fa07d7fa640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 0x7fa064068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.321+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa078083c80 con 0x7fa08014dfd0 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.321+0000 7fa084b8c640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 0x7fa064068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.321+0000 7fa084b8c640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 0x7fa064068b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa074006fd0 tx=0x7fa074008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.325+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa078050d00 con 0x7fa08014dfd0 2024-05-08T20:54:28.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.473+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0800ac770 con 0x7fa08014dfd0 2024-05-08T20:54:28.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa07d7fa640 1 -- 172.21.15.81:0/4137705807 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa078017020 con 0x7fa08014dfd0 2024-05-08T20:54:28.482 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 msgr2=0x7fa064068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 0x7fa064068b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa074006fd0 tx=0x7fa074008040 comp rx=0 tx=0).stop 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 msgr2=0x7fa0800acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa07800c7a0 tx=0x7fa07800cc60 comp rx=0 tx=0).stop 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 shutdown_connections 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fa0640666c0 0x7fa064068b80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08014dfd0 0x7fa0800acaa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa080154cf0 0x7fa0801498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 --2- 172.21.15.81:0/4137705807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa080151f00 0x7fa0800ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 >> 172.21.15.81:0/4137705807 conn(0x7fa0800715f0 msgr2=0x7fa0800719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 shutdown_connections 2024-05-08T20:54:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.477+0000 7fa086df0640 1 -- 172.21.15.81:0/4137705807 wait complete. 2024-05-08T20:54:28.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:54:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 Processor -- start 2024-05-08T20:54:28.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 -- start start 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0500ca000 0x7fb0500ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb050155860 con 0x7fb050154cf0 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0501522e0 con 0x7fb050151f00 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb054c5e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05006bb20 con 0x7fb0500ca000 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0500ca000 0x7fb0500ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0500ca000 0x7fb0500ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55658/0 (socket says 172.21.15.81:55658) 2024-05-08T20:54:28.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1485841875 learned_addr learned my addr 172.21.15.81:0/1485841875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04dd9b640 1 --1- 172.21.15.81:0/1485841875 >> v1:172.21.15.81:6789/0 conn(0x7fb050154cf0 0x7fb050155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51978/0 (socket says 172.21.15.81:51978) 2024-05-08T20:54:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1485841875 >> v1:172.21.15.117:6789/0 conn(0x7fb050151f00 legacy=0x7fb0501588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1485841875 >> v1:172.21.15.81:6789/0 conn(0x7fb050154cf0 legacy=0x7fb050155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1485841875 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500c5f80 con 0x7fb0500ca000 2024-05-08T20:54:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.617+0000 7fb04ed9d640 1 --2- 172.21.15.81:0/1485841875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0500ca000 0x7fb0500ca440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb050155a50 tx=0x7fb04801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4528c9a3dd32eda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04d59a640 1 -- 172.21.15.81:0/1485841875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480a5790 con 0x7fb0500ca000 2024-05-08T20:54:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04d59a640 1 -- 172.21.15.81:0/1485841875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480a58f0 con 0x7fb0500ca000 2024-05-08T20:54:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04d59a640 1 -- 172.21.15.81:0/1485841875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480a5c80 con 0x7fb0500ca000 2024-05-08T20:54:28.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1485841875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0500ca000 msgr2=0x7fb0500ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1485841875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0500ca000 0x7fb0500ca440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb050155a50 tx=0x7fb04801c8b0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1485841875 shutdown_connections 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1485841875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0500ca000 0x7fb0500ca440 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1485841875 >> 172.21.15.81:0/1485841875 conn(0x7fb0500715f0 msgr2=0x7fb050071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1485841875 shutdown_connections 2024-05-08T20:54:28.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1485841875 wait complete. 2024-05-08T20:54:28.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 Processor -- start 2024-05-08T20:54:28.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- start start 2024-05-08T20:54:28.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0500ca000 0x7fb0501f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb050151f00 0x7fb050154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500ad610 con 0x7fb050154cf0 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500af500 con 0x7fb0500ca000 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500adb30 con 0x7fb050151f00 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55674/0 (socket says 172.21.15.81:55674) 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1671739231 learned_addr learned my addr 172.21.15.81:0/1671739231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb050151f00 msgr2=0x7fb050154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb050151f00 0x7fb050154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0500ca000 msgr2=0x7fb0501f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0500ca000 0x7fb0501f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 -- 172.21.15.81:0/1671739231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048009b30 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb04ed9d640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0480194c0 tx=0x7fb048019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b8670 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480b87d0 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b8b60 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0501f0d60 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.621+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050153720 con 0x7fb050154cf0 2024-05-08T20:54:28.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0500675e0 con 0x7fb050154cf0 2024-05-08T20:54:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0480b8cc0 con 0x7fb050154cf0 2024-05-08T20:54:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb03effd640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 0x7fb030068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb04811f8b0 con 0x7fb050154cf0 2024-05-08T20:54:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb04e59c640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 0x7fb030068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.625+0000 7fb04e59c640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 0x7fb030068b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb040009670 tx=0x7fb040006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.629+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb0480eca30 con 0x7fb050154cf0 2024-05-08T20:54:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.773+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb050074950 con 0x7fb050154cf0 2024-05-08T20:54:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.773+0000 7fb03effd640 1 -- 172.21.15.81:0/1671739231 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fb0480bc020 con 0x7fb050154cf0 2024-05-08T20:54:28.780 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:28.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 msgr2=0x7fb030068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 0x7fb030068b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb040009670 tx=0x7fb040006bd0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 msgr2=0x7fb05014c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0480194c0 tx=0x7fb048019650 comp rx=0 tx=0).stop 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 shutdown_connections 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb030066690 0x7fb030068b50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb050154cf0 0x7fb05014c320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb050151f00 0x7fb050154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 --2- 172.21.15.81:0/1671739231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0500ca000 0x7fb0501f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 >> 172.21.15.81:0/1671739231 conn(0x7fb0500715f0 msgr2=0x7fb0500c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 shutdown_connections 2024-05-08T20:54:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.777+0000 7fb054c5e640 1 -- 172.21.15.81:0/1671739231 wait complete. 2024-05-08T20:54:28.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:54:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 Processor -- start 2024-05-08T20:54:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 -- start start 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f344406f400 0x7f34440c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34440c0650 con 0x7f34441501e0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344406fa80 con 0x7f34440725f0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344bb9d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344406fd60 con 0x7f344406f400 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449939640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34441501e0 0x7f344406c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40218/0 (socket says 172.21.15.81:40218) 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449939640 1 -- 172.21.15.81:0/3122150739 learned_addr learned my addr 172.21.15.81:0/3122150739 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344a13a640 1 --2- 172.21.15.81:0/3122150739 >> v2:172.21.15.117:3300/0 conn(0x7f344406f400 0x7f34440c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931693998 0 0) 0x7f34440c0650 con 0x7f34441501e0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3430003530 con 0x7f34441501e0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3971899262 0 0) 0x7f3430003530 con 0x7f34441501e0 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 >> v2:172.21.15.117:3300/0 conn(0x7f344406f400 msgr2=0x7f34440c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 --2- 172.21.15.81:0/3122150739 >> v2:172.21.15.117:3300/0 conn(0x7f344406f400 0x7f34440c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 >> v1:172.21.15.117:6789/0 conn(0x7f34440725f0 legacy=0x7f34440c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444071ea0 con 0x7f34441501e0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f3434001680 con 0x7f34441501e0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 >> v1:172.21.15.81:6789/0 conn(0x7f34441501e0 legacy=0x7f344406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430003980 0x7f3430003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 0x7f3430004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34300052b0 0x7f343000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344406fd60 con 0x7f34300047d0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343000c180 con 0x7f3430003980 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343000c340 con 0x7f34300052b0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 0x7f3430004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449939640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430003980 0x7f3430003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344a13a640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34300052b0 0x7f343000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 -- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34300052b0 msgr2=0x7f343000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34300052b0 0x7f343000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 -- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430003980 msgr2=0x7f3430003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3430003980 0x7f3430003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f3449138640 1 -- 172.21.15.81:0/3122150739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430003530 con 0x7f34300047d0 2024-05-08T20:54:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.905+0000 7f344a13a640 1 -- 172.21.15.81:0/3122150739 reap_dead start 2024-05-08T20:54:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f3449138640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 0x7f3430004c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3440001750 tx=0x7f344001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d71985503ebf25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400050d0 con 0x7f34300047d0 2024-05-08T20:54:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34400a7050 con 0x7f34300047d0 2024-05-08T20:54:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f3448937640 1 -- 172.21.15.81:0/3122150739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440005490 con 0x7f34300047d0 2024-05-08T20:54:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 msgr2=0x7f3430004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 0x7f3430004c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3440001750 tx=0x7f344001c3a0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- 172.21.15.81:0/3122150739 shutdown_connections 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3122150739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34300047d0 0x7f3430004c50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- 172.21.15.81:0/3122150739 >> 172.21.15.81:0/3122150739 conn(0x7f34440c2ca0 msgr2=0x7f34440c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- 172.21.15.81:0/3122150739 shutdown_connections 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- 172.21.15.81:0/3122150739 wait complete. 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 Processor -- start 2024-05-08T20:54:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- start start 2024-05-08T20:54:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 0x7f34441ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 0x7f34441ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444072180 con 0x7f34441edca0 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34440c58b0 con 0x7f34300047d0 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344bb9d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34441eb810 con 0x7f34440c4630 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344a13a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344a13a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45420/0 (socket says 172.21.15.81:45420) 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.909+0000 7f344a13a640 1 -- 172.21.15.81:0/3735020988 learned_addr learned my addr 172.21.15.81:0/3735020988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449939640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 0x7f34441ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449138640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 0x7f34441ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 -- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 msgr2=0x7f34441ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 0x7f34441ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 -- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 msgr2=0x7f34441ec0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 0x7f34441ec0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 -- 172.21.15.81:0/3735020988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34441ebaf0 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449939640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 0x7f34441ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449138640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 0x7f34441ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344a13a640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f34440c2b80 tx=0x7f343c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c00e070 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c011db0 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34440c3e30 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0039a0 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34440c5580 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344406d810 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f343c003b00 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 0x7f3428068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f343c084d50 con 0x7f34441edca0 2024-05-08T20:54:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449939640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 0x7f3428068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.913+0000 7f3449939640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 0x7f3428068b80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f344404fbc0 tx=0x7f3434000ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:28.917+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f343c088030 con 0x7f34441edca0 2024-05-08T20:54:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f34440c4350 con 0x7f34441edca0 2024-05-08T20:54:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f343a7fc640 1 -- 172.21.15.81:0/3735020988 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f34440c4350 con 0x7f34441edca0 2024-05-08T20:54:29.071 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 msgr2=0x7f3428068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 0x7f3428068b80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f344404fbc0 tx=0x7f3434000ee0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 msgr2=0x7f3444149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f34440c2b80 tx=0x7f343c0115a0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 shutdown_connections 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f34280666c0 0x7f3428068b80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34441edca0 0x7f3444149590 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34440c4630 0x7f34441ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 --2- 172.21.15.81:0/3735020988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34300047d0 0x7f34441ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 >> 172.21.15.81:0/3735020988 conn(0x7f34440c2ca0 msgr2=0x7f3444143050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 shutdown_connections 2024-05-08T20:54:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.065+0000 7f344bb9d640 1 -- 172.21.15.81:0/3735020988 wait complete. 2024-05-08T20:54:29.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:54:29.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:29.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 Processor -- start 2024-05-08T20:54:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 -- start start 2024-05-08T20:54:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d980c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980c4de0 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980c50c0 con 0x7f6d98155340 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9f7c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9806a080 con 0x7f6d980afb40 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d980c81c0 0x7f6d9806abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40226/0 (socket says 172.21.15.81:40226) 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/3800687538 learned_addr learned my addr 172.21.15.81:0/3800687538 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9d55e640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d980c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998198249 0 0) 0x7f6d980c4de0 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d84003530 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 274497907 0 0) 0x7f6d84003530 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 msgr2=0x7f6d980c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d980c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 >> v1:172.21.15.117:6789/0 conn(0x7f6d98155340 legacy=0x7f6d9806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980c53a0 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f6d90001a00 con 0x7f6d980c81c0 2024-05-08T20:54:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 >> v1:172.21.15.81:6789/0 conn(0x7f6d980c81c0 legacy=0x7f6d9806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84003f30 0x7f6d840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d84004d10 0x7f6d84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9806a080 con 0x7f6d84004d10 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8400bbd0 con 0x7f6d84003f30 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8400bd90 con 0x7f6d980afb40 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d84004d10 0x7f6d84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9cd5d640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84003f30 0x7f6d840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9d55e640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 msgr2=0x7f6d840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980afb40 0x7f6d840039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84003f30 msgr2=0x7f6d840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84003f30 0x7f6d840047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.197+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/3800687538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84003530 con 0x7f6d84004d10 2024-05-08T20:54:29.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d84004d10 0x7f6d84005190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000a830 tx=0x7f6d9001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbbd2072ac654dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900070d0 con 0x7f6d84004d10 2024-05-08T20:54:29.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d900a8070 con 0x7f6d84004d10 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d8ffff640 1 -- 172.21.15.81:0/3800687538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90007490 con 0x7f6d84004d10 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/3800687538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d84004d10 msgr2=0x7f6d84005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/3800687538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d84004d10 0x7f6d84005190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000a830 tx=0x7f6d9001d360 comp rx=0 tx=0).stop 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/3800687538 reap_dead start 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/3800687538 shutdown_connections 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/3800687538 >> 172.21.15.81:0/3800687538 conn(0x7f6d980abfb0 msgr2=0x7f6d980ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/3800687538 shutdown_connections 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/3800687538 wait complete. 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 Processor -- start 2024-05-08T20:54:29.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- start start 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84004d10 0x7f6d98156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d981460a0 0x7f6d980aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981589f0 con 0x7f6d98155c80 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981443e0 con 0x7f6d84004d10 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9f7c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981edf60 con 0x7f6d981460a0 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9dd5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9dd5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45440/0 (socket says 172.21.15.81:45440) 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.201+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/814020353 learned_addr learned my addr 172.21.15.81:0/814020353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9d55e640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84004d10 0x7f6d98156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9cd5d640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d981460a0 0x7f6d980aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d981460a0 msgr2=0x7f6d980aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d981460a0 0x7f6d980aa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84004d10 msgr2=0x7f6d98156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84004d10 0x7f6d98156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 -- 172.21.15.81:0/814020353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d981ee240 con 0x7f6d98155c80 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9dd5f640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d9001cdd0 tx=0x7f6d84005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90001210 con 0x7f6d98155c80 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90001800 con 0x7f6d98155c80 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900072d0 con 0x7f6d98155c80 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d98144630 con 0x7f6d98155c80 2024-05-08T20:54:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980aaae0 con 0x7f6d98155c80 2024-05-08T20:54:29.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d98144b50 con 0x7f6d98155c80 2024-05-08T20:54:29.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d900aa030 con 0x7f6d98155c80 2024-05-08T20:54:29.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 0x7f6d7c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6d9011e2a0 con 0x7f6d98155c80 2024-05-08T20:54:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9d55e640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 0x7f6d7c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.205+0000 7f6d9d55e640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 0x7f6d7c068b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009a30 tx=0x7f6d94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.209+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6d98144b50 con 0x7f6d98155c80 2024-05-08T20:54:29.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.361+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d98144b50 con 0x7f6d98155c80 2024-05-08T20:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.361+0000 7f6d8dffb640 1 -- 172.21.15.81:0/814020353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f6d98144b50 con 0x7f6d98155c80 2024-05-08T20:54:29.369 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 msgr2=0x7f6d7c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 0x7f6d7c068b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009a30 tx=0x7f6d94008040 comp rx=0 tx=0).stop 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 msgr2=0x7f6d98144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d9001cdd0 tx=0x7f6d84005800 comp rx=0 tx=0).stop 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 shutdown_connections 2024-05-08T20:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6d7c0666c0 0x7f6d7c068b80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d98155c80 0x7f6d98144e30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d981460a0 0x7f6d980aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 --2- 172.21.15.81:0/814020353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d84004d10 0x7f6d98156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 >> 172.21.15.81:0/814020353 conn(0x7f6d980abfb0 msgr2=0x7f6d980ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 shutdown_connections 2024-05-08T20:54:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.365+0000 7f6d9f7c2640 1 -- 172.21.15.81:0/814020353 wait complete. 2024-05-08T20:54:29.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:54:29.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.505+0000 7fb8dac1a640 1 Processor -- start 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.505+0000 7fb8dac1a640 1 -- start start 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d40c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d41535a0 0x7fb8d415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d4155060 con 0x7fb8d40c1bb0 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d4155340 con 0x7fb8d41535a0 2024-05-08T20:54:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d4155620 con 0x7fb8d4151740 2024-05-08T20:54:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d41535a0 0x7fb8d415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d41535a0 0x7fb8d415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45454/0 (socket says 172.21.15.81:45454) 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 -- 172.21.15.81:0/3814741406 learned_addr learned my addr 172.21.15.81:0/3814741406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d3fff640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d40c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 -- 172.21.15.81:0/3814741406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 msgr2=0x7fb8d40c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d40c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 -- 172.21.15.81:0/3814741406 >> v1:172.21.15.117:6789/0 conn(0x7fb8d40c1bb0 legacy=0x7fb8d4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 -- 172.21.15.81:0/3814741406 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4155900 con 0x7fb8d41535a0 2024-05-08T20:54:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d91b7640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d415c080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009e50 tx=0x7fb8cc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89041db0b6643e9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d37fe640 1 -- 172.21.15.81:0/3814741406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0a5770 con 0x7fb8d41535a0 2024-05-08T20:54:29.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d37fe640 1 -- 172.21.15.81:0/3814741406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0a58d0 con 0x7fb8d41535a0 2024-05-08T20:54:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8d37fe640 1 -- 172.21.15.81:0/3814741406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0a5c60 con 0x7fb8d41535a0 2024-05-08T20:54:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- 172.21.15.81:0/3814741406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 msgr2=0x7fb8d415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d415c080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009e50 tx=0x7fb8cc01c960 comp rx=0 tx=0).stop 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- 172.21.15.81:0/3814741406 shutdown_connections 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d415c080 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/3814741406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d40c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- 172.21.15.81:0/3814741406 >> 172.21.15.81:0/3814741406 conn(0x7fb8d40c2ca0 msgr2=0x7fb8d40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- 172.21.15.81:0/3814741406 shutdown_connections 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.509+0000 7fb8dac1a640 1 -- 172.21.15.81:0/3814741406 wait complete. 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 Processor -- start 2024-05-08T20:54:29.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- start start 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 0x7fb8d41eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d4156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d4157ce0 con 0x7fb8d41535a0 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40bfd00 con 0x7fb8d40c1bb0 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d41ef7f0 con 0x7fb8d4151740 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45466/0 (socket says 172.21.15.81:45466) 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 -- 172.21.15.81:0/223553469 learned_addr learned my addr 172.21.15.81:0/223553469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d3fff640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d4156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d89b6640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 0x7fb8d41eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 -- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 msgr2=0x7fb8d4156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d4156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 -- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 msgr2=0x7fb8d41eeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 0x7fb8d41eeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 -- 172.21.15.81:0/223553469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009b30 con 0x7fb8d41535a0 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d3fff640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d4156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d89b6640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 0x7fb8d41eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d91b7640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af040 tx=0x7fb8cc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0b8670 con 0x7fb8d41535a0 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0b87d0 con 0x7fb8d41535a0 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0b8b80 con 0x7fb8d41535a0 2024-05-08T20:54:29.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d40bff50 con 0x7fb8d41535a0 2024-05-08T20:54:29.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d4151090 con 0x7fb8d41535a0 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.513+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d41515b0 con 0x7fb8d41535a0 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.517+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8cc0b8ce0 con 0x7fb8d41535a0 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.517+0000 7fb8d17fa640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 0x7fb8c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.517+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb8cc11f940 con 0x7fb8d41535a0 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.517+0000 7fb8d89b6640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 0x7fb8c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.517+0000 7fb8d89b6640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 0x7fb8c0068b50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000f70 tx=0x7fb8c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.521+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb8cc0ecb70 con 0x7fb8d41535a0 2024-05-08T20:54:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fb8d4074950 con 0x7fb8d41535a0 2024-05-08T20:54:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8d17fa640 1 -- 172.21.15.81:0/223553469 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fb8cc0bc020 con 0x7fb8d41535a0 2024-05-08T20:54:29.675 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 msgr2=0x7fb8c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 0x7fb8c0068b50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000f70 tx=0x7fb8c4009040 comp rx=0 tx=0).stop 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 msgr2=0x7fb8d4156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.669+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af040 tx=0x7fb8cc019700 comp rx=0 tx=0).stop 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 shutdown_connections 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8c0066690 0x7fb8c0068b50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d41535a0 0x7fb8d4156fa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8d4151740 0x7fb8d4156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 --2- 172.21.15.81:0/223553469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8d40c1bb0 0x7fb8d41eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 >> 172.21.15.81:0/223553469 conn(0x7fb8d40c2ca0 msgr2=0x7fb8d4070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 shutdown_connections 2024-05-08T20:54:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.673+0000 7fb8dac1a640 1 -- 172.21.15.81:0/223553469 wait complete. 2024-05-08T20:54:29.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:54:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 Processor -- start 2024-05-08T20:54:29.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 -- start start 2024-05-08T20:54:29.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb101501e0 0x7fcb1006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb100c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100c0650 con 0x7fcb1006f400 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1006fd60 con 0x7fcb101501e0 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb16238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10072180 con 0x7fcb100725f0 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb101501e0 0x7fcb1006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcb101501e0 0x7fcb1006c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45472/0 (socket says 172.21.15.81:45472) 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 -- 172.21.15.81:0/3886155946 learned_addr learned my addr 172.21.15.81:0/3886155946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0effd640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb100c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 -- 172.21.15.81:0/3886155946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 msgr2=0x7fcb100c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb100c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 -- 172.21.15.81:0/3886155946 >> v1:172.21.15.117:6789/0 conn(0x7fcb1006f400 legacy=0x7fcb100c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.805+0000 7fcb0f7fe640 1 -- 172.21.15.81:0/3886155946 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1006fa80 con 0x7fcb101501e0 2024-05-08T20:54:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0f7fe640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb1006c930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009e50 tx=0x7fcb0801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f451913c5f70ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0e7fc640 1 -- 172.21.15.81:0/3886155946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a57c0 con 0x7fcb101501e0 2024-05-08T20:54:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0e7fc640 1 -- 172.21.15.81:0/3886155946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080a5920 con 0x7fcb101501e0 2024-05-08T20:54:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0e7fc640 1 -- 172.21.15.81:0/3886155946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a5cb0 con 0x7fcb101501e0 2024-05-08T20:54:29.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- 172.21.15.81:0/3886155946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 msgr2=0x7fcb1006c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb1006c930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009e50 tx=0x7fcb0801c8e0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- 172.21.15.81:0/3886155946 shutdown_connections 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb100c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- 172.21.15.81:0/3886155946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb1006c930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- 172.21.15.81:0/3886155946 >> 172.21.15.81:0/3886155946 conn(0x7fcb100c2ca0 msgr2=0x7fcb100c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- 172.21.15.81:0/3886155946 shutdown_connections 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- 172.21.15.81:0/3886155946 wait complete. 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 Processor -- start 2024-05-08T20:54:29.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- start start 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1006f400 0x7fcb10149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb10148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10156ec0 con 0x7fcb101501e0 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100c5f70 con 0x7fcb1006f400 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb16238640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10146540 con 0x7fcb100725f0 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45476/0 (socket says 172.21.15.81:45476) 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.809+0000 7fcb0ffff640 1 -- 172.21.15.81:0/2981216030 learned_addr learned my addr 172.21.15.81:0/2981216030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0effd640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb10148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0f7fe640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1006f400 0x7fcb10149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 -- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 msgr2=0x7fcb10148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb10148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 -- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1006f400 msgr2=0x7fcb10149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1006f400 0x7fcb10149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 -- 172.21.15.81:0/2981216030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08009b30 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0ffff640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000c340 tx=0x7fcb0000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00005220 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00005380 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb10150740 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00007270 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb100c5a50 con 0x7fcb101501e0 2024-05-08T20:54:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb10074950 con 0x7fcb101501e0 2024-05-08T20:54:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb000073d0 con 0x7fcb101501e0 2024-05-08T20:54:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 0x7fcaf0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcb000839f0 con 0x7fcb101501e0 2024-05-08T20:54:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0f7fe640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 0x7fcaf0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.813+0000 7fcb0f7fe640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 0x7fcaf0068b50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ae000 tx=0x7fcb080a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.817+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcb00050a50 con 0x7fcb101501e0 2024-05-08T20:54:29.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb1014c780 con 0x7fcb101501e0 2024-05-08T20:54:29.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb07fff640 1 -- 172.21.15.81:0/2981216030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb00054070 con 0x7fcb101501e0 2024-05-08T20:54:29.983 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-05-08T20:54:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 msgr2=0x7fcaf0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 0x7fcaf0068b50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ae000 tx=0x7fcb080a7070 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 msgr2=0x7fcb100bf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.977+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000c340 tx=0x7fcb0000c800 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 shutdown_connections 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fcaf0066690 0x7fcaf0068b50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb101501e0 0x7fcb100bf5d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb100725f0 0x7fcb10148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 --2- 172.21.15.81:0/2981216030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb1006f400 0x7fcb10149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 >> 172.21.15.81:0/2981216030 conn(0x7fcb100c2ca0 msgr2=0x7fcb100712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 shutdown_connections 2024-05-08T20:54:29.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:29.981+0000 7fcb16238640 1 -- 172.21.15.81:0/2981216030 wait complete. 2024-05-08T20:54:30.001 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-08T20:54:30.001 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:54:30.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.105+0000 7f2d9d424640 1 Processor -- start 2024-05-08T20:54:30.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.105+0000 7f2d9d424640 1 -- start start 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d9d424640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d981501e0 0x7f2d9806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d9d424640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d980725f0 0x7f2d980c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d9d424640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980c0650 con 0x7f2d9806f400 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d9d424640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9806fd60 con 0x7f2d980725f0 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d9d424640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98072180 con 0x7f2d981501e0 2024-05-08T20:54:30.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d980725f0 0x7f2d980c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d980725f0 0x7f2d980c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45480/0 (socket says 172.21.15.81:45480) 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 -- 172.21.15.81:0/3256423819 learned_addr learned my addr 172.21.15.81:0/3256423819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d96ffd640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d981501e0 0x7f2d9806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 -- 172.21.15.81:0/3256423819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d981501e0 msgr2=0x7f2d9806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d981501e0 0x7f2d9806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 -- 172.21.15.81:0/3256423819 >> v1:172.21.15.81:6789/0 conn(0x7f2d9806f400 legacy=0x7f2d980c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 -- 172.21.15.81:0/3256423819 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9806fa80 con 0x7f2d980725f0 2024-05-08T20:54:30.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d967fc640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d980725f0 0x7f2d980c1c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea98f34014c5851 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d95ffb640 1 -- 172.21.15.81:0/3256423819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0a7070 con 0x7f2d980725f0 2024-05-08T20:54:30.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d95ffb640 1 -- 172.21.15.81:0/3256423819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0ab430 con 0x7f2d980725f0 2024-05-08T20:54:30.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.109+0000 7f2d95ffb640 1 -- 172.21.15.81:0/3256423819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0ab7c0 con 0x7f2d980725f0 2024-05-08T20:54:30.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/3256423819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d980725f0 msgr2=0x7f2d980c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d980725f0 0x7f2d980c1c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009870 tx=0x7f2d8c01c410 comp rx=0 tx=0).stop 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/3256423819 shutdown_connections 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d980725f0 0x7f2d980c1c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- 172.21.15.81:0/3256423819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d981501e0 0x7f2d9806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/3256423819 >> 172.21.15.81:0/3256423819 conn(0x7f2d980c2ca0 msgr2=0x7f2d980c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/3256423819 shutdown_connections 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/3256423819 wait complete. 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 Processor -- start 2024-05-08T20:54:30.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- start start 2024-05-08T20:54:30.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9806f400 0x7f2d9814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 0x7f2d980a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9814d7f0 con 0x7f2d981501e0 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981f1360 con 0x7f2d980725f0 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9806c980 con 0x7f2d9806f400 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45484/0 (socket says 172.21.15.81:45484) 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 -- 172.21.15.81:0/4110784043 learned_addr learned my addr 172.21.15.81:0/4110784043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d96ffd640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9806f400 0x7f2d9814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d967fc640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 0x7f2d980a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 -- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9806f400 msgr2=0x7f2d9814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9806f400 0x7f2d9814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 -- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 msgr2=0x7f2d980a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 0x7f2d980a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 -- 172.21.15.81:0/4110784043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0094d0 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d967fc640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 0x7f2d980a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d977fe640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c760 tx=0x7f2d9000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90003b80 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90003ce0 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d98150740 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000aa30 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d981f0d10 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.113+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d981f14d0 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.117+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d9000ab90 con 0x7f2d981501e0 2024-05-08T20:54:30.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.117+0000 7f2d7f7fe640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 0x7f2d84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.117+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2d900842d0 con 0x7f2d981501e0 2024-05-08T20:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.117+0000 7f2d96ffd640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 0x7f2d84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.117+0000 7f2d96ffd640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 0x7f2d84068b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2d981eb420 tx=0x7f2d88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.121+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2d90051290 con 0x7f2d981501e0 2024-05-08T20:54:30.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.265+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d98074950 con 0x7f2d981501e0 2024-05-08T20:54:30.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d7f7fe640 1 -- 172.21.15.81:0/4110784043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7f2d900548b0 con 0x7f2d981501e0 2024-05-08T20:54:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:30.275 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 msgr2=0x7f2d84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 0x7f2d84068b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2d981eb420 tx=0x7f2d88008040 comp rx=0 tx=0).stop 2024-05-08T20:54:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 msgr2=0x7f2d98142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c760 tx=0x7f2d9000cc20 comp rx=0 tx=0).stop 2024-05-08T20:54:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 shutdown_connections 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2d84066690 0x7f2d84068b50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d981501e0 0x7f2d98142280 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d980725f0 0x7f2d980a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 --2- 172.21.15.81:0/4110784043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9806f400 0x7f2d9814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 >> 172.21.15.81:0/4110784043 conn(0x7f2d980c2ca0 msgr2=0x7f2d980bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 shutdown_connections 2024-05-08T20:54:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.269+0000 7f2d9d424640 1 -- 172.21.15.81:0/4110784043 wait complete. 2024-05-08T20:54:30.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:27:07.299974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-05-08T20:27:17.243066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-05-08T20:27:17.854875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-05-08T20:27:25.763523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-05-08T20:27:26.947347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:30.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:30.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.405+0000 7f64fba6b640 1 Processor -- start 2024-05-08T20:54:30.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 -- start start 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64f41501e0 0x7f64f406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f40c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f40c0650 con 0x7f64f406f400 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f406fd60 con 0x7f64f41501e0 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64fba6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4072180 con 0x7f64f40725f0 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64f41501e0 0x7f64f406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64f41501e0 0x7f64f406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45492/0 (socket says 172.21.15.81:45492) 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 -- 172.21.15.81:0/1747575125 learned_addr learned my addr 172.21.15.81:0/1747575125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9006640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f40c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 -- 172.21.15.81:0/1747575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 msgr2=0x7f64f40c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f40c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 -- 172.21.15.81:0/1747575125 >> v1:172.21.15.117:6789/0 conn(0x7f64f406f400 legacy=0x7f64f40c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 -- 172.21.15.81:0/1747575125 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f406fa80 con 0x7f64f41501e0 2024-05-08T20:54:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9006640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f9807640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f41501e0 0x7f64f406c930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009870 tx=0x7f64f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be09d8f7f90656a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f8805640 1 -- 172.21.15.81:0/1747575125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00ac410 con 0x7f64f41501e0 2024-05-08T20:54:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f8805640 1 -- 172.21.15.81:0/1747575125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f00ac570 con 0x7f64f41501e0 2024-05-08T20:54:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.409+0000 7f64f8805640 1 -- 172.21.15.81:0/1747575125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00ac900 con 0x7f64f41501e0 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/1747575125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f41501e0 msgr2=0x7f64f406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f41501e0 0x7f64f406c930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009870 tx=0x7f64f001c3d0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/1747575125 shutdown_connections 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f40c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- 172.21.15.81:0/1747575125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f41501e0 0x7f64f406c930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/1747575125 >> 172.21.15.81:0/1747575125 conn(0x7f64f40c2ca0 msgr2=0x7f64f40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/1747575125 shutdown_connections 2024-05-08T20:54:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/1747575125 wait complete. 2024-05-08T20:54:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 Processor -- start 2024-05-08T20:54:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- start start 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f4143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f41501e0 0x7f64f4144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4146fa0 con 0x7f64f406f400 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f413fb90 con 0x7f64f41501e0 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4146190 con 0x7f64f40725f0 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45498/0 (socket says 172.21.15.81:45498) 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 -- 172.21.15.81:0/2258230750 learned_addr learned my addr 172.21.15.81:0/2258230750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fa008640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f41501e0 0x7f64f4144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9006640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f4143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 -- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 msgr2=0x7f64f4143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f4143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 -- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f41501e0 msgr2=0x7f64f4144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f41501e0 0x7f64f4144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 -- 172.21.15.81:0/2258230750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00094d0 con 0x7f64f406f400 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64f9807640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64f00af040 tx=0x7f64f0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00ac410 con 0x7f64f406f400 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f00b65f0 con 0x7f64f406f400 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f4150740 con 0x7f64f406f400 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00b6980 con 0x7f64f406f400 2024-05-08T20:54:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.413+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f4146cc0 con 0x7f64f406f400 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f4074950 con 0x7f64f406f400 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64f00b6ae0 con 0x7f64f406f400 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64ea7fc640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 0x7f64d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f64f011eeb0 con 0x7f64f406f400 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64f9006640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 0x7f64d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.417+0000 7f64f9006640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 0x7f64d8068b50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f64f4149dc0 tx=0x7f64e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.421+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f64f00ec030 con 0x7f64f406f400 2024-05-08T20:54:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64f4071b80 con 0x7f64f406f400 2024-05-08T20:54:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64ea7fc640 1 -- 172.21.15.81:0/2258230750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64f00b1020 con 0x7f64f406f400 2024-05-08T20:54:30.582 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-08T20:54:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 msgr2=0x7f64d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 0x7f64d8068b50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f64f4149dc0 tx=0x7f64e4008040 comp rx=0 tx=0).stop 2024-05-08T20:54:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 msgr2=0x7f64f40c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64f00af040 tx=0x7f64f0019170 comp rx=0 tx=0).stop 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 shutdown_connections 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f64d8066690 0x7f64d8068b50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f41501e0 0x7f64f4144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64f40725f0 0x7f64f4143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 --2- 172.21.15.81:0/2258230750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64f406f400 0x7f64f40c5040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 >> 172.21.15.81:0/2258230750 conn(0x7f64f40c2ca0 msgr2=0x7f64f406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 shutdown_connections 2024-05-08T20:54:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.577+0000 7f64fba6b640 1 -- 172.21.15.81:0/2258230750 wait complete. 2024-05-08T20:54:30.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-05-08T20:54:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.701+0000 7f28af7b6640 1 Processor -- start 2024-05-08T20:54:30.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.701+0000 7f28af7b6640 1 -- start start 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a806f400 0x7f28a80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a80c0650 con 0x7f28a81501e0 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a806fa80 con 0x7f28a80725f0 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a806fd60 con 0x7f28a806f400 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a806f400 0x7f28a80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a806f400 0x7f28a80c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45506/0 (socket says 172.21.15.81:45506) 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 -- 172.21.15.81:0/244804583 learned_addr learned my addr 172.21.15.81:0/244804583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 -- 172.21.15.81:0/244804583 >> v1:172.21.15.117:6789/0 conn(0x7f28a80725f0 legacy=0x7f28a80c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 -- 172.21.15.81:0/244804583 >> v1:172.21.15.81:6789/0 conn(0x7f28a81501e0 legacy=0x7f28a806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 -- 172.21.15.81:0/244804583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8071ea0 con 0x7f28a806f400 2024-05-08T20:54:30.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28add53640 1 --2- 172.21.15.81:0/244804583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a80c2350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009e50 tx=0x7f28a001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35104195a8432f71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f289ffff640 1 -- 172.21.15.81:0/244804583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a56c0 con 0x7f28a806f400 2024-05-08T20:54:30.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f289ffff640 1 -- 172.21.15.81:0/244804583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00a5820 con 0x7f28a806f400 2024-05-08T20:54:30.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f289ffff640 1 -- 172.21.15.81:0/244804583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a5bb0 con 0x7f28a806f400 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- 172.21.15.81:0/244804583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 msgr2=0x7f28a80c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 --2- 172.21.15.81:0/244804583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a80c2350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009e50 tx=0x7f28a001c8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- 172.21.15.81:0/244804583 shutdown_connections 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 --2- 172.21.15.81:0/244804583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a80c2350 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- 172.21.15.81:0/244804583 >> 172.21.15.81:0/244804583 conn(0x7f28a80c2ca0 msgr2=0x7f28a80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- 172.21.15.81:0/244804583 shutdown_connections 2024-05-08T20:54:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.705+0000 7f28af7b6640 1 -- 172.21.15.81:0/244804583 wait complete. 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 Processor -- start 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- start start 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28a80725f0 0x7f28a81453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a81501e0 0x7f28a81ec200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8072180 con 0x7f28a806f400 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a81436e0 con 0x7f28a81501e0 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a813a250 con 0x7f28a80725f0 2024-05-08T20:54:30.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45508/0 (socket says 172.21.15.81:45508) 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 -- 172.21.15.81:0/2269740821 learned_addr learned my addr 172.21.15.81:0/2269740821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28acd51640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28a80725f0 0x7f28a81453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 -- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28a80725f0 msgr2=0x7f28a81453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28a80725f0 0x7f28a81453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 -- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a81501e0 msgr2=0x7f28a81ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28add53640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a81501e0 0x7f28a81ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a81501e0 0x7f28a81ec200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 -- 172.21.15.81:0/2269740821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0009b30 con 0x7f28a806f400 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28ad552640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c3c0 tx=0x7f28a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40052d0 con 0x7f28a806f400 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4005430 con 0x7f28a806f400 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a8150740 con 0x7f28a806f400 2024-05-08T20:54:30.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4003840 con 0x7f28a806f400 2024-05-08T20:54:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a81448f0 con 0x7f28a806f400 2024-05-08T20:54:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a8074950 con 0x7f28a806f400 2024-05-08T20:54:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28a40039a0 con 0x7f28a806f400 2024-05-08T20:54:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 0x7f288c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f28a4083a70 con 0x7f28a806f400 2024-05-08T20:54:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.709+0000 7f28acd51640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 0x7f288c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.713+0000 7f28acd51640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 0x7f288c068b50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28a80c6170 tx=0x7f2898008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.713+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f28a4050a40 con 0x7f28a806f400 2024-05-08T20:54:30.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.861+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28a8067410 con 0x7f28a806f400 2024-05-08T20:54:30.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.861+0000 7f289dffb640 1 -- 172.21.15.81:0/2269740821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f28a40170a0 con 0x7f28a806f400 2024-05-08T20:54:30.869 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 msgr2=0x7f288c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 0x7f288c068b50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f28a80c6170 tx=0x7f2898008040 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 msgr2=0x7f28a8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c3c0 tx=0x7f28a400c880 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 shutdown_connections 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f288c066690 0x7f288c068b50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a81501e0 0x7f28a81ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28a80725f0 0x7f28a81453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 --2- 172.21.15.81:0/2269740821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f400 0x7f28a8139c60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 >> 172.21.15.81:0/2269740821 conn(0x7f28a80c2ca0 msgr2=0x7f28a806aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:30.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 shutdown_connections 2024-05-08T20:54:30.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.865+0000 7f28af7b6640 1 -- 172.21.15.81:0/2269740821 wait complete. 2024-05-08T20:54:30.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-05-08T20:54:30.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 Processor -- start 2024-05-08T20:54:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 -- start start 2024-05-08T20:54:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe18151740 0x7fbe180c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe1815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe18155060 con 0x7fbe180c1bb0 2024-05-08T20:54:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe18155340 con 0x7fbe18151740 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1fb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18155620 con 0x7fbe181535a0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d903640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe180c1bb0 0x7fbe18152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40262/0 (socket says 172.21.15.81:40262) 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d903640 1 -- 172.21.15.81:0/2124920870 learned_addr learned my addr 172.21.15.81:0/2124920870 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1e104640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe1815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 --2- 172.21.15.81:0/2124920870 >> v2:172.21.15.117:3300/0 conn(0x7fbe18151740 0x7fbe180c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905115119 0 0) 0x7fbe18155060 con 0x7fbe180c1bb0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe04003530 con 0x7fbe180c1bb0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229685896 0 0) 0x7fbe04003530 con 0x7fbe180c1bb0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 msgr2=0x7fbe1815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe1815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 >> v2:172.21.15.117:3300/0 conn(0x7fbe18151740 msgr2=0x7fbe180c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 --2- 172.21.15.81:0/2124920870 >> v2:172.21.15.117:3300/0 conn(0x7fbe18151740 0x7fbe180c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18155900 con 0x7fbe180c1bb0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fbe14001680 con 0x7fbe180c1bb0 2024-05-08T20:54:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 >> v1:172.21.15.81:6789/0 conn(0x7fbe180c1bb0 legacy=0x7fbe18152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe04003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe04004d10 0x7fbe04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18155340 con 0x7fbe04003f00 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18155620 con 0x7fbe04004d10 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0400b9e0 con 0x7fbe181535a0 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d903640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe04003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 -- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 msgr2=0x7fbe04003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe181535a0 0x7fbe04003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 -- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe04004d10 msgr2=0x7fbe04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1e104640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe04004d10 0x7fbe04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe04004d10 0x7fbe04005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.993+0000 7fbe1d102640 1 -- 172.21.15.81:0/2124920870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04003530 con 0x7fbe04003f00 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d102640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe040047d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009b10 tx=0x7fbe0801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f682522df1e142c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080a5590 con 0x7fbe04003f00 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe080a56f0 con 0x7fbe04003f00 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1c901640 1 -- 172.21.15.81:0/2124920870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080a5aa0 con 0x7fbe04003f00 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/2124920870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 msgr2=0x7fbe040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/2124920870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe040047d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009b10 tx=0x7fbe0801ca70 comp rx=0 tx=0).stop 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1e104640 1 -- 172.21.15.81:0/2124920870 reap_dead start 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/2124920870 shutdown_connections 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/2124920870 >> 172.21.15.81:0/2124920870 conn(0x7fbe180c2ca0 msgr2=0x7fbe180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/2124920870 shutdown_connections 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/2124920870 wait complete. 2024-05-08T20:54:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 Processor -- start 2024-05-08T20:54:31.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- start start 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1806afd0 0x7fbe1806b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe18147f20 0x7fbe181483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe181488e0 con 0x7fbe04003f00 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe181eaf50 con 0x7fbe1806afd0 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180c5da0 con 0x7fbe18147f20 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45516/0 (socket says 172.21.15.81:45516) 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 -- 172.21.15.81:0/603916392 learned_addr learned my addr 172.21.15.81:0/603916392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d102640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1806afd0 0x7fbe1806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 -- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe18147f20 msgr2=0x7fbe181483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe18147f20 0x7fbe181483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 -- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1806afd0 msgr2=0x7fbe1806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1806afd0 0x7fbe1806b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 -- 172.21.15.81:0/603916392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1814c430 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1d903640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbe14001210 tx=0x7fbe1400dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140074e0 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14007640 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1814c710 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:30.997+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140049f0 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe18149030 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe18074950 con 0x7fbe04003f00 2024-05-08T20:54:31.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe14004b50 con 0x7fbe04003f00 2024-05-08T20:54:31.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe0e7fc640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 0x7fbdfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbe14084080 con 0x7fbe04003f00 2024-05-08T20:54:31.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe1d102640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 0x7fbdfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.001+0000 7fbe1d102640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 0x7fbdfc068b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbe080af000 tx=0x7fbe080046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.005+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe140510e0 con 0x7fbe04003f00 2024-05-08T20:54:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.153+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fbe180c39a0 con 0x7fbe04003f00 2024-05-08T20:54:31.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.153+0000 7fbe0e7fc640 1 -- 172.21.15.81:0/603916392 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fbe140190a0 con 0x7fbe04003f00 2024-05-08T20:54:31.161 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 msgr2=0x7fbdfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 0x7fbdfc068b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbe080af000 tx=0x7fbe080046d0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 msgr2=0x7fbe18156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbe14001210 tx=0x7fbe1400dad0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 shutdown_connections 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbdfc066690 0x7fbdfc068b50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe18147f20 0x7fbe181483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe1806afd0 0x7fbe1806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 --2- 172.21.15.81:0/603916392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe04003f00 0x7fbe18156740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 >> 172.21.15.81:0/603916392 conn(0x7fbe180c2ca0 msgr2=0x7fbe18150ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 shutdown_connections 2024-05-08T20:54:31.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.157+0000 7fbe1fb67640 1 -- 172.21.15.81:0/603916392 wait complete. 2024-05-08T20:54:31.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-05-08T20:54:31.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 Processor -- start 2024-05-08T20:54:31.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 -- start start 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0180c1bb0 0x7fb018151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0180c1f90 0x7fb018152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0181533d0 0x7fb01806c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180c2420 con 0x7fb0180c1bb0 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb018155060 con 0x7fb0180c1f90 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01f891640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb018155340 con 0x7fb0181533d0 2024-05-08T20:54:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0180c1bb0 0x7fb018151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb0180c1bb0 0x7fb018151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 -- 172.21.15.81:0/240508493 learned_addr learned my addr 172.21.15.81:0/240508493 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 -- 172.21.15.81:0/240508493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0181533d0 msgr2=0x7fb01806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 --2- 172.21.15.81:0/240508493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0181533d0 0x7fb01806c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 -- 172.21.15.81:0/240508493 >> v2:172.21.15.117:3300/0 conn(0x7fb0180c1f90 msgr2=0x7fb018152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 --2- 172.21.15.81:0/240508493 >> v2:172.21.15.117:3300/0 conn(0x7fb0180c1f90 0x7fb018152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.285+0000 7fb01d62d640 1 -- 172.21.15.81:0/240508493 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018155620 con 0x7fb0180c1bb0 2024-05-08T20:54:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01d62d640 1 --2- 172.21.15.81:0/240508493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180c1bb0 0x7fb018151740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb01806ec10 tx=0x7fb01001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871c8b85a9a7fb39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb00ffff640 1 -- 172.21.15.81:0/240508493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100ab600 con 0x7fb0180c1bb0 2024-05-08T20:54:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb00ffff640 1 -- 172.21.15.81:0/240508493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100a7050 con 0x7fb0180c1bb0 2024-05-08T20:54:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb00ffff640 1 -- 172.21.15.81:0/240508493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100ab980 con 0x7fb0180c1bb0 2024-05-08T20:54:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 -- 172.21.15.81:0/240508493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180c1bb0 msgr2=0x7fb018151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 --2- 172.21.15.81:0/240508493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180c1bb0 0x7fb018151740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb01806ec10 tx=0x7fb01001c460 comp rx=0 tx=0).stop 2024-05-08T20:54:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 -- 172.21.15.81:0/240508493 shutdown_connections 2024-05-08T20:54:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 --2- 172.21.15.81:0/240508493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0181533d0 0x7fb01806c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 --2- 172.21.15.81:0/240508493 >> v2:172.21.15.117:3300/0 conn(0x7fb0180c1f90 0x7fb018152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 --2- 172.21.15.81:0/240508493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180c1bb0 0x7fb018151740 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 -- 172.21.15.81:0/240508493 >> 172.21.15.81:0/240508493 conn(0x7fb0180c2ca0 msgr2=0x7fb0180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 -- 172.21.15.81:0/240508493 shutdown_connections 2024-05-08T20:54:31.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.289+0000 7fb01f891640 1 -- 172.21.15.81:0/240508493 wait complete. 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 Processor -- start 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- start start 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 0x7fb0181577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180c1f90 0x7fb0180aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180a9380 con 0x7fb0181533d0 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180a9e90 con 0x7fb0180c1bb0 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180a9560 con 0x7fb0180c1f90 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45528/0 (socket says 172.21.15.81:45528) 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 -- 172.21.15.81:0/1215218658 learned_addr learned my addr 172.21.15.81:0/1215218658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01d62d640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 0x7fb0181577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01ce2c640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180c1f90 0x7fb0180aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 -- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180c1f90 msgr2=0x7fb0180aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180c1f90 0x7fb0180aaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 -- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 msgr2=0x7fb0181577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 0x7fb0181577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 -- 172.21.15.81:0/1215218658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100094d0 con 0x7fb0181533d0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01d62d640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 0x7fb0181577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01de2e640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb01400b970 tx=0x7fb01400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400cb40 con 0x7fb0181533d0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400ccc0 con 0x7fb0181533d0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0180a9840 con 0x7fb0181533d0 2024-05-08T20:54:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014014680 con 0x7fb0181533d0 2024-05-08T20:54:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0180c5e60 con 0x7fb0181533d0 2024-05-08T20:54:31.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0180aa000 con 0x7fb0181533d0 2024-05-08T20:54:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.293+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb01401d3b0 con 0x7fb0181533d0 2024-05-08T20:54:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.297+0000 7fb00dffb640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.297+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb014084420 con 0x7fb0181533d0 2024-05-08T20:54:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.297+0000 7fb01d62d640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.297+0000 7fb01d62d640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 0x7faffc068b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ad000 tx=0x7fb010008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.301+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb014051480 con 0x7fb0181533d0 2024-05-08T20:54:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.457+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb018154cc0 con 0x7fb0181533d0 2024-05-08T20:54:31.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.457+0000 7fb00dffb640 1 -- 172.21.15.81:0/1215218658 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fb014054aa0 con 0x7fb0181533d0 2024-05-08T20:54:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-08T20:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 msgr2=0x7faffc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 0x7faffc068b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ad000 tx=0x7fb010008040 comp rx=0 tx=0).stop 2024-05-08T20:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 msgr2=0x7fb0180c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb01400b970 tx=0x7fb01400be30 comp rx=0 tx=0).stop 2024-05-08T20:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 shutdown_connections 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0181533d0 0x7fb0180c3d40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0180c1f90 0x7fb0180aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 --2- 172.21.15.81:0/1215218658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0180c1bb0 0x7fb0181577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 >> 172.21.15.81:0/1215218658 conn(0x7fb0180c2ca0 msgr2=0x7fb018071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 shutdown_connections 2024-05-08T20:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.461+0000 7fb01f891640 1 -- 172.21.15.81:0/1215218658 wait complete. 2024-05-08T20:54:31.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-05-08T20:54:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 Processor -- start 2024-05-08T20:54:31.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 -- start start 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8148154970 0x7f814806a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f814806a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480c8b10 con 0x7f81481522b0 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8148152690 con 0x7f8148154970 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f814d4dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148069ec0 con 0x7f81480c8230 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f81481522b0 0x7f81480c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40264/0 (socket says 172.21.15.81:40264) 2024-05-08T20:54:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 -- 172.21.15.81:0/1526023442 learned_addr learned my addr 172.21.15.81:0/1526023442 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f813ffff640 1 --2- 172.21.15.81:0/1526023442 >> v2:172.21.15.117:3300/0 conn(0x7f8148154970 0x7f814806a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81477fe640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f814806a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925436452 0 0) 0x7f81480c8b10 con 0x7f81481522b0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8128003530 con 0x7f81481522b0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873777205 0 0) 0x7f8128003530 con 0x7f81481522b0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 msgr2=0x7f814806a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f814806a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 >> v2:172.21.15.117:3300/0 conn(0x7f8148154970 msgr2=0x7f814806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 --2- 172.21.15.81:0/1526023442 >> v2:172.21.15.117:3300/0 conn(0x7f8148154970 0x7f814806a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148154ee0 con 0x7f81481522b0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f8138001680 con 0x7f81481522b0 2024-05-08T20:54:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 >> v1:172.21.15.81:6789/0 conn(0x7f81481522b0 legacy=0x7f81480c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8128003980 0x7f8128003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81280047d0 0x7f8128004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f8128005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148069ec0 con 0x7f8128003980 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812800b990 con 0x7f81280047d0 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812800bad0 con 0x7f81480c8230 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8128003980 0x7f8128003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f813ffff640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81280047d0 0x7f8128004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f81477fe640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f8128005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 -- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 msgr2=0x7f8128005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81480c8230 0x7f8128005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 -- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81280047d0 msgr2=0x7f8128004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81280047d0 0x7f8128004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.601+0000 7f8146ffd640 1 -- 172.21.15.81:0/1526023442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128003530 con 0x7f8128003980 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f8146ffd640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8128003980 0x7f8128003da0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f813800c240 tx=0x7f813801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c376fc1963690336 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81380058e0 con 0x7f8128003980 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138005a40 con 0x7f8128003980 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81467fc640 1 -- 172.21.15.81:0/1526023442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138005e10 con 0x7f8128003980 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- 172.21.15.81:0/1526023442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8128003980 msgr2=0x7f8128003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 --2- 172.21.15.81:0/1526023442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8128003980 0x7f8128003da0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f813800c240 tx=0x7f813801cc30 comp rx=0 tx=0).stop 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 -- 172.21.15.81:0/1526023442 reap_dead start 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- 172.21.15.81:0/1526023442 shutdown_connections 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- 172.21.15.81:0/1526023442 >> 172.21.15.81:0/1526023442 conn(0x7f81480ca330 msgr2=0x7f81480ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- 172.21.15.81:0/1526023442 shutdown_connections 2024-05-08T20:54:31.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- 172.21.15.81:0/1526023442 wait complete. 2024-05-08T20:54:31.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 Processor -- start 2024-05-08T20:54:31.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- start start 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 0x7f8148155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81480c2420 0x7f81481432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148142e20 con 0x7f814814ce10 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c3bb0 con 0x7f81480c2420 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f814d4dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814814e160 con 0x7f8128003980 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45544/0 (socket says 172.21.15.81:45544) 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 -- 172.21.15.81:0/4275874221 learned_addr learned my addr 172.21.15.81:0/4275874221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f8146ffd640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 0x7f8148155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f813ffff640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81480c2420 0x7f81481432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 -- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 msgr2=0x7f8148155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 0x7f8148155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 -- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81480c2420 msgr2=0x7f81481432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81480c2420 0x7f81481432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f81477fe640 1 -- 172.21.15.81:0/4275874221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814814dec0 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.605+0000 7f8146ffd640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 0x7f8148155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f81477fe640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8140007d10 tx=0x7f81400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e070 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140011e40 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81480c3fd0 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400039a0 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81480c42b0 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480675e0 con 0x7f814814ce10 2024-05-08T20:54:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8140003b20 con 0x7f814814ce10 2024-05-08T20:54:31.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 0x7f812c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f8146ffd640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 0x7f812c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8140084ba0 con 0x7f814814ce10 2024-05-08T20:54:31.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.609+0000 7f8146ffd640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 0x7f812c068b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f81380aa000 tx=0x7f8138001a10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.613+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8140051b70 con 0x7f814814ce10 2024-05-08T20:54:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.773+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f8148074950 con 0x7f814814ce10 2024-05-08T20:54:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.773+0000 7f813f7fe640 1 -- 172.21.15.81:0/4275874221 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f8140055190 con 0x7f814814ce10 2024-05-08T20:54:31.781 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 msgr2=0x7f812c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 0x7f812c068b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f81380aa000 tx=0x7f8138001a10 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 msgr2=0x7f814814d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8140007d10 tx=0x7f81400115a0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 shutdown_connections 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f812c066690 0x7f812c068b50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f814814ce10 0x7f814814d290 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81480c2420 0x7f81481432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 --2- 172.21.15.81:0/4275874221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8128003980 0x7f8148155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 >> 172.21.15.81:0/4275874221 conn(0x7f81480ca330 msgr2=0x7f8148147700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 shutdown_connections 2024-05-08T20:54:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.777+0000 7f814d4dc640 1 -- 172.21.15.81:0/4275874221 wait complete. 2024-05-08T20:54:31.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 Processor -- start 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 -- start start 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7dc41521f0 0x7f7dc41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40aa830 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc4155a20 con 0x7f7dc41521f0 2024-05-08T20:54:31.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dcc134640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4072900 con 0x7f7dc40c1bb0 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc96cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7dc41521f0 0x7f7dc41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc96cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:33588/0 (socket says 172.21.15.81:33588) 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7dc41521f0 0x7f7dc41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43518/0 (socket says 172.21.15.81:43518) 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dca6d1640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7dc40bf9b0 0x7f7dc40bfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:33120/0 (socket says 172.21.15.81:33120) 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc96cf640 1 -- 172.21.15.81:0/1486877535 learned_addr learned my addr 172.21.15.81:0/1486877535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 msgr2=0x7f7dc40c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1486877535 >> v1:172.21.15.117:6789/0 conn(0x7f7dc40bf9b0 legacy=0x7f7dc40bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1486877535 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40c0640 con 0x7f7dc41521f0 2024-05-08T20:54:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.917+0000 7f7dc96cf640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dc9ed0640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc41521f0 0x7f7dc41554e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097c0 tx=0x7f7db401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f97d147d1fbbf77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dc8ece640 1 -- 172.21.15.81:0/1486877535 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40ad640 con 0x7f7dc41521f0 2024-05-08T20:54:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dc8ece640 1 -- 172.21.15.81:0/1486877535 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db40ad7a0 con 0x7f7dc41521f0 2024-05-08T20:54:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dc8ece640 1 -- 172.21.15.81:0/1486877535 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40adb30 con 0x7f7dc41521f0 2024-05-08T20:54:31.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 -- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc41521f0 msgr2=0x7f7dc41554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc41521f0 0x7f7dc41554e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097c0 tx=0x7f7db401c4a0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 -- 172.21.15.81:0/1486877535 shutdown_connections 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc40c1bb0 0x7f7dc40c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1486877535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc41521f0 0x7f7dc41554e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 -- 172.21.15.81:0/1486877535 >> 172.21.15.81:0/1486877535 conn(0x7f7dc40c2ca0 msgr2=0x7f7dc40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 -- 172.21.15.81:0/1486877535 shutdown_connections 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.921+0000 7f7dcc134640 1 -- 172.21.15.81:0/1486877535 wait complete. 2024-05-08T20:54:31.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 Processor -- start 2024-05-08T20:54:31.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- start start 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc40c1bb0 0x7f7dc406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc41521f0 0x7f7dc40713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41ed060 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40a8f90 con 0x7f7dc40c1bb0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc415e2c0 con 0x7f7dc41521f0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45560/0 (socket says 172.21.15.81:45560) 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1345680860 learned_addr learned my addr 172.21.15.81:0/1345680860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dca6d1640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc41521f0 0x7f7dc40713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc96cf640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc40c1bb0 0x7f7dc406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc41521f0 msgr2=0x7f7dc40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc41521f0 0x7f7dc40713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc40c1bb0 msgr2=0x7f7dc406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc40c1bb0 0x7f7dc406b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 -- 172.21.15.81:0/1345680860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00094d0 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dc9ed0640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7db40b0040 tx=0x7f7db4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40b6610 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db40a6040 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db4009420 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40b6990 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc41ed270 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4074950 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.925+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7db40b4040 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.929+0000 7f7dba7fc640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 0x7f7da8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.929+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7db411e350 con 0x7f7dc40bf9b0 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.929+0000 7f7dc96cf640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 0x7f7da8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.929+0000 7f7dc96cf640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 0x7f7da8068b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7dc414c580 tx=0x7f7dc0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:31.933+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7db40eb460 con 0x7f7dc40bf9b0 2024-05-08T20:54:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7dc40c0640 con 0x7f7dc40bf9b0 2024-05-08T20:54:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dba7fc640 1 -- 172.21.15.81:0/1345680860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7dc40c0640 con 0x7f7dc40bf9b0 2024-05-08T20:54:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 msgr2=0x7f7da8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 0x7f7da8068b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7dc414c580 tx=0x7f7dc0009240 comp rx=0 tx=0).stop 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 msgr2=0x7f7dc40a8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7db40b0040 tx=0x7f7db4019240 comp rx=0 tx=0).stop 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 shutdown_connections 2024-05-08T20:54:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f7da8066690 0x7f7da8068b50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7dc41521f0 0x7f7dc40713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc40c1bb0 0x7f7dc406b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 --2- 172.21.15.81:0/1345680860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dc40bf9b0 0x7f7dc40a8a50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 >> 172.21.15.81:0/1345680860 conn(0x7f7dc40c2ca0 msgr2=0x7f7dc415ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 shutdown_connections 2024-05-08T20:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:32.105+0000 7f7dcc134640 1 -- 172.21.15.81:0/1345680860 wait complete. 2024-05-08T20:54:32.130 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-05-08T20:54:32.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:32.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T20:54:32.173 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:54:32.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[33493]: fuse finished with error 0 and tester_r 0 2024-05-08T20:54:38.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:54:38.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.275 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T20:54:38.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.293 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-08T20:54:38.356 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T20:54:38.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:54:38.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-08T20:54:38.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.564 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-08T20:54:38.622 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T20:54:38.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.623 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T20:54:38.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:54:38.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-05-08T20:54:38.809 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T20:54:38.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T20:54:38.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:54:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 Processor -- start 2024-05-08T20:54:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- start start 2024-05-08T20:54:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f150c072270 0x7f150c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f150c06da40 0x7f150c156180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c06f3a0 con 0x7f150c14c5a0 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c0c2bc0 con 0x7f150c06da40 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c06d560 con 0x7f150c072270 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f150c06da40 0x7f150c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f150c06da40 0x7f150c156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56968/0 (socket says 172.21.15.81:56968) 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 -- 172.21.15.81:0/3722896656 learned_addr learned my addr 172.21.15.81:0/3722896656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 -- 172.21.15.81:0/3722896656 >> v2:172.21.15.117:3300/0 conn(0x7f150c072270 msgr2=0x7f150c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- 172.21.15.81:0/3722896656 >> v2:172.21.15.117:3300/0 conn(0x7f150c072270 0x7f150c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 --2- 172.21.15.81:0/3722896656 >> v2:172.21.15.117:3300/0 conn(0x7f150c072270 0x7f150c155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 -- 172.21.15.81:0/3722896656 >> v1:172.21.15.81:6789/0 conn(0x7f150c14c5a0 legacy=0x7f150c0c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 -- 172.21.15.81:0/3722896656 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c1569a0 con 0x7f150c06da40 2024-05-08T20:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1511d67640 1 --2- 172.21.15.81:0/3722896656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c06da40 0x7f150c156180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f150c072870 tx=0x7f150401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83630e94ab1a86bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1503fff640 1 -- 172.21.15.81:0/3722896656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040a5760 con 0x7f150c06da40 2024-05-08T20:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1503fff640 1 -- 172.21.15.81:0/3722896656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15040a58c0 con 0x7f150c06da40 2024-05-08T20:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1503fff640 1 -- 172.21.15.81:0/3722896656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040a5c50 con 0x7f150c06da40 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/3722896656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c06da40 msgr2=0x7f150c156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- 172.21.15.81:0/3722896656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c06da40 0x7f150c156180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f150c072870 tx=0x7f150401c8a0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/3722896656 shutdown_connections 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- 172.21.15.81:0/3722896656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c06da40 0x7f150c156180 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- 172.21.15.81:0/3722896656 >> v2:172.21.15.117:3300/0 conn(0x7f150c072270 0x7f150c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/3722896656 >> 172.21.15.81:0/3722896656 conn(0x7f150c0c4cc0 msgr2=0x7f150c0c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/3722896656 shutdown_connections 2024-05-08T20:54:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/3722896656 wait complete. 2024-05-08T20:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 Processor -- start 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- start start 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f150c06da40 0x7f150c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c14c5a0 0x7f150c141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c154ac0 con 0x7f150c072270 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c142380 con 0x7f150c14c5a0 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c153f40 con 0x7f150c06da40 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56972/0 (socket says 172.21.15.81:56972) 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 -- 172.21.15.81:0/4174779602 learned_addr learned my addr 172.21.15.81:0/4174779602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 -- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f150c06da40 msgr2=0x7f150c0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f150c06da40 0x7f150c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 -- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c14c5a0 msgr2=0x7f150c141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c14c5a0 0x7f150c141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 -- 172.21.15.81:0/4174779602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009b30 con 0x7f150c072270 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1510d65640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c7f0 tx=0x7f14fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc004230 con 0x7f150c072270 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc004390 con 0x7f150c072270 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c154220 con 0x7f150c072270 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc003860 con 0x7f150c072270 2024-05-08T20:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.953+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c1547e0 con 0x7f150c072270 2024-05-08T20:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c06eb70 con 0x7f150c072270 2024-05-08T20:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14fc003bd0 con 0x7f150c072270 2024-05-08T20:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f1501ffb640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 0x7f14f0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f14fc084500 con 0x7f150c072270 2024-05-08T20:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f1511566640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 0x7f14f0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.957+0000 7f1511566640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 0x7f14f0068b80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1508000f70 tx=0x7f15080079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:38.961+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f14fc051560 con 0x7f150c072270 2024-05-08T20:54:39.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.121+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f150c0c2760 con 0x7f14f00666c0 2024-05-08T20:54:39.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.161+0000 7f1501ffb640 1 -- 172.21.15.81:0/4174779602 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528782 (secure 0 0 0) 0x7f1508005080 con 0x7f14f00666c0 2024-05-08T20:54:39.171 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:54:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 msgr2=0x7f14f0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 0x7f14f0068b80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1508000f70 tx=0x7f15080079c0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 msgr2=0x7f150c141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c7f0 tx=0x7f14fc00ccb0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 shutdown_connections 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f14f00666c0 0x7f14f0068b80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c14c5a0 0x7f150c141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150c072270 0x7f150c141900 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 --2- 172.21.15.81:0/4174779602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f150c06da40 0x7f150c0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 >> 172.21.15.81:0/4174779602 conn(0x7f150c0c4cc0 msgr2=0x7f150c149dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 shutdown_connections 2024-05-08T20:54:39.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.169+0000 7f15137ca640 1 -- 172.21.15.81:0/4174779602 wait complete. 2024-05-08T20:54:39.195 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":844,"stamp":"2024-05-08T20:54:37.889891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622869,"ondisk_log_size":622869,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005253"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408085+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408085+0000","last_peered":"2024-05-08T20:54:32.408085+0000","last_clean":"2024-05-08T20:54:32.408085+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408085+0000","last_undegraded":"2024-05-08T20:54:32.408085+0000","last_fullsized":"2024-05-08T20:54:32.408085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'764","reported_seq":794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.326300+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:52:23.326300+0000","last_peered":"2024-05-08T20:52:23.326300+0000","last_clean":"2024-05-08T20:52:23.326300+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:52:23.326300+0000","last_undegraded":"2024-05-08T20:52:23.326300+0000","last_fullsized":"2024-05-08T20:52:23.326300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.760841+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:21.760841+0000","last_peered":"2024-05-08T20:54:21.760841+0000","last_clean":"2024-05-08T20:54:21.760841+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:21.760841+0000","last_undegraded":"2024-05-08T20:54:21.760841+0000","last_fullsized":"2024-05-08T20:54:21.760841+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972492+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:54:12.972492+0000","last_peered":"2024-05-08T20:54:12.972492+0000","last_clean":"2024-05-08T20:54:12.972492+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:12.972492+0000","last_undegraded":"2024-05-08T20:54:12.972492+0000","last_fullsized":"2024-05-08T20:54:12.972492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345231+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:32.345231+0000","last_peered":"2024-05-08T20:54:32.345231+0000","last_clean":"2024-05-08T20:54:32.345231+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:32.345231+0000","last_undegraded":"2024-05-08T20:54:32.345231+0000","last_fullsized":"2024-05-08T20:54:32.345231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.484572+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:52:16.484572+0000","last_peered":"2024-05-08T20:52:16.484572+0000","last_clean":"2024-05-08T20:52:16.484572+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:52:16.484572+0000","last_undegraded":"2024-05-08T20:52:16.484572+0000","last_fullsized":"2024-05-08T20:52:16.484572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.836075+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:54:21.836075+0000","last_peered":"2024-05-08T20:54:21.836075+0000","last_clean":"2024-05-08T20:54:21.836075+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:21.836075+0000","last_undegraded":"2024-05-08T20:54:21.836075+0000","last_fullsized":"2024-05-08T20:54:21.836075+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:04.433355+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:54:04.433355+0000","last_peered":"2024-05-08T20:54:04.433355+0000","last_clean":"2024-05-08T20:54:04.433355+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:54:04.433355+0000","last_undegraded":"2024-05-08T20:54:04.433355+0000","last_fullsized":"2024-05-08T20:54:04.433355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3618,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385127+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:32.385127+0000","last_peered":"2024-05-08T20:54:32.385127+0000","last_clean":"2024-05-08T20:54:32.385127+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:32.385127+0000","last_undegraded":"2024-05-08T20:54:32.385127+0000","last_fullsized":"2024-05-08T20:54:32.385127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.097096+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:52:15.097096+0000","last_peered":"2024-05-08T20:52:15.097096+0000","last_clean":"2024-05-08T20:52:15.097096+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:52:15.097096+0000","last_undegraded":"2024-05-08T20:52:15.097096+0000","last_fullsized":"2024-05-08T20:52:15.097096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842236+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:54:21.842236+0000","last_peered":"2024-05-08T20:54:21.842236+0000","last_clean":"2024-05-08T20:54:21.842236+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:21.842236+0000","last_undegraded":"2024-05-08T20:54:21.842236+0000","last_fullsized":"2024-05-08T20:54:21.842236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'618","reported_seq":641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.975632+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:54:12.975632+0000","last_peered":"2024-05-08T20:54:12.975632+0000","last_clean":"2024-05-08T20:54:12.975632+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:12.975632+0000","last_undegraded":"2024-05-08T20:54:12.975632+0000","last_fullsized":"2024-05-08T20:54:12.975632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.321288+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:54:32.321288+0000","last_peered":"2024-05-08T20:54:32.321288+0000","last_clean":"2024-05-08T20:54:32.321288+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:54:32.321288+0000","last_undegraded":"2024-05-08T20:54:32.321288+0000","last_fullsized":"2024-05-08T20:54:32.321288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.593251+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:52:17.593251+0000","last_peered":"2024-05-08T20:52:17.593251+0000","last_clean":"2024-05-08T20:52:17.593251+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:52:17.593251+0000","last_undegraded":"2024-05-08T20:52:17.593251+0000","last_fullsized":"2024-05-08T20:52:17.593251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.899026+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:54:21.899026+0000","last_peered":"2024-05-08T20:54:21.899026+0000","last_clean":"2024-05-08T20:54:21.899026+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:21.899026+0000","last_undegraded":"2024-05-08T20:54:21.899026+0000","last_fullsized":"2024-05-08T20:54:21.899026+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.187731+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:54:32.187731+0000","last_peered":"2024-05-08T20:54:32.187731+0000","last_clean":"2024-05-08T20:54:32.187731+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:32.187731+0000","last_undegraded":"2024-05-08T20:54:32.187731+0000","last_fullsized":"2024-05-08T20:54:32.187731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385482+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:32.385482+0000","last_peered":"2024-05-08T20:54:32.385482+0000","last_clean":"2024-05-08T20:54:32.385482+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:32.385482+0000","last_undegraded":"2024-05-08T20:54:32.385482+0000","last_fullsized":"2024-05-08T20:54:32.385482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.790464+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:54:21.790464+0000","last_peered":"2024-05-08T20:54:21.790464+0000","last_clean":"2024-05-08T20:54:21.790464+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:54:21.790464+0000","last_undegraded":"2024-05-08T20:54:21.790464+0000","last_fullsized":"2024-05-08T20:54:21.790464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.606595+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:52:17.606595+0000","last_peered":"2024-05-08T20:52:17.606595+0000","last_clean":"2024-05-08T20:52:17.606595+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:52:17.606595+0000","last_undegraded":"2024-05-08T20:52:17.606595+0000","last_fullsized":"2024-05-08T20:52:17.606595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.997993+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:54:12.997993+0000","last_peered":"2024-05-08T20:54:12.997993+0000","last_clean":"2024-05-08T20:54:12.997993+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:12.997993+0000","last_undegraded":"2024-05-08T20:54:12.997993+0000","last_fullsized":"2024-05-08T20:54:12.997993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.720841+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:54:32.720841+0000","last_peered":"2024-05-08T20:54:32.720841+0000","last_clean":"2024-05-08T20:54:32.720841+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:54:32.720841+0000","last_undegraded":"2024-05-08T20:54:32.720841+0000","last_fullsized":"2024-05-08T20:54:32.720841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792716+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.792716+0000","last_peered":"2024-05-08T20:54:21.792716+0000","last_clean":"2024-05-08T20:54:21.792716+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.792716+0000","last_undegraded":"2024-05-08T20:54:21.792716+0000","last_fullsized":"2024-05-08T20:54:21.792716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489381+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:52:16.489381+0000","last_peered":"2024-05-08T20:52:16.489381+0000","last_clean":"2024-05-08T20:52:16.489381+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:52:16.489381+0000","last_undegraded":"2024-05-08T20:52:16.489381+0000","last_fullsized":"2024-05-08T20:52:16.489381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.993291+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:54:12.993291+0000","last_peered":"2024-05-08T20:54:12.993291+0000","last_clean":"2024-05-08T20:54:12.993291+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:12.993291+0000","last_undegraded":"2024-05-08T20:54:12.993291+0000","last_fullsized":"2024-05-08T20:54:12.993291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3463,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368057+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:32.368057+0000","last_peered":"2024-05-08T20:54:32.368057+0000","last_clean":"2024-05-08T20:54:32.368057+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:32.368057+0000","last_undegraded":"2024-05-08T20:54:32.368057+0000","last_fullsized":"2024-05-08T20:54:32.368057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793596+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793596+0000","last_peered":"2024-05-08T20:54:21.793596+0000","last_clean":"2024-05-08T20:54:21.793596+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793596+0000","last_undegraded":"2024-05-08T20:54:21.793596+0000","last_fullsized":"2024-05-08T20:54:21.793596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.078657+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:52:15.078657+0000","last_peered":"2024-05-08T20:52:15.078657+0000","last_clean":"2024-05-08T20:52:15.078657+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:52:15.078657+0000","last_undegraded":"2024-05-08T20:52:15.078657+0000","last_fullsized":"2024-05-08T20:52:15.078657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.986661+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:54:12.986661+0000","last_peered":"2024-05-08T20:54:12.986661+0000","last_clean":"2024-05-08T20:54:12.986661+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:12.986661+0000","last_undegraded":"2024-05-08T20:54:12.986661+0000","last_fullsized":"2024-05-08T20:54:12.986661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.392109+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:32.392109+0000","last_peered":"2024-05-08T20:54:32.392109+0000","last_clean":"2024-05-08T20:54:32.392109+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:32.392109+0000","last_undegraded":"2024-05-08T20:54:32.392109+0000","last_fullsized":"2024-05-08T20:54:32.392109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.759597+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:54:21.759597+0000","last_peered":"2024-05-08T20:54:21.759597+0000","last_clean":"2024-05-08T20:54:21.759597+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:54:21.759597+0000","last_undegraded":"2024-05-08T20:54:21.759597+0000","last_fullsized":"2024-05-08T20:54:21.759597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.076400+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:52:15.076400+0000","last_peered":"2024-05-08T20:52:15.076400+0000","last_clean":"2024-05-08T20:52:15.076400+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:52:15.076400+0000","last_undegraded":"2024-05-08T20:52:15.076400+0000","last_fullsized":"2024-05-08T20:52:15.076400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'7","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984726+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:54:12.984726+0000","last_peered":"2024-05-08T20:54:12.984726+0000","last_clean":"2024-05-08T20:54:12.984726+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:12.984726+0000","last_undegraded":"2024-05-08T20:54:12.984726+0000","last_fullsized":"2024-05-08T20:54:12.984726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404921+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:54:32.404921+0000","last_peered":"2024-05-08T20:54:32.404921+0000","last_clean":"2024-05-08T20:54:32.404921+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:54:32.404921+0000","last_undegraded":"2024-05-08T20:54:32.404921+0000","last_fullsized":"2024-05-08T20:54:32.404921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.752812+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:54:21.752812+0000","last_peered":"2024-05-08T20:54:21.752812+0000","last_clean":"2024-05-08T20:54:21.752812+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:21.752812+0000","last_undegraded":"2024-05-08T20:54:21.752812+0000","last_fullsized":"2024-05-08T20:54:21.752812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.519154+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:52:16.519154+0000","last_peered":"2024-05-08T20:52:16.519154+0000","last_clean":"2024-05-08T20:52:16.519154+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:52:16.519154+0000","last_undegraded":"2024-05-08T20:52:16.519154+0000","last_fullsized":"2024-05-08T20:52:16.519154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'64","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.210071+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:54:15.210071+0000","last_peered":"2024-05-08T20:54:15.210071+0000","last_clean":"2024-05-08T20:54:15.210071+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:54:15.210071+0000","last_undegraded":"2024-05-08T20:54:15.210071+0000","last_fullsized":"2024-05-08T20:54:15.210071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4005,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.360912+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:32.360912+0000","last_peered":"2024-05-08T20:54:32.360912+0000","last_clean":"2024-05-08T20:54:32.360912+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:32.360912+0000","last_undegraded":"2024-05-08T20:54:32.360912+0000","last_fullsized":"2024-05-08T20:54:32.360912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792266+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:54:21.792266+0000","last_peered":"2024-05-08T20:54:21.792266+0000","last_clean":"2024-05-08T20:54:21.792266+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:54:21.792266+0000","last_undegraded":"2024-05-08T20:54:21.792266+0000","last_fullsized":"2024-05-08T20:54:21.792266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'254","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.824742+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:54:12.824742+0000","last_peered":"2024-05-08T20:54:12.824742+0000","last_clean":"2024-05-08T20:54:12.824742+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:54:12.824742+0000","last_undegraded":"2024-05-08T20:54:12.824742+0000","last_fullsized":"2024-05-08T20:54:12.824742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.990396+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:54:12.990396+0000","last_peered":"2024-05-08T20:54:12.990396+0000","last_clean":"2024-05-08T20:54:12.990396+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:54:12.990396+0000","last_undegraded":"2024-05-08T20:54:12.990396+0000","last_fullsized":"2024-05-08T20:54:12.990396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.296768+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:32.296768+0000","last_peered":"2024-05-08T20:54:32.296768+0000","last_clean":"2024-05-08T20:54:32.296768+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:32.296768+0000","last_undegraded":"2024-05-08T20:54:32.296768+0000","last_fullsized":"2024-05-08T20:54:32.296768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.788170+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:54:21.788170+0000","last_peered":"2024-05-08T20:54:21.788170+0000","last_clean":"2024-05-08T20:54:21.788170+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:54:21.788170+0000","last_undegraded":"2024-05-08T20:54:21.788170+0000","last_fullsized":"2024-05-08T20:54:21.788170+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:30.539923+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:52:30.539923+0000","last_peered":"2024-05-08T20:52:30.539923+0000","last_clean":"2024-05-08T20:52:30.539923+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:52:30.539923+0000","last_undegraded":"2024-05-08T20:52:30.539923+0000","last_fullsized":"2024-05-08T20:52:30.539923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.971964+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:54:12.971964+0000","last_peered":"2024-05-08T20:54:12.971964+0000","last_clean":"2024-05-08T20:54:12.971964+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:54:12.971964+0000","last_undegraded":"2024-05-08T20:54:12.971964+0000","last_fullsized":"2024-05-08T20:54:12.971964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4647,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.431453+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:54:32.431453+0000","last_peered":"2024-05-08T20:54:32.431453+0000","last_clean":"2024-05-08T20:54:32.431453+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:54:32.431453+0000","last_undegraded":"2024-05-08T20:54:32.431453+0000","last_fullsized":"2024-05-08T20:54:32.431453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4651,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.898778+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:54:21.898778+0000","last_peered":"2024-05-08T20:54:21.898778+0000","last_clean":"2024-05-08T20:54:21.898778+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:21.898778+0000","last_undegraded":"2024-05-08T20:54:21.898778+0000","last_fullsized":"2024-05-08T20:54:21.898778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.130266+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:52:23.130266+0000","last_peered":"2024-05-08T20:52:23.130266+0000","last_clean":"2024-05-08T20:52:23.130266+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:52:23.130266+0000","last_undegraded":"2024-05-08T20:52:23.130266+0000","last_fullsized":"2024-05-08T20:52:23.130266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.634805+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:54:07.634805+0000","last_peered":"2024-05-08T20:54:07.634805+0000","last_clean":"2024-05-08T20:54:07.634805+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:07.634805+0000","last_undegraded":"2024-05-08T20:54:07.634805+0000","last_fullsized":"2024-05-08T20:54:07.634805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.364835+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:54:32.364835+0000","last_peered":"2024-05-08T20:54:32.364835+0000","last_clean":"2024-05-08T20:54:32.364835+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:54:32.364835+0000","last_undegraded":"2024-05-08T20:54:32.364835+0000","last_fullsized":"2024-05-08T20:54:32.364835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5908,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.814282+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:54:21.814282+0000","last_peered":"2024-05-08T20:54:21.814282+0000","last_clean":"2024-05-08T20:54:21.814282+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:54:21.814282+0000","last_undegraded":"2024-05-08T20:54:21.814282+0000","last_fullsized":"2024-05-08T20:54:21.814282+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:20.746091+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:52:20.746091+0000","last_peered":"2024-05-08T20:52:20.746091+0000","last_clean":"2024-05-08T20:52:20.746091+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:52:20.746091+0000","last_undegraded":"2024-05-08T20:52:20.746091+0000","last_fullsized":"2024-05-08T20:52:20.746091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.985126+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:54:12.985126+0000","last_peered":"2024-05-08T20:54:12.985126+0000","last_clean":"2024-05-08T20:54:12.985126+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:12.985126+0000","last_undegraded":"2024-05-08T20:54:12.985126+0000","last_fullsized":"2024-05-08T20:54:12.985126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325930+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:54:32.325930+0000","last_peered":"2024-05-08T20:54:32.325930+0000","last_clean":"2024-05-08T20:54:32.325930+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:54:32.325930+0000","last_undegraded":"2024-05-08T20:54:32.325930+0000","last_fullsized":"2024-05-08T20:54:32.325930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4784,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.797586+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:54:21.797586+0000","last_peered":"2024-05-08T20:54:21.797586+0000","last_clean":"2024-05-08T20:54:21.797586+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:54:21.797586+0000","last_undegraded":"2024-05-08T20:54:21.797586+0000","last_fullsized":"2024-05-08T20:54:21.797586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'72","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.130807+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:54:15.130807+0000","last_peered":"2024-05-08T20:54:15.130807+0000","last_clean":"2024-05-08T20:54:15.130807+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:15.130807+0000","last_undegraded":"2024-05-08T20:54:15.130807+0000","last_fullsized":"2024-05-08T20:54:15.130807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.983711+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:54:12.983711+0000","last_peered":"2024-05-08T20:54:12.983711+0000","last_clean":"2024-05-08T20:54:12.983711+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:12.983711+0000","last_undegraded":"2024-05-08T20:54:12.983711+0000","last_fullsized":"2024-05-08T20:54:12.983711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3652,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375188+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375188+0000","last_peered":"2024-05-08T20:54:32.375188+0000","last_clean":"2024-05-08T20:54:32.375188+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375188+0000","last_undegraded":"2024-05-08T20:54:32.375188+0000","last_fullsized":"2024-05-08T20:54:32.375188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":4996,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.838483+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:54:21.838483+0000","last_peered":"2024-05-08T20:54:21.838483+0000","last_clean":"2024-05-08T20:54:21.838483+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:21.838483+0000","last_undegraded":"2024-05-08T20:54:21.838483+0000","last_fullsized":"2024-05-08T20:54:21.838483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.496369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:52:16.496369+0000","last_peered":"2024-05-08T20:52:16.496369+0000","last_clean":"2024-05-08T20:52:16.496369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:52:16.496369+0000","last_undegraded":"2024-05-08T20:52:16.496369+0000","last_fullsized":"2024-05-08T20:52:16.496369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'276","reported_seq":301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960565+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:54:12.960565+0000","last_peered":"2024-05-08T20:54:12.960565+0000","last_clean":"2024-05-08T20:54:12.960565+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:54:12.960565+0000","last_undegraded":"2024-05-08T20:54:12.960565+0000","last_fullsized":"2024-05-08T20:54:12.960565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5503,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.403897+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:32.403897+0000","last_peered":"2024-05-08T20:54:32.403897+0000","last_clean":"2024-05-08T20:54:32.403897+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:32.403897+0000","last_undegraded":"2024-05-08T20:54:32.403897+0000","last_fullsized":"2024-05-08T20:54:32.403897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5099,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:21.824960+0000","last_peered":"2024-05-08T20:54:21.824960+0000","last_clean":"2024-05-08T20:54:21.824960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:21.824960+0000","last_undegraded":"2024-05-08T20:54:21.824960+0000","last_fullsized":"2024-05-08T20:54:21.824960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:25.807713+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:52:25.807713+0000","last_peered":"2024-05-08T20:52:25.807713+0000","last_clean":"2024-05-08T20:52:25.807713+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:52:25.807713+0000","last_undegraded":"2024-05-08T20:52:25.807713+0000","last_fullsized":"2024-05-08T20:52:25.807713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:51:19.878927+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:51:19.878927+0000","last_peered":"2024-05-08T20:51:19.878927+0000","last_clean":"2024-05-08T20:51:19.878927+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:51:19.878927+0000","last_undegraded":"2024-05-08T20:51:19.878927+0000","last_fullsized":"2024-05-08T20:51:19.878927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:32.834790+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:52:32.834790+0000","last_peered":"2024-05-08T20:52:32.834790+0000","last_clean":"2024-05-08T20:52:32.834790+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:52:32.834790+0000","last_undegraded":"2024-05-08T20:52:32.834790+0000","last_fullsized":"2024-05-08T20:52:32.834790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.539784+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:54:32.539784+0000","last_peered":"2024-05-08T20:54:32.539784+0000","last_clean":"2024-05-08T20:54:32.539784+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:54:32.539784+0000","last_undegraded":"2024-05-08T20:54:32.539784+0000","last_fullsized":"2024-05-08T20:54:32.539784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5582,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.883282+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:54:21.883282+0000","last_peered":"2024-05-08T20:54:21.883282+0000","last_clean":"2024-05-08T20:54:21.883282+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:21.883282+0000","last_undegraded":"2024-05-08T20:54:21.883282+0000","last_fullsized":"2024-05-08T20:54:21.883282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.088321+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:52:15.088321+0000","last_peered":"2024-05-08T20:52:15.088321+0000","last_clean":"2024-05-08T20:52:15.088321+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:52:15.088321+0000","last_undegraded":"2024-05-08T20:52:15.088321+0000","last_fullsized":"2024-05-08T20:52:15.088321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.966573+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:54:12.966573+0000","last_peered":"2024-05-08T20:54:12.966573+0000","last_clean":"2024-05-08T20:54:12.966573+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:54:12.966573+0000","last_undegraded":"2024-05-08T20:54:12.966573+0000","last_fullsized":"2024-05-08T20:54:12.966573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.397458+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:54:32.397458+0000","last_peered":"2024-05-08T20:54:32.397458+0000","last_clean":"2024-05-08T20:54:32.397458+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:54:32.397458+0000","last_undegraded":"2024-05-08T20:54:32.397458+0000","last_fullsized":"2024-05-08T20:54:32.397458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5622,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793078+0000","last_change":"2024-05-08T20:28:00.414547+0000","last_active":"2024-05-08T20:54:21.793078+0000","last_peered":"2024-05-08T20:54:21.793078+0000","last_clean":"2024-05-08T20:54:21.793078+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:54:21.793078+0000","last_undegraded":"2024-05-08T20:54:21.793078+0000","last_fullsized":"2024-05-08T20:54:21.793078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:58.107901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.601869+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:52:17.601869+0000","last_peered":"2024-05-08T20:52:17.601869+0000","last_clean":"2024-05-08T20:52:17.601869+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:52:17.601869+0000","last_undegraded":"2024-05-08T20:52:17.601869+0000","last_fullsized":"2024-05-08T20:52:17.601869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1136","reported_seq":1161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.000077+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:54:13.000077+0000","last_peered":"2024-05-08T20:54:13.000077+0000","last_clean":"2024-05-08T20:54:13.000077+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:54:13.000077+0000","last_undegraded":"2024-05-08T20:54:13.000077+0000","last_fullsized":"2024-05-08T20:54:13.000077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.298191+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.298191+0000","last_peered":"2024-05-08T20:54:32.298191+0000","last_clean":"2024-05-08T20:54:32.298191+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.298191+0000","last_undegraded":"2024-05-08T20:54:32.298191+0000","last_fullsized":"2024-05-08T20:54:32.298191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.910601+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:54:21.910601+0000","last_peered":"2024-05-08T20:54:21.910601+0000","last_clean":"2024-05-08T20:54:21.910601+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:54:21.910601+0000","last_undegraded":"2024-05-08T20:54:21.910601+0000","last_fullsized":"2024-05-08T20:54:21.910601+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.071772+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:52:15.071772+0000","last_peered":"2024-05-08T20:52:15.071772+0000","last_clean":"2024-05-08T20:52:15.071772+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:52:15.071772+0000","last_undegraded":"2024-05-08T20:52:15.071772+0000","last_fullsized":"2024-05-08T20:52:15.071772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.635968+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:54:07.635968+0000","last_peered":"2024-05-08T20:54:07.635968+0000","last_clean":"2024-05-08T20:54:07.635968+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:07.635968+0000","last_undegraded":"2024-05-08T20:54:07.635968+0000","last_fullsized":"2024-05-08T20:54:07.635968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3750,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368145+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:54:32.368145+0000","last_peered":"2024-05-08T20:54:32.368145+0000","last_clean":"2024-05-08T20:54:32.368145+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:32.368145+0000","last_undegraded":"2024-05-08T20:54:32.368145+0000","last_fullsized":"2024-05-08T20:54:32.368145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867267+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:54:21.867267+0000","last_peered":"2024-05-08T20:54:21.867267+0000","last_clean":"2024-05-08T20:54:21.867267+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:54:21.867267+0000","last_undegraded":"2024-05-08T20:54:21.867267+0000","last_fullsized":"2024-05-08T20:54:21.867267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.836779+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:52:15.836779+0000","last_peered":"2024-05-08T20:52:15.836779+0000","last_clean":"2024-05-08T20:52:15.836779+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:52:15.836779+0000","last_undegraded":"2024-05-08T20:52:15.836779+0000","last_fullsized":"2024-05-08T20:52:15.836779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960698+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:54:12.960698+0000","last_peered":"2024-05-08T20:54:12.960698+0000","last_clean":"2024-05-08T20:54:12.960698+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:12.960698+0000","last_undegraded":"2024-05-08T20:54:12.960698+0000","last_fullsized":"2024-05-08T20:54:12.960698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367255+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367255+0000","last_peered":"2024-05-08T20:54:32.367255+0000","last_clean":"2024-05-08T20:54:32.367255+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367255+0000","last_undegraded":"2024-05-08T20:54:32.367255+0000","last_fullsized":"2024-05-08T20:54:32.367255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4904,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863399+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:54:21.863399+0000","last_peered":"2024-05-08T20:54:21.863399+0000","last_clean":"2024-05-08T20:54:21.863399+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:54:21.863399+0000","last_undegraded":"2024-05-08T20:54:21.863399+0000","last_fullsized":"2024-05-08T20:54:21.863399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:02.925048+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:53:02.925048+0000","last_peered":"2024-05-08T20:53:02.925048+0000","last_clean":"2024-05-08T20:53:02.925048+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:53:02.925048+0000","last_undegraded":"2024-05-08T20:53:02.925048+0000","last_fullsized":"2024-05-08T20:53:02.925048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.974440+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:54:12.974440+0000","last_peered":"2024-05-08T20:54:12.974440+0000","last_clean":"2024-05-08T20:54:12.974440+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:12.974440+0000","last_undegraded":"2024-05-08T20:54:12.974440+0000","last_fullsized":"2024-05-08T20:54:12.974440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382036+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382036+0000","last_peered":"2024-05-08T20:54:32.382036+0000","last_clean":"2024-05-08T20:54:32.382036+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382036+0000","last_undegraded":"2024-05-08T20:54:32.382036+0000","last_fullsized":"2024-05-08T20:54:32.382036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.789086+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:54:21.789086+0000","last_peered":"2024-05-08T20:54:21.789086+0000","last_clean":"2024-05-08T20:54:21.789086+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:54:21.789086+0000","last_undegraded":"2024-05-08T20:54:21.789086+0000","last_fullsized":"2024-05-08T20:54:21.789086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.946926+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:52:15.946926+0000","last_peered":"2024-05-08T20:52:15.946926+0000","last_clean":"2024-05-08T20:52:15.946926+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:52:15.946926+0000","last_undegraded":"2024-05-08T20:52:15.946926+0000","last_fullsized":"2024-05-08T20:52:15.946926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.923631+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:54:12.923631+0000","last_peered":"2024-05-08T20:54:12.923631+0000","last_clean":"2024-05-08T20:54:12.923631+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:54:12.923631+0000","last_undegraded":"2024-05-08T20:54:12.923631+0000","last_fullsized":"2024-05-08T20:54:12.923631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368762+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368762+0000","last_peered":"2024-05-08T20:54:32.368762+0000","last_clean":"2024-05-08T20:54:32.368762+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368762+0000","last_undegraded":"2024-05-08T20:54:32.368762+0000","last_fullsized":"2024-05-08T20:54:32.368762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6080,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.886261+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:21.886261+0000","last_peered":"2024-05-08T20:54:21.886261+0000","last_clean":"2024-05-08T20:54:21.886261+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:21.886261+0000","last_undegraded":"2024-05-08T20:54:21.886261+0000","last_fullsized":"2024-05-08T20:54:21.886261+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489130+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:52:16.489130+0000","last_peered":"2024-05-08T20:52:16.489130+0000","last_clean":"2024-05-08T20:52:16.489130+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:52:16.489130+0000","last_undegraded":"2024-05-08T20:52:16.489130+0000","last_fullsized":"2024-05-08T20:52:16.489130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'389","reported_seq":413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.272721+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:54:07.272721+0000","last_peered":"2024-05-08T20:54:07.272721+0000","last_clean":"2024-05-08T20:54:07.272721+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:07.272721+0000","last_undegraded":"2024-05-08T20:54:07.272721+0000","last_fullsized":"2024-05-08T20:54:07.272721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398306+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398306+0000","last_peered":"2024-05-08T20:54:32.398306+0000","last_clean":"2024-05-08T20:54:32.398306+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398306+0000","last_undegraded":"2024-05-08T20:54:32.398306+0000","last_fullsized":"2024-05-08T20:54:32.398306+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.749989+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:54:21.749989+0000","last_peered":"2024-05-08T20:54:21.749989+0000","last_clean":"2024-05-08T20:54:21.749989+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:21.749989+0000","last_undegraded":"2024-05-08T20:54:21.749989+0000","last_fullsized":"2024-05-08T20:54:21.749989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.551192+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:52:17.551192+0000","last_peered":"2024-05-08T20:52:17.551192+0000","last_clean":"2024-05-08T20:52:17.551192+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:52:17.551192+0000","last_undegraded":"2024-05-08T20:52:17.551192+0000","last_fullsized":"2024-05-08T20:52:17.551192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'38","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.880156+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:54:13.880156+0000","last_peered":"2024-05-08T20:54:13.880156+0000","last_clean":"2024-05-08T20:54:13.880156+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:54:13.880156+0000","last_undegraded":"2024-05-08T20:54:13.880156+0000","last_fullsized":"2024-05-08T20:54:13.880156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.426159+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:54:32.426159+0000","last_peered":"2024-05-08T20:54:32.426159+0000","last_clean":"2024-05-08T20:54:32.426159+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:54:32.426159+0000","last_undegraded":"2024-05-08T20:54:32.426159+0000","last_fullsized":"2024-05-08T20:54:32.426159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.799792+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:54:21.799792+0000","last_peered":"2024-05-08T20:54:21.799792+0000","last_clean":"2024-05-08T20:54:21.799792+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:54:21.799792+0000","last_undegraded":"2024-05-08T20:54:21.799792+0000","last_fullsized":"2024-05-08T20:54:21.799792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'372","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:07.848241+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:53:07.848241+0000","last_peered":"2024-05-08T20:53:07.848241+0000","last_clean":"2024-05-08T20:53:07.848241+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:53:07.848241+0000","last_undegraded":"2024-05-08T20:53:07.848241+0000","last_fullsized":"2024-05-08T20:53:07.848241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.973682+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:54:12.973682+0000","last_peered":"2024-05-08T20:54:12.973682+0000","last_clean":"2024-05-08T20:54:12.973682+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:12.973682+0000","last_undegraded":"2024-05-08T20:54:12.973682+0000","last_fullsized":"2024-05-08T20:54:12.973682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3965,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325893+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325893+0000","last_peered":"2024-05-08T20:54:32.325893+0000","last_clean":"2024-05-08T20:54:32.325893+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325893+0000","last_undegraded":"2024-05-08T20:54:32.325893+0000","last_fullsized":"2024-05-08T20:54:32.325893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.876604+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:54:21.876604+0000","last_peered":"2024-05-08T20:54:21.876604+0000","last_clean":"2024-05-08T20:54:21.876604+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:54:21.876604+0000","last_undegraded":"2024-05-08T20:54:21.876604+0000","last_fullsized":"2024-05-08T20:54:21.876604+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'40","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:58.250615+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:53:58.250615+0000","last_peered":"2024-05-08T20:53:58.250615+0000","last_clean":"2024-05-08T20:53:58.250615+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:53:58.250615+0000","last_undegraded":"2024-05-08T20:53:58.250615+0000","last_fullsized":"2024-05-08T20:53:58.250615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'7","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.991280+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:54:12.991280+0000","last_peered":"2024-05-08T20:54:12.991280+0000","last_clean":"2024-05-08T20:54:12.991280+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:12.991280+0000","last_undegraded":"2024-05-08T20:54:12.991280+0000","last_fullsized":"2024-05-08T20:54:12.991280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.363218+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.363218+0000","last_peered":"2024-05-08T20:54:32.363218+0000","last_clean":"2024-05-08T20:54:32.363218+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.363218+0000","last_undegraded":"2024-05-08T20:54:32.363218+0000","last_fullsized":"2024-05-08T20:54:32.363218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.812600+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:54:21.812600+0000","last_peered":"2024-05-08T20:54:21.812600+0000","last_clean":"2024-05-08T20:54:21.812600+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:54:21.812600+0000","last_undegraded":"2024-05-08T20:54:21.812600+0000","last_fullsized":"2024-05-08T20:54:21.812600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.483086+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:52:16.483086+0000","last_peered":"2024-05-08T20:52:16.483086+0000","last_clean":"2024-05-08T20:52:16.483086+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:52:16.483086+0000","last_undegraded":"2024-05-08T20:52:16.483086+0000","last_fullsized":"2024-05-08T20:52:16.483086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972676+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:54:12.972676+0000","last_peered":"2024-05-08T20:54:12.972676+0000","last_clean":"2024-05-08T20:54:12.972676+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:12.972676+0000","last_undegraded":"2024-05-08T20:54:12.972676+0000","last_fullsized":"2024-05-08T20:54:12.972676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406456+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:32.406456+0000","last_peered":"2024-05-08T20:54:32.406456+0000","last_clean":"2024-05-08T20:54:32.406456+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:32.406456+0000","last_undegraded":"2024-05-08T20:54:32.406456+0000","last_fullsized":"2024-05-08T20:54:32.406456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.800922+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.800922+0000","last_peered":"2024-05-08T20:54:21.800922+0000","last_clean":"2024-05-08T20:54:21.800922+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.800922+0000","last_undegraded":"2024-05-08T20:54:21.800922+0000","last_fullsized":"2024-05-08T20:54:21.800922+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.981217+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:52:15.981217+0000","last_peered":"2024-05-08T20:52:15.981217+0000","last_clean":"2024-05-08T20:52:15.981217+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:52:15.981217+0000","last_undegraded":"2024-05-08T20:52:15.981217+0000","last_fullsized":"2024-05-08T20:52:15.981217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972569+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:54:12.972569+0000","last_peered":"2024-05-08T20:54:12.972569+0000","last_clean":"2024-05-08T20:54:12.972569+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:54:12.972569+0000","last_undegraded":"2024-05-08T20:54:12.972569+0000","last_fullsized":"2024-05-08T20:54:12.972569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6612,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.392792+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:32.392792+0000","last_peered":"2024-05-08T20:54:32.392792+0000","last_clean":"2024-05-08T20:54:32.392792+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:32.392792+0000","last_undegraded":"2024-05-08T20:54:32.392792+0000","last_fullsized":"2024-05-08T20:54:32.392792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.963381+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:54:12.963381+0000","last_peered":"2024-05-08T20:54:12.963381+0000","last_clean":"2024-05-08T20:54:12.963381+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:54:12.963381+0000","last_undegraded":"2024-05-08T20:54:12.963381+0000","last_fullsized":"2024-05-08T20:54:12.963381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6026,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793198+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:54:21.793198+0000","last_peered":"2024-05-08T20:54:21.793198+0000","last_clean":"2024-05-08T20:54:21.793198+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:21.793198+0000","last_undegraded":"2024-05-08T20:54:21.793198+0000","last_fullsized":"2024-05-08T20:54:21.793198+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:03.788193+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:52:03.788193+0000","last_peered":"2024-05-08T20:52:03.788193+0000","last_clean":"2024-05-08T20:52:03.788193+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:52:03.788193+0000","last_undegraded":"2024-05-08T20:52:03.788193+0000","last_fullsized":"2024-05-08T20:52:03.788193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.301812+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:54:32.301812+0000","last_peered":"2024-05-08T20:54:32.301812+0000","last_clean":"2024-05-08T20:54:32.301812+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:54:32.301812+0000","last_undegraded":"2024-05-08T20:54:32.301812+0000","last_fullsized":"2024-05-08T20:54:32.301812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984777+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:54:12.984777+0000","last_peered":"2024-05-08T20:54:12.984777+0000","last_clean":"2024-05-08T20:54:12.984777+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:54:12.984777+0000","last_undegraded":"2024-05-08T20:54:12.984777+0000","last_fullsized":"2024-05-08T20:54:12.984777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.798553+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:54:21.798553+0000","last_peered":"2024-05-08T20:54:21.798553+0000","last_clean":"2024-05-08T20:54:21.798553+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:54:21.798553+0000","last_undegraded":"2024-05-08T20:54:21.798553+0000","last_fullsized":"2024-05-08T20:54:21.798553+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.879936+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:52:15.879936+0000","last_peered":"2024-05-08T20:52:15.879936+0000","last_clean":"2024-05-08T20:52:15.879936+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:52:15.879936+0000","last_undegraded":"2024-05-08T20:52:15.879936+0000","last_fullsized":"2024-05-08T20:52:15.879936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4948,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.442604+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:54:32.442604+0000","last_peered":"2024-05-08T20:54:32.442604+0000","last_clean":"2024-05-08T20:54:32.442604+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:54:32.442604+0000","last_undegraded":"2024-05-08T20:54:32.442604+0000","last_fullsized":"2024-05-08T20:54:32.442604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'162","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.590870+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:54:21.590870+0000","last_peered":"2024-05-08T20:54:21.590870+0000","last_clean":"2024-05-08T20:54:21.590870+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:21.590870+0000","last_undegraded":"2024-05-08T20:54:21.590870+0000","last_fullsized":"2024-05-08T20:54:21.590870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.851678+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:54:21.851678+0000","last_peered":"2024-05-08T20:54:21.851678+0000","last_clean":"2024-05-08T20:54:21.851678+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:54:21.851678+0000","last_undegraded":"2024-05-08T20:54:21.851678+0000","last_fullsized":"2024-05-08T20:54:21.851678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:27.909301+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:52:27.909301+0000","last_peered":"2024-05-08T20:52:27.909301+0000","last_clean":"2024-05-08T20:52:27.909301+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:52:27.909301+0000","last_undegraded":"2024-05-08T20:52:27.909301+0000","last_fullsized":"2024-05-08T20:52:27.909301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.400488+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:32.400488+0000","last_peered":"2024-05-08T20:54:32.400488+0000","last_clean":"2024-05-08T20:54:32.400488+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:32.400488+0000","last_undegraded":"2024-05-08T20:54:32.400488+0000","last_fullsized":"2024-05-08T20:54:32.400488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'654","reported_seq":681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.109585+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:52:15.109585+0000","last_peered":"2024-05-08T20:52:15.109585+0000","last_clean":"2024-05-08T20:52:15.109585+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:52:15.109585+0000","last_undegraded":"2024-05-08T20:52:15.109585+0000","last_fullsized":"2024-05-08T20:52:15.109585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.786384+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:54:21.786384+0000","last_peered":"2024-05-08T20:54:21.786384+0000","last_clean":"2024-05-08T20:54:21.786384+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:54:21.786384+0000","last_undegraded":"2024-05-08T20:54:21.786384+0000","last_fullsized":"2024-05-08T20:54:21.786384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'7","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.965965+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:54:12.965965+0000","last_peered":"2024-05-08T20:54:12.965965+0000","last_clean":"2024-05-08T20:54:12.965965+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:12.965965+0000","last_undegraded":"2024-05-08T20:54:12.965965+0000","last_fullsized":"2024-05-08T20:54:12.965965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.441006+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.441006+0000","last_peered":"2024-05-08T20:54:32.441006+0000","last_clean":"2024-05-08T20:54:32.441006+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.441006+0000","last_undegraded":"2024-05-08T20:54:32.441006+0000","last_fullsized":"2024-05-08T20:54:32.441006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.809888+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:54:21.809888+0000","last_peered":"2024-05-08T20:54:21.809888+0000","last_clean":"2024-05-08T20:54:21.809888+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:21.809888+0000","last_undegraded":"2024-05-08T20:54:21.809888+0000","last_fullsized":"2024-05-08T20:54:21.809888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.413717+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.413717+0000","last_peered":"2024-05-08T20:54:32.413717+0000","last_clean":"2024-05-08T20:54:32.413717+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.413717+0000","last_undegraded":"2024-05-08T20:54:32.413717+0000","last_fullsized":"2024-05-08T20:54:32.413717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5624,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.762734+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:54:21.762734+0000","last_peered":"2024-05-08T20:54:21.762734+0000","last_clean":"2024-05-08T20:54:21.762734+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:21.762734+0000","last_undegraded":"2024-05-08T20:54:21.762734+0000","last_fullsized":"2024-05-08T20:54:21.762734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.290807+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.290807+0000","last_peered":"2024-05-08T20:54:32.290807+0000","last_clean":"2024-05-08T20:54:32.290807+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.290807+0000","last_undegraded":"2024-05-08T20:54:32.290807+0000","last_fullsized":"2024-05-08T20:54:32.290807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873705+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:21.873705+0000","last_peered":"2024-05-08T20:54:21.873705+0000","last_clean":"2024-05-08T20:54:21.873705+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:21.873705+0000","last_undegraded":"2024-05-08T20:54:21.873705+0000","last_fullsized":"2024-05-08T20:54:21.873705+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4812,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.433420+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.433420+0000","last_peered":"2024-05-08T20:54:32.433420+0000","last_clean":"2024-05-08T20:54:32.433420+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.433420+0000","last_undegraded":"2024-05-08T20:54:32.433420+0000","last_fullsized":"2024-05-08T20:54:32.433420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5722,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804450+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:54:21.804450+0000","last_peered":"2024-05-08T20:54:21.804450+0000","last_clean":"2024-05-08T20:54:21.804450+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:21.804450+0000","last_undegraded":"2024-05-08T20:54:21.804450+0000","last_fullsized":"2024-05-08T20:54:21.804450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339531+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:32.339531+0000","last_peered":"2024-05-08T20:54:32.339531+0000","last_clean":"2024-05-08T20:54:32.339531+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:32.339531+0000","last_undegraded":"2024-05-08T20:54:32.339531+0000","last_fullsized":"2024-05-08T20:54:32.339531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5427,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862537+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862537+0000","last_peered":"2024-05-08T20:54:21.862537+0000","last_clean":"2024-05-08T20:54:21.862537+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862537+0000","last_undegraded":"2024-05-08T20:54:21.862537+0000","last_fullsized":"2024-05-08T20:54:21.862537+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4139,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.403208+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:32.403208+0000","last_peered":"2024-05-08T20:54:32.403208+0000","last_clean":"2024-05-08T20:54:32.403208+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:32.403208+0000","last_undegraded":"2024-05-08T20:54:32.403208+0000","last_fullsized":"2024-05-08T20:54:32.403208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.741430+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:54:21.741430+0000","last_peered":"2024-05-08T20:54:21.741430+0000","last_clean":"2024-05-08T20:54:21.741430+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:54:21.741430+0000","last_undegraded":"2024-05-08T20:54:21.741430+0000","last_fullsized":"2024-05-08T20:54:21.741430+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406976+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:32.406976+0000","last_peered":"2024-05-08T20:54:32.406976+0000","last_clean":"2024-05-08T20:54:32.406976+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:32.406976+0000","last_undegraded":"2024-05-08T20:54:32.406976+0000","last_fullsized":"2024-05-08T20:54:32.406976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907633+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:54:21.907633+0000","last_peered":"2024-05-08T20:54:21.907633+0000","last_clean":"2024-05-08T20:54:21.907633+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:21.907633+0000","last_undegraded":"2024-05-08T20:54:21.907633+0000","last_fullsized":"2024-05-08T20:54:21.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370459+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:32.370459+0000","last_peered":"2024-05-08T20:54:32.370459+0000","last_clean":"2024-05-08T20:54:32.370459+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:32.370459+0000","last_undegraded":"2024-05-08T20:54:32.370459+0000","last_fullsized":"2024-05-08T20:54:32.370459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750487+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:54:21.750487+0000","last_peered":"2024-05-08T20:54:21.750487+0000","last_clean":"2024-05-08T20:54:21.750487+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:54:21.750487+0000","last_undegraded":"2024-05-08T20:54:21.750487+0000","last_fullsized":"2024-05-08T20:54:21.750487+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447520+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.447520+0000","last_peered":"2024-05-08T20:54:32.447520+0000","last_clean":"2024-05-08T20:54:32.447520+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.447520+0000","last_undegraded":"2024-05-08T20:54:32.447520+0000","last_fullsized":"2024-05-08T20:54:32.447520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824316+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824316+0000","last_peered":"2024-05-08T20:54:21.824316+0000","last_clean":"2024-05-08T20:54:21.824316+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824316+0000","last_undegraded":"2024-05-08T20:54:21.824316+0000","last_fullsized":"2024-05-08T20:54:21.824316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6030,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339757+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:54:32.339757+0000","last_peered":"2024-05-08T20:54:32.339757+0000","last_clean":"2024-05-08T20:54:32.339757+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:54:32.339757+0000","last_undegraded":"2024-05-08T20:54:32.339757+0000","last_fullsized":"2024-05-08T20:54:32.339757+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862354+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:54:21.862354+0000","last_peered":"2024-05-08T20:54:21.862354+0000","last_clean":"2024-05-08T20:54:21.862354+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:54:21.862354+0000","last_undegraded":"2024-05-08T20:54:21.862354+0000","last_fullsized":"2024-05-08T20:54:21.862354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345142+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:54:32.345142+0000","last_peered":"2024-05-08T20:54:32.345142+0000","last_clean":"2024-05-08T20:54:32.345142+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:54:32.345142+0000","last_undegraded":"2024-05-08T20:54:32.345142+0000","last_fullsized":"2024-05-08T20:54:32.345142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873770+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.873770+0000","last_peered":"2024-05-08T20:54:21.873770+0000","last_clean":"2024-05-08T20:54:21.873770+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.873770+0000","last_undegraded":"2024-05-08T20:54:21.873770+0000","last_fullsized":"2024-05-08T20:54:21.873770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404985+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:32.404985+0000","last_peered":"2024-05-08T20:54:32.404985+0000","last_clean":"2024-05-08T20:54:32.404985+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:32.404985+0000","last_undegraded":"2024-05-08T20:54:32.404985+0000","last_fullsized":"2024-05-08T20:54:32.404985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.794395+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:21.794395+0000","last_peered":"2024-05-08T20:54:21.794395+0000","last_clean":"2024-05-08T20:54:21.794395+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:21.794395+0000","last_undegraded":"2024-05-08T20:54:21.794395+0000","last_fullsized":"2024-05-08T20:54:21.794395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:31.832985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406667+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:32.406667+0000","last_peered":"2024-05-08T20:54:32.406667+0000","last_clean":"2024-05-08T20:54:32.406667+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:32.406667+0000","last_undegraded":"2024-05-08T20:54:32.406667+0000","last_fullsized":"2024-05-08T20:54:32.406667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842224+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:54:21.842224+0000","last_peered":"2024-05-08T20:54:21.842224+0000","last_clean":"2024-05-08T20:54:21.842224+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:54:21.842224+0000","last_undegraded":"2024-05-08T20:54:21.842224+0000","last_fullsized":"2024-05-08T20:54:21.842224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.427047+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:32.427047+0000","last_peered":"2024-05-08T20:54:32.427047+0000","last_clean":"2024-05-08T20:54:32.427047+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:32.427047+0000","last_undegraded":"2024-05-08T20:54:32.427047+0000","last_fullsized":"2024-05-08T20:54:32.427047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6035,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.839762+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:54:21.839762+0000","last_peered":"2024-05-08T20:54:21.839762+0000","last_clean":"2024-05-08T20:54:21.839762+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:54:21.839762+0000","last_undegraded":"2024-05-08T20:54:21.839762+0000","last_fullsized":"2024-05-08T20:54:21.839762+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.320278+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.320278+0000","last_peered":"2024-05-08T20:54:32.320278+0000","last_clean":"2024-05-08T20:54:32.320278+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.320278+0000","last_undegraded":"2024-05-08T20:54:32.320278+0000","last_fullsized":"2024-05-08T20:54:32.320278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.796071+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:54:21.796071+0000","last_peered":"2024-05-08T20:54:21.796071+0000","last_clean":"2024-05-08T20:54:21.796071+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:21.796071+0000","last_undegraded":"2024-05-08T20:54:21.796071+0000","last_fullsized":"2024-05-08T20:54:21.796071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.315251+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:54:32.315251+0000","last_peered":"2024-05-08T20:54:32.315251+0000","last_clean":"2024-05-08T20:54:32.315251+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:54:32.315251+0000","last_undegraded":"2024-05-08T20:54:32.315251+0000","last_fullsized":"2024-05-08T20:54:32.315251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873440+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:54:21.873440+0000","last_peered":"2024-05-08T20:54:21.873440+0000","last_clean":"2024-05-08T20:54:21.873440+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:54:21.873440+0000","last_undegraded":"2024-05-08T20:54:21.873440+0000","last_fullsized":"2024-05-08T20:54:21.873440+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4672,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.419364+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.419364+0000","last_peered":"2024-05-08T20:54:32.419364+0000","last_clean":"2024-05-08T20:54:32.419364+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.419364+0000","last_undegraded":"2024-05-08T20:54:32.419364+0000","last_fullsized":"2024-05-08T20:54:32.419364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.827140+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:54:21.827140+0000","last_peered":"2024-05-08T20:54:21.827140+0000","last_clean":"2024-05-08T20:54:21.827140+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:21.827140+0000","last_undegraded":"2024-05-08T20:54:21.827140+0000","last_fullsized":"2024-05-08T20:54:21.827140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415141+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415141+0000","last_peered":"2024-05-08T20:54:32.415141+0000","last_clean":"2024-05-08T20:54:32.415141+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415141+0000","last_undegraded":"2024-05-08T20:54:32.415141+0000","last_fullsized":"2024-05-08T20:54:32.415141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4629,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862710+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:54:21.862710+0000","last_peered":"2024-05-08T20:54:21.862710+0000","last_clean":"2024-05-08T20:54:21.862710+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:21.862710+0000","last_undegraded":"2024-05-08T20:54:21.862710+0000","last_fullsized":"2024-05-08T20:54:21.862710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.342985+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.342985+0000","last_peered":"2024-05-08T20:54:32.342985+0000","last_clean":"2024-05-08T20:54:32.342985+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.342985+0000","last_undegraded":"2024-05-08T20:54:32.342985+0000","last_fullsized":"2024-05-08T20:54:32.342985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.745730+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:54:21.745730+0000","last_peered":"2024-05-08T20:54:21.745730+0000","last_clean":"2024-05-08T20:54:21.745730+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:21.745730+0000","last_undegraded":"2024-05-08T20:54:21.745730+0000","last_fullsized":"2024-05-08T20:54:21.745730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382399+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.382399+0000","last_peered":"2024-05-08T20:54:32.382399+0000","last_clean":"2024-05-08T20:54:32.382399+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.382399+0000","last_undegraded":"2024-05-08T20:54:32.382399+0000","last_fullsized":"2024-05-08T20:54:32.382399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.772331+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:54:21.772331+0000","last_peered":"2024-05-08T20:54:21.772331+0000","last_clean":"2024-05-08T20:54:21.772331+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:54:21.772331+0000","last_undegraded":"2024-05-08T20:54:21.772331+0000","last_fullsized":"2024-05-08T20:54:21.772331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.354339+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.354339+0000","last_peered":"2024-05-08T20:54:32.354339+0000","last_clean":"2024-05-08T20:54:32.354339+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.354339+0000","last_undegraded":"2024-05-08T20:54:32.354339+0000","last_fullsized":"2024-05-08T20:54:32.354339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863383+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:54:21.863383+0000","last_peered":"2024-05-08T20:54:21.863383+0000","last_clean":"2024-05-08T20:54:21.863383+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:54:21.863383+0000","last_undegraded":"2024-05-08T20:54:21.863383+0000","last_fullsized":"2024-05-08T20:54:21.863383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340542+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:54:32.340542+0000","last_peered":"2024-05-08T20:54:32.340542+0000","last_clean":"2024-05-08T20:54:32.340542+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:54:32.340542+0000","last_undegraded":"2024-05-08T20:54:32.340542+0000","last_fullsized":"2024-05-08T20:54:32.340542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.808590+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:54:21.808590+0000","last_peered":"2024-05-08T20:54:21.808590+0000","last_clean":"2024-05-08T20:54:21.808590+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:21.808590+0000","last_undegraded":"2024-05-08T20:54:21.808590+0000","last_fullsized":"2024-05-08T20:54:21.808590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.391513+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:54:32.391513+0000","last_peered":"2024-05-08T20:54:32.391513+0000","last_clean":"2024-05-08T20:54:32.391513+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:54:32.391513+0000","last_undegraded":"2024-05-08T20:54:32.391513+0000","last_fullsized":"2024-05-08T20:54:32.391513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.904783+0000","last_change":"2024-05-08T20:28:00.413131+0000","last_active":"2024-05-08T20:54:21.904783+0000","last_peered":"2024-05-08T20:54:21.904783+0000","last_clean":"2024-05-08T20:54:21.904783+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:21.904783+0000","last_undegraded":"2024-05-08T20:54:21.904783+0000","last_fullsized":"2024-05-08T20:54:21.904783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:24.920403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.295323+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:54:32.295323+0000","last_peered":"2024-05-08T20:54:32.295323+0000","last_clean":"2024-05-08T20:54:32.295323+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:54:32.295323+0000","last_undegraded":"2024-05-08T20:54:32.295323+0000","last_fullsized":"2024-05-08T20:54:32.295323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6669,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907477+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:54:21.907477+0000","last_peered":"2024-05-08T20:54:21.907477+0000","last_clean":"2024-05-08T20:54:21.907477+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:54:21.907477+0000","last_undegraded":"2024-05-08T20:54:21.907477+0000","last_fullsized":"2024-05-08T20:54:21.907477+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.435277+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:32.435277+0000","last_peered":"2024-05-08T20:54:32.435277+0000","last_clean":"2024-05-08T20:54:32.435277+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:32.435277+0000","last_undegraded":"2024-05-08T20:54:32.435277+0000","last_fullsized":"2024-05-08T20:54:32.435277+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.826447+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.826447+0000","last_peered":"2024-05-08T20:54:21.826447+0000","last_clean":"2024-05-08T20:54:21.826447+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.826447+0000","last_undegraded":"2024-05-08T20:54:21.826447+0000","last_fullsized":"2024-05-08T20:54:21.826447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:22.668993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.374228+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:32.374228+0000","last_peered":"2024-05-08T20:54:32.374228+0000","last_clean":"2024-05-08T20:54:32.374228+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:32.374228+0000","last_undegraded":"2024-05-08T20:54:32.374228+0000","last_fullsized":"2024-05-08T20:54:32.374228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.742400+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:54:21.742400+0000","last_peered":"2024-05-08T20:54:21.742400+0000","last_clean":"2024-05-08T20:54:21.742400+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:54:21.742400+0000","last_undegraded":"2024-05-08T20:54:21.742400+0000","last_fullsized":"2024-05-08T20:54:21.742400+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3818,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385550+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385550+0000","last_peered":"2024-05-08T20:54:32.385550+0000","last_clean":"2024-05-08T20:54:32.385550+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385550+0000","last_undegraded":"2024-05-08T20:54:32.385550+0000","last_fullsized":"2024-05-08T20:54:32.385550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4562,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873313+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:54:21.873313+0000","last_peered":"2024-05-08T20:54:21.873313+0000","last_clean":"2024-05-08T20:54:21.873313+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:54:21.873313+0000","last_undegraded":"2024-05-08T20:54:21.873313+0000","last_fullsized":"2024-05-08T20:54:21.873313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.381776+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.381776+0000","last_peered":"2024-05-08T20:54:32.381776+0000","last_clean":"2024-05-08T20:54:32.381776+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.381776+0000","last_undegraded":"2024-05-08T20:54:32.381776+0000","last_fullsized":"2024-05-08T20:54:32.381776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867693+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:54:21.867693+0000","last_peered":"2024-05-08T20:54:21.867693+0000","last_clean":"2024-05-08T20:54:21.867693+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:54:21.867693+0000","last_undegraded":"2024-05-08T20:54:21.867693+0000","last_fullsized":"2024-05-08T20:54:21.867693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3762,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.353091+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:32.353091+0000","last_peered":"2024-05-08T20:54:32.353091+0000","last_clean":"2024-05-08T20:54:32.353091+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:32.353091+0000","last_undegraded":"2024-05-08T20:54:32.353091+0000","last_fullsized":"2024-05-08T20:54:32.353091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.774789+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:54:21.774789+0000","last_peered":"2024-05-08T20:54:21.774789+0000","last_clean":"2024-05-08T20:54:21.774789+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:21.774789+0000","last_undegraded":"2024-05-08T20:54:21.774789+0000","last_fullsized":"2024-05-08T20:54:21.774789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.350259+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:54:32.350259+0000","last_peered":"2024-05-08T20:54:32.350259+0000","last_clean":"2024-05-08T20:54:32.350259+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:54:32.350259+0000","last_undegraded":"2024-05-08T20:54:32.350259+0000","last_fullsized":"2024-05-08T20:54:32.350259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5667,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.765347+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:54:21.765347+0000","last_peered":"2024-05-08T20:54:21.765347+0000","last_clean":"2024-05-08T20:54:21.765347+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:54:21.765347+0000","last_undegraded":"2024-05-08T20:54:21.765347+0000","last_fullsized":"2024-05-08T20:54:21.765347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.380157+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:32.380157+0000","last_peered":"2024-05-08T20:54:32.380157+0000","last_clean":"2024-05-08T20:54:32.380157+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:32.380157+0000","last_undegraded":"2024-05-08T20:54:32.380157+0000","last_fullsized":"2024-05-08T20:54:32.380157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.754082+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:54:21.754082+0000","last_peered":"2024-05-08T20:54:21.754082+0000","last_clean":"2024-05-08T20:54:21.754082+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:21.754082+0000","last_undegraded":"2024-05-08T20:54:21.754082+0000","last_fullsized":"2024-05-08T20:54:21.754082+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.346308+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:54:32.346308+0000","last_peered":"2024-05-08T20:54:32.346308+0000","last_clean":"2024-05-08T20:54:32.346308+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:54:32.346308+0000","last_undegraded":"2024-05-08T20:54:32.346308+0000","last_fullsized":"2024-05-08T20:54:32.346308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.900494+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:54:21.900494+0000","last_peered":"2024-05-08T20:54:21.900494+0000","last_clean":"2024-05-08T20:54:21.900494+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:21.900494+0000","last_undegraded":"2024-05-08T20:54:21.900494+0000","last_fullsized":"2024-05-08T20:54:21.900494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3539,"ondisk_log_size":3539,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575183,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":3.4089999999999998,"15min":1.579},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":4.5750000000000002,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.9650000000000001,"15min":1.1859999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":3.7829999999999999,"5min":34.091000000000001,"15min":34.091000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.732,"15min":1.077},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.4249999999999998,"5min":13.579000000000001,"15min":13.579000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.736,"15min":1.153},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":7.4699999999999998,"5min":13.467000000000001,"15min":13.467000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.9199999999999999,"15min":1.147},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":4.585,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.3620000000000001,"5min":2.069,"15min":1.288},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":4.5570000000000004,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.077}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.663,"15min":1.1100000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2589999999999999,"5min":15.532,"15min":15.532},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.2879999999999998,"15min":1.397},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.5,"5min":16.584,"15min":16.584},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.4950000000000001,"15min":1.732},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.214},"max":{"1min":6.4630000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.2389999999999999,"15min":1.361},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":4.617,"5min":22.741,"15min":22.741},"last":0.996}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":4.0570000000000004,"15min":1.9810000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":5.8380000000000001,"5min":33.679000000000002,"15min":33.679000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.522,"5min":2.5019999999999998,"15min":1.506},"min":{"1min":0.41999999999999998,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":4.5700000000000003,"5min":20.869,"15min":20.869},"last":1.123}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7050000000000001,"15min":1.2669999999999999},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.157,"5min":13.714,"15min":13.714},"last":1.165},{"interface":"front","average":{"1min":1.6539999999999999,"5min":2.2090000000000001,"15min":1.3480000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":6.2519999999999998,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.97399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575181,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.5369999999999999,"15min":0.99099999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":4.657,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":1.25},{"interface":"front","average":{"1min":1.556,"5min":1.726,"15min":1.181},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.2960000000000003,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":1.073}]},{"osd":1,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.9330000000000001,"15min":1.1830000000000001},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":2.5270000000000001,"5min":14.717000000000001,"15min":14.717000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.71,"15min":1.0900000000000001},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":7.3810000000000002,"5min":14.404,"15min":14.404},"last":0.84299999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.603,"15min":1.095},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":3.5310000000000001,"5min":9.907,"15min":9.907},"last":1.036},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4530000000000001,"15min":1.093},"min":{"1min":0.41899999999999998,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":3.694,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":2.0630000000000002,"15min":1.3089999999999999},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":4.3780000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.159},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.714,"15min":1.198},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":4.6280000000000001,"5min":8.2940000000000005,"15min":8.2940000000000005},"last":1.3779999999999999}]},{"osd":4,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":2.9340000000000002,"15min":1.552},"min":{"1min":0.39100000000000001,"5min":0.28699999999999998,"15min":0.223},"max":{"1min":4.4450000000000003,"5min":30.094000000000001,"15min":30.094000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":2.4620000000000002,"15min":1.4410000000000001},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":4.415,"5min":29.538,"15min":29.538},"last":1.476}]},{"osd":5,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.98,"15min":1.206},"min":{"1min":0.47999999999999998,"5min":0.28499999999999998,"15min":0.25},"max":{"1min":3.7589999999999999,"5min":11.568,"15min":11.568},"last":1.218},{"interface":"front","average":{"1min":1.5660000000000001,"5min":2.0369999999999999,"15min":1.329},"min":{"1min":0.52500000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"max":{"1min":3.806,"5min":11.593999999999999,"15min":11.593999999999999},"last":1.411}]},{"osd":7,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":2.1600000000000001,"15min":1.2769999999999999},"min":{"1min":0.317,"5min":0.188,"15min":0.188},"max":{"1min":4.2430000000000003,"5min":12.77,"15min":12.77},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.532,"5min":2.0449999999999999,"15min":1.2909999999999999},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":6.2880000000000003,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.343}]}]},{"osd":5,"up_from":13,"seq":55834575182,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.6799999999999999,"15min":1.056},"min":{"1min":0.25600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.4550000000000001,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.357,"15min":1.0029999999999999},"min":{"1min":0.33500000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7799999999999998,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":5.3259999999999996,"15min":2.298},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.20799999999999999},"max":{"1min":5.3019999999999996,"5min":121.521,"15min":121.521},"last":1.01},{"interface":"front","average":{"1min":1.139,"5min":1.9159999999999999,"15min":1.2030000000000001},"min":{"1min":0.28399999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.9409999999999998,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.96299999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.9630000000000001,"15min":1.206},"min":{"1min":0.25,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":5.2569999999999997,"5min":16.535,"15min":16.535},"last":1.228},{"interface":"front","average":{"1min":1.028,"5min":1.7410000000000001,"15min":1.1379999999999999},"min":{"1min":0.32400000000000001,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":2.9590000000000001,"5min":15.006,"15min":15.006},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.6790000000000003,"15min":2.4950000000000001},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":5.2830000000000004,"5min":121.498,"15min":121.498},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.849,"15min":1.256},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.0549999999999997,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.1200000000000001}]},{"osd":4,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":5.202,"15min":2.3149999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.3209999999999997,"5min":121.464,"15min":121.464},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.613,"5min":1.746,"15min":1.1870000000000001},"min":{"1min":0.35999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2329999999999997,"5min":8.2710000000000008,"15min":8.2710000000000008},"last":1.1639999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.0790000000000002,"15min":1.3120000000000001},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0910000000000002,"5min":15.048,"15min":15.048},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.6970000000000001,"15min":1.212},"min":{"1min":0.38100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":5.3360000000000003,"5min":11.56,"15min":11.56},"last":1.294}]},{"osd":7,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":3.915,"15min":1.9730000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":2.8370000000000002,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.355},{"interface":"front","average":{"1min":1.216,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.436,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.1429999999999998,"5min":12.679,"15min":12.679},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575182,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":2.1960000000000002,"15min":1.252},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":10.419,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.026},{"interface":"front","average":{"1min":1.345,"5min":1.901,"15min":1.1839999999999999},"min":{"1min":0.34699999999999998,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.505000000000001,"5min":16.119,"15min":16.119},"last":1.143}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":2.6309999999999998,"15min":1.4219999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.977,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.593,"15min":1.077},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9969999999999999,"5min":16.904,"15min":16.904},"last":0.78400000000000003}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":2.6890000000000001,"15min":1.478},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":11.013999999999999,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3200000000000001,"15min":0.99199999999999999},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":4.024,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":2.6030000000000002,"15min":1.5229999999999999},"min":{"1min":0.33700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.471,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":2.54,"15min":1.5009999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":3.1989999999999998,"5min":29.526,"15min":29.526},"last":1.101}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":2.6779999999999999,"15min":1.4670000000000001},"min":{"1min":0.32500000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":10.808,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.756,"5min":1.782,"15min":1.177},"min":{"1min":0.41099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6699999999999999,"5min":14.863,"15min":14.863},"last":1.2210000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":2.1120000000000001,"15min":1.327},"min":{"1min":0.38700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.554,"5min":33.198,"15min":33.198},"last":1.294},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.0939999999999999,"15min":1.379},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.308},"max":{"1min":10.528,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.3420000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":3.5920000000000001,"15min":1.8440000000000001},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.9980000000000002,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.762,"5min":3.7669999999999999,"15min":1.9490000000000001},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.37},"max":{"1min":6.0309999999999997,"5min":54.113,"15min":54.113},"last":1.2629999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575181,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.603,"15min":0.95299999999999996},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":2.6429999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":1.6699999999999999,"15min":1.095},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.9980000000000002,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Wed May 8 20:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":1.6799999999999999,"15min":1.0269999999999999},"min":{"1min":0.215,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7330000000000001,"5min":16.355,"15min":16.355},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.0800000000000001,"15min":0.86599999999999999},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.706,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.86899999999999999}]},{"osd":2,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.345,"15min":0.89500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":3.1059999999999999,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1,"15min":0.83499999999999996},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.95799999999999996,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":1.008}]},{"osd":4,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.5700000000000001,"15min":1.075},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.0259999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.4059999999999999,"15min":1.03},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.0720000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":1.0609999999999999}]},{"osd":5,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":3.911,"15min":1.9179999999999999},"min":{"1min":0.373,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3300000000000001,"5min":117.105,"15min":117.105},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.706,"5min":1.7190000000000001,"15min":1.1559999999999999},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":6.3179999999999996,"5min":14.394,"15min":14.394},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":2.1579999999999999,"15min":1.331},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.5979999999999999,"5min":16.113,"15min":16.113},"last":1.042},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.7669999999999999,"15min":1.216},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":5.0730000000000004,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.242}]},{"osd":7,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":2.0659999999999998,"15min":1.345},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.6749999999999998,"5min":16.977,"15min":16.977},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.903,"15min":1.306},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":3.669,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834575179,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":1.206,"15min":0.84199999999999997},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.84099999999999997,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":1.1970000000000001,"15min":0.91100000000000003},"min":{"1min":0.22500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":2.9449999999999998,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":1.0580000000000001,"15min":0.76800000000000002},"min":{"1min":0.188,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.0609999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.623},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.92200000000000004,"15min":0.76200000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.6459999999999999,"5min":6.7009999999999996,"15min":6.7009999999999996},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.3440000000000001,"15min":0.93100000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":3.1259999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.1830000000000001,"15min":0.93100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.0939999999999999,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":0.95099999999999996}]},{"osd":4,"last update":"Wed May 8 20:54:04 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":2.0379999999999998,"15min":1.234},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":10.257,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.8640000000000001,"15min":1.2350000000000001},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.6509999999999998,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":2.1509999999999998,"15min":1.319},"min":{"1min":0.31,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":5.6340000000000003,"5min":22.489000000000001,"15min":22.489000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.7969999999999999,"15min":1.238},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.9610000000000003,"5min":14.968999999999999,"15min":14.968999999999999},"last":1.075}]},{"osd":6,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.702,"15min":1.1739999999999999},"min":{"1min":0.34899999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.4460000000000002,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":1.052},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.6080000000000001,"15min":1.157},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":6.5039999999999996,"5min":12.553000000000001,"15min":12.553000000000001},"last":0.997}]},{"osd":7,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.141,"15min":1.405},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":13.663,"5min":13.663,"15min":13.663},"last":1.095},{"interface":"front","average":{"1min":1.526,"5min":2.5430000000000001,"15min":1.494},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.6970000000000001,"5min":19.201000000000001,"15min":19.201000000000001},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575180,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.0900000000000001,"15min":0.77400000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.044,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.44,"5min":1.4350000000000001,"15min":0.92900000000000005},"min":{"1min":0.20899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.149,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.4330000000000001,"15min":0.88700000000000001},"min":{"1min":0.20000000000000001,"5min":0.192,"15min":0.188},"max":{"1min":3.2149999999999999,"5min":13.961,"15min":13.961},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.435,"5min":1.1479999999999999,"15min":0.84899999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.5009999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":2.8140000000000001,"15min":1.45},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":3.1819999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":2.0600000000000001,"15min":1.2170000000000001},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":3.0710000000000002,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.8220000000000001,"15min":1.139},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.2490000000000001,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.357,"15min":1.0349999999999999},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.097,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":3.7799999999999998,"15min":1.863},"min":{"1min":0.33500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.0090000000000003,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.877},{"interface":"front","average":{"1min":1.403,"5min":2.0609999999999999,"15min":1.3049999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.2439999999999998,"5min":23.742000000000001,"15min":23.742000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":1.855,"15min":1.226},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":5.069,"5min":14.032,"15min":14.032},"last":1.121},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.47,"15min":1.133},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":4.8540000000000001,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.016}]},{"osd":7,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":3.0099999999999998,"15min":1.6679999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.2060000000000004,"5min":26.881,"15min":26.881},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.917,"15min":1.321},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.5060000000000002,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.1000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.89900000000000002,"15min":0.70099999999999996},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.98999999999999999,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.748,"5min":1.2290000000000001,"15min":0.83999999999999997},"min":{"1min":0.17499999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.2589999999999999,"5min":13.305,"15min":13.305},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.1850000000000001,"15min":0.82399999999999995},"min":{"1min":0.20699999999999999,"5min":0.20300000000000001,"15min":0.19700000000000001},"max":{"1min":3.0859999999999999,"5min":15.212,"15min":15.212},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.1100000000000001,"15min":0.82599999999999996},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":2.8660000000000001,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.0609999999999999,"15min":0.873},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":2.8980000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.115,"15min":0.95999999999999996},"min":{"1min":0.33400000000000002,"5min":0.30299999999999999,"15min":0.26300000000000001},"max":{"1min":2.9239999999999999,"5min":6.758,"15min":6.758},"last":0.63100000000000001}]},{"osd":4,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.613,"15min":1.1040000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.242,"5min":18.407,"15min":18.407},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.6180000000000001,"15min":1.085},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.3240000000000001,"5min":18.466999999999999,"15min":18.466999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.246,"15min":1.3049999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":3.048,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.8220000000000001,"15min":1.1830000000000001},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.1840000000000002,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.103}]},{"osd":6,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.496,"15min":1.0960000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.0860000000000003,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.5609999999999999,"15min":1.123},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":3.6030000000000002,"5min":11.597,"15min":11.597},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":2.3340000000000001,"15min":1.4059999999999999},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5259999999999998,"5min":18.748999999999999,"15min":18.748999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.232,"5min":2.3660000000000001,"15min":1.4930000000000001},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.5590000000000002,"5min":18.788,"15min":18.788},"last":1.0229999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:54:39.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:54:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 Processor -- start 2024-05-08T20:54:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 -- start start 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd71c0c21f0 0x7fd71c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0c2a00 con 0x7fd71c0a8890 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c0aa950 con 0x7fd71c0c21f0 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd720ae5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0a94f0 con 0x7fd71c0c1e10 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd71ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd71c0a8890 0x7fd71c0a9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46184/0 (socket says 172.21.15.81:46184) 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd71ad9d640 1 -- 172.21.15.81:0/2660749515 learned_addr learned my addr 172.21.15.81:0/2660749515 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd719d9b640 1 --2- 172.21.15.81:0/2660749515 >> v2:172.21.15.81:3300/0 conn(0x7fd71c0c21f0 0x7fd71c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd71a59c640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd71959a640 1 -- 172.21.15.81:0/2660749515 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689546446 0 0) 0x7fd71c0c2a00 con 0x7fd71c0a8890 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd71959a640 1 -- 172.21.15.81:0/2660749515 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd708003530 con 0x7fd71c0a8890 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd719d9b640 1 -- 172.21.15.81:0/2660749515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 msgr2=0x7fd71c158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd719d9b640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd719d9b640 1 -- 172.21.15.81:0/2660749515 >> v1:172.21.15.81:6789/0 conn(0x7fd71c0a8890 legacy=0x7fd71c0a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.365+0000 7fd719d9b640 1 -- 172.21.15.81:0/2660749515 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0c0850 con 0x7fd71c0c21f0 2024-05-08T20:54:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd719d9b640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c158b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7040097c0 tx=0x7fd70401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52687aeb491b65b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd71959a640 1 -- 172.21.15.81:0/2660749515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040ab600 con 0x7fd71c0c21f0 2024-05-08T20:54:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd71959a640 1 -- 172.21.15.81:0/2660749515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7040a7050 con 0x7fd71c0c21f0 2024-05-08T20:54:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd71959a640 1 -- 172.21.15.81:0/2660749515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040ab980 con 0x7fd71c0c21f0 2024-05-08T20:54:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- 172.21.15.81:0/2660749515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 msgr2=0x7fd71c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c158b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7040097c0 tx=0x7fd70401c410 comp rx=0 tx=0).stop 2024-05-08T20:54:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- 172.21.15.81:0/2660749515 shutdown_connections 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c158b50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 --2- 172.21.15.81:0/2660749515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- 172.21.15.81:0/2660749515 >> 172.21.15.81:0/2660749515 conn(0x7fd71c0c2ca0 msgr2=0x7fd71c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- 172.21.15.81:0/2660749515 shutdown_connections 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- 172.21.15.81:0/2660749515 wait complete. 2024-05-08T20:54:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 Processor -- start 2024-05-08T20:54:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.369+0000 7fd720ae5640 1 -- start start 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c0a8890 0x7fd71c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c14ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c14d480 con 0x7fd71c0c21f0 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c06c520 con 0x7fd71c0a8890 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c06d0a0 con 0x7fd71c0c1e10 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56994/0 (socket says 172.21.15.81:56994) 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 -- 172.21.15.81:0/555262645 learned_addr learned my addr 172.21.15.81:0/555262645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd719d9b640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c14ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71a59c640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c0a8890 0x7fd71c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 -- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 msgr2=0x7fd71c14ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c14ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 -- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c0a8890 msgr2=0x7fd71c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c0a8890 0x7fd71c14a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 -- 172.21.15.81:0/555262645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009420 con 0x7fd71c0c21f0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71ad9d640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c450 tx=0x7fd71400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714005cf0 con 0x7fd71c0c21f0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714005e50 con 0x7fd71c0c21f0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c152120 con 0x7fd71c0c21f0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140072b0 con 0x7fd71c0c21f0 2024-05-08T20:54:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c06ca50 con 0x7fd71c0c21f0 2024-05-08T20:54:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c074950 con 0x7fd71c0c21f0 2024-05-08T20:54:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd714007410 con 0x7fd71c0c21f0 2024-05-08T20:54:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 0x7fd6fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd714083a50 con 0x7fd71c0c21f0 2024-05-08T20:54:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71a59c640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 0x7fd6fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.373+0000 7fd71a59c640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 0x7fd6fc068b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd71c067600 tx=0x7fd70c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.377+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd714050ab0 con 0x7fd71c0c21f0 2024-05-08T20:54:39.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.533+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd71c0aa6b0 con 0x7fd6fc066690 2024-05-08T20:54:39.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.553+0000 7fd712ffd640 1 -- 172.21.15.81:0/555262645 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528782 (secure 0 0 0) 0x7fd70c0143d0 con 0x7fd6fc066690 2024-05-08T20:54:39.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:39.564 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:54:39.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 msgr2=0x7fd6fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 0x7fd6fc068b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd71c067600 tx=0x7fd70c00b040 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 msgr2=0x7fd71c14f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c450 tx=0x7fd71400c910 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 shutdown_connections 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd6fc066690 0x7fd6fc068b50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c0c21f0 0x7fd71c14f1a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0c1e10 0x7fd71c14ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 --2- 172.21.15.81:0/555262645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c0a8890 0x7fd71c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 >> 172.21.15.81:0/555262645 conn(0x7fd71c0c2ca0 msgr2=0x7fd71c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 shutdown_connections 2024-05-08T20:54:39.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.557+0000 7fd720ae5640 1 -- 172.21.15.81:0/555262645 wait complete. 2024-05-08T20:54:39.578 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":844,"stamp":"2024-05-08T20:54:37.889891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622869,"ondisk_log_size":622869,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005253"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408085+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408085+0000","last_peered":"2024-05-08T20:54:32.408085+0000","last_clean":"2024-05-08T20:54:32.408085+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408085+0000","last_undegraded":"2024-05-08T20:54:32.408085+0000","last_fullsized":"2024-05-08T20:54:32.408085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'764","reported_seq":794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.326300+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:52:23.326300+0000","last_peered":"2024-05-08T20:52:23.326300+0000","last_clean":"2024-05-08T20:52:23.326300+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:52:23.326300+0000","last_undegraded":"2024-05-08T20:52:23.326300+0000","last_fullsized":"2024-05-08T20:52:23.326300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.760841+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:21.760841+0000","last_peered":"2024-05-08T20:54:21.760841+0000","last_clean":"2024-05-08T20:54:21.760841+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:21.760841+0000","last_undegraded":"2024-05-08T20:54:21.760841+0000","last_fullsized":"2024-05-08T20:54:21.760841+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972492+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:54:12.972492+0000","last_peered":"2024-05-08T20:54:12.972492+0000","last_clean":"2024-05-08T20:54:12.972492+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:12.972492+0000","last_undegraded":"2024-05-08T20:54:12.972492+0000","last_fullsized":"2024-05-08T20:54:12.972492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345231+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:32.345231+0000","last_peered":"2024-05-08T20:54:32.345231+0000","last_clean":"2024-05-08T20:54:32.345231+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:32.345231+0000","last_undegraded":"2024-05-08T20:54:32.345231+0000","last_fullsized":"2024-05-08T20:54:32.345231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.484572+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:52:16.484572+0000","last_peered":"2024-05-08T20:52:16.484572+0000","last_clean":"2024-05-08T20:52:16.484572+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:52:16.484572+0000","last_undegraded":"2024-05-08T20:52:16.484572+0000","last_fullsized":"2024-05-08T20:52:16.484572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.836075+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:54:21.836075+0000","last_peered":"2024-05-08T20:54:21.836075+0000","last_clean":"2024-05-08T20:54:21.836075+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:21.836075+0000","last_undegraded":"2024-05-08T20:54:21.836075+0000","last_fullsized":"2024-05-08T20:54:21.836075+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:04.433355+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:54:04.433355+0000","last_peered":"2024-05-08T20:54:04.433355+0000","last_clean":"2024-05-08T20:54:04.433355+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:54:04.433355+0000","last_undegraded":"2024-05-08T20:54:04.433355+0000","last_fullsized":"2024-05-08T20:54:04.433355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3618,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385127+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:32.385127+0000","last_peered":"2024-05-08T20:54:32.385127+0000","last_clean":"2024-05-08T20:54:32.385127+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:32.385127+0000","last_undegraded":"2024-05-08T20:54:32.385127+0000","last_fullsized":"2024-05-08T20:54:32.385127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.097096+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:52:15.097096+0000","last_peered":"2024-05-08T20:52:15.097096+0000","last_clean":"2024-05-08T20:52:15.097096+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:52:15.097096+0000","last_undegraded":"2024-05-08T20:52:15.097096+0000","last_fullsized":"2024-05-08T20:52:15.097096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842236+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:54:21.842236+0000","last_peered":"2024-05-08T20:54:21.842236+0000","last_clean":"2024-05-08T20:54:21.842236+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:21.842236+0000","last_undegraded":"2024-05-08T20:54:21.842236+0000","last_fullsized":"2024-05-08T20:54:21.842236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'618","reported_seq":641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.975632+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:54:12.975632+0000","last_peered":"2024-05-08T20:54:12.975632+0000","last_clean":"2024-05-08T20:54:12.975632+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:12.975632+0000","last_undegraded":"2024-05-08T20:54:12.975632+0000","last_fullsized":"2024-05-08T20:54:12.975632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.321288+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:54:32.321288+0000","last_peered":"2024-05-08T20:54:32.321288+0000","last_clean":"2024-05-08T20:54:32.321288+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:54:32.321288+0000","last_undegraded":"2024-05-08T20:54:32.321288+0000","last_fullsized":"2024-05-08T20:54:32.321288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.593251+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:52:17.593251+0000","last_peered":"2024-05-08T20:52:17.593251+0000","last_clean":"2024-05-08T20:52:17.593251+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:52:17.593251+0000","last_undegraded":"2024-05-08T20:52:17.593251+0000","last_fullsized":"2024-05-08T20:52:17.593251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.899026+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:54:21.899026+0000","last_peered":"2024-05-08T20:54:21.899026+0000","last_clean":"2024-05-08T20:54:21.899026+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:21.899026+0000","last_undegraded":"2024-05-08T20:54:21.899026+0000","last_fullsized":"2024-05-08T20:54:21.899026+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.187731+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:54:32.187731+0000","last_peered":"2024-05-08T20:54:32.187731+0000","last_clean":"2024-05-08T20:54:32.187731+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:32.187731+0000","last_undegraded":"2024-05-08T20:54:32.187731+0000","last_fullsized":"2024-05-08T20:54:32.187731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385482+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:32.385482+0000","last_peered":"2024-05-08T20:54:32.385482+0000","last_clean":"2024-05-08T20:54:32.385482+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:32.385482+0000","last_undegraded":"2024-05-08T20:54:32.385482+0000","last_fullsized":"2024-05-08T20:54:32.385482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.790464+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:54:21.790464+0000","last_peered":"2024-05-08T20:54:21.790464+0000","last_clean":"2024-05-08T20:54:21.790464+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:54:21.790464+0000","last_undegraded":"2024-05-08T20:54:21.790464+0000","last_fullsized":"2024-05-08T20:54:21.790464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.606595+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:52:17.606595+0000","last_peered":"2024-05-08T20:52:17.606595+0000","last_clean":"2024-05-08T20:52:17.606595+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:52:17.606595+0000","last_undegraded":"2024-05-08T20:52:17.606595+0000","last_fullsized":"2024-05-08T20:52:17.606595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.997993+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:54:12.997993+0000","last_peered":"2024-05-08T20:54:12.997993+0000","last_clean":"2024-05-08T20:54:12.997993+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:12.997993+0000","last_undegraded":"2024-05-08T20:54:12.997993+0000","last_fullsized":"2024-05-08T20:54:12.997993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.720841+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:54:32.720841+0000","last_peered":"2024-05-08T20:54:32.720841+0000","last_clean":"2024-05-08T20:54:32.720841+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:54:32.720841+0000","last_undegraded":"2024-05-08T20:54:32.720841+0000","last_fullsized":"2024-05-08T20:54:32.720841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792716+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.792716+0000","last_peered":"2024-05-08T20:54:21.792716+0000","last_clean":"2024-05-08T20:54:21.792716+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.792716+0000","last_undegraded":"2024-05-08T20:54:21.792716+0000","last_fullsized":"2024-05-08T20:54:21.792716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489381+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:52:16.489381+0000","last_peered":"2024-05-08T20:52:16.489381+0000","last_clean":"2024-05-08T20:52:16.489381+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:52:16.489381+0000","last_undegraded":"2024-05-08T20:52:16.489381+0000","last_fullsized":"2024-05-08T20:52:16.489381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.993291+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:54:12.993291+0000","last_peered":"2024-05-08T20:54:12.993291+0000","last_clean":"2024-05-08T20:54:12.993291+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:12.993291+0000","last_undegraded":"2024-05-08T20:54:12.993291+0000","last_fullsized":"2024-05-08T20:54:12.993291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3463,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368057+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:32.368057+0000","last_peered":"2024-05-08T20:54:32.368057+0000","last_clean":"2024-05-08T20:54:32.368057+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:32.368057+0000","last_undegraded":"2024-05-08T20:54:32.368057+0000","last_fullsized":"2024-05-08T20:54:32.368057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793596+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793596+0000","last_peered":"2024-05-08T20:54:21.793596+0000","last_clean":"2024-05-08T20:54:21.793596+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793596+0000","last_undegraded":"2024-05-08T20:54:21.793596+0000","last_fullsized":"2024-05-08T20:54:21.793596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.078657+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:52:15.078657+0000","last_peered":"2024-05-08T20:52:15.078657+0000","last_clean":"2024-05-08T20:52:15.078657+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:52:15.078657+0000","last_undegraded":"2024-05-08T20:52:15.078657+0000","last_fullsized":"2024-05-08T20:52:15.078657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.986661+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:54:12.986661+0000","last_peered":"2024-05-08T20:54:12.986661+0000","last_clean":"2024-05-08T20:54:12.986661+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:12.986661+0000","last_undegraded":"2024-05-08T20:54:12.986661+0000","last_fullsized":"2024-05-08T20:54:12.986661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.392109+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:32.392109+0000","last_peered":"2024-05-08T20:54:32.392109+0000","last_clean":"2024-05-08T20:54:32.392109+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:32.392109+0000","last_undegraded":"2024-05-08T20:54:32.392109+0000","last_fullsized":"2024-05-08T20:54:32.392109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.759597+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:54:21.759597+0000","last_peered":"2024-05-08T20:54:21.759597+0000","last_clean":"2024-05-08T20:54:21.759597+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:54:21.759597+0000","last_undegraded":"2024-05-08T20:54:21.759597+0000","last_fullsized":"2024-05-08T20:54:21.759597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.076400+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:52:15.076400+0000","last_peered":"2024-05-08T20:52:15.076400+0000","last_clean":"2024-05-08T20:52:15.076400+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:52:15.076400+0000","last_undegraded":"2024-05-08T20:52:15.076400+0000","last_fullsized":"2024-05-08T20:52:15.076400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'7","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984726+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:54:12.984726+0000","last_peered":"2024-05-08T20:54:12.984726+0000","last_clean":"2024-05-08T20:54:12.984726+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:12.984726+0000","last_undegraded":"2024-05-08T20:54:12.984726+0000","last_fullsized":"2024-05-08T20:54:12.984726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404921+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:54:32.404921+0000","last_peered":"2024-05-08T20:54:32.404921+0000","last_clean":"2024-05-08T20:54:32.404921+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:54:32.404921+0000","last_undegraded":"2024-05-08T20:54:32.404921+0000","last_fullsized":"2024-05-08T20:54:32.404921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.752812+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:54:21.752812+0000","last_peered":"2024-05-08T20:54:21.752812+0000","last_clean":"2024-05-08T20:54:21.752812+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:21.752812+0000","last_undegraded":"2024-05-08T20:54:21.752812+0000","last_fullsized":"2024-05-08T20:54:21.752812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.519154+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:52:16.519154+0000","last_peered":"2024-05-08T20:52:16.519154+0000","last_clean":"2024-05-08T20:52:16.519154+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:52:16.519154+0000","last_undegraded":"2024-05-08T20:52:16.519154+0000","last_fullsized":"2024-05-08T20:52:16.519154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'64","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.210071+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:54:15.210071+0000","last_peered":"2024-05-08T20:54:15.210071+0000","last_clean":"2024-05-08T20:54:15.210071+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:54:15.210071+0000","last_undegraded":"2024-05-08T20:54:15.210071+0000","last_fullsized":"2024-05-08T20:54:15.210071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4005,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.360912+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:32.360912+0000","last_peered":"2024-05-08T20:54:32.360912+0000","last_clean":"2024-05-08T20:54:32.360912+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:32.360912+0000","last_undegraded":"2024-05-08T20:54:32.360912+0000","last_fullsized":"2024-05-08T20:54:32.360912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792266+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:54:21.792266+0000","last_peered":"2024-05-08T20:54:21.792266+0000","last_clean":"2024-05-08T20:54:21.792266+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:54:21.792266+0000","last_undegraded":"2024-05-08T20:54:21.792266+0000","last_fullsized":"2024-05-08T20:54:21.792266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'254","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.824742+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:54:12.824742+0000","last_peered":"2024-05-08T20:54:12.824742+0000","last_clean":"2024-05-08T20:54:12.824742+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:54:12.824742+0000","last_undegraded":"2024-05-08T20:54:12.824742+0000","last_fullsized":"2024-05-08T20:54:12.824742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.990396+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:54:12.990396+0000","last_peered":"2024-05-08T20:54:12.990396+0000","last_clean":"2024-05-08T20:54:12.990396+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:54:12.990396+0000","last_undegraded":"2024-05-08T20:54:12.990396+0000","last_fullsized":"2024-05-08T20:54:12.990396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.296768+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:32.296768+0000","last_peered":"2024-05-08T20:54:32.296768+0000","last_clean":"2024-05-08T20:54:32.296768+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:32.296768+0000","last_undegraded":"2024-05-08T20:54:32.296768+0000","last_fullsized":"2024-05-08T20:54:32.296768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.788170+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:54:21.788170+0000","last_peered":"2024-05-08T20:54:21.788170+0000","last_clean":"2024-05-08T20:54:21.788170+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:54:21.788170+0000","last_undegraded":"2024-05-08T20:54:21.788170+0000","last_fullsized":"2024-05-08T20:54:21.788170+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:30.539923+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:52:30.539923+0000","last_peered":"2024-05-08T20:52:30.539923+0000","last_clean":"2024-05-08T20:52:30.539923+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:52:30.539923+0000","last_undegraded":"2024-05-08T20:52:30.539923+0000","last_fullsized":"2024-05-08T20:52:30.539923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.971964+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:54:12.971964+0000","last_peered":"2024-05-08T20:54:12.971964+0000","last_clean":"2024-05-08T20:54:12.971964+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:54:12.971964+0000","last_undegraded":"2024-05-08T20:54:12.971964+0000","last_fullsized":"2024-05-08T20:54:12.971964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4647,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.431453+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:54:32.431453+0000","last_peered":"2024-05-08T20:54:32.431453+0000","last_clean":"2024-05-08T20:54:32.431453+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:54:32.431453+0000","last_undegraded":"2024-05-08T20:54:32.431453+0000","last_fullsized":"2024-05-08T20:54:32.431453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4651,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.898778+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:54:21.898778+0000","last_peered":"2024-05-08T20:54:21.898778+0000","last_clean":"2024-05-08T20:54:21.898778+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:21.898778+0000","last_undegraded":"2024-05-08T20:54:21.898778+0000","last_fullsized":"2024-05-08T20:54:21.898778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.130266+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:52:23.130266+0000","last_peered":"2024-05-08T20:52:23.130266+0000","last_clean":"2024-05-08T20:52:23.130266+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:52:23.130266+0000","last_undegraded":"2024-05-08T20:52:23.130266+0000","last_fullsized":"2024-05-08T20:52:23.130266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.634805+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:54:07.634805+0000","last_peered":"2024-05-08T20:54:07.634805+0000","last_clean":"2024-05-08T20:54:07.634805+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:07.634805+0000","last_undegraded":"2024-05-08T20:54:07.634805+0000","last_fullsized":"2024-05-08T20:54:07.634805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.364835+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:54:32.364835+0000","last_peered":"2024-05-08T20:54:32.364835+0000","last_clean":"2024-05-08T20:54:32.364835+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:54:32.364835+0000","last_undegraded":"2024-05-08T20:54:32.364835+0000","last_fullsized":"2024-05-08T20:54:32.364835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5908,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.814282+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:54:21.814282+0000","last_peered":"2024-05-08T20:54:21.814282+0000","last_clean":"2024-05-08T20:54:21.814282+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:54:21.814282+0000","last_undegraded":"2024-05-08T20:54:21.814282+0000","last_fullsized":"2024-05-08T20:54:21.814282+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:20.746091+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:52:20.746091+0000","last_peered":"2024-05-08T20:52:20.746091+0000","last_clean":"2024-05-08T20:52:20.746091+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:52:20.746091+0000","last_undegraded":"2024-05-08T20:52:20.746091+0000","last_fullsized":"2024-05-08T20:52:20.746091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.985126+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:54:12.985126+0000","last_peered":"2024-05-08T20:54:12.985126+0000","last_clean":"2024-05-08T20:54:12.985126+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:12.985126+0000","last_undegraded":"2024-05-08T20:54:12.985126+0000","last_fullsized":"2024-05-08T20:54:12.985126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325930+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:54:32.325930+0000","last_peered":"2024-05-08T20:54:32.325930+0000","last_clean":"2024-05-08T20:54:32.325930+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:54:32.325930+0000","last_undegraded":"2024-05-08T20:54:32.325930+0000","last_fullsized":"2024-05-08T20:54:32.325930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4784,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.797586+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:54:21.797586+0000","last_peered":"2024-05-08T20:54:21.797586+0000","last_clean":"2024-05-08T20:54:21.797586+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:54:21.797586+0000","last_undegraded":"2024-05-08T20:54:21.797586+0000","last_fullsized":"2024-05-08T20:54:21.797586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'72","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.130807+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:54:15.130807+0000","last_peered":"2024-05-08T20:54:15.130807+0000","last_clean":"2024-05-08T20:54:15.130807+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:15.130807+0000","last_undegraded":"2024-05-08T20:54:15.130807+0000","last_fullsized":"2024-05-08T20:54:15.130807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.983711+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:54:12.983711+0000","last_peered":"2024-05-08T20:54:12.983711+0000","last_clean":"2024-05-08T20:54:12.983711+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:12.983711+0000","last_undegraded":"2024-05-08T20:54:12.983711+0000","last_fullsized":"2024-05-08T20:54:12.983711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3652,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375188+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375188+0000","last_peered":"2024-05-08T20:54:32.375188+0000","last_clean":"2024-05-08T20:54:32.375188+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375188+0000","last_undegraded":"2024-05-08T20:54:32.375188+0000","last_fullsized":"2024-05-08T20:54:32.375188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":4996,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.838483+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:54:21.838483+0000","last_peered":"2024-05-08T20:54:21.838483+0000","last_clean":"2024-05-08T20:54:21.838483+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:21.838483+0000","last_undegraded":"2024-05-08T20:54:21.838483+0000","last_fullsized":"2024-05-08T20:54:21.838483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.496369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:52:16.496369+0000","last_peered":"2024-05-08T20:52:16.496369+0000","last_clean":"2024-05-08T20:52:16.496369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:52:16.496369+0000","last_undegraded":"2024-05-08T20:52:16.496369+0000","last_fullsized":"2024-05-08T20:52:16.496369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'276","reported_seq":301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960565+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:54:12.960565+0000","last_peered":"2024-05-08T20:54:12.960565+0000","last_clean":"2024-05-08T20:54:12.960565+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:54:12.960565+0000","last_undegraded":"2024-05-08T20:54:12.960565+0000","last_fullsized":"2024-05-08T20:54:12.960565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5503,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.403897+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:32.403897+0000","last_peered":"2024-05-08T20:54:32.403897+0000","last_clean":"2024-05-08T20:54:32.403897+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:32.403897+0000","last_undegraded":"2024-05-08T20:54:32.403897+0000","last_fullsized":"2024-05-08T20:54:32.403897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5099,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:21.824960+0000","last_peered":"2024-05-08T20:54:21.824960+0000","last_clean":"2024-05-08T20:54:21.824960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:21.824960+0000","last_undegraded":"2024-05-08T20:54:21.824960+0000","last_fullsized":"2024-05-08T20:54:21.824960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:25.807713+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:52:25.807713+0000","last_peered":"2024-05-08T20:52:25.807713+0000","last_clean":"2024-05-08T20:52:25.807713+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:52:25.807713+0000","last_undegraded":"2024-05-08T20:52:25.807713+0000","last_fullsized":"2024-05-08T20:52:25.807713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:51:19.878927+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:51:19.878927+0000","last_peered":"2024-05-08T20:51:19.878927+0000","last_clean":"2024-05-08T20:51:19.878927+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:51:19.878927+0000","last_undegraded":"2024-05-08T20:51:19.878927+0000","last_fullsized":"2024-05-08T20:51:19.878927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:32.834790+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:52:32.834790+0000","last_peered":"2024-05-08T20:52:32.834790+0000","last_clean":"2024-05-08T20:52:32.834790+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:52:32.834790+0000","last_undegraded":"2024-05-08T20:52:32.834790+0000","last_fullsized":"2024-05-08T20:52:32.834790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.539784+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:54:32.539784+0000","last_peered":"2024-05-08T20:54:32.539784+0000","last_clean":"2024-05-08T20:54:32.539784+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:54:32.539784+0000","last_undegraded":"2024-05-08T20:54:32.539784+0000","last_fullsized":"2024-05-08T20:54:32.539784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5582,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.883282+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:54:21.883282+0000","last_peered":"2024-05-08T20:54:21.883282+0000","last_clean":"2024-05-08T20:54:21.883282+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:21.883282+0000","last_undegraded":"2024-05-08T20:54:21.883282+0000","last_fullsized":"2024-05-08T20:54:21.883282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.088321+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:52:15.088321+0000","last_peered":"2024-05-08T20:52:15.088321+0000","last_clean":"2024-05-08T20:52:15.088321+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:52:15.088321+0000","last_undegraded":"2024-05-08T20:52:15.088321+0000","last_fullsized":"2024-05-08T20:52:15.088321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.966573+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:54:12.966573+0000","last_peered":"2024-05-08T20:54:12.966573+0000","last_clean":"2024-05-08T20:54:12.966573+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:54:12.966573+0000","last_undegraded":"2024-05-08T20:54:12.966573+0000","last_fullsized":"2024-05-08T20:54:12.966573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.397458+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:54:32.397458+0000","last_peered":"2024-05-08T20:54:32.397458+0000","last_clean":"2024-05-08T20:54:32.397458+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:54:32.397458+0000","last_undegraded":"2024-05-08T20:54:32.397458+0000","last_fullsized":"2024-05-08T20:54:32.397458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5622,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793078+0000","last_change":"2024-05-08T20:28:00.414547+0000","last_active":"2024-05-08T20:54:21.793078+0000","last_peered":"2024-05-08T20:54:21.793078+0000","last_clean":"2024-05-08T20:54:21.793078+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:54:21.793078+0000","last_undegraded":"2024-05-08T20:54:21.793078+0000","last_fullsized":"2024-05-08T20:54:21.793078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:58.107901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.601869+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:52:17.601869+0000","last_peered":"2024-05-08T20:52:17.601869+0000","last_clean":"2024-05-08T20:52:17.601869+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:52:17.601869+0000","last_undegraded":"2024-05-08T20:52:17.601869+0000","last_fullsized":"2024-05-08T20:52:17.601869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1136","reported_seq":1161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.000077+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:54:13.000077+0000","last_peered":"2024-05-08T20:54:13.000077+0000","last_clean":"2024-05-08T20:54:13.000077+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:54:13.000077+0000","last_undegraded":"2024-05-08T20:54:13.000077+0000","last_fullsized":"2024-05-08T20:54:13.000077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.298191+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.298191+0000","last_peered":"2024-05-08T20:54:32.298191+0000","last_clean":"2024-05-08T20:54:32.298191+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.298191+0000","last_undegraded":"2024-05-08T20:54:32.298191+0000","last_fullsized":"2024-05-08T20:54:32.298191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.910601+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:54:21.910601+0000","last_peered":"2024-05-08T20:54:21.910601+0000","last_clean":"2024-05-08T20:54:21.910601+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:54:21.910601+0000","last_undegraded":"2024-05-08T20:54:21.910601+0000","last_fullsized":"2024-05-08T20:54:21.910601+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.071772+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:52:15.071772+0000","last_peered":"2024-05-08T20:52:15.071772+0000","last_clean":"2024-05-08T20:52:15.071772+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:52:15.071772+0000","last_undegraded":"2024-05-08T20:52:15.071772+0000","last_fullsized":"2024-05-08T20:52:15.071772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.635968+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:54:07.635968+0000","last_peered":"2024-05-08T20:54:07.635968+0000","last_clean":"2024-05-08T20:54:07.635968+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:07.635968+0000","last_undegraded":"2024-05-08T20:54:07.635968+0000","last_fullsized":"2024-05-08T20:54:07.635968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3750,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368145+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:54:32.368145+0000","last_peered":"2024-05-08T20:54:32.368145+0000","last_clean":"2024-05-08T20:54:32.368145+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:32.368145+0000","last_undegraded":"2024-05-08T20:54:32.368145+0000","last_fullsized":"2024-05-08T20:54:32.368145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867267+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:54:21.867267+0000","last_peered":"2024-05-08T20:54:21.867267+0000","last_clean":"2024-05-08T20:54:21.867267+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:54:21.867267+0000","last_undegraded":"2024-05-08T20:54:21.867267+0000","last_fullsized":"2024-05-08T20:54:21.867267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.836779+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:52:15.836779+0000","last_peered":"2024-05-08T20:52:15.836779+0000","last_clean":"2024-05-08T20:52:15.836779+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:52:15.836779+0000","last_undegraded":"2024-05-08T20:52:15.836779+0000","last_fullsized":"2024-05-08T20:52:15.836779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960698+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:54:12.960698+0000","last_peered":"2024-05-08T20:54:12.960698+0000","last_clean":"2024-05-08T20:54:12.960698+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:12.960698+0000","last_undegraded":"2024-05-08T20:54:12.960698+0000","last_fullsized":"2024-05-08T20:54:12.960698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367255+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367255+0000","last_peered":"2024-05-08T20:54:32.367255+0000","last_clean":"2024-05-08T20:54:32.367255+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367255+0000","last_undegraded":"2024-05-08T20:54:32.367255+0000","last_fullsized":"2024-05-08T20:54:32.367255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4904,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863399+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:54:21.863399+0000","last_peered":"2024-05-08T20:54:21.863399+0000","last_clean":"2024-05-08T20:54:21.863399+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:54:21.863399+0000","last_undegraded":"2024-05-08T20:54:21.863399+0000","last_fullsized":"2024-05-08T20:54:21.863399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:02.925048+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:53:02.925048+0000","last_peered":"2024-05-08T20:53:02.925048+0000","last_clean":"2024-05-08T20:53:02.925048+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:53:02.925048+0000","last_undegraded":"2024-05-08T20:53:02.925048+0000","last_fullsized":"2024-05-08T20:53:02.925048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.974440+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:54:12.974440+0000","last_peered":"2024-05-08T20:54:12.974440+0000","last_clean":"2024-05-08T20:54:12.974440+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:12.974440+0000","last_undegraded":"2024-05-08T20:54:12.974440+0000","last_fullsized":"2024-05-08T20:54:12.974440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382036+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382036+0000","last_peered":"2024-05-08T20:54:32.382036+0000","last_clean":"2024-05-08T20:54:32.382036+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382036+0000","last_undegraded":"2024-05-08T20:54:32.382036+0000","last_fullsized":"2024-05-08T20:54:32.382036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.789086+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:54:21.789086+0000","last_peered":"2024-05-08T20:54:21.789086+0000","last_clean":"2024-05-08T20:54:21.789086+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:54:21.789086+0000","last_undegraded":"2024-05-08T20:54:21.789086+0000","last_fullsized":"2024-05-08T20:54:21.789086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.946926+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:52:15.946926+0000","last_peered":"2024-05-08T20:52:15.946926+0000","last_clean":"2024-05-08T20:52:15.946926+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:52:15.946926+0000","last_undegraded":"2024-05-08T20:52:15.946926+0000","last_fullsized":"2024-05-08T20:52:15.946926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.923631+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:54:12.923631+0000","last_peered":"2024-05-08T20:54:12.923631+0000","last_clean":"2024-05-08T20:54:12.923631+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:54:12.923631+0000","last_undegraded":"2024-05-08T20:54:12.923631+0000","last_fullsized":"2024-05-08T20:54:12.923631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368762+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368762+0000","last_peered":"2024-05-08T20:54:32.368762+0000","last_clean":"2024-05-08T20:54:32.368762+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368762+0000","last_undegraded":"2024-05-08T20:54:32.368762+0000","last_fullsized":"2024-05-08T20:54:32.368762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6080,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.886261+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:21.886261+0000","last_peered":"2024-05-08T20:54:21.886261+0000","last_clean":"2024-05-08T20:54:21.886261+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:21.886261+0000","last_undegraded":"2024-05-08T20:54:21.886261+0000","last_fullsized":"2024-05-08T20:54:21.886261+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489130+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:52:16.489130+0000","last_peered":"2024-05-08T20:52:16.489130+0000","last_clean":"2024-05-08T20:52:16.489130+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:52:16.489130+0000","last_undegraded":"2024-05-08T20:52:16.489130+0000","last_fullsized":"2024-05-08T20:52:16.489130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'389","reported_seq":413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.272721+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:54:07.272721+0000","last_peered":"2024-05-08T20:54:07.272721+0000","last_clean":"2024-05-08T20:54:07.272721+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:07.272721+0000","last_undegraded":"2024-05-08T20:54:07.272721+0000","last_fullsized":"2024-05-08T20:54:07.272721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398306+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398306+0000","last_peered":"2024-05-08T20:54:32.398306+0000","last_clean":"2024-05-08T20:54:32.398306+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398306+0000","last_undegraded":"2024-05-08T20:54:32.398306+0000","last_fullsized":"2024-05-08T20:54:32.398306+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.749989+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:54:21.749989+0000","last_peered":"2024-05-08T20:54:21.749989+0000","last_clean":"2024-05-08T20:54:21.749989+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:21.749989+0000","last_undegraded":"2024-05-08T20:54:21.749989+0000","last_fullsized":"2024-05-08T20:54:21.749989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.551192+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:52:17.551192+0000","last_peered":"2024-05-08T20:52:17.551192+0000","last_clean":"2024-05-08T20:52:17.551192+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:52:17.551192+0000","last_undegraded":"2024-05-08T20:52:17.551192+0000","last_fullsized":"2024-05-08T20:52:17.551192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'38","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.880156+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:54:13.880156+0000","last_peered":"2024-05-08T20:54:13.880156+0000","last_clean":"2024-05-08T20:54:13.880156+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:54:13.880156+0000","last_undegraded":"2024-05-08T20:54:13.880156+0000","last_fullsized":"2024-05-08T20:54:13.880156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.426159+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:54:32.426159+0000","last_peered":"2024-05-08T20:54:32.426159+0000","last_clean":"2024-05-08T20:54:32.426159+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:54:32.426159+0000","last_undegraded":"2024-05-08T20:54:32.426159+0000","last_fullsized":"2024-05-08T20:54:32.426159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.799792+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:54:21.799792+0000","last_peered":"2024-05-08T20:54:21.799792+0000","last_clean":"2024-05-08T20:54:21.799792+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:54:21.799792+0000","last_undegraded":"2024-05-08T20:54:21.799792+0000","last_fullsized":"2024-05-08T20:54:21.799792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'372","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:07.848241+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:53:07.848241+0000","last_peered":"2024-05-08T20:53:07.848241+0000","last_clean":"2024-05-08T20:53:07.848241+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:53:07.848241+0000","last_undegraded":"2024-05-08T20:53:07.848241+0000","last_fullsized":"2024-05-08T20:53:07.848241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.973682+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:54:12.973682+0000","last_peered":"2024-05-08T20:54:12.973682+0000","last_clean":"2024-05-08T20:54:12.973682+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:12.973682+0000","last_undegraded":"2024-05-08T20:54:12.973682+0000","last_fullsized":"2024-05-08T20:54:12.973682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3965,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325893+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325893+0000","last_peered":"2024-05-08T20:54:32.325893+0000","last_clean":"2024-05-08T20:54:32.325893+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325893+0000","last_undegraded":"2024-05-08T20:54:32.325893+0000","last_fullsized":"2024-05-08T20:54:32.325893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.876604+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:54:21.876604+0000","last_peered":"2024-05-08T20:54:21.876604+0000","last_clean":"2024-05-08T20:54:21.876604+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:54:21.876604+0000","last_undegraded":"2024-05-08T20:54:21.876604+0000","last_fullsized":"2024-05-08T20:54:21.876604+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'40","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:58.250615+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:53:58.250615+0000","last_peered":"2024-05-08T20:53:58.250615+0000","last_clean":"2024-05-08T20:53:58.250615+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:53:58.250615+0000","last_undegraded":"2024-05-08T20:53:58.250615+0000","last_fullsized":"2024-05-08T20:53:58.250615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'7","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.991280+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:54:12.991280+0000","last_peered":"2024-05-08T20:54:12.991280+0000","last_clean":"2024-05-08T20:54:12.991280+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:12.991280+0000","last_undegraded":"2024-05-08T20:54:12.991280+0000","last_fullsized":"2024-05-08T20:54:12.991280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.363218+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.363218+0000","last_peered":"2024-05-08T20:54:32.363218+0000","last_clean":"2024-05-08T20:54:32.363218+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.363218+0000","last_undegraded":"2024-05-08T20:54:32.363218+0000","last_fullsized":"2024-05-08T20:54:32.363218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.812600+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:54:21.812600+0000","last_peered":"2024-05-08T20:54:21.812600+0000","last_clean":"2024-05-08T20:54:21.812600+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:54:21.812600+0000","last_undegraded":"2024-05-08T20:54:21.812600+0000","last_fullsized":"2024-05-08T20:54:21.812600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.483086+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:52:16.483086+0000","last_peered":"2024-05-08T20:52:16.483086+0000","last_clean":"2024-05-08T20:52:16.483086+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:52:16.483086+0000","last_undegraded":"2024-05-08T20:52:16.483086+0000","last_fullsized":"2024-05-08T20:52:16.483086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972676+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:54:12.972676+0000","last_peered":"2024-05-08T20:54:12.972676+0000","last_clean":"2024-05-08T20:54:12.972676+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:12.972676+0000","last_undegraded":"2024-05-08T20:54:12.972676+0000","last_fullsized":"2024-05-08T20:54:12.972676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406456+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:32.406456+0000","last_peered":"2024-05-08T20:54:32.406456+0000","last_clean":"2024-05-08T20:54:32.406456+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:32.406456+0000","last_undegraded":"2024-05-08T20:54:32.406456+0000","last_fullsized":"2024-05-08T20:54:32.406456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.800922+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.800922+0000","last_peered":"2024-05-08T20:54:21.800922+0000","last_clean":"2024-05-08T20:54:21.800922+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.800922+0000","last_undegraded":"2024-05-08T20:54:21.800922+0000","last_fullsized":"2024-05-08T20:54:21.800922+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.981217+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:52:15.981217+0000","last_peered":"2024-05-08T20:52:15.981217+0000","last_clean":"2024-05-08T20:52:15.981217+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:52:15.981217+0000","last_undegraded":"2024-05-08T20:52:15.981217+0000","last_fullsized":"2024-05-08T20:52:15.981217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972569+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:54:12.972569+0000","last_peered":"2024-05-08T20:54:12.972569+0000","last_clean":"2024-05-08T20:54:12.972569+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:54:12.972569+0000","last_undegraded":"2024-05-08T20:54:12.972569+0000","last_fullsized":"2024-05-08T20:54:12.972569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6612,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.392792+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:32.392792+0000","last_peered":"2024-05-08T20:54:32.392792+0000","last_clean":"2024-05-08T20:54:32.392792+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:32.392792+0000","last_undegraded":"2024-05-08T20:54:32.392792+0000","last_fullsized":"2024-05-08T20:54:32.392792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.963381+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:54:12.963381+0000","last_peered":"2024-05-08T20:54:12.963381+0000","last_clean":"2024-05-08T20:54:12.963381+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:54:12.963381+0000","last_undegraded":"2024-05-08T20:54:12.963381+0000","last_fullsized":"2024-05-08T20:54:12.963381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6026,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793198+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:54:21.793198+0000","last_peered":"2024-05-08T20:54:21.793198+0000","last_clean":"2024-05-08T20:54:21.793198+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:21.793198+0000","last_undegraded":"2024-05-08T20:54:21.793198+0000","last_fullsized":"2024-05-08T20:54:21.793198+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:03.788193+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:52:03.788193+0000","last_peered":"2024-05-08T20:52:03.788193+0000","last_clean":"2024-05-08T20:52:03.788193+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:52:03.788193+0000","last_undegraded":"2024-05-08T20:52:03.788193+0000","last_fullsized":"2024-05-08T20:52:03.788193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.301812+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:54:32.301812+0000","last_peered":"2024-05-08T20:54:32.301812+0000","last_clean":"2024-05-08T20:54:32.301812+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:54:32.301812+0000","last_undegraded":"2024-05-08T20:54:32.301812+0000","last_fullsized":"2024-05-08T20:54:32.301812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984777+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:54:12.984777+0000","last_peered":"2024-05-08T20:54:12.984777+0000","last_clean":"2024-05-08T20:54:12.984777+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:54:12.984777+0000","last_undegraded":"2024-05-08T20:54:12.984777+0000","last_fullsized":"2024-05-08T20:54:12.984777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.798553+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:54:21.798553+0000","last_peered":"2024-05-08T20:54:21.798553+0000","last_clean":"2024-05-08T20:54:21.798553+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:54:21.798553+0000","last_undegraded":"2024-05-08T20:54:21.798553+0000","last_fullsized":"2024-05-08T20:54:21.798553+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.879936+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:52:15.879936+0000","last_peered":"2024-05-08T20:52:15.879936+0000","last_clean":"2024-05-08T20:52:15.879936+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:52:15.879936+0000","last_undegraded":"2024-05-08T20:52:15.879936+0000","last_fullsized":"2024-05-08T20:52:15.879936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4948,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.442604+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:54:32.442604+0000","last_peered":"2024-05-08T20:54:32.442604+0000","last_clean":"2024-05-08T20:54:32.442604+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:54:32.442604+0000","last_undegraded":"2024-05-08T20:54:32.442604+0000","last_fullsized":"2024-05-08T20:54:32.442604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'162","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.590870+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:54:21.590870+0000","last_peered":"2024-05-08T20:54:21.590870+0000","last_clean":"2024-05-08T20:54:21.590870+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:21.590870+0000","last_undegraded":"2024-05-08T20:54:21.590870+0000","last_fullsized":"2024-05-08T20:54:21.590870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.851678+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:54:21.851678+0000","last_peered":"2024-05-08T20:54:21.851678+0000","last_clean":"2024-05-08T20:54:21.851678+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:54:21.851678+0000","last_undegraded":"2024-05-08T20:54:21.851678+0000","last_fullsized":"2024-05-08T20:54:21.851678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:27.909301+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:52:27.909301+0000","last_peered":"2024-05-08T20:52:27.909301+0000","last_clean":"2024-05-08T20:52:27.909301+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:52:27.909301+0000","last_undegraded":"2024-05-08T20:52:27.909301+0000","last_fullsized":"2024-05-08T20:52:27.909301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.400488+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:32.400488+0000","last_peered":"2024-05-08T20:54:32.400488+0000","last_clean":"2024-05-08T20:54:32.400488+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:32.400488+0000","last_undegraded":"2024-05-08T20:54:32.400488+0000","last_fullsized":"2024-05-08T20:54:32.400488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'654","reported_seq":681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.109585+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:52:15.109585+0000","last_peered":"2024-05-08T20:52:15.109585+0000","last_clean":"2024-05-08T20:52:15.109585+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:52:15.109585+0000","last_undegraded":"2024-05-08T20:52:15.109585+0000","last_fullsized":"2024-05-08T20:52:15.109585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.786384+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:54:21.786384+0000","last_peered":"2024-05-08T20:54:21.786384+0000","last_clean":"2024-05-08T20:54:21.786384+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:54:21.786384+0000","last_undegraded":"2024-05-08T20:54:21.786384+0000","last_fullsized":"2024-05-08T20:54:21.786384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'7","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.965965+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:54:12.965965+0000","last_peered":"2024-05-08T20:54:12.965965+0000","last_clean":"2024-05-08T20:54:12.965965+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:12.965965+0000","last_undegraded":"2024-05-08T20:54:12.965965+0000","last_fullsized":"2024-05-08T20:54:12.965965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.441006+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.441006+0000","last_peered":"2024-05-08T20:54:32.441006+0000","last_clean":"2024-05-08T20:54:32.441006+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.441006+0000","last_undegraded":"2024-05-08T20:54:32.441006+0000","last_fullsized":"2024-05-08T20:54:32.441006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.809888+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:54:21.809888+0000","last_peered":"2024-05-08T20:54:21.809888+0000","last_clean":"2024-05-08T20:54:21.809888+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:21.809888+0000","last_undegraded":"2024-05-08T20:54:21.809888+0000","last_fullsized":"2024-05-08T20:54:21.809888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.413717+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.413717+0000","last_peered":"2024-05-08T20:54:32.413717+0000","last_clean":"2024-05-08T20:54:32.413717+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.413717+0000","last_undegraded":"2024-05-08T20:54:32.413717+0000","last_fullsized":"2024-05-08T20:54:32.413717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5624,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.762734+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:54:21.762734+0000","last_peered":"2024-05-08T20:54:21.762734+0000","last_clean":"2024-05-08T20:54:21.762734+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:21.762734+0000","last_undegraded":"2024-05-08T20:54:21.762734+0000","last_fullsized":"2024-05-08T20:54:21.762734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.290807+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.290807+0000","last_peered":"2024-05-08T20:54:32.290807+0000","last_clean":"2024-05-08T20:54:32.290807+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.290807+0000","last_undegraded":"2024-05-08T20:54:32.290807+0000","last_fullsized":"2024-05-08T20:54:32.290807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873705+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:21.873705+0000","last_peered":"2024-05-08T20:54:21.873705+0000","last_clean":"2024-05-08T20:54:21.873705+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:21.873705+0000","last_undegraded":"2024-05-08T20:54:21.873705+0000","last_fullsized":"2024-05-08T20:54:21.873705+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4812,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.433420+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.433420+0000","last_peered":"2024-05-08T20:54:32.433420+0000","last_clean":"2024-05-08T20:54:32.433420+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.433420+0000","last_undegraded":"2024-05-08T20:54:32.433420+0000","last_fullsized":"2024-05-08T20:54:32.433420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5722,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804450+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:54:21.804450+0000","last_peered":"2024-05-08T20:54:21.804450+0000","last_clean":"2024-05-08T20:54:21.804450+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:21.804450+0000","last_undegraded":"2024-05-08T20:54:21.804450+0000","last_fullsized":"2024-05-08T20:54:21.804450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339531+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:32.339531+0000","last_peered":"2024-05-08T20:54:32.339531+0000","last_clean":"2024-05-08T20:54:32.339531+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:32.339531+0000","last_undegraded":"2024-05-08T20:54:32.339531+0000","last_fullsized":"2024-05-08T20:54:32.339531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5427,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862537+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862537+0000","last_peered":"2024-05-08T20:54:21.862537+0000","last_clean":"2024-05-08T20:54:21.862537+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862537+0000","last_undegraded":"2024-05-08T20:54:21.862537+0000","last_fullsized":"2024-05-08T20:54:21.862537+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4139,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.403208+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:32.403208+0000","last_peered":"2024-05-08T20:54:32.403208+0000","last_clean":"2024-05-08T20:54:32.403208+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:32.403208+0000","last_undegraded":"2024-05-08T20:54:32.403208+0000","last_fullsized":"2024-05-08T20:54:32.403208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.741430+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:54:21.741430+0000","last_peered":"2024-05-08T20:54:21.741430+0000","last_clean":"2024-05-08T20:54:21.741430+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:54:21.741430+0000","last_undegraded":"2024-05-08T20:54:21.741430+0000","last_fullsized":"2024-05-08T20:54:21.741430+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406976+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:32.406976+0000","last_peered":"2024-05-08T20:54:32.406976+0000","last_clean":"2024-05-08T20:54:32.406976+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:32.406976+0000","last_undegraded":"2024-05-08T20:54:32.406976+0000","last_fullsized":"2024-05-08T20:54:32.406976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907633+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:54:21.907633+0000","last_peered":"2024-05-08T20:54:21.907633+0000","last_clean":"2024-05-08T20:54:21.907633+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:21.907633+0000","last_undegraded":"2024-05-08T20:54:21.907633+0000","last_fullsized":"2024-05-08T20:54:21.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370459+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:32.370459+0000","last_peered":"2024-05-08T20:54:32.370459+0000","last_clean":"2024-05-08T20:54:32.370459+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:32.370459+0000","last_undegraded":"2024-05-08T20:54:32.370459+0000","last_fullsized":"2024-05-08T20:54:32.370459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750487+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:54:21.750487+0000","last_peered":"2024-05-08T20:54:21.750487+0000","last_clean":"2024-05-08T20:54:21.750487+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:54:21.750487+0000","last_undegraded":"2024-05-08T20:54:21.750487+0000","last_fullsized":"2024-05-08T20:54:21.750487+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447520+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.447520+0000","last_peered":"2024-05-08T20:54:32.447520+0000","last_clean":"2024-05-08T20:54:32.447520+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.447520+0000","last_undegraded":"2024-05-08T20:54:32.447520+0000","last_fullsized":"2024-05-08T20:54:32.447520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824316+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824316+0000","last_peered":"2024-05-08T20:54:21.824316+0000","last_clean":"2024-05-08T20:54:21.824316+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824316+0000","last_undegraded":"2024-05-08T20:54:21.824316+0000","last_fullsized":"2024-05-08T20:54:21.824316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6030,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339757+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:54:32.339757+0000","last_peered":"2024-05-08T20:54:32.339757+0000","last_clean":"2024-05-08T20:54:32.339757+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:54:32.339757+0000","last_undegraded":"2024-05-08T20:54:32.339757+0000","last_fullsized":"2024-05-08T20:54:32.339757+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862354+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:54:21.862354+0000","last_peered":"2024-05-08T20:54:21.862354+0000","last_clean":"2024-05-08T20:54:21.862354+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:54:21.862354+0000","last_undegraded":"2024-05-08T20:54:21.862354+0000","last_fullsized":"2024-05-08T20:54:21.862354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345142+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:54:32.345142+0000","last_peered":"2024-05-08T20:54:32.345142+0000","last_clean":"2024-05-08T20:54:32.345142+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:54:32.345142+0000","last_undegraded":"2024-05-08T20:54:32.345142+0000","last_fullsized":"2024-05-08T20:54:32.345142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873770+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.873770+0000","last_peered":"2024-05-08T20:54:21.873770+0000","last_clean":"2024-05-08T20:54:21.873770+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.873770+0000","last_undegraded":"2024-05-08T20:54:21.873770+0000","last_fullsized":"2024-05-08T20:54:21.873770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404985+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:32.404985+0000","last_peered":"2024-05-08T20:54:32.404985+0000","last_clean":"2024-05-08T20:54:32.404985+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:32.404985+0000","last_undegraded":"2024-05-08T20:54:32.404985+0000","last_fullsized":"2024-05-08T20:54:32.404985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.794395+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:21.794395+0000","last_peered":"2024-05-08T20:54:21.794395+0000","last_clean":"2024-05-08T20:54:21.794395+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:21.794395+0000","last_undegraded":"2024-05-08T20:54:21.794395+0000","last_fullsized":"2024-05-08T20:54:21.794395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:31.832985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406667+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:32.406667+0000","last_peered":"2024-05-08T20:54:32.406667+0000","last_clean":"2024-05-08T20:54:32.406667+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:32.406667+0000","last_undegraded":"2024-05-08T20:54:32.406667+0000","last_fullsized":"2024-05-08T20:54:32.406667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842224+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:54:21.842224+0000","last_peered":"2024-05-08T20:54:21.842224+0000","last_clean":"2024-05-08T20:54:21.842224+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:54:21.842224+0000","last_undegraded":"2024-05-08T20:54:21.842224+0000","last_fullsized":"2024-05-08T20:54:21.842224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.427047+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:32.427047+0000","last_peered":"2024-05-08T20:54:32.427047+0000","last_clean":"2024-05-08T20:54:32.427047+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:32.427047+0000","last_undegraded":"2024-05-08T20:54:32.427047+0000","last_fullsized":"2024-05-08T20:54:32.427047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6035,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.839762+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:54:21.839762+0000","last_peered":"2024-05-08T20:54:21.839762+0000","last_clean":"2024-05-08T20:54:21.839762+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:54:21.839762+0000","last_undegraded":"2024-05-08T20:54:21.839762+0000","last_fullsized":"2024-05-08T20:54:21.839762+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.320278+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.320278+0000","last_peered":"2024-05-08T20:54:32.320278+0000","last_clean":"2024-05-08T20:54:32.320278+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.320278+0000","last_undegraded":"2024-05-08T20:54:32.320278+0000","last_fullsized":"2024-05-08T20:54:32.320278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.796071+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:54:21.796071+0000","last_peered":"2024-05-08T20:54:21.796071+0000","last_clean":"2024-05-08T20:54:21.796071+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:21.796071+0000","last_undegraded":"2024-05-08T20:54:21.796071+0000","last_fullsized":"2024-05-08T20:54:21.796071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.315251+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:54:32.315251+0000","last_peered":"2024-05-08T20:54:32.315251+0000","last_clean":"2024-05-08T20:54:32.315251+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:54:32.315251+0000","last_undegraded":"2024-05-08T20:54:32.315251+0000","last_fullsized":"2024-05-08T20:54:32.315251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873440+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:54:21.873440+0000","last_peered":"2024-05-08T20:54:21.873440+0000","last_clean":"2024-05-08T20:54:21.873440+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:54:21.873440+0000","last_undegraded":"2024-05-08T20:54:21.873440+0000","last_fullsized":"2024-05-08T20:54:21.873440+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4672,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.419364+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.419364+0000","last_peered":"2024-05-08T20:54:32.419364+0000","last_clean":"2024-05-08T20:54:32.419364+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.419364+0000","last_undegraded":"2024-05-08T20:54:32.419364+0000","last_fullsized":"2024-05-08T20:54:32.419364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.827140+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:54:21.827140+0000","last_peered":"2024-05-08T20:54:21.827140+0000","last_clean":"2024-05-08T20:54:21.827140+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:21.827140+0000","last_undegraded":"2024-05-08T20:54:21.827140+0000","last_fullsized":"2024-05-08T20:54:21.827140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415141+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415141+0000","last_peered":"2024-05-08T20:54:32.415141+0000","last_clean":"2024-05-08T20:54:32.415141+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415141+0000","last_undegraded":"2024-05-08T20:54:32.415141+0000","last_fullsized":"2024-05-08T20:54:32.415141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4629,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862710+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:54:21.862710+0000","last_peered":"2024-05-08T20:54:21.862710+0000","last_clean":"2024-05-08T20:54:21.862710+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:21.862710+0000","last_undegraded":"2024-05-08T20:54:21.862710+0000","last_fullsized":"2024-05-08T20:54:21.862710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.342985+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.342985+0000","last_peered":"2024-05-08T20:54:32.342985+0000","last_clean":"2024-05-08T20:54:32.342985+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.342985+0000","last_undegraded":"2024-05-08T20:54:32.342985+0000","last_fullsized":"2024-05-08T20:54:32.342985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.745730+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:54:21.745730+0000","last_peered":"2024-05-08T20:54:21.745730+0000","last_clean":"2024-05-08T20:54:21.745730+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:21.745730+0000","last_undegraded":"2024-05-08T20:54:21.745730+0000","last_fullsized":"2024-05-08T20:54:21.745730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382399+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.382399+0000","last_peered":"2024-05-08T20:54:32.382399+0000","last_clean":"2024-05-08T20:54:32.382399+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.382399+0000","last_undegraded":"2024-05-08T20:54:32.382399+0000","last_fullsized":"2024-05-08T20:54:32.382399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.772331+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:54:21.772331+0000","last_peered":"2024-05-08T20:54:21.772331+0000","last_clean":"2024-05-08T20:54:21.772331+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:54:21.772331+0000","last_undegraded":"2024-05-08T20:54:21.772331+0000","last_fullsized":"2024-05-08T20:54:21.772331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.354339+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.354339+0000","last_peered":"2024-05-08T20:54:32.354339+0000","last_clean":"2024-05-08T20:54:32.354339+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.354339+0000","last_undegraded":"2024-05-08T20:54:32.354339+0000","last_fullsized":"2024-05-08T20:54:32.354339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863383+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:54:21.863383+0000","last_peered":"2024-05-08T20:54:21.863383+0000","last_clean":"2024-05-08T20:54:21.863383+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:54:21.863383+0000","last_undegraded":"2024-05-08T20:54:21.863383+0000","last_fullsized":"2024-05-08T20:54:21.863383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340542+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:54:32.340542+0000","last_peered":"2024-05-08T20:54:32.340542+0000","last_clean":"2024-05-08T20:54:32.340542+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:54:32.340542+0000","last_undegraded":"2024-05-08T20:54:32.340542+0000","last_fullsized":"2024-05-08T20:54:32.340542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.808590+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:54:21.808590+0000","last_peered":"2024-05-08T20:54:21.808590+0000","last_clean":"2024-05-08T20:54:21.808590+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:21.808590+0000","last_undegraded":"2024-05-08T20:54:21.808590+0000","last_fullsized":"2024-05-08T20:54:21.808590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.391513+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:54:32.391513+0000","last_peered":"2024-05-08T20:54:32.391513+0000","last_clean":"2024-05-08T20:54:32.391513+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:54:32.391513+0000","last_undegraded":"2024-05-08T20:54:32.391513+0000","last_fullsized":"2024-05-08T20:54:32.391513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.904783+0000","last_change":"2024-05-08T20:28:00.413131+0000","last_active":"2024-05-08T20:54:21.904783+0000","last_peered":"2024-05-08T20:54:21.904783+0000","last_clean":"2024-05-08T20:54:21.904783+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:21.904783+0000","last_undegraded":"2024-05-08T20:54:21.904783+0000","last_fullsized":"2024-05-08T20:54:21.904783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:24.920403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.295323+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:54:32.295323+0000","last_peered":"2024-05-08T20:54:32.295323+0000","last_clean":"2024-05-08T20:54:32.295323+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:54:32.295323+0000","last_undegraded":"2024-05-08T20:54:32.295323+0000","last_fullsized":"2024-05-08T20:54:32.295323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6669,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907477+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:54:21.907477+0000","last_peered":"2024-05-08T20:54:21.907477+0000","last_clean":"2024-05-08T20:54:21.907477+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:54:21.907477+0000","last_undegraded":"2024-05-08T20:54:21.907477+0000","last_fullsized":"2024-05-08T20:54:21.907477+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.435277+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:32.435277+0000","last_peered":"2024-05-08T20:54:32.435277+0000","last_clean":"2024-05-08T20:54:32.435277+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:32.435277+0000","last_undegraded":"2024-05-08T20:54:32.435277+0000","last_fullsized":"2024-05-08T20:54:32.435277+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.826447+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.826447+0000","last_peered":"2024-05-08T20:54:21.826447+0000","last_clean":"2024-05-08T20:54:21.826447+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.826447+0000","last_undegraded":"2024-05-08T20:54:21.826447+0000","last_fullsized":"2024-05-08T20:54:21.826447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:22.668993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.374228+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:32.374228+0000","last_peered":"2024-05-08T20:54:32.374228+0000","last_clean":"2024-05-08T20:54:32.374228+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:32.374228+0000","last_undegraded":"2024-05-08T20:54:32.374228+0000","last_fullsized":"2024-05-08T20:54:32.374228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.742400+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:54:21.742400+0000","last_peered":"2024-05-08T20:54:21.742400+0000","last_clean":"2024-05-08T20:54:21.742400+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:54:21.742400+0000","last_undegraded":"2024-05-08T20:54:21.742400+0000","last_fullsized":"2024-05-08T20:54:21.742400+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3818,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385550+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385550+0000","last_peered":"2024-05-08T20:54:32.385550+0000","last_clean":"2024-05-08T20:54:32.385550+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385550+0000","last_undegraded":"2024-05-08T20:54:32.385550+0000","last_fullsized":"2024-05-08T20:54:32.385550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4562,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873313+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:54:21.873313+0000","last_peered":"2024-05-08T20:54:21.873313+0000","last_clean":"2024-05-08T20:54:21.873313+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:54:21.873313+0000","last_undegraded":"2024-05-08T20:54:21.873313+0000","last_fullsized":"2024-05-08T20:54:21.873313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.381776+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.381776+0000","last_peered":"2024-05-08T20:54:32.381776+0000","last_clean":"2024-05-08T20:54:32.381776+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.381776+0000","last_undegraded":"2024-05-08T20:54:32.381776+0000","last_fullsized":"2024-05-08T20:54:32.381776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867693+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:54:21.867693+0000","last_peered":"2024-05-08T20:54:21.867693+0000","last_clean":"2024-05-08T20:54:21.867693+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:54:21.867693+0000","last_undegraded":"2024-05-08T20:54:21.867693+0000","last_fullsized":"2024-05-08T20:54:21.867693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3762,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.353091+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:32.353091+0000","last_peered":"2024-05-08T20:54:32.353091+0000","last_clean":"2024-05-08T20:54:32.353091+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:32.353091+0000","last_undegraded":"2024-05-08T20:54:32.353091+0000","last_fullsized":"2024-05-08T20:54:32.353091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.774789+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:54:21.774789+0000","last_peered":"2024-05-08T20:54:21.774789+0000","last_clean":"2024-05-08T20:54:21.774789+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:21.774789+0000","last_undegraded":"2024-05-08T20:54:21.774789+0000","last_fullsized":"2024-05-08T20:54:21.774789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.350259+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:54:32.350259+0000","last_peered":"2024-05-08T20:54:32.350259+0000","last_clean":"2024-05-08T20:54:32.350259+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:54:32.350259+0000","last_undegraded":"2024-05-08T20:54:32.350259+0000","last_fullsized":"2024-05-08T20:54:32.350259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5667,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.765347+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:54:21.765347+0000","last_peered":"2024-05-08T20:54:21.765347+0000","last_clean":"2024-05-08T20:54:21.765347+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:54:21.765347+0000","last_undegraded":"2024-05-08T20:54:21.765347+0000","last_fullsized":"2024-05-08T20:54:21.765347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.380157+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:32.380157+0000","last_peered":"2024-05-08T20:54:32.380157+0000","last_clean":"2024-05-08T20:54:32.380157+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:32.380157+0000","last_undegraded":"2024-05-08T20:54:32.380157+0000","last_fullsized":"2024-05-08T20:54:32.380157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.754082+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:54:21.754082+0000","last_peered":"2024-05-08T20:54:21.754082+0000","last_clean":"2024-05-08T20:54:21.754082+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:21.754082+0000","last_undegraded":"2024-05-08T20:54:21.754082+0000","last_fullsized":"2024-05-08T20:54:21.754082+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.346308+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:54:32.346308+0000","last_peered":"2024-05-08T20:54:32.346308+0000","last_clean":"2024-05-08T20:54:32.346308+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:54:32.346308+0000","last_undegraded":"2024-05-08T20:54:32.346308+0000","last_fullsized":"2024-05-08T20:54:32.346308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.900494+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:54:21.900494+0000","last_peered":"2024-05-08T20:54:21.900494+0000","last_clean":"2024-05-08T20:54:21.900494+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:21.900494+0000","last_undegraded":"2024-05-08T20:54:21.900494+0000","last_fullsized":"2024-05-08T20:54:21.900494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3539,"ondisk_log_size":3539,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575183,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":3.4089999999999998,"15min":1.579},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":4.5750000000000002,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.9650000000000001,"15min":1.1859999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":3.7829999999999999,"5min":34.091000000000001,"15min":34.091000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.732,"15min":1.077},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.4249999999999998,"5min":13.579000000000001,"15min":13.579000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.736,"15min":1.153},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":7.4699999999999998,"5min":13.467000000000001,"15min":13.467000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.9199999999999999,"15min":1.147},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":4.585,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.3620000000000001,"5min":2.069,"15min":1.288},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":4.5570000000000004,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.077}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.663,"15min":1.1100000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2589999999999999,"5min":15.532,"15min":15.532},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.2879999999999998,"15min":1.397},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.5,"5min":16.584,"15min":16.584},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.4950000000000001,"15min":1.732},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.214},"max":{"1min":6.4630000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.2389999999999999,"15min":1.361},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":4.617,"5min":22.741,"15min":22.741},"last":0.996}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":4.0570000000000004,"15min":1.9810000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":5.8380000000000001,"5min":33.679000000000002,"15min":33.679000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.522,"5min":2.5019999999999998,"15min":1.506},"min":{"1min":0.41999999999999998,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":4.5700000000000003,"5min":20.869,"15min":20.869},"last":1.123}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7050000000000001,"15min":1.2669999999999999},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.157,"5min":13.714,"15min":13.714},"last":1.165},{"interface":"front","average":{"1min":1.6539999999999999,"5min":2.2090000000000001,"15min":1.3480000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":6.2519999999999998,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.97399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575181,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.5369999999999999,"15min":0.99099999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":4.657,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":1.25},{"interface":"front","average":{"1min":1.556,"5min":1.726,"15min":1.181},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.2960000000000003,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":1.073}]},{"osd":1,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.9330000000000001,"15min":1.1830000000000001},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":2.5270000000000001,"5min":14.717000000000001,"15min":14.717000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.71,"15min":1.0900000000000001},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":7.3810000000000002,"5min":14.404,"15min":14.404},"last":0.84299999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.603,"15min":1.095},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":3.5310000000000001,"5min":9.907,"15min":9.907},"last":1.036},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4530000000000001,"15min":1.093},"min":{"1min":0.41899999999999998,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":3.694,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":2.0630000000000002,"15min":1.3089999999999999},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":4.3780000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.159},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.714,"15min":1.198},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":4.6280000000000001,"5min":8.2940000000000005,"15min":8.2940000000000005},"last":1.3779999999999999}]},{"osd":4,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":2.9340000000000002,"15min":1.552},"min":{"1min":0.39100000000000001,"5min":0.28699999999999998,"15min":0.223},"max":{"1min":4.4450000000000003,"5min":30.094000000000001,"15min":30.094000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":2.4620000000000002,"15min":1.4410000000000001},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":4.415,"5min":29.538,"15min":29.538},"last":1.476}]},{"osd":5,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.98,"15min":1.206},"min":{"1min":0.47999999999999998,"5min":0.28499999999999998,"15min":0.25},"max":{"1min":3.7589999999999999,"5min":11.568,"15min":11.568},"last":1.218},{"interface":"front","average":{"1min":1.5660000000000001,"5min":2.0369999999999999,"15min":1.329},"min":{"1min":0.52500000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"max":{"1min":3.806,"5min":11.593999999999999,"15min":11.593999999999999},"last":1.411}]},{"osd":7,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":2.1600000000000001,"15min":1.2769999999999999},"min":{"1min":0.317,"5min":0.188,"15min":0.188},"max":{"1min":4.2430000000000003,"5min":12.77,"15min":12.77},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.532,"5min":2.0449999999999999,"15min":1.2909999999999999},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":6.2880000000000003,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.343}]}]},{"osd":5,"up_from":13,"seq":55834575182,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.6799999999999999,"15min":1.056},"min":{"1min":0.25600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.4550000000000001,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.357,"15min":1.0029999999999999},"min":{"1min":0.33500000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7799999999999998,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":5.3259999999999996,"15min":2.298},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.20799999999999999},"max":{"1min":5.3019999999999996,"5min":121.521,"15min":121.521},"last":1.01},{"interface":"front","average":{"1min":1.139,"5min":1.9159999999999999,"15min":1.2030000000000001},"min":{"1min":0.28399999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.9409999999999998,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.96299999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.9630000000000001,"15min":1.206},"min":{"1min":0.25,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":5.2569999999999997,"5min":16.535,"15min":16.535},"last":1.228},{"interface":"front","average":{"1min":1.028,"5min":1.7410000000000001,"15min":1.1379999999999999},"min":{"1min":0.32400000000000001,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":2.9590000000000001,"5min":15.006,"15min":15.006},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.6790000000000003,"15min":2.4950000000000001},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":5.2830000000000004,"5min":121.498,"15min":121.498},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.849,"15min":1.256},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.0549999999999997,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.1200000000000001}]},{"osd":4,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":5.202,"15min":2.3149999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.3209999999999997,"5min":121.464,"15min":121.464},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.613,"5min":1.746,"15min":1.1870000000000001},"min":{"1min":0.35999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2329999999999997,"5min":8.2710000000000008,"15min":8.2710000000000008},"last":1.1639999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.0790000000000002,"15min":1.3120000000000001},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0910000000000002,"5min":15.048,"15min":15.048},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.6970000000000001,"15min":1.212},"min":{"1min":0.38100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":5.3360000000000003,"5min":11.56,"15min":11.56},"last":1.294}]},{"osd":7,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":3.915,"15min":1.9730000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":2.8370000000000002,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.355},{"interface":"front","average":{"1min":1.216,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.436,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.1429999999999998,"5min":12.679,"15min":12.679},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575182,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":2.1960000000000002,"15min":1.252},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":10.419,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.026},{"interface":"front","average":{"1min":1.345,"5min":1.901,"15min":1.1839999999999999},"min":{"1min":0.34699999999999998,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.505000000000001,"5min":16.119,"15min":16.119},"last":1.143}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":2.6309999999999998,"15min":1.4219999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.977,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.593,"15min":1.077},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9969999999999999,"5min":16.904,"15min":16.904},"last":0.78400000000000003}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":2.6890000000000001,"15min":1.478},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":11.013999999999999,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3200000000000001,"15min":0.99199999999999999},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":4.024,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":2.6030000000000002,"15min":1.5229999999999999},"min":{"1min":0.33700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.471,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":2.54,"15min":1.5009999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":3.1989999999999998,"5min":29.526,"15min":29.526},"last":1.101}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":2.6779999999999999,"15min":1.4670000000000001},"min":{"1min":0.32500000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":10.808,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.756,"5min":1.782,"15min":1.177},"min":{"1min":0.41099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6699999999999999,"5min":14.863,"15min":14.863},"last":1.2210000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":2.1120000000000001,"15min":1.327},"min":{"1min":0.38700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.554,"5min":33.198,"15min":33.198},"last":1.294},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.0939999999999999,"15min":1.379},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.308},"max":{"1min":10.528,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.3420000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":3.5920000000000001,"15min":1.8440000000000001},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.9980000000000002,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.762,"5min":3.7669999999999999,"15min":1.9490000000000001},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.37},"max":{"1min":6.0309999999999997,"5min":54.113,"15min":54.113},"last":1.2629999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575181,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.603,"15min":0.95299999999999996},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":2.6429999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":1.6699999999999999,"15min":1.095},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.9980000000000002,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Wed May 8 20:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":1.6799999999999999,"15min":1.0269999999999999},"min":{"1min":0.215,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7330000000000001,"5min":16.355,"15min":16.355},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.0800000000000001,"15min":0.86599999999999999},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.706,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.86899999999999999}]},{"osd":2,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.345,"15min":0.89500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":3.1059999999999999,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1,"15min":0.83499999999999996},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.95799999999999996,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":1.008}]},{"osd":4,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.5700000000000001,"15min":1.075},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.0259999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.4059999999999999,"15min":1.03},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.0720000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":1.0609999999999999}]},{"osd":5,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":3.911,"15min":1.9179999999999999},"min":{"1min":0.373,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3300000000000001,"5min":117.105,"15min":117.105},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.706,"5min":1.7190000000000001,"15min":1.1559999999999999},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":6.3179999999999996,"5min":14.394,"15min":14.394},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":2.1579999999999999,"15min":1.331},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.5979999999999999,"5min":16.113,"15min":16.113},"last":1.042},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.7669999999999999,"15min":1.216},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":5.0730000000000004,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.242}]},{"osd":7,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":2.0659999999999998,"15min":1.345},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.6749999999999998,"5min":16.977,"15min":16.977},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.903,"15min":1.306},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":3.669,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.107}]}]},{"osd":2,"up_from":13,"seq":55834575179,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":1.206,"15min":0.84199999999999997},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.84099999999999997,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.46100000000000002,"5min":1.1970000000000001,"15min":0.91100000000000003},"min":{"1min":0.22500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":2.9449999999999998,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":1.0580000000000001,"15min":0.76800000000000002},"min":{"1min":0.188,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.0609999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.623},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.92200000000000004,"15min":0.76200000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.6459999999999999,"5min":6.7009999999999996,"15min":6.7009999999999996},"last":0.75700000000000001}]},{"osd":3,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.3440000000000001,"15min":0.93100000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":3.1259999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.1830000000000001,"15min":0.93100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.0939999999999999,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":0.95099999999999996}]},{"osd":4,"last update":"Wed May 8 20:54:04 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":2.0379999999999998,"15min":1.234},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":10.257,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.8640000000000001,"15min":1.2350000000000001},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.6509999999999998,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":2.1509999999999998,"15min":1.319},"min":{"1min":0.31,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":5.6340000000000003,"5min":22.489000000000001,"15min":22.489000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.7969999999999999,"15min":1.238},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.9610000000000003,"5min":14.968999999999999,"15min":14.968999999999999},"last":1.075}]},{"osd":6,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.702,"15min":1.1739999999999999},"min":{"1min":0.34899999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.4460000000000002,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":1.052},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.6080000000000001,"15min":1.157},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":6.5039999999999996,"5min":12.553000000000001,"15min":12.553000000000001},"last":0.997}]},{"osd":7,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.141,"15min":1.405},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":13.663,"5min":13.663,"15min":13.663},"last":1.095},{"interface":"front","average":{"1min":1.526,"5min":2.5430000000000001,"15min":1.494},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.6970000000000001,"5min":19.201000000000001,"15min":19.201000000000001},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575180,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.0900000000000001,"15min":0.77400000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.044,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.44,"5min":1.4350000000000001,"15min":0.92900000000000005},"min":{"1min":0.20899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.149,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.4330000000000001,"15min":0.88700000000000001},"min":{"1min":0.20000000000000001,"5min":0.192,"15min":0.188},"max":{"1min":3.2149999999999999,"5min":13.961,"15min":13.961},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.435,"5min":1.1479999999999999,"15min":0.84899999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.5009999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":2.8140000000000001,"15min":1.45},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":3.1819999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":2.0600000000000001,"15min":1.2170000000000001},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":3.0710000000000002,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.8220000000000001,"15min":1.139},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.2490000000000001,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.357,"15min":1.0349999999999999},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.097,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":3.7799999999999998,"15min":1.863},"min":{"1min":0.33500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.0090000000000003,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.877},{"interface":"front","average":{"1min":1.403,"5min":2.0609999999999999,"15min":1.3049999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.2439999999999998,"5min":23.742000000000001,"15min":23.742000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":1.855,"15min":1.226},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":5.069,"5min":14.032,"15min":14.032},"last":1.121},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.47,"15min":1.133},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":4.8540000000000001,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.016}]},{"osd":7,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":3.0099999999999998,"15min":1.6679999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.2060000000000004,"5min":26.881,"15min":26.881},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.917,"15min":1.321},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.5060000000000002,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.1000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575180,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.89900000000000002,"15min":0.70099999999999996},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.98999999999999999,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.748,"5min":1.2290000000000001,"15min":0.83999999999999997},"min":{"1min":0.17499999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.2589999999999999,"5min":13.305,"15min":13.305},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.1850000000000001,"15min":0.82399999999999995},"min":{"1min":0.20699999999999999,"5min":0.20300000000000001,"15min":0.19700000000000001},"max":{"1min":3.0859999999999999,"5min":15.212,"15min":15.212},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.1100000000000001,"15min":0.82599999999999996},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":2.8660000000000001,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.0609999999999999,"15min":0.873},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":2.8980000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.115,"15min":0.95999999999999996},"min":{"1min":0.33400000000000002,"5min":0.30299999999999999,"15min":0.26300000000000001},"max":{"1min":2.9239999999999999,"5min":6.758,"15min":6.758},"last":0.63100000000000001}]},{"osd":4,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.613,"15min":1.1040000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.242,"5min":18.407,"15min":18.407},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.6180000000000001,"15min":1.085},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.3240000000000001,"5min":18.466999999999999,"15min":18.466999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.246,"15min":1.3049999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":3.048,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.8220000000000001,"15min":1.1830000000000001},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.1840000000000002,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.103}]},{"osd":6,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.496,"15min":1.0960000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.0860000000000003,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.5609999999999999,"15min":1.123},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":3.6030000000000002,"5min":11.597,"15min":11.597},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":2.3340000000000001,"15min":1.4059999999999999},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5259999999999998,"5min":18.748999999999999,"15min":18.748999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.232,"5min":2.3660000000000001,"15min":1.4930000000000001},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.5590000000000002,"5min":18.788,"15min":18.788},"last":1.0229999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:54:39.628 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T20:54:39.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:54:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.753+0000 7fc0b17b3640 1 Processor -- start 2024-05-08T20:54:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.753+0000 7fc0b17b3640 1 -- start start 2024-05-08T20:54:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 0x7fc0ac155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0ac155690 0x7fc0ac0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac1522e0 con 0x7fc0ac151f00 2024-05-08T20:54:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac06bb20 con 0x7fc0ac155690 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac1548e0 con 0x7fc0ac154cf0 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0ac155690 0x7fc0ac0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0ac155690 0x7fc0ac0ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57006/0 (socket says 172.21.15.81:57006) 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 -- 172.21.15.81:0/2366596047 learned_addr learned my addr 172.21.15.81:0/2366596047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0a3fff640 1 --2- 172.21.15.81:0/2366596047 >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 0x7fc0ac155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 -- 172.21.15.81:0/2366596047 >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 msgr2=0x7fc0ac155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 --2- 172.21.15.81:0/2366596047 >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 0x7fc0ac155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 -- 172.21.15.81:0/2366596047 >> v1:172.21.15.117:6789/0 conn(0x7fc0ac151f00 legacy=0x7fc0ac1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 -- 172.21.15.81:0/2366596047 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac0c5f80 con 0x7fc0ac155690 2024-05-08T20:54:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0a3fff640 1 --2- 172.21.15.81:0/2366596047 >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 0x7fc0ac155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0ab7fe640 1 --2- 172.21.15.81:0/2366596047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac155690 0x7fc0ac0ca000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac08c580 tx=0x7fc0a401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a76b544e7f30d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0aa7fc640 1 -- 172.21.15.81:0/2366596047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40a56f0 con 0x7fc0ac155690 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0aa7fc640 1 -- 172.21.15.81:0/2366596047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a40a5850 con 0x7fc0ac155690 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0aa7fc640 1 -- 172.21.15.81:0/2366596047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40a5be0 con 0x7fc0ac155690 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- 172.21.15.81:0/2366596047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac155690 msgr2=0x7fc0ac0ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/2366596047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac155690 0x7fc0ac0ca000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac08c580 tx=0x7fc0a401c890 comp rx=0 tx=0).stop 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- 172.21.15.81:0/2366596047 shutdown_connections 2024-05-08T20:54:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/2366596047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac155690 0x7fc0ac0ca000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/2366596047 >> v2:172.21.15.117:3300/0 conn(0x7fc0ac154cf0 0x7fc0ac155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.757+0000 7fc0b17b3640 1 -- 172.21.15.81:0/2366596047 >> 172.21.15.81:0/2366596047 conn(0x7fc0ac0715f0 msgr2=0x7fc0ac071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- 172.21.15.81:0/2366596047 shutdown_connections 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- 172.21.15.81:0/2366596047 wait complete. 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 Processor -- start 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- start start 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac154cf0 0x7fc0ac0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac14dd70 0x7fc0ac0ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac157410 con 0x7fc0ac151f00 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac14a540 con 0x7fc0ac154cf0 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0adc50 con 0x7fc0ac14dd70 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57010/0 (socket says 172.21.15.81:57010) 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 -- 172.21.15.81:0/43921385 learned_addr learned my addr 172.21.15.81:0/43921385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0ab7fe640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac14dd70 0x7fc0ac0ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0a3fff640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac154cf0 0x7fc0ac0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 -- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac14dd70 msgr2=0x7fc0ac0ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac14dd70 0x7fc0ac0ae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 -- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac154cf0 msgr2=0x7fc0ac0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac154cf0 0x7fc0ac0ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 -- 172.21.15.81:0/43921385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009b30 con 0x7fc0ac151f00 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0aaffd640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00b410 tx=0x7fc09c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c004020 con 0x7fc0ac151f00 2024-05-08T20:54:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c004180 con 0x7fc0ac151f00 2024-05-08T20:54:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac0ad340 con 0x7fc0ac151f00 2024-05-08T20:54:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c011630 con 0x7fc0ac151f00 2024-05-08T20:54:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac0ad600 con 0x7fc0ac151f00 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.761+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac074950 con 0x7fc0ac151f00 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.765+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc09c011790 con 0x7fc0ac151f00 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.765+0000 7fc0a37fe640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 0x7fc08c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.765+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc09c084200 con 0x7fc0ac151f00 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.765+0000 7fc0a3fff640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 0x7fc08c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.765+0000 7fc0a3fff640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 0x7fc08c068b50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc094006fd0 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:39.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.769+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc09c051260 con 0x7fc0ac151f00 2024-05-08T20:54:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.925+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0ac073af0 con 0x7fc08c066690 2024-05-08T20:54:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.945+0000 7fc0a37fe640 1 -- 172.21.15.81:0/43921385 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528800 (secure 0 0 0) 0x7fc0ac073af0 con 0x7fc08c066690 2024-05-08T20:54:39.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:39.959 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 msgr2=0x7fc08c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 0x7fc08c068b50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc094006fd0 tx=0x7fc094008040 comp rx=0 tx=0).stop 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 msgr2=0x7fc0ac156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00b410 tx=0x7fc09c00b8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 shutdown_connections 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc08c066690 0x7fc08c068b50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0ac14dd70 0x7fc0ac0ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0ac154cf0 0x7fc0ac0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 --2- 172.21.15.81:0/43921385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ac151f00 0x7fc0ac156570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:39.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 >> 172.21.15.81:0/43921385 conn(0x7fc0ac0715f0 msgr2=0x7fc0ac0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:39.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 shutdown_connections 2024-05-08T20:54:39.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:39.953+0000 7fc0b17b3640 1 -- 172.21.15.81:0/43921385 wait complete. 2024-05-08T20:54:39.973 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":845,"stamp":"2024-05-08T20:54:39.890652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622869,"ondisk_log_size":622869,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005195"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408085+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408085+0000","last_peered":"2024-05-08T20:54:32.408085+0000","last_clean":"2024-05-08T20:54:32.408085+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408085+0000","last_undegraded":"2024-05-08T20:54:32.408085+0000","last_fullsized":"2024-05-08T20:54:32.408085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'764","reported_seq":794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.326300+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:52:23.326300+0000","last_peered":"2024-05-08T20:52:23.326300+0000","last_clean":"2024-05-08T20:52:23.326300+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:52:23.326300+0000","last_undegraded":"2024-05-08T20:52:23.326300+0000","last_fullsized":"2024-05-08T20:52:23.326300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:57.879284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5343,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.760841+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:21.760841+0000","last_peered":"2024-05-08T20:54:21.760841+0000","last_clean":"2024-05-08T20:54:21.760841+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:21.760841+0000","last_undegraded":"2024-05-08T20:54:21.760841+0000","last_fullsized":"2024-05-08T20:54:21.760841+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:01.532607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972492+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:54:12.972492+0000","last_peered":"2024-05-08T20:54:12.972492+0000","last_clean":"2024-05-08T20:54:12.972492+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:12.972492+0000","last_undegraded":"2024-05-08T20:54:12.972492+0000","last_fullsized":"2024-05-08T20:54:12.972492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:07.665842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345231+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:32.345231+0000","last_peered":"2024-05-08T20:54:32.345231+0000","last_clean":"2024-05-08T20:54:32.345231+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:32.345231+0000","last_undegraded":"2024-05-08T20:54:32.345231+0000","last_fullsized":"2024-05-08T20:54:32.345231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.935002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.484572+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:52:16.484572+0000","last_peered":"2024-05-08T20:52:16.484572+0000","last_clean":"2024-05-08T20:52:16.484572+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:52:16.484572+0000","last_undegraded":"2024-05-08T20:52:16.484572+0000","last_fullsized":"2024-05-08T20:52:16.484572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:23.396114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.836075+0000","last_change":"2024-05-08T20:27:18.930217+0000","last_active":"2024-05-08T20:54:21.836075+0000","last_peered":"2024-05-08T20:54:21.836075+0000","last_clean":"2024-05-08T20:54:21.836075+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:21.836075+0000","last_undegraded":"2024-05-08T20:54:21.836075+0000","last_fullsized":"2024-05-08T20:54:21.836075+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:46.575224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:04.433355+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:54:04.433355+0000","last_peered":"2024-05-08T20:54:04.433355+0000","last_clean":"2024-05-08T20:54:04.433355+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:54:04.433355+0000","last_undegraded":"2024-05-08T20:54:04.433355+0000","last_fullsized":"2024-05-08T20:54:04.433355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3618,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385127+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:32.385127+0000","last_peered":"2024-05-08T20:54:32.385127+0000","last_clean":"2024-05-08T20:54:32.385127+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:32.385127+0000","last_undegraded":"2024-05-08T20:54:32.385127+0000","last_fullsized":"2024-05-08T20:54:32.385127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.097096+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:52:15.097096+0000","last_peered":"2024-05-08T20:52:15.097096+0000","last_clean":"2024-05-08T20:52:15.097096+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:52:15.097096+0000","last_undegraded":"2024-05-08T20:52:15.097096+0000","last_fullsized":"2024-05-08T20:52:15.097096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842236+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:54:21.842236+0000","last_peered":"2024-05-08T20:54:21.842236+0000","last_clean":"2024-05-08T20:54:21.842236+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:21.842236+0000","last_undegraded":"2024-05-08T20:54:21.842236+0000","last_fullsized":"2024-05-08T20:54:21.842236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'618","reported_seq":641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.975632+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:54:12.975632+0000","last_peered":"2024-05-08T20:54:12.975632+0000","last_clean":"2024-05-08T20:54:12.975632+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:12.975632+0000","last_undegraded":"2024-05-08T20:54:12.975632+0000","last_fullsized":"2024-05-08T20:54:12.975632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.321288+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:54:32.321288+0000","last_peered":"2024-05-08T20:54:32.321288+0000","last_clean":"2024-05-08T20:54:32.321288+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:54:32.321288+0000","last_undegraded":"2024-05-08T20:54:32.321288+0000","last_fullsized":"2024-05-08T20:54:32.321288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.593251+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:52:17.593251+0000","last_peered":"2024-05-08T20:52:17.593251+0000","last_clean":"2024-05-08T20:52:17.593251+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:52:17.593251+0000","last_undegraded":"2024-05-08T20:52:17.593251+0000","last_fullsized":"2024-05-08T20:52:17.593251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.899026+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:54:21.899026+0000","last_peered":"2024-05-08T20:54:21.899026+0000","last_clean":"2024-05-08T20:54:21.899026+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:21.899026+0000","last_undegraded":"2024-05-08T20:54:21.899026+0000","last_fullsized":"2024-05-08T20:54:21.899026+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.187731+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:54:32.187731+0000","last_peered":"2024-05-08T20:54:32.187731+0000","last_clean":"2024-05-08T20:54:32.187731+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:32.187731+0000","last_undegraded":"2024-05-08T20:54:32.187731+0000","last_fullsized":"2024-05-08T20:54:32.187731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385482+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:32.385482+0000","last_peered":"2024-05-08T20:54:32.385482+0000","last_clean":"2024-05-08T20:54:32.385482+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:32.385482+0000","last_undegraded":"2024-05-08T20:54:32.385482+0000","last_fullsized":"2024-05-08T20:54:32.385482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:40.359107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.790464+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:54:21.790464+0000","last_peered":"2024-05-08T20:54:21.790464+0000","last_clean":"2024-05-08T20:54:21.790464+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:54:21.790464+0000","last_undegraded":"2024-05-08T20:54:21.790464+0000","last_fullsized":"2024-05-08T20:54:21.790464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.606595+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:52:17.606595+0000","last_peered":"2024-05-08T20:52:17.606595+0000","last_clean":"2024-05-08T20:52:17.606595+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:52:17.606595+0000","last_undegraded":"2024-05-08T20:52:17.606595+0000","last_fullsized":"2024-05-08T20:52:17.606595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.997993+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:54:12.997993+0000","last_peered":"2024-05-08T20:54:12.997993+0000","last_clean":"2024-05-08T20:54:12.997993+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:12.997993+0000","last_undegraded":"2024-05-08T20:54:12.997993+0000","last_fullsized":"2024-05-08T20:54:12.997993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.720841+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:54:32.720841+0000","last_peered":"2024-05-08T20:54:32.720841+0000","last_clean":"2024-05-08T20:54:32.720841+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:54:32.720841+0000","last_undegraded":"2024-05-08T20:54:32.720841+0000","last_fullsized":"2024-05-08T20:54:32.720841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.544915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792716+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.792716+0000","last_peered":"2024-05-08T20:54:21.792716+0000","last_clean":"2024-05-08T20:54:21.792716+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.792716+0000","last_undegraded":"2024-05-08T20:54:21.792716+0000","last_fullsized":"2024-05-08T20:54:21.792716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:03.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489381+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:52:16.489381+0000","last_peered":"2024-05-08T20:52:16.489381+0000","last_clean":"2024-05-08T20:52:16.489381+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:52:16.489381+0000","last_undegraded":"2024-05-08T20:52:16.489381+0000","last_fullsized":"2024-05-08T20:52:16.489381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.993291+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:54:12.993291+0000","last_peered":"2024-05-08T20:54:12.993291+0000","last_clean":"2024-05-08T20:54:12.993291+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:12.993291+0000","last_undegraded":"2024-05-08T20:54:12.993291+0000","last_fullsized":"2024-05-08T20:54:12.993291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3463,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368057+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:32.368057+0000","last_peered":"2024-05-08T20:54:32.368057+0000","last_clean":"2024-05-08T20:54:32.368057+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:32.368057+0000","last_undegraded":"2024-05-08T20:54:32.368057+0000","last_fullsized":"2024-05-08T20:54:32.368057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793596+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793596+0000","last_peered":"2024-05-08T20:54:21.793596+0000","last_clean":"2024-05-08T20:54:21.793596+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793596+0000","last_undegraded":"2024-05-08T20:54:21.793596+0000","last_fullsized":"2024-05-08T20:54:21.793596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:11.905354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.078657+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:52:15.078657+0000","last_peered":"2024-05-08T20:52:15.078657+0000","last_clean":"2024-05-08T20:52:15.078657+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:52:15.078657+0000","last_undegraded":"2024-05-08T20:52:15.078657+0000","last_fullsized":"2024-05-08T20:52:15.078657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:44.136137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.986661+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:54:12.986661+0000","last_peered":"2024-05-08T20:54:12.986661+0000","last_clean":"2024-05-08T20:54:12.986661+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:12.986661+0000","last_undegraded":"2024-05-08T20:54:12.986661+0000","last_fullsized":"2024-05-08T20:54:12.986661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:46.845582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.392109+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:32.392109+0000","last_peered":"2024-05-08T20:54:32.392109+0000","last_clean":"2024-05-08T20:54:32.392109+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:32.392109+0000","last_undegraded":"2024-05-08T20:54:32.392109+0000","last_fullsized":"2024-05-08T20:54:32.392109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.759597+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:54:21.759597+0000","last_peered":"2024-05-08T20:54:21.759597+0000","last_clean":"2024-05-08T20:54:21.759597+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:54:21.759597+0000","last_undegraded":"2024-05-08T20:54:21.759597+0000","last_fullsized":"2024-05-08T20:54:21.759597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.076400+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:52:15.076400+0000","last_peered":"2024-05-08T20:52:15.076400+0000","last_clean":"2024-05-08T20:52:15.076400+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:52:15.076400+0000","last_undegraded":"2024-05-08T20:52:15.076400+0000","last_fullsized":"2024-05-08T20:52:15.076400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'7","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984726+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:54:12.984726+0000","last_peered":"2024-05-08T20:54:12.984726+0000","last_clean":"2024-05-08T20:54:12.984726+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:12.984726+0000","last_undegraded":"2024-05-08T20:54:12.984726+0000","last_fullsized":"2024-05-08T20:54:12.984726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404921+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:54:32.404921+0000","last_peered":"2024-05-08T20:54:32.404921+0000","last_clean":"2024-05-08T20:54:32.404921+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:54:32.404921+0000","last_undegraded":"2024-05-08T20:54:32.404921+0000","last_fullsized":"2024-05-08T20:54:32.404921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:22.871022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.752812+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:54:21.752812+0000","last_peered":"2024-05-08T20:54:21.752812+0000","last_clean":"2024-05-08T20:54:21.752812+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:21.752812+0000","last_undegraded":"2024-05-08T20:54:21.752812+0000","last_fullsized":"2024-05-08T20:54:21.752812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:13.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.519154+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:52:16.519154+0000","last_peered":"2024-05-08T20:52:16.519154+0000","last_clean":"2024-05-08T20:52:16.519154+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:52:16.519154+0000","last_undegraded":"2024-05-08T20:52:16.519154+0000","last_fullsized":"2024-05-08T20:52:16.519154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'64","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.210071+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:54:15.210071+0000","last_peered":"2024-05-08T20:54:15.210071+0000","last_clean":"2024-05-08T20:54:15.210071+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:54:15.210071+0000","last_undegraded":"2024-05-08T20:54:15.210071+0000","last_fullsized":"2024-05-08T20:54:15.210071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4005,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.360912+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:32.360912+0000","last_peered":"2024-05-08T20:54:32.360912+0000","last_clean":"2024-05-08T20:54:32.360912+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:32.360912+0000","last_undegraded":"2024-05-08T20:54:32.360912+0000","last_fullsized":"2024-05-08T20:54:32.360912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792266+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:54:21.792266+0000","last_peered":"2024-05-08T20:54:21.792266+0000","last_clean":"2024-05-08T20:54:21.792266+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:54:21.792266+0000","last_undegraded":"2024-05-08T20:54:21.792266+0000","last_fullsized":"2024-05-08T20:54:21.792266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:10.350115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'254","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.824742+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:54:12.824742+0000","last_peered":"2024-05-08T20:54:12.824742+0000","last_clean":"2024-05-08T20:54:12.824742+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:54:12.824742+0000","last_undegraded":"2024-05-08T20:54:12.824742+0000","last_fullsized":"2024-05-08T20:54:12.824742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:50.446717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.990396+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:54:12.990396+0000","last_peered":"2024-05-08T20:54:12.990396+0000","last_clean":"2024-05-08T20:54:12.990396+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:54:12.990396+0000","last_undegraded":"2024-05-08T20:54:12.990396+0000","last_fullsized":"2024-05-08T20:54:12.990396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:41:06.805048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.302535+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:32.302535+0000","last_peered":"2024-05-08T20:54:32.302535+0000","last_clean":"2024-05-08T20:54:32.302535+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:32.302535+0000","last_undegraded":"2024-05-08T20:54:32.302535+0000","last_fullsized":"2024-05-08T20:54:32.302535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.788170+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:54:21.788170+0000","last_peered":"2024-05-08T20:54:21.788170+0000","last_clean":"2024-05-08T20:54:21.788170+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:54:21.788170+0000","last_undegraded":"2024-05-08T20:54:21.788170+0000","last_fullsized":"2024-05-08T20:54:21.788170+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:04.436966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:30.539923+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:52:30.539923+0000","last_peered":"2024-05-08T20:52:30.539923+0000","last_clean":"2024-05-08T20:52:30.539923+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:52:30.539923+0000","last_undegraded":"2024-05-08T20:52:30.539923+0000","last_fullsized":"2024-05-08T20:52:30.539923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.971964+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:54:12.971964+0000","last_peered":"2024-05-08T20:54:12.971964+0000","last_clean":"2024-05-08T20:54:12.971964+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:54:12.971964+0000","last_undegraded":"2024-05-08T20:54:12.971964+0000","last_fullsized":"2024-05-08T20:54:12.971964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:35.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.434073+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:54:32.434073+0000","last_peered":"2024-05-08T20:54:32.434073+0000","last_clean":"2024-05-08T20:54:32.434073+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:54:32.434073+0000","last_undegraded":"2024-05-08T20:54:32.434073+0000","last_fullsized":"2024-05-08T20:54:32.434073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:11.520003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4651,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.898778+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:54:21.898778+0000","last_peered":"2024-05-08T20:54:21.898778+0000","last_clean":"2024-05-08T20:54:21.898778+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:21.898778+0000","last_undegraded":"2024-05-08T20:54:21.898778+0000","last_fullsized":"2024-05-08T20:54:21.898778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.130266+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:52:23.130266+0000","last_peered":"2024-05-08T20:52:23.130266+0000","last_clean":"2024-05-08T20:52:23.130266+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:52:23.130266+0000","last_undegraded":"2024-05-08T20:52:23.130266+0000","last_fullsized":"2024-05-08T20:52:23.130266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:39.601666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.634805+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:54:07.634805+0000","last_peered":"2024-05-08T20:54:07.634805+0000","last_clean":"2024-05-08T20:54:07.634805+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:07.634805+0000","last_undegraded":"2024-05-08T20:54:07.634805+0000","last_fullsized":"2024-05-08T20:54:07.634805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:31.293668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.364835+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:54:32.364835+0000","last_peered":"2024-05-08T20:54:32.364835+0000","last_clean":"2024-05-08T20:54:32.364835+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:54:32.364835+0000","last_undegraded":"2024-05-08T20:54:32.364835+0000","last_fullsized":"2024-05-08T20:54:32.364835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:26.455114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5908,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.814282+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:54:21.814282+0000","last_peered":"2024-05-08T20:54:21.814282+0000","last_clean":"2024-05-08T20:54:21.814282+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:54:21.814282+0000","last_undegraded":"2024-05-08T20:54:21.814282+0000","last_fullsized":"2024-05-08T20:54:21.814282+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:20.746091+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:52:20.746091+0000","last_peered":"2024-05-08T20:52:20.746091+0000","last_clean":"2024-05-08T20:52:20.746091+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:52:20.746091+0000","last_undegraded":"2024-05-08T20:52:20.746091+0000","last_fullsized":"2024-05-08T20:52:20.746091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.985126+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:54:12.985126+0000","last_peered":"2024-05-08T20:54:12.985126+0000","last_clean":"2024-05-08T20:54:12.985126+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:12.985126+0000","last_undegraded":"2024-05-08T20:54:12.985126+0000","last_fullsized":"2024-05-08T20:54:12.985126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:02.790042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325930+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:54:32.325930+0000","last_peered":"2024-05-08T20:54:32.325930+0000","last_clean":"2024-05-08T20:54:32.325930+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:54:32.325930+0000","last_undegraded":"2024-05-08T20:54:32.325930+0000","last_fullsized":"2024-05-08T20:54:32.325930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:33.348170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4784,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.797586+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:54:21.797586+0000","last_peered":"2024-05-08T20:54:21.797586+0000","last_clean":"2024-05-08T20:54:21.797586+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:54:21.797586+0000","last_undegraded":"2024-05-08T20:54:21.797586+0000","last_fullsized":"2024-05-08T20:54:21.797586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:51.076313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'72","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.130807+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:54:15.130807+0000","last_peered":"2024-05-08T20:54:15.130807+0000","last_clean":"2024-05-08T20:54:15.130807+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:15.130807+0000","last_undegraded":"2024-05-08T20:54:15.130807+0000","last_fullsized":"2024-05-08T20:54:15.130807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:03.723846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.983711+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:54:12.983711+0000","last_peered":"2024-05-08T20:54:12.983711+0000","last_clean":"2024-05-08T20:54:12.983711+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:12.983711+0000","last_undegraded":"2024-05-08T20:54:12.983711+0000","last_fullsized":"2024-05-08T20:54:12.983711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:33.707848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3652,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375188+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375188+0000","last_peered":"2024-05-08T20:54:32.375188+0000","last_clean":"2024-05-08T20:54:32.375188+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375188+0000","last_undegraded":"2024-05-08T20:54:32.375188+0000","last_fullsized":"2024-05-08T20:54:32.375188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":4996,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.838483+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:54:21.838483+0000","last_peered":"2024-05-08T20:54:21.838483+0000","last_clean":"2024-05-08T20:54:21.838483+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:21.838483+0000","last_undegraded":"2024-05-08T20:54:21.838483+0000","last_fullsized":"2024-05-08T20:54:21.838483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:03.157656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.496369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:52:16.496369+0000","last_peered":"2024-05-08T20:52:16.496369+0000","last_clean":"2024-05-08T20:52:16.496369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:52:16.496369+0000","last_undegraded":"2024-05-08T20:52:16.496369+0000","last_fullsized":"2024-05-08T20:52:16.496369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'276","reported_seq":301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960565+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:54:12.960565+0000","last_peered":"2024-05-08T20:54:12.960565+0000","last_clean":"2024-05-08T20:54:12.960565+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:54:12.960565+0000","last_undegraded":"2024-05-08T20:54:12.960565+0000","last_fullsized":"2024-05-08T20:54:12.960565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:56.599655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5503,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.403897+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:32.403897+0000","last_peered":"2024-05-08T20:54:32.403897+0000","last_clean":"2024-05-08T20:54:32.403897+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:32.403897+0000","last_undegraded":"2024-05-08T20:54:32.403897+0000","last_fullsized":"2024-05-08T20:54:32.403897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5099,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824960+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:21.824960+0000","last_peered":"2024-05-08T20:54:21.824960+0000","last_clean":"2024-05-08T20:54:21.824960+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:21.824960+0000","last_undegraded":"2024-05-08T20:54:21.824960+0000","last_fullsized":"2024-05-08T20:54:21.824960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:26.888581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:25.807713+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:52:25.807713+0000","last_peered":"2024-05-08T20:52:25.807713+0000","last_clean":"2024-05-08T20:52:25.807713+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:52:25.807713+0000","last_undegraded":"2024-05-08T20:52:25.807713+0000","last_fullsized":"2024-05-08T20:52:25.807713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:51:19.878927+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:51:19.878927+0000","last_peered":"2024-05-08T20:51:19.878927+0000","last_clean":"2024-05-08T20:51:19.878927+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:51:19.878927+0000","last_undegraded":"2024-05-08T20:51:19.878927+0000","last_fullsized":"2024-05-08T20:51:19.878927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.638261+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:54:07.638261+0000","last_peered":"2024-05-08T20:54:07.638261+0000","last_clean":"2024-05-08T20:54:07.638261+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:54:07.638261+0000","last_undegraded":"2024-05-08T20:54:07.638261+0000","last_fullsized":"2024-05-08T20:54:07.638261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.539784+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:54:32.539784+0000","last_peered":"2024-05-08T20:54:32.539784+0000","last_clean":"2024-05-08T20:54:32.539784+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:54:32.539784+0000","last_undegraded":"2024-05-08T20:54:32.539784+0000","last_fullsized":"2024-05-08T20:54:32.539784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:31.060849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5582,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.883282+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:54:21.883282+0000","last_peered":"2024-05-08T20:54:21.883282+0000","last_clean":"2024-05-08T20:54:21.883282+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:21.883282+0000","last_undegraded":"2024-05-08T20:54:21.883282+0000","last_fullsized":"2024-05-08T20:54:21.883282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.088321+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:52:15.088321+0000","last_peered":"2024-05-08T20:52:15.088321+0000","last_clean":"2024-05-08T20:52:15.088321+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:52:15.088321+0000","last_undegraded":"2024-05-08T20:52:15.088321+0000","last_fullsized":"2024-05-08T20:52:15.088321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:49.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.966573+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:54:12.966573+0000","last_peered":"2024-05-08T20:54:12.966573+0000","last_clean":"2024-05-08T20:54:12.966573+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:54:12.966573+0000","last_undegraded":"2024-05-08T20:54:12.966573+0000","last_fullsized":"2024-05-08T20:54:12.966573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.397458+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:54:32.397458+0000","last_peered":"2024-05-08T20:54:32.397458+0000","last_clean":"2024-05-08T20:54:32.397458+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:54:32.397458+0000","last_undegraded":"2024-05-08T20:54:32.397458+0000","last_fullsized":"2024-05-08T20:54:32.397458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:11.205778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5622,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793078+0000","last_change":"2024-05-08T20:28:00.414547+0000","last_active":"2024-05-08T20:54:21.793078+0000","last_peered":"2024-05-08T20:54:21.793078+0000","last_clean":"2024-05-08T20:54:21.793078+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:54:21.793078+0000","last_undegraded":"2024-05-08T20:54:21.793078+0000","last_fullsized":"2024-05-08T20:54:21.793078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:58.107901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.601869+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:52:17.601869+0000","last_peered":"2024-05-08T20:52:17.601869+0000","last_clean":"2024-05-08T20:52:17.601869+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:52:17.601869+0000","last_undegraded":"2024-05-08T20:52:17.601869+0000","last_fullsized":"2024-05-08T20:52:17.601869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:21.042162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1136","reported_seq":1161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.000077+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:54:13.000077+0000","last_peered":"2024-05-08T20:54:13.000077+0000","last_clean":"2024-05-08T20:54:13.000077+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:54:13.000077+0000","last_undegraded":"2024-05-08T20:54:13.000077+0000","last_fullsized":"2024-05-08T20:54:13.000077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:24.198004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.298191+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.298191+0000","last_peered":"2024-05-08T20:54:32.298191+0000","last_clean":"2024-05-08T20:54:32.298191+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.298191+0000","last_undegraded":"2024-05-08T20:54:32.298191+0000","last_fullsized":"2024-05-08T20:54:32.298191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.910601+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:54:21.910601+0000","last_peered":"2024-05-08T20:54:21.910601+0000","last_clean":"2024-05-08T20:54:21.910601+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:54:21.910601+0000","last_undegraded":"2024-05-08T20:54:21.910601+0000","last_fullsized":"2024-05-08T20:54:21.910601+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.071772+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:52:15.071772+0000","last_peered":"2024-05-08T20:52:15.071772+0000","last_clean":"2024-05-08T20:52:15.071772+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:52:15.071772+0000","last_undegraded":"2024-05-08T20:52:15.071772+0000","last_fullsized":"2024-05-08T20:52:15.071772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:27.153507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.635968+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:54:07.635968+0000","last_peered":"2024-05-08T20:54:07.635968+0000","last_clean":"2024-05-08T20:54:07.635968+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:07.635968+0000","last_undegraded":"2024-05-08T20:54:07.635968+0000","last_fullsized":"2024-05-08T20:54:07.635968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3750,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368145+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:54:32.368145+0000","last_peered":"2024-05-08T20:54:32.368145+0000","last_clean":"2024-05-08T20:54:32.368145+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:32.368145+0000","last_undegraded":"2024-05-08T20:54:32.368145+0000","last_fullsized":"2024-05-08T20:54:32.368145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:29.451248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867267+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:54:21.867267+0000","last_peered":"2024-05-08T20:54:21.867267+0000","last_clean":"2024-05-08T20:54:21.867267+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:54:21.867267+0000","last_undegraded":"2024-05-08T20:54:21.867267+0000","last_fullsized":"2024-05-08T20:54:21.867267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.836779+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:52:15.836779+0000","last_peered":"2024-05-08T20:52:15.836779+0000","last_clean":"2024-05-08T20:52:15.836779+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:52:15.836779+0000","last_undegraded":"2024-05-08T20:52:15.836779+0000","last_fullsized":"2024-05-08T20:52:15.836779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960698+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:54:12.960698+0000","last_peered":"2024-05-08T20:54:12.960698+0000","last_clean":"2024-05-08T20:54:12.960698+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:12.960698+0000","last_undegraded":"2024-05-08T20:54:12.960698+0000","last_fullsized":"2024-05-08T20:54:12.960698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367255+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367255+0000","last_peered":"2024-05-08T20:54:32.367255+0000","last_clean":"2024-05-08T20:54:32.367255+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367255+0000","last_undegraded":"2024-05-08T20:54:32.367255+0000","last_fullsized":"2024-05-08T20:54:32.367255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:38.828844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4904,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863399+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:54:21.863399+0000","last_peered":"2024-05-08T20:54:21.863399+0000","last_clean":"2024-05-08T20:54:21.863399+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:54:21.863399+0000","last_undegraded":"2024-05-08T20:54:21.863399+0000","last_fullsized":"2024-05-08T20:54:21.863399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:02.925048+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:53:02.925048+0000","last_peered":"2024-05-08T20:53:02.925048+0000","last_clean":"2024-05-08T20:53:02.925048+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:53:02.925048+0000","last_undegraded":"2024-05-08T20:53:02.925048+0000","last_fullsized":"2024-05-08T20:53:02.925048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:44.275999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.974440+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:54:12.974440+0000","last_peered":"2024-05-08T20:54:12.974440+0000","last_clean":"2024-05-08T20:54:12.974440+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:12.974440+0000","last_undegraded":"2024-05-08T20:54:12.974440+0000","last_fullsized":"2024-05-08T20:54:12.974440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:25.864349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382036+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382036+0000","last_peered":"2024-05-08T20:54:32.382036+0000","last_clean":"2024-05-08T20:54:32.382036+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382036+0000","last_undegraded":"2024-05-08T20:54:32.382036+0000","last_fullsized":"2024-05-08T20:54:32.382036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.789086+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:54:21.789086+0000","last_peered":"2024-05-08T20:54:21.789086+0000","last_clean":"2024-05-08T20:54:21.789086+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:54:21.789086+0000","last_undegraded":"2024-05-08T20:54:21.789086+0000","last_fullsized":"2024-05-08T20:54:21.789086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.946926+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:52:15.946926+0000","last_peered":"2024-05-08T20:52:15.946926+0000","last_clean":"2024-05-08T20:52:15.946926+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:52:15.946926+0000","last_undegraded":"2024-05-08T20:52:15.946926+0000","last_fullsized":"2024-05-08T20:52:15.946926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.923631+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:54:12.923631+0000","last_peered":"2024-05-08T20:54:12.923631+0000","last_clean":"2024-05-08T20:54:12.923631+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:54:12.923631+0000","last_undegraded":"2024-05-08T20:54:12.923631+0000","last_fullsized":"2024-05-08T20:54:12.923631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:29.455202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368762+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368762+0000","last_peered":"2024-05-08T20:54:32.368762+0000","last_clean":"2024-05-08T20:54:32.368762+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368762+0000","last_undegraded":"2024-05-08T20:54:32.368762+0000","last_fullsized":"2024-05-08T20:54:32.368762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6080,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.886261+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:21.886261+0000","last_peered":"2024-05-08T20:54:21.886261+0000","last_clean":"2024-05-08T20:54:21.886261+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:21.886261+0000","last_undegraded":"2024-05-08T20:54:21.886261+0000","last_fullsized":"2024-05-08T20:54:21.886261+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489130+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:52:16.489130+0000","last_peered":"2024-05-08T20:52:16.489130+0000","last_clean":"2024-05-08T20:52:16.489130+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:52:16.489130+0000","last_undegraded":"2024-05-08T20:52:16.489130+0000","last_fullsized":"2024-05-08T20:52:16.489130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'389","reported_seq":413,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.272721+0000","last_change":"2024-05-08T20:27:27.604367+0000","last_active":"2024-05-08T20:54:07.272721+0000","last_peered":"2024-05-08T20:54:07.272721+0000","last_clean":"2024-05-08T20:54:07.272721+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:07.272721+0000","last_undegraded":"2024-05-08T20:54:07.272721+0000","last_fullsized":"2024-05-08T20:54:07.272721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:33:11.168123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398306+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398306+0000","last_peered":"2024-05-08T20:54:32.398306+0000","last_clean":"2024-05-08T20:54:32.398306+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398306+0000","last_undegraded":"2024-05-08T20:54:32.398306+0000","last_fullsized":"2024-05-08T20:54:32.398306+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:09.973785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.749989+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:54:21.749989+0000","last_peered":"2024-05-08T20:54:21.749989+0000","last_clean":"2024-05-08T20:54:21.749989+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:21.749989+0000","last_undegraded":"2024-05-08T20:54:21.749989+0000","last_fullsized":"2024-05-08T20:54:21.749989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:51:04.382031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.551192+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:52:17.551192+0000","last_peered":"2024-05-08T20:52:17.551192+0000","last_clean":"2024-05-08T20:52:17.551192+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:52:17.551192+0000","last_undegraded":"2024-05-08T20:52:17.551192+0000","last_fullsized":"2024-05-08T20:52:17.551192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:06.685394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'38","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.880156+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:54:13.880156+0000","last_peered":"2024-05-08T20:54:13.880156+0000","last_clean":"2024-05-08T20:54:13.880156+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:54:13.880156+0000","last_undegraded":"2024-05-08T20:54:13.880156+0000","last_fullsized":"2024-05-08T20:54:13.880156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.426159+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:54:32.426159+0000","last_peered":"2024-05-08T20:54:32.426159+0000","last_clean":"2024-05-08T20:54:32.426159+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:54:32.426159+0000","last_undegraded":"2024-05-08T20:54:32.426159+0000","last_fullsized":"2024-05-08T20:54:32.426159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:48.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.799792+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:54:21.799792+0000","last_peered":"2024-05-08T20:54:21.799792+0000","last_clean":"2024-05-08T20:54:21.799792+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:54:21.799792+0000","last_undegraded":"2024-05-08T20:54:21.799792+0000","last_fullsized":"2024-05-08T20:54:21.799792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'372","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:07.848241+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:53:07.848241+0000","last_peered":"2024-05-08T20:53:07.848241+0000","last_clean":"2024-05-08T20:53:07.848241+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:53:07.848241+0000","last_undegraded":"2024-05-08T20:53:07.848241+0000","last_fullsized":"2024-05-08T20:53:07.848241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.973682+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:54:12.973682+0000","last_peered":"2024-05-08T20:54:12.973682+0000","last_clean":"2024-05-08T20:54:12.973682+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:12.973682+0000","last_undegraded":"2024-05-08T20:54:12.973682+0000","last_fullsized":"2024-05-08T20:54:12.973682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:47.643848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3965,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325893+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325893+0000","last_peered":"2024-05-08T20:54:32.325893+0000","last_clean":"2024-05-08T20:54:32.325893+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325893+0000","last_undegraded":"2024-05-08T20:54:32.325893+0000","last_fullsized":"2024-05-08T20:54:32.325893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:35.815219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.876604+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:54:21.876604+0000","last_peered":"2024-05-08T20:54:21.876604+0000","last_clean":"2024-05-08T20:54:21.876604+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:54:21.876604+0000","last_undegraded":"2024-05-08T20:54:21.876604+0000","last_fullsized":"2024-05-08T20:54:21.876604+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'40","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:58.250615+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:53:58.250615+0000","last_peered":"2024-05-08T20:53:58.250615+0000","last_clean":"2024-05-08T20:53:58.250615+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:53:58.250615+0000","last_undegraded":"2024-05-08T20:53:58.250615+0000","last_fullsized":"2024-05-08T20:53:58.250615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:30.929250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'7","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.991280+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:54:12.991280+0000","last_peered":"2024-05-08T20:54:12.991280+0000","last_clean":"2024-05-08T20:54:12.991280+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:12.991280+0000","last_undegraded":"2024-05-08T20:54:12.991280+0000","last_fullsized":"2024-05-08T20:54:12.991280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.363218+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.363218+0000","last_peered":"2024-05-08T20:54:32.363218+0000","last_clean":"2024-05-08T20:54:32.363218+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.363218+0000","last_undegraded":"2024-05-08T20:54:32.363218+0000","last_fullsized":"2024-05-08T20:54:32.363218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.812600+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:54:21.812600+0000","last_peered":"2024-05-08T20:54:21.812600+0000","last_clean":"2024-05-08T20:54:21.812600+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:54:21.812600+0000","last_undegraded":"2024-05-08T20:54:21.812600+0000","last_fullsized":"2024-05-08T20:54:21.812600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:53.840511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.483086+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:52:16.483086+0000","last_peered":"2024-05-08T20:52:16.483086+0000","last_clean":"2024-05-08T20:52:16.483086+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:52:16.483086+0000","last_undegraded":"2024-05-08T20:52:16.483086+0000","last_fullsized":"2024-05-08T20:52:16.483086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972676+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:54:12.972676+0000","last_peered":"2024-05-08T20:54:12.972676+0000","last_clean":"2024-05-08T20:54:12.972676+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:12.972676+0000","last_undegraded":"2024-05-08T20:54:12.972676+0000","last_fullsized":"2024-05-08T20:54:12.972676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:41.240143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406456+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:32.406456+0000","last_peered":"2024-05-08T20:54:32.406456+0000","last_clean":"2024-05-08T20:54:32.406456+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:32.406456+0000","last_undegraded":"2024-05-08T20:54:32.406456+0000","last_fullsized":"2024-05-08T20:54:32.406456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.800922+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.800922+0000","last_peered":"2024-05-08T20:54:21.800922+0000","last_clean":"2024-05-08T20:54:21.800922+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.800922+0000","last_undegraded":"2024-05-08T20:54:21.800922+0000","last_fullsized":"2024-05-08T20:54:21.800922+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.981217+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:52:15.981217+0000","last_peered":"2024-05-08T20:52:15.981217+0000","last_clean":"2024-05-08T20:52:15.981217+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:52:15.981217+0000","last_undegraded":"2024-05-08T20:52:15.981217+0000","last_fullsized":"2024-05-08T20:52:15.981217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972569+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:54:12.972569+0000","last_peered":"2024-05-08T20:54:12.972569+0000","last_clean":"2024-05-08T20:54:12.972569+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:54:12.972569+0000","last_undegraded":"2024-05-08T20:54:12.972569+0000","last_fullsized":"2024-05-08T20:54:12.972569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:28.437817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6613,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.394003+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:32.394003+0000","last_peered":"2024-05-08T20:54:32.394003+0000","last_clean":"2024-05-08T20:54:32.394003+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:32.394003+0000","last_undegraded":"2024-05-08T20:54:32.394003+0000","last_fullsized":"2024-05-08T20:54:32.394003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.963381+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:54:12.963381+0000","last_peered":"2024-05-08T20:54:12.963381+0000","last_clean":"2024-05-08T20:54:12.963381+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:54:12.963381+0000","last_undegraded":"2024-05-08T20:54:12.963381+0000","last_fullsized":"2024-05-08T20:54:12.963381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:08.707780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6026,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793198+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:54:21.793198+0000","last_peered":"2024-05-08T20:54:21.793198+0000","last_clean":"2024-05-08T20:54:21.793198+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:21.793198+0000","last_undegraded":"2024-05-08T20:54:21.793198+0000","last_fullsized":"2024-05-08T20:54:21.793198+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:48.305582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:03.788193+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:52:03.788193+0000","last_peered":"2024-05-08T20:52:03.788193+0000","last_clean":"2024-05-08T20:52:03.788193+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:52:03.788193+0000","last_undegraded":"2024-05-08T20:52:03.788193+0000","last_fullsized":"2024-05-08T20:52:03.788193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4371,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.301812+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:54:32.301812+0000","last_peered":"2024-05-08T20:54:32.301812+0000","last_clean":"2024-05-08T20:54:32.301812+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:54:32.301812+0000","last_undegraded":"2024-05-08T20:54:32.301812+0000","last_fullsized":"2024-05-08T20:54:32.301812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:43.295503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984777+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:54:12.984777+0000","last_peered":"2024-05-08T20:54:12.984777+0000","last_clean":"2024-05-08T20:54:12.984777+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:54:12.984777+0000","last_undegraded":"2024-05-08T20:54:12.984777+0000","last_fullsized":"2024-05-08T20:54:12.984777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5574,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.798553+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:54:21.798553+0000","last_peered":"2024-05-08T20:54:21.798553+0000","last_clean":"2024-05-08T20:54:21.798553+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:54:21.798553+0000","last_undegraded":"2024-05-08T20:54:21.798553+0000","last_fullsized":"2024-05-08T20:54:21.798553+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:37.767174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.879936+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:52:15.879936+0000","last_peered":"2024-05-08T20:52:15.879936+0000","last_clean":"2024-05-08T20:52:15.879936+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:52:15.879936+0000","last_undegraded":"2024-05-08T20:52:15.879936+0000","last_fullsized":"2024-05-08T20:52:15.879936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:54.693358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4948,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.442604+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:54:32.442604+0000","last_peered":"2024-05-08T20:54:32.442604+0000","last_clean":"2024-05-08T20:54:32.442604+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:54:32.442604+0000","last_undegraded":"2024-05-08T20:54:32.442604+0000","last_fullsized":"2024-05-08T20:54:32.442604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:51.490040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'162","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.590870+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:54:21.590870+0000","last_peered":"2024-05-08T20:54:21.590870+0000","last_clean":"2024-05-08T20:54:21.590870+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:21.590870+0000","last_undegraded":"2024-05-08T20:54:21.590870+0000","last_fullsized":"2024-05-08T20:54:21.590870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.851678+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:54:21.851678+0000","last_peered":"2024-05-08T20:54:21.851678+0000","last_clean":"2024-05-08T20:54:21.851678+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:54:21.851678+0000","last_undegraded":"2024-05-08T20:54:21.851678+0000","last_fullsized":"2024-05-08T20:54:21.851678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:05.507328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:27.909301+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:52:27.909301+0000","last_peered":"2024-05-08T20:52:27.909301+0000","last_clean":"2024-05-08T20:52:27.909301+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:52:27.909301+0000","last_undegraded":"2024-05-08T20:52:27.909301+0000","last_fullsized":"2024-05-08T20:52:27.909301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:02.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.400488+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:32.400488+0000","last_peered":"2024-05-08T20:54:32.400488+0000","last_clean":"2024-05-08T20:54:32.400488+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:32.400488+0000","last_undegraded":"2024-05-08T20:54:32.400488+0000","last_fullsized":"2024-05-08T20:54:32.400488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'654","reported_seq":681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.109585+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:52:15.109585+0000","last_peered":"2024-05-08T20:52:15.109585+0000","last_clean":"2024-05-08T20:52:15.109585+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:52:15.109585+0000","last_undegraded":"2024-05-08T20:52:15.109585+0000","last_fullsized":"2024-05-08T20:52:15.109585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:33.334338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.786384+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:54:21.786384+0000","last_peered":"2024-05-08T20:54:21.786384+0000","last_clean":"2024-05-08T20:54:21.786384+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:54:21.786384+0000","last_undegraded":"2024-05-08T20:54:21.786384+0000","last_fullsized":"2024-05-08T20:54:21.786384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'7","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.965965+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:54:12.965965+0000","last_peered":"2024-05-08T20:54:12.965965+0000","last_clean":"2024-05-08T20:54:12.965965+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:12.965965+0000","last_undegraded":"2024-05-08T20:54:12.965965+0000","last_fullsized":"2024-05-08T20:54:12.965965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:46.039261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.441006+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.441006+0000","last_peered":"2024-05-08T20:54:32.441006+0000","last_clean":"2024-05-08T20:54:32.441006+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.441006+0000","last_undegraded":"2024-05-08T20:54:32.441006+0000","last_fullsized":"2024-05-08T20:54:32.441006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:10.988585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.809888+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:54:21.809888+0000","last_peered":"2024-05-08T20:54:21.809888+0000","last_clean":"2024-05-08T20:54:21.809888+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:21.809888+0000","last_undegraded":"2024-05-08T20:54:21.809888+0000","last_fullsized":"2024-05-08T20:54:21.809888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.413717+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.413717+0000","last_peered":"2024-05-08T20:54:32.413717+0000","last_clean":"2024-05-08T20:54:32.413717+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.413717+0000","last_undegraded":"2024-05-08T20:54:32.413717+0000","last_fullsized":"2024-05-08T20:54:32.413717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:39.942002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5624,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.762734+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:54:21.762734+0000","last_peered":"2024-05-08T20:54:21.762734+0000","last_clean":"2024-05-08T20:54:21.762734+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:21.762734+0000","last_undegraded":"2024-05-08T20:54:21.762734+0000","last_fullsized":"2024-05-08T20:54:21.762734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:52:53.690361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.290807+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.290807+0000","last_peered":"2024-05-08T20:54:32.290807+0000","last_clean":"2024-05-08T20:54:32.290807+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.290807+0000","last_undegraded":"2024-05-08T20:54:32.290807+0000","last_fullsized":"2024-05-08T20:54:32.290807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873705+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:21.873705+0000","last_peered":"2024-05-08T20:54:21.873705+0000","last_clean":"2024-05-08T20:54:21.873705+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:21.873705+0000","last_undegraded":"2024-05-08T20:54:21.873705+0000","last_fullsized":"2024-05-08T20:54:21.873705+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4812,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.433420+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.433420+0000","last_peered":"2024-05-08T20:54:32.433420+0000","last_clean":"2024-05-08T20:54:32.433420+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.433420+0000","last_undegraded":"2024-05-08T20:54:32.433420+0000","last_fullsized":"2024-05-08T20:54:32.433420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:09.787868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5722,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804450+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:54:21.804450+0000","last_peered":"2024-05-08T20:54:21.804450+0000","last_clean":"2024-05-08T20:54:21.804450+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:21.804450+0000","last_undegraded":"2024-05-08T20:54:21.804450+0000","last_fullsized":"2024-05-08T20:54:21.804450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:38.912500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339531+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:32.339531+0000","last_peered":"2024-05-08T20:54:32.339531+0000","last_clean":"2024-05-08T20:54:32.339531+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:32.339531+0000","last_undegraded":"2024-05-08T20:54:32.339531+0000","last_fullsized":"2024-05-08T20:54:32.339531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5427,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862537+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862537+0000","last_peered":"2024-05-08T20:54:21.862537+0000","last_clean":"2024-05-08T20:54:21.862537+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862537+0000","last_undegraded":"2024-05-08T20:54:21.862537+0000","last_fullsized":"2024-05-08T20:54:21.862537+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:35.027767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4140,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.407488+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:32.407488+0000","last_peered":"2024-05-08T20:54:32.407488+0000","last_clean":"2024-05-08T20:54:32.407488+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:32.407488+0000","last_undegraded":"2024-05-08T20:54:32.407488+0000","last_fullsized":"2024-05-08T20:54:32.407488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.741430+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:54:21.741430+0000","last_peered":"2024-05-08T20:54:21.741430+0000","last_clean":"2024-05-08T20:54:21.741430+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:54:21.741430+0000","last_undegraded":"2024-05-08T20:54:21.741430+0000","last_fullsized":"2024-05-08T20:54:21.741430+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:46.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406976+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:32.406976+0000","last_peered":"2024-05-08T20:54:32.406976+0000","last_clean":"2024-05-08T20:54:32.406976+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:32.406976+0000","last_undegraded":"2024-05-08T20:54:32.406976+0000","last_fullsized":"2024-05-08T20:54:32.406976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907633+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:54:21.907633+0000","last_peered":"2024-05-08T20:54:21.907633+0000","last_clean":"2024-05-08T20:54:21.907633+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:21.907633+0000","last_undegraded":"2024-05-08T20:54:21.907633+0000","last_fullsized":"2024-05-08T20:54:21.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4664,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370570+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:32.370570+0000","last_peered":"2024-05-08T20:54:32.370570+0000","last_clean":"2024-05-08T20:54:32.370570+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:32.370570+0000","last_undegraded":"2024-05-08T20:54:32.370570+0000","last_fullsized":"2024-05-08T20:54:32.370570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6154,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750487+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:54:21.750487+0000","last_peered":"2024-05-08T20:54:21.750487+0000","last_clean":"2024-05-08T20:54:21.750487+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:54:21.750487+0000","last_undegraded":"2024-05-08T20:54:21.750487+0000","last_fullsized":"2024-05-08T20:54:21.750487+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:15.191693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447520+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.447520+0000","last_peered":"2024-05-08T20:54:32.447520+0000","last_clean":"2024-05-08T20:54:32.447520+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.447520+0000","last_undegraded":"2024-05-08T20:54:32.447520+0000","last_fullsized":"2024-05-08T20:54:32.447520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:44.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824316+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824316+0000","last_peered":"2024-05-08T20:54:21.824316+0000","last_clean":"2024-05-08T20:54:21.824316+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824316+0000","last_undegraded":"2024-05-08T20:54:21.824316+0000","last_fullsized":"2024-05-08T20:54:21.824316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6030,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339757+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:54:32.339757+0000","last_peered":"2024-05-08T20:54:32.339757+0000","last_clean":"2024-05-08T20:54:32.339757+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:54:32.339757+0000","last_undegraded":"2024-05-08T20:54:32.339757+0000","last_fullsized":"2024-05-08T20:54:32.339757+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862354+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:54:21.862354+0000","last_peered":"2024-05-08T20:54:21.862354+0000","last_clean":"2024-05-08T20:54:21.862354+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:54:21.862354+0000","last_undegraded":"2024-05-08T20:54:21.862354+0000","last_fullsized":"2024-05-08T20:54:21.862354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:00.733617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.345142+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:54:32.345142+0000","last_peered":"2024-05-08T20:54:32.345142+0000","last_clean":"2024-05-08T20:54:32.345142+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:54:32.345142+0000","last_undegraded":"2024-05-08T20:54:32.345142+0000","last_fullsized":"2024-05-08T20:54:32.345142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:41.674682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873770+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.873770+0000","last_peered":"2024-05-08T20:54:21.873770+0000","last_clean":"2024-05-08T20:54:21.873770+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.873770+0000","last_undegraded":"2024-05-08T20:54:21.873770+0000","last_fullsized":"2024-05-08T20:54:21.873770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4592,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.404985+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:32.404985+0000","last_peered":"2024-05-08T20:54:32.404985+0000","last_clean":"2024-05-08T20:54:32.404985+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:32.404985+0000","last_undegraded":"2024-05-08T20:54:32.404985+0000","last_fullsized":"2024-05-08T20:54:32.404985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:49:53.726266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6421,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.794395+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:21.794395+0000","last_peered":"2024-05-08T20:54:21.794395+0000","last_clean":"2024-05-08T20:54:21.794395+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:21.794395+0000","last_undegraded":"2024-05-08T20:54:21.794395+0000","last_fullsized":"2024-05-08T20:54:21.794395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:31.832985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406667+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:32.406667+0000","last_peered":"2024-05-08T20:54:32.406667+0000","last_clean":"2024-05-08T20:54:32.406667+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:32.406667+0000","last_undegraded":"2024-05-08T20:54:32.406667+0000","last_fullsized":"2024-05-08T20:54:32.406667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842224+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:54:21.842224+0000","last_peered":"2024-05-08T20:54:21.842224+0000","last_clean":"2024-05-08T20:54:21.842224+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:54:21.842224+0000","last_undegraded":"2024-05-08T20:54:21.842224+0000","last_fullsized":"2024-05-08T20:54:21.842224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.427047+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:32.427047+0000","last_peered":"2024-05-08T20:54:32.427047+0000","last_clean":"2024-05-08T20:54:32.427047+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:32.427047+0000","last_undegraded":"2024-05-08T20:54:32.427047+0000","last_fullsized":"2024-05-08T20:54:32.427047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6035,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.839762+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:54:21.839762+0000","last_peered":"2024-05-08T20:54:21.839762+0000","last_clean":"2024-05-08T20:54:21.839762+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:54:21.839762+0000","last_undegraded":"2024-05-08T20:54:21.839762+0000","last_fullsized":"2024-05-08T20:54:21.839762+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.320278+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.320278+0000","last_peered":"2024-05-08T20:54:32.320278+0000","last_clean":"2024-05-08T20:54:32.320278+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.320278+0000","last_undegraded":"2024-05-08T20:54:32.320278+0000","last_fullsized":"2024-05-08T20:54:32.320278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.796071+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:54:21.796071+0000","last_peered":"2024-05-08T20:54:21.796071+0000","last_clean":"2024-05-08T20:54:21.796071+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:21.796071+0000","last_undegraded":"2024-05-08T20:54:21.796071+0000","last_fullsized":"2024-05-08T20:54:21.796071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:13.431880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.315251+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:54:32.315251+0000","last_peered":"2024-05-08T20:54:32.315251+0000","last_clean":"2024-05-08T20:54:32.315251+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:54:32.315251+0000","last_undegraded":"2024-05-08T20:54:32.315251+0000","last_fullsized":"2024-05-08T20:54:32.315251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:39.143693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873440+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:54:21.873440+0000","last_peered":"2024-05-08T20:54:21.873440+0000","last_clean":"2024-05-08T20:54:21.873440+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:54:21.873440+0000","last_undegraded":"2024-05-08T20:54:21.873440+0000","last_fullsized":"2024-05-08T20:54:21.873440+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4672,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.419364+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.419364+0000","last_peered":"2024-05-08T20:54:32.419364+0000","last_clean":"2024-05-08T20:54:32.419364+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.419364+0000","last_undegraded":"2024-05-08T20:54:32.419364+0000","last_fullsized":"2024-05-08T20:54:32.419364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:23.159995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.827140+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:54:21.827140+0000","last_peered":"2024-05-08T20:54:21.827140+0000","last_clean":"2024-05-08T20:54:21.827140+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:21.827140+0000","last_undegraded":"2024-05-08T20:54:21.827140+0000","last_fullsized":"2024-05-08T20:54:21.827140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415141+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415141+0000","last_peered":"2024-05-08T20:54:32.415141+0000","last_clean":"2024-05-08T20:54:32.415141+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415141+0000","last_undegraded":"2024-05-08T20:54:32.415141+0000","last_fullsized":"2024-05-08T20:54:32.415141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4629,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862710+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:54:21.862710+0000","last_peered":"2024-05-08T20:54:21.862710+0000","last_clean":"2024-05-08T20:54:21.862710+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:21.862710+0000","last_undegraded":"2024-05-08T20:54:21.862710+0000","last_fullsized":"2024-05-08T20:54:21.862710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:14.026611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.342985+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.342985+0000","last_peered":"2024-05-08T20:54:32.342985+0000","last_clean":"2024-05-08T20:54:32.342985+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.342985+0000","last_undegraded":"2024-05-08T20:54:32.342985+0000","last_fullsized":"2024-05-08T20:54:32.342985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.745730+0000","last_change":"2024-05-08T20:27:18.886183+0000","last_active":"2024-05-08T20:54:21.745730+0000","last_peered":"2024-05-08T20:54:21.745730+0000","last_clean":"2024-05-08T20:54:21.745730+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:21.745730+0000","last_undegraded":"2024-05-08T20:54:21.745730+0000","last_fullsized":"2024-05-08T20:54:21.745730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:40.004274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382399+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.382399+0000","last_peered":"2024-05-08T20:54:32.382399+0000","last_clean":"2024-05-08T20:54:32.382399+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.382399+0000","last_undegraded":"2024-05-08T20:54:32.382399+0000","last_fullsized":"2024-05-08T20:54:32.382399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.772331+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:54:21.772331+0000","last_peered":"2024-05-08T20:54:21.772331+0000","last_clean":"2024-05-08T20:54:21.772331+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:54:21.772331+0000","last_undegraded":"2024-05-08T20:54:21.772331+0000","last_fullsized":"2024-05-08T20:54:21.772331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:53.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.354339+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.354339+0000","last_peered":"2024-05-08T20:54:32.354339+0000","last_clean":"2024-05-08T20:54:32.354339+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.354339+0000","last_undegraded":"2024-05-08T20:54:32.354339+0000","last_fullsized":"2024-05-08T20:54:32.354339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:12.937124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863383+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:54:21.863383+0000","last_peered":"2024-05-08T20:54:21.863383+0000","last_clean":"2024-05-08T20:54:21.863383+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:54:21.863383+0000","last_undegraded":"2024-05-08T20:54:21.863383+0000","last_fullsized":"2024-05-08T20:54:21.863383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340542+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:54:32.340542+0000","last_peered":"2024-05-08T20:54:32.340542+0000","last_clean":"2024-05-08T20:54:32.340542+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:54:32.340542+0000","last_undegraded":"2024-05-08T20:54:32.340542+0000","last_fullsized":"2024-05-08T20:54:32.340542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:31.768287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.808590+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:54:21.808590+0000","last_peered":"2024-05-08T20:54:21.808590+0000","last_clean":"2024-05-08T20:54:21.808590+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:21.808590+0000","last_undegraded":"2024-05-08T20:54:21.808590+0000","last_fullsized":"2024-05-08T20:54:21.808590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.391513+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:54:32.391513+0000","last_peered":"2024-05-08T20:54:32.391513+0000","last_clean":"2024-05-08T20:54:32.391513+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:54:32.391513+0000","last_undegraded":"2024-05-08T20:54:32.391513+0000","last_fullsized":"2024-05-08T20:54:32.391513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.904783+0000","last_change":"2024-05-08T20:28:00.413131+0000","last_active":"2024-05-08T20:54:21.904783+0000","last_peered":"2024-05-08T20:54:21.904783+0000","last_clean":"2024-05-08T20:54:21.904783+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:21.904783+0000","last_undegraded":"2024-05-08T20:54:21.904783+0000","last_fullsized":"2024-05-08T20:54:21.904783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:24.920403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.295323+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:54:32.295323+0000","last_peered":"2024-05-08T20:54:32.295323+0000","last_clean":"2024-05-08T20:54:32.295323+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:54:32.295323+0000","last_undegraded":"2024-05-08T20:54:32.295323+0000","last_fullsized":"2024-05-08T20:54:32.295323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6669,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907477+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:54:21.907477+0000","last_peered":"2024-05-08T20:54:21.907477+0000","last_clean":"2024-05-08T20:54:21.907477+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:54:21.907477+0000","last_undegraded":"2024-05-08T20:54:21.907477+0000","last_fullsized":"2024-05-08T20:54:21.907477+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.448843+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:32.448843+0000","last_peered":"2024-05-08T20:54:32.448843+0000","last_clean":"2024-05-08T20:54:32.448843+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:32.448843+0000","last_undegraded":"2024-05-08T20:54:32.448843+0000","last_fullsized":"2024-05-08T20:54:32.448843+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:18.580683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.826447+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.826447+0000","last_peered":"2024-05-08T20:54:21.826447+0000","last_clean":"2024-05-08T20:54:21.826447+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.826447+0000","last_undegraded":"2024-05-08T20:54:21.826447+0000","last_fullsized":"2024-05-08T20:54:21.826447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:22.668993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4044,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.374361+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:32.374361+0000","last_peered":"2024-05-08T20:54:32.374361+0000","last_clean":"2024-05-08T20:54:32.374361+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:32.374361+0000","last_undegraded":"2024-05-08T20:54:32.374361+0000","last_fullsized":"2024-05-08T20:54:32.374361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.742400+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:54:21.742400+0000","last_peered":"2024-05-08T20:54:21.742400+0000","last_clean":"2024-05-08T20:54:21.742400+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:54:21.742400+0000","last_undegraded":"2024-05-08T20:54:21.742400+0000","last_fullsized":"2024-05-08T20:54:21.742400+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3818,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385550+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385550+0000","last_peered":"2024-05-08T20:54:32.385550+0000","last_clean":"2024-05-08T20:54:32.385550+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385550+0000","last_undegraded":"2024-05-08T20:54:32.385550+0000","last_fullsized":"2024-05-08T20:54:32.385550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:35.561501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4562,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873313+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:54:21.873313+0000","last_peered":"2024-05-08T20:54:21.873313+0000","last_clean":"2024-05-08T20:54:21.873313+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:54:21.873313+0000","last_undegraded":"2024-05-08T20:54:21.873313+0000","last_fullsized":"2024-05-08T20:54:21.873313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.381776+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.381776+0000","last_peered":"2024-05-08T20:54:32.381776+0000","last_clean":"2024-05-08T20:54:32.381776+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.381776+0000","last_undegraded":"2024-05-08T20:54:32.381776+0000","last_fullsized":"2024-05-08T20:54:32.381776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867693+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:54:21.867693+0000","last_peered":"2024-05-08T20:54:21.867693+0000","last_clean":"2024-05-08T20:54:21.867693+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:54:21.867693+0000","last_undegraded":"2024-05-08T20:54:21.867693+0000","last_fullsized":"2024-05-08T20:54:21.867693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3762,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.353091+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:32.353091+0000","last_peered":"2024-05-08T20:54:32.353091+0000","last_clean":"2024-05-08T20:54:32.353091+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:32.353091+0000","last_undegraded":"2024-05-08T20:54:32.353091+0000","last_fullsized":"2024-05-08T20:54:32.353091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:26.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.774789+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:54:21.774789+0000","last_peered":"2024-05-08T20:54:21.774789+0000","last_clean":"2024-05-08T20:54:21.774789+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:21.774789+0000","last_undegraded":"2024-05-08T20:54:21.774789+0000","last_fullsized":"2024-05-08T20:54:21.774789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.350259+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:54:32.350259+0000","last_peered":"2024-05-08T20:54:32.350259+0000","last_clean":"2024-05-08T20:54:32.350259+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:54:32.350259+0000","last_undegraded":"2024-05-08T20:54:32.350259+0000","last_fullsized":"2024-05-08T20:54:32.350259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:27:45.162857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5667,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.765347+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:54:21.765347+0000","last_peered":"2024-05-08T20:54:21.765347+0000","last_clean":"2024-05-08T20:54:21.765347+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:54:21.765347+0000","last_undegraded":"2024-05-08T20:54:21.765347+0000","last_fullsized":"2024-05-08T20:54:21.765347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.352427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.380157+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:32.380157+0000","last_peered":"2024-05-08T20:54:32.380157+0000","last_clean":"2024-05-08T20:54:32.380157+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:32.380157+0000","last_undegraded":"2024-05-08T20:54:32.380157+0000","last_fullsized":"2024-05-08T20:54:32.380157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.754082+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:54:21.754082+0000","last_peered":"2024-05-08T20:54:21.754082+0000","last_clean":"2024-05-08T20:54:21.754082+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:21.754082+0000","last_undegraded":"2024-05-08T20:54:21.754082+0000","last_fullsized":"2024-05-08T20:54:21.754082+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:05.216501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.346308+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:54:32.346308+0000","last_peered":"2024-05-08T20:54:32.346308+0000","last_clean":"2024-05-08T20:54:32.346308+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:54:32.346308+0000","last_undegraded":"2024-05-08T20:54:32.346308+0000","last_fullsized":"2024-05-08T20:54:32.346308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.900494+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:54:21.900494+0000","last_peered":"2024-05-08T20:54:21.900494+0000","last_clean":"2024-05-08T20:54:21.900494+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:21.900494+0000","last_undegraded":"2024-05-08T20:54:21.900494+0000","last_fullsized":"2024-05-08T20:54:21.900494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3533,"ondisk_log_size":3533,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3539,"ondisk_log_size":3539,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575183,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":3.4089999999999998,"15min":1.579},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":4.5750000000000002,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.9650000000000001,"15min":1.1859999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":3.7829999999999999,"5min":34.091000000000001,"15min":34.091000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.732,"15min":1.077},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.4249999999999998,"5min":13.579000000000001,"15min":13.579000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.736,"15min":1.153},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":7.4699999999999998,"5min":13.467000000000001,"15min":13.467000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.9199999999999999,"15min":1.147},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":4.585,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.3620000000000001,"5min":2.069,"15min":1.288},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":4.5570000000000004,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.077}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.663,"15min":1.1100000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2589999999999999,"5min":15.532,"15min":15.532},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.2879999999999998,"15min":1.397},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.5,"5min":16.584,"15min":16.584},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.4950000000000001,"15min":1.732},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.214},"max":{"1min":6.4630000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.2389999999999999,"15min":1.361},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":4.617,"5min":22.741,"15min":22.741},"last":0.996}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":4.0570000000000004,"15min":1.9810000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":5.8380000000000001,"5min":33.679000000000002,"15min":33.679000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.522,"5min":2.5019999999999998,"15min":1.506},"min":{"1min":0.41999999999999998,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":4.5700000000000003,"5min":20.869,"15min":20.869},"last":1.123}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7050000000000001,"15min":1.2669999999999999},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.157,"5min":13.714,"15min":13.714},"last":1.165},{"interface":"front","average":{"1min":1.6539999999999999,"5min":2.2090000000000001,"15min":1.3480000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":6.2519999999999998,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.97399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575182,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.5369999999999999,"15min":0.99099999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":4.657,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.556,"5min":1.726,"15min":1.181},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.2960000000000003,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":1.1879999999999999}]},{"osd":1,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.9330000000000001,"15min":1.1830000000000001},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":2.5270000000000001,"5min":14.717000000000001,"15min":14.717000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.71,"15min":1.0900000000000001},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":7.3810000000000002,"5min":14.404,"15min":14.404},"last":1.2829999999999999}]},{"osd":2,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.603,"15min":1.095},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":3.5310000000000001,"5min":9.907,"15min":9.907},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4530000000000001,"15min":1.093},"min":{"1min":0.41899999999999998,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":3.694,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":0.746}]},{"osd":3,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":2.0630000000000002,"15min":1.3089999999999999},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":4.3780000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.714,"15min":1.198},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":4.6280000000000001,"5min":8.2940000000000005,"15min":8.2940000000000005},"last":1.238}]},{"osd":4,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":2.9340000000000002,"15min":1.552},"min":{"1min":0.39100000000000001,"5min":0.28699999999999998,"15min":0.223},"max":{"1min":4.4450000000000003,"5min":30.094000000000001,"15min":30.094000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":2.4620000000000002,"15min":1.4410000000000001},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":4.415,"5min":29.538,"15min":29.538},"last":1.111}]},{"osd":5,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.98,"15min":1.206},"min":{"1min":0.47999999999999998,"5min":0.28499999999999998,"15min":0.25},"max":{"1min":3.7589999999999999,"5min":11.568,"15min":11.568},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.5660000000000001,"5min":2.0369999999999999,"15min":1.329},"min":{"1min":0.52500000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"max":{"1min":3.806,"5min":11.593999999999999,"15min":11.593999999999999},"last":1.1479999999999999}]},{"osd":7,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":2.1600000000000001,"15min":1.2769999999999999},"min":{"1min":0.317,"5min":0.188,"15min":0.188},"max":{"1min":4.2430000000000003,"5min":12.77,"15min":12.77},"last":0.876},{"interface":"front","average":{"1min":1.532,"5min":2.0449999999999999,"15min":1.2909999999999999},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":6.2880000000000003,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575182,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.6799999999999999,"15min":1.056},"min":{"1min":0.25600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.4550000000000001,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.357,"15min":1.0029999999999999},"min":{"1min":0.33500000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7799999999999998,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.76000000000000001}]},{"osd":1,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":5.3259999999999996,"15min":2.298},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.20799999999999999},"max":{"1min":5.3019999999999996,"5min":121.521,"15min":121.521},"last":1.01},{"interface":"front","average":{"1min":1.139,"5min":1.9159999999999999,"15min":1.2030000000000001},"min":{"1min":0.28399999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.9409999999999998,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.96299999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.9630000000000001,"15min":1.206},"min":{"1min":0.25,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":5.2569999999999997,"5min":16.535,"15min":16.535},"last":1.228},{"interface":"front","average":{"1min":1.028,"5min":1.7410000000000001,"15min":1.1379999999999999},"min":{"1min":0.32400000000000001,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":2.9590000000000001,"5min":15.006,"15min":15.006},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.6790000000000003,"15min":2.4950000000000001},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":5.2830000000000004,"5min":121.498,"15min":121.498},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.849,"15min":1.256},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.0549999999999997,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.1200000000000001}]},{"osd":4,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":5.202,"15min":2.3149999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.3209999999999997,"5min":121.464,"15min":121.464},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.613,"5min":1.746,"15min":1.1870000000000001},"min":{"1min":0.35999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2329999999999997,"5min":8.2710000000000008,"15min":8.2710000000000008},"last":1.1639999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.0790000000000002,"15min":1.3120000000000001},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0910000000000002,"5min":15.048,"15min":15.048},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.6970000000000001,"15min":1.212},"min":{"1min":0.38100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":5.3360000000000003,"5min":11.56,"15min":11.56},"last":1.294}]},{"osd":7,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":3.915,"15min":1.9730000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":2.8370000000000002,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.355},{"interface":"front","average":{"1min":1.216,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.436,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.1429999999999998,"5min":12.679,"15min":12.679},"last":1.3200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575183,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":2.1960000000000002,"15min":1.252},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":10.419,"5min":28.303999999999998,"15min":28.303999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.901,"15min":1.1839999999999999},"min":{"1min":0.34699999999999998,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.505000000000001,"5min":16.119,"15min":16.119},"last":0.97799999999999998}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":2.6309999999999998,"15min":1.4219999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.977,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.593,"15min":1.077},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9969999999999999,"5min":16.904,"15min":16.904},"last":0.71499999999999997}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":2.6890000000000001,"15min":1.478},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":11.013999999999999,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.873},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3200000000000001,"15min":0.99199999999999999},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":4.024,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.93400000000000005}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":2.6030000000000002,"15min":1.5229999999999999},"min":{"1min":0.33700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.471,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0649999999999999,"5min":2.54,"15min":1.5009999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":3.1989999999999998,"5min":29.526,"15min":29.526},"last":1.1000000000000001}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":2.6779999999999999,"15min":1.4670000000000001},"min":{"1min":0.32500000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":10.808,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.756,"5min":1.782,"15min":1.177},"min":{"1min":0.41099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6699999999999999,"5min":14.863,"15min":14.863},"last":1.056}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":2.1120000000000001,"15min":1.327},"min":{"1min":0.38700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.554,"5min":33.198,"15min":33.198},"last":1.1379999999999999},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.0939999999999999,"15min":1.379},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.308},"max":{"1min":10.528,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.2090000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":3.5920000000000001,"15min":1.8440000000000001},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.9980000000000002,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.024},{"interface":"front","average":{"1min":1.762,"5min":3.7669999999999999,"15min":1.9490000000000001},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.37},"max":{"1min":6.0309999999999997,"5min":54.113,"15min":54.113},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834575182,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.603,"15min":0.95299999999999996},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":2.6429999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":1.6699999999999999,"15min":1.095},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.9980000000000002,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed May 8 20:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":1.6799999999999999,"15min":1.0269999999999999},"min":{"1min":0.215,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7330000000000001,"5min":16.355,"15min":16.355},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.0800000000000001,"15min":0.86599999999999999},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.706,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.59399999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.345,"15min":0.89500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":3.1059999999999999,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1,"15min":0.83499999999999996},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.95799999999999996,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.73199999999999998}]},{"osd":4,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.5700000000000001,"15min":1.075},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.0259999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.4059999999999999,"15min":1.03},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.0720000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":3.911,"15min":1.9179999999999999},"min":{"1min":0.373,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3300000000000001,"5min":117.105,"15min":117.105},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.706,"5min":1.7190000000000001,"15min":1.1559999999999999},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":6.3179999999999996,"5min":14.394,"15min":14.394},"last":1.0109999999999999}]},{"osd":6,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":2.1579999999999999,"15min":1.331},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.5979999999999999,"5min":16.113,"15min":16.113},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.7669999999999999,"15min":1.216},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":5.0730000000000004,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":2.0659999999999998,"15min":1.345},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.6749999999999998,"5min":16.977,"15min":16.977},"last":1.075},{"interface":"front","average":{"1min":1.117,"5min":1.903,"15min":1.306},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":3.669,"5min":15.289999999999999,"15min":15.289999999999999},"last":0.94799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575180,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":1.206,"15min":0.84199999999999997},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.84099999999999997,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":1.1970000000000001,"15min":0.91100000000000003},"min":{"1min":0.22500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":2.9449999999999998,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":1.0580000000000001,"15min":0.76800000000000002},"min":{"1min":0.188,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.0609999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.92200000000000004,"15min":0.76200000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.6459999999999999,"5min":6.7009999999999996,"15min":6.7009999999999996},"last":0.86399999999999999}]},{"osd":3,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.3440000000000001,"15min":0.93100000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":3.1259999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.1830000000000001,"15min":0.93100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.0939999999999999,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":1}]},{"osd":4,"last update":"Wed May 8 20:54:04 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":2.0379999999999998,"15min":1.234},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":10.257,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.8640000000000001,"15min":1.2350000000000001},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.6509999999999998,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":2.1509999999999998,"15min":1.319},"min":{"1min":0.31,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":5.6340000000000003,"5min":22.489000000000001,"15min":22.489000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.7969999999999999,"15min":1.238},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.9610000000000003,"5min":14.968999999999999,"15min":14.968999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.702,"15min":1.1739999999999999},"min":{"1min":0.34899999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.4460000000000002,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.6080000000000001,"15min":1.157},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":6.5039999999999996,"5min":12.553000000000001,"15min":12.553000000000001},"last":1.264}]},{"osd":7,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.141,"15min":1.405},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":13.663,"5min":13.663,"15min":13.663},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.526,"5min":2.5430000000000001,"15min":1.494},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.6970000000000001,"5min":19.201000000000001,"15min":19.201000000000001},"last":1.1419999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575181,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.0900000000000001,"15min":0.77400000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.044,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.44,"5min":1.4350000000000001,"15min":0.92900000000000005},"min":{"1min":0.20899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.149,"5min":21.094999999999999,"15min":21.094999999999999},"last":1.1140000000000001}]},{"osd":2,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.4330000000000001,"15min":0.88700000000000001},"min":{"1min":0.20000000000000001,"5min":0.192,"15min":0.188},"max":{"1min":3.2149999999999999,"5min":13.961,"15min":13.961},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.435,"5min":1.1479999999999999,"15min":0.84899999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.5009999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":2.8140000000000001,"15min":1.45},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":3.1819999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":2.0600000000000001,"15min":1.2170000000000001},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":3.0710000000000002,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.8220000000000001,"15min":1.139},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.2490000000000001,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.357,"15min":1.0349999999999999},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.097,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":1.038}]},{"osd":5,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":3.7799999999999998,"15min":1.863},"min":{"1min":0.33500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.0090000000000003,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.403,"5min":2.0609999999999999,"15min":1.3049999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.2439999999999998,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.175}]},{"osd":6,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":1.855,"15min":1.226},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":5.069,"5min":14.032,"15min":14.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.47,"15min":1.133},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":4.8540000000000001,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":3.0099999999999998,"15min":1.6679999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.2060000000000004,"5min":26.881,"15min":26.881},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.917,"15min":1.321},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.5060000000000002,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834575181,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.89900000000000002,"15min":0.70099999999999996},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.98999999999999999,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.748,"5min":1.2290000000000001,"15min":0.83999999999999997},"min":{"1min":0.17499999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.2589999999999999,"5min":13.305,"15min":13.305},"last":0.93300000000000005}]},{"osd":2,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.1850000000000001,"15min":0.82399999999999995},"min":{"1min":0.20699999999999999,"5min":0.20300000000000001,"15min":0.19700000000000001},"max":{"1min":3.0859999999999999,"5min":15.212,"15min":15.212},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.1100000000000001,"15min":0.82599999999999996},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":2.8660000000000001,"5min":15.138999999999999,"15min":15.138999999999999},"last":1.137}]},{"osd":3,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.0609999999999999,"15min":0.873},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":2.8980000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.746},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.115,"15min":0.95999999999999996},"min":{"1min":0.33400000000000002,"5min":0.30299999999999999,"15min":0.26300000000000001},"max":{"1min":2.9239999999999999,"5min":6.758,"15min":6.758},"last":1.095}]},{"osd":4,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.613,"15min":1.1040000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.242,"5min":18.407,"15min":18.407},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.6180000000000001,"15min":1.085},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.3240000000000001,"5min":18.466999999999999,"15min":18.466999999999999},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.246,"15min":1.3049999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":3.048,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.8220000000000001,"15min":1.1830000000000001},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.1840000000000002,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.1180000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.496,"15min":1.0960000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.0860000000000003,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.5609999999999999,"15min":1.123},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":3.6030000000000002,"5min":11.597,"15min":11.597},"last":0.97499999999999998}]},{"osd":7,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":2.3340000000000001,"15min":1.4059999999999999},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5259999999999998,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.232,"5min":2.3660000000000001,"15min":1.4930000000000001},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.5590000000000002,"5min":18.788,"15min":18.788},"last":1.206}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:54:39.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 Processor -- start 2024-05-08T20:54:40.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 -- start start 2024-05-08T20:54:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff770151740 0x7ff7700c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7701535a0 0x7ff77015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff770155060 con 0x7ff7700c1bb0 2024-05-08T20:54:40.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770155340 con 0x7ff770151740 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff774946640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff770155620 con 0x7ff7701535a0 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff770151740 0x7ff7700c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff770151740 0x7ff7700c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57012/0 (socket says 172.21.15.81:57012) 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 -- 172.21.15.81:0/1555573427 learned_addr learned my addr 172.21.15.81:0/1555573427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76ed9d640 1 --2- 172.21.15.81:0/1555573427 >> v2:172.21.15.117:3300/0 conn(0x7ff7701535a0 0x7ff77015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 -- 172.21.15.81:0/1555573427 >> v2:172.21.15.117:3300/0 conn(0x7ff7701535a0 msgr2=0x7ff77015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1555573427 >> v2:172.21.15.117:3300/0 conn(0x7ff7701535a0 0x7ff77015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 -- 172.21.15.81:0/1555573427 >> v1:172.21.15.117:6789/0 conn(0x7ff7700c1bb0 legacy=0x7ff770152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.133+0000 7ff76dd9b640 1 -- 172.21.15.81:0/1555573427 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770155900 con 0x7ff770151740 2024-05-08T20:54:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1555573427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770151740 0x7ff7700c1f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff77006f190 tx=0x7ff76801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee39d73c75f370d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76d59a640 1 -- 172.21.15.81:0/1555573427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680ab670 con 0x7ff770151740 2024-05-08T20:54:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76d59a640 1 -- 172.21.15.81:0/1555573427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7680ab7d0 con 0x7ff770151740 2024-05-08T20:54:40.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76d59a640 1 -- 172.21.15.81:0/1555573427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680abb60 con 0x7ff770151740 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1555573427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770151740 msgr2=0x7ff7700c1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- 172.21.15.81:0/1555573427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770151740 0x7ff7700c1f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff77006f190 tx=0x7ff76801c410 comp rx=0 tx=0).stop 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1555573427 shutdown_connections 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- 172.21.15.81:0/1555573427 >> v2:172.21.15.117:3300/0 conn(0x7ff7701535a0 0x7ff77015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- 172.21.15.81:0/1555573427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff770151740 0x7ff7700c1f90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1555573427 >> 172.21.15.81:0/1555573427 conn(0x7ff7700c2ca0 msgr2=0x7ff7700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1555573427 shutdown_connections 2024-05-08T20:54:40.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1555573427 wait complete. 2024-05-08T20:54:40.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 Processor -- start 2024-05-08T20:54:40.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- start start 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 0x7ff7700bb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 0x7ff7701eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701ee240 con 0x7ff7700c1bb0 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701eed80 con 0x7ff7701535a0 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701ee450 con 0x7ff770151740 2024-05-08T20:54:40.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57026/0 (socket says 172.21.15.81:57026) 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 -- 172.21.15.81:0/1992633960 learned_addr learned my addr 172.21.15.81:0/1992633960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76ed9d640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 0x7ff7701eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 0x7ff7700bb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 -- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 msgr2=0x7ff7700bb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 0x7ff7700bb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 -- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 msgr2=0x7ff7701eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 0x7ff7701eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 -- 172.21.15.81:0/1992633960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680094d0 con 0x7ff7700c1bb0 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76ed9d640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 0x7ff7701eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 0x7ff7700bb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff76e59c640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff76000b410 tx=0x7ff76000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:40.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004020 con 0x7ff7700c1bb0 2024-05-08T20:54:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760004180 con 0x7ff7700c1bb0 2024-05-08T20:54:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7701ee730 con 0x7ff7700c1bb0 2024-05-08T20:54:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011630 con 0x7ff7700c1bb0 2024-05-08T20:54:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.137+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700bf340 con 0x7ff7700c1bb0 2024-05-08T20:54:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770074950 con 0x7ff7700c1bb0 2024-05-08T20:54:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff760011790 con 0x7ff7700c1bb0 2024-05-08T20:54:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff766ffd640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 0x7ff750068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff760084210 con 0x7ff7700c1bb0 2024-05-08T20:54:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 0x7ff750068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.141+0000 7ff76dd9b640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 0x7ff750068b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff7680af000 tx=0x7ff768008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.145+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff760051270 con 0x7ff7700c1bb0 2024-05-08T20:54:40.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.305+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7700c39a0 con 0x7ff7700c1bb0 2024-05-08T20:54:40.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff766ffd640 1 -- 172.21.15.81:0/1992633960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7ff760054890 con 0x7ff7700c1bb0 2024-05-08T20:54:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:40.310 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 msgr2=0x7ff750068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 0x7ff750068b80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff7680af000 tx=0x7ff768008040 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 msgr2=0x7ff77014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff76000b410 tx=0x7ff76000b8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 shutdown_connections 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7500666c0 0x7ff750068b80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7701535a0 0x7ff7701eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff770151740 0x7ff7700bb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 --2- 172.21.15.81:0/1992633960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7700c1bb0 0x7ff77014e6a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 >> 172.21.15.81:0/1992633960 conn(0x7ff7700c2ca0 msgr2=0x7ff7700c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 shutdown_connections 2024-05-08T20:54:40.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:40.309+0000 7ff774946640 1 -- 172.21.15.81:0/1992633960 wait complete. 2024-05-08T20:54:41.331 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T20:54:41.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:41.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 Processor -- start 2024-05-08T20:54:41.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 -- start start 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b806b3f0 0x7f51b806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51b806be50 0x7f51b80ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b806c610 con 0x7f51b814ff30 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b806cb40 con 0x7f51b806be50 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bf1c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8153530 con 0x7f51b806b3f0 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51b806be50 0x7f51b80ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51b806be50 0x7f51b80ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57042/0 (socket says 172.21.15.81:57042) 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 -- 172.21.15.81:0/1344734413 learned_addr learned my addr 172.21.15.81:0/1344734413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bcf62640 1 --1- 172.21.15.81:0/1344734413 >> v1:172.21.15.81:6789/0 conn(0x7f51b814ff30 0x7f51b806cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46190/0 (socket says 172.21.15.81:46190) 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51b7fff640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b806b3f0 0x7f51b806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 -- 172.21.15.81:0/1344734413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b806b3f0 msgr2=0x7f51b806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b806b3f0 0x7f51b806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 -- 172.21.15.81:0/1344734413 >> v1:172.21.15.81:6789/0 conn(0x7f51b814ff30 legacy=0x7f51b806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.465+0000 7f51bd763640 1 -- 172.21.15.81:0/1344734413 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8150310 con 0x7f51b806be50 2024-05-08T20:54:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bd763640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80ab5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf031e09cf709f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51b77fe640 1 -- 172.21.15.81:0/1344734413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80ab660 con 0x7f51b806be50 2024-05-08T20:54:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51b77fe640 1 -- 172.21.15.81:0/1344734413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a80ab7c0 con 0x7f51b806be50 2024-05-08T20:54:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51b77fe640 1 -- 172.21.15.81:0/1344734413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80abb50 con 0x7f51b806be50 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 -- 172.21.15.81:0/1344734413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 msgr2=0x7f51b80ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80ab5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009870 tx=0x7f51a801c440 comp rx=0 tx=0).stop 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 -- 172.21.15.81:0/1344734413 shutdown_connections 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80ab5d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/1344734413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b806b3f0 0x7f51b806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 -- 172.21.15.81:0/1344734413 >> 172.21.15.81:0/1344734413 conn(0x7f51b80c2d10 msgr2=0x7f51b80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 -- 172.21.15.81:0/1344734413 shutdown_connections 2024-05-08T20:54:41.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.469+0000 7f51bf1c6640 1 -- 172.21.15.81:0/1344734413 wait complete. 2024-05-08T20:54:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 Processor -- start 2024-05-08T20:54:41.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- start start 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b806b3f0 0x7f51b80c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b814ff30 0x7f51b80bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80c59f0 con 0x7f51b806be50 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80aa140 con 0x7f51b806b3f0 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b814a0a0 con 0x7f51b814ff30 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57044/0 (socket says 172.21.15.81:57044) 2024-05-08T20:54:41.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 -- 172.21.15.81:0/241326970 learned_addr learned my addr 172.21.15.81:0/241326970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bd763640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b814ff30 0x7f51b80bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bcf62640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b806b3f0 0x7f51b80c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 -- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b814ff30 msgr2=0x7f51b80bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b814ff30 0x7f51b80bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 -- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b806b3f0 msgr2=0x7f51b80c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b806b3f0 0x7f51b80c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80094d0 con 0x7f51b806be50 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bd763640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b814ff30 0x7f51b80bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b7fff640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80c54b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d5f0 tx=0x7f51ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0125f0 con 0x7f51b806be50 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac012750 con 0x7f51b806be50 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b80c51d0 con 0x7f51b806be50 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac012ae0 con 0x7f51b806be50 2024-05-08T20:54:41.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b80a9dd0 con 0x7f51b806be50 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.473+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51b814d960 con 0x7f51b806be50 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51ac012c40 con 0x7f51b806be50 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51a40666c0 0x7f51a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f51ac084960 con 0x7f51b806be50 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51bcf62640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51a40666c0 0x7f51a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f51a4071060 0x7f51a40734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51a4073bb0 con 0x7f51a4071060 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51ac0892c0 con 0x7f51b806be50 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51bd763640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f51a4071060 0x7f51a40734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51bcf62640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51a40666c0 0x7f51a4068b80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f51b0007fd0 tx=0x7f51b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51bd763640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f51a4071060 0x7f51a40734e0 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.477+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== osd.0 v2:172.21.15.81:6824/27589 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f51a4073bb0 con 0x7f51a4071060 2024-05-08T20:54:41.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 --> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51b80a9950 con 0x7f51a4071060 2024-05-08T20:54:41.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51b57fa640 1 -- 172.21.15.81:0/241326970 <== osd.0 v2:172.21.15.81:6824/27589 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f51b80a9950 con 0x7f51a4071060 2024-05-08T20:54:41.493 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:41.493 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:41.493 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f51a4071060 msgr2=0x7f51a40734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6824/27589,v1:172.21.15.81:6825/27589] conn(0x7f51a4071060 0x7f51a40734e0 crc :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51a40666c0 msgr2=0x7f51a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f51a40666c0 0x7f51a4068b80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f51b0007fd0 tx=0x7f51b0009040 comp rx=0 tx=0).stop 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 msgr2=0x7f51b80c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 --2- 172.21.15.81:0/241326970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b806be50 0x7f51b80c54b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d5f0 tx=0x7f51ac00dab0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bd763640 1 -- 172.21.15.81:0/241326970 reap_dead start 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 shutdown_connections 2024-05-08T20:54:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 >> 172.21.15.81:0/241326970 conn(0x7f51b80c2d10 msgr2=0x7f51b815c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 shutdown_connections 2024-05-08T20:54:41.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.489+0000 7f51bf1c6640 1 -- 172.21.15.81:0/241326970 wait complete. 2024-05-08T20:54:41.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T20:54:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 Processor -- start 2024-05-08T20:54:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 -- start start 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81fc1501e0 0x7f81fc06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc0c0650 con 0x7f81fc0725f0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc06fa80 con 0x7f81fc06f400 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f8201d46640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc06fd60 con 0x7f81fc1501e0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81faffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f81fc0725f0 0x7f81fc0c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46192/0 (socket says 172.21.15.81:46192) 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81faffd640 1 -- 172.21.15.81:0/3905050769 learned_addr learned my addr 172.21.15.81:0/3905050769 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/3905050769 >> v2:172.21.15.117:3300/0 conn(0x7f81fc1501e0 0x7f81fc06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431218265 0 0) 0x7f81fc0c0650 con 0x7f81fc0725f0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e8003530 con 0x7f81fc0725f0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088418330 0 0) 0x7f81e8003530 con 0x7f81fc0725f0 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 >> v2:172.21.15.117:3300/0 conn(0x7f81fc1501e0 msgr2=0x7f81fc06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 --2- 172.21.15.81:0/3905050769 >> v2:172.21.15.117:3300/0 conn(0x7f81fc1501e0 0x7f81fc06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 >> v1:172.21.15.117:6789/0 conn(0x7f81fc06f400 legacy=0x7f81fc0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc071ea0 con 0x7f81fc0725f0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f81e4001680 con 0x7f81fc0725f0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 >> v1:172.21.15.81:6789/0 conn(0x7f81fc0725f0 legacy=0x7f81fc0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81e8003980 0x7f81e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 0x7f81e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80052b0 0x7f81e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc06fd60 con 0x7f81e80047d0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e800c180 con 0x7f81e8003980 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.629+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e800c340 con 0x7f81e80052b0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 0x7f81e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81e8003980 0x7f81e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fbfff640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80052b0 0x7f81e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 -- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80052b0 msgr2=0x7f81e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80052b0 0x7f81e800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 -- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81e8003980 msgr2=0x7f81e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81e8003980 0x7f81e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 -- 172.21.15.81:0/3905050769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8003530 con 0x7f81e80047d0 2024-05-08T20:54:41.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fbfff640 1 -- 172.21.15.81:0/3905050769 reap_dead start 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81faffd640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 0x7f81e8004c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c210 tx=0x7f81e401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46689fafe430ff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40058e0 con 0x7f81e80047d0 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4005a40 con 0x7f81e80047d0 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f81fa7fc640 1 -- 172.21.15.81:0/3905050769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4005e70 con 0x7f81e80047d0 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 -- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 msgr2=0x7f81e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 0x7f81e8004c50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81e400c210 tx=0x7f81e401cc20 comp rx=0 tx=0).stop 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 -- 172.21.15.81:0/3905050769 shutdown_connections 2024-05-08T20:54:41.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 --2- 172.21.15.81:0/3905050769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81e80047d0 0x7f81e8004c50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 -- 172.21.15.81:0/3905050769 >> 172.21.15.81:0/3905050769 conn(0x7f81fc0c2ca0 msgr2=0x7f81fc0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 -- 172.21.15.81:0/3905050769 shutdown_connections 2024-05-08T20:54:41.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.633+0000 7f8201d46640 1 -- 172.21.15.81:0/3905050769 wait complete. 2024-05-08T20:54:41.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 Processor -- start 2024-05-08T20:54:41.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- start start 2024-05-08T20:54:41.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80047d0 0x7f81fc0bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81fc143020 0x7f81fc1e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc072180 con 0x7f81fc0c50c0 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1424b0 con 0x7f81fc143020 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0aae70 con 0x7f81e80047d0 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57060/0 (socket says 172.21.15.81:57060) 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 -- 172.21.15.81:0/2644392693 learned_addr learned my addr 172.21.15.81:0/2644392693 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81fbfff640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81fc143020 0x7f81fc1e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80047d0 0x7f81fc0bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 -- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80047d0 msgr2=0x7f81fc0bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80047d0 0x7f81fc0bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 -- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81fc143020 msgr2=0x7f81fc1e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81fc143020 0x7f81fc1e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 -- 172.21.15.81:0/2644392693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc1410e0 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81faffd640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f81e401ca50 tx=0x7f81e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40b4070 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40010a0 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc0c5550 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4001660 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc1e0ca0 con 0x7f81fc0c50c0 2024-05-08T20:54:41.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc14e1a0 con 0x7f81fc0c50c0 2024-05-08T20:54:41.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.637+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81e4007090 con 0x7f81fc0c50c0 2024-05-08T20:54:41.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.641+0000 7f81f3fff640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 0x7f81dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.641+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 0x7f81dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.641+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f81e411df50 con 0x7f81fc0c50c0 2024-05-08T20:54:41.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.641+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 0x7f81dc068b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007520 tx=0x7f81f400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.645+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f81e40eafb0 con 0x7f81fc0c50c0 2024-05-08T20:54:41.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.801+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f81fc074930 con 0x7f81dc066690 2024-05-08T20:54:41.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.801+0000 7f81f3fff640 1 -- 172.21.15.81:0/2644392693 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81fc074930 con 0x7f81dc066690 2024-05-08T20:54:41.805 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T20:54:41.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 msgr2=0x7f81dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 0x7f81dc068b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007520 tx=0x7f81f400b040 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 msgr2=0x7f81fc1e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f81e401ca50 tx=0x7f81e8005800 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 shutdown_connections 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f81dc066690 0x7f81dc068b50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81fc143020 0x7f81fc1e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc0c50c0 0x7f81fc1e0220 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 --2- 172.21.15.81:0/2644392693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81e80047d0 0x7f81fc0bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 >> 172.21.15.81:0/2644392693 conn(0x7f81fc0c2ca0 msgr2=0x7f81fc14e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 shutdown_connections 2024-05-08T20:54:41.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.805+0000 7f8201d46640 1 -- 172.21.15.81:0/2644392693 wait complete. 2024-05-08T20:54:41.825 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T20:54:41.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:41.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 Processor -- start 2024-05-08T20:54:41.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 -- start start 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0bd9b0 0x7f59dc1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc06b850 0x7f59dc154f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0c4d90 con 0x7f59dc0af930 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0afd10 con 0x7f59dc06b850 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e2b0a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06b440 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc06b850 0x7f59dc154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59dc06b850 0x7f59dc154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57068/0 (socket says 172.21.15.81:57068) 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 -- 172.21.15.81:0/2492271109 learned_addr learned my addr 172.21.15.81:0/2492271109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59dbfff640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0bd9b0 0x7f59dc1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 -- 172.21.15.81:0/2492271109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0bd9b0 msgr2=0x7f59dc1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0bd9b0 0x7f59dc1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 -- 172.21.15.81:0/2492271109 >> v1:172.21.15.117:6789/0 conn(0x7f59dc0af930 legacy=0x7f59dc0ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:41.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.945+0000 7f59e10a7640 1 -- 172.21.15.81:0/2492271109 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc158e50 con 0x7f59dc06b850 2024-05-08T20:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e10a7640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc06b850 0x7f59dc154f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009870 tx=0x7f59d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6223dc1237fc801d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59db7fe640 1 -- 172.21.15.81:0/2492271109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40a6040 con 0x7f59dc06b850 2024-05-08T20:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59db7fe640 1 -- 172.21.15.81:0/2492271109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d40aa600 con 0x7f59dc06b850 2024-05-08T20:54:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59db7fe640 1 -- 172.21.15.81:0/2492271109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40aa990 con 0x7f59dc06b850 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- 172.21.15.81:0/2492271109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc06b850 msgr2=0x7f59dc154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc06b850 0x7f59dc154f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009870 tx=0x7f59d401c4a0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- 172.21.15.81:0/2492271109 shutdown_connections 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc06b850 0x7f59dc154f30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/2492271109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0bd9b0 0x7f59dc1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- 172.21.15.81:0/2492271109 >> 172.21.15.81:0/2492271109 conn(0x7f59dc0715f0 msgr2=0x7f59dc071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- 172.21.15.81:0/2492271109 shutdown_connections 2024-05-08T20:54:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- 172.21.15.81:0/2492271109 wait complete. 2024-05-08T20:54:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 Processor -- start 2024-05-08T20:54:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.949+0000 7f59e2b0a640 1 -- start start 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59dc06b850 0x7f59dc0c0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0af930 0x7f59dc150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 0x7f59dc1f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0bf780 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c0da0 con 0x7f59dc06b850 2024-05-08T20:54:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c0f80 con 0x7f59dc0af930 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 0x7f59dc1f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 0x7f59dc1f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57084/0 (socket says 172.21.15.81:57084) 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 -- 172.21.15.81:0/3346979541 learned_addr learned my addr 172.21.15.81:0/3346979541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59dbfff640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0af930 0x7f59dc150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e08a6640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59dc06b850 0x7f59dc0c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 -- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0af930 msgr2=0x7f59dc150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59dc0af930 0x7f59dc150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 -- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59dc06b850 msgr2=0x7f59dc0c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59dc06b850 0x7f59dc0c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094d0 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e08a6640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59dc06b850 0x7f59dc0c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e10a7640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 0x7f59dc1f0c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f59d401a0d0 tx=0x7f59d401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40b3600 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d40b3760 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0c0460 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40b3ad0 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc0abaf0 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59dc0c4110 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59d40b3c30 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f59c8066690 0x7f59c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f59d411f230 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e08a6640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f59c8066690 0x7f59c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f59c8071030 0x7f59c80734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59c8073b80 con 0x7f59c8071030 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59d411f680 con 0x7f59dc0bd9b0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59dbfff640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f59c8071030 0x7f59c80734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.953+0000 7f59e08a6640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f59c8066690 0x7f59c8068b50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f59cc007fd0 tx=0x7f59cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.957+0000 7f59dbfff640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f59c8071030 0x7f59c80734b0 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:41.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.957+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== osd.1 v2:172.21.15.81:6807/27590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f59c8073b80 con 0x7f59c8071030 2024-05-08T20:54:41.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 --> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59dc0c5200 con 0x7f59c8071030 2024-05-08T20:54:41.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59d97fa640 1 -- 172.21.15.81:0/3346979541 <== osd.1 v2:172.21.15.81:6807/27590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f59d00093c0 con 0x7f59c8071030 2024-05-08T20:54:41.971 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:41.971 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:41.972 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:41.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f59c8071030 msgr2=0x7f59c80734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6807/27590,v1:172.21.15.81:6809/27590] conn(0x7f59c8071030 0x7f59c80734b0 crc :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f59c8066690 msgr2=0x7f59c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f59c8066690 0x7f59c8068b50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f59cc007fd0 tx=0x7f59cc009040 comp rx=0 tx=0).stop 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 msgr2=0x7f59dc1f0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 --2- 172.21.15.81:0/3346979541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59dc0bd9b0 0x7f59dc1f0c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f59d401a0d0 tx=0x7f59d401ace0 comp rx=0 tx=0).stop 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e10a7640 1 -- 172.21.15.81:0/3346979541 reap_dead start 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 shutdown_connections 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 >> 172.21.15.81:0/3346979541 conn(0x7f59dc0715f0 msgr2=0x7f59dc0c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 shutdown_connections 2024-05-08T20:54:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:41.969+0000 7f59e2b0a640 1 -- 172.21.15.81:0/3346979541 wait complete. 2024-05-08T20:54:41.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T20:54:42.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 Processor -- start 2024-05-08T20:54:42.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 -- start start 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1781501e0 0x7fd17806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd17806f400 0x7fd1780c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1780c0650 con 0x7fd1780725f0 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17806fd60 con 0x7fd17806f400 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17cd6b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178072180 con 0x7fd1781501e0 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd175d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1780725f0 0x7fd1780c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46206/0 (socket says 172.21.15.81:46206) 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd175d9b640 1 -- 172.21.15.81:0/218208645 learned_addr learned my addr 172.21.15.81:0/218208645 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd176d9d640 1 --2- 172.21.15.81:0/218208645 >> v2:172.21.15.81:3300/0 conn(0x7fd17806f400 0x7fd1780c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd17659c640 1 --2- 172.21.15.81:0/218208645 >> v2:172.21.15.117:3300/0 conn(0x7fd1781501e0 0x7fd17806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd176d9d640 1 -- 172.21.15.81:0/218208645 >> v2:172.21.15.117:3300/0 conn(0x7fd1781501e0 msgr2=0x7fd17806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd176d9d640 1 --2- 172.21.15.81:0/218208645 >> v2:172.21.15.117:3300/0 conn(0x7fd1781501e0 0x7fd17806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd176d9d640 1 -- 172.21.15.81:0/218208645 >> v1:172.21.15.81:6789/0 conn(0x7fd1780725f0 legacy=0x7fd1780c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.101+0000 7fd176d9d640 1 -- 172.21.15.81:0/218208645 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17806fa80 con 0x7fd17806f400 2024-05-08T20:54:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd176d9d640 1 --2- 172.21.15.81:0/218208645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17806f400 0x7fd1780c2350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd17806ae70 tx=0x7fd17001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50312261d2cd6f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17559a640 1 -- 172.21.15.81:0/218208645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700a58c0 con 0x7fd17806f400 2024-05-08T20:54:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17559a640 1 -- 172.21.15.81:0/218208645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700a5a20 con 0x7fd17806f400 2024-05-08T20:54:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17559a640 1 -- 172.21.15.81:0/218208645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700a5db0 con 0x7fd17806f400 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- 172.21.15.81:0/218208645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17806f400 msgr2=0x7fd1780c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/218208645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17806f400 0x7fd1780c2350 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd17806ae70 tx=0x7fd17001c7e0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- 172.21.15.81:0/218208645 shutdown_connections 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/218208645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd17806f400 0x7fd1780c2350 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/218208645 >> v2:172.21.15.117:3300/0 conn(0x7fd1781501e0 0x7fd17806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- 172.21.15.81:0/218208645 >> 172.21.15.81:0/218208645 conn(0x7fd1780c2ca0 msgr2=0x7fd1780c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- 172.21.15.81:0/218208645 shutdown_connections 2024-05-08T20:54:42.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- 172.21.15.81:0/218208645 wait complete. 2024-05-08T20:54:42.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 Processor -- start 2024-05-08T20:54:42.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- start start 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 0x7fd17806b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1780725f0 0x7fd17813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781483f0 con 0x7fd1781501e0 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17813cef0 con 0x7fd17806f400 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.105+0000 7fd17cd6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17806bf90 con 0x7fd1780725f0 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57104/0 (socket says 172.21.15.81:57104) 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 -- 172.21.15.81:0/1673962073 learned_addr learned my addr 172.21.15.81:0/1673962073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17659c640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 0x7fd17806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd175d9b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1780725f0 0x7fd17813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 -- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1780725f0 msgr2=0x7fd17813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1780725f0 0x7fd17813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 -- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 msgr2=0x7fd17806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 0x7fd17806b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 -- 172.21.15.81:0/1673962073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170009a70 con 0x7fd1781501e0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17659c640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 0x7fd17806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd176d9d640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b0040 tx=0x7fd170019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700ad640 con 0x7fd1781501e0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700ad7a0 con 0x7fd1781501e0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178150740 con 0x7fd1781501e0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700adb70 con 0x7fd1781501e0 2024-05-08T20:54:42.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17814a2b0 con 0x7fd1781501e0 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd178148560 con 0x7fd1781501e0 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1700b4050 con 0x7fd1781501e0 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 0x7fd158068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fd17011f400 con 0x7fd1781501e0 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17659c640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 0x7fd158068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.109+0000 7fd17659c640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 0x7fd158068b50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd178153070 tx=0x7fd168008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.113+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd1700ec500 con 0x7fd1781501e0 2024-05-08T20:54:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1780ab5d0 con 0x7fd158066690 2024-05-08T20:54:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd166ffd640 1 -- 172.21.15.81:0/1673962073 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd1780ab5d0 con 0x7fd158066690 2024-05-08T20:54:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T20:54:42.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 msgr2=0x7fd158068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 0x7fd158068b50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd178153070 tx=0x7fd168008040 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 msgr2=0x7fd17813c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b0040 tx=0x7fd170019580 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 shutdown_connections 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fd158066690 0x7fd158068b50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1781501e0 0x7fd17813c9b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1780725f0 0x7fd17813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 --2- 172.21.15.81:0/1673962073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd17806f400 0x7fd17806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.261+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 >> 172.21.15.81:0/1673962073 conn(0x7fd1780c2ca0 msgr2=0x7fd17814d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.265+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 shutdown_connections 2024-05-08T20:54:42.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.265+0000 7fd17cd6b640 1 -- 172.21.15.81:0/1673962073 wait complete. 2024-05-08T20:54:42.281 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T20:54:42.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 Processor -- start 2024-05-08T20:54:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 -- start start 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 0x7f056c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c155990 0x7f056c06c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06f710 con 0x7f056c155990 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c154c70 con 0x7f056c14edb0 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0573005640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0aba40 con 0x7f056c152100 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c155990 0x7f056c06c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f056c155990 0x7f056c06c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57106/0 (socket says 172.21.15.81:57106) 2024-05-08T20:54:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 -- 172.21.15.81:0/2009512996 learned_addr learned my addr 172.21.15.81:0/2009512996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0570da1640 1 --2- 172.21.15.81:0/2009512996 >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 0x7f056c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f056bfff640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 -- 172.21.15.81:0/2009512996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 msgr2=0x7f056c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 -- 172.21.15.81:0/2009512996 >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 msgr2=0x7f056c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 --2- 172.21.15.81:0/2009512996 >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 0x7f056c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f05715a2640 1 -- 172.21.15.81:0/2009512996 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0abd20 con 0x7f056c155990 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f0570da1640 1 --2- 172.21.15.81:0/2009512996 >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 0x7f056c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.405+0000 7f056bfff640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f05715a2640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c155990 0x7f056c06c500 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f056c06d310 tx=0x7f056401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef21872cc7e0e16f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f056b7fe640 1 -- 172.21.15.81:0/2009512996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a56d0 con 0x7f056c155990 2024-05-08T20:54:42.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f056b7fe640 1 -- 172.21.15.81:0/2009512996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640a5830 con 0x7f056c155990 2024-05-08T20:54:42.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f056b7fe640 1 -- 172.21.15.81:0/2009512996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5bc0 con 0x7f056c155990 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- 172.21.15.81:0/2009512996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c155990 msgr2=0x7f056c06c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c155990 0x7f056c06c500 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f056c06d310 tx=0x7f056401c960 comp rx=0 tx=0).stop 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- 172.21.15.81:0/2009512996 shutdown_connections 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 --2- 172.21.15.81:0/2009512996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c155990 0x7f056c06c500 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 --2- 172.21.15.81:0/2009512996 >> v2:172.21.15.117:3300/0 conn(0x7f056c14edb0 0x7f056c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- 172.21.15.81:0/2009512996 >> 172.21.15.81:0/2009512996 conn(0x7f056c0c2d10 msgr2=0x7f056c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- 172.21.15.81:0/2009512996 shutdown_connections 2024-05-08T20:54:42.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- 172.21.15.81:0/2009512996 wait complete. 2024-05-08T20:54:42.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 Processor -- start 2024-05-08T20:54:42.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.409+0000 7f0573005640 1 -- start start 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 0x7f056c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c155990 0x7f056c1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14a650 con 0x7f056c14edb0 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0c5d60 con 0x7f056c155990 2024-05-08T20:54:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0c57d0 con 0x7f056c152100 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 0x7f056c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 0x7f056c0c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57114/0 (socket says 172.21.15.81:57114) 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 -- 172.21.15.81:0/2666387203 learned_addr learned my addr 172.21.15.81:0/2666387203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 -- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 msgr2=0x7f056c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05715a2640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c155990 0x7f056c1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f056bfff640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f056c152100 0x7f056c144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 -- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c155990 msgr2=0x7f056c1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c155990 0x7f056c1446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009b30 con 0x7f056c14edb0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05715a2640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f056c155990 0x7f056c1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0570da1640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 0x7f056c0c4ce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c7f0 tx=0x7f055c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c00cea0 con 0x7f056c14edb0 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c007a30 con 0x7f056c14edb0 2024-05-08T20:54:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0c5530 con 0x7f056c14edb0 2024-05-08T20:54:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c007dc0 con 0x7f056c14edb0 2024-05-08T20:54:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c147430 con 0x7f056c14edb0 2024-05-08T20:54:42.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f056c0c3a70 con 0x7f056c14edb0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f055c0113f0 con 0x7f056c14edb0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0558066690 0x7f0558068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f056bfff640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0558066690 0x7f0558068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.413+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f055c084c30 con 0x7f056c14edb0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05697fa640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f0558071030 0x7f05580734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0558073b80 con 0x7f0558071030 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f055c085080 con 0x7f056c14edb0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05715a2640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f0558071030 0x7f05580734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f056bfff640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0558066690 0x7f0558068b50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0560006fd0 tx=0x7f0560008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05715a2640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f0558071030 0x7f05580734b0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.417+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== osd.2 v2:172.21.15.81:6816/27592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0558073b80 con 0x7f0558071030 2024-05-08T20:54:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 --> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f056c074950 con 0x7f0558071030 2024-05-08T20:54:42.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f05697fa640 1 -- 172.21.15.81:0/2666387203 <== osd.2 v2:172.21.15.81:6816/27592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f056c074950 con 0x7f0558071030 2024-05-08T20:54:42.433 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:42.433 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:42.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:42.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f0558071030 msgr2=0x7f05580734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6816/27592,v1:172.21.15.81:6817/27592] conn(0x7f0558071030 0x7f05580734b0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0558066690 msgr2=0x7f0558068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0558066690 0x7f0558068b50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0560006fd0 tx=0x7f0560008040 comp rx=0 tx=0).stop 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 msgr2=0x7f056c0c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 --2- 172.21.15.81:0/2666387203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c14edb0 0x7f056c0c4ce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c7f0 tx=0x7f055c00ccb0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f05715a2640 1 -- 172.21.15.81:0/2666387203 reap_dead start 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 shutdown_connections 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 >> 172.21.15.81:0/2666387203 conn(0x7f056c0c2d10 msgr2=0x7f056c153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 shutdown_connections 2024-05-08T20:54:42.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.429+0000 7f0573005640 1 -- 172.21.15.81:0/2666387203 wait complete. 2024-05-08T20:54:42.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T20:54:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 Processor -- start 2024-05-08T20:54:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 -- start start 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbe141501e0 0x7fbe1406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbe140c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140c0650 con 0x7fbe1406f400 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1406fd60 con 0x7fbe141501e0 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe19aed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14072180 con 0x7fbe140725f0 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe1406f400 0x7fbe140c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46220/0 (socket says 172.21.15.81:46220) 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 -- 172.21.15.81:0/1228709866 learned_addr learned my addr 172.21.15.81:0/1228709866 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe12ffd640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbe140c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1228709866 >> v2:172.21.15.117:3300/0 conn(0x7fbe141501e0 0x7fbe1406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806570847 0 0) 0x7fbe140c0650 con 0x7fbe1406f400 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdfc003530 con 0x7fbe1406f400 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3733293293 0 0) 0x7fbdfc003530 con 0x7fbe1406f400 2024-05-08T20:54:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 msgr2=0x7fbe140c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbe140c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 >> v2:172.21.15.117:3300/0 conn(0x7fbe141501e0 msgr2=0x7fbe1406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 --2- 172.21.15.81:0/1228709866 >> v2:172.21.15.117:3300/0 conn(0x7fbe141501e0 0x7fbe1406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1406fa80 con 0x7fbe1406f400 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fbe0c001a00 con 0x7fbe1406f400 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 >> v1:172.21.15.81:6789/0 conn(0x7fbe1406f400 legacy=0x7fbe140c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdfc003980 0x7fbdfc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbdfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdfc004d10 0x7fbdfc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1406fd60 con 0x7fbdfc004d10 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14072180 con 0x7fbdfc003980 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc00ba10 con 0x7fbe140725f0 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdfc004d10 0x7fbdfc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdfc003980 0x7fbdfc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe12ffd640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbdfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 -- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 msgr2=0x7fbdfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe140725f0 0x7fbdfc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 -- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdfc003980 msgr2=0x7fbdfc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdfc003980 0x7fbdfc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe13fff640 1 -- 172.21.15.81:0/1228709866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc003530 con 0x7fbdfc004d10 2024-05-08T20:54:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.561+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdfc003980 0x7fbdfc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe13fff640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdfc004d10 0x7fbdfc005190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00a8d0 tx=0x7fbe0c01d3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9937ea41670ba424 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0ad630 con 0x7fbdfc004d10 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0a8070 con 0x7fbdfc004d10 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe127fc640 1 -- 172.21.15.81:0/1228709866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0ad9d0 con 0x7fbdfc004d10 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- 172.21.15.81:0/1228709866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdfc004d10 msgr2=0x7fbdfc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1228709866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdfc004d10 0x7fbdfc005190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00a8d0 tx=0x7fbe0c01d3d0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe13fff640 1 -- 172.21.15.81:0/1228709866 reap_dead start 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- 172.21.15.81:0/1228709866 shutdown_connections 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- 172.21.15.81:0/1228709866 >> 172.21.15.81:0/1228709866 conn(0x7fbe140c2ca0 msgr2=0x7fbe140c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- 172.21.15.81:0/1228709866 shutdown_connections 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- 172.21.15.81:0/1228709866 wait complete. 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 Processor -- start 2024-05-08T20:54:42.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- start start 2024-05-08T20:54:42.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe141422a0 0x7fbe140c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe140c5370 0x7fbe140c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14142700 con 0x7fbe14141ec0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140c4d50 con 0x7fbe140c5370 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe19aed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14158870 con 0x7fbe141422a0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57134/0 (socket says 172.21.15.81:57134) 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 -- 172.21.15.81:0/1442970414 learned_addr learned my addr 172.21.15.81:0/1442970414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe13fff640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe140c5370 0x7fbe140c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe12ffd640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe141422a0 0x7fbe140c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 -- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe141422a0 msgr2=0x7fbe140c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe141422a0 0x7fbe140c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 -- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe140c5370 msgr2=0x7fbe140c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe140c5370 0x7fbe140c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.565+0000 7fbe137fe640 1 -- 172.21.15.81:0/1442970414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14150740 con 0x7fbe14141ec0 2024-05-08T20:54:42.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe137fe640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe04010950 tx=0x7fbe04010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004220 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04004380 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14158b50 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400ebc0 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141465e0 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe14074950 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe0400ed20 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbe040843e0 con 0x7fbe14141ec0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe12ffd640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.569+0000 7fbe12ffd640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 0x7fbe00068b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbe141e8d30 tx=0x7fbe08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.573+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe04051440 con 0x7fbe14141ec0 2024-05-08T20:54:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.729+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe1406d4a0 con 0x7fbe000666c0 2024-05-08T20:54:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.729+0000 7fbdfbfff640 1 -- 172.21.15.81:0/1442970414 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbe1406d4a0 con 0x7fbe000666c0 2024-05-08T20:54:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T20:54:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 msgr2=0x7fbe00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 0x7fbe00068b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbe141e8d30 tx=0x7fbe08008040 comp rx=0 tx=0).stop 2024-05-08T20:54:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 msgr2=0x7fbe14158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe04010950 tx=0x7fbe04010e10 comp rx=0 tx=0).stop 2024-05-08T20:54:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 shutdown_connections 2024-05-08T20:54:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe140c5370 0x7fbe140c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbe141422a0 0x7fbe140c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 --2- 172.21.15.81:0/1442970414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe14141ec0 0x7fbe14158220 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 >> 172.21.15.81:0/1442970414 conn(0x7fbe140c2ca0 msgr2=0x7fbe14144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 shutdown_connections 2024-05-08T20:54:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.733+0000 7fbe19aed640 1 -- 172.21.15.81:0/1442970414 wait complete. 2024-05-08T20:54:42.751 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T20:54:42.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 Processor -- start 2024-05-08T20:54:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 -- start start 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 0x7f3cc006f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 0x7f3cc006cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cc006be50 0x7f3cc00ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc006cb40 con 0x7f3cc006be50 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc006c610 con 0x7f3cc014ff30 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cc56ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0153530 con 0x7f3cc006b3f0 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cc006be50 0x7f3cc00ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cc006be50 0x7f3cc00ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57136/0 (socket says 172.21.15.81:57136) 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 -- 172.21.15.81:0/2423204375 learned_addr learned my addr 172.21.15.81:0/2423204375 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 0x7f3cc006cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbeffd640 1 --2- 172.21.15.81:0/2423204375 >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 0x7f3cc006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 -- 172.21.15.81:0/2423204375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 msgr2=0x7f3cc006cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 0x7f3cc006cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 -- 172.21.15.81:0/2423204375 >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 msgr2=0x7f3cc006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/2423204375 >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 0x7f3cc006f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbf7fe640 1 -- 172.21.15.81:0/2423204375 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0150310 con 0x7f3cc006be50 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbeffd640 1 --2- 172.21.15.81:0/2423204375 >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 0x7f3cc006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.877+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 0x7f3cc006cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006be50 0x7f3cc00ab5d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0069860 tx=0x7f3cb801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae19c1158142907d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbdffb640 1 -- 172.21.15.81:0/2423204375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80a5770 con 0x7f3cc006be50 2024-05-08T20:54:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbdffb640 1 -- 172.21.15.81:0/2423204375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb80a58d0 con 0x7f3cc006be50 2024-05-08T20:54:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbdffb640 1 -- 172.21.15.81:0/2423204375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80a5c60 con 0x7f3cc006be50 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- 172.21.15.81:0/2423204375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006be50 msgr2=0x7f3cc00ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006be50 0x7f3cc00ab5d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0069860 tx=0x7f3cb801c8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- 172.21.15.81:0/2423204375 shutdown_connections 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006b3f0 0x7f3cc006cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/2423204375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006be50 0x7f3cc00ab5d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/2423204375 >> v2:172.21.15.117:3300/0 conn(0x7f3cc014ff30 0x7f3cc006f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- 172.21.15.81:0/2423204375 >> 172.21.15.81:0/2423204375 conn(0x7f3cc00c2d10 msgr2=0x7f3cc00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- 172.21.15.81:0/2423204375 shutdown_connections 2024-05-08T20:54:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- 172.21.15.81:0/2423204375 wait complete. 2024-05-08T20:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 Processor -- start 2024-05-08T20:54:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- start start 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 0x7f3cc014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc006be50 0x7f3cc01494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc014ff30 0x7f3cc0149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00bb6f0 con 0x7f3cc006b3f0 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01ec220 con 0x7f3cc006be50 2024-05-08T20:54:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cc56ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00bb990 con 0x7f3cc014ff30 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 0x7f3cc014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 0x7f3cc014a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57150/0 (socket says 172.21.15.81:57150) 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 -- 172.21.15.81:0/4161425190 learned_addr learned my addr 172.21.15.81:0/4161425190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc006be50 0x7f3cc01494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 -- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc014ff30 msgr2=0x7f3cc0149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc014ff30 0x7f3cc0149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc014ff30 0x7f3cc0149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 -- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc006be50 msgr2=0x7f3cc01494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc006be50 0x7f3cc01494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8009b30 con 0x7f3cc006b3f0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc006be50 0x7f3cc01494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.881+0000 7f3cbeffd640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 0x7f3cc014a440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000d800 tx=0x7f3cb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00096c0 con 0x7f3cc006b3f0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0009820 con 0x7f3cc006b3f0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc00bbc70 con 0x7f3cc006b3f0 2024-05-08T20:54:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0009bd0 con 0x7f3cc006b3f0 2024-05-08T20:54:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc01ebe10 con 0x7f3cc006b3f0 2024-05-08T20:54:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cc014e6f0 con 0x7f3cc006b3f0 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3cb0009d30 con 0x7f3cc006b3f0 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3cac066690 0x7f3cac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f3cb0085210 con 0x7f3cc006b3f0 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3cac066690 0x7f3cac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f3cac071030 0x7f3cac0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cac073b80 con 0x7f3cac071030 2024-05-08T20:54:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cb0085660 con 0x7f3cc006b3f0 2024-05-08T20:54:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f3cac071030 0x7f3cac0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cbe7fc640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3cac066690 0x7f3cac068b50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0072810 tx=0x7f3cb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3cbf7fe640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f3cac071030 0x7f3cac0734b0 crc :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.885+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== osd.3 v2:172.21.15.81:6800/27591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3cac073b80 con 0x7f3cac071030 2024-05-08T20:54:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 --> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3cc014bf90 con 0x7f3cac071030 2024-05-08T20:54:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3ca77fe640 1 -- 172.21.15.81:0/4161425190 <== osd.3 v2:172.21.15.81:6800/27591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3cc014bf90 con 0x7f3cac071030 2024-05-08T20:54:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:42.902 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f3cac071030 msgr2=0x7f3cac0734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6800/27591,v1:172.21.15.81:6801/27591] conn(0x7f3cac071030 0x7f3cac0734b0 crc :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3cac066690 msgr2=0x7f3cac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f3cac066690 0x7f3cac068b50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0072810 tx=0x7f3cb4008040 comp rx=0 tx=0).stop 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 msgr2=0x7f3cc014a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 --2- 172.21.15.81:0/4161425190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc006b3f0 0x7f3cc014a440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000d800 tx=0x7f3cb000dcc0 comp rx=0 tx=0).stop 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cbf7fe640 1 -- 172.21.15.81:0/4161425190 reap_dead start 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 shutdown_connections 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 >> 172.21.15.81:0/4161425190 conn(0x7f3cc00c2d10 msgr2=0x7f3cc015c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 shutdown_connections 2024-05-08T20:54:42.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:42.901+0000 7f3cc56ac640 1 -- 172.21.15.81:0/4161425190 wait complete. 2024-05-08T20:54:42.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T20:54:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.021+0000 7f914b929640 1 Processor -- start 2024-05-08T20:54:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.021+0000 7f914b929640 1 -- start start 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f914b929640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144158c60 0x7f91440c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f914b929640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f9144155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f914b929640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440c2fc0 con 0x7f914406e690 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f914b929640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440ad180 con 0x7f9144158c60 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f914b929640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914406d910 con 0x7f9144154fa0 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144158c60 0x7f91440c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9144158c60 0x7f91440c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57166/0 (socket says 172.21.15.81:57166) 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 -- 172.21.15.81:0/1884427058 learned_addr learned my addr 172.21.15.81:0/1884427058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f9149ec6640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f9144155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 -- 172.21.15.81:0/1884427058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 msgr2=0x7f9144155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f9144155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 -- 172.21.15.81:0/1884427058 >> v1:172.21.15.81:6789/0 conn(0x7f914406e690 legacy=0x7f9144069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 -- 172.21.15.81:0/1884427058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144154aa0 con 0x7f9144158c60 2024-05-08T20:54:43.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.025+0000 7f91496c5640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f91440c2a80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9140009e50 tx=0x7f914001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbebf2c60f8cf8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f913bfff640 1 -- 172.21.15.81:0/1884427058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400a5830 con 0x7f9144158c60 2024-05-08T20:54:43.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f913bfff640 1 -- 172.21.15.81:0/1884427058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400a5990 con 0x7f9144158c60 2024-05-08T20:54:43.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f913bfff640 1 -- 172.21.15.81:0/1884427058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400a5d20 con 0x7f9144158c60 2024-05-08T20:54:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1884427058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 msgr2=0x7f91440c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f91440c2a80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9140009e50 tx=0x7f914001c970 comp rx=0 tx=0).stop 2024-05-08T20:54:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1884427058 shutdown_connections 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f9144155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- 172.21.15.81:0/1884427058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f91440c2a80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1884427058 >> 172.21.15.81:0/1884427058 conn(0x7f91440c7010 msgr2=0x7f91440c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1884427058 shutdown_connections 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1884427058 wait complete. 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 Processor -- start 2024-05-08T20:54:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- start start 2024-05-08T20:54:43.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f914406e690 0x7f91441474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f914414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914414e0f0 con 0x7f9144158c60 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914415ebf0 con 0x7f914406e690 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144146740 con 0x7f9144154fa0 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57168/0 (socket says 172.21.15.81:57168) 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 -- 172.21.15.81:0/1577657578 learned_addr learned my addr 172.21.15.81:0/1577657578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f91496c5640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f914406e690 0x7f91441474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9148ec4640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f914414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 -- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 msgr2=0x7f914414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f914414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 -- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f914406e690 msgr2=0x7f91441474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f914406e690 0x7f91441474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 -- 172.21.15.81:0/1577657578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009b30 con 0x7f9144158c60 2024-05-08T20:54:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9149ec6640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c5c0 tx=0x7f913c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004220 con 0x7f9144158c60 2024-05-08T20:54:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c004380 con 0x7f9144158c60 2024-05-08T20:54:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9144146a20 con 0x7f9144158c60 2024-05-08T20:54:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c003840 con 0x7f9144158c60 2024-05-08T20:54:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.029+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914414b040 con 0x7f9144158c60 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144074950 con 0x7f9144158c60 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f913c0039a0 con 0x7f9144158c60 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f9139ffb640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f913c084170 con 0x7f9144158c60 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f91496c5640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.033+0000 7f91496c5640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 0x7f9128068b50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f91400ae000 tx=0x7f91400a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.037+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f913c0511d0 con 0x7f9144158c60 2024-05-08T20:54:43.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.181+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9144155990 con 0x7f9128066690 2024-05-08T20:54:43.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.181+0000 7f9139ffb640 1 -- 172.21.15.81:0/1577657578 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91400091d0 con 0x7f9128066690 2024-05-08T20:54:43.185 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 msgr2=0x7f9128068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 0x7f9128068b50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f91400ae000 tx=0x7f91400a7070 comp rx=0 tx=0).stop 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 msgr2=0x7f914414dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c5c0 tx=0x7f913c00ca80 comp rx=0 tx=0).stop 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 shutdown_connections 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9144158c60 0x7f914414dbb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9144154fa0 0x7f914414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 --2- 172.21.15.81:0/1577657578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f914406e690 0x7f91441474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 >> 172.21.15.81:0/1577657578 conn(0x7f91440c7010 msgr2=0x7f9144152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 shutdown_connections 2024-05-08T20:54:43.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.185+0000 7f914b929640 1 -- 172.21.15.81:0/1577657578 wait complete. 2024-05-08T20:54:43.204 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T20:54:43.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 Processor -- start 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 -- start start 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffaa8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaa8152100 0x7ffaa8155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa8154c70 con 0x7ffaa8155990 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa806f710 con 0x7ffaa8152100 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaacd7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80aba40 con 0x7ffaa814edb0 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaa6d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffaa8155990 0x7ffaa806c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46238/0 (socket says 172.21.15.81:46238) 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.313+0000 7ffaa6d9d640 1 -- 172.21.15.81:0/2622685881 learned_addr learned my addr 172.21.15.81:0/2622685881 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/2622685881 >> v2:172.21.15.117:3300/0 conn(0x7ffaa8152100 0x7ffaa8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa659c640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffaa8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634801133 0 0) 0x7ffaa8154c70 con 0x7ffaa8155990 2024-05-08T20:54:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90003530 con 0x7ffaa8155990 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536693503 0 0) 0x7ffa90003530 con 0x7ffaa8155990 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 msgr2=0x7ffaa8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffaa8152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 >> v2:172.21.15.117:3300/0 conn(0x7ffaa8152100 msgr2=0x7ffaa8155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 --2- 172.21.15.81:0/2622685881 >> v2:172.21.15.117:3300/0 conn(0x7ffaa8152100 0x7ffaa8155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80abd20 con 0x7ffaa8155990 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ffaa0001a00 con 0x7ffaa8155990 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 >> v1:172.21.15.81:6789/0 conn(0x7ffaa8155990 legacy=0x7ffaa806c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa90003980 0x7ffa90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa900047d0 0x7ffa90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffa90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80aba40 con 0x7ffa900047d0 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000b990 con 0x7ffa90003980 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000bad0 con 0x7ffaa814edb0 2024-05-08T20:54:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa900047d0 0x7ffa90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa659c640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa90003980 0x7ffa90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa6d9d640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffa90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 msgr2=0x7ffa90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaa814edb0 0x7ffa90005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa90003980 msgr2=0x7ffa90003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa90003980 0x7ffa90003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/2622685881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90003530 con 0x7ffa900047d0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa659c640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa90003980 0x7ffa90003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa900047d0 0x7ffa90004c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009b10 tx=0x7ffa9c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b804623b7318b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a8410 con 0x7ffa900047d0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0a8570 con 0x7ffa900047d0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa559a640 1 -- 172.21.15.81:0/2622685881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a8920 con 0x7ffa900047d0 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 -- 172.21.15.81:0/2622685881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa900047d0 msgr2=0x7ffa90004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 --2- 172.21.15.81:0/2622685881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa900047d0 0x7ffa90004c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009b10 tx=0x7ffa9c01cab0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaa6d9d640 1 -- 172.21.15.81:0/2622685881 reap_dead start 2024-05-08T20:54:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 -- 172.21.15.81:0/2622685881 shutdown_connections 2024-05-08T20:54:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 -- 172.21.15.81:0/2622685881 >> 172.21.15.81:0/2622685881 conn(0x7ffaa80c2d10 msgr2=0x7ffaa80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 -- 172.21.15.81:0/2622685881 shutdown_connections 2024-05-08T20:54:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.317+0000 7ffaacd7a640 1 -- 172.21.15.81:0/2622685881 wait complete. 2024-05-08T20:54:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 Processor -- start 2024-05-08T20:54:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- start start 2024-05-08T20:54:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa900047d0 0x7ffaa80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 0x7ffaa8159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa815a000 0x7ffaa81ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c5b90 con 0x7ffaa80c4650 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80aa400 con 0x7ffaa815a000 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80a9dd0 con 0x7ffa900047d0 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 0x7ffaa8159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 0x7ffaa8159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57190/0 (socket says 172.21.15.81:57190) 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/3426820502 learned_addr learned my addr 172.21.15.81:0/3426820502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa900047d0 msgr2=0x7ffaa80c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa900047d0 0x7ffaa80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa815a000 msgr2=0x7ffaa81ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa815a000 0x7ffaa81ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80c3fa0 con 0x7ffaa80c4650 2024-05-08T20:54:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaa5d9b640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 0x7ffaa8159ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c01c8e0 tx=0x7ffa9c019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00f000 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0a8d60 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80c4280 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c004220 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa80c5360 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaa81524e0 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.321+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa9c0a6040 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffa88066690 0x7ffa88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ffa9c11e640 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffaa659c640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffa88066690 0x7ffa88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7ffa88071030 0x7ffa880734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa88073b80 con 0x7ffa88071030 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa9c11ea90 con 0x7ffaa80c4650 2024-05-08T20:54:43.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffaa659c640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffa88066690 0x7ffa88068b50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81e90a0 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffaa6d9d640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7ffa88071030 0x7ffa880734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffaa6d9d640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7ffa88071030 0x7ffa880734b0 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.325+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== osd.4 v2:172.21.15.117:6800/27738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffa88073b80 con 0x7ffa88071030 2024-05-08T20:54:43.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.337+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 --> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffaa8074950 con 0x7ffa88071030 2024-05-08T20:54:43.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffa96ffd640 1 -- 172.21.15.81:0/3426820502 <== osd.4 v2:172.21.15.117:6800/27738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffaa8074950 con 0x7ffa88071030 2024-05-08T20:54:43.342 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:43.342 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7ffa88071030 msgr2=0x7ffa880734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.117:6800/27738,v1:172.21.15.117:6801/27738] conn(0x7ffa88071030 0x7ffa880734b0 crc :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffa88066690 msgr2=0x7ffa88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ffa88066690 0x7ffa88068b50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81e90a0 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 msgr2=0x7ffaa8159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 --2- 172.21.15.81:0/3426820502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa80c4650 0x7ffaa8159ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c01c8e0 tx=0x7ffa9c019850 comp rx=0 tx=0).stop 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaa6d9d640 1 -- 172.21.15.81:0/3426820502 reap_dead start 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 shutdown_connections 2024-05-08T20:54:43.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 >> 172.21.15.81:0/3426820502 conn(0x7ffaa80c2d10 msgr2=0x7ffaa8070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 shutdown_connections 2024-05-08T20:54:43.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.341+0000 7ffaacd7a640 1 -- 172.21.15.81:0/3426820502 wait complete. 2024-05-08T20:54:43.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T20:54:43.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 Processor -- start 2024-05-08T20:54:43.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 -- start start 2024-05-08T20:54:43.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4664151f00 0x7f46641588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f4664155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4664158e20 con 0x7f4664155690 2024-05-08T20:54:43.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466406bb20 con 0x7f4664151f00 2024-05-08T20:54:43.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f466a213640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46641548e0 con 0x7f4664154cf0 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4664151f00 0x7f46641588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f4662ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f4664155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4664151f00 0x7f46641588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.81:43082/0 (socket says 172.21.15.81:43082) 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f4663fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4664155690 0x7f46640ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:54740/0 (socket says 172.21.15.81:54740) 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 -- 172.21.15.81:0/167694498 learned_addr learned my addr 172.21.15.81:0/167694498 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 -- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 msgr2=0x7f4664155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 --2- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f4664155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 -- 172.21.15.81:0/167694498 >> v1:172.21.15.117:6789/0 conn(0x7f4664155690 legacy=0x7f46640ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.469+0000 7f46637fe640 1 -- 172.21.15.81:0/167694498 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46641522e0 con 0x7f4664151f00 2024-05-08T20:54:43.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f46637fe640 1 --2- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641588e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46540098a0 tx=0x7f465401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c2af3149f01281 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f46627fc640 1 -- 172.21.15.81:0/167694498 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540ab640 con 0x7f4664151f00 2024-05-08T20:54:43.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f46627fc640 1 -- 172.21.15.81:0/167694498 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46540a7070 con 0x7f4664151f00 2024-05-08T20:54:43.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f46627fc640 1 -- 172.21.15.81:0/167694498 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540ab9c0 con 0x7f4664151f00 2024-05-08T20:54:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 msgr2=0x7f46641588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641588e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46540098a0 tx=0x7f465401c420 comp rx=0 tx=0).stop 2024-05-08T20:54:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- 172.21.15.81:0/167694498 shutdown_connections 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f4664155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- 172.21.15.81:0/167694498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641588e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- 172.21.15.81:0/167694498 >> 172.21.15.81:0/167694498 conn(0x7f46640715f0 msgr2=0x7f4664071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- 172.21.15.81:0/167694498 shutdown_connections 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- 172.21.15.81:0/167694498 wait complete. 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 Processor -- start 2024-05-08T20:54:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- start start 2024-05-08T20:54:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f46640a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640aeb40 con 0x7f46640af3a0 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640aefd0 con 0x7f4664151f00 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f466a213640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ade30 con 0x7f4664154cf0 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f4663fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f4663fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57204/0 (socket says 172.21.15.81:57204) 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.473+0000 7f4663fff640 1 -- 172.21.15.81:0/888194395 learned_addr learned my addr 172.21.15.81:0/888194395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f46637fe640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4662ffd640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f46640a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 -- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 msgr2=0x7f46640a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f46640a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 -- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 msgr2=0x7f46641487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 -- 172.21.15.81:0/888194395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540094d0 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f46637fe640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f4663fff640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c7a0 tx=0x7f465c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00a640 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c00a7a0 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c00ab10 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640ae250 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46640ae4f0 con 0x7f46640af3a0 2024-05-08T20:54:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46640aecb0 con 0x7f46640af3a0 2024-05-08T20:54:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f465c00ac70 con 0x7f46640af3a0 2024-05-08T20:54:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 0x7f4650068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f465c083c10 con 0x7f46640af3a0 2024-05-08T20:54:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f46637fe640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 0x7f4650068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.477+0000 7f46637fe640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 0x7f4650068b50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f46540af000 tx=0x7f46540a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.481+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f465c050c80 con 0x7f46640af3a0 2024-05-08T20:54:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.633+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f46640cab20 con 0x7f4650066690 2024-05-08T20:54:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.633+0000 7f464bfff640 1 -- 172.21.15.81:0/888194395 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46540ab760 con 0x7f4650066690 2024-05-08T20:54:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 msgr2=0x7f4650068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 0x7f4650068b50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f46540af000 tx=0x7f46540a7000 comp rx=0 tx=0).stop 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 msgr2=0x7f46640aa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c7a0 tx=0x7f465c00cc60 comp rx=0 tx=0).stop 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 shutdown_connections 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4650066690 0x7f4650068b50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46640af3a0 0x7f46640aa230 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4664154cf0 0x7f46640a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 --2- 172.21.15.81:0/888194395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4664151f00 0x7f46641487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 >> 172.21.15.81:0/888194395 conn(0x7f46640715f0 msgr2=0x7f46640719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 shutdown_connections 2024-05-08T20:54:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.637+0000 7f466a213640 1 -- 172.21.15.81:0/888194395 wait complete. 2024-05-08T20:54:43.653 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T20:54:43.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 Processor -- start 2024-05-08T20:54:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 -- start start 2024-05-08T20:54:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 0x7fc5dc158840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 0x7fc5dc0c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc06a1f0 con 0x7fc5dc152180 2024-05-08T20:54:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c2d90 con 0x7fc5dc0c5d90 2024-05-08T20:54:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e270e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc06a4d0 con 0x7fc5dc158d80 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5db7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 0x7fc5dc158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e0cab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 0x7fc5dc0c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5dbfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc5dc152180 0x7fc5dc1554d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:54744/0 (socket says 172.21.15.81:54744) 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5dbfff640 1 -- 172.21.15.81:0/3918652833 learned_addr learned my addr 172.21.15.81:0/3918652833 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3918652833 >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 msgr2=0x7fc5dc158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e0cab640 1 --2- 172.21.15.81:0/3918652833 >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 0x7fc5dc158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3918652833 >> v1:172.21.15.117:6789/0 conn(0x7fc5dc152180 legacy=0x7fc5dc1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3918652833 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc06a7b0 con 0x7fc5dc158d80 2024-05-08T20:54:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.765+0000 7fc5db7fe640 1 --2- 172.21.15.81:0/3918652833 >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 0x7fc5dc158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e0cab640 1 --2- 172.21.15.81:0/3918652833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 0x7fc5dc0c1c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40097c0 tx=0x7fc5d401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cacc940fceea1b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5daffd640 1 -- 172.21.15.81:0/3918652833 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40a4ea0 con 0x7fc5dc158d80 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5daffd640 1 -- 172.21.15.81:0/3918652833 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40a7050 con 0x7fc5dc158d80 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5daffd640 1 -- 172.21.15.81:0/3918652833 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40ab820 con 0x7fc5dc158d80 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- 172.21.15.81:0/3918652833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 msgr2=0x7fc5dc0c1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3918652833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 0x7fc5dc0c1c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40097c0 tx=0x7fc5d401c410 comp rx=0 tx=0).stop 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- 172.21.15.81:0/3918652833 shutdown_connections 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3918652833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc158d80 0x7fc5dc0c1c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3918652833 >> v2:172.21.15.117:3300/0 conn(0x7fc5dc0c5d90 0x7fc5dc158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- 172.21.15.81:0/3918652833 >> 172.21.15.81:0/3918652833 conn(0x7fc5dc0c3d20 msgr2=0x7fc5dc0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- 172.21.15.81:0/3918652833 shutdown_connections 2024-05-08T20:54:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- 172.21.15.81:0/3918652833 wait complete. 2024-05-08T20:54:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 Processor -- start 2024-05-08T20:54:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.769+0000 7fc5e270e640 1 -- start start 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5dc0c5d90 0x7fc5dc1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc152180 0x7fc5dc0acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 0x7fc5dc13c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1f1720 con 0x7fc5dc158d80 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc134b00 con 0x7fc5dc0c5d90 2024-05-08T20:54:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc135e40 con 0x7fc5dc152180 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 0x7fc5dc13c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 0x7fc5dc13c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57208/0 (socket says 172.21.15.81:57208) 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3064509517 learned_addr learned my addr 172.21.15.81:0/3064509517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5db7fe640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc152180 0x7fc5dc0acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5dbfff640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5dc0c5d90 0x7fc5dc1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc152180 msgr2=0x7fc5dc0acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5dc152180 0x7fc5dc0acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5dc0c5d90 msgr2=0x7fc5dc1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5dc0c5d90 0x7fc5dc1f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0009420 con 0x7fc5dc158d80 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e0cab640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 0x7fc5dc13c8e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc5d401aac0 tx=0x7fc5d40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40a4ea0 con 0x7fc5dc158d80 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4006e20 con 0x7fc5dc158d80 2024-05-08T20:54:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4009420 con 0x7fc5dc158d80 2024-05-08T20:54:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40b4620 con 0x7fc5dc158d80 2024-05-08T20:54:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc136650 con 0x7fc5dc158d80 2024-05-08T20:54:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5dc074950 con 0x7fc5dc158d80 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5d40b2040 con 0x7fc5dc158d80 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc5c80666c0 0x7fc5c8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5dbfff640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc5c80666c0 0x7fc5c8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc5d411e740 con 0x7fc5dc158d80 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7fc5c8071060 0x7fc5c80734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5c8073bb0 con 0x7fc5c8071060 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5d411eb90 con 0x7fc5dc158d80 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5dbfff640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc5c80666c0 0x7fc5c8068b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0012f0 tx=0x7fc5cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.773+0000 7fc5db7fe640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7fc5c8071060 0x7fc5c80734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.777+0000 7fc5db7fe640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7fc5c8071060 0x7fc5c80734e0 crc :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.777+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== osd.5 v2:172.21.15.117:6816/27739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc5c8073bb0 con 0x7fc5c8071060 2024-05-08T20:54:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 --> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5dc06aaf0 con 0x7fc5c8071060 2024-05-08T20:54:43.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5d8ff9640 1 -- 172.21.15.81:0/3064509517 <== osd.5 v2:172.21.15.117:6816/27739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5dc06aaf0 con 0x7fc5c8071060 2024-05-08T20:54:43.793 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:43.793 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7fc5c8071060 msgr2=0x7fc5c80734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.117:6816/27739,v1:172.21.15.117:6817/27739] conn(0x7fc5c8071060 0x7fc5c80734e0 crc :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc5c80666c0 msgr2=0x7fc5c8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc5c80666c0 0x7fc5c8068b80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0012f0 tx=0x7fc5cc009040 comp rx=0 tx=0).stop 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 msgr2=0x7fc5dc13c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 --2- 172.21.15.81:0/3064509517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5dc158d80 0x7fc5dc13c8e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc5d401aac0 tx=0x7fc5d40191b0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e0cab640 1 -- 172.21.15.81:0/3064509517 reap_dead start 2024-05-08T20:54:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 shutdown_connections 2024-05-08T20:54:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.789+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 >> 172.21.15.81:0/3064509517 conn(0x7fc5dc0c3d20 msgr2=0x7fc5dc0c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.793+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 shutdown_connections 2024-05-08T20:54:43.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.793+0000 7fc5e270e640 1 -- 172.21.15.81:0/3064509517 wait complete. 2024-05-08T20:54:43.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T20:54:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.909+0000 7fab913a5640 1 Processor -- start 2024-05-08T20:54:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.909+0000 7fab913a5640 1 -- start start 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab913a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab8c06f400 0x7fab8c0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab913a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0c0650 con 0x7fab8c0725f0 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab913a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c06fa80 con 0x7fab8c1501e0 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab913a5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c06fd60 con 0x7fab8c06f400 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab8c06f400 0x7fab8c0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab8c06f400 0x7fab8c0c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57222/0 (socket says 172.21.15.81:57222) 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 -- 172.21.15.81:0/1424636663 learned_addr learned my addr 172.21.15.81:0/1424636663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 -- 172.21.15.81:0/1424636663 >> v1:172.21.15.117:6789/0 conn(0x7fab8c1501e0 legacy=0x7fab8c06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 -- 172.21.15.81:0/1424636663 >> v1:172.21.15.81:6789/0 conn(0x7fab8c0725f0 legacy=0x7fab8c0c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 -- 172.21.15.81:0/1424636663 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c071ea0 con 0x7fab8c06f400 2024-05-08T20:54:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab8b7fe640 1 --2- 172.21.15.81:0/1424636663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c06f400 0x7fab8c0c2350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab84009e50 tx=0x7fab8401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93e8cb1ce17b42 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab89ffb640 1 -- 172.21.15.81:0/1424636663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840a56c0 con 0x7fab8c06f400 2024-05-08T20:54:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab89ffb640 1 -- 172.21.15.81:0/1424636663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab840a5820 con 0x7fab8c06f400 2024-05-08T20:54:43.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.913+0000 7fab89ffb640 1 -- 172.21.15.81:0/1424636663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840a5bb0 con 0x7fab8c06f400 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/1424636663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c06f400 msgr2=0x7fab8c0c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 --2- 172.21.15.81:0/1424636663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c06f400 0x7fab8c0c2350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab84009e50 tx=0x7fab8401c8d0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/1424636663 shutdown_connections 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 --2- 172.21.15.81:0/1424636663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c06f400 0x7fab8c0c2350 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/1424636663 >> 172.21.15.81:0/1424636663 conn(0x7fab8c0c2ca0 msgr2=0x7fab8c0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/1424636663 shutdown_connections 2024-05-08T20:54:43.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/1424636663 wait complete. 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 Processor -- start 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- start start 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c06f400 0x7fab8c0a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0725f0 0x7fab8c1f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c072180 con 0x7fab8c1501e0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0a9070 con 0x7fab8c06f400 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c145490 con 0x7fab8c0725f0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57230/0 (socket says 172.21.15.81:57230) 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 -- 172.21.15.81:0/423198249 learned_addr learned my addr 172.21.15.81:0/423198249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 -- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0725f0 msgr2=0x7fab8c1f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0725f0 0x7fab8c1f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8affd640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c06f400 0x7fab8c0a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 -- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c06f400 msgr2=0x7fab8c0a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c06f400 0x7fab8c0a8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 -- 172.21.15.81:0/423198249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009b30 con 0x7fab8c1501e0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab8b7fe640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab840af040 tx=0x7fab84019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840b8670 con 0x7fab8c1501e0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab840b87d0 con 0x7fab8c1501e0 2024-05-08T20:54:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c150740 con 0x7fab8c1501e0 2024-05-08T20:54:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840b8b60 con 0x7fab8c1501e0 2024-05-08T20:54:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1f3320 con 0x7fab8c1501e0 2024-05-08T20:54:43.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.917+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c1f34b0 con 0x7fab8c1501e0 2024-05-08T20:54:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.921+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab840b8cc0 con 0x7fab8c1501e0 2024-05-08T20:54:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.921+0000 7fab837fe640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 0x7fab6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.921+0000 7fab8affd640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 0x7fab6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.921+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fab8411fbb0 con 0x7fab8c1501e0 2024-05-08T20:54:43.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.921+0000 7fab8affd640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 0x7fab6c068b50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00a750 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:43.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:43.925+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fab840ecd30 con 0x7fab8c1501e0 2024-05-08T20:54:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.073+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fab8c1505c0 con 0x7fab6c066690 2024-05-08T20:54:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab837fe640 1 -- 172.21.15.81:0/423198249 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab7c00a380 con 0x7fab6c066690 2024-05-08T20:54:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 msgr2=0x7fab6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 0x7fab6c068b50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00a750 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 msgr2=0x7fab8c1f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab840af040 tx=0x7fab84019670 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 shutdown_connections 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fab6c066690 0x7fab6c068b50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8c1501e0 0x7fab8c1f54c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0725f0 0x7fab8c1f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 --2- 172.21.15.81:0/423198249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c06f400 0x7fab8c0a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 >> 172.21.15.81:0/423198249 conn(0x7fab8c0c2ca0 msgr2=0x7fab8c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 shutdown_connections 2024-05-08T20:54:44.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.077+0000 7fab913a5640 1 -- 172.21.15.81:0/423198249 wait complete. 2024-05-08T20:54:44.095 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T20:54:44.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 Processor -- start 2024-05-08T20:54:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 -- start start 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76e00c8230 0x7f76e0155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76e00c5090 0x7f76e006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00c77f0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e006aef0 con 0x7f76e00c8230 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e7cdd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00c6d40 con 0x7f76e00c5090 2024-05-08T20:54:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76e00c8230 0x7f76e0155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76e00c8230 0x7f76e0155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57240/0 (socket says 172.21.15.81:57240) 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 -- 172.21.15.81:0/1650769047 learned_addr learned my addr 172.21.15.81:0/1650769047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5a79640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76e00c4cb0 0x7f76e006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46252/0 (socket says 172.21.15.81:46252) 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 -- 172.21.15.81:0/1650769047 >> v2:172.21.15.117:3300/0 conn(0x7f76e00c5090 msgr2=0x7f76e006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e627a640 1 --2- 172.21.15.81:0/1650769047 >> v2:172.21.15.117:3300/0 conn(0x7f76e00c5090 0x7f76e006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 --2- 172.21.15.81:0/1650769047 >> v2:172.21.15.117:3300/0 conn(0x7f76e00c5090 0x7f76e006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 -- 172.21.15.81:0/1650769047 >> v1:172.21.15.81:6789/0 conn(0x7f76e00c4cb0 legacy=0x7f76e006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e4a77640 1 -- 172.21.15.81:0/1650769047 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796067286 0 0) 0x7f76e00c77f0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.217+0000 7f76e5278640 1 -- 172.21.15.81:0/1650769047 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00c54e0 con 0x7f76e00c8230 2024-05-08T20:54:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5278640 1 --2- 172.21.15.81:0/1650769047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c8230 0x7f76e0155450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f76e00cb310 tx=0x7f76d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9607bef0d4f4ea1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e4a77640 1 -- 172.21.15.81:0/1650769047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00ab660 con 0x7f76e00c8230 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e4a77640 1 -- 172.21.15.81:0/1650769047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00ab7c0 con 0x7f76e00c8230 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e4a77640 1 -- 172.21.15.81:0/1650769047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00abb50 con 0x7f76e00c8230 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- 172.21.15.81:0/1650769047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c8230 msgr2=0x7f76e0155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/1650769047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c8230 0x7f76e0155450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f76e00cb310 tx=0x7f76d001c460 comp rx=0 tx=0).stop 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- 172.21.15.81:0/1650769047 shutdown_connections 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/1650769047 >> v2:172.21.15.117:3300/0 conn(0x7f76e00c5090 0x7f76e006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/1650769047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c8230 0x7f76e0155450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- 172.21.15.81:0/1650769047 >> 172.21.15.81:0/1650769047 conn(0x7f76e00ca330 msgr2=0x7f76e00ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- 172.21.15.81:0/1650769047 shutdown_connections 2024-05-08T20:54:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- 172.21.15.81:0/1650769047 wait complete. 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 Processor -- start 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- start start 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 0x7f76e0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e00c5090 0x7f76e00aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e00c8230 0x7f76e00bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0154cd0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e01527b0 con 0x7f76e00c8230 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e7cdd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0152a90 con 0x7f76e00c5090 2024-05-08T20:54:44.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 0x7f76e0154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 0x7f76e0154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57244/0 (socket says 172.21.15.81:57244) 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 -- 172.21.15.81:0/727536742 learned_addr learned my addr 172.21.15.81:0/727536742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 -- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e00c5090 msgr2=0x7f76e00aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5278640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e00c5090 0x7f76e00aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e627a640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e00c8230 0x7f76e00bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e00c5090 0x7f76e00aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 -- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e00c8230 msgr2=0x7f76e00bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e00c8230 0x7f76e00bfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00094d0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.221+0000 7f76e5a79640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 0x7f76e0154790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0011f0 tx=0x7f76dc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0074e0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc007640 con 0x7f76e00c4cb0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e0152d70 con 0x7f76e00c4cb0 2024-05-08T20:54:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc004a10 con 0x7f76e00c4cb0 2024-05-08T20:54:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e0153330 con 0x7f76e00c4cb0 2024-05-08T20:54:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76e00c8880 con 0x7f76e00c4cb0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76dc01c3b0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76c40666c0 0x7f76c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f76dc083fe0 con 0x7f76e00c4cb0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e5278640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76c40666c0 0x7f76c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7f76c4071060 0x7f76c40734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76c4073bb0 con 0x7f76c4071060 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76dc084430 con 0x7f76e00c4cb0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e5278640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76c40666c0 0x7f76c4068b80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f76d00af000 tx=0x7f76d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e627a640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7f76c4071060 0x7f76c40734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.225+0000 7f76e627a640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7f76c4071060 0x7f76c40734e0 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.229+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== osd.6 v2:172.21.15.117:6824/27741 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f76c4073bb0 con 0x7f76c4071060 2024-05-08T20:54:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 --> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f76e0074950 con 0x7f76c4071060 2024-05-08T20:54:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76d67fc640 1 -- 172.21.15.81:0/727536742 <== osd.6 v2:172.21.15.117:6824/27741 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f76e0074950 con 0x7f76c4071060 2024-05-08T20:54:44.243 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:44.244 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:44.244 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:44.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7f76c4071060 msgr2=0x7f76c40734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.117:6824/27741,v1:172.21.15.117:6825/27741] conn(0x7f76c4071060 0x7f76c40734e0 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76c40666c0 msgr2=0x7f76c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f76c40666c0 0x7f76c4068b80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f76d00af000 tx=0x7f76d0008040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 msgr2=0x7f76e0154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 --2- 172.21.15.81:0/727536742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e00c4cb0 0x7f76e0154790 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0011f0 tx=0x7f76dc00c9b0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e627a640 1 -- 172.21.15.81:0/727536742 reap_dead start 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 shutdown_connections 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 >> 172.21.15.81:0/727536742 conn(0x7f76e00ca330 msgr2=0x7f76e00c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 shutdown_connections 2024-05-08T20:54:44.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.241+0000 7f76e7cdd640 1 -- 172.21.15.81:0/727536742 wait complete. 2024-05-08T20:54:44.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T20:54:44.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 Processor -- start 2024-05-08T20:54:44.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 -- start start 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700a9970 0x7fc0700aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0700c38f0 0x7fc070153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc070153880 con 0x7fc0700c3510 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700c47c0 con 0x7fc0700c38f0 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc075e84640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c6220 con 0x7fc0700a9970 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0700c38f0 0x7fc070153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0700c38f0 0x7fc070153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57258/0 (socket says 172.21.15.81:57258) 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 -- 172.21.15.81:0/207021725 learned_addr learned my addr 172.21.15.81:0/207021725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc067fff640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700a9970 0x7fc0700aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 -- 172.21.15.81:0/207021725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700a9970 msgr2=0x7fc0700aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700a9970 0x7fc0700aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 -- 172.21.15.81:0/207021725 >> v1:172.21.15.81:6789/0 conn(0x7fc0700c3510 legacy=0x7fc0700c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.365+0000 7fc06ffff640 1 -- 172.21.15.81:0/207021725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700c6500 con 0x7fc0700c38f0 2024-05-08T20:54:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc06ffff640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700c38f0 0x7fc070153340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc068009e50 tx=0x7fc06801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9f427baf123013 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc06effd640 1 -- 172.21.15.81:0/207021725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680a5830 con 0x7fc0700c38f0 2024-05-08T20:54:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc06effd640 1 -- 172.21.15.81:0/207021725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0680a5990 con 0x7fc0700c38f0 2024-05-08T20:54:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc06effd640 1 -- 172.21.15.81:0/207021725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680a5d20 con 0x7fc0700c38f0 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- 172.21.15.81:0/207021725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700c38f0 msgr2=0x7fc070153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700c38f0 0x7fc070153340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc068009e50 tx=0x7fc06801c970 comp rx=0 tx=0).stop 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- 172.21.15.81:0/207021725 shutdown_connections 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700c38f0 0x7fc070153340 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 --2- 172.21.15.81:0/207021725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700a9970 0x7fc0700aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- 172.21.15.81:0/207021725 >> 172.21.15.81:0/207021725 conn(0x7fc0700c68c0 msgr2=0x7fc0700c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- 172.21.15.81:0/207021725 shutdown_connections 2024-05-08T20:54:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- 172.21.15.81:0/207021725 wait complete. 2024-05-08T20:54:44.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 Processor -- start 2024-05-08T20:54:44.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.369+0000 7fc075e84640 1 -- start start 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c3510 0x7fc070151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0700c38f0 0x7fc0701ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700704b0 con 0x7fc0700a9970 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070151fe0 con 0x7fc0700c38f0 2024-05-08T20:54:44.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07006f950 con 0x7fc0700c3510 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57272/0 (socket says 172.21.15.81:57272) 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 -- 172.21.15.81:0/3000308196 learned_addr learned my addr 172.21.15.81:0/3000308196 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 -- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c3510 msgr2=0x7fc070151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c3510 0x7fc070151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 -- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0700c38f0 msgr2=0x7fc0701ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0700c38f0 0x7fc0701ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 -- 172.21.15.81:0/3000308196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009b30 con 0x7fc0700a9970 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06f7fe640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c500 tx=0x7fc06000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060005220 con 0x7fc0700a9970 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060005380 con 0x7fc0700a9970 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07006fc30 con 0x7fc0700a9970 2024-05-08T20:54:44.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060007270 con 0x7fc0700a9970 2024-05-08T20:54:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0701eaf40 con 0x7fc0700a9970 2024-05-08T20:54:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070074950 con 0x7fc0700a9970 2024-05-08T20:54:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0600073d0 con 0x7fc0700a9970 2024-05-08T20:54:44.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 0x7fc050068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc067fff640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 0x7fc050068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc060083740 con 0x7fc0700a9970 2024-05-08T20:54:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.373+0000 7fc067fff640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 0x7fc050068b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc0701523c0 tx=0x7fc058008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.377+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc060050720 con 0x7fc0700a9970 2024-05-08T20:54:44.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.525+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0700c5920 con 0x7fc050066690 2024-05-08T20:54:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.525+0000 7fc06cff9640 1 -- 172.21.15.81:0/3000308196 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc05800a4c0 con 0x7fc050066690 2024-05-08T20:54:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 msgr2=0x7fc050068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 0x7fc050068b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc0701523c0 tx=0x7fc058008040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 msgr2=0x7fc0701eb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c500 tx=0x7fc06000c9c0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 shutdown_connections 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc050066690 0x7fc050068b50 secure :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc0701523c0 tx=0x7fc058008040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0700c38f0 0x7fc0701ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0700c3510 0x7fc070151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 --2- 172.21.15.81:0/3000308196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700a9970 0x7fc0701eb740 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 >> 172.21.15.81:0/3000308196 conn(0x7fc0700c68c0 msgr2=0x7fc0700c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 shutdown_connections 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.529+0000 7fc075e84640 1 -- 172.21.15.81:0/3000308196 wait complete. 2024-05-08T20:54:44.546 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T20:54:44.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T20:54:44.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 Processor -- start 2024-05-08T20:54:44.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 -- start start 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c40c4cb0 0x7f73c4155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40c77f0 con 0x7f73c40c5090 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40c54e0 con 0x7f73c40c8230 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73cb622640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40c6d40 con 0x7f73c40c4cb0 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c40c4cb0 0x7f73c4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73c40c4cb0 0x7f73c4155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57288/0 (socket says 172.21.15.81:57288) 2024-05-08T20:54:44.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 -- 172.21.15.81:0/2039729627 learned_addr learned my addr 172.21.15.81:0/2039729627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 -- 172.21.15.81:0/2039729627 >> v1:172.21.15.117:6789/0 conn(0x7f73c40c8230 legacy=0x7f73c406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 -- 172.21.15.81:0/2039729627 >> v1:172.21.15.81:6789/0 conn(0x7f73c40c5090 legacy=0x7f73c415f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.657+0000 7f73c93be640 1 -- 172.21.15.81:0/2039729627 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40c6f50 con 0x7f73c40c4cb0 2024-05-08T20:54:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c93be640 1 --2- 172.21.15.81:0/2039729627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c4cb0 0x7f73c4155450 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac9c4c09e021055 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73bbfff640 1 -- 172.21.15.81:0/2039729627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00a6040 con 0x7f73c40c4cb0 2024-05-08T20:54:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73bbfff640 1 -- 172.21.15.81:0/2039729627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c00aa600 con 0x7f73c40c4cb0 2024-05-08T20:54:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73bbfff640 1 -- 172.21.15.81:0/2039729627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c00aa990 con 0x7f73c40c4cb0 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/2039729627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c4cb0 msgr2=0x7f73c4155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 --2- 172.21.15.81:0/2039729627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c4cb0 0x7f73c4155450 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009870 tx=0x7f73c001c4a0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/2039729627 shutdown_connections 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 --2- 172.21.15.81:0/2039729627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c4cb0 0x7f73c4155450 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/2039729627 >> 172.21.15.81:0/2039729627 conn(0x7f73c40ca330 msgr2=0x7f73c40ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/2039729627 shutdown_connections 2024-05-08T20:54:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/2039729627 wait complete. 2024-05-08T20:54:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 Processor -- start 2024-05-08T20:54:44.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- start start 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c40c4cb0 0x7f73c414a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 0x7f73c40c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c40c8230 0x7f73c40c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40c2cf0 con 0x7f73c40c5090 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40ac360 con 0x7f73c40c4cb0 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40a9d70 con 0x7f73c40c8230 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 0x7f73c40c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 0x7f73c40c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57294/0 (socket says 172.21.15.81:57294) 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 -- 172.21.15.81:0/1478395179 learned_addr learned my addr 172.21.15.81:0/1478395179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c9bbf640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c40c8230 0x7f73c40c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c93be640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c40c4cb0 0x7f73c414a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 -- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c40c8230 msgr2=0x7f73c40c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73c40c8230 0x7f73c40c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 -- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c40c4cb0 msgr2=0x7f73c414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c40c4cb0 0x7f73c414a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00094d0 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73c8bbd640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 0x7f73c40c1400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c390 tx=0x7f73b400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b40052d0 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4005430 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4003820 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c40aa030 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.661+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c40abd10 con 0x7f73c40c5090 2024-05-08T20:54:44.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73c40c8880 con 0x7f73c40c5090 2024-05-08T20:54:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73b4003980 con 0x7f73c40c5090 2024-05-08T20:54:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73a8066690 0x7f73a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73c93be640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73a8066690 0x7f73a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f73b4083a70 con 0x7f73c40c5090 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7f73a8071030 0x7f73a80734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73a8073b80 con 0x7f73a8071030 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73b40882c0 con 0x7f73c40c5090 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73c93be640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73a8066690 0x7f73a8068b50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f73c00ae000 tx=0x7f73c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73c9bbf640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7f73a8071030 0x7f73a80734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.665+0000 7f73c9bbf640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7f73a8071030 0x7f73a80734b0 crc :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.669+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== osd.7 v2:172.21.15.117:6804/27740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f73a8073b80 con 0x7f73a8071030 2024-05-08T20:54:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 --> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73c4074950 con 0x7f73a8071030 2024-05-08T20:54:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73b9ffb640 1 -- 172.21.15.81:0/1478395179 <== osd.7 v2:172.21.15.117:6804/27740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f73c4074950 con 0x7f73a8071030 2024-05-08T20:54:44.683 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T20:54:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T20:54:44.683 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7f73a8071030 msgr2=0x7f73a80734b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.117:6804/27740,v1:172.21.15.117:6806/27740] conn(0x7f73a8071030 0x7f73a80734b0 crc :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73a8066690 msgr2=0x7f73a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f73a8066690 0x7f73a8068b50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f73c00ae000 tx=0x7f73c0008040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 msgr2=0x7f73c40c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 --2- 172.21.15.81:0/1478395179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73c40c5090 0x7f73c40c1400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c390 tx=0x7f73b400c850 comp rx=0 tx=0).stop 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73c9bbf640 1 -- 172.21.15.81:0/1478395179 reap_dead start 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 shutdown_connections 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 >> 172.21.15.81:0/1478395179 conn(0x7f73c40ca330 msgr2=0x7f73c406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 shutdown_connections 2024-05-08T20:54:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.681+0000 7f73cb622640 1 -- 172.21.15.81:0/1478395179 wait complete. 2024-05-08T20:54:44.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T20:54:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 Processor -- start 2024-05-08T20:54:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 -- start start 2024-05-08T20:54:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f633c0ca000 0x7f633c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c155860 con 0x7f633c151f00 2024-05-08T20:54:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c1522e0 con 0x7f633c154cf0 2024-05-08T20:54:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6343ea5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c06bb20 con 0x7f633c0ca000 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341c41640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f633c151f00 0x7f633c1588e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46282/0 (socket says 172.21.15.81:46282) 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341c41640 1 -- 172.21.15.81:0/2017755276 learned_addr learned my addr 172.21.15.81:0/2017755276 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645828698 0 0) 0x7f633c155860 con 0x7f633c151f00 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6342442640 1 --2- 172.21.15.81:0/2017755276 >> v2:172.21.15.117:3300/0 conn(0x7f633c0ca000 0x7f633c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328003530 con 0x7f633c151f00 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909318585 0 0) 0x7f6328003530 con 0x7f633c151f00 2024-05-08T20:54:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 >> v2:172.21.15.117:3300/0 conn(0x7f633c0ca000 msgr2=0x7f633c0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 --2- 172.21.15.81:0/2017755276 >> v2:172.21.15.117:3300/0 conn(0x7f633c0ca000 0x7f633c0ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 >> v1:172.21.15.117:6789/0 conn(0x7f633c154cf0 legacy=0x7f633c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0c5f80 con 0x7f633c151f00 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f6338001680 con 0x7f633c151f00 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 >> v1:172.21.15.81:6789/0 conn(0x7f633c151f00 legacy=0x7f633c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6328003980 0x7f6328003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 0x7f6328004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280052b0 0x7f632800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632800c150 con 0x7f63280047d0 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632800c2c0 con 0x7f6328003980 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632800c480 con 0x7f63280052b0 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 0x7f6328004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341c41640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6328003980 0x7f6328003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6342442640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280052b0 0x7f632800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 -- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280052b0 msgr2=0x7f632800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280052b0 0x7f632800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 -- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6328003980 msgr2=0x7f6328003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6328003980 0x7f6328003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6341440640 1 -- 172.21.15.81:0/2017755276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328003530 con 0x7f63280047d0 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.809+0000 7f6342442640 1 -- 172.21.15.81:0/2017755276 reap_dead start 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6341440640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 0x7f6328004c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f632c001780 tx=0x7f632c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88abacbe5b0780a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0052d0 con 0x7f63280047d0 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c0a7050 con 0x7f63280047d0 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6340c3f640 1 -- 172.21.15.81:0/2017755276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c003600 con 0x7f63280047d0 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 msgr2=0x7f6328004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 0x7f6328004c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f632c001780 tx=0x7f632c01c400 comp rx=0 tx=0).stop 2024-05-08T20:54:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- 172.21.15.81:0/2017755276 shutdown_connections 2024-05-08T20:54:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 --2- 172.21.15.81:0/2017755276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63280047d0 0x7f6328004c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- 172.21.15.81:0/2017755276 >> 172.21.15.81:0/2017755276 conn(0x7f633c0715f0 msgr2=0x7f633c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- 172.21.15.81:0/2017755276 shutdown_connections 2024-05-08T20:54:44.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- 172.21.15.81:0/2017755276 wait complete. 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 Processor -- start 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.813+0000 7f6343ea5640 1 -- start start 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280047d0 0x7f633c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f633c1ee980 0x7f633c1eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0aef40 con 0x7f633c1ef340 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0ae050 con 0x7f633c1ee980 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0ae330 con 0x7f63280047d0 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57308/0 (socket says 172.21.15.81:57308) 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 -- 172.21.15.81:0/1834452870 learned_addr learned my addr 172.21.15.81:0/1834452870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:44.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6341c41640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280047d0 0x7f633c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6341440640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f633c1ee980 0x7f633c1eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 -- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280047d0 msgr2=0x7f633c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280047d0 0x7f633c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 -- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f633c1ee980 msgr2=0x7f633c1eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f633c1ee980 0x7f633c1eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 -- 172.21.15.81:0/1834452870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c158e70 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6342442640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f633c0cb050 tx=0x7f633400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334016620 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63340167a0 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c0ae610 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334016b50 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0aebd0 con 0x7f633c1ef340 2024-05-08T20:54:44.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c074950 con 0x7f633c1ef340 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6334016cb0 con 0x7f633c1ef340 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 0x7f6320068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f63340852d0 con 0x7f633c1ef340 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6341c41640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 0x7f6320068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.817+0000 7f6341c41640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 0x7f6320068b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6338001ec0 tx=0x7f6338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:44.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.821+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6334052330 con 0x7f633c1ef340 2024-05-08T20:54:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.969+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f633c158cf0 con 0x7f6320066690 2024-05-08T20:54:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f63327fc640 1 -- 172.21.15.81:0/1834452870 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6338005e70 con 0x7f6320066690 2024-05-08T20:54:44.975 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T20:54:44.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 msgr2=0x7f6320068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 0x7f6320068b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6338001ec0 tx=0x7f6338009040 comp rx=0 tx=0).stop 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 msgr2=0x7f633c1f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f633c0cb050 tx=0x7f633400f520 comp rx=0 tx=0).stop 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 shutdown_connections 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f6320066690 0x7f6320068b50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f633c1ef340 0x7f633c1f08d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f633c1ee980 0x7f633c1eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 --2- 172.21.15.81:0/1834452870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280047d0 0x7f633c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 >> 172.21.15.81:0/1834452870 conn(0x7f633c0715f0 msgr2=0x7f633c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 shutdown_connections 2024-05-08T20:54:44.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:44.973+0000 7f6343ea5640 1 -- 172.21.15.81:0/1834452870 wait complete. 2024-05-08T20:54:44.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:54:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.093+0000 7f2aecc82640 1 Processor -- start 2024-05-08T20:54:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 -- start start 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae81501e0 0x7f2ae806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ae806f400 0x7f2ae80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae80c0650 con 0x7f2ae80725f0 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae806fd60 con 0x7f2ae806f400 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2aecc82640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8072180 con 0x7f2ae81501e0 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ae806f400 0x7f2ae80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ae806f400 0x7f2ae80c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57314/0 (socket says 172.21.15.81:57314) 2024-05-08T20:54:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 -- 172.21.15.81:0/25104731 learned_addr learned my addr 172.21.15.81:0/25104731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:45.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae659c640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae81501e0 0x7f2ae806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 -- 172.21.15.81:0/25104731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae81501e0 msgr2=0x7f2ae806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:45.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae81501e0 0x7f2ae806c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 -- 172.21.15.81:0/25104731 >> v1:172.21.15.117:6789/0 conn(0x7f2ae80725f0 legacy=0x7f2ae80c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:45.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 -- 172.21.15.81:0/25104731 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae806fa80 con 0x7f2ae806f400 2024-05-08T20:54:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae6d9d640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae80c2350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009e50 tx=0x7f2ae001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5dfa61d44b4893 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae559a640 1 -- 172.21.15.81:0/25104731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00a5740 con 0x7f2ae806f400 2024-05-08T20:54:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae559a640 1 -- 172.21.15.81:0/25104731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00a58a0 con 0x7f2ae806f400 2024-05-08T20:54:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.097+0000 7f2ae559a640 1 -- 172.21.15.81:0/25104731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00a5c30 con 0x7f2ae806f400 2024-05-08T20:54:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/25104731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 msgr2=0x7f2ae80c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae80c2350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009e50 tx=0x7f2ae001c8a0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/25104731 shutdown_connections 2024-05-08T20:54:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae80c2350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- 172.21.15.81:0/25104731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae81501e0 0x7f2ae806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/25104731 >> 172.21.15.81:0/25104731 conn(0x7f2ae80c2ca0 msgr2=0x7f2ae80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/25104731 shutdown_connections 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/25104731 wait complete. 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 Processor -- start 2024-05-08T20:54:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- start start 2024-05-08T20:54:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae80725f0 0x7f2ae814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae81501e0 0x7f2ae813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81ebfc0 con 0x7f2ae806f400 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae814da50 con 0x7f2ae81501e0 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae814dd30 con 0x7f2ae80725f0 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57326/0 (socket says 172.21.15.81:57326) 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 -- 172.21.15.81:0/1240919199 learned_addr learned my addr 172.21.15.81:0/1240919199 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae5d9b640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae80725f0 0x7f2ae814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 -- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae80725f0 msgr2=0x7f2ae814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae80725f0 0x7f2ae814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 -- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae81501e0 msgr2=0x7f2ae813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae81501e0 0x7f2ae813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 -- 172.21.15.81:0/1240919199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009b30 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ae659c640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800c7f0 tx=0x7f2ad800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8007820 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8007980 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae8150740 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8007d30 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.101+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae814e2f0 con 0x7f2ae806f400 2024-05-08T20:54:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae814e510 con 0x7f2ae806f400 2024-05-08T20:54:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ad8024480 con 0x7f2ae806f400 2024-05-08T20:54:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2ad6ffd640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 0x7f2ac8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2ad8084b50 con 0x7f2ae806f400 2024-05-08T20:54:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2ae5d9b640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 0x7f2ac8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.105+0000 7f2ae5d9b640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 0x7f2ac8068b50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00a750 tx=0x7f2adc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.109+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2ad8084e60 con 0x7f2ae806f400 2024-05-08T20:54:45.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.253+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ae81505c0 con 0x7f2ac8066690 2024-05-08T20:54:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.289+0000 7f2ad6ffd640 1 -- 172.21.15.81:0/1240919199 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525432 (secure 0 0 0) 0x7f2adc00a380 con 0x7f2ac8066690 2024-05-08T20:54:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:54:45.302 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 msgr2=0x7f2ac8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 0x7f2ac8068b50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00a750 tx=0x7f2adc008040 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 msgr2=0x7f2ae8147340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800c7f0 tx=0x7f2ad800ccb0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 shutdown_connections 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f2ac8066690 0x7f2ac8068b50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ae81501e0 0x7f2ae813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ae80725f0 0x7f2ae814e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 --2- 172.21.15.81:0/1240919199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ae806f400 0x7f2ae8147340 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.293+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 >> 172.21.15.81:0/1240919199 conn(0x7f2ae80c2ca0 msgr2=0x7f2ae80712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:45.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.297+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 shutdown_connections 2024-05-08T20:54:45.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:54:45.297+0000 7f2aecc82640 1 -- 172.21.15.81:0/1240919199 wait complete. 2024-05-08T20:54:45.315 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":847,"stamp":"2024-05-08T20:54:43.892354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622872,"ondisk_log_size":622872,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005011"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408085+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408085+0000","last_peered":"2024-05-08T20:54:32.408085+0000","last_clean":"2024-05-08T20:54:32.408085+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408085+0000","last_undegraded":"2024-05-08T20:54:32.408085+0000","last_fullsized":"2024-05-08T20:54:32.408085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:14.187608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'764","reported_seq":795,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.384914+0000","last_change":"2024-05-08T20:27:18.519130+0000","last_active":"2024-05-08T20:54:28.384914+0000","last_peered":"2024-05-08T20:54:28.384914+0000","last_clean":"2024-05-08T20:54:28.384914+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:28.384914+0000","last_undegraded":"2024-05-08T20:54:28.384914+0000","last_fullsized":"2024-05-08T20:54:28.384914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.761057+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:21.761057+0000","last_peered":"2024-05-08T20:54:21.761057+0000","last_clean":"2024-05-08T20:54:21.761057+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:21.761057+0000","last_undegraded":"2024-05-08T20:54:21.761057+0000","last_fullsized":"2024-05-08T20:54:21.761057+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.987283+0000","last_change":"2024-05-08T20:27:27.601156+0000","last_active":"2024-05-08T20:54:12.987283+0000","last_peered":"2024-05-08T20:54:12.987283+0000","last_clean":"2024-05-08T20:54:12.987283+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:12.987283+0000","last_undegraded":"2024-05-08T20:54:12.987283+0000","last_fullsized":"2024-05-08T20:54:12.987283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.176748+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:33.176748+0000","last_peered":"2024-05-08T20:54:33.176748+0000","last_clean":"2024-05-08T20:54:33.176748+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:33.176748+0000","last_undegraded":"2024-05-08T20:54:33.176748+0000","last_fullsized":"2024-05-08T20:54:33.176748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.826245+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:53:23.826245+0000","last_peered":"2024-05-08T20:53:23.826245+0000","last_clean":"2024-05-08T20:53:23.826245+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:53:23.826245+0000","last_undegraded":"2024-05-08T20:53:23.826245+0000","last_fullsized":"2024-05-08T20:53:23.826245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:04.433355+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:54:04.433355+0000","last_peered":"2024-05-08T20:54:04.433355+0000","last_clean":"2024-05-08T20:54:04.433355+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:54:04.433355+0000","last_undegraded":"2024-05-08T20:54:04.433355+0000","last_fullsized":"2024-05-08T20:54:04.433355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:56.674153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3618,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385127+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:32.385127+0000","last_peered":"2024-05-08T20:54:32.385127+0000","last_clean":"2024-05-08T20:54:32.385127+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:32.385127+0000","last_undegraded":"2024-05-08T20:54:32.385127+0000","last_fullsized":"2024-05-08T20:54:32.385127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:26.583361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.097096+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:52:15.097096+0000","last_peered":"2024-05-08T20:52:15.097096+0000","last_clean":"2024-05-08T20:52:15.097096+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:52:15.097096+0000","last_undegraded":"2024-05-08T20:52:15.097096+0000","last_fullsized":"2024-05-08T20:52:15.097096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:12.461956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842236+0000","last_change":"2024-05-08T20:27:18.926917+0000","last_active":"2024-05-08T20:54:21.842236+0000","last_peered":"2024-05-08T20:54:21.842236+0000","last_clean":"2024-05-08T20:54:21.842236+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:21.842236+0000","last_undegraded":"2024-05-08T20:54:21.842236+0000","last_fullsized":"2024-05-08T20:54:21.842236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:33.298018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'618","reported_seq":641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.975632+0000","last_change":"2024-05-08T20:27:27.619546+0000","last_active":"2024-05-08T20:54:12.975632+0000","last_peered":"2024-05-08T20:54:12.975632+0000","last_clean":"2024-05-08T20:54:12.975632+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:12.975632+0000","last_undegraded":"2024-05-08T20:54:12.975632+0000","last_fullsized":"2024-05-08T20:54:12.975632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:55.140296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.321288+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:54:32.321288+0000","last_peered":"2024-05-08T20:54:32.321288+0000","last_clean":"2024-05-08T20:54:32.321288+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:54:32.321288+0000","last_undegraded":"2024-05-08T20:54:32.321288+0000","last_fullsized":"2024-05-08T20:54:32.321288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:30.278533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.593251+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:52:17.593251+0000","last_peered":"2024-05-08T20:52:17.593251+0000","last_clean":"2024-05-08T20:52:17.593251+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:52:17.593251+0000","last_undegraded":"2024-05-08T20:52:17.593251+0000","last_fullsized":"2024-05-08T20:52:17.593251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:34:11.647979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.899026+0000","last_change":"2024-05-08T20:27:18.930924+0000","last_active":"2024-05-08T20:54:21.899026+0000","last_peered":"2024-05-08T20:54:21.899026+0000","last_clean":"2024-05-08T20:54:21.899026+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:21.899026+0000","last_undegraded":"2024-05-08T20:54:21.899026+0000","last_fullsized":"2024-05-08T20:54:21.899026+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:42.127616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.187731+0000","last_change":"2024-05-08T20:27:27.618200+0000","last_active":"2024-05-08T20:54:32.187731+0000","last_peered":"2024-05-08T20:54:32.187731+0000","last_clean":"2024-05-08T20:54:32.187731+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:32.187731+0000","last_undegraded":"2024-05-08T20:54:32.187731+0000","last_fullsized":"2024-05-08T20:54:32.187731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:02.735493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.257629+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:33.257629+0000","last_peered":"2024-05-08T20:54:33.257629+0000","last_clean":"2024-05-08T20:54:33.257629+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:33.257629+0000","last_undegraded":"2024-05-08T20:54:33.257629+0000","last_fullsized":"2024-05-08T20:54:33.257629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.790464+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:54:21.790464+0000","last_peered":"2024-05-08T20:54:21.790464+0000","last_clean":"2024-05-08T20:54:21.790464+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:54:21.790464+0000","last_undegraded":"2024-05-08T20:54:21.790464+0000","last_fullsized":"2024-05-08T20:54:21.790464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.588143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:17.606595+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:52:17.606595+0000","last_peered":"2024-05-08T20:52:17.606595+0000","last_clean":"2024-05-08T20:52:17.606595+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:52:17.606595+0000","last_undegraded":"2024-05-08T20:52:17.606595+0000","last_fullsized":"2024-05-08T20:52:17.606595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.759969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.997993+0000","last_change":"2024-05-08T20:27:27.618163+0000","last_active":"2024-05-08T20:54:12.997993+0000","last_peered":"2024-05-08T20:54:12.997993+0000","last_clean":"2024-05-08T20:54:12.997993+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:12.997993+0000","last_undegraded":"2024-05-08T20:54:12.997993+0000","last_fullsized":"2024-05-08T20:54:12.997993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:57.438088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948350+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:54:32.948350+0000","last_peered":"2024-05-08T20:54:32.948350+0000","last_clean":"2024-05-08T20:54:32.948350+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:54:32.948350+0000","last_undegraded":"2024-05-08T20:54:32.948350+0000","last_fullsized":"2024-05-08T20:54:32.948350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4791,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804571+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.804571+0000","last_peered":"2024-05-08T20:54:21.804571+0000","last_clean":"2024-05-08T20:54:21.804571+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.804571+0000","last_undegraded":"2024-05-08T20:54:21.804571+0000","last_fullsized":"2024-05-08T20:54:21.804571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.238592+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:53:23.238592+0000","last_peered":"2024-05-08T20:53:23.238592+0000","last_clean":"2024-05-08T20:53:23.238592+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:53:23.238592+0000","last_undegraded":"2024-05-08T20:53:23.238592+0000","last_fullsized":"2024-05-08T20:53:23.238592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.993291+0000","last_change":"2024-05-08T20:27:27.619759+0000","last_active":"2024-05-08T20:54:12.993291+0000","last_peered":"2024-05-08T20:54:12.993291+0000","last_clean":"2024-05-08T20:54:12.993291+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:12.993291+0000","last_undegraded":"2024-05-08T20:54:12.993291+0000","last_fullsized":"2024-05-08T20:54:12.993291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:55.361219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3463,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368057+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:32.368057+0000","last_peered":"2024-05-08T20:54:32.368057+0000","last_clean":"2024-05-08T20:54:32.368057+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:32.368057+0000","last_undegraded":"2024-05-08T20:54:32.368057+0000","last_fullsized":"2024-05-08T20:54:32.368057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:03.463420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793803+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793803+0000","last_peered":"2024-05-08T20:54:21.793803+0000","last_clean":"2024-05-08T20:54:21.793803+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793803+0000","last_undegraded":"2024-05-08T20:54:21.793803+0000","last_fullsized":"2024-05-08T20:54:21.793803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.238542+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:53:23.238542+0000","last_peered":"2024-05-08T20:53:23.238542+0000","last_clean":"2024-05-08T20:53:23.238542+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:53:23.238542+0000","last_undegraded":"2024-05-08T20:53:23.238542+0000","last_fullsized":"2024-05-08T20:53:23.238542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256781+0000","last_change":"2024-05-08T20:27:27.604982+0000","last_active":"2024-05-08T20:54:28.256781+0000","last_peered":"2024-05-08T20:54:28.256781+0000","last_clean":"2024-05-08T20:54:28.256781+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:28.256781+0000","last_undegraded":"2024-05-08T20:54:28.256781+0000","last_fullsized":"2024-05-08T20:54:28.256781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5795,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.481043+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:32.481043+0000","last_peered":"2024-05-08T20:54:32.481043+0000","last_clean":"2024-05-08T20:54:32.481043+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:32.481043+0000","last_undegraded":"2024-05-08T20:54:32.481043+0000","last_fullsized":"2024-05-08T20:54:32.481043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:44:18.945900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.759597+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:54:21.759597+0000","last_peered":"2024-05-08T20:54:21.759597+0000","last_clean":"2024-05-08T20:54:21.759597+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:54:21.759597+0000","last_undegraded":"2024-05-08T20:54:21.759597+0000","last_fullsized":"2024-05-08T20:54:21.759597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:28.830788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.076400+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:52:15.076400+0000","last_peered":"2024-05-08T20:52:15.076400+0000","last_clean":"2024-05-08T20:52:15.076400+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:52:15.076400+0000","last_undegraded":"2024-05-08T20:52:15.076400+0000","last_fullsized":"2024-05-08T20:52:15.076400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:48.016176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'7","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984726+0000","last_change":"2024-05-08T20:27:27.618141+0000","last_active":"2024-05-08T20:54:12.984726+0000","last_peered":"2024-05-08T20:54:12.984726+0000","last_clean":"2024-05-08T20:54:12.984726+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:12.984726+0000","last_undegraded":"2024-05-08T20:54:12.984726+0000","last_fullsized":"2024-05-08T20:54:12.984726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:22:16.622607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405724+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:54:32.405724+0000","last_peered":"2024-05-08T20:54:32.405724+0000","last_clean":"2024-05-08T20:54:32.405724+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:54:32.405724+0000","last_undegraded":"2024-05-08T20:54:32.405724+0000","last_fullsized":"2024-05-08T20:54:32.405724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6040,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.763631+0000","last_change":"2024-05-08T20:27:18.882881+0000","last_active":"2024-05-08T20:54:21.763631+0000","last_peered":"2024-05-08T20:54:21.763631+0000","last_clean":"2024-05-08T20:54:21.763631+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:21.763631+0000","last_undegraded":"2024-05-08T20:54:21.763631+0000","last_fullsized":"2024-05-08T20:54:21.763631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'8","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.519154+0000","last_change":"2024-05-08T20:27:18.528241+0000","last_active":"2024-05-08T20:52:16.519154+0000","last_peered":"2024-05-08T20:52:16.519154+0000","last_clean":"2024-05-08T20:52:16.519154+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:52:16.519154+0000","last_undegraded":"2024-05-08T20:52:16.519154+0000","last_fullsized":"2024-05-08T20:52:16.519154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:23.642324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'64","reported_seq":151,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.210071+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:54:15.210071+0000","last_peered":"2024-05-08T20:54:15.210071+0000","last_clean":"2024-05-08T20:54:15.210071+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:54:15.210071+0000","last_undegraded":"2024-05-08T20:54:15.210071+0000","last_fullsized":"2024-05-08T20:54:15.210071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:00.976281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4005,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.360912+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:32.360912+0000","last_peered":"2024-05-08T20:54:32.360912+0000","last_clean":"2024-05-08T20:54:32.360912+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:32.360912+0000","last_undegraded":"2024-05-08T20:54:32.360912+0000","last_fullsized":"2024-05-08T20:54:32.360912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:15.493372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792370+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:54:21.792370+0000","last_peered":"2024-05-08T20:54:21.792370+0000","last_clean":"2024-05-08T20:54:21.792370+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:54:21.792370+0000","last_undegraded":"2024-05-08T20:54:21.792370+0000","last_fullsized":"2024-05-08T20:54:21.792370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'254","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:17.810321+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:54:17.810321+0000","last_peered":"2024-05-08T20:54:17.810321+0000","last_clean":"2024-05-08T20:54:17.810321+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:54:17.810321+0000","last_undegraded":"2024-05-08T20:54:17.810321+0000","last_fullsized":"2024-05-08T20:54:17.810321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.011660+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:54:13.011660+0000","last_peered":"2024-05-08T20:54:13.011660+0000","last_clean":"2024-05-08T20:54:13.011660+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:54:13.011660+0000","last_undegraded":"2024-05-08T20:54:13.011660+0000","last_fullsized":"2024-05-08T20:54:13.011660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.302535+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:32.302535+0000","last_peered":"2024-05-08T20:54:32.302535+0000","last_clean":"2024-05-08T20:54:32.302535+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:32.302535+0000","last_undegraded":"2024-05-08T20:54:32.302535+0000","last_fullsized":"2024-05-08T20:54:32.302535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.313412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6866,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256639+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:54:28.256639+0000","last_peered":"2024-05-08T20:54:28.256639+0000","last_clean":"2024-05-08T20:54:28.256639+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:54:28.256639+0000","last_undegraded":"2024-05-08T20:54:28.256639+0000","last_fullsized":"2024-05-08T20:54:28.256639+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:30.539923+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:52:30.539923+0000","last_peered":"2024-05-08T20:52:30.539923+0000","last_clean":"2024-05-08T20:52:30.539923+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:52:30.539923+0000","last_undegraded":"2024-05-08T20:52:30.539923+0000","last_fullsized":"2024-05-08T20:52:30.539923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:12.129551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.385750+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:54:33.385750+0000","last_peered":"2024-05-08T20:54:33.385750+0000","last_clean":"2024-05-08T20:54:33.385750+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:54:33.385750+0000","last_undegraded":"2024-05-08T20:54:33.385750+0000","last_fullsized":"2024-05-08T20:54:33.385750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4649,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.386740+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:54:38.386740+0000","last_peered":"2024-05-08T20:54:38.386740+0000","last_clean":"2024-05-08T20:54:38.386740+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:54:38.386740+0000","last_undegraded":"2024-05-08T20:54:38.386740+0000","last_fullsized":"2024-05-08T20:54:38.386740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4651,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.898778+0000","last_change":"2024-05-08T20:27:18.930512+0000","last_active":"2024-05-08T20:54:21.898778+0000","last_peered":"2024-05-08T20:54:21.898778+0000","last_clean":"2024-05-08T20:54:21.898778+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:21.898778+0000","last_undegraded":"2024-05-08T20:54:21.898778+0000","last_fullsized":"2024-05-08T20:54:21.898778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:41.004764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256671+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:54:28.256671+0000","last_peered":"2024-05-08T20:54:28.256671+0000","last_clean":"2024-05-08T20:54:28.256671+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:54:28.256671+0000","last_undegraded":"2024-05-08T20:54:28.256671+0000","last_fullsized":"2024-05-08T20:54:28.256671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.257560+0000","last_change":"2024-05-08T20:27:27.612083+0000","last_active":"2024-05-08T20:54:33.257560+0000","last_peered":"2024-05-08T20:54:33.257560+0000","last_clean":"2024-05-08T20:54:33.257560+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:33.257560+0000","last_undegraded":"2024-05-08T20:54:33.257560+0000","last_fullsized":"2024-05-08T20:54:33.257560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.805818+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:54:41.805818+0000","last_peered":"2024-05-08T20:54:41.805818+0000","last_clean":"2024-05-08T20:54:41.805818+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:54:41.805818+0000","last_undegraded":"2024-05-08T20:54:41.805818+0000","last_fullsized":"2024-05-08T20:54:41.805818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5908,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.814282+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:54:21.814282+0000","last_peered":"2024-05-08T20:54:21.814282+0000","last_clean":"2024-05-08T20:54:21.814282+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:54:21.814282+0000","last_undegraded":"2024-05-08T20:54:21.814282+0000","last_fullsized":"2024-05-08T20:54:21.814282+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:28.869011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:20.746091+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:52:20.746091+0000","last_peered":"2024-05-08T20:52:20.746091+0000","last_clean":"2024-05-08T20:52:20.746091+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:52:20.746091+0000","last_undegraded":"2024-05-08T20:52:20.746091+0000","last_fullsized":"2024-05-08T20:52:20.746091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.274539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.257678+0000","last_change":"2024-05-08T20:27:27.597616+0000","last_active":"2024-05-08T20:54:33.257678+0000","last_peered":"2024-05-08T20:54:33.257678+0000","last_clean":"2024-05-08T20:54:33.257678+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:33.257678+0000","last_undegraded":"2024-05-08T20:54:33.257678+0000","last_fullsized":"2024-05-08T20:54:33.257678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.326126+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:54:32.326126+0000","last_peered":"2024-05-08T20:54:32.326126+0000","last_clean":"2024-05-08T20:54:32.326126+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:54:32.326126+0000","last_undegraded":"2024-05-08T20:54:32.326126+0000","last_fullsized":"2024-05-08T20:54:32.326126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.803386+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:54:21.803386+0000","last_peered":"2024-05-08T20:54:21.803386+0000","last_clean":"2024-05-08T20:54:21.803386+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:54:21.803386+0000","last_undegraded":"2024-05-08T20:54:21.803386+0000","last_fullsized":"2024-05-08T20:54:21.803386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'72","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:27.947154+0000","last_change":"2024-05-08T20:27:18.512975+0000","last_active":"2024-05-08T20:54:27.947154+0000","last_peered":"2024-05-08T20:54:27.947154+0000","last_clean":"2024-05-08T20:54:27.947154+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:27.947154+0000","last_undegraded":"2024-05-08T20:54:27.947154+0000","last_fullsized":"2024-05-08T20:54:27.947154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.017383+0000","last_change":"2024-05-08T20:27:27.612207+0000","last_active":"2024-05-08T20:54:13.017383+0000","last_peered":"2024-05-08T20:54:13.017383+0000","last_clean":"2024-05-08T20:54:13.017383+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:13.017383+0000","last_undegraded":"2024-05-08T20:54:13.017383+0000","last_fullsized":"2024-05-08T20:54:13.017383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3652,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375188+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375188+0000","last_peered":"2024-05-08T20:54:32.375188+0000","last_clean":"2024-05-08T20:54:32.375188+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375188+0000","last_undegraded":"2024-05-08T20:54:32.375188+0000","last_fullsized":"2024-05-08T20:54:32.375188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.544903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":4997,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.384700+0000","last_change":"2024-05-08T20:27:18.907645+0000","last_active":"2024-05-08T20:54:28.384700+0000","last_peered":"2024-05-08T20:54:28.384700+0000","last_clean":"2024-05-08T20:54:28.384700+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:28.384700+0000","last_undegraded":"2024-05-08T20:54:28.384700+0000","last_fullsized":"2024-05-08T20:54:28.384700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.496369+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:52:16.496369+0000","last_peered":"2024-05-08T20:52:16.496369+0000","last_clean":"2024-05-08T20:52:16.496369+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:52:16.496369+0000","last_undegraded":"2024-05-08T20:52:16.496369+0000","last_fullsized":"2024-05-08T20:52:16.496369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:34.550229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'276","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:17.817407+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:54:17.817407+0000","last_peered":"2024-05-08T20:54:17.817407+0000","last_clean":"2024-05-08T20:54:17.817407+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:54:17.817407+0000","last_undegraded":"2024-05-08T20:54:17.817407+0000","last_fullsized":"2024-05-08T20:54:17.817407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405525+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:32.405525+0000","last_peered":"2024-05-08T20:54:32.405525+0000","last_clean":"2024-05-08T20:54:32.405525+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:32.405525+0000","last_undegraded":"2024-05-08T20:54:32.405525+0000","last_fullsized":"2024-05-08T20:54:32.405525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:35.069676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5100,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.850643+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:28.850643+0000","last_peered":"2024-05-08T20:54:28.850643+0000","last_clean":"2024-05-08T20:54:28.850643+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:28.850643+0000","last_undegraded":"2024-05-08T20:54:28.850643+0000","last_fullsized":"2024-05-08T20:54:28.850643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:25.807713+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:52:25.807713+0000","last_peered":"2024-05-08T20:52:25.807713+0000","last_clean":"2024-05-08T20:52:25.807713+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:52:25.807713+0000","last_undegraded":"2024-05-08T20:52:25.807713+0000","last_fullsized":"2024-05-08T20:52:25.807713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:16.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:51:19.878927+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:51:19.878927+0000","last_peered":"2024-05-08T20:51:19.878927+0000","last_clean":"2024-05-08T20:51:19.878927+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:51:19.878927+0000","last_undegraded":"2024-05-08T20:51:19.878927+0000","last_fullsized":"2024-05-08T20:51:19.878927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:43:22.845151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.638261+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:54:07.638261+0000","last_peered":"2024-05-08T20:54:07.638261+0000","last_clean":"2024-05-08T20:54:07.638261+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:54:07.638261+0000","last_undegraded":"2024-05-08T20:54:07.638261+0000","last_fullsized":"2024-05-08T20:54:07.638261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.149873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3779,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948168+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:54:32.948168+0000","last_peered":"2024-05-08T20:54:32.948168+0000","last_clean":"2024-05-08T20:54:32.948168+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:54:32.948168+0000","last_undegraded":"2024-05-08T20:54:32.948168+0000","last_fullsized":"2024-05-08T20:54:32.948168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5582,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.883282+0000","last_change":"2024-05-08T20:27:18.933235+0000","last_active":"2024-05-08T20:54:21.883282+0000","last_peered":"2024-05-08T20:54:21.883282+0000","last_clean":"2024-05-08T20:54:21.883282+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:21.883282+0000","last_undegraded":"2024-05-08T20:54:21.883282+0000","last_fullsized":"2024-05-08T20:54:21.883282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:42.127507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.946422+0000","last_change":"2024-05-08T20:27:18.528805+0000","last_active":"2024-05-08T20:54:22.946422+0000","last_peered":"2024-05-08T20:54:22.946422+0000","last_clean":"2024-05-08T20:54:22.946422+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:22.946422+0000","last_undegraded":"2024-05-08T20:54:22.946422+0000","last_fullsized":"2024-05-08T20:54:22.946422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.966573+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:54:12.966573+0000","last_peered":"2024-05-08T20:54:12.966573+0000","last_clean":"2024-05-08T20:54:12.966573+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:54:12.966573+0000","last_undegraded":"2024-05-08T20:54:12.966573+0000","last_fullsized":"2024-05-08T20:54:12.966573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:48.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4037,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.397630+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:54:32.397630+0000","last_peered":"2024-05-08T20:54:32.397630+0000","last_clean":"2024-05-08T20:54:32.397630+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:54:32.397630+0000","last_undegraded":"2024-05-08T20:54:32.397630+0000","last_fullsized":"2024-05-08T20:54:32.397630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793232+0000","last_change":"2024-05-08T20:28:00.414547+0000","last_active":"2024-05-08T20:54:21.793232+0000","last_peered":"2024-05-08T20:54:21.793232+0000","last_clean":"2024-05-08T20:54:21.793232+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:54:21.793232+0000","last_undegraded":"2024-05-08T20:54:21.793232+0000","last_fullsized":"2024-05-08T20:54:21.793232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:23.255795+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:54:23.255795+0000","last_peered":"2024-05-08T20:54:23.255795+0000","last_clean":"2024-05-08T20:54:23.255795+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:54:23.255795+0000","last_undegraded":"2024-05-08T20:54:23.255795+0000","last_fullsized":"2024-05-08T20:54:23.255795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1136","reported_seq":1162,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.384726+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:54:28.384726+0000","last_peered":"2024-05-08T20:54:28.384726+0000","last_clean":"2024-05-08T20:54:28.384726+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:54:28.384726+0000","last_undegraded":"2024-05-08T20:54:28.384726+0000","last_fullsized":"2024-05-08T20:54:28.384726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.298191+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.298191+0000","last_peered":"2024-05-08T20:54:32.298191+0000","last_clean":"2024-05-08T20:54:32.298191+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.298191+0000","last_undegraded":"2024-05-08T20:54:32.298191+0000","last_fullsized":"2024-05-08T20:54:32.298191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:17:55.403696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.910601+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:54:21.910601+0000","last_peered":"2024-05-08T20:54:21.910601+0000","last_clean":"2024-05-08T20:54:21.910601+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:54:21.910601+0000","last_undegraded":"2024-05-08T20:54:21.910601+0000","last_fullsized":"2024-05-08T20:54:21.910601+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'7","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.946493+0000","last_change":"2024-05-08T20:27:18.513052+0000","last_active":"2024-05-08T20:54:22.946493+0000","last_peered":"2024-05-08T20:54:22.946493+0000","last_clean":"2024-05-08T20:54:22.946493+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:22.946493+0000","last_undegraded":"2024-05-08T20:54:22.946493+0000","last_fullsized":"2024-05-08T20:54:22.946493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.635968+0000","last_change":"2024-05-08T20:27:27.611861+0000","last_active":"2024-05-08T20:54:07.635968+0000","last_peered":"2024-05-08T20:54:07.635968+0000","last_clean":"2024-05-08T20:54:07.635968+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:07.635968+0000","last_undegraded":"2024-05-08T20:54:07.635968+0000","last_fullsized":"2024-05-08T20:54:07.635968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:48.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368557+0000","last_change":"2024-05-08T20:27:27.979601+0000","last_active":"2024-05-08T20:54:32.368557+0000","last_peered":"2024-05-08T20:54:32.368557+0000","last_clean":"2024-05-08T20:54:32.368557+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:32.368557+0000","last_undegraded":"2024-05-08T20:54:32.368557+0000","last_fullsized":"2024-05-08T20:54:32.368557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867267+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:54:21.867267+0000","last_peered":"2024-05-08T20:54:21.867267+0000","last_clean":"2024-05-08T20:54:21.867267+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:54:21.867267+0000","last_undegraded":"2024-05-08T20:54:21.867267+0000","last_fullsized":"2024-05-08T20:54:21.867267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:07.004883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.836779+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:52:15.836779+0000","last_peered":"2024-05-08T20:52:15.836779+0000","last_clean":"2024-05-08T20:52:15.836779+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:52:15.836779+0000","last_undegraded":"2024-05-08T20:52:15.836779+0000","last_fullsized":"2024-05-08T20:52:15.836779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:48.558562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.960698+0000","last_change":"2024-05-08T20:27:27.624746+0000","last_active":"2024-05-08T20:54:12.960698+0000","last_peered":"2024-05-08T20:54:12.960698+0000","last_clean":"2024-05-08T20:54:12.960698+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:12.960698+0000","last_undegraded":"2024-05-08T20:54:12.960698+0000","last_fullsized":"2024-05-08T20:54:12.960698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:42.185735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367383+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367383+0000","last_peered":"2024-05-08T20:54:32.367383+0000","last_clean":"2024-05-08T20:54:32.367383+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367383+0000","last_undegraded":"2024-05-08T20:54:32.367383+0000","last_fullsized":"2024-05-08T20:54:32.367383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4904,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863399+0000","last_change":"2024-05-08T20:27:18.918432+0000","last_active":"2024-05-08T20:54:21.863399+0000","last_peered":"2024-05-08T20:54:21.863399+0000","last_clean":"2024-05-08T20:54:21.863399+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:54:21.863399+0000","last_undegraded":"2024-05-08T20:54:21.863399+0000","last_fullsized":"2024-05-08T20:54:21.863399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:51.059481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.133712+0000","last_change":"2024-05-08T20:27:18.507017+0000","last_active":"2024-05-08T20:54:15.133712+0000","last_peered":"2024-05-08T20:54:15.133712+0000","last_clean":"2024-05-08T20:54:15.133712+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:15.133712+0000","last_undegraded":"2024-05-08T20:54:15.133712+0000","last_fullsized":"2024-05-08T20:54:15.133712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.985404+0000","last_change":"2024-05-08T20:27:27.605114+0000","last_active":"2024-05-08T20:54:12.985404+0000","last_peered":"2024-05-08T20:54:12.985404+0000","last_clean":"2024-05-08T20:54:12.985404+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:12.985404+0000","last_undegraded":"2024-05-08T20:54:12.985404+0000","last_fullsized":"2024-05-08T20:54:12.985404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382036+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382036+0000","last_peered":"2024-05-08T20:54:32.382036+0000","last_clean":"2024-05-08T20:54:32.382036+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382036+0000","last_undegraded":"2024-05-08T20:54:32.382036+0000","last_fullsized":"2024-05-08T20:54:32.382036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:24.203771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.789086+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:54:21.789086+0000","last_peered":"2024-05-08T20:54:21.789086+0000","last_clean":"2024-05-08T20:54:21.789086+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:54:21.789086+0000","last_undegraded":"2024-05-08T20:54:21.789086+0000","last_fullsized":"2024-05-08T20:54:21.789086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:30.114744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.946926+0000","last_change":"2024-05-08T20:27:18.542164+0000","last_active":"2024-05-08T20:52:15.946926+0000","last_peered":"2024-05-08T20:52:15.946926+0000","last_clean":"2024-05-08T20:52:15.946926+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:52:15.946926+0000","last_undegraded":"2024-05-08T20:52:15.946926+0000","last_fullsized":"2024-05-08T20:52:15.946926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:00.717614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.986900+0000","last_change":"2024-05-08T20:27:27.611271+0000","last_active":"2024-05-08T20:54:12.986900+0000","last_peered":"2024-05-08T20:54:12.986900+0000","last_clean":"2024-05-08T20:54:12.986900+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:54:12.986900+0000","last_undegraded":"2024-05-08T20:54:12.986900+0000","last_fullsized":"2024-05-08T20:54:12.986900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368762+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368762+0000","last_peered":"2024-05-08T20:54:32.368762+0000","last_clean":"2024-05-08T20:54:32.368762+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368762+0000","last_undegraded":"2024-05-08T20:54:32.368762+0000","last_fullsized":"2024-05-08T20:54:32.368762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:14.025572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6080,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.886261+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:21.886261+0000","last_peered":"2024-05-08T20:54:21.886261+0000","last_clean":"2024-05-08T20:54:21.886261+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:21.886261+0000","last_undegraded":"2024-05-08T20:54:21.886261+0000","last_fullsized":"2024-05-08T20:54:21.886261+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:05.960777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.489130+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:52:16.489130+0000","last_peered":"2024-05-08T20:52:16.489130+0000","last_clean":"2024-05-08T20:52:16.489130+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:52:16.489130+0000","last_undegraded":"2024-05-08T20:52:16.489130+0000","last_fullsized":"2024-05-08T20:52:16.489130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:17.696057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417324+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417324+0000","last_peered":"2024-05-08T20:54:43.417324+0000","last_clean":"2024-05-08T20:54:43.417324+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417324+0000","last_undegraded":"2024-05-08T20:54:43.417324+0000","last_fullsized":"2024-05-08T20:54:43.417324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398395+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398395+0000","last_peered":"2024-05-08T20:54:32.398395+0000","last_clean":"2024-05-08T20:54:32.398395+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398395+0000","last_undegraded":"2024-05-08T20:54:32.398395+0000","last_fullsized":"2024-05-08T20:54:32.398395+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4735,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750237+0000","last_change":"2024-05-08T20:27:18.901200+0000","last_active":"2024-05-08T20:54:21.750237+0000","last_peered":"2024-05-08T20:54:21.750237+0000","last_clean":"2024-05-08T20:54:21.750237+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:21.750237+0000","last_undegraded":"2024-05-08T20:54:21.750237+0000","last_fullsized":"2024-05-08T20:54:21.750237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:03.339018+0000","last_change":"2024-05-08T20:27:18.540880+0000","last_active":"2024-05-08T20:53:03.339018+0000","last_peered":"2024-05-08T20:53:03.339018+0000","last_clean":"2024-05-08T20:53:03.339018+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:53:03.339018+0000","last_undegraded":"2024-05-08T20:53:03.339018+0000","last_fullsized":"2024-05-08T20:53:03.339018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'38","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.880156+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:54:13.880156+0000","last_peered":"2024-05-08T20:54:13.880156+0000","last_clean":"2024-05-08T20:54:13.880156+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:54:13.880156+0000","last_undegraded":"2024-05-08T20:54:13.880156+0000","last_fullsized":"2024-05-08T20:54:13.880156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.620836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.428690+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:54:32.428690+0000","last_peered":"2024-05-08T20:54:32.428690+0000","last_clean":"2024-05-08T20:54:32.428690+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:54:32.428690+0000","last_undegraded":"2024-05-08T20:54:32.428690+0000","last_fullsized":"2024-05-08T20:54:32.428690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.799792+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:54:21.799792+0000","last_peered":"2024-05-08T20:54:21.799792+0000","last_clean":"2024-05-08T20:54:21.799792+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:54:21.799792+0000","last_undegraded":"2024-05-08T20:54:21.799792+0000","last_fullsized":"2024-05-08T20:54:21.799792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:01.479331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'372","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:07.848241+0000","last_change":"2024-05-08T20:27:18.511087+0000","last_active":"2024-05-08T20:53:07.848241+0000","last_peered":"2024-05-08T20:53:07.848241+0000","last_clean":"2024-05-08T20:53:07.848241+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:53:07.848241+0000","last_undegraded":"2024-05-08T20:53:07.848241+0000","last_fullsized":"2024-05-08T20:53:07.848241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:45.131698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.016977+0000","last_change":"2024-05-08T20:27:27.614877+0000","last_active":"2024-05-08T20:54:13.016977+0000","last_peered":"2024-05-08T20:54:13.016977+0000","last_clean":"2024-05-08T20:54:13.016977+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:13.016977+0000","last_undegraded":"2024-05-08T20:54:13.016977+0000","last_fullsized":"2024-05-08T20:54:13.016977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3966,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325981+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325981+0000","last_peered":"2024-05-08T20:54:32.325981+0000","last_clean":"2024-05-08T20:54:32.325981+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325981+0000","last_undegraded":"2024-05-08T20:54:32.325981+0000","last_fullsized":"2024-05-08T20:54:32.325981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.876604+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:54:21.876604+0000","last_peered":"2024-05-08T20:54:21.876604+0000","last_clean":"2024-05-08T20:54:21.876604+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:54:21.876604+0000","last_undegraded":"2024-05-08T20:54:21.876604+0000","last_fullsized":"2024-05-08T20:54:21.876604+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:47.202030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'40","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.137328+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:54:15.137328+0000","last_peered":"2024-05-08T20:54:15.137328+0000","last_clean":"2024-05-08T20:54:15.137328+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:54:15.137328+0000","last_undegraded":"2024-05-08T20:54:15.137328+0000","last_fullsized":"2024-05-08T20:54:15.137328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'7","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.991280+0000","last_change":"2024-05-08T20:27:27.624882+0000","last_active":"2024-05-08T20:54:12.991280+0000","last_peered":"2024-05-08T20:54:12.991280+0000","last_clean":"2024-05-08T20:54:12.991280+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:12.991280+0000","last_undegraded":"2024-05-08T20:54:12.991280+0000","last_fullsized":"2024-05-08T20:54:12.991280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:41.362210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.363218+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.363218+0000","last_peered":"2024-05-08T20:54:32.363218+0000","last_clean":"2024-05-08T20:54:32.363218+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.363218+0000","last_undegraded":"2024-05-08T20:54:32.363218+0000","last_fullsized":"2024-05-08T20:54:32.363218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:41.575222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5282,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.835961+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:54:21.835961+0000","last_peered":"2024-05-08T20:54:21.835961+0000","last_clean":"2024-05-08T20:54:21.835961+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:54:21.835961+0000","last_undegraded":"2024-05-08T20:54:21.835961+0000","last_fullsized":"2024-05-08T20:54:21.835961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:16.483086+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:52:16.483086+0000","last_peered":"2024-05-08T20:52:16.483086+0000","last_clean":"2024-05-08T20:52:16.483086+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:52:16.483086+0000","last_undegraded":"2024-05-08T20:52:16.483086+0000","last_fullsized":"2024-05-08T20:52:16.483086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:39.688535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'15","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.212363+0000","last_change":"2024-05-08T20:27:27.603244+0000","last_active":"2024-05-08T20:54:15.212363+0000","last_peered":"2024-05-08T20:54:15.212363+0000","last_clean":"2024-05-08T20:54:15.212363+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:15.212363+0000","last_undegraded":"2024-05-08T20:54:15.212363+0000","last_fullsized":"2024-05-08T20:54:15.212363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406456+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:32.406456+0000","last_peered":"2024-05-08T20:54:32.406456+0000","last_clean":"2024-05-08T20:54:32.406456+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:32.406456+0000","last_undegraded":"2024-05-08T20:54:32.406456+0000","last_fullsized":"2024-05-08T20:54:32.406456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:49:11.093835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5986,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.800922+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.800922+0000","last_peered":"2024-05-08T20:54:21.800922+0000","last_clean":"2024-05-08T20:54:21.800922+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.800922+0000","last_undegraded":"2024-05-08T20:54:21.800922+0000","last_fullsized":"2024-05-08T20:54:21.800922+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:39.693126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:15.981217+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:52:15.981217+0000","last_peered":"2024-05-08T20:52:15.981217+0000","last_clean":"2024-05-08T20:52:15.981217+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:52:15.981217+0000","last_undegraded":"2024-05-08T20:52:15.981217+0000","last_fullsized":"2024-05-08T20:52:15.981217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:24.461755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.987221+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:54:12.987221+0000","last_peered":"2024-05-08T20:54:12.987221+0000","last_clean":"2024-05-08T20:54:12.987221+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:54:12.987221+0000","last_undegraded":"2024-05-08T20:54:12.987221+0000","last_fullsized":"2024-05-08T20:54:12.987221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6613,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.394003+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:32.394003+0000","last_peered":"2024-05-08T20:54:32.394003+0000","last_clean":"2024-05-08T20:54:32.394003+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:32.394003+0000","last_undegraded":"2024-05-08T20:54:32.394003+0000","last_fullsized":"2024-05-08T20:54:32.394003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:26.320322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.980433+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:54:12.980433+0000","last_peered":"2024-05-08T20:54:12.980433+0000","last_clean":"2024-05-08T20:54:12.980433+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:54:12.980433+0000","last_undegraded":"2024-05-08T20:54:12.980433+0000","last_fullsized":"2024-05-08T20:54:12.980433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.533842+0000","last_change":"2024-05-08T20:27:18.887427+0000","last_active":"2024-05-08T20:54:22.533842+0000","last_peered":"2024-05-08T20:54:22.533842+0000","last_clean":"2024-05-08T20:54:22.533842+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:22.533842+0000","last_undegraded":"2024-05-08T20:54:22.533842+0000","last_fullsized":"2024-05-08T20:54:22.533842+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:03.788193+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:52:03.788193+0000","last_peered":"2024-05-08T20:52:03.788193+0000","last_clean":"2024-05-08T20:52:03.788193+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:52:03.788193+0000","last_undegraded":"2024-05-08T20:52:03.788193+0000","last_fullsized":"2024-05-08T20:52:03.788193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:25.808884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4372,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.307817+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:54:32.307817+0000","last_peered":"2024-05-08T20:54:32.307817+0000","last_clean":"2024-05-08T20:54:32.307817+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:54:32.307817+0000","last_undegraded":"2024-05-08T20:54:32.307817+0000","last_fullsized":"2024-05-08T20:54:32.307817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":773,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.984777+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:54:12.984777+0000","last_peered":"2024-05-08T20:54:12.984777+0000","last_clean":"2024-05-08T20:54:12.984777+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:54:12.984777+0000","last_undegraded":"2024-05-08T20:54:12.984777+0000","last_fullsized":"2024-05-08T20:54:12.984777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:15.279885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.801850+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:54:21.801850+0000","last_peered":"2024-05-08T20:54:21.801850+0000","last_clean":"2024-05-08T20:54:21.801850+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:54:21.801850+0000","last_undegraded":"2024-05-08T20:54:21.801850+0000","last_fullsized":"2024-05-08T20:54:21.801850+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:58.843758+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:53:58.843758+0000","last_peered":"2024-05-08T20:53:58.843758+0000","last_clean":"2024-05-08T20:53:58.843758+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:53:58.843758+0000","last_undegraded":"2024-05-08T20:53:58.843758+0000","last_fullsized":"2024-05-08T20:53:58.843758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.443836+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:54:32.443836+0000","last_peered":"2024-05-08T20:54:32.443836+0000","last_clean":"2024-05-08T20:54:32.443836+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:54:32.443836+0000","last_undegraded":"2024-05-08T20:54:32.443836+0000","last_fullsized":"2024-05-08T20:54:32.443836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'162","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.590870+0000","last_change":"2024-05-08T20:27:18.540976+0000","last_active":"2024-05-08T20:54:21.590870+0000","last_peered":"2024-05-08T20:54:21.590870+0000","last_clean":"2024-05-08T20:54:21.590870+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:21.590870+0000","last_undegraded":"2024-05-08T20:54:21.590870+0000","last_fullsized":"2024-05-08T20:54:21.590870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:12.496802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4478,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.021555+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:54:22.021555+0000","last_peered":"2024-05-08T20:54:22.021555+0000","last_clean":"2024-05-08T20:54:22.021555+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:54:22.021555+0000","last_undegraded":"2024-05-08T20:54:22.021555+0000","last_fullsized":"2024-05-08T20:54:22.021555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'5","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.002928+0000","last_change":"2024-05-08T20:27:27.595035+0000","last_active":"2024-05-08T20:54:13.002928+0000","last_peered":"2024-05-08T20:54:13.002928+0000","last_clean":"2024-05-08T20:54:13.002928+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:54:13.002928+0000","last_undegraded":"2024-05-08T20:54:13.002928+0000","last_fullsized":"2024-05-08T20:54:13.002928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.400488+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:32.400488+0000","last_peered":"2024-05-08T20:54:32.400488+0000","last_clean":"2024-05-08T20:54:32.400488+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:32.400488+0000","last_undegraded":"2024-05-08T20:54:32.400488+0000","last_fullsized":"2024-05-08T20:54:32.400488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:38.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'654","reported_seq":682,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:52:23.805824+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:52:23.805824+0000","last_peered":"2024-05-08T20:52:23.805824+0000","last_clean":"2024-05-08T20:52:23.805824+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:52:23.805824+0000","last_undegraded":"2024-05-08T20:52:23.805824+0000","last_fullsized":"2024-05-08T20:52:23.805824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.786384+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:54:21.786384+0000","last_peered":"2024-05-08T20:54:21.786384+0000","last_clean":"2024-05-08T20:54:21.786384+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:54:21.786384+0000","last_undegraded":"2024-05-08T20:54:21.786384+0000","last_fullsized":"2024-05-08T20:54:21.786384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:53.435603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'7","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.972661+0000","last_change":"2024-05-08T20:27:27.603358+0000","last_active":"2024-05-08T20:54:12.972661+0000","last_peered":"2024-05-08T20:54:12.972661+0000","last_clean":"2024-05-08T20:54:12.972661+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:12.972661+0000","last_undegraded":"2024-05-08T20:54:12.972661+0000","last_fullsized":"2024-05-08T20:54:12.972661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3740,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447440+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.447440+0000","last_peered":"2024-05-08T20:54:32.447440+0000","last_clean":"2024-05-08T20:54:32.447440+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.447440+0000","last_undegraded":"2024-05-08T20:54:32.447440+0000","last_fullsized":"2024-05-08T20:54:32.447440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5354,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.809888+0000","last_change":"2024-05-08T20:27:18.895913+0000","last_active":"2024-05-08T20:54:21.809888+0000","last_peered":"2024-05-08T20:54:21.809888+0000","last_clean":"2024-05-08T20:54:21.809888+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:21.809888+0000","last_undegraded":"2024-05-08T20:54:21.809888+0000","last_fullsized":"2024-05-08T20:54:21.809888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:34.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.416552+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.416552+0000","last_peered":"2024-05-08T20:54:32.416552+0000","last_clean":"2024-05-08T20:54:32.416552+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.416552+0000","last_undegraded":"2024-05-08T20:54:32.416552+0000","last_fullsized":"2024-05-08T20:54:32.416552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:27.947136+0000","last_change":"2024-05-08T20:27:18.926260+0000","last_active":"2024-05-08T20:54:27.947136+0000","last_peered":"2024-05-08T20:54:27.947136+0000","last_clean":"2024-05-08T20:54:27.947136+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:27.947136+0000","last_undegraded":"2024-05-08T20:54:27.947136+0000","last_fullsized":"2024-05-08T20:54:27.947136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.290807+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.290807+0000","last_peered":"2024-05-08T20:54:32.290807+0000","last_clean":"2024-05-08T20:54:32.290807+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.290807+0000","last_undegraded":"2024-05-08T20:54:32.290807+0000","last_fullsized":"2024-05-08T20:54:32.290807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:09:41.996496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873705+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:21.873705+0000","last_peered":"2024-05-08T20:54:21.873705+0000","last_clean":"2024-05-08T20:54:21.873705+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:21.873705+0000","last_undegraded":"2024-05-08T20:54:21.873705+0000","last_fullsized":"2024-05-08T20:54:21.873705+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:33.541588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.440334+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.440334+0000","last_peered":"2024-05-08T20:54:32.440334+0000","last_clean":"2024-05-08T20:54:32.440334+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.440334+0000","last_undegraded":"2024-05-08T20:54:32.440334+0000","last_fullsized":"2024-05-08T20:54:32.440334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5723,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.385789+0000","last_change":"2024-05-08T20:27:18.887614+0000","last_active":"2024-05-08T20:54:33.385789+0000","last_peered":"2024-05-08T20:54:33.385789+0000","last_clean":"2024-05-08T20:54:33.385789+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:33.385789+0000","last_undegraded":"2024-05-08T20:54:33.385789+0000","last_fullsized":"2024-05-08T20:54:33.385789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5114,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339615+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:32.339615+0000","last_peered":"2024-05-08T20:54:32.339615+0000","last_clean":"2024-05-08T20:54:32.339615+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:32.339615+0000","last_undegraded":"2024-05-08T20:54:32.339615+0000","last_fullsized":"2024-05-08T20:54:32.339615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:30.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862664+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862664+0000","last_peered":"2024-05-08T20:54:21.862664+0000","last_clean":"2024-05-08T20:54:21.862664+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862664+0000","last_undegraded":"2024-05-08T20:54:21.862664+0000","last_fullsized":"2024-05-08T20:54:21.862664+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4140,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.407488+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:32.407488+0000","last_peered":"2024-05-08T20:54:32.407488+0000","last_clean":"2024-05-08T20:54:32.407488+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:32.407488+0000","last_undegraded":"2024-05-08T20:54:32.407488+0000","last_fullsized":"2024-05-08T20:54:32.407488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:39.221769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.741511+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:54:21.741511+0000","last_peered":"2024-05-08T20:54:21.741511+0000","last_clean":"2024-05-08T20:54:21.741511+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:54:21.741511+0000","last_undegraded":"2024-05-08T20:54:21.741511+0000","last_fullsized":"2024-05-08T20:54:21.741511+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4688,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.407082+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:32.407082+0000","last_peered":"2024-05-08T20:54:32.407082+0000","last_clean":"2024-05-08T20:54:32.407082+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:32.407082+0000","last_undegraded":"2024-05-08T20:54:32.407082+0000","last_fullsized":"2024-05-08T20:54:32.407082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:49.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5094,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907633+0000","last_change":"2024-05-08T20:27:18.910155+0000","last_active":"2024-05-08T20:54:21.907633+0000","last_peered":"2024-05-08T20:54:21.907633+0000","last_clean":"2024-05-08T20:54:21.907633+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:21.907633+0000","last_undegraded":"2024-05-08T20:54:21.907633+0000","last_fullsized":"2024-05-08T20:54:21.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:21.734123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4664,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370570+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:32.370570+0000","last_peered":"2024-05-08T20:54:32.370570+0000","last_clean":"2024-05-08T20:54:32.370570+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:32.370570+0000","last_undegraded":"2024-05-08T20:54:32.370570+0000","last_fullsized":"2024-05-08T20:54:32.370570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:48.611535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750604+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:54:21.750604+0000","last_peered":"2024-05-08T20:54:21.750604+0000","last_clean":"2024-05-08T20:54:21.750604+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:54:21.750604+0000","last_undegraded":"2024-05-08T20:54:21.750604+0000","last_fullsized":"2024-05-08T20:54:21.750604+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4933,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.449638+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.449638+0000","last_peered":"2024-05-08T20:54:32.449638+0000","last_clean":"2024-05-08T20:54:32.449638+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.449638+0000","last_undegraded":"2024-05-08T20:54:32.449638+0000","last_fullsized":"2024-05-08T20:54:32.449638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824316+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824316+0000","last_peered":"2024-05-08T20:54:21.824316+0000","last_clean":"2024-05-08T20:54:21.824316+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824316+0000","last_undegraded":"2024-05-08T20:54:21.824316+0000","last_fullsized":"2024-05-08T20:54:21.824316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:15.550342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6030,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.339757+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:54:32.339757+0000","last_peered":"2024-05-08T20:54:32.339757+0000","last_clean":"2024-05-08T20:54:32.339757+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:54:32.339757+0000","last_undegraded":"2024-05-08T20:54:32.339757+0000","last_fullsized":"2024-05-08T20:54:32.339757+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:23.735722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863259+0000","last_change":"2024-05-08T20:27:18.897525+0000","last_active":"2024-05-08T20:54:21.863259+0000","last_peered":"2024-05-08T20:54:21.863259+0000","last_clean":"2024-05-08T20:54:21.863259+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:54:21.863259+0000","last_undegraded":"2024-05-08T20:54:21.863259+0000","last_fullsized":"2024-05-08T20:54:21.863259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948250+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:54:32.948250+0000","last_peered":"2024-05-08T20:54:32.948250+0000","last_clean":"2024-05-08T20:54:32.948250+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:54:32.948250+0000","last_undegraded":"2024-05-08T20:54:32.948250+0000","last_fullsized":"2024-05-08T20:54:32.948250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873770+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.873770+0000","last_peered":"2024-05-08T20:54:21.873770+0000","last_clean":"2024-05-08T20:54:21.873770+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.873770+0000","last_undegraded":"2024-05-08T20:54:21.873770+0000","last_fullsized":"2024-05-08T20:54:21.873770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:25.530853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4593,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.851895+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:33.851895+0000","last_peered":"2024-05-08T20:54:33.851895+0000","last_clean":"2024-05-08T20:54:33.851895+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:33.851895+0000","last_undegraded":"2024-05-08T20:54:33.851895+0000","last_fullsized":"2024-05-08T20:54:33.851895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.798409+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:21.798409+0000","last_peered":"2024-05-08T20:54:21.798409+0000","last_clean":"2024-05-08T20:54:21.798409+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:21.798409+0000","last_undegraded":"2024-05-08T20:54:21.798409+0000","last_fullsized":"2024-05-08T20:54:21.798409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406667+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:32.406667+0000","last_peered":"2024-05-08T20:54:32.406667+0000","last_clean":"2024-05-08T20:54:32.406667+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:32.406667+0000","last_undegraded":"2024-05-08T20:54:32.406667+0000","last_fullsized":"2024-05-08T20:54:32.406667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:08.745000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.842224+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:54:21.842224+0000","last_peered":"2024-05-08T20:54:21.842224+0000","last_clean":"2024-05-08T20:54:21.842224+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:54:21.842224+0000","last_undegraded":"2024-05-08T20:54:21.842224+0000","last_fullsized":"2024-05-08T20:54:21.842224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:07.637184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.427047+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:32.427047+0000","last_peered":"2024-05-08T20:54:32.427047+0000","last_clean":"2024-05-08T20:54:32.427047+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:32.427047+0000","last_undegraded":"2024-05-08T20:54:32.427047+0000","last_fullsized":"2024-05-08T20:54:32.427047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:22.636416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6035,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.839762+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:54:21.839762+0000","last_peered":"2024-05-08T20:54:21.839762+0000","last_clean":"2024-05-08T20:54:21.839762+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:54:21.839762+0000","last_undegraded":"2024-05-08T20:54:21.839762+0000","last_fullsized":"2024-05-08T20:54:21.839762+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:32.761409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.320278+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.320278+0000","last_peered":"2024-05-08T20:54:32.320278+0000","last_clean":"2024-05-08T20:54:32.320278+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.320278+0000","last_undegraded":"2024-05-08T20:54:32.320278+0000","last_fullsized":"2024-05-08T20:54:32.320278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:40.117324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.566965+0000","last_change":"2024-05-08T20:27:18.904981+0000","last_active":"2024-05-08T20:54:22.566965+0000","last_peered":"2024-05-08T20:54:22.566965+0000","last_clean":"2024-05-08T20:54:22.566965+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:22.566965+0000","last_undegraded":"2024-05-08T20:54:22.566965+0000","last_fullsized":"2024-05-08T20:54:22.566965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3941,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.385640+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:54:33.385640+0000","last_peered":"2024-05-08T20:54:33.385640+0000","last_clean":"2024-05-08T20:54:33.385640+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:54:33.385640+0000","last_undegraded":"2024-05-08T20:54:33.385640+0000","last_fullsized":"2024-05-08T20:54:33.385640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7206,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873440+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:54:21.873440+0000","last_peered":"2024-05-08T20:54:21.873440+0000","last_clean":"2024-05-08T20:54:21.873440+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:54:21.873440+0000","last_undegraded":"2024-05-08T20:54:21.873440+0000","last_fullsized":"2024-05-08T20:54:21.873440+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:46.913326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.421794+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.421794+0000","last_peered":"2024-05-08T20:54:32.421794+0000","last_clean":"2024-05-08T20:54:32.421794+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.421794+0000","last_undegraded":"2024-05-08T20:54:32.421794+0000","last_fullsized":"2024-05-08T20:54:32.421794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.827140+0000","last_change":"2024-05-08T20:27:18.924832+0000","last_active":"2024-05-08T20:54:21.827140+0000","last_peered":"2024-05-08T20:54:21.827140+0000","last_clean":"2024-05-08T20:54:21.827140+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:21.827140+0000","last_undegraded":"2024-05-08T20:54:21.827140+0000","last_fullsized":"2024-05-08T20:54:21.827140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:31.189142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415141+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415141+0000","last_peered":"2024-05-08T20:54:32.415141+0000","last_clean":"2024-05-08T20:54:32.415141+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415141+0000","last_undegraded":"2024-05-08T20:54:32.415141+0000","last_fullsized":"2024-05-08T20:54:32.415141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:03.955343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4630,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862817+0000","last_change":"2024-05-08T20:27:18.894541+0000","last_active":"2024-05-08T20:54:21.862817+0000","last_peered":"2024-05-08T20:54:21.862817+0000","last_clean":"2024-05-08T20:54:21.862817+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:21.862817+0000","last_undegraded":"2024-05-08T20:54:21.862817+0000","last_fullsized":"2024-05-08T20:54:21.862817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.342985+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.342985+0000","last_peered":"2024-05-08T20:54:32.342985+0000","last_clean":"2024-05-08T20:54:32.342985+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.342985+0000","last_undegraded":"2024-05-08T20:54:32.342985+0000","last_fullsized":"2024-05-08T20:54:32.342985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:21:45.652325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941403+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941403+0000","last_peered":"2024-05-08T20:54:42.941403+0000","last_clean":"2024-05-08T20:54:42.941403+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941403+0000","last_undegraded":"2024-05-08T20:54:42.941403+0000","last_fullsized":"2024-05-08T20:54:42.941403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4213,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382399+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.382399+0000","last_peered":"2024-05-08T20:54:32.382399+0000","last_clean":"2024-05-08T20:54:32.382399+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.382399+0000","last_undegraded":"2024-05-08T20:54:32.382399+0000","last_fullsized":"2024-05-08T20:54:32.382399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:41.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4654,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.773301+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:54:21.773301+0000","last_peered":"2024-05-08T20:54:21.773301+0000","last_clean":"2024-05-08T20:54:21.773301+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:54:21.773301+0000","last_undegraded":"2024-05-08T20:54:21.773301+0000","last_fullsized":"2024-05-08T20:54:21.773301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.357288+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.357288+0000","last_peered":"2024-05-08T20:54:32.357288+0000","last_clean":"2024-05-08T20:54:32.357288+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.357288+0000","last_undegraded":"2024-05-08T20:54:32.357288+0000","last_fullsized":"2024-05-08T20:54:32.357288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3715,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863383+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:54:21.863383+0000","last_peered":"2024-05-08T20:54:21.863383+0000","last_clean":"2024-05-08T20:54:21.863383+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:54:21.863383+0000","last_undegraded":"2024-05-08T20:54:21.863383+0000","last_fullsized":"2024-05-08T20:54:21.863383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:04.136427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340613+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:54:32.340613+0000","last_peered":"2024-05-08T20:54:32.340613+0000","last_clean":"2024-05-08T20:54:32.340613+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:54:32.340613+0000","last_undegraded":"2024-05-08T20:54:32.340613+0000","last_fullsized":"2024-05-08T20:54:32.340613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.808590+0000","last_change":"2024-05-08T20:27:18.932697+0000","last_active":"2024-05-08T20:54:21.808590+0000","last_peered":"2024-05-08T20:54:21.808590+0000","last_clean":"2024-05-08T20:54:21.808590+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:21.808590+0000","last_undegraded":"2024-05-08T20:54:21.808590+0000","last_fullsized":"2024-05-08T20:54:21.808590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:58.383433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.391513+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:54:32.391513+0000","last_peered":"2024-05-08T20:54:32.391513+0000","last_clean":"2024-05-08T20:54:32.391513+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:54:32.391513+0000","last_undegraded":"2024-05-08T20:54:32.391513+0000","last_fullsized":"2024-05-08T20:54:32.391513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:48.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.904783+0000","last_change":"2024-05-08T20:28:00.413131+0000","last_active":"2024-05-08T20:54:21.904783+0000","last_peered":"2024-05-08T20:54:21.904783+0000","last_clean":"2024-05-08T20:54:21.904783+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:21.904783+0000","last_undegraded":"2024-05-08T20:54:21.904783+0000","last_fullsized":"2024-05-08T20:54:21.904783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:24.920403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.295323+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:54:32.295323+0000","last_peered":"2024-05-08T20:54:32.295323+0000","last_clean":"2024-05-08T20:54:32.295323+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:54:32.295323+0000","last_undegraded":"2024-05-08T20:54:32.295323+0000","last_fullsized":"2024-05-08T20:54:32.295323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:52:12.164098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6669,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907477+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:54:21.907477+0000","last_peered":"2024-05-08T20:54:21.907477+0000","last_clean":"2024-05-08T20:54:21.907477+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:54:21.907477+0000","last_undegraded":"2024-05-08T20:54:21.907477+0000","last_fullsized":"2024-05-08T20:54:21.907477+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:36:59.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.852816+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:38.852816+0000","last_peered":"2024-05-08T20:54:38.852816+0000","last_clean":"2024-05-08T20:54:38.852816+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:38.852816+0000","last_undegraded":"2024-05-08T20:54:38.852816+0000","last_fullsized":"2024-05-08T20:54:38.852816+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.828298+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.828298+0000","last_peered":"2024-05-08T20:54:21.828298+0000","last_clean":"2024-05-08T20:54:21.828298+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.828298+0000","last_undegraded":"2024-05-08T20:54:21.828298+0000","last_fullsized":"2024-05-08T20:54:21.828298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4044,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.374361+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:32.374361+0000","last_peered":"2024-05-08T20:54:32.374361+0000","last_clean":"2024-05-08T20:54:32.374361+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:32.374361+0000","last_undegraded":"2024-05-08T20:54:32.374361+0000","last_fullsized":"2024-05-08T20:54:32.374361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:08.167343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.742400+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:54:21.742400+0000","last_peered":"2024-05-08T20:54:21.742400+0000","last_clean":"2024-05-08T20:54:21.742400+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:54:21.742400+0000","last_undegraded":"2024-05-08T20:54:21.742400+0000","last_fullsized":"2024-05-08T20:54:21.742400+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:21.319452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385760+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385760+0000","last_peered":"2024-05-08T20:54:32.385760+0000","last_clean":"2024-05-08T20:54:32.385760+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385760+0000","last_undegraded":"2024-05-08T20:54:32.385760+0000","last_fullsized":"2024-05-08T20:54:32.385760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4562,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.873313+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:54:21.873313+0000","last_peered":"2024-05-08T20:54:21.873313+0000","last_clean":"2024-05-08T20:54:21.873313+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:54:21.873313+0000","last_undegraded":"2024-05-08T20:54:21.873313+0000","last_fullsized":"2024-05-08T20:54:21.873313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:11.257197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.381776+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.381776+0000","last_peered":"2024-05-08T20:54:32.381776+0000","last_clean":"2024-05-08T20:54:32.381776+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.381776+0000","last_undegraded":"2024-05-08T20:54:32.381776+0000","last_fullsized":"2024-05-08T20:54:32.381776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4837,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.867693+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:54:21.867693+0000","last_peered":"2024-05-08T20:54:21.867693+0000","last_clean":"2024-05-08T20:54:21.867693+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:54:21.867693+0000","last_undegraded":"2024-05-08T20:54:21.867693+0000","last_fullsized":"2024-05-08T20:54:21.867693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:50.839813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3763,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.366093+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:32.366093+0000","last_peered":"2024-05-08T20:54:32.366093+0000","last_clean":"2024-05-08T20:54:32.366093+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:32.366093+0000","last_undegraded":"2024-05-08T20:54:32.366093+0000","last_fullsized":"2024-05-08T20:54:32.366093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.774789+0000","last_change":"2024-05-08T20:27:18.930173+0000","last_active":"2024-05-08T20:54:21.774789+0000","last_peered":"2024-05-08T20:54:21.774789+0000","last_clean":"2024-05-08T20:54:21.774789+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:21.774789+0000","last_undegraded":"2024-05-08T20:54:21.774789+0000","last_fullsized":"2024-05-08T20:54:21.774789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:45.916846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.401906+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:54:32.401906+0000","last_peered":"2024-05-08T20:54:32.401906+0000","last_clean":"2024-05-08T20:54:32.401906+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:54:32.401906+0000","last_undegraded":"2024-05-08T20:54:32.401906+0000","last_fullsized":"2024-05-08T20:54:32.401906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5668,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.384772+0000","last_change":"2024-05-08T20:27:18.882669+0000","last_active":"2024-05-08T20:54:28.384772+0000","last_peered":"2024-05-08T20:54:28.384772+0000","last_clean":"2024-05-08T20:54:28.384772+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:54:28.384772+0000","last_undegraded":"2024-05-08T20:54:28.384772+0000","last_fullsized":"2024-05-08T20:54:28.384772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4376,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.380157+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:32.380157+0000","last_peered":"2024-05-08T20:54:32.380157+0000","last_clean":"2024-05-08T20:54:32.380157+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:32.380157+0000","last_undegraded":"2024-05-08T20:54:32.380157+0000","last_fullsized":"2024-05-08T20:54:32.380157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:44.323984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6674,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256744+0000","last_change":"2024-05-08T20:27:18.890020+0000","last_active":"2024-05-08T20:54:28.256744+0000","last_peered":"2024-05-08T20:54:28.256744+0000","last_clean":"2024-05-08T20:54:28.256744+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:28.256744+0000","last_undegraded":"2024-05-08T20:54:28.256744+0000","last_fullsized":"2024-05-08T20:54:28.256744+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.346308+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:54:32.346308+0000","last_peered":"2024-05-08T20:54:32.346308+0000","last_clean":"2024-05-08T20:54:32.346308+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:54:32.346308+0000","last_undegraded":"2024-05-08T20:54:32.346308+0000","last_fullsized":"2024-05-08T20:54:32.346308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:47.593206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5134,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.900494+0000","last_change":"2024-05-08T20:27:18.913291+0000","last_active":"2024-05-08T20:54:21.900494+0000","last_peered":"2024-05-08T20:54:21.900494+0000","last_clean":"2024-05-08T20:54:21.900494+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:21.900494+0000","last_undegraded":"2024-05-08T20:54:21.900494+0000","last_fullsized":"2024-05-08T20:54:21.900494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:31.734985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3539,"ondisk_log_size":3539,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575184,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":3.4089999999999998,"15min":1.579},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":4.5750000000000002,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.9650000000000001,"15min":1.1859999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":3.7829999999999999,"5min":34.091000000000001,"15min":34.091000000000001},"last":0.71199999999999997}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.732,"15min":1.077},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.4249999999999998,"5min":13.579000000000001,"15min":13.579000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.736,"15min":1.153},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":7.4699999999999998,"5min":13.467000000000001,"15min":13.467000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.9199999999999999,"15min":1.147},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":4.585,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":2.069,"15min":1.288},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":4.5570000000000004,"5min":34.003999999999998,"15min":34.003999999999998},"last":0.878}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.663,"15min":1.1100000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2589999999999999,"5min":15.532,"15min":15.532},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.2879999999999998,"15min":1.397},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.5,"5min":16.584,"15min":16.584},"last":0.91000000000000003}]},{"osd":4,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.4950000000000001,"15min":1.732},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.214},"max":{"1min":6.4630000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.2389999999999999,"15min":1.361},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":4.617,"5min":22.741,"15min":22.741},"last":1.069}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":4.0570000000000004,"15min":1.9810000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":5.8380000000000001,"5min":33.679000000000002,"15min":33.679000000000002},"last":1.022},{"interface":"front","average":{"1min":1.522,"5min":2.5019999999999998,"15min":1.506},"min":{"1min":0.41999999999999998,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":4.5700000000000003,"5min":20.869,"15min":20.869},"last":1.105}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7050000000000001,"15min":1.2669999999999999},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.157,"5min":13.714,"15min":13.714},"last":1.159},{"interface":"front","average":{"1min":1.6539999999999999,"5min":2.2090000000000001,"15min":1.3480000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":6.2519999999999998,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.98899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575183,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.5369999999999999,"15min":0.99099999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":4.657,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.726,"15min":1.181},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":7.2960000000000003,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":1.9330000000000001,"15min":1.1830000000000001},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":2.5270000000000001,"5min":14.717000000000001,"15min":14.717000000000001},"last":1.099},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.71,"15min":1.0900000000000001},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":7.3810000000000002,"5min":14.404,"15min":14.404},"last":0.92200000000000004}]},{"osd":2,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.603,"15min":1.095},"min":{"1min":0.38200000000000001,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":3.5310000000000001,"5min":9.907,"15min":9.907},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.4530000000000001,"15min":1.093},"min":{"1min":0.41899999999999998,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":3.694,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.1739999999999999}]},{"osd":3,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":2.0630000000000002,"15min":1.3089999999999999},"min":{"1min":0.30099999999999999,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":4.3780000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.714,"15min":1.198},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":4.6280000000000001,"5min":8.2940000000000005,"15min":8.2940000000000005},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":2.9340000000000002,"15min":1.552},"min":{"1min":0.39100000000000001,"5min":0.28699999999999998,"15min":0.223},"max":{"1min":4.4450000000000003,"5min":30.094000000000001,"15min":30.094000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":2.4620000000000002,"15min":1.4410000000000001},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":4.415,"5min":29.538,"15min":29.538},"last":1.133}]},{"osd":5,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.98,"15min":1.206},"min":{"1min":0.47999999999999998,"5min":0.28499999999999998,"15min":0.25},"max":{"1min":3.7589999999999999,"5min":11.568,"15min":11.568},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":2.0369999999999999,"15min":1.329},"min":{"1min":0.52500000000000002,"5min":0.34899999999999998,"15min":0.34599999999999997},"max":{"1min":3.806,"5min":11.593999999999999,"15min":11.593999999999999},"last":1.012}]},{"osd":7,"last update":"Wed May 8 20:53:58 2024","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":2.1600000000000001,"15min":1.2769999999999999},"min":{"1min":0.317,"5min":0.188,"15min":0.188},"max":{"1min":4.2430000000000003,"5min":12.77,"15min":12.77},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.532,"5min":2.0449999999999999,"15min":1.2909999999999999},"min":{"1min":0.371,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":6.2880000000000003,"5min":20.495999999999999,"15min":20.495999999999999},"last":0.877}]}]},{"osd":5,"up_from":13,"seq":55834575183,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.6799999999999999,"15min":1.056},"min":{"1min":0.25600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":2.4550000000000001,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.357,"15min":1.0029999999999999},"min":{"1min":0.33500000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7799999999999998,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":1.014}]},{"osd":1,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":5.3259999999999996,"15min":2.298},"min":{"1min":0.28999999999999998,"5min":0.25900000000000001,"15min":0.20799999999999999},"max":{"1min":5.3019999999999996,"5min":121.521,"15min":121.521},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.139,"5min":1.9159999999999999,"15min":1.2030000000000001},"min":{"1min":0.28399999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":6.9409999999999998,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.96499999999999997}]},{"osd":2,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.9630000000000001,"15min":1.206},"min":{"1min":0.25,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":5.2569999999999997,"5min":16.535,"15min":16.535},"last":1.147},{"interface":"front","average":{"1min":1.028,"5min":1.7410000000000001,"15min":1.1379999999999999},"min":{"1min":0.32400000000000001,"5min":0.26800000000000002,"15min":0.249},"max":{"1min":2.9590000000000001,"5min":15.006,"15min":15.006},"last":0.84199999999999997}]},{"osd":3,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":5.6790000000000003,"15min":2.4950000000000001},"min":{"1min":0.315,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":5.2830000000000004,"5min":121.498,"15min":121.498},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.093,"5min":1.849,"15min":1.256},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.0549999999999997,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.169}]},{"osd":4,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":5.202,"15min":2.3149999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":5.3209999999999997,"5min":121.464,"15min":121.464},"last":1.05},{"interface":"front","average":{"1min":1.613,"5min":1.746,"15min":1.1870000000000001},"min":{"1min":0.35999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.2329999999999997,"5min":8.2710000000000008,"15min":8.2710000000000008},"last":1.073}]},{"osd":6,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":2.0790000000000002,"15min":1.3120000000000001},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0910000000000002,"5min":15.048,"15min":15.048},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.6970000000000001,"15min":1.212},"min":{"1min":0.38100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":5.3360000000000003,"5min":11.56,"15min":11.56},"last":1.2729999999999999}]},{"osd":7,"last update":"Wed May 8 20:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":3.915,"15min":1.9730000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":2.8370000000000002,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.621,"15min":1.2330000000000001},"min":{"1min":0.436,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":5.1429999999999998,"5min":12.679,"15min":12.679},"last":1.125}]}]},{"osd":4,"up_from":13,"seq":55834575183,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":2.1960000000000002,"15min":1.252},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":10.419,"5min":28.303999999999998,"15min":28.303999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.901,"15min":1.1839999999999999},"min":{"1min":0.34699999999999998,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.505000000000001,"5min":16.119,"15min":16.119},"last":0.97799999999999998}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":2.6309999999999998,"15min":1.4219999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.977,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.593,"15min":1.077},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9969999999999999,"5min":16.904,"15min":16.904},"last":0.71499999999999997}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":2.6890000000000001,"15min":1.478},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":11.013999999999999,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.873},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3200000000000001,"15min":0.99199999999999999},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":4.024,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.93400000000000005}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":2.6030000000000002,"15min":1.5229999999999999},"min":{"1min":0.33700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.471,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0649999999999999,"5min":2.54,"15min":1.5009999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":3.1989999999999998,"5min":29.526,"15min":29.526},"last":1.1000000000000001}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":2.6779999999999999,"15min":1.4670000000000001},"min":{"1min":0.32500000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":10.808,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.756,"5min":1.782,"15min":1.177},"min":{"1min":0.41099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6699999999999999,"5min":14.863,"15min":14.863},"last":1.056}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":2.1120000000000001,"15min":1.327},"min":{"1min":0.38700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.554,"5min":33.198,"15min":33.198},"last":1.1379999999999999},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.0939999999999999,"15min":1.379},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.308},"max":{"1min":10.528,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.2090000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":3.5920000000000001,"15min":1.8440000000000001},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.9980000000000002,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.024},{"interface":"front","average":{"1min":1.762,"5min":3.7669999999999999,"15min":1.9490000000000001},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.37},"max":{"1min":6.0309999999999997,"5min":54.113,"15min":54.113},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834575183,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":1.603,"15min":0.95299999999999996},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":2.6429999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":1.6699999999999999,"15min":1.095},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.9980000000000002,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed May 8 20:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":1.6799999999999999,"15min":1.0269999999999999},"min":{"1min":0.215,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.7330000000000001,"5min":16.355,"15min":16.355},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":1.0800000000000001,"15min":0.86599999999999999},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.706,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.45300000000000001}]},{"osd":2,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":1.345,"15min":0.89500000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":3.1059999999999999,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1,"15min":0.83499999999999996},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.95799999999999996,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.5700000000000001,"15min":1.075},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.0259999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.4059999999999999,"15min":1.03},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.0720000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":3.911,"15min":1.9179999999999999},"min":{"1min":0.373,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3300000000000001,"5min":117.105,"15min":117.105},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.706,"5min":1.7190000000000001,"15min":1.1559999999999999},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":6.3179999999999996,"5min":14.394,"15min":14.394},"last":0.76400000000000001}]},{"osd":6,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":2.1579999999999999,"15min":1.331},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.5979999999999999,"5min":16.113,"15min":16.113},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.7669999999999999,"15min":1.216},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":5.0730000000000004,"5min":16.992999999999999,"15min":16.992999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Wed May 8 20:53:55 2024","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":2.0659999999999998,"15min":1.345},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.6749999999999998,"5min":16.977,"15min":16.977},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.903,"15min":1.306},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":3.669,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.008}]}]},{"osd":2,"up_from":13,"seq":55834575181,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":1.206,"15min":0.84199999999999997},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.84099999999999997,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":1.1970000000000001,"15min":0.91100000000000003},"min":{"1min":0.22500000000000001,"5min":0.189,"15min":0.189},"max":{"1min":2.9449999999999998,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":1.0580000000000001,"15min":0.76800000000000002},"min":{"1min":0.188,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.0609999999999999,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.92200000000000004,"15min":0.76200000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.6459999999999999,"5min":6.7009999999999996,"15min":6.7009999999999996},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.3440000000000001,"15min":0.93100000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":3.1259999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.1830000000000001,"15min":0.93100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":3.0939999999999999,"5min":8.4109999999999996,"15min":8.4109999999999996},"last":0.78300000000000003}]},{"osd":4,"last update":"Wed May 8 20:54:04 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":2.0379999999999998,"15min":1.234},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":10.257,"5min":13.829000000000001,"15min":13.829000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.8640000000000001,"15min":1.2350000000000001},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.6509999999999998,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":2.1509999999999998,"15min":1.319},"min":{"1min":0.31,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":5.6340000000000003,"5min":22.489000000000001,"15min":22.489000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.7969999999999999,"15min":1.238},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.9610000000000003,"5min":14.968999999999999,"15min":14.968999999999999},"last":0.747}]},{"osd":6,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.702,"15min":1.1739999999999999},"min":{"1min":0.34899999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":3.4460000000000002,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.6080000000000001,"15min":1.157},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":6.5039999999999996,"5min":12.553000000000001,"15min":12.553000000000001},"last":1.101}]},{"osd":7,"last update":"Wed May 8 20:53:49 2024","interfaces":[{"interface":"back","average":{"1min":2.3199999999999998,"5min":2.141,"15min":1.405},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":13.663,"5min":13.663,"15min":13.663},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.526,"5min":2.5430000000000001,"15min":1.494},"min":{"1min":0.44700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.6970000000000001,"5min":19.201000000000001,"15min":19.201000000000001},"last":1.012}]}]},{"osd":1,"up_from":13,"seq":55834575182,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.0900000000000001,"15min":0.77400000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.044,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.44,"5min":1.4350000000000001,"15min":0.92900000000000005},"min":{"1min":0.20899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":3.149,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.499}]},{"osd":2,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.4330000000000001,"15min":0.88700000000000001},"min":{"1min":0.20000000000000001,"5min":0.192,"15min":0.188},"max":{"1min":3.2149999999999999,"5min":13.961,"15min":13.961},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.435,"5min":1.1479999999999999,"15min":0.84899999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.5009999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":2.8140000000000001,"15min":1.45},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":3.1819999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":2.0600000000000001,"15min":1.2170000000000001},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":3.0710000000000002,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.8220000000000001,"15min":1.139},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.2490000000000001,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":1.357,"15min":1.0349999999999999},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":3.097,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":0.83699999999999997}]},{"osd":5,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":3.7799999999999998,"15min":1.863},"min":{"1min":0.33500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.0090000000000003,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.403,"5min":2.0609999999999999,"15min":1.3049999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":5.2439999999999998,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.026}]},{"osd":6,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":1.855,"15min":1.226},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":5.069,"5min":14.032,"15min":14.032},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.47,"15min":1.133},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":4.8540000000000001,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.175}]},{"osd":7,"last update":"Wed May 8 20:53:53 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":3.0099999999999998,"15min":1.6679999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.2060000000000004,"5min":26.881,"15min":26.881},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.917,"15min":1.321},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.5060000000000002,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.0489999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575182,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.89900000000000002,"15min":0.70099999999999996},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.98999999999999999,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.748,"5min":1.2290000000000001,"15min":0.83999999999999997},"min":{"1min":0.17499999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.2589999999999999,"5min":13.305,"15min":13.305},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.1850000000000001,"15min":0.82399999999999995},"min":{"1min":0.20699999999999999,"5min":0.20300000000000001,"15min":0.19700000000000001},"max":{"1min":3.0859999999999999,"5min":15.212,"15min":15.212},"last":0.753},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.1100000000000001,"15min":0.82599999999999996},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":2.8660000000000001,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.99199999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.0609999999999999,"15min":0.873},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":2.8980000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.115,"15min":0.95999999999999996},"min":{"1min":0.33400000000000002,"5min":0.30299999999999999,"15min":0.26300000000000001},"max":{"1min":2.9239999999999999,"5min":6.758,"15min":6.758},"last":1.087}]},{"osd":4,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.613,"15min":1.1040000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.242,"5min":18.407,"15min":18.407},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.6180000000000001,"15min":1.085},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.3240000000000001,"5min":18.466999999999999,"15min":18.466999999999999},"last":1.177}]},{"osd":5,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.246,"15min":1.3049999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":3.048,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.8220000000000001,"15min":1.1830000000000001},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.1840000000000002,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.073}]},{"osd":6,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.496,"15min":1.0960000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.0860000000000003,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.875},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.5609999999999999,"15min":1.123},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":3.6030000000000002,"5min":11.597,"15min":11.597},"last":1.24}]},{"osd":7,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":2.3340000000000001,"15min":1.4059999999999999},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5259999999999998,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.232,"5min":2.3660000000000001,"15min":1.4930000000000001},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.5590000000000002,"5min":18.788,"15min":18.788},"last":1.3160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:54:45.326 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.327 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.328 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.329 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.330 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.331 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.332 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T20:27:07.421269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.333 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.334 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.335 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.336 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.337 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.338 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.339 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.340 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.341 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.342 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.343 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.344 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.345 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.346 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.347 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.348 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.348 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:54:45.348 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T20:54:59.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:59.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:05.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.477+0000 7f42dc4f5640 1 Processor -- start 2024-05-08T20:55:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.477+0000 7f42dc4f5640 1 -- start start 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.477+0000 7f42dc4f5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 0x7f42d4151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.477+0000 7f42dc4f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 0x7f42d4152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42d41533d0 0x7f42d406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40c23f0 con 0x7f42d41533d0 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4155060 con 0x7f42d40c1bb0 2024-05-08T20:55:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4155340 con 0x7f42d40c1f90 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42d41533d0 0x7f42d406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42d41533d0 0x7f42d406c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58142/0 (socket says 172.21.15.81:58142) 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 -- 172.21.15.81:0/3985895912 learned_addr learned my addr 172.21.15.81:0/3985895912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42d9a90640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 0x7f42d4152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 -- 172.21.15.81:0/3985895912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 msgr2=0x7f42d4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42da291640 1 --2- 172.21.15.81:0/3985895912 >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 0x7f42d4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 0x7f42d4152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 -- 172.21.15.81:0/3985895912 >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 msgr2=0x7f42d4151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 --2- 172.21.15.81:0/3985895912 >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 0x7f42d4151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 -- 172.21.15.81:0/3985895912 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d4155620 con 0x7f42d41533d0 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42d9a90640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 0x7f42d4152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:05.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42da291640 1 --2- 172.21.15.81:0/3985895912 >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 0x7f42d4151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42daa92640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d41533d0 0x7f42d406c0e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f42d4073fc0 tx=0x7f42cc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b92939679f6397 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42d928f640 1 -- 172.21.15.81:0/3985895912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5790 con 0x7f42d41533d0 2024-05-08T20:55:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42d928f640 1 -- 172.21.15.81:0/3985895912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0a58f0 con 0x7f42d41533d0 2024-05-08T20:55:05.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42d928f640 1 -- 172.21.15.81:0/3985895912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5c80 con 0x7f42d41533d0 2024-05-08T20:55:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3985895912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d41533d0 msgr2=0x7f42d406c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d41533d0 0x7f42d406c0e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f42d4073fc0 tx=0x7f42cc01c930 comp rx=0 tx=0).stop 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3985895912 shutdown_connections 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1f90 0x7f42d4152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3985895912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d41533d0 0x7f42d406c0e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3985895912 >> v2:172.21.15.117:3300/0 conn(0x7f42d40c1bb0 0x7f42d4151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3985895912 >> 172.21.15.81:0/3985895912 conn(0x7f42d40c2ca0 msgr2=0x7f42d40c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3985895912 shutdown_connections 2024-05-08T20:55:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.481+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3985895912 wait complete. 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 Processor -- start 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- start start 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1bb0 0x7f42d41ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42d41533d0 0x7f42d41f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40bd350 con 0x7f42d40c1f90 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41f04b0 con 0x7f42d41533d0 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41f0790 con 0x7f42d40c1bb0 2024-05-08T20:55:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58150/0 (socket says 172.21.15.81:58150) 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 -- 172.21.15.81:0/3721461723 learned_addr learned my addr 172.21.15.81:0/3721461723 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42daa92640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42d41533d0 0x7f42d41f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42da291640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1bb0 0x7f42d41ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 -- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1bb0 msgr2=0x7f42d41ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1bb0 0x7f42d41ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 -- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42d41533d0 msgr2=0x7f42d41f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42d41533d0 0x7f42d41f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 -- 172.21.15.81:0/3721461723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009b30 con 0x7f42d40c1f90 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42d9a90640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c7f0 tx=0x7f42c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4007820 con 0x7f42d40c1f90 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4007980 con 0x7f42d40c1f90 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4153070 con 0x7f42d40c1f90 2024-05-08T20:55:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4007d30 con 0x7f42d40c1f90 2024-05-08T20:55:05.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d4071f20 con 0x7f42d40c1f90 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.485+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d41f0900 con 0x7f42d40c1f90 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.489+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42c40113f0 con 0x7f42d40c1f90 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.489+0000 7f42caffd640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 0x7f42b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.489+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f42c4084760 con 0x7f42d40c1f90 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.489+0000 7f42da291640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 0x7f42b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.489+0000 7f42da291640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 0x7f42b8068b50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42d0006fd0 tx=0x7f42d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.493+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f42c40517c0 con 0x7f42d40c1f90 2024-05-08T20:55:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.649+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42d4154cf0 con 0x7f42b8066690 2024-05-08T20:55:05.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.689+0000 7f42caffd640 1 -- 172.21.15.81:0/3721461723 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525330 (secure 0 0 0) 0x7f42d000c050 con 0x7f42b8066690 2024-05-08T20:55:05.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:55:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 msgr2=0x7f42b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 0x7f42b8068b50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42d0006fd0 tx=0x7f42d0008040 comp rx=0 tx=0).stop 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 msgr2=0x7f42d40aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c7f0 tx=0x7f42c400ccb0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 shutdown_connections 2024-05-08T20:55:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f42b8066690 0x7f42b8068b50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42d41533d0 0x7f42d41f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40c1f90 0x7f42d40aae30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 --2- 172.21.15.81:0/3721461723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42d40c1bb0 0x7f42d41ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 >> 172.21.15.81:0/3721461723 conn(0x7f42d40c2ca0 msgr2=0x7f42d414e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 shutdown_connections 2024-05-08T20:55:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:05.693+0000 7f42dc4f5640 1 -- 172.21.15.81:0/3721461723 wait complete. 2024-05-08T20:55:05.715 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":857,"stamp":"2024-05-08T20:55:03.901448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622902,"ondisk_log_size":622902,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005506"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408414+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408414+0000","last_peered":"2024-05-08T20:54:32.408414+0000","last_clean":"2024-05-08T20:54:32.408414+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408414+0000","last_undegraded":"2024-05-08T20:54:32.408414+0000","last_fullsized":"2024-05-08T20:54:32.408414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'767","reported_seq":809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.034026+0000","last_change":"2024-05-08T20:54:52.034318+0000","last_active":"2024-05-08T20:54:52.034026+0000","last_peered":"2024-05-08T20:54:52.034026+0000","last_clean":"2024-05-08T20:54:52.034026+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:52.034026+0000","last_undegraded":"2024-05-08T20:54:52.034026+0000","last_fullsized":"2024-05-08T20:54:52.034026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'767","last_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_deep_scrub":"26'767","last_deep_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.033968+0000","objects_scrubbed":3,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.997884+0000","scrub_duration":0.095634259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.761057+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:21.761057+0000","last_peered":"2024-05-08T20:54:21.761057+0000","last_clean":"2024-05-08T20:54:21.761057+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:21.761057+0000","last_undegraded":"2024-05-08T20:54:21.761057+0000","last_fullsized":"2024-05-08T20:54:21.761057+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.318767+0000","last_change":"2024-05-08T20:54:58.319009+0000","last_active":"2024-05-08T20:54:58.318767+0000","last_peered":"2024-05-08T20:54:58.318767+0000","last_clean":"2024-05-08T20:54:58.318767+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:58.318767+0000","last_undegraded":"2024-05-08T20:54:58.318767+0000","last_fullsized":"2024-05-08T20:54:58.318767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.318713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:57.774502+0000","scrub_duration":0.0077592889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.176748+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:33.176748+0000","last_peered":"2024-05-08T20:54:33.176748+0000","last_clean":"2024-05-08T20:54:33.176748+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:33.176748+0000","last_undegraded":"2024-05-08T20:54:33.176748+0000","last_fullsized":"2024-05-08T20:54:33.176748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.826245+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:53:23.826245+0000","last_peered":"2024-05-08T20:53:23.826245+0000","last_clean":"2024-05-08T20:53:23.826245+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:53:23.826245+0000","last_undegraded":"2024-05-08T20:53:23.826245+0000","last_fullsized":"2024-05-08T20:53:23.826245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:07.637335+0000","last_change":"2024-05-08T20:27:27.626660+0000","last_active":"2024-05-08T20:54:07.637335+0000","last_peered":"2024-05-08T20:54:07.637335+0000","last_clean":"2024-05-08T20:54:07.637335+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:54:07.637335+0000","last_undegraded":"2024-05-08T20:54:07.637335+0000","last_fullsized":"2024-05-08T20:54:07.637335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976543+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:44.976543+0000","last_peered":"2024-05-08T20:54:44.976543+0000","last_clean":"2024-05-08T20:54:44.976543+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:44.976543+0000","last_undegraded":"2024-05-08T20:54:44.976543+0000","last_fullsized":"2024-05-08T20:54:44.976543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975997+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:54:44.975997+0000","last_peered":"2024-05-08T20:54:44.975997+0000","last_clean":"2024-05-08T20:54:44.975997+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:54:44.975997+0000","last_undegraded":"2024-05-08T20:54:44.975997+0000","last_fullsized":"2024-05-08T20:54:44.975997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.217320+0000","last_change":"2024-05-08T20:54:58.217575+0000","last_active":"2024-05-08T20:54:58.217320+0000","last_peered":"2024-05-08T20:54:58.217320+0000","last_clean":"2024-05-08T20:54:58.217320+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:58.217320+0000","last_undegraded":"2024-05-08T20:54:58.217320+0000","last_fullsized":"2024-05-08T20:54:58.217320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.217264+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:04.029681+0000","scrub_duration":0.019522241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'619","reported_seq":655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.174972+0000","last_change":"2024-05-08T20:54:55.174972+0000","last_active":"2024-05-08T20:54:55.174972+0000","last_peered":"2024-05-08T20:54:55.174972+0000","last_clean":"2024-05-08T20:54:55.174972+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:55.174972+0000","last_undegraded":"2024-05-08T20:54:55.174972+0000","last_fullsized":"2024-05-08T20:54:55.174972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'619","last_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_deep_scrub":"26'619","last_deep_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.174692+0000","objects_scrubbed":1,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:43.612782+0000","scrub_duration":0.059475472000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079828+0000","last_change":"2024-05-08T20:27:27.997399+0000","last_active":"2024-05-08T20:54:44.079828+0000","last_peered":"2024-05-08T20:54:44.079828+0000","last_clean":"2024-05-08T20:54:44.079828+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:54:44.079828+0000","last_undegraded":"2024-05-08T20:54:44.079828+0000","last_fullsized":"2024-05-08T20:54:44.079828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975822+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:54:44.975822+0000","last_peered":"2024-05-08T20:54:44.975822+0000","last_clean":"2024-05-08T20:54:44.975822+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:54:44.975822+0000","last_undegraded":"2024-05-08T20:54:44.975822+0000","last_fullsized":"2024-05-08T20:54:44.975822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.186266+0000","last_change":"2024-05-08T20:54:51.186266+0000","last_active":"2024-05-08T20:54:51.186266+0000","last_peered":"2024-05-08T20:54:51.186266+0000","last_clean":"2024-05-08T20:54:51.186266+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:51.186266+0000","last_undegraded":"2024-05-08T20:54:51.186266+0000","last_fullsized":"2024-05-08T20:54:51.186266+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6790","last_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_deep_scrub":"26'6790","last_deep_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.185945+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:12.471228+0000","scrub_duration":0.025898879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.145576+0000","last_change":"2024-05-08T20:54:52.145576+0000","last_active":"2024-05-08T20:54:52.145576+0000","last_peered":"2024-05-08T20:54:52.145576+0000","last_clean":"2024-05-08T20:54:52.145576+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:52.145576+0000","last_undegraded":"2024-05-08T20:54:52.145576+0000","last_fullsized":"2024-05-08T20:54:52.145576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.145299+0000","objects_scrubbed":1,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:17.689064+0000","scrub_duration":0.013037381000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.257629+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:33.257629+0000","last_peered":"2024-05-08T20:54:33.257629+0000","last_clean":"2024-05-08T20:54:33.257629+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:33.257629+0000","last_undegraded":"2024-05-08T20:54:33.257629+0000","last_fullsized":"2024-05-08T20:54:33.257629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5352,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.790565+0000","last_change":"2024-05-08T20:27:18.908623+0000","last_active":"2024-05-08T20:54:21.790565+0000","last_peered":"2024-05-08T20:54:21.790565+0000","last_clean":"2024-05-08T20:54:21.790565+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:54:21.790565+0000","last_undegraded":"2024-05-08T20:54:21.790565+0000","last_fullsized":"2024-05-08T20:54:21.790565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:20.708466+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:54:20.708466+0000","last_peered":"2024-05-08T20:54:20.708466+0000","last_clean":"2024-05-08T20:54:20.708466+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:54:20.708466+0000","last_undegraded":"2024-05-08T20:54:20.708466+0000","last_fullsized":"2024-05-08T20:54:20.708466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.298281+0000","last_change":"2024-05-08T20:54:46.298581+0000","last_active":"2024-05-08T20:54:46.298281+0000","last_peered":"2024-05-08T20:54:46.298281+0000","last_clean":"2024-05-08T20:54:46.298281+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:46.298281+0000","last_undegraded":"2024-05-08T20:54:46.298281+0000","last_fullsized":"2024-05-08T20:54:46.298281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.298228+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:28.684882+0000","scrub_duration":0.047052471999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948350+0000","last_change":"2024-05-08T20:27:27.993703+0000","last_active":"2024-05-08T20:54:32.948350+0000","last_peered":"2024-05-08T20:54:32.948350+0000","last_clean":"2024-05-08T20:54:32.948350+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:54:32.948350+0000","last_undegraded":"2024-05-08T20:54:32.948350+0000","last_fullsized":"2024-05-08T20:54:32.948350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4791,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804571+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.804571+0000","last_peered":"2024-05-08T20:54:21.804571+0000","last_clean":"2024-05-08T20:54:21.804571+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.804571+0000","last_undegraded":"2024-05-08T20:54:21.804571+0000","last_fullsized":"2024-05-08T20:54:21.804571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.238592+0000","last_change":"2024-05-08T20:27:18.512065+0000","last_active":"2024-05-08T20:53:23.238592+0000","last_peered":"2024-05-08T20:53:23.238592+0000","last_clean":"2024-05-08T20:53:23.238592+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:53:23.238592+0000","last_undegraded":"2024-05-08T20:53:23.238592+0000","last_fullsized":"2024-05-08T20:53:23.238592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.127560+0000","last_change":"2024-05-08T20:54:59.127778+0000","last_active":"2024-05-08T20:54:59.127560+0000","last_peered":"2024-05-08T20:54:59.127560+0000","last_clean":"2024-05-08T20:54:59.127560+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:59.127560+0000","last_undegraded":"2024-05-08T20:54:59.127560+0000","last_fullsized":"2024-05-08T20:54:59.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.127504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:30.421435+0000","scrub_duration":0.0034702330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3464,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443985+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:34.443985+0000","last_peered":"2024-05-08T20:54:34.443985+0000","last_clean":"2024-05-08T20:54:34.443985+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:34.443985+0000","last_undegraded":"2024-05-08T20:54:34.443985+0000","last_fullsized":"2024-05-08T20:54:34.443985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793803+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793803+0000","last_peered":"2024-05-08T20:54:21.793803+0000","last_clean":"2024-05-08T20:54:21.793803+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793803+0000","last_undegraded":"2024-05-08T20:54:21.793803+0000","last_fullsized":"2024-05-08T20:54:21.793803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:23.238542+0000","last_change":"2024-05-08T20:27:18.518103+0000","last_active":"2024-05-08T20:53:23.238542+0000","last_peered":"2024-05-08T20:53:23.238542+0000","last_clean":"2024-05-08T20:53:23.238542+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:53:23.238542+0000","last_undegraded":"2024-05-08T20:53:23.238542+0000","last_fullsized":"2024-05-08T20:53:23.238542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.870480+0000","last_change":"2024-05-08T20:54:56.870718+0000","last_active":"2024-05-08T20:54:56.870480+0000","last_peered":"2024-05-08T20:54:56.870480+0000","last_clean":"2024-05-08T20:54:56.870480+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:56.870480+0000","last_undegraded":"2024-05-08T20:54:56.870480+0000","last_fullsized":"2024-05-08T20:54:56.870480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.870433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:43.134102+0000","scrub_duration":0.054762970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5796,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.968995+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:40.968995+0000","last_peered":"2024-05-08T20:54:40.968995+0000","last_clean":"2024-05-08T20:54:40.968995+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:40.968995+0000","last_undegraded":"2024-05-08T20:54:40.968995+0000","last_fullsized":"2024-05-08T20:54:40.968995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4697,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.859525+0000","last_change":"2024-05-08T20:27:18.888397+0000","last_active":"2024-05-08T20:54:21.859525+0000","last_peered":"2024-05-08T20:54:21.859525+0000","last_clean":"2024-05-08T20:54:21.859525+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:54:21.859525+0000","last_undegraded":"2024-05-08T20:54:21.859525+0000","last_fullsized":"2024-05-08T20:54:21.859525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:25.584701+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:53:25.584701+0000","last_peered":"2024-05-08T20:53:25.584701+0000","last_clean":"2024-05-08T20:53:25.584701+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:53:25.584701+0000","last_undegraded":"2024-05-08T20:53:25.584701+0000","last_fullsized":"2024-05-08T20:53:25.584701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.185941+0000","last_change":"2024-05-08T20:54:44.186218+0000","last_active":"2024-05-08T20:54:44.185941+0000","last_peered":"2024-05-08T20:54:44.185941+0000","last_clean":"2024-05-08T20:54:44.185941+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:44.185941+0000","last_undegraded":"2024-05-08T20:54:44.185941+0000","last_fullsized":"2024-05-08T20:54:44.185941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_clean_scrub_stamp":"2024-05-08T20:54:44.185881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:49.152153+0000","scrub_duration":0.0071163260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405724+0000","last_change":"2024-05-08T20:27:27.974747+0000","last_active":"2024-05-08T20:54:32.405724+0000","last_peered":"2024-05-08T20:54:32.405724+0000","last_clean":"2024-05-08T20:54:32.405724+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:54:32.405724+0000","last_undegraded":"2024-05-08T20:54:32.405724+0000","last_fullsized":"2024-05-08T20:54:32.405724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6051,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.042883+0000","last_change":"2024-05-08T20:54:59.043067+0000","last_active":"2024-05-08T20:54:59.042883+0000","last_peered":"2024-05-08T20:54:59.042883+0000","last_clean":"2024-05-08T20:54:59.042883+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:59.042883+0000","last_undegraded":"2024-05-08T20:54:59.042883+0000","last_fullsized":"2024-05-08T20:54:59.042883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6011","last_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_deep_scrub":"26'6011","last_deep_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.042843+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:03.715065+0000","scrub_duration":0.062194480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.549690+0000","last_change":"2024-05-08T20:54:55.549940+0000","last_active":"2024-05-08T20:54:55.549690+0000","last_peered":"2024-05-08T20:54:55.549690+0000","last_clean":"2024-05-08T20:54:55.549690+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:54:55.549690+0000","last_undegraded":"2024-05-08T20:54:55.549690+0000","last_fullsized":"2024-05-08T20:54:55.549690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.549635+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:30.768311+0000","scrub_duration":0.012030836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'64","reported_seq":152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:29.442574+0000","last_change":"2024-05-08T20:27:27.617215+0000","last_active":"2024-05-08T20:54:29.442574+0000","last_peered":"2024-05-08T20:54:29.442574+0000","last_clean":"2024-05-08T20:54:29.442574+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:54:29.442574+0000","last_undegraded":"2024-05-08T20:54:29.442574+0000","last_fullsized":"2024-05-08T20:54:29.442574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443668+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:34.443668+0000","last_peered":"2024-05-08T20:54:34.443668+0000","last_clean":"2024-05-08T20:54:34.443668+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:34.443668+0000","last_undegraded":"2024-05-08T20:54:34.443668+0000","last_fullsized":"2024-05-08T20:54:34.443668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4696,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.792370+0000","last_change":"2024-05-08T20:27:18.899267+0000","last_active":"2024-05-08T20:54:21.792370+0000","last_peered":"2024-05-08T20:54:21.792370+0000","last_clean":"2024-05-08T20:54:21.792370+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:54:21.792370+0000","last_undegraded":"2024-05-08T20:54:21.792370+0000","last_fullsized":"2024-05-08T20:54:21.792370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'254","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:17.810321+0000","last_change":"2024-05-08T20:27:18.508907+0000","last_active":"2024-05-08T20:54:17.810321+0000","last_peered":"2024-05-08T20:54:17.810321+0000","last_clean":"2024-05-08T20:54:17.810321+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:54:17.810321+0000","last_undegraded":"2024-05-08T20:54:17.810321+0000","last_fullsized":"2024-05-08T20:54:17.810321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:13.011660+0000","last_change":"2024-05-08T20:27:27.623973+0000","last_active":"2024-05-08T20:54:13.011660+0000","last_peered":"2024-05-08T20:54:13.011660+0000","last_clean":"2024-05-08T20:54:13.011660+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:54:13.011660+0000","last_undegraded":"2024-05-08T20:54:13.011660+0000","last_fullsized":"2024-05-08T20:54:13.011660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922628+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:37.922628+0000","last_peered":"2024-05-08T20:54:37.922628+0000","last_clean":"2024-05-08T20:54:37.922628+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:37.922628+0000","last_undegraded":"2024-05-08T20:54:37.922628+0000","last_fullsized":"2024-05-08T20:54:37.922628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6866,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256639+0000","last_change":"2024-05-08T20:27:18.884740+0000","last_active":"2024-05-08T20:54:28.256639+0000","last_peered":"2024-05-08T20:54:28.256639+0000","last_clean":"2024-05-08T20:54:28.256639+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:54:28.256639+0000","last_undegraded":"2024-05-08T20:54:28.256639+0000","last_fullsized":"2024-05-08T20:54:28.256639+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:35.712011+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:54:35.712011+0000","last_peered":"2024-05-08T20:54:35.712011+0000","last_clean":"2024-05-08T20:54:35.712011+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:54:35.712011+0000","last_undegraded":"2024-05-08T20:54:35.712011+0000","last_fullsized":"2024-05-08T20:54:35.712011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.385750+0000","last_change":"2024-05-08T20:27:27.611572+0000","last_active":"2024-05-08T20:54:33.385750+0000","last_peered":"2024-05-08T20:54:33.385750+0000","last_clean":"2024-05-08T20:54:33.385750+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:54:33.385750+0000","last_undegraded":"2024-05-08T20:54:33.385750+0000","last_fullsized":"2024-05-08T20:54:33.385750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4649,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.386740+0000","last_change":"2024-05-08T20:27:27.982567+0000","last_active":"2024-05-08T20:54:38.386740+0000","last_peered":"2024-05-08T20:54:38.386740+0000","last_clean":"2024-05-08T20:54:38.386740+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:54:38.386740+0000","last_undegraded":"2024-05-08T20:54:38.386740+0000","last_fullsized":"2024-05-08T20:54:38.386740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.149350+0000","last_change":"2024-05-08T20:54:50.149623+0000","last_active":"2024-05-08T20:54:50.149350+0000","last_peered":"2024-05-08T20:54:50.149350+0000","last_clean":"2024-05-08T20:54:50.149350+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:50.149350+0000","last_undegraded":"2024-05-08T20:54:50.149350+0000","last_fullsized":"2024-05-08T20:54:50.149350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4622","last_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_deep_scrub":"26'4622","last_deep_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.149296+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:43.672383+0000","scrub_duration":0.028645501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.256671+0000","last_change":"2024-05-08T20:27:18.506585+0000","last_active":"2024-05-08T20:54:28.256671+0000","last_peered":"2024-05-08T20:54:28.256671+0000","last_clean":"2024-05-08T20:54:28.256671+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:54:28.256671+0000","last_undegraded":"2024-05-08T20:54:28.256671+0000","last_fullsized":"2024-05-08T20:54:28.256671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.802099+0000","last_change":"2024-05-08T20:54:45.802328+0000","last_active":"2024-05-08T20:54:45.802099+0000","last_peered":"2024-05-08T20:54:45.802099+0000","last_clean":"2024-05-08T20:54:45.802099+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:45.802099+0000","last_undegraded":"2024-05-08T20:54:45.802099+0000","last_fullsized":"2024-05-08T20:54:45.802099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.802044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:29.693595+0000","scrub_duration":0.0040510620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.805818+0000","last_change":"2024-05-08T20:27:27.974531+0000","last_active":"2024-05-08T20:54:41.805818+0000","last_peered":"2024-05-08T20:54:41.805818+0000","last_clean":"2024-05-08T20:54:41.805818+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:54:41.805818+0000","last_undegraded":"2024-05-08T20:54:41.805818+0000","last_fullsized":"2024-05-08T20:54:41.805818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:29.442742+0000","last_change":"2024-05-08T20:27:18.911255+0000","last_active":"2024-05-08T20:54:29.442742+0000","last_peered":"2024-05-08T20:54:29.442742+0000","last_clean":"2024-05-08T20:54:29.442742+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:54:29.442742+0000","last_undegraded":"2024-05-08T20:54:29.442742+0000","last_fullsized":"2024-05-08T20:54:29.442742+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:25.965330+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:54:25.965330+0000","last_peered":"2024-05-08T20:54:25.965330+0000","last_clean":"2024-05-08T20:54:25.965330+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:54:25.965330+0000","last_undegraded":"2024-05-08T20:54:25.965330+0000","last_fullsized":"2024-05-08T20:54:25.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.723537+0000","last_change":"2024-05-08T20:54:43.723653+0000","last_active":"2024-05-08T20:54:43.723537+0000","last_peered":"2024-05-08T20:54:43.723537+0000","last_clean":"2024-05-08T20:54:43.723537+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:43.723537+0000","last_undegraded":"2024-05-08T20:54:43.723537+0000","last_fullsized":"2024-05-08T20:54:43.723537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.723507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:06.949102+0000","scrub_duration":0.001729041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.326126+0000","last_change":"2024-05-08T20:27:27.995701+0000","last_active":"2024-05-08T20:54:32.326126+0000","last_peered":"2024-05-08T20:54:32.326126+0000","last_clean":"2024-05-08T20:54:32.326126+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:54:32.326126+0000","last_undegraded":"2024-05-08T20:54:32.326126+0000","last_fullsized":"2024-05-08T20:54:32.326126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.803386+0000","last_change":"2024-05-08T20:27:18.885272+0000","last_active":"2024-05-08T20:54:21.803386+0000","last_peered":"2024-05-08T20:54:21.803386+0000","last_clean":"2024-05-08T20:54:21.803386+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:54:21.803386+0000","last_undegraded":"2024-05-08T20:54:21.803386+0000","last_fullsized":"2024-05-08T20:54:21.803386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'73","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.584883+0000","last_change":"2024-05-08T20:54:47.585094+0000","last_active":"2024-05-08T20:54:47.584883+0000","last_peered":"2024-05-08T20:54:47.584883+0000","last_clean":"2024-05-08T20:54:47.584883+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:47.584883+0000","last_undegraded":"2024-05-08T20:54:47.584883+0000","last_fullsized":"2024-05-08T20:54:47.584883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.584829+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.762899+0000","scrub_duration":0.021519024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'10","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.757952+0000","last_change":"2024-05-08T20:54:48.758169+0000","last_active":"2024-05-08T20:54:48.757952+0000","last_peered":"2024-05-08T20:54:48.757952+0000","last_clean":"2024-05-08T20:54:48.757952+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:48.757952+0000","last_undegraded":"2024-05-08T20:54:48.757952+0000","last_fullsized":"2024-05-08T20:54:48.757952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.757894+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:28.411623+0000","scrub_duration":0.026700504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375294+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375294+0000","last_peered":"2024-05-08T20:54:32.375294+0000","last_clean":"2024-05-08T20:54:32.375294+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375294+0000","last_undegraded":"2024-05-08T20:54:32.375294+0000","last_fullsized":"2024-05-08T20:54:32.375294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":5008,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.005590+0000","last_change":"2024-05-08T20:54:55.005875+0000","last_active":"2024-05-08T20:54:55.005590+0000","last_peered":"2024-05-08T20:54:55.005590+0000","last_clean":"2024-05-08T20:54:55.005590+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:55.005590+0000","last_undegraded":"2024-05-08T20:54:55.005590+0000","last_fullsized":"2024-05-08T20:54:55.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4967","last_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_deep_scrub":"26'4967","last_deep_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.005533+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:32.459770+0000","scrub_duration":0.055935091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:30.610927+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:53:30.610927+0000","last_peered":"2024-05-08T20:53:30.610927+0000","last_clean":"2024-05-08T20:53:30.610927+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:53:30.610927+0000","last_undegraded":"2024-05-08T20:53:30.610927+0000","last_fullsized":"2024-05-08T20:53:30.610927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'276","reported_seq":302,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:17.817407+0000","last_change":"2024-05-08T20:27:27.597877+0000","last_active":"2024-05-08T20:54:17.817407+0000","last_peered":"2024-05-08T20:54:17.817407+0000","last_clean":"2024-05-08T20:54:17.817407+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:54:17.817407+0000","last_undegraded":"2024-05-08T20:54:17.817407+0000","last_fullsized":"2024-05-08T20:54:17.817407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713107+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:40.713107+0000","last_peered":"2024-05-08T20:54:40.713107+0000","last_clean":"2024-05-08T20:54:40.713107+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:40.713107+0000","last_undegraded":"2024-05-08T20:54:40.713107+0000","last_fullsized":"2024-05-08T20:54:40.713107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5100,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.850643+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:28.850643+0000","last_peered":"2024-05-08T20:54:28.850643+0000","last_clean":"2024-05-08T20:54:28.850643+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:28.850643+0000","last_undegraded":"2024-05-08T20:54:28.850643+0000","last_fullsized":"2024-05-08T20:54:28.850643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.966519+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:54:30.966519+0000","last_peered":"2024-05-08T20:54:30.966519+0000","last_clean":"2024-05-08T20:54:30.966519+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:54:30.966519+0000","last_undegraded":"2024-05-08T20:54:30.966519+0000","last_fullsized":"2024-05-08T20:54:30.966519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:20.583041+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:53:20.583041+0000","last_peered":"2024-05-08T20:53:20.583041+0000","last_clean":"2024-05-08T20:53:20.583041+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:53:20.583041+0000","last_undegraded":"2024-05-08T20:53:20.583041+0000","last_fullsized":"2024-05-08T20:53:20.583041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922741+0000","last_change":"2024-05-08T20:27:27.621018+0000","last_active":"2024-05-08T20:54:37.922741+0000","last_peered":"2024-05-08T20:54:37.922741+0000","last_clean":"2024-05-08T20:54:37.922741+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:54:37.922741+0000","last_undegraded":"2024-05-08T20:54:37.922741+0000","last_fullsized":"2024-05-08T20:54:37.922741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3779,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948168+0000","last_change":"2024-05-08T20:27:27.979657+0000","last_active":"2024-05-08T20:54:32.948168+0000","last_peered":"2024-05-08T20:54:32.948168+0000","last_clean":"2024-05-08T20:54:32.948168+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:54:32.948168+0000","last_undegraded":"2024-05-08T20:54:32.948168+0000","last_fullsized":"2024-05-08T20:54:32.948168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.675660+0000","last_change":"2024-05-08T20:54:59.675908+0000","last_active":"2024-05-08T20:54:59.675660+0000","last_peered":"2024-05-08T20:54:59.675660+0000","last_clean":"2024-05-08T20:54:59.675660+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:59.675660+0000","last_undegraded":"2024-05-08T20:54:59.675660+0000","last_fullsized":"2024-05-08T20:54:59.675660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5554","last_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_deep_scrub":"26'5554","last_deep_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.675603+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:25.048100+0000","scrub_duration":0.019361314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.490516+0000","last_change":"2024-05-08T20:54:54.490784+0000","last_active":"2024-05-08T20:54:54.490516+0000","last_peered":"2024-05-08T20:54:54.490516+0000","last_clean":"2024-05-08T20:54:54.490516+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:54.490516+0000","last_undegraded":"2024-05-08T20:54:54.490516+0000","last_fullsized":"2024-05-08T20:54:54.490516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.490464+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:32.933174+0000","scrub_duration":0.0037125420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.974758+0000","last_change":"2024-05-08T20:27:27.605624+0000","last_active":"2024-05-08T20:54:12.974758+0000","last_peered":"2024-05-08T20:54:12.974758+0000","last_clean":"2024-05-08T20:54:12.974758+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:54:12.974758+0000","last_undegraded":"2024-05-08T20:54:12.974758+0000","last_fullsized":"2024-05-08T20:54:12.974758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4037,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.397630+0000","last_change":"2024-05-08T20:27:28.010875+0000","last_active":"2024-05-08T20:54:32.397630+0000","last_peered":"2024-05-08T20:54:32.397630+0000","last_clean":"2024-05-08T20:54:32.397630+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:54:32.397630+0000","last_undegraded":"2024-05-08T20:54:32.397630+0000","last_fullsized":"2024-05-08T20:54:32.397630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5624,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.733179+0000","last_change":"2024-05-08T20:28:00.414547+0000","last_active":"2024-05-08T20:54:42.733179+0000","last_peered":"2024-05-08T20:54:42.733179+0000","last_clean":"2024-05-08T20:54:42.733179+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:54:42.733179+0000","last_undegraded":"2024-05-08T20:54:42.733179+0000","last_fullsized":"2024-05-08T20:54:42.733179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:23.255795+0000","last_change":"2024-05-08T20:27:18.540744+0000","last_active":"2024-05-08T20:54:23.255795+0000","last_peered":"2024-05-08T20:54:23.255795+0000","last_clean":"2024-05-08T20:54:23.255795+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:54:23.255795+0000","last_undegraded":"2024-05-08T20:54:23.255795+0000","last_fullsized":"2024-05-08T20:54:23.255795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1136","reported_seq":1162,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.384726+0000","last_change":"2024-05-08T20:27:27.597812+0000","last_active":"2024-05-08T20:54:28.384726+0000","last_peered":"2024-05-08T20:54:28.384726+0000","last_clean":"2024-05-08T20:54:28.384726+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:54:28.384726+0000","last_undegraded":"2024-05-08T20:54:28.384726+0000","last_fullsized":"2024-05-08T20:54:28.384726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370332+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.370332+0000","last_peered":"2024-05-08T20:54:32.370332+0000","last_clean":"2024-05-08T20:54:32.370332+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.370332+0000","last_undegraded":"2024-05-08T20:54:32.370332+0000","last_fullsized":"2024-05-08T20:54:32.370332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.710992+0000","last_change":"2024-05-08T20:27:18.922272+0000","last_active":"2024-05-08T20:54:30.710992+0000","last_peered":"2024-05-08T20:54:30.710992+0000","last_clean":"2024-05-08T20:54:30.710992+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:54:30.710992+0000","last_undegraded":"2024-05-08T20:54:30.710992+0000","last_fullsized":"2024-05-08T20:54:30.710992+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.541242+0000","last_change":"2024-05-08T20:54:46.541548+0000","last_active":"2024-05-08T20:54:46.541242+0000","last_peered":"2024-05-08T20:54:46.541242+0000","last_clean":"2024-05-08T20:54:46.541242+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:46.541242+0000","last_undegraded":"2024-05-08T20:54:46.541242+0000","last_fullsized":"2024-05-08T20:54:46.541242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.541186+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:53.630432+0000","scrub_duration":0.014769915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.201747+0000","last_change":"2024-05-08T20:54:55.201979+0000","last_active":"2024-05-08T20:54:55.201747+0000","last_peered":"2024-05-08T20:54:55.201747+0000","last_clean":"2024-05-08T20:54:55.201747+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:55.201747+0000","last_undegraded":"2024-05-08T20:54:55.201747+0000","last_fullsized":"2024-05-08T20:54:55.201747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.201695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:39.510474+0000","scrub_duration":0.0064570130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3762,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.650008+0000","last_change":"2024-05-08T20:54:45.650155+0000","last_active":"2024-05-08T20:54:45.650008+0000","last_peered":"2024-05-08T20:54:45.650008+0000","last_clean":"2024-05-08T20:54:45.650008+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:45.650008+0000","last_undegraded":"2024-05-08T20:54:45.650008+0000","last_fullsized":"2024-05-08T20:54:45.650008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3726","last_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_deep_scrub":"26'3726","last_deep_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.649980+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:59.522800+0000","scrub_duration":0.11612742700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4531,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:25.709702+0000","last_change":"2024-05-08T20:27:18.921042+0000","last_active":"2024-05-08T20:54:25.709702+0000","last_peered":"2024-05-08T20:54:25.709702+0000","last_clean":"2024-05-08T20:54:25.709702+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:54:25.709702+0000","last_undegraded":"2024-05-08T20:54:25.709702+0000","last_fullsized":"2024-05-08T20:54:25.709702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:24.441741+0000","last_change":"2024-05-08T20:27:18.541112+0000","last_active":"2024-05-08T20:54:24.441741+0000","last_peered":"2024-05-08T20:54:24.441741+0000","last_clean":"2024-05-08T20:54:24.441741+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:54:24.441741+0000","last_undegraded":"2024-05-08T20:54:24.441741+0000","last_fullsized":"2024-05-08T20:54:24.441741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.240218+0000","last_change":"2024-05-08T20:54:48.240489+0000","last_active":"2024-05-08T20:54:48.240218+0000","last_peered":"2024-05-08T20:54:48.240218+0000","last_clean":"2024-05-08T20:54:48.240218+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:48.240218+0000","last_undegraded":"2024-05-08T20:54:48.240218+0000","last_fullsized":"2024-05-08T20:54:48.240218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.240164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:57.651499+0000","scrub_duration":0.0039283549999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367383+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367383+0000","last_peered":"2024-05-08T20:54:32.367383+0000","last_clean":"2024-05-08T20:54:32.367383+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367383+0000","last_undegraded":"2024-05-08T20:54:32.367383+0000","last_fullsized":"2024-05-08T20:54:32.367383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:00.643740+0000","last_change":"2024-05-08T20:55:00.644023+0000","last_active":"2024-05-08T20:55:00.643740+0000","last_peered":"2024-05-08T20:55:00.643740+0000","last_clean":"2024-05-08T20:55:00.643740+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:55:00.643740+0000","last_undegraded":"2024-05-08T20:55:00.643740+0000","last_fullsized":"2024-05-08T20:55:00.643740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4877","last_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_deep_scrub":"26'4877","last_deep_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_clean_scrub_stamp":"2024-05-08T20:55:00.643679+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:46.199456+0000","scrub_duration":0.018174326000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'19","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.552371+0000","last_change":"2024-05-08T20:54:56.552614+0000","last_active":"2024-05-08T20:54:56.552371+0000","last_peered":"2024-05-08T20:54:56.552371+0000","last_clean":"2024-05-08T20:54:56.552371+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:56.552371+0000","last_undegraded":"2024-05-08T20:54:56.552371+0000","last_fullsized":"2024-05-08T20:54:56.552371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.552316+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:38.919551+0000","scrub_duration":0.016343099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.950947+0000","last_change":"2024-05-08T20:54:43.951036+0000","last_active":"2024-05-08T20:54:43.950947+0000","last_peered":"2024-05-08T20:54:43.950947+0000","last_clean":"2024-05-08T20:54:43.950947+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:43.950947+0000","last_undegraded":"2024-05-08T20:54:43.950947+0000","last_fullsized":"2024-05-08T20:54:43.950947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.950926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:21.719335+0000","scrub_duration":0.0015213539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4854,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382130+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382130+0000","last_peered":"2024-05-08T20:54:32.382130+0000","last_clean":"2024-05-08T20:54:32.382130+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382130+0000","last_undegraded":"2024-05-08T20:54:32.382130+0000","last_fullsized":"2024-05-08T20:54:32.382130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4834,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.791983+0000","last_change":"2024-05-08T20:27:18.899701+0000","last_active":"2024-05-08T20:54:21.791983+0000","last_peered":"2024-05-08T20:54:21.791983+0000","last_clean":"2024-05-08T20:54:21.791983+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:54:21.791983+0000","last_undegraded":"2024-05-08T20:54:21.791983+0000","last_fullsized":"2024-05-08T20:54:21.791983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:53.472086+0000","last_change":"2024-05-08T20:54:53.472321+0000","last_active":"2024-05-08T20:54:53.472086+0000","last_peered":"2024-05-08T20:54:53.472086+0000","last_clean":"2024-05-08T20:54:53.472086+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:54:53.472086+0000","last_undegraded":"2024-05-08T20:54:53.472086+0000","last_fullsized":"2024-05-08T20:54:53.472086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_clean_scrub_stamp":"2024-05-08T20:54:53.472031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:36.420711+0000","scrub_duration":0.0032315270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.416742+0000","last_change":"2024-05-08T20:55:01.416966+0000","last_active":"2024-05-08T20:55:01.416742+0000","last_peered":"2024-05-08T20:55:01.416742+0000","last_clean":"2024-05-08T20:55:01.416742+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:55:01.416742+0000","last_undegraded":"2024-05-08T20:55:01.416742+0000","last_fullsized":"2024-05-08T20:55:01.416742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.416687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:50.039785+0000","scrub_duration":0.038290926000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368953+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368953+0000","last_peered":"2024-05-08T20:54:32.368953+0000","last_clean":"2024-05-08T20:54:32.368953+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368953+0000","last_undegraded":"2024-05-08T20:54:32.368953+0000","last_fullsized":"2024-05-08T20:54:32.368953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6081,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.891681+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:21.891681+0000","last_peered":"2024-05-08T20:54:21.891681+0000","last_clean":"2024-05-08T20:54:21.891681+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:21.891681+0000","last_undegraded":"2024-05-08T20:54:21.891681+0000","last_fullsized":"2024-05-08T20:54:21.891681+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:05.913868+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:53:05.913868+0000","last_peered":"2024-05-08T20:53:05.913868+0000","last_clean":"2024-05-08T20:53:05.913868+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:53:05.913868+0000","last_undegraded":"2024-05-08T20:53:05.913868+0000","last_fullsized":"2024-05-08T20:53:05.913868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417324+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417324+0000","last_peered":"2024-05-08T20:54:43.417324+0000","last_clean":"2024-05-08T20:54:43.417324+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417324+0000","last_undegraded":"2024-05-08T20:54:43.417324+0000","last_fullsized":"2024-05-08T20:54:43.417324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398395+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398395+0000","last_peered":"2024-05-08T20:54:32.398395+0000","last_clean":"2024-05-08T20:54:32.398395+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398395+0000","last_undegraded":"2024-05-08T20:54:32.398395+0000","last_fullsized":"2024-05-08T20:54:32.398395+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4746,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.102449+0000","last_change":"2024-05-08T20:54:57.102627+0000","last_active":"2024-05-08T20:54:57.102449+0000","last_peered":"2024-05-08T20:54:57.102449+0000","last_clean":"2024-05-08T20:54:57.102449+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:57.102449+0000","last_undegraded":"2024-05-08T20:54:57.102449+0000","last_fullsized":"2024-05-08T20:54:57.102449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4707","last_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_deep_scrub":"26'4707","last_deep_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.102409+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:04.868854+0000","scrub_duration":0.064899769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.967075+0000","last_change":"2024-05-08T20:54:47.967329+0000","last_active":"2024-05-08T20:54:47.967075+0000","last_peered":"2024-05-08T20:54:47.967075+0000","last_clean":"2024-05-08T20:54:47.967075+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:54:47.967075+0000","last_undegraded":"2024-05-08T20:54:47.967075+0000","last_fullsized":"2024-05-08T20:54:47.967075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.967013+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:43.643764+0000","scrub_duration":0.019010636000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'38","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.216947+0000","last_change":"2024-05-08T20:27:27.620262+0000","last_active":"2024-05-08T20:54:15.216947+0000","last_peered":"2024-05-08T20:54:15.216947+0000","last_clean":"2024-05-08T20:54:15.216947+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:54:15.216947+0000","last_undegraded":"2024-05-08T20:54:15.216947+0000","last_fullsized":"2024-05-08T20:54:15.216947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.428690+0000","last_change":"2024-05-08T20:27:27.980206+0000","last_active":"2024-05-08T20:54:32.428690+0000","last_peered":"2024-05-08T20:54:32.428690+0000","last_clean":"2024-05-08T20:54:32.428690+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:54:32.428690+0000","last_undegraded":"2024-05-08T20:54:32.428690+0000","last_fullsized":"2024-05-08T20:54:32.428690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4336,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.839701+0000","last_change":"2024-05-08T20:27:18.915185+0000","last_active":"2024-05-08T20:54:21.839701+0000","last_peered":"2024-05-08T20:54:21.839701+0000","last_clean":"2024-05-08T20:54:21.839701+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:54:21.839701+0000","last_undegraded":"2024-05-08T20:54:21.839701+0000","last_fullsized":"2024-05-08T20:54:21.839701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'376","reported_seq":416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.547036+0000","last_change":"2024-05-08T20:55:01.547300+0000","last_active":"2024-05-08T20:55:01.547036+0000","last_peered":"2024-05-08T20:55:01.547036+0000","last_clean":"2024-05-08T20:55:01.547036+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:55:01.547036+0000","last_undegraded":"2024-05-08T20:55:01.547036+0000","last_fullsized":"2024-05-08T20:55:01.547036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'376","last_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_deep_scrub":"26'376","last_deep_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.546976+0000","objects_scrubbed":4,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:51.672058+0000","scrub_duration":0.025240988999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.699953+0000","last_change":"2024-05-08T20:54:50.700173+0000","last_active":"2024-05-08T20:54:50.699953+0000","last_peered":"2024-05-08T20:54:50.699953+0000","last_clean":"2024-05-08T20:54:50.699953+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:50.699953+0000","last_undegraded":"2024-05-08T20:54:50.699953+0000","last_fullsized":"2024-05-08T20:54:50.699953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.699899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:25.302614+0000","scrub_duration":0.003656903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3966,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325981+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325981+0000","last_peered":"2024-05-08T20:54:32.325981+0000","last_clean":"2024-05-08T20:54:32.325981+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325981+0000","last_undegraded":"2024-05-08T20:54:32.325981+0000","last_fullsized":"2024-05-08T20:54:32.325981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6500,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.876808+0000","last_change":"2024-05-08T20:27:18.925106+0000","last_active":"2024-05-08T20:54:21.876808+0000","last_peered":"2024-05-08T20:54:21.876808+0000","last_clean":"2024-05-08T20:54:21.876808+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:54:21.876808+0000","last_undegraded":"2024-05-08T20:54:21.876808+0000","last_fullsized":"2024-05-08T20:54:21.876808+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'40","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:15.137328+0000","last_change":"2024-05-08T20:27:18.526365+0000","last_active":"2024-05-08T20:54:15.137328+0000","last_peered":"2024-05-08T20:54:15.137328+0000","last_clean":"2024-05-08T20:54:15.137328+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:54:15.137328+0000","last_undegraded":"2024-05-08T20:54:15.137328+0000","last_fullsized":"2024-05-08T20:54:15.137328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'9","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.249271+0000","last_change":"2024-05-08T20:54:45.249501+0000","last_active":"2024-05-08T20:54:45.249271+0000","last_peered":"2024-05-08T20:54:45.249271+0000","last_clean":"2024-05-08T20:54:45.249271+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:45.249271+0000","last_undegraded":"2024-05-08T20:54:45.249271+0000","last_fullsized":"2024-05-08T20:54:45.249271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.249216+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:16.617377+0000","scrub_duration":0.021333827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382777+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.382777+0000","last_peered":"2024-05-08T20:54:32.382777+0000","last_clean":"2024-05-08T20:54:32.382777+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.382777+0000","last_undegraded":"2024-05-08T20:54:32.382777+0000","last_fullsized":"2024-05-08T20:54:32.382777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5282,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.835961+0000","last_change":"2024-05-08T20:27:18.929597+0000","last_active":"2024-05-08T20:54:21.835961+0000","last_peered":"2024-05-08T20:54:21.835961+0000","last_clean":"2024-05-08T20:54:21.835961+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:54:21.835961+0000","last_undegraded":"2024-05-08T20:54:21.835961+0000","last_fullsized":"2024-05-08T20:54:21.835961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:55.944753+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:53:55.944753+0000","last_peered":"2024-05-08T20:53:55.944753+0000","last_clean":"2024-05-08T20:53:55.944753+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:53:55.944753+0000","last_undegraded":"2024-05-08T20:53:55.944753+0000","last_fullsized":"2024-05-08T20:53:55.944753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'19","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.395438+0000","last_change":"2024-05-08T20:54:46.395653+0000","last_active":"2024-05-08T20:54:46.395438+0000","last_peered":"2024-05-08T20:54:46.395438+0000","last_clean":"2024-05-08T20:54:46.395438+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:46.395438+0000","last_undegraded":"2024-05-08T20:54:46.395438+0000","last_fullsized":"2024-05-08T20:54:46.395438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.395382+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:12.986179+0000","scrub_duration":0.011244446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406645+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:32.406645+0000","last_peered":"2024-05-08T20:54:32.406645+0000","last_clean":"2024-05-08T20:54:32.406645+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:32.406645+0000","last_undegraded":"2024-05-08T20:54:32.406645+0000","last_fullsized":"2024-05-08T20:54:32.406645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.801044+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.801044+0000","last_peered":"2024-05-08T20:54:21.801044+0000","last_clean":"2024-05-08T20:54:21.801044+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.801044+0000","last_undegraded":"2024-05-08T20:54:21.801044+0000","last_fullsized":"2024-05-08T20:54:21.801044+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:57.899148+0000","last_change":"2024-05-08T20:27:18.529205+0000","last_active":"2024-05-08T20:53:57.899148+0000","last_peered":"2024-05-08T20:53:57.899148+0000","last_clean":"2024-05-08T20:53:57.899148+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:53:57.899148+0000","last_undegraded":"2024-05-08T20:53:57.899148+0000","last_fullsized":"2024-05-08T20:53:57.899148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.987221+0000","last_change":"2024-05-08T20:27:27.615624+0000","last_active":"2024-05-08T20:54:12.987221+0000","last_peered":"2024-05-08T20:54:12.987221+0000","last_clean":"2024-05-08T20:54:12.987221+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:54:12.987221+0000","last_undegraded":"2024-05-08T20:54:12.987221+0000","last_fullsized":"2024-05-08T20:54:12.987221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6614,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922840+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:37.922840+0000","last_peered":"2024-05-08T20:54:37.922840+0000","last_clean":"2024-05-08T20:54:37.922840+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:37.922840+0000","last_undegraded":"2024-05-08T20:54:37.922840+0000","last_fullsized":"2024-05-08T20:54:37.922840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:12.980433+0000","last_change":"2024-05-08T20:27:27.616076+0000","last_active":"2024-05-08T20:54:12.980433+0000","last_peered":"2024-05-08T20:54:12.980433+0000","last_clean":"2024-05-08T20:54:12.980433+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:54:12.980433+0000","last_undegraded":"2024-05-08T20:54:12.980433+0000","last_fullsized":"2024-05-08T20:54:12.980433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6038,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.865004+0000","last_change":"2024-05-08T20:54:59.865230+0000","last_active":"2024-05-08T20:54:59.865004+0000","last_peered":"2024-05-08T20:54:59.865004+0000","last_clean":"2024-05-08T20:54:59.865004+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:59.865004+0000","last_undegraded":"2024-05-08T20:54:59.865004+0000","last_fullsized":"2024-05-08T20:54:59.865004+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5999","last_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_deep_scrub":"26'5999","last_deep_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.864944+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:43.980839+0000","scrub_duration":0.021147691999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:00.945558+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:54:00.945558+0000","last_peered":"2024-05-08T20:54:00.945558+0000","last_clean":"2024-05-08T20:54:00.945558+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:54:00.945558+0000","last_undegraded":"2024-05-08T20:54:00.945558+0000","last_fullsized":"2024-05-08T20:54:00.945558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4372,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.307817+0000","last_change":"2024-05-08T20:27:27.982299+0000","last_active":"2024-05-08T20:54:32.307817+0000","last_peered":"2024-05-08T20:54:32.307817+0000","last_clean":"2024-05-08T20:54:32.307817+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:54:32.307817+0000","last_undegraded":"2024-05-08T20:54:32.307817+0000","last_fullsized":"2024-05-08T20:54:32.307817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'747","reported_seq":774,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.921769+0000","last_change":"2024-05-08T20:27:27.624821+0000","last_active":"2024-05-08T20:54:32.921769+0000","last_peered":"2024-05-08T20:54:32.921769+0000","last_clean":"2024-05-08T20:54:32.921769+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:54:32.921769+0000","last_undegraded":"2024-05-08T20:54:32.921769+0000","last_fullsized":"2024-05-08T20:54:32.921769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:26.551584+0000","last_clean_scrub_stamp":"2024-05-08T20:27:26.551584+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.801850+0000","last_change":"2024-05-08T20:27:18.890298+0000","last_active":"2024-05-08T20:54:21.801850+0000","last_peered":"2024-05-08T20:54:21.801850+0000","last_clean":"2024-05-08T20:54:21.801850+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:54:21.801850+0000","last_undegraded":"2024-05-08T20:54:21.801850+0000","last_fullsized":"2024-05-08T20:54:21.801850+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:58.843758+0000","last_change":"2024-05-08T20:27:18.518872+0000","last_active":"2024-05-08T20:53:58.843758+0000","last_peered":"2024-05-08T20:53:58.843758+0000","last_clean":"2024-05-08T20:53:58.843758+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:53:58.843758+0000","last_undegraded":"2024-05-08T20:53:58.843758+0000","last_fullsized":"2024-05-08T20:53:58.843758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4950,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.263869+0000","last_change":"2024-05-08T20:27:28.011098+0000","last_active":"2024-05-08T20:54:42.263869+0000","last_peered":"2024-05-08T20:54:42.263869+0000","last_clean":"2024-05-08T20:54:42.263869+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:54:42.263869+0000","last_undegraded":"2024-05-08T20:54:42.263869+0000","last_fullsized":"2024-05-08T20:54:42.263869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'163","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.590220+0000","last_change":"2024-05-08T20:54:59.590495+0000","last_active":"2024-05-08T20:54:59.590220+0000","last_peered":"2024-05-08T20:54:59.590220+0000","last_clean":"2024-05-08T20:54:59.590220+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:59.590220+0000","last_undegraded":"2024-05-08T20:54:59.590220+0000","last_fullsized":"2024-05-08T20:54:59.590220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'163","last_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_deep_scrub":"26'163","last_deep_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.590164+0000","objects_scrubbed":1,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.910490+0000","scrub_duration":0.020938656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4479,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.805846+0000","last_change":"2024-05-08T20:27:18.907912+0000","last_active":"2024-05-08T20:54:41.805846+0000","last_peered":"2024-05-08T20:54:41.805846+0000","last_clean":"2024-05-08T20:54:41.805846+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:54:41.805846+0000","last_undegraded":"2024-05-08T20:54:41.805846+0000","last_fullsized":"2024-05-08T20:54:41.805846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.520135+0000","last_change":"2024-05-08T20:55:02.520371+0000","last_active":"2024-05-08T20:55:02.520135+0000","last_peered":"2024-05-08T20:55:02.520135+0000","last_clean":"2024-05-08T20:55:02.520135+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:55:02.520135+0000","last_undegraded":"2024-05-08T20:55:02.520135+0000","last_fullsized":"2024-05-08T20:55:02.520135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.520078+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:26.455981+0000","scrub_duration":0.0061828689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3699,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.400603+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:32.400603+0000","last_peered":"2024-05-08T20:54:32.400603+0000","last_clean":"2024-05-08T20:54:32.400603+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:32.400603+0000","last_undegraded":"2024-05-08T20:54:32.400603+0000","last_fullsized":"2024-05-08T20:54:32.400603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'654","reported_seq":683,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185078+0000","last_change":"2024-05-08T20:27:18.528295+0000","last_active":"2024-05-08T20:54:43.185078+0000","last_peered":"2024-05-08T20:54:43.185078+0000","last_clean":"2024-05-08T20:54:43.185078+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:54:43.185078+0000","last_undegraded":"2024-05-08T20:54:43.185078+0000","last_fullsized":"2024-05-08T20:54:43.185078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4777,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.637388+0000","last_change":"2024-05-08T20:27:18.895463+0000","last_active":"2024-05-08T20:54:43.637388+0000","last_peered":"2024-05-08T20:54:43.637388+0000","last_clean":"2024-05-08T20:54:43.637388+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:54:43.637388+0000","last_undegraded":"2024-05-08T20:54:43.637388+0000","last_fullsized":"2024-05-08T20:54:43.637388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.342167+0000","last_change":"2024-05-08T20:54:56.342167+0000","last_active":"2024-05-08T20:54:56.342167+0000","last_peered":"2024-05-08T20:54:56.342167+0000","last_clean":"2024-05-08T20:54:56.342167+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:56.342167+0000","last_undegraded":"2024-05-08T20:54:56.342167+0000","last_fullsized":"2024-05-08T20:54:56.342167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.341600+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:37.112673+0000","scrub_duration":0.0065677610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3740,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447440+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.447440+0000","last_peered":"2024-05-08T20:54:32.447440+0000","last_clean":"2024-05-08T20:54:32.447440+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.447440+0000","last_undegraded":"2024-05-08T20:54:32.447440+0000","last_fullsized":"2024-05-08T20:54:32.447440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.540402+0000","last_change":"2024-05-08T20:54:49.540646+0000","last_active":"2024-05-08T20:54:49.540402+0000","last_peered":"2024-05-08T20:54:49.540402+0000","last_clean":"2024-05-08T20:54:49.540402+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:49.540402+0000","last_undegraded":"2024-05-08T20:54:49.540402+0000","last_fullsized":"2024-05-08T20:54:49.540402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5325","last_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_deep_scrub":"26'5325","last_deep_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.540347+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:25.992758+0000","scrub_duration":0.061375869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.416552+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.416552+0000","last_peered":"2024-05-08T20:54:32.416552+0000","last_clean":"2024-05-08T20:54:32.416552+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.416552+0000","last_undegraded":"2024-05-08T20:54:32.416552+0000","last_fullsized":"2024-05-08T20:54:32.416552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.583918+0000","last_change":"2024-05-08T20:54:57.584171+0000","last_active":"2024-05-08T20:54:57.583918+0000","last_peered":"2024-05-08T20:54:57.583918+0000","last_clean":"2024-05-08T20:54:57.583918+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:57.583918+0000","last_undegraded":"2024-05-08T20:54:57.583918+0000","last_fullsized":"2024-05-08T20:54:57.583918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5595","last_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_deep_scrub":"26'5595","last_deep_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.583862+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:54.463390+0000","scrub_duration":0.019454468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4690,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.300795+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.300795+0000","last_peered":"2024-05-08T20:54:32.300795+0000","last_clean":"2024-05-08T20:54:32.300795+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.300795+0000","last_undegraded":"2024-05-08T20:54:32.300795+0000","last_fullsized":"2024-05-08T20:54:32.300795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.966449+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:30.966449+0000","last_peered":"2024-05-08T20:54:30.966449+0000","last_clean":"2024-05-08T20:54:30.966449+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:30.966449+0000","last_undegraded":"2024-05-08T20:54:30.966449+0000","last_fullsized":"2024-05-08T20:54:30.966449+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.440334+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.440334+0000","last_peered":"2024-05-08T20:54:32.440334+0000","last_clean":"2024-05-08T20:54:32.440334+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.440334+0000","last_undegraded":"2024-05-08T20:54:32.440334+0000","last_fullsized":"2024-05-08T20:54:32.440334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.063296+0000","last_change":"2024-05-08T20:54:46.063510+0000","last_active":"2024-05-08T20:54:46.063296+0000","last_peered":"2024-05-08T20:54:46.063296+0000","last_clean":"2024-05-08T20:54:46.063296+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:46.063296+0000","last_undegraded":"2024-05-08T20:54:46.063296+0000","last_fullsized":"2024-05-08T20:54:46.063296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5693","last_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_deep_scrub":"26'5693","last_deep_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.063251+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:47.062496+0000","scrub_duration":0.071792174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713023+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:40.713023+0000","last_peered":"2024-05-08T20:54:40.713023+0000","last_clean":"2024-05-08T20:54:40.713023+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:40.713023+0000","last_undegraded":"2024-05-08T20:54:40.713023+0000","last_fullsized":"2024-05-08T20:54:40.713023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862664+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862664+0000","last_peered":"2024-05-08T20:54:21.862664+0000","last_clean":"2024-05-08T20:54:21.862664+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862664+0000","last_undegraded":"2024-05-08T20:54:21.862664+0000","last_fullsized":"2024-05-08T20:54:21.862664+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:39.444918+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:39.444918+0000","last_peered":"2024-05-08T20:54:39.444918+0000","last_clean":"2024-05-08T20:54:39.444918+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:39.444918+0000","last_undegraded":"2024-05-08T20:54:39.444918+0000","last_fullsized":"2024-05-08T20:54:39.444918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.741511+0000","last_change":"2024-05-08T20:27:18.887006+0000","last_active":"2024-05-08T20:54:21.741511+0000","last_peered":"2024-05-08T20:54:21.741511+0000","last_clean":"2024-05-08T20:54:21.741511+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:54:21.741511+0000","last_undegraded":"2024-05-08T20:54:21.741511+0000","last_fullsized":"2024-05-08T20:54:21.741511+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.712868+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:40.712868+0000","last_peered":"2024-05-08T20:54:40.712868+0000","last_clean":"2024-05-08T20:54:40.712868+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:40.712868+0000","last_undegraded":"2024-05-08T20:54:40.712868+0000","last_fullsized":"2024-05-08T20:54:40.712868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.492210+0000","last_change":"2024-05-08T20:54:47.492492+0000","last_active":"2024-05-08T20:54:47.492210+0000","last_peered":"2024-05-08T20:54:47.492210+0000","last_clean":"2024-05-08T20:54:47.492210+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:47.492210+0000","last_undegraded":"2024-05-08T20:54:47.492210+0000","last_fullsized":"2024-05-08T20:54:47.492210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5066","last_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_deep_scrub":"26'5066","last_deep_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.492152+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.271368+0000","scrub_duration":0.020000068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922568+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:37.922568+0000","last_peered":"2024-05-08T20:54:37.922568+0000","last_clean":"2024-05-08T20:54:37.922568+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:37.922568+0000","last_undegraded":"2024-05-08T20:54:37.922568+0000","last_fullsized":"2024-05-08T20:54:37.922568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.750604+0000","last_change":"2024-05-08T20:27:18.898267+0000","last_active":"2024-05-08T20:54:21.750604+0000","last_peered":"2024-05-08T20:54:21.750604+0000","last_clean":"2024-05-08T20:54:21.750604+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:54:21.750604+0000","last_undegraded":"2024-05-08T20:54:21.750604+0000","last_fullsized":"2024-05-08T20:54:21.750604+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4933,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.449638+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.449638+0000","last_peered":"2024-05-08T20:54:32.449638+0000","last_clean":"2024-05-08T20:54:32.449638+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.449638+0000","last_undegraded":"2024-05-08T20:54:32.449638+0000","last_fullsized":"2024-05-08T20:54:32.449638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824405+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824405+0000","last_peered":"2024-05-08T20:54:21.824405+0000","last_clean":"2024-05-08T20:54:21.824405+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824405+0000","last_undegraded":"2024-05-08T20:54:21.824405+0000","last_fullsized":"2024-05-08T20:54:21.824405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6031,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340064+0000","last_change":"2024-05-08T20:27:28.000048+0000","last_active":"2024-05-08T20:54:32.340064+0000","last_peered":"2024-05-08T20:54:32.340064+0000","last_clean":"2024-05-08T20:54:32.340064+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:54:32.340064+0000","last_undegraded":"2024-05-08T20:54:32.340064+0000","last_fullsized":"2024-05-08T20:54:32.340064+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.442535+0000","last_change":"2024-05-08T20:55:02.442768+0000","last_active":"2024-05-08T20:55:02.442535+0000","last_peered":"2024-05-08T20:55:02.442535+0000","last_clean":"2024-05-08T20:55:02.442535+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:55:02.442535+0000","last_undegraded":"2024-05-08T20:55:02.442535+0000","last_fullsized":"2024-05-08T20:55:02.442535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5184","last_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_deep_scrub":"26'5184","last_deep_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.442482+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:06.919194+0000","scrub_duration":0.015103089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4201,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.948250+0000","last_change":"2024-05-08T20:27:27.997960+0000","last_active":"2024-05-08T20:54:32.948250+0000","last_peered":"2024-05-08T20:54:32.948250+0000","last_clean":"2024-05-08T20:54:32.948250+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:54:32.948250+0000","last_undegraded":"2024-05-08T20:54:32.948250+0000","last_fullsized":"2024-05-08T20:54:32.948250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.878243+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.878243+0000","last_peered":"2024-05-08T20:54:21.878243+0000","last_clean":"2024-05-08T20:54:21.878243+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.878243+0000","last_undegraded":"2024-05-08T20:54:21.878243+0000","last_fullsized":"2024-05-08T20:54:21.878243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4593,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.851895+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:33.851895+0000","last_peered":"2024-05-08T20:54:33.851895+0000","last_clean":"2024-05-08T20:54:33.851895+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:33.851895+0000","last_undegraded":"2024-05-08T20:54:33.851895+0000","last_fullsized":"2024-05-08T20:54:33.851895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6423,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.732804+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:42.732804+0000","last_peered":"2024-05-08T20:54:42.732804+0000","last_clean":"2024-05-08T20:54:42.732804+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:42.732804+0000","last_undegraded":"2024-05-08T20:54:42.732804+0000","last_fullsized":"2024-05-08T20:54:42.732804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4868,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443742+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:34.443742+0000","last_peered":"2024-05-08T20:54:34.443742+0000","last_clean":"2024-05-08T20:54:34.443742+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:34.443742+0000","last_undegraded":"2024-05-08T20:54:34.443742+0000","last_fullsized":"2024-05-08T20:54:34.443742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5016,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:22.919563+0000","last_change":"2024-05-08T20:27:18.917912+0000","last_active":"2024-05-08T20:54:22.919563+0000","last_peered":"2024-05-08T20:54:22.919563+0000","last_clean":"2024-05-08T20:54:22.919563+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:54:22.919563+0000","last_undegraded":"2024-05-08T20:54:22.919563+0000","last_fullsized":"2024-05-08T20:54:22.919563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443798+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:34.443798+0000","last_peered":"2024-05-08T20:54:34.443798+0000","last_clean":"2024-05-08T20:54:34.443798+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:34.443798+0000","last_undegraded":"2024-05-08T20:54:34.443798+0000","last_fullsized":"2024-05-08T20:54:34.443798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6036,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.710872+0000","last_change":"2024-05-08T20:27:18.915125+0000","last_active":"2024-05-08T20:54:30.710872+0000","last_peered":"2024-05-08T20:54:30.710872+0000","last_clean":"2024-05-08T20:54:30.710872+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:54:30.710872+0000","last_undegraded":"2024-05-08T20:54:30.710872+0000","last_fullsized":"2024-05-08T20:54:30.710872+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.330591+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.330591+0000","last_peered":"2024-05-08T20:54:32.330591+0000","last_clean":"2024-05-08T20:54:32.330591+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.330591+0000","last_undegraded":"2024-05-08T20:54:32.330591+0000","last_fullsized":"2024-05-08T20:54:32.330591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.580457+0000","last_change":"2024-05-08T20:54:59.580745+0000","last_active":"2024-05-08T20:54:59.580457+0000","last_peered":"2024-05-08T20:54:59.580457+0000","last_clean":"2024-05-08T20:54:59.580457+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:59.580457+0000","last_undegraded":"2024-05-08T20:54:59.580457+0000","last_fullsized":"2024-05-08T20:54:59.580457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5402","last_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_deep_scrub":"26'5402","last_deep_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.580403+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:43.325297+0000","scrub_duration":0.019827373999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3941,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.385640+0000","last_change":"2024-05-08T20:27:27.984913+0000","last_active":"2024-05-08T20:54:33.385640+0000","last_peered":"2024-05-08T20:54:33.385640+0000","last_clean":"2024-05-08T20:54:33.385640+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:54:33.385640+0000","last_undegraded":"2024-05-08T20:54:33.385640+0000","last_fullsized":"2024-05-08T20:54:33.385640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.877246+0000","last_change":"2024-05-08T20:27:18.930617+0000","last_active":"2024-05-08T20:54:21.877246+0000","last_peered":"2024-05-08T20:54:21.877246+0000","last_clean":"2024-05-08T20:54:21.877246+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:54:21.877246+0000","last_undegraded":"2024-05-08T20:54:21.877246+0000","last_fullsized":"2024-05-08T20:54:21.877246+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.421794+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.421794+0000","last_peered":"2024-05-08T20:54:32.421794+0000","last_clean":"2024-05-08T20:54:32.421794+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.421794+0000","last_undegraded":"2024-05-08T20:54:32.421794+0000","last_fullsized":"2024-05-08T20:54:32.421794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.191509+0000","last_change":"2024-05-08T20:54:47.191768+0000","last_active":"2024-05-08T20:54:47.191509+0000","last_peered":"2024-05-08T20:54:47.191509+0000","last_clean":"2024-05-08T20:54:47.191509+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:47.191509+0000","last_undegraded":"2024-05-08T20:54:47.191509+0000","last_fullsized":"2024-05-08T20:54:47.191509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5121","last_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_deep_scrub":"26'5121","last_deep_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.191457+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:32.886217+0000","scrub_duration":0.059662343999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415210+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415210+0000","last_peered":"2024-05-08T20:54:32.415210+0000","last_clean":"2024-05-08T20:54:32.415210+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415210+0000","last_undegraded":"2024-05-08T20:54:32.415210+0000","last_fullsized":"2024-05-08T20:54:32.415210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.836706+0000","last_change":"2024-05-08T20:54:54.836939+0000","last_active":"2024-05-08T20:54:54.836706+0000","last_peered":"2024-05-08T20:54:54.836706+0000","last_clean":"2024-05-08T20:54:54.836706+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:54.836706+0000","last_undegraded":"2024-05-08T20:54:54.836706+0000","last_fullsized":"2024-05-08T20:54:54.836706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4602","last_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_deep_scrub":"26'4602","last_deep_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.836650+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:37.068481+0000","scrub_duration":0.026253420999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.343098+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.343098+0000","last_peered":"2024-05-08T20:54:32.343098+0000","last_clean":"2024-05-08T20:54:32.343098+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.343098+0000","last_undegraded":"2024-05-08T20:54:32.343098+0000","last_fullsized":"2024-05-08T20:54:32.343098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941403+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941403+0000","last_peered":"2024-05-08T20:54:42.941403+0000","last_clean":"2024-05-08T20:54:42.941403+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941403+0000","last_undegraded":"2024-05-08T20:54:42.941403+0000","last_fullsized":"2024-05-08T20:54:42.941403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405851+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.405851+0000","last_peered":"2024-05-08T20:54:32.405851+0000","last_clean":"2024-05-08T20:54:32.405851+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.405851+0000","last_undegraded":"2024-05-08T20:54:32.405851+0000","last_fullsized":"2024-05-08T20:54:32.405851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4654,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.773301+0000","last_change":"2024-05-08T20:27:18.885980+0000","last_active":"2024-05-08T20:54:21.773301+0000","last_peered":"2024-05-08T20:54:21.773301+0000","last_clean":"2024-05-08T20:54:21.773301+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:54:21.773301+0000","last_undegraded":"2024-05-08T20:54:21.773301+0000","last_fullsized":"2024-05-08T20:54:21.773301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.357288+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.357288+0000","last_peered":"2024-05-08T20:54:32.357288+0000","last_clean":"2024-05-08T20:54:32.357288+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.357288+0000","last_undegraded":"2024-05-08T20:54:32.357288+0000","last_fullsized":"2024-05-08T20:54:32.357288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3716,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.863851+0000","last_change":"2024-05-08T20:27:18.917903+0000","last_active":"2024-05-08T20:54:21.863851+0000","last_peered":"2024-05-08T20:54:21.863851+0000","last_clean":"2024-05-08T20:54:21.863851+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:54:21.863851+0000","last_undegraded":"2024-05-08T20:54:21.863851+0000","last_fullsized":"2024-05-08T20:54:21.863851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.340613+0000","last_change":"2024-05-08T20:27:27.969069+0000","last_active":"2024-05-08T20:54:32.340613+0000","last_peered":"2024-05-08T20:54:32.340613+0000","last_clean":"2024-05-08T20:54:32.340613+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:54:32.340613+0000","last_undegraded":"2024-05-08T20:54:32.340613+0000","last_fullsized":"2024-05-08T20:54:32.340613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.474491+0000","last_change":"2024-05-08T20:54:51.474745+0000","last_active":"2024-05-08T20:54:51.474491+0000","last_peered":"2024-05-08T20:54:51.474491+0000","last_clean":"2024-05-08T20:54:51.474491+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:51.474491+0000","last_undegraded":"2024-05-08T20:54:51.474491+0000","last_fullsized":"2024-05-08T20:54:51.474491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5609","last_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_deep_scrub":"26'5609","last_deep_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.474437+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:37.535496+0000","scrub_duration":0.017226228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4551,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.406042+0000","last_change":"2024-05-08T20:27:28.001137+0000","last_active":"2024-05-08T20:54:32.406042+0000","last_peered":"2024-05-08T20:54:32.406042+0000","last_clean":"2024-05-08T20:54:32.406042+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:54:32.406042+0000","last_undegraded":"2024-05-08T20:54:32.406042+0000","last_fullsized":"2024-05-08T20:54:32.406042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.487212+0000","last_change":"2024-05-08T20:54:45.487445+0000","last_active":"2024-05-08T20:54:45.487212+0000","last_peered":"2024-05-08T20:54:45.487212+0000","last_clean":"2024-05-08T20:54:45.487212+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:45.487212+0000","last_undegraded":"2024-05-08T20:54:45.487212+0000","last_fullsized":"2024-05-08T20:54:45.487212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5845","last_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_deep_scrub":"26'5845","last_deep_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.487159+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:35.646681+0000","scrub_duration":0.033861688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3529,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.344970+0000","last_change":"2024-05-08T20:27:27.993545+0000","last_active":"2024-05-08T20:54:32.344970+0000","last_peered":"2024-05-08T20:54:32.344970+0000","last_clean":"2024-05-08T20:54:32.344970+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:54:32.344970+0000","last_undegraded":"2024-05-08T20:54:32.344970+0000","last_fullsized":"2024-05-08T20:54:32.344970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6670,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.907678+0000","last_change":"2024-05-08T20:27:18.933017+0000","last_active":"2024-05-08T20:54:21.907678+0000","last_peered":"2024-05-08T20:54:21.907678+0000","last_clean":"2024-05-08T20:54:21.907678+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:54:21.907678+0000","last_undegraded":"2024-05-08T20:54:21.907678+0000","last_fullsized":"2024-05-08T20:54:21.907678+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.852816+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:38.852816+0000","last_peered":"2024-05-08T20:54:38.852816+0000","last_clean":"2024-05-08T20:54:38.852816+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:38.852816+0000","last_undegraded":"2024-05-08T20:54:38.852816+0000","last_fullsized":"2024-05-08T20:54:38.852816+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.828298+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.828298+0000","last_peered":"2024-05-08T20:54:21.828298+0000","last_clean":"2024-05-08T20:54:21.828298+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.828298+0000","last_undegraded":"2024-05-08T20:54:21.828298+0000","last_fullsized":"2024-05-08T20:54:21.828298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4045,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922814+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:37.922814+0000","last_peered":"2024-05-08T20:54:37.922814+0000","last_clean":"2024-05-08T20:54:37.922814+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:37.922814+0000","last_undegraded":"2024-05-08T20:54:37.922814+0000","last_fullsized":"2024-05-08T20:54:37.922814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5898,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976211+0000","last_change":"2024-05-08T20:27:18.903376+0000","last_active":"2024-05-08T20:54:44.976211+0000","last_peered":"2024-05-08T20:54:44.976211+0000","last_clean":"2024-05-08T20:54:44.976211+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:54:44.976211+0000","last_undegraded":"2024-05-08T20:54:44.976211+0000","last_fullsized":"2024-05-08T20:54:44.976211+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385760+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385760+0000","last_peered":"2024-05-08T20:54:32.385760+0000","last_clean":"2024-05-08T20:54:32.385760+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385760+0000","last_undegraded":"2024-05-08T20:54:32.385760+0000","last_fullsized":"2024-05-08T20:54:32.385760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079537+0000","last_change":"2024-05-08T20:27:18.928570+0000","last_active":"2024-05-08T20:54:44.079537+0000","last_peered":"2024-05-08T20:54:44.079537+0000","last_clean":"2024-05-08T20:54:44.079537+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:54:44.079537+0000","last_undegraded":"2024-05-08T20:54:44.079537+0000","last_fullsized":"2024-05-08T20:54:44.079537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.387527+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.387527+0000","last_peered":"2024-05-08T20:54:32.387527+0000","last_clean":"2024-05-08T20:54:32.387527+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.387527+0000","last_undegraded":"2024-05-08T20:54:32.387527+0000","last_fullsized":"2024-05-08T20:54:32.387527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976245+0000","last_change":"2024-05-08T20:27:18.914459+0000","last_active":"2024-05-08T20:54:44.976245+0000","last_peered":"2024-05-08T20:54:44.976245+0000","last_clean":"2024-05-08T20:54:44.976245+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:54:44.976245+0000","last_undegraded":"2024-05-08T20:54:44.976245+0000","last_fullsized":"2024-05-08T20:54:44.976245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3764,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185689+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:43.185689+0000","last_peered":"2024-05-08T20:54:43.185689+0000","last_clean":"2024-05-08T20:54:43.185689+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:43.185689+0000","last_undegraded":"2024-05-08T20:54:43.185689+0000","last_fullsized":"2024-05-08T20:54:43.185689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4750,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.171330+0000","last_change":"2024-05-08T20:54:54.172178+0000","last_active":"2024-05-08T20:54:54.171330+0000","last_peered":"2024-05-08T20:54:54.171330+0000","last_clean":"2024-05-08T20:54:54.171330+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:54.171330+0000","last_undegraded":"2024-05-08T20:54:54.171330+0000","last_fullsized":"2024-05-08T20:54:54.171330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4709","last_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_deep_scrub":"26'4709","last_deep_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.171276+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.280762+0000","scrub_duration":0.026438705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3924,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.733158+0000","last_change":"2024-05-08T20:27:27.975515+0000","last_active":"2024-05-08T20:54:42.733158+0000","last_peered":"2024-05-08T20:54:42.733158+0000","last_clean":"2024-05-08T20:54:42.733158+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:54:42.733158+0000","last_undegraded":"2024-05-08T20:54:42.733158+0000","last_fullsized":"2024-05-08T20:54:42.733158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5679,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.101942+0000","last_change":"2024-05-08T20:55:03.102295+0000","last_active":"2024-05-08T20:55:03.101942+0000","last_peered":"2024-05-08T20:55:03.101942+0000","last_clean":"2024-05-08T20:55:03.101942+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:55:03.101942+0000","last_undegraded":"2024-05-08T20:55:03.101942+0000","last_fullsized":"2024-05-08T20:55:03.101942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5638","last_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_deep_scrub":"26'5638","last_deep_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.101828+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:45.438163+0000","scrub_duration":0.077280746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976854+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:44.976854+0000","last_peered":"2024-05-08T20:54:44.976854+0000","last_clean":"2024-05-08T20:54:44.976854+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:44.976854+0000","last_undegraded":"2024-05-08T20:54:44.976854+0000","last_fullsized":"2024-05-08T20:54:44.976854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.773320+0000","last_change":"2024-05-08T20:54:49.773606+0000","last_active":"2024-05-08T20:54:49.773320+0000","last_peered":"2024-05-08T20:54:49.773320+0000","last_clean":"2024-05-08T20:54:49.773320+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:49.773320+0000","last_undegraded":"2024-05-08T20:54:49.773320+0000","last_fullsized":"2024-05-08T20:54:49.773320+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6644","last_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_deep_scrub":"26'6644","last_deep_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.773265+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:23.617467+0000","scrub_duration":0.054899599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4770,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976860+0000","last_change":"2024-05-08T20:27:28.000195+0000","last_active":"2024-05-08T20:54:44.976860+0000","last_peered":"2024-05-08T20:54:44.976860+0000","last_clean":"2024-05-08T20:54:44.976860+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:54:44.976860+0000","last_undegraded":"2024-05-08T20:54:44.976860+0000","last_fullsized":"2024-05-08T20:54:44.976860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5146,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.584824+0000","last_change":"2024-05-08T20:54:48.585054+0000","last_active":"2024-05-08T20:54:48.584824+0000","last_peered":"2024-05-08T20:54:48.584824+0000","last_clean":"2024-05-08T20:54:48.584824+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:48.584824+0000","last_undegraded":"2024-05-08T20:54:48.584824+0000","last_fullsized":"2024-05-08T20:54:48.584824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5105","last_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_deep_scrub":"26'5105","last_deep_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.584770+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:58.380211+0000","scrub_duration":0.012206140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3549,"ondisk_log_size":3549,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3556,"ondisk_log_size":3556,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575188,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":3.4089999999999998,"15min":1.579},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":4.5750000000000002,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.9650000000000001,"15min":1.1859999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":3.7829999999999999,"5min":34.091000000000001,"15min":34.091000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.732,"15min":1.077},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.4249999999999998,"5min":13.579000000000001,"15min":13.579000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.736,"15min":1.153},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":7.4699999999999998,"5min":13.467000000000001,"15min":13.467000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.9199999999999999,"15min":1.147},"min":{"1min":0.26300000000000001,"5min":0.245,"15min":0.245},"max":{"1min":4.585,"5min":33.950000000000003,"15min":33.950000000000003},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":2.069,"15min":1.288},"min":{"1min":0.36799999999999999,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":4.5570000000000004,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.2649999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.663,"15min":1.1100000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2589999999999999,"5min":15.532,"15min":15.532},"last":1.125},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.2879999999999998,"15min":1.397},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.5,"5min":16.584,"15min":16.584},"last":0.92900000000000005}]},{"osd":4,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.4950000000000001,"15min":1.732},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.214},"max":{"1min":6.4630000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.3080000000000001,"5min":2.2389999999999999,"15min":1.361},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":4.617,"5min":22.741,"15min":22.741},"last":0.629}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":4.0570000000000004,"15min":1.9810000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":5.8380000000000001,"5min":33.679000000000002,"15min":33.679000000000002},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.522,"5min":2.5019999999999998,"15min":1.506},"min":{"1min":0.41999999999999998,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":4.5700000000000003,"5min":20.869,"15min":20.869},"last":1.3160000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.7050000000000001,"15min":1.2669999999999999},"min":{"1min":0.27900000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.157,"5min":13.714,"15min":13.714},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":2.2090000000000001,"15min":1.3480000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":6.2519999999999998,"5min":22.405000000000001,"15min":22.405000000000001},"last":1.2410000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575187,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":1.389,"15min":0.98899999999999999},"min":{"1min":0.39400000000000002,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":1.25,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.5780000000000001,"15min":1.173},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2829999999999999,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":1}]},{"osd":1,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.504,"15min":1.1799999999999999},"min":{"1min":0.38200000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":1.2050000000000001,"5min":6.5739999999999998,"15min":14.717000000000001},"last":0.874},{"interface":"front","average":{"1min":1.095,"5min":1.4610000000000001,"15min":1.1100000000000001},"min":{"1min":0.442,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":3.645,"5min":11.523999999999999,"15min":14.404},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.3500000000000001,"15min":1.0980000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":1.198,"5min":9.907,"15min":9.907},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.244,"15min":1.0940000000000001},"min":{"1min":0.51200000000000001,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":1.294,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.03}]},{"osd":3,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.7729999999999999,"15min":1.3140000000000001},"min":{"1min":0.46899999999999997,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":1.349,"5min":26.088999999999999,"15min":26.088999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.7490000000000001,"5min":1.6870000000000001,"15min":1.252},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":13.960000000000001,"5min":13.960000000000001,"15min":13.960000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":2.4609999999999999,"15min":1.5580000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.223},"max":{"1min":3.177,"5min":30.094000000000001,"15min":30.094000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.048,"5min":1.9530000000000001,"15min":1.444},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":1.476,"5min":29.538,"15min":29.538},"last":1.087}]},{"osd":5,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.8440000000000001,"15min":1.2090000000000001},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.25},"max":{"1min":1.3759999999999999,"5min":11.568,"15min":11.568},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.9279999999999999,"15min":1.333},"min":{"1min":0.54100000000000004,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":1.484,"5min":11.593999999999999,"15min":11.593999999999999},"last":0.97699999999999998}]},{"osd":7,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.9219999999999999,"15min":1.27},"min":{"1min":0.312,"5min":0.188,"15min":0.188},"max":{"1min":1.2949999999999999,"5min":12.77,"15min":12.77},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.788,"15min":1.3069999999999999},"min":{"1min":0.48499999999999999,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":1.4319999999999999,"5min":20.495999999999999,"15min":20.495999999999999},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834575187,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.3320000000000001,"15min":1.0800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.1559999999999997,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.3109999999999999,"15min":1.018},"min":{"1min":0.55900000000000005,"5min":0.27800000000000002,"15min":0.23599999999999999},"max":{"1min":3.7090000000000001,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":1.008}]},{"osd":1,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":4.976,"15min":2.3239999999999998},"min":{"1min":0.43099999999999999,"5min":0.27100000000000002,"15min":0.20799999999999999},"max":{"1min":3.7530000000000001,"5min":121.521,"15min":121.521},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.9179999999999999,"15min":1.2310000000000001},"min":{"1min":0.57399999999999995,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.1980000000000004,"5min":18.957999999999998,"15min":18.957999999999998},"last":1.099}]},{"osd":2,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.8109999999999999,"15min":1.224},"min":{"1min":0.317,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":4.6870000000000003,"5min":16.535,"15min":16.535},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.7529999999999999,"15min":1.1599999999999999},"min":{"1min":0.40000000000000002,"5min":0.27900000000000003,"15min":0.249},"max":{"1min":3.7930000000000001,"5min":15.006,"15min":15.006},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":5.3209999999999997,"15min":2.516},"min":{"1min":0.33900000000000002,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":4.6150000000000002,"5min":121.498,"15min":121.498},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.714,"5min":1.8939999999999999,"15min":1.3129999999999999},"min":{"1min":0.5,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.737,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":4.6740000000000004,"15min":2.335},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.4790000000000001,"5min":121.464,"15min":121.464},"last":1.496},{"interface":"front","average":{"1min":1.137,"5min":1.657,"15min":1.2010000000000001},"min":{"1min":0.36599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.8759999999999999,"5min":7.7110000000000003,"15min":8.2710000000000008},"last":1.081}]},{"osd":6,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.8580000000000001,"15min":1.351},"min":{"1min":0.66500000000000004,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0430000000000001,"5min":15.048,"15min":15.048},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.665,"15min":1.2270000000000001},"min":{"1min":0.71399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":3.649,"5min":11.56,"15min":11.56},"last":1.3169999999999999}]},{"osd":7,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":3.113,"15min":2.0150000000000001},"min":{"1min":0.55200000000000005,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":5.1050000000000004,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.554,"15min":1.2549999999999999},"min":{"1min":0.68000000000000005,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.8300000000000001,"5min":9.4890000000000008,"15min":12.679},"last":1.2110000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575187,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":2.1960000000000002,"15min":1.252},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":10.419,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.901,"15min":1.1839999999999999},"min":{"1min":0.34699999999999998,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":10.505000000000001,"5min":16.119,"15min":16.119},"last":1.0600000000000001}]},{"osd":1,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.766,"5min":2.6309999999999998,"15min":1.4219999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":10.977,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.593,"15min":1.077},"min":{"1min":0.26500000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9969999999999999,"5min":16.904,"15min":16.904},"last":0.94999999999999996}]},{"osd":2,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":2.6890000000000001,"15min":1.478},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":11.013999999999999,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3200000000000001,"15min":0.99199999999999999},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":4.024,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":1.1240000000000001}]},{"osd":3,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":2.6030000000000002,"15min":1.5229999999999999},"min":{"1min":0.33700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":10.471,"5min":16.449000000000002,"15min":16.449000000000002},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":2.54,"15min":1.5009999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":3.1989999999999998,"5min":29.526,"15min":29.526},"last":1.0880000000000001}]},{"osd":5,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.093,"5min":2.6779999999999999,"15min":1.4670000000000001},"min":{"1min":0.32500000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":10.808,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.756,"5min":1.782,"15min":1.177},"min":{"1min":0.41099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.6699999999999999,"5min":14.863,"15min":14.863},"last":1.2110000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":2.1120000000000001,"15min":1.327},"min":{"1min":0.38700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":10.554,"5min":33.198,"15min":33.198},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.0939999999999999,"15min":1.379},"min":{"1min":0.39000000000000001,"5min":0.318,"15min":0.308},"max":{"1min":10.528,"5min":31.495999999999999,"15min":31.495999999999999},"last":0.91000000000000003}]},{"osd":7,"last update":"Wed May 8 20:54:03 2024","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":3.5920000000000001,"15min":1.8440000000000001},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":5.9980000000000002,"5min":54.073999999999998,"15min":54.073999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.762,"5min":3.7669999999999999,"15min":1.9490000000000001},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.37},"max":{"1min":6.0309999999999997,"5min":54.113,"15min":54.113},"last":1.181}]}]},{"osd":3,"up_from":13,"seq":55834575187,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.379,"15min":0.95699999999999996},"min":{"1min":0.48399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.97899999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.4730000000000001,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.192,"15min":0.192},"max":{"1min":1.0369999999999999,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.745}]},{"osd":1,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":1.171,"15min":1.0289999999999999},"min":{"1min":0.40600000000000003,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.88,"5min":12.253,"15min":16.355},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.04,"15min":0.86199999999999999},"min":{"1min":0.36099999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.872,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.83299999999999996}]},{"osd":2,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":0.90600000000000003},"min":{"1min":0.54900000000000004,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":1.127,"5min":17.106000000000002,"15min":17.106000000000002},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.96299999999999997,"15min":0.83999999999999997},"min":{"1min":0.48599999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.0880000000000001,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.68899999999999995}]},{"osd":4,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.512,"15min":1.091},"min":{"1min":0.70599999999999996,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5539999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.4319999999999999,"15min":1.046},"min":{"1min":0.74299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.4630000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.96099999999999997}]},{"osd":5,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.7350000000000001,"15min":1.9179999999999999},"min":{"1min":0.52900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4750000000000001,"5min":17.004999999999999,"15min":117.105},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.5549999999999999,"15min":1.1619999999999999},"min":{"1min":0.45400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1879999999999999,"5min":14.394,"15min":14.394},"last":0.996}]},{"osd":6,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.6359999999999999,"15min":1.3340000000000001},"min":{"1min":0.67000000000000004,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5629999999999999,"5min":10.834,"15min":16.113},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.651,"15min":1.2230000000000001},"min":{"1min":0.84999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5109999999999999,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.097}]},{"osd":7,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.827,"15min":1.3520000000000001},"min":{"1min":0.79100000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4430000000000001,"5min":16.977,"15min":16.977},"last":1.147},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.7509999999999999,"15min":1.2929999999999999},"min":{"1min":0.51800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":1.4410000000000001,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834575185,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.111,"15min":0.86899999999999999},"min":{"1min":0.315,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":7.5679999999999996,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":1.101,"15min":0.91900000000000004},"min":{"1min":0.34000000000000002,"5min":0.189,"15min":0.189},"max":{"1min":2.2440000000000002,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.02,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.7409999999999997,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.373,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.3170000000000002,"5min":6.0380000000000003,"15min":6.7009999999999996},"last":0.80900000000000005}]},{"osd":3,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.3340000000000001,"15min":0.94699999999999995},"min":{"1min":0.45900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.6289999999999996,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.2350000000000001,"15min":0.97299999999999998},"min":{"1min":0.52300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":10.510999999999999,"5min":10.510999999999999,"15min":10.510999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Wed May 8 20:54:04 2024","interfaces":[{"interface":"back","average":{"1min":1.649,"5min":2.0379999999999998,"15min":1.234},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":10.257,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.149},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.8640000000000001,"15min":1.2350000000000001},"min":{"1min":0.30399999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":3.6509999999999998,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.764,"15min":1.3169999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":1.1659999999999999,"5min":12.391999999999999,"15min":22.489000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.6839999999999999,"15min":1.2450000000000001},"min":{"1min":0.71899999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.0059999999999998,"5min":14.968999999999999,"15min":14.968999999999999},"last":0.83999999999999997}]},{"osd":6,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.657,"15min":1.214},"min":{"1min":0.53500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.6520000000000001,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6439999999999999,"15min":1.2010000000000001},"min":{"1min":0.66100000000000003,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":7.5060000000000002,"5min":12.553000000000001,"15min":12.553000000000001},"last":0.99299999999999999}]},{"osd":7,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":2.0390000000000001,"15min":1.4330000000000001},"min":{"1min":0.57099999999999995,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":7.4210000000000003,"5min":13.663,"15min":13.663},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4510000000000001,"15min":1.51},"min":{"1min":0.85699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.915,"5min":19.201000000000001,"15min":19.201000000000001},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834575186,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.92700000000000005,"15min":0.78000000000000003},"min":{"1min":0.214,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.633,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":1.236,"15min":0.94099999999999995},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0779999999999998,"5min":21.094999999999999,"15min":21.094999999999999},"last":1.0429999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":0.88600000000000001},"min":{"1min":0.23000000000000001,"5min":0.20000000000000001,"15min":0.188},"max":{"1min":0.95799999999999996,"5min":13.961,"15min":13.961},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.0369999999999999,"15min":0.84499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.0740000000000001,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.84799999999999998}]},{"osd":3,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":2.2909999999999999,"15min":1.458},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":1.6599999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.22},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.20399999999999999},"max":{"1min":1.548,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":1.3999999999999999,"15min":1.137},"min":{"1min":0.46999999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1319999999999999,"5min":14.002000000000001,"15min":14.002000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.2490000000000001,"15min":1.04},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":1.5980000000000001,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":3.3940000000000001,"15min":1.8720000000000001},"min":{"1min":0.46999999999999997,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":2.7490000000000001,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.8140000000000001,"15min":1.3080000000000001},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.444,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.1160000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.2210000000000001},"min":{"1min":0.60499999999999998,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":14.032,"15min":14.032},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.405,"15min":1.1379999999999999},"min":{"1min":0.58799999999999997,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":2.9079999999999999,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.1870000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":2.4660000000000002,"15min":1.677},"min":{"1min":0.60099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.7749999999999999,"5min":26.881,"15min":26.881},"last":1.149},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.738,"15min":1.339},"min":{"1min":0.45900000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":7.1429999999999998,"5min":13.946999999999999,"15min":13.946999999999999},"last":0.95399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575186,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.89900000000000002,"15min":0.70099999999999996},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.98999999999999999,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.748,"5min":1.2290000000000001,"15min":0.83999999999999997},"min":{"1min":0.17499999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":3.2589999999999999,"5min":13.305,"15min":13.305},"last":0.72399999999999998}]},{"osd":2,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.1850000000000001,"15min":0.82399999999999995},"min":{"1min":0.20699999999999999,"5min":0.20300000000000001,"15min":0.19700000000000001},"max":{"1min":3.0859999999999999,"5min":15.212,"15min":15.212},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":1.1100000000000001,"15min":0.82599999999999996},"min":{"1min":0.23899999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":2.8660000000000001,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.0609999999999999,"15min":0.873},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":2.8980000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.115,"15min":0.95999999999999996},"min":{"1min":0.33400000000000002,"5min":0.30299999999999999,"15min":0.26300000000000001},"max":{"1min":2.9239999999999999,"5min":6.758,"15min":6.758},"last":1.25}]},{"osd":4,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":1.613,"15min":1.1040000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.242,"5min":18.407,"15min":18.407},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.6180000000000001,"15min":1.085},"min":{"1min":0.32900000000000001,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.3240000000000001,"5min":18.466999999999999,"15min":18.466999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.246,"15min":1.3049999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":3.048,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.8220000000000001,"15min":1.1830000000000001},"min":{"1min":0.32400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":3.1840000000000002,"5min":14.375999999999999,"15min":14.375999999999999},"last":0.995}]},{"osd":6,"last update":"Wed May 8 20:54:01 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.496,"15min":1.0960000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":6.0860000000000003,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":1.052},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.5609999999999999,"15min":1.123},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":3.6030000000000002,"5min":11.597,"15min":11.597},"last":1.0720000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":2.3340000000000001,"15min":1.4059999999999999},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.5259999999999998,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.042},{"interface":"front","average":{"1min":1.232,"5min":2.3660000000000001,"15min":1.4930000000000001},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.5590000000000002,"5min":18.788,"15min":18.788},"last":1.286}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:05.731 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.731 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.731 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.731 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.731 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.732 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.732 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.732 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.732 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.733 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.733 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.733 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.733 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.733 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.734 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.734 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.734 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.734 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.734 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.735 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.735 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.735 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.735 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.735 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.736 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.736 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.736 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.736 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.736 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.737 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.737 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.737 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.737 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.737 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.738 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.738 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.738 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.738 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.739 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.739 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.739 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.739 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.739 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.740 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.740 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T20:27:07.421269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.740 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.740 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.740 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.741 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.742 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.742 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.742 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.743 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.743 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.743 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.743 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.743 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.744 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.744 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.744 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.745 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.745 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.745 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.745 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.745 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.746 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.746 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.746 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.746 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.747 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.748 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T20:27:26.551584+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.748 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.748 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.748 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.748 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.749 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.749 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.749 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.749 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.749 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.750 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.750 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.750 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.750 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.751 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.752 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.752 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.752 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.752 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.752 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.753 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.753 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.753 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.753 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.754 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.754 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.754 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.754 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.755 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.755 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.755 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.755 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.756 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.756 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.756 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.756 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.757 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.757 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.757 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.757 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.758 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.758 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.758 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.758 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.759 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.759 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.759 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.759 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.760 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.760 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.760 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.760 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:05.761 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T20:55:25.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.888+0000 7fec1efef640 1 Processor -- start 2024-05-08T20:55:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.888+0000 7fec1efef640 1 -- start start 2024-05-08T20:55:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1efef640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec181501e0 0x7fec1806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1efef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec1806f400 0x7fec180c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1efef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec180c0650 con 0x7fec180725f0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1efef640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1806fd60 con 0x7fec1806f400 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1efef640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec18072180 con 0x7fec181501e0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec17fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fec180725f0 0x7fec180c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43272/0 (socket says 172.21.15.81:43272) 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec17fff640 1 -- 172.21.15.81:0/3269367659 learned_addr learned my addr 172.21.15.81:0/3269367659 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1d58c640 1 --2- 172.21.15.81:0/3269367659 >> v2:172.21.15.81:3300/0 conn(0x7fec1806f400 0x7fec180c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1cd8b640 1 --2- 172.21.15.81:0/3269367659 >> v2:172.21.15.117:3300/0 conn(0x7fec181501e0 0x7fec1806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec177fe640 1 -- 172.21.15.81:0/3269367659 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999716452 0 0) 0x7fec180c0650 con 0x7fec180725f0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec177fe640 1 -- 172.21.15.81:0/3269367659 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec04003530 con 0x7fec180725f0 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1d58c640 1 -- 172.21.15.81:0/3269367659 >> v2:172.21.15.117:3300/0 conn(0x7fec181501e0 msgr2=0x7fec1806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1d58c640 1 --2- 172.21.15.81:0/3269367659 >> v2:172.21.15.117:3300/0 conn(0x7fec181501e0 0x7fec1806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1d58c640 1 -- 172.21.15.81:0/3269367659 >> v1:172.21.15.81:6789/0 conn(0x7fec180725f0 legacy=0x7fec180c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.892+0000 7fec1d58c640 1 -- 172.21.15.81:0/3269367659 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1806fa80 con 0x7fec1806f400 2024-05-08T20:55:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1d58c640 1 --2- 172.21.15.81:0/3269367659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec180c2350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fec1806ae70 tx=0x7fec1001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a77d508b8a8f578 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec177fe640 1 -- 172.21.15.81:0/3269367659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10004230 con 0x7fec1806f400 2024-05-08T20:55:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec177fe640 1 -- 172.21.15.81:0/3269367659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec100a7050 con 0x7fec1806f400 2024-05-08T20:55:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec177fe640 1 -- 172.21.15.81:0/3269367659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10003620 con 0x7fec1806f400 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/3269367659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 msgr2=0x7fec180c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- 172.21.15.81:0/3269367659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec180c2350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fec1806ae70 tx=0x7fec1001c330 comp rx=0 tx=0).stop 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/3269367659 shutdown_connections 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- 172.21.15.81:0/3269367659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec180c2350 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- 172.21.15.81:0/3269367659 >> v2:172.21.15.117:3300/0 conn(0x7fec181501e0 0x7fec1806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/3269367659 >> 172.21.15.81:0/3269367659 conn(0x7fec180c2ca0 msgr2=0x7fec180c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/3269367659 shutdown_connections 2024-05-08T20:55:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/3269367659 wait complete. 2024-05-08T20:55:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 Processor -- start 2024-05-08T20:55:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- start start 2024-05-08T20:55:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec180725f0 0x7fec18145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec181501e0 0x7fec181ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18143610 con 0x7fec1806f400 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18149480 con 0x7fec180725f0 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec181403e0 con 0x7fec181501e0 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44804/0 (socket says 172.21.15.81:44804) 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 -- 172.21.15.81:0/1758970764 learned_addr learned my addr 172.21.15.81:0/1758970764 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 -- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec181501e0 msgr2=0x7fec181ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec181501e0 0x7fec181ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 -- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec180725f0 msgr2=0x7fec18145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec180725f0 0x7fec18145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 -- 172.21.15.81:0/1758970764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10009420 con 0x7fec1806f400 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1cd8b640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec0800efc0 tx=0x7fec0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08014480 con 0x7fec1806f400 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800f040 con 0x7fec1806f400 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec18150740 con 0x7fec1806f400 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.896+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08014800 con 0x7fec1806f400 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec181496b0 con 0x7fec1806f400 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec18074950 con 0x7fec1806f400 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec08014960 con 0x7fec1806f400 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec157fa640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 0x7febf8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fec08085080 con 0x7fec1806f400 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec17fff640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 0x7febf8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.900+0000 7fec17fff640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 0x7febf8068b50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec000011f0 tx=0x7fec00007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:25.904+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fec080520e0 con 0x7fec1806f400 2024-05-08T20:55:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.056+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec181505c0 con 0x7febf8066690 2024-05-08T20:55:26.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.092+0000 7fec157fa640 1 -- 172.21.15.81:0/1758970764 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+529414 (secure 0 0 0) 0x7fec000070d0 con 0x7febf8066690 2024-05-08T20:55:26.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:55:26.107 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:55:26.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 msgr2=0x7febf8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 0x7febf8068b50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec000011f0 tx=0x7fec00007920 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 msgr2=0x7fec1813fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fec0800efc0 tx=0x7fec0800c490 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 shutdown_connections 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7febf8066690 0x7febf8068b50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec181501e0 0x7fec181ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec180725f0 0x7fec18145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 --2- 172.21.15.81:0/1758970764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1806f400 0x7fec1813fea0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 >> 172.21.15.81:0/1758970764 conn(0x7fec180c2ca0 msgr2=0x7fec1814bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 shutdown_connections 2024-05-08T20:55:26.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:26.100+0000 7fec1efef640 1 -- 172.21.15.81:0/1758970764 wait complete. 2024-05-08T20:55:26.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":868,"stamp":"2024-05-08T20:55:25.912354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622917,"ondisk_log_size":622917,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005805"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.408414+0000","last_change":"2024-05-08T20:27:28.014859+0000","last_active":"2024-05-08T20:54:32.408414+0000","last_peered":"2024-05-08T20:54:32.408414+0000","last_clean":"2024-05-08T20:54:32.408414+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:54:32.408414+0000","last_undegraded":"2024-05-08T20:54:32.408414+0000","last_fullsized":"2024-05-08T20:54:32.408414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'767","reported_seq":809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.034026+0000","last_change":"2024-05-08T20:54:52.034318+0000","last_active":"2024-05-08T20:54:52.034026+0000","last_peered":"2024-05-08T20:54:52.034026+0000","last_clean":"2024-05-08T20:54:52.034026+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:52.034026+0000","last_undegraded":"2024-05-08T20:54:52.034026+0000","last_fullsized":"2024-05-08T20:54:52.034026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'767","last_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_deep_scrub":"26'767","last_deep_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.033968+0000","objects_scrubbed":3,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.997884+0000","scrub_duration":0.095634259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185271+0000","last_change":"2024-05-08T20:27:18.906643+0000","last_active":"2024-05-08T20:54:43.185271+0000","last_peered":"2024-05-08T20:54:43.185271+0000","last_clean":"2024-05-08T20:54:43.185271+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:54:43.185271+0000","last_undegraded":"2024-05-08T20:54:43.185271+0000","last_fullsized":"2024-05-08T20:54:43.185271+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.318767+0000","last_change":"2024-05-08T20:54:58.319009+0000","last_active":"2024-05-08T20:54:58.318767+0000","last_peered":"2024-05-08T20:54:58.318767+0000","last_clean":"2024-05-08T20:54:58.318767+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:58.318767+0000","last_undegraded":"2024-05-08T20:54:58.318767+0000","last_fullsized":"2024-05-08T20:54:58.318767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.318713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:57.774502+0000","scrub_duration":0.0077592889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.176748+0000","last_change":"2024-05-08T20:27:28.001541+0000","last_active":"2024-05-08T20:54:33.176748+0000","last_peered":"2024-05-08T20:54:33.176748+0000","last_clean":"2024-05-08T20:54:33.176748+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:54:33.176748+0000","last_undegraded":"2024-05-08T20:54:33.176748+0000","last_fullsized":"2024-05-08T20:54:33.176748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185109+0000","last_change":"2024-05-08T20:27:18.516045+0000","last_active":"2024-05-08T20:54:43.185109+0000","last_peered":"2024-05-08T20:54:43.185109+0000","last_clean":"2024-05-08T20:54:43.185109+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:54:43.185109+0000","last_undegraded":"2024-05-08T20:54:43.185109+0000","last_fullsized":"2024-05-08T20:54:43.185109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.962764+0000","last_change":"2024-05-08T20:55:21.962980+0000","last_active":"2024-05-08T20:55:21.962764+0000","last_peered":"2024-05-08T20:55:21.962764+0000","last_clean":"2024-05-08T20:55:21.962764+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:55:21.962764+0000","last_undegraded":"2024-05-08T20:55:21.962764+0000","last_fullsized":"2024-05-08T20:55:21.962764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.962709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:06.689855+0000","scrub_duration":0.0035857630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976543+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:44.976543+0000","last_peered":"2024-05-08T20:54:44.976543+0000","last_clean":"2024-05-08T20:54:44.976543+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:44.976543+0000","last_undegraded":"2024-05-08T20:54:44.976543+0000","last_fullsized":"2024-05-08T20:54:44.976543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975997+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:54:44.975997+0000","last_peered":"2024-05-08T20:54:44.975997+0000","last_clean":"2024-05-08T20:54:44.975997+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:54:44.975997+0000","last_undegraded":"2024-05-08T20:54:44.975997+0000","last_fullsized":"2024-05-08T20:54:44.975997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.217320+0000","last_change":"2024-05-08T20:54:58.217575+0000","last_active":"2024-05-08T20:54:58.217320+0000","last_peered":"2024-05-08T20:54:58.217320+0000","last_clean":"2024-05-08T20:54:58.217320+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:58.217320+0000","last_undegraded":"2024-05-08T20:54:58.217320+0000","last_fullsized":"2024-05-08T20:54:58.217320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.217264+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:04.029681+0000","scrub_duration":0.019522241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'619","reported_seq":655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.174972+0000","last_change":"2024-05-08T20:54:55.174972+0000","last_active":"2024-05-08T20:54:55.174972+0000","last_peered":"2024-05-08T20:54:55.174972+0000","last_clean":"2024-05-08T20:54:55.174972+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:55.174972+0000","last_undegraded":"2024-05-08T20:54:55.174972+0000","last_fullsized":"2024-05-08T20:54:55.174972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'619","last_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_deep_scrub":"26'619","last_deep_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.174692+0000","objects_scrubbed":1,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:43.612782+0000","scrub_duration":0.059475472000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.147415+0000","last_change":"2024-05-08T20:55:11.147679+0000","last_active":"2024-05-08T20:55:11.147415+0000","last_peered":"2024-05-08T20:55:11.147415+0000","last_clean":"2024-05-08T20:55:11.147415+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:55:11.147415+0000","last_undegraded":"2024-05-08T20:55:11.147415+0000","last_fullsized":"2024-05-08T20:55:11.147415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3818","last_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_deep_scrub":"26'3818","last_deep_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.147361+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:52.832177+0000","scrub_duration":0.046126465999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975822+0000","last_change":"2024-05-08T20:27:18.533266+0000","last_active":"2024-05-08T20:54:44.975822+0000","last_peered":"2024-05-08T20:54:44.975822+0000","last_clean":"2024-05-08T20:54:44.975822+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:54:44.975822+0000","last_undegraded":"2024-05-08T20:54:44.975822+0000","last_fullsized":"2024-05-08T20:54:44.975822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.186266+0000","last_change":"2024-05-08T20:54:51.186266+0000","last_active":"2024-05-08T20:54:51.186266+0000","last_peered":"2024-05-08T20:54:51.186266+0000","last_clean":"2024-05-08T20:54:51.186266+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:51.186266+0000","last_undegraded":"2024-05-08T20:54:51.186266+0000","last_fullsized":"2024-05-08T20:54:51.186266+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6790","last_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_deep_scrub":"26'6790","last_deep_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.185945+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:12.471228+0000","scrub_duration":0.025898879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.145576+0000","last_change":"2024-05-08T20:54:52.145576+0000","last_active":"2024-05-08T20:54:52.145576+0000","last_peered":"2024-05-08T20:54:52.145576+0000","last_clean":"2024-05-08T20:54:52.145576+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:52.145576+0000","last_undegraded":"2024-05-08T20:54:52.145576+0000","last_fullsized":"2024-05-08T20:54:52.145576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.145299+0000","objects_scrubbed":1,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:17.689064+0000","scrub_duration":0.013037381000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4687,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.257629+0000","last_change":"2024-05-08T20:27:28.015753+0000","last_active":"2024-05-08T20:54:33.257629+0000","last_peered":"2024-05-08T20:54:33.257629+0000","last_clean":"2024-05-08T20:54:33.257629+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:54:33.257629+0000","last_undegraded":"2024-05-08T20:54:33.257629+0000","last_fullsized":"2024-05-08T20:54:33.257629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.575780+0000","last_change":"2024-05-08T20:55:08.576011+0000","last_active":"2024-05-08T20:55:08.575780+0000","last_peered":"2024-05-08T20:55:08.575780+0000","last_clean":"2024-05-08T20:55:08.575780+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:55:08.575780+0000","last_undegraded":"2024-05-08T20:55:08.575780+0000","last_fullsized":"2024-05-08T20:55:08.575780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5323","last_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_deep_scrub":"26'5323","last_deep_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.575724+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:03.281285+0000","scrub_duration":0.015670814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1105","reported_seq":1135,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:20.708466+0000","last_change":"2024-05-08T20:27:18.542056+0000","last_active":"2024-05-08T20:54:20.708466+0000","last_peered":"2024-05-08T20:54:20.708466+0000","last_clean":"2024-05-08T20:54:20.708466+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:54:20.708466+0000","last_undegraded":"2024-05-08T20:54:20.708466+0000","last_fullsized":"2024-05-08T20:54:20.708466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.298281+0000","last_change":"2024-05-08T20:54:46.298581+0000","last_active":"2024-05-08T20:54:46.298281+0000","last_peered":"2024-05-08T20:54:46.298281+0000","last_clean":"2024-05-08T20:54:46.298281+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:46.298281+0000","last_undegraded":"2024-05-08T20:54:46.298281+0000","last_fullsized":"2024-05-08T20:54:46.298281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.298228+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:28.684882+0000","scrub_duration":0.047052471999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.551738+0000","last_change":"2024-05-08T20:55:08.552011+0000","last_active":"2024-05-08T20:55:08.551738+0000","last_peered":"2024-05-08T20:55:08.551738+0000","last_clean":"2024-05-08T20:55:08.551738+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:55:08.551738+0000","last_undegraded":"2024-05-08T20:55:08.551738+0000","last_fullsized":"2024-05-08T20:55:08.551738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4342","last_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_deep_scrub":"26'4342","last_deep_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.551682+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:49.967545+0000","scrub_duration":0.065785658999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4791,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.804571+0000","last_change":"2024-05-08T20:27:18.890581+0000","last_active":"2024-05-08T20:54:21.804571+0000","last_peered":"2024-05-08T20:54:21.804571+0000","last_clean":"2024-05-08T20:54:21.804571+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:54:21.804571+0000","last_undegraded":"2024-05-08T20:54:21.804571+0000","last_fullsized":"2024-05-08T20:54:21.804571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.642090+0000","last_change":"2024-05-08T20:55:14.642343+0000","last_active":"2024-05-08T20:55:14.642090+0000","last_peered":"2024-05-08T20:55:14.642090+0000","last_clean":"2024-05-08T20:55:14.642090+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:55:14.642090+0000","last_undegraded":"2024-05-08T20:55:14.642090+0000","last_fullsized":"2024-05-08T20:55:14.642090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.642037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:30.640727+0000","scrub_duration":0.0074746580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.127560+0000","last_change":"2024-05-08T20:54:59.127778+0000","last_active":"2024-05-08T20:54:59.127560+0000","last_peered":"2024-05-08T20:54:59.127560+0000","last_clean":"2024-05-08T20:54:59.127560+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:59.127560+0000","last_undegraded":"2024-05-08T20:54:59.127560+0000","last_fullsized":"2024-05-08T20:54:59.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.127504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:30.421435+0000","scrub_duration":0.0034702330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3464,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443985+0000","last_change":"2024-05-08T20:27:28.016396+0000","last_active":"2024-05-08T20:54:34.443985+0000","last_peered":"2024-05-08T20:54:34.443985+0000","last_clean":"2024-05-08T20:54:34.443985+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:54:34.443985+0000","last_undegraded":"2024-05-08T20:54:34.443985+0000","last_fullsized":"2024-05-08T20:54:34.443985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.793803+0000","last_change":"2024-05-08T20:27:18.884305+0000","last_active":"2024-05-08T20:54:21.793803+0000","last_peered":"2024-05-08T20:54:21.793803+0000","last_clean":"2024-05-08T20:54:21.793803+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:54:21.793803+0000","last_undegraded":"2024-05-08T20:54:21.793803+0000","last_fullsized":"2024-05-08T20:54:21.793803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.670974+0000","last_change":"2024-05-08T20:55:13.671190+0000","last_active":"2024-05-08T20:55:13.670974+0000","last_peered":"2024-05-08T20:55:13.670974+0000","last_clean":"2024-05-08T20:55:13.670974+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:55:13.670974+0000","last_undegraded":"2024-05-08T20:55:13.670974+0000","last_fullsized":"2024-05-08T20:55:13.670974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.670918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:25.637941+0000","scrub_duration":0.0076373999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.870480+0000","last_change":"2024-05-08T20:54:56.870718+0000","last_active":"2024-05-08T20:54:56.870480+0000","last_peered":"2024-05-08T20:54:56.870480+0000","last_clean":"2024-05-08T20:54:56.870480+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:56.870480+0000","last_undegraded":"2024-05-08T20:54:56.870480+0000","last_fullsized":"2024-05-08T20:54:56.870480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.870433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:43.134102+0000","scrub_duration":0.054762970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5796,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.968995+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:40.968995+0000","last_peered":"2024-05-08T20:54:40.968995+0000","last_clean":"2024-05-08T20:54:40.968995+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:40.968995+0000","last_undegraded":"2024-05-08T20:54:40.968995+0000","last_fullsized":"2024-05-08T20:54:40.968995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4708,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.863333+0000","last_change":"2024-05-08T20:55:11.863669+0000","last_active":"2024-05-08T20:55:11.863333+0000","last_peered":"2024-05-08T20:55:11.863333+0000","last_clean":"2024-05-08T20:55:11.863333+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:55:11.863333+0000","last_undegraded":"2024-05-08T20:55:11.863333+0000","last_fullsized":"2024-05-08T20:55:11.863333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4668","last_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_deep_scrub":"26'4668","last_deep_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.863229+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:40.887182+0000","scrub_duration":0.013718674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:25.584701+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:53:25.584701+0000","last_peered":"2024-05-08T20:53:25.584701+0000","last_clean":"2024-05-08T20:53:25.584701+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:53:25.584701+0000","last_undegraded":"2024-05-08T20:53:25.584701+0000","last_fullsized":"2024-05-08T20:53:25.584701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.185941+0000","last_change":"2024-05-08T20:54:44.186218+0000","last_active":"2024-05-08T20:54:44.185941+0000","last_peered":"2024-05-08T20:54:44.185941+0000","last_clean":"2024-05-08T20:54:44.185941+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:44.185941+0000","last_undegraded":"2024-05-08T20:54:44.185941+0000","last_fullsized":"2024-05-08T20:54:44.185941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_clean_scrub_stamp":"2024-05-08T20:54:44.185881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:49.152153+0000","scrub_duration":0.0071163260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.468674+0000","last_change":"2024-05-08T20:55:14.468990+0000","last_active":"2024-05-08T20:55:14.468674+0000","last_peered":"2024-05-08T20:55:14.468674+0000","last_clean":"2024-05-08T20:55:14.468674+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:55:14.468674+0000","last_undegraded":"2024-05-08T20:55:14.468674+0000","last_fullsized":"2024-05-08T20:55:14.468674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3392","last_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_deep_scrub":"26'3392","last_deep_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.468610+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:17.529243+0000","scrub_duration":0.100340728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6051,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.042883+0000","last_change":"2024-05-08T20:54:59.043067+0000","last_active":"2024-05-08T20:54:59.042883+0000","last_peered":"2024-05-08T20:54:59.042883+0000","last_clean":"2024-05-08T20:54:59.042883+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:59.042883+0000","last_undegraded":"2024-05-08T20:54:59.042883+0000","last_fullsized":"2024-05-08T20:54:59.042883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6011","last_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_deep_scrub":"26'6011","last_deep_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.042843+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:03.715065+0000","scrub_duration":0.062194480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.549690+0000","last_change":"2024-05-08T20:54:55.549940+0000","last_active":"2024-05-08T20:54:55.549690+0000","last_peered":"2024-05-08T20:54:55.549690+0000","last_clean":"2024-05-08T20:54:55.549690+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:54:55.549690+0000","last_undegraded":"2024-05-08T20:54:55.549690+0000","last_fullsized":"2024-05-08T20:54:55.549690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.549635+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:30.768311+0000","scrub_duration":0.012030836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'65","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.950830+0000","last_change":"2024-05-08T20:55:22.951068+0000","last_active":"2024-05-08T20:55:22.950830+0000","last_peered":"2024-05-08T20:55:22.950830+0000","last_clean":"2024-05-08T20:55:22.950830+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:55:22.950830+0000","last_undegraded":"2024-05-08T20:55:22.950830+0000","last_fullsized":"2024-05-08T20:55:22.950830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.950775+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:09.874263+0000","scrub_duration":0.0069395639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443668+0000","last_change":"2024-05-08T20:27:28.010700+0000","last_active":"2024-05-08T20:54:34.443668+0000","last_peered":"2024-05-08T20:54:34.443668+0000","last_clean":"2024-05-08T20:54:34.443668+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:54:34.443668+0000","last_undegraded":"2024-05-08T20:54:34.443668+0000","last_fullsized":"2024-05-08T20:54:34.443668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4707,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.222496+0000","last_change":"2024-05-08T20:55:20.222714+0000","last_active":"2024-05-08T20:55:20.222496+0000","last_peered":"2024-05-08T20:55:20.222496+0000","last_clean":"2024-05-08T20:55:20.222496+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:55:20.222496+0000","last_undegraded":"2024-05-08T20:55:20.222496+0000","last_fullsized":"2024-05-08T20:55:20.222496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.222435+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:22.265649+0000","scrub_duration":0.010318590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'255","reported_seq":296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.700135+0000","last_change":"2024-05-08T20:55:11.700383+0000","last_active":"2024-05-08T20:55:11.700135+0000","last_peered":"2024-05-08T20:55:11.700135+0000","last_clean":"2024-05-08T20:55:11.700135+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:55:11.700135+0000","last_undegraded":"2024-05-08T20:55:11.700135+0000","last_fullsized":"2024-05-08T20:55:11.700135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'255","last_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_deep_scrub":"26'255","last_deep_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.700078+0000","objects_scrubbed":1,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:05.942160+0000","scrub_duration":0.012718293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.476196+0000","last_change":"2024-05-08T20:55:09.476447+0000","last_active":"2024-05-08T20:55:09.476196+0000","last_peered":"2024-05-08T20:55:09.476196+0000","last_clean":"2024-05-08T20:55:09.476196+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:55:09.476196+0000","last_undegraded":"2024-05-08T20:55:09.476196+0000","last_fullsized":"2024-05-08T20:55:09.476196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.476143+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:20.326575+0000","scrub_duration":0.0053068539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922628+0000","last_change":"2024-05-08T20:27:27.982368+0000","last_active":"2024-05-08T20:54:37.922628+0000","last_peered":"2024-05-08T20:54:37.922628+0000","last_clean":"2024-05-08T20:54:37.922628+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:54:37.922628+0000","last_undegraded":"2024-05-08T20:54:37.922628+0000","last_fullsized":"2024-05-08T20:54:37.922628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6877,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.661513+0000","last_change":"2024-05-08T20:55:20.661789+0000","last_active":"2024-05-08T20:55:20.661513+0000","last_peered":"2024-05-08T20:55:20.661513+0000","last_clean":"2024-05-08T20:55:20.661513+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:55:20.661513+0000","last_undegraded":"2024-05-08T20:55:20.661513+0000","last_fullsized":"2024-05-08T20:55:20.661513+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6836","last_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_deep_scrub":"26'6836","last_deep_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.661466+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.019245+0000","scrub_duration":0.046721182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:35.712011+0000","last_change":"2024-05-08T20:27:18.528417+0000","last_active":"2024-05-08T20:54:35.712011+0000","last_peered":"2024-05-08T20:54:35.712011+0000","last_clean":"2024-05-08T20:54:35.712011+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:54:35.712011+0000","last_undegraded":"2024-05-08T20:54:35.712011+0000","last_fullsized":"2024-05-08T20:54:35.712011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.016256+0000","last_change":"2024-05-08T20:55:07.016519+0000","last_active":"2024-05-08T20:55:07.016256+0000","last_peered":"2024-05-08T20:55:07.016256+0000","last_clean":"2024-05-08T20:55:07.016256+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:55:07.016256+0000","last_undegraded":"2024-05-08T20:55:07.016256+0000","last_fullsized":"2024-05-08T20:55:07.016256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.016198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:21.537191+0000","scrub_duration":0.034043589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4660,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.044003+0000","last_change":"2024-05-08T20:55:18.044138+0000","last_active":"2024-05-08T20:55:18.044003+0000","last_peered":"2024-05-08T20:55:18.044003+0000","last_clean":"2024-05-08T20:55:18.044003+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:55:18.044003+0000","last_undegraded":"2024-05-08T20:55:18.044003+0000","last_fullsized":"2024-05-08T20:55:18.044003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4623","last_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_deep_scrub":"26'4623","last_deep_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.043977+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:18.907698+0000","scrub_duration":0.113151719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.149350+0000","last_change":"2024-05-08T20:54:50.149623+0000","last_active":"2024-05-08T20:54:50.149350+0000","last_peered":"2024-05-08T20:54:50.149350+0000","last_clean":"2024-05-08T20:54:50.149350+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:50.149350+0000","last_undegraded":"2024-05-08T20:54:50.149350+0000","last_fullsized":"2024-05-08T20:54:50.149350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4622","last_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_deep_scrub":"26'4622","last_deep_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.149296+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:43.672383+0000","scrub_duration":0.028645501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.677449+0000","last_change":"2024-05-08T20:55:09.677733+0000","last_active":"2024-05-08T20:55:09.677449+0000","last_peered":"2024-05-08T20:55:09.677449+0000","last_clean":"2024-05-08T20:55:09.677449+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:55:09.677449+0000","last_undegraded":"2024-05-08T20:55:09.677449+0000","last_fullsized":"2024-05-08T20:55:09.677449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.677387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:52.277246+0000","scrub_duration":0.0096814850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.802099+0000","last_change":"2024-05-08T20:54:45.802328+0000","last_active":"2024-05-08T20:54:45.802099+0000","last_peered":"2024-05-08T20:54:45.802099+0000","last_clean":"2024-05-08T20:54:45.802099+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:45.802099+0000","last_undegraded":"2024-05-08T20:54:45.802099+0000","last_fullsized":"2024-05-08T20:54:45.802099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.802044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:29.693595+0000","scrub_duration":0.0040510620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.092766+0000","last_change":"2024-05-08T20:55:22.093023+0000","last_active":"2024-05-08T20:55:22.092766+0000","last_peered":"2024-05-08T20:55:22.092766+0000","last_clean":"2024-05-08T20:55:22.092766+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:55:22.092766+0000","last_undegraded":"2024-05-08T20:55:22.092766+0000","last_fullsized":"2024-05-08T20:55:22.092766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4079","last_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_deep_scrub":"26'4079","last_deep_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.092719+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:36.160004+0000","scrub_duration":0.119144502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.951072+0000","last_change":"2024-05-08T20:55:15.951284+0000","last_active":"2024-05-08T20:55:15.951072+0000","last_peered":"2024-05-08T20:55:15.951072+0000","last_clean":"2024-05-08T20:55:15.951072+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:55:15.951072+0000","last_undegraded":"2024-05-08T20:55:15.951072+0000","last_fullsized":"2024-05-08T20:55:15.951072+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5879","last_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_deep_scrub":"26'5879","last_deep_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.951022+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:30.374831+0000","scrub_duration":0.045408759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:25.965330+0000","last_change":"2024-05-08T20:27:18.520868+0000","last_active":"2024-05-08T20:54:25.965330+0000","last_peered":"2024-05-08T20:54:25.965330+0000","last_clean":"2024-05-08T20:54:25.965330+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:54:25.965330+0000","last_undegraded":"2024-05-08T20:54:25.965330+0000","last_fullsized":"2024-05-08T20:54:25.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.723537+0000","last_change":"2024-05-08T20:54:43.723653+0000","last_active":"2024-05-08T20:54:43.723537+0000","last_peered":"2024-05-08T20:54:43.723537+0000","last_clean":"2024-05-08T20:54:43.723537+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:43.723537+0000","last_undegraded":"2024-05-08T20:54:43.723537+0000","last_fullsized":"2024-05-08T20:54:43.723537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.723507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:06.949102+0000","scrub_duration":0.001729041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.506093+0000","last_change":"2024-05-08T20:55:06.506331+0000","last_active":"2024-05-08T20:55:06.506093+0000","last_peered":"2024-05-08T20:55:06.506093+0000","last_clean":"2024-05-08T20:55:06.506093+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:55:06.506093+0000","last_undegraded":"2024-05-08T20:55:06.506093+0000","last_fullsized":"2024-05-08T20:55:06.506093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.506041+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:14.298193+0000","scrub_duration":0.090320424999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.609510+0000","last_change":"2024-05-08T20:55:17.609510+0000","last_active":"2024-05-08T20:55:17.609510+0000","last_peered":"2024-05-08T20:55:17.609510+0000","last_clean":"2024-05-08T20:55:17.609510+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:55:17.609510+0000","last_undegraded":"2024-05-08T20:55:17.609510+0000","last_fullsized":"2024-05-08T20:55:17.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4755","last_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_deep_scrub":"26'4755","last_deep_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.609211+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.114442+0000","scrub_duration":0.021058222000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'73","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.584883+0000","last_change":"2024-05-08T20:54:47.585094+0000","last_active":"2024-05-08T20:54:47.584883+0000","last_peered":"2024-05-08T20:54:47.584883+0000","last_clean":"2024-05-08T20:54:47.584883+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:47.584883+0000","last_undegraded":"2024-05-08T20:54:47.584883+0000","last_fullsized":"2024-05-08T20:54:47.584883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.584829+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.762899+0000","scrub_duration":0.021519024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'10","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.757952+0000","last_change":"2024-05-08T20:54:48.758169+0000","last_active":"2024-05-08T20:54:48.757952+0000","last_peered":"2024-05-08T20:54:48.757952+0000","last_clean":"2024-05-08T20:54:48.757952+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:48.757952+0000","last_undegraded":"2024-05-08T20:54:48.757952+0000","last_fullsized":"2024-05-08T20:54:48.757952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.757894+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:28.411623+0000","scrub_duration":0.026700504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.375294+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:32.375294+0000","last_peered":"2024-05-08T20:54:32.375294+0000","last_clean":"2024-05-08T20:54:32.375294+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:32.375294+0000","last_undegraded":"2024-05-08T20:54:32.375294+0000","last_fullsized":"2024-05-08T20:54:32.375294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":5008,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.005590+0000","last_change":"2024-05-08T20:54:55.005875+0000","last_active":"2024-05-08T20:54:55.005590+0000","last_peered":"2024-05-08T20:54:55.005590+0000","last_clean":"2024-05-08T20:54:55.005590+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:55.005590+0000","last_undegraded":"2024-05-08T20:54:55.005590+0000","last_fullsized":"2024-05-08T20:54:55.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4967","last_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_deep_scrub":"26'4967","last_deep_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.005533+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:32.459770+0000","scrub_duration":0.055935091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:30.610927+0000","last_change":"2024-05-08T20:27:18.522133+0000","last_active":"2024-05-08T20:53:30.610927+0000","last_peered":"2024-05-08T20:53:30.610927+0000","last_clean":"2024-05-08T20:53:30.610927+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:53:30.610927+0000","last_undegraded":"2024-05-08T20:53:30.610927+0000","last_fullsized":"2024-05-08T20:53:30.610927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'277","reported_seq":314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.959100+0000","last_change":"2024-05-08T20:55:07.959319+0000","last_active":"2024-05-08T20:55:07.959100+0000","last_peered":"2024-05-08T20:55:07.959100+0000","last_clean":"2024-05-08T20:55:07.959100+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:55:07.959100+0000","last_undegraded":"2024-05-08T20:55:07.959100+0000","last_fullsized":"2024-05-08T20:55:07.959100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.959046+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:19.805541+0000","scrub_duration":0.0082517920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713107+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:40.713107+0000","last_peered":"2024-05-08T20:54:40.713107+0000","last_clean":"2024-05-08T20:54:40.713107+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:40.713107+0000","last_undegraded":"2024-05-08T20:54:40.713107+0000","last_fullsized":"2024-05-08T20:54:40.713107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5100,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:28.850643+0000","last_change":"2024-05-08T20:27:18.928772+0000","last_active":"2024-05-08T20:54:28.850643+0000","last_peered":"2024-05-08T20:54:28.850643+0000","last_clean":"2024-05-08T20:54:28.850643+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:54:28.850643+0000","last_undegraded":"2024-05-08T20:54:28.850643+0000","last_fullsized":"2024-05-08T20:54:28.850643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.966519+0000","last_change":"2024-05-08T20:27:18.522551+0000","last_active":"2024-05-08T20:54:30.966519+0000","last_peered":"2024-05-08T20:54:30.966519+0000","last_clean":"2024-05-08T20:54:30.966519+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:54:30.966519+0000","last_undegraded":"2024-05-08T20:54:30.966519+0000","last_fullsized":"2024-05-08T20:54:30.966519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975717+0000","last_change":"2024-05-08T20:27:08.443846+0000","last_active":"2024-05-08T20:54:44.975717+0000","last_peered":"2024-05-08T20:54:44.975717+0000","last_clean":"2024-05-08T20:54:44.975717+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:54:44.975717+0000","last_undegraded":"2024-05-08T20:54:44.975717+0000","last_fullsized":"2024-05-08T20:54:44.975717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:07.421269+0000","last_clean_scrub_stamp":"2024-05-08T20:27:07.421269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.523201+0000","last_change":"2024-05-08T20:55:17.523419+0000","last_active":"2024-05-08T20:55:17.523201+0000","last_peered":"2024-05-08T20:55:17.523201+0000","last_clean":"2024-05-08T20:55:17.523201+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:55:17.523201+0000","last_undegraded":"2024-05-08T20:55:17.523201+0000","last_fullsized":"2024-05-08T20:55:17.523201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.523147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:26.971511+0000","scrub_duration":0.0037874789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.561694+0000","last_change":"2024-05-08T20:55:09.561956+0000","last_active":"2024-05-08T20:55:09.561694+0000","last_peered":"2024-05-08T20:55:09.561694+0000","last_clean":"2024-05-08T20:55:09.561694+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:55:09.561694+0000","last_undegraded":"2024-05-08T20:55:09.561694+0000","last_fullsized":"2024-05-08T20:55:09.561694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3754","last_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_deep_scrub":"26'3754","last_deep_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.561619+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.309817+0000","scrub_duration":0.072311814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.675660+0000","last_change":"2024-05-08T20:54:59.675908+0000","last_active":"2024-05-08T20:54:59.675660+0000","last_peered":"2024-05-08T20:54:59.675660+0000","last_clean":"2024-05-08T20:54:59.675660+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:59.675660+0000","last_undegraded":"2024-05-08T20:54:59.675660+0000","last_fullsized":"2024-05-08T20:54:59.675660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5554","last_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_deep_scrub":"26'5554","last_deep_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.675603+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:25.048100+0000","scrub_duration":0.019361314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.490516+0000","last_change":"2024-05-08T20:54:54.490784+0000","last_active":"2024-05-08T20:54:54.490516+0000","last_peered":"2024-05-08T20:54:54.490516+0000","last_clean":"2024-05-08T20:54:54.490516+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:54.490516+0000","last_undegraded":"2024-05-08T20:54:54.490516+0000","last_fullsized":"2024-05-08T20:54:54.490516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.490464+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:32.933174+0000","scrub_duration":0.0037125420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.536854+0000","last_change":"2024-05-08T20:55:11.537068+0000","last_active":"2024-05-08T20:55:11.536854+0000","last_peered":"2024-05-08T20:55:11.536854+0000","last_clean":"2024-05-08T20:55:11.536854+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:55:11.536854+0000","last_undegraded":"2024-05-08T20:55:11.536854+0000","last_fullsized":"2024-05-08T20:55:11.536854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.536797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:00.377575+0000","scrub_duration":0.0033698030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.521164+0000","last_change":"2024-05-08T20:55:07.521421+0000","last_active":"2024-05-08T20:55:07.521164+0000","last_peered":"2024-05-08T20:55:07.521164+0000","last_clean":"2024-05-08T20:55:07.521164+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:55:07.521164+0000","last_undegraded":"2024-05-08T20:55:07.521164+0000","last_fullsized":"2024-05-08T20:55:07.521164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4012","last_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_deep_scrub":"26'4012","last_deep_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.521110+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:03.444633+0000","scrub_duration":0.063926325000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5635,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.501804+0000","last_change":"2024-05-08T20:55:16.502074+0000","last_active":"2024-05-08T20:55:16.501804+0000","last_peered":"2024-05-08T20:55:16.501804+0000","last_clean":"2024-05-08T20:55:16.501804+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:55:16.501804+0000","last_undegraded":"2024-05-08T20:55:16.501804+0000","last_fullsized":"2024-05-08T20:55:16.501804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5601","last_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_deep_scrub":"26'5601","last_deep_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.501744+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:36.883976+0000","scrub_duration":0.012783813,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'7","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:12.704523+0000","last_change":"2024-05-08T20:55:12.704754+0000","last_active":"2024-05-08T20:55:12.704523+0000","last_peered":"2024-05-08T20:55:12.704523+0000","last_clean":"2024-05-08T20:55:12.704523+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:55:12.704523+0000","last_undegraded":"2024-05-08T20:55:12.704523+0000","last_fullsized":"2024-05-08T20:55:12.704523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_clean_scrub_stamp":"2024-05-08T20:55:12.704463+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:16.190314+0000","scrub_duration":0.023886415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1138","reported_seq":1175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.063954+0000","last_change":"2024-05-08T20:55:09.064235+0000","last_active":"2024-05-08T20:55:09.063954+0000","last_peered":"2024-05-08T20:55:09.063954+0000","last_clean":"2024-05-08T20:55:09.063954+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:55:09.063954+0000","last_undegraded":"2024-05-08T20:55:09.063954+0000","last_fullsized":"2024-05-08T20:55:09.063954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1138","last_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_deep_scrub":"26'1138","last_deep_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.063899+0000","objects_scrubbed":2,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:52.567416+0000","scrub_duration":0.080673476999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.370332+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:32.370332+0000","last_peered":"2024-05-08T20:54:32.370332+0000","last_clean":"2024-05-08T20:54:32.370332+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:32.370332+0000","last_undegraded":"2024-05-08T20:54:32.370332+0000","last_fullsized":"2024-05-08T20:54:32.370332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.820930+0000","last_change":"2024-05-08T20:55:24.821157+0000","last_active":"2024-05-08T20:55:24.820930+0000","last_peered":"2024-05-08T20:55:24.820930+0000","last_clean":"2024-05-08T20:55:24.820930+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:55:24.820930+0000","last_undegraded":"2024-05-08T20:55:24.820930+0000","last_fullsized":"2024-05-08T20:55:24.820930+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7221","last_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_deep_scrub":"26'7221","last_deep_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.820875+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:12.961351+0000","scrub_duration":0.011508404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.541242+0000","last_change":"2024-05-08T20:54:46.541548+0000","last_active":"2024-05-08T20:54:46.541242+0000","last_peered":"2024-05-08T20:54:46.541242+0000","last_clean":"2024-05-08T20:54:46.541242+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:46.541242+0000","last_undegraded":"2024-05-08T20:54:46.541242+0000","last_fullsized":"2024-05-08T20:54:46.541242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.541186+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:53.630432+0000","scrub_duration":0.014769915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.201747+0000","last_change":"2024-05-08T20:54:55.201979+0000","last_active":"2024-05-08T20:54:55.201747+0000","last_peered":"2024-05-08T20:54:55.201747+0000","last_clean":"2024-05-08T20:54:55.201747+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:55.201747+0000","last_undegraded":"2024-05-08T20:54:55.201747+0000","last_fullsized":"2024-05-08T20:54:55.201747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.201695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:39.510474+0000","scrub_duration":0.0064570130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3762,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.650008+0000","last_change":"2024-05-08T20:54:45.650155+0000","last_active":"2024-05-08T20:54:45.650008+0000","last_peered":"2024-05-08T20:54:45.650008+0000","last_clean":"2024-05-08T20:54:45.650008+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:45.650008+0000","last_undegraded":"2024-05-08T20:54:45.650008+0000","last_fullsized":"2024-05-08T20:54:45.650008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3726","last_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_deep_scrub":"26'3726","last_deep_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.649980+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:59.522800+0000","scrub_duration":0.11612742700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.738096+0000","last_change":"2024-05-08T20:55:21.738325+0000","last_active":"2024-05-08T20:55:21.738096+0000","last_peered":"2024-05-08T20:55:21.738096+0000","last_clean":"2024-05-08T20:55:21.738096+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:55:21.738096+0000","last_undegraded":"2024-05-08T20:55:21.738096+0000","last_fullsized":"2024-05-08T20:55:21.738096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4502","last_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_deep_scrub":"26'4502","last_deep_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.738039+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:43.638169+0000","scrub_duration":0.011148622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.196680+0000","last_change":"2024-05-08T20:55:03.196899+0000","last_active":"2024-05-08T20:55:03.196680+0000","last_peered":"2024-05-08T20:55:03.196680+0000","last_clean":"2024-05-08T20:55:03.196680+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:55:03.196680+0000","last_undegraded":"2024-05-08T20:55:03.196680+0000","last_fullsized":"2024-05-08T20:55:03.196680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.196622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:49.285017+0000","scrub_duration":0.017642686000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.240218+0000","last_change":"2024-05-08T20:54:48.240489+0000","last_active":"2024-05-08T20:54:48.240218+0000","last_peered":"2024-05-08T20:54:48.240218+0000","last_clean":"2024-05-08T20:54:48.240218+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:48.240218+0000","last_undegraded":"2024-05-08T20:54:48.240218+0000","last_fullsized":"2024-05-08T20:54:48.240218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.240164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:57.651499+0000","scrub_duration":0.0039283549999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367383+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367383+0000","last_peered":"2024-05-08T20:54:32.367383+0000","last_clean":"2024-05-08T20:54:32.367383+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367383+0000","last_undegraded":"2024-05-08T20:54:32.367383+0000","last_fullsized":"2024-05-08T20:54:32.367383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:00.644023+0000","last_change":"2024-05-08T20:55:00.644023+0000","last_active":"2024-05-08T20:55:00.644023+0000","last_peered":"2024-05-08T20:55:00.644023+0000","last_clean":"2024-05-08T20:55:00.644023+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:55:00.644023+0000","last_undegraded":"2024-05-08T20:55:00.644023+0000","last_fullsized":"2024-05-08T20:55:00.644023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4877","last_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_deep_scrub":"26'4877","last_deep_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_clean_scrub_stamp":"2024-05-08T20:55:00.643679+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:46.199456+0000","scrub_duration":0.018174326000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'19","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.552614+0000","last_change":"2024-05-08T20:54:56.552614+0000","last_active":"2024-05-08T20:54:56.552614+0000","last_peered":"2024-05-08T20:54:56.552614+0000","last_clean":"2024-05-08T20:54:56.552614+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:56.552614+0000","last_undegraded":"2024-05-08T20:54:56.552614+0000","last_fullsized":"2024-05-08T20:54:56.552614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.552316+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:38.919551+0000","scrub_duration":0.016343099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.950947+0000","last_change":"2024-05-08T20:54:43.951036+0000","last_active":"2024-05-08T20:54:43.950947+0000","last_peered":"2024-05-08T20:54:43.950947+0000","last_clean":"2024-05-08T20:54:43.950947+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:43.950947+0000","last_undegraded":"2024-05-08T20:54:43.950947+0000","last_fullsized":"2024-05-08T20:54:43.950947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.950926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:21.719335+0000","scrub_duration":0.0015213539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4854,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382130+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382130+0000","last_peered":"2024-05-08T20:54:32.382130+0000","last_clean":"2024-05-08T20:54:32.382130+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382130+0000","last_undegraded":"2024-05-08T20:54:32.382130+0000","last_fullsized":"2024-05-08T20:54:32.382130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.624126+0000","last_change":"2024-05-08T20:55:05.624126+0000","last_active":"2024-05-08T20:55:05.624126+0000","last_peered":"2024-05-08T20:55:05.624126+0000","last_clean":"2024-05-08T20:55:05.624126+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:55:05.624126+0000","last_undegraded":"2024-05-08T20:55:05.624126+0000","last_fullsized":"2024-05-08T20:55:05.624126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4806","last_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_deep_scrub":"26'4806","last_deep_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.623784+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:05.299562+0000","scrub_duration":0.050542888000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:53.472321+0000","last_change":"2024-05-08T20:54:53.472321+0000","last_active":"2024-05-08T20:54:53.472321+0000","last_peered":"2024-05-08T20:54:53.472321+0000","last_clean":"2024-05-08T20:54:53.472321+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:54:53.472321+0000","last_undegraded":"2024-05-08T20:54:53.472321+0000","last_fullsized":"2024-05-08T20:54:53.472321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_clean_scrub_stamp":"2024-05-08T20:54:53.472031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:36.420711+0000","scrub_duration":0.0032315270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.416742+0000","last_change":"2024-05-08T20:55:01.416966+0000","last_active":"2024-05-08T20:55:01.416742+0000","last_peered":"2024-05-08T20:55:01.416742+0000","last_clean":"2024-05-08T20:55:01.416742+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:55:01.416742+0000","last_undegraded":"2024-05-08T20:55:01.416742+0000","last_fullsized":"2024-05-08T20:55:01.416742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.416687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:50.039785+0000","scrub_duration":0.038290926000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368953+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368953+0000","last_peered":"2024-05-08T20:54:32.368953+0000","last_clean":"2024-05-08T20:54:32.368953+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368953+0000","last_undegraded":"2024-05-08T20:54:32.368953+0000","last_fullsized":"2024-05-08T20:54:32.368953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6082,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975979+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:44.975979+0000","last_peered":"2024-05-08T20:54:44.975979+0000","last_clean":"2024-05-08T20:54:44.975979+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:44.975979+0000","last_undegraded":"2024-05-08T20:54:44.975979+0000","last_fullsized":"2024-05-08T20:54:44.975979+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:05.913868+0000","last_change":"2024-05-08T20:27:18.520506+0000","last_active":"2024-05-08T20:53:05.913868+0000","last_peered":"2024-05-08T20:53:05.913868+0000","last_clean":"2024-05-08T20:53:05.913868+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:53:05.913868+0000","last_undegraded":"2024-05-08T20:53:05.913868+0000","last_fullsized":"2024-05-08T20:53:05.913868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417324+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417324+0000","last_peered":"2024-05-08T20:54:43.417324+0000","last_clean":"2024-05-08T20:54:43.417324+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417324+0000","last_undegraded":"2024-05-08T20:54:43.417324+0000","last_fullsized":"2024-05-08T20:54:43.417324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.398395+0000","last_change":"2024-05-08T20:27:27.994136+0000","last_active":"2024-05-08T20:54:32.398395+0000","last_peered":"2024-05-08T20:54:32.398395+0000","last_clean":"2024-05-08T20:54:32.398395+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:54:32.398395+0000","last_undegraded":"2024-05-08T20:54:32.398395+0000","last_fullsized":"2024-05-08T20:54:32.398395+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.102627+0000","last_change":"2024-05-08T20:54:57.102627+0000","last_active":"2024-05-08T20:54:57.102627+0000","last_peered":"2024-05-08T20:54:57.102627+0000","last_clean":"2024-05-08T20:54:57.102627+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:57.102627+0000","last_undegraded":"2024-05-08T20:54:57.102627+0000","last_fullsized":"2024-05-08T20:54:57.102627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4707","last_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_deep_scrub":"26'4707","last_deep_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.102409+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:04.868854+0000","scrub_duration":0.064899769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.967329+0000","last_change":"2024-05-08T20:54:47.967329+0000","last_active":"2024-05-08T20:54:47.967329+0000","last_peered":"2024-05-08T20:54:47.967329+0000","last_clean":"2024-05-08T20:54:47.967329+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:54:47.967329+0000","last_undegraded":"2024-05-08T20:54:47.967329+0000","last_fullsized":"2024-05-08T20:54:47.967329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.967013+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:43.643764+0000","scrub_duration":0.019010636000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.135142+0000","last_change":"2024-05-08T20:55:01.135433+0000","last_active":"2024-05-08T20:55:01.135142+0000","last_peered":"2024-05-08T20:55:01.135142+0000","last_clean":"2024-05-08T20:55:01.135142+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:55:01.135142+0000","last_undegraded":"2024-05-08T20:55:01.135142+0000","last_fullsized":"2024-05-08T20:55:01.135142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.135090+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:17.529691+0000","scrub_duration":0.017716335999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.359445+0000","last_change":"2024-05-08T20:55:17.359712+0000","last_active":"2024-05-08T20:55:17.359445+0000","last_peered":"2024-05-08T20:55:17.359445+0000","last_clean":"2024-05-08T20:55:17.359445+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:55:17.359445+0000","last_undegraded":"2024-05-08T20:55:17.359445+0000","last_fullsized":"2024-05-08T20:55:17.359445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4311","last_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_deep_scrub":"26'4311","last_deep_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.359387+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:10.597732+0000","scrub_duration":0.071380895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.557391+0000","last_change":"2024-05-08T20:55:04.557627+0000","last_active":"2024-05-08T20:55:04.557391+0000","last_peered":"2024-05-08T20:55:04.557391+0000","last_clean":"2024-05-08T20:55:04.557391+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:55:04.557391+0000","last_undegraded":"2024-05-08T20:55:04.557391+0000","last_fullsized":"2024-05-08T20:55:04.557391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4308","last_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_deep_scrub":"26'4308","last_deep_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.557335+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:14.404320+0000","scrub_duration":0.013594441000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'376","reported_seq":416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.547036+0000","last_change":"2024-05-08T20:55:01.547300+0000","last_active":"2024-05-08T20:55:01.547036+0000","last_peered":"2024-05-08T20:55:01.547036+0000","last_clean":"2024-05-08T20:55:01.547036+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:55:01.547036+0000","last_undegraded":"2024-05-08T20:55:01.547036+0000","last_fullsized":"2024-05-08T20:55:01.547036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'376","last_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_deep_scrub":"26'376","last_deep_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.546976+0000","objects_scrubbed":4,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:51.672058+0000","scrub_duration":0.025240988999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.699953+0000","last_change":"2024-05-08T20:54:50.700173+0000","last_active":"2024-05-08T20:54:50.699953+0000","last_peered":"2024-05-08T20:54:50.699953+0000","last_clean":"2024-05-08T20:54:50.699953+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:50.699953+0000","last_undegraded":"2024-05-08T20:54:50.699953+0000","last_fullsized":"2024-05-08T20:54:50.699953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.699899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:25.302614+0000","scrub_duration":0.003656903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3966,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.325981+0000","last_change":"2024-05-08T20:27:28.001504+0000","last_active":"2024-05-08T20:54:32.325981+0000","last_peered":"2024-05-08T20:54:32.325981+0000","last_clean":"2024-05-08T20:54:32.325981+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:54:32.325981+0000","last_undegraded":"2024-05-08T20:54:32.325981+0000","last_fullsized":"2024-05-08T20:54:32.325981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.147116+0000","last_change":"2024-05-08T20:55:04.147116+0000","last_active":"2024-05-08T20:55:04.147116+0000","last_peered":"2024-05-08T20:55:04.147116+0000","last_clean":"2024-05-08T20:55:04.147116+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:55:04.147116+0000","last_undegraded":"2024-05-08T20:55:04.147116+0000","last_fullsized":"2024-05-08T20:55:04.147116+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6472","last_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_deep_scrub":"26'6472","last_deep_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.146808+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:26.755900+0000","scrub_duration":0.015729532000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'42","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.627876+0000","last_change":"2024-05-08T20:55:16.628190+0000","last_active":"2024-05-08T20:55:16.627876+0000","last_peered":"2024-05-08T20:55:16.627876+0000","last_clean":"2024-05-08T20:55:16.627876+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:55:16.627876+0000","last_undegraded":"2024-05-08T20:55:16.627876+0000","last_fullsized":"2024-05-08T20:55:16.627876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.627755+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:04.126022+0000","scrub_duration":0.018944094000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'9","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.249271+0000","last_change":"2024-05-08T20:54:45.249501+0000","last_active":"2024-05-08T20:54:45.249271+0000","last_peered":"2024-05-08T20:54:45.249271+0000","last_clean":"2024-05-08T20:54:45.249271+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:45.249271+0000","last_undegraded":"2024-05-08T20:54:45.249271+0000","last_fullsized":"2024-05-08T20:54:45.249271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.249216+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:16.617377+0000","scrub_duration":0.021333827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382777+0000","last_change":"2024-05-08T20:27:28.016710+0000","last_active":"2024-05-08T20:54:32.382777+0000","last_peered":"2024-05-08T20:54:32.382777+0000","last_clean":"2024-05-08T20:54:32.382777+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:54:32.382777+0000","last_undegraded":"2024-05-08T20:54:32.382777+0000","last_fullsized":"2024-05-08T20:54:32.382777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5293,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.082903+0000","last_change":"2024-05-08T20:55:05.083125+0000","last_active":"2024-05-08T20:55:05.082903+0000","last_peered":"2024-05-08T20:55:05.082903+0000","last_clean":"2024-05-08T20:55:05.082903+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:55:05.082903+0000","last_undegraded":"2024-05-08T20:55:05.082903+0000","last_fullsized":"2024-05-08T20:55:05.082903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5254","last_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_deep_scrub":"26'5254","last_deep_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.082849+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:08.613953+0000","scrub_duration":0.046904636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:53:55.944753+0000","last_change":"2024-05-08T20:27:18.532058+0000","last_active":"2024-05-08T20:53:55.944753+0000","last_peered":"2024-05-08T20:53:55.944753+0000","last_clean":"2024-05-08T20:53:55.944753+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:53:55.944753+0000","last_undegraded":"2024-05-08T20:53:55.944753+0000","last_fullsized":"2024-05-08T20:53:55.944753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'19","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.395438+0000","last_change":"2024-05-08T20:54:46.395653+0000","last_active":"2024-05-08T20:54:46.395438+0000","last_peered":"2024-05-08T20:54:46.395438+0000","last_clean":"2024-05-08T20:54:46.395438+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:46.395438+0000","last_undegraded":"2024-05-08T20:54:46.395438+0000","last_fullsized":"2024-05-08T20:54:46.395438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.395382+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:12.986179+0000","scrub_duration":0.011244446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976504+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:44.976504+0000","last_peered":"2024-05-08T20:54:44.976504+0000","last_clean":"2024-05-08T20:54:44.976504+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:44.976504+0000","last_undegraded":"2024-05-08T20:54:44.976504+0000","last_fullsized":"2024-05-08T20:54:44.976504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5987,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.801044+0000","last_change":"2024-05-08T20:27:18.929741+0000","last_active":"2024-05-08T20:54:21.801044+0000","last_peered":"2024-05-08T20:54:21.801044+0000","last_clean":"2024-05-08T20:54:21.801044+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:54:21.801044+0000","last_undegraded":"2024-05-08T20:54:21.801044+0000","last_fullsized":"2024-05-08T20:54:21.801044+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.579721+0000","last_change":"2024-05-08T20:55:04.579960+0000","last_active":"2024-05-08T20:55:04.579721+0000","last_peered":"2024-05-08T20:55:04.579721+0000","last_clean":"2024-05-08T20:55:04.579721+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:55:04.579721+0000","last_undegraded":"2024-05-08T20:55:04.579721+0000","last_fullsized":"2024-05-08T20:55:04.579721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.579663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.992226+0000","scrub_duration":0.010179356000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.362815+0000","last_change":"2024-05-08T20:55:06.363021+0000","last_active":"2024-05-08T20:55:06.362815+0000","last_peered":"2024-05-08T20:55:06.362815+0000","last_clean":"2024-05-08T20:55:06.362815+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:55:06.362815+0000","last_undegraded":"2024-05-08T20:55:06.362815+0000","last_fullsized":"2024-05-08T20:55:06.362815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.362763+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:52.398831+0000","scrub_duration":0.005099742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6614,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922840+0000","last_change":"2024-05-08T20:27:28.017315+0000","last_active":"2024-05-08T20:54:37.922840+0000","last_peered":"2024-05-08T20:54:37.922840+0000","last_clean":"2024-05-08T20:54:37.922840+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:54:37.922840+0000","last_undegraded":"2024-05-08T20:54:37.922840+0000","last_fullsized":"2024-05-08T20:54:37.922840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.929406+0000","last_change":"2024-05-08T20:55:11.929619+0000","last_active":"2024-05-08T20:55:11.929406+0000","last_peered":"2024-05-08T20:55:11.929406+0000","last_clean":"2024-05-08T20:55:11.929406+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:55:11.929406+0000","last_undegraded":"2024-05-08T20:55:11.929406+0000","last_fullsized":"2024-05-08T20:55:11.929406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.929353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:48.141846+0000","scrub_duration":0.0054755710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6038,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.865004+0000","last_change":"2024-05-08T20:54:59.865230+0000","last_active":"2024-05-08T20:54:59.865004+0000","last_peered":"2024-05-08T20:54:59.865004+0000","last_clean":"2024-05-08T20:54:59.865004+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:59.865004+0000","last_undegraded":"2024-05-08T20:54:59.865004+0000","last_fullsized":"2024-05-08T20:54:59.865004+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5999","last_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_deep_scrub":"26'5999","last_deep_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.864944+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:43.980839+0000","scrub_duration":0.021147691999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:00.945558+0000","last_change":"2024-05-08T20:27:18.540807+0000","last_active":"2024-05-08T20:54:00.945558+0000","last_peered":"2024-05-08T20:54:00.945558+0000","last_clean":"2024-05-08T20:54:00.945558+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:54:00.945558+0000","last_undegraded":"2024-05-08T20:54:00.945558+0000","last_fullsized":"2024-05-08T20:54:00.945558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4383,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.041578+0000","last_change":"2024-05-08T20:55:19.041756+0000","last_active":"2024-05-08T20:55:19.041578+0000","last_peered":"2024-05-08T20:55:19.041578+0000","last_clean":"2024-05-08T20:55:19.041578+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:55:19.041578+0000","last_undegraded":"2024-05-08T20:55:19.041578+0000","last_fullsized":"2024-05-08T20:55:19.041578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4346","last_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_deep_scrub":"26'4346","last_deep_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.041549+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.115810+0000","scrub_duration":0.090105366000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'750","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.624205+0000","last_change":"2024-05-08T20:55:13.624444+0000","last_active":"2024-05-08T20:55:13.624205+0000","last_peered":"2024-05-08T20:55:13.624205+0000","last_clean":"2024-05-08T20:55:13.624205+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:55:13.624205+0000","last_undegraded":"2024-05-08T20:55:13.624205+0000","last_fullsized":"2024-05-08T20:55:13.624205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.624149+0000","objects_scrubbed":3,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:48.563067+0000","scrub_duration":0.082494374999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5586,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.369752+0000","last_change":"2024-05-08T20:55:16.369985+0000","last_active":"2024-05-08T20:55:16.369752+0000","last_peered":"2024-05-08T20:55:16.369752+0000","last_clean":"2024-05-08T20:55:16.369752+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:55:16.369752+0000","last_undegraded":"2024-05-08T20:55:16.369752+0000","last_fullsized":"2024-05-08T20:55:16.369752+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5547","last_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_deep_scrub":"26'5547","last_deep_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.369692+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:07.095999+0000","scrub_duration":0.052017234000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.268871+0000","last_change":"2024-05-08T20:55:21.269094+0000","last_active":"2024-05-08T20:55:21.268871+0000","last_peered":"2024-05-08T20:55:21.268871+0000","last_clean":"2024-05-08T20:55:21.268871+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:55:21.268871+0000","last_undegraded":"2024-05-08T20:55:21.268871+0000","last_fullsized":"2024-05-08T20:55:21.268871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.268812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:45.570299+0000","scrub_duration":0.0068504059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.889215+0000","last_change":"2024-05-08T20:55:03.889349+0000","last_active":"2024-05-08T20:55:03.889215+0000","last_peered":"2024-05-08T20:55:03.889215+0000","last_clean":"2024-05-08T20:55:03.889215+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:55:03.889215+0000","last_undegraded":"2024-05-08T20:55:03.889215+0000","last_fullsized":"2024-05-08T20:55:03.889215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4926","last_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_deep_scrub":"26'4926","last_deep_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.889187+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:53.056172+0000","scrub_duration":0.110946349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'163","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.590220+0000","last_change":"2024-05-08T20:54:59.590495+0000","last_active":"2024-05-08T20:54:59.590220+0000","last_peered":"2024-05-08T20:54:59.590220+0000","last_clean":"2024-05-08T20:54:59.590220+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:59.590220+0000","last_undegraded":"2024-05-08T20:54:59.590220+0000","last_fullsized":"2024-05-08T20:54:59.590220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'163","last_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_deep_scrub":"26'163","last_deep_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.590164+0000","objects_scrubbed":1,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.910490+0000","scrub_duration":0.020938656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.049268+0000","last_change":"2024-05-08T20:55:06.049513+0000","last_active":"2024-05-08T20:55:06.049268+0000","last_peered":"2024-05-08T20:55:06.049268+0000","last_clean":"2024-05-08T20:55:06.049268+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:55:06.049268+0000","last_undegraded":"2024-05-08T20:55:06.049268+0000","last_fullsized":"2024-05-08T20:55:06.049268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4451","last_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_deep_scrub":"26'4451","last_deep_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.049212+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:24.430723+0000","scrub_duration":0.052059591000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.520135+0000","last_change":"2024-05-08T20:55:02.520371+0000","last_active":"2024-05-08T20:55:02.520135+0000","last_peered":"2024-05-08T20:55:02.520135+0000","last_clean":"2024-05-08T20:55:02.520135+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:55:02.520135+0000","last_undegraded":"2024-05-08T20:55:02.520135+0000","last_fullsized":"2024-05-08T20:55:02.520135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.520078+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:26.455981+0000","scrub_duration":0.0061828689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3700,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.638025+0000","last_change":"2024-05-08T20:27:28.012203+0000","last_active":"2024-05-08T20:54:43.638025+0000","last_peered":"2024-05-08T20:54:43.638025+0000","last_clean":"2024-05-08T20:54:43.638025+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:54:43.638025+0000","last_undegraded":"2024-05-08T20:54:43.638025+0000","last_fullsized":"2024-05-08T20:54:43.638025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'655","reported_seq":695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.317920+0000","last_change":"2024-05-08T20:55:23.318135+0000","last_active":"2024-05-08T20:55:23.317920+0000","last_peered":"2024-05-08T20:55:23.317920+0000","last_clean":"2024-05-08T20:55:23.317920+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:55:23.317920+0000","last_undegraded":"2024-05-08T20:55:23.317920+0000","last_fullsized":"2024-05-08T20:55:23.317920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'655","last_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_deep_scrub":"26'655","last_deep_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.317866+0000","objects_scrubbed":1,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:46.680579+0000","scrub_duration":0.028425507999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.863360+0000","last_change":"2024-05-08T20:55:13.863574+0000","last_active":"2024-05-08T20:55:13.863360+0000","last_peered":"2024-05-08T20:55:13.863360+0000","last_clean":"2024-05-08T20:55:13.863360+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:55:13.863360+0000","last_undegraded":"2024-05-08T20:55:13.863360+0000","last_fullsized":"2024-05-08T20:55:13.863360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4749","last_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_deep_scrub":"26'4749","last_deep_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.863305+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:59.772479+0000","scrub_duration":0.028153702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.342167+0000","last_change":"2024-05-08T20:54:56.342167+0000","last_active":"2024-05-08T20:54:56.342167+0000","last_peered":"2024-05-08T20:54:56.342167+0000","last_clean":"2024-05-08T20:54:56.342167+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:56.342167+0000","last_undegraded":"2024-05-08T20:54:56.342167+0000","last_fullsized":"2024-05-08T20:54:56.342167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.341600+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:37.112673+0000","scrub_duration":0.0065677610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3740,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.447440+0000","last_change":"2024-05-08T20:27:27.987554+0000","last_active":"2024-05-08T20:54:32.447440+0000","last_peered":"2024-05-08T20:54:32.447440+0000","last_clean":"2024-05-08T20:54:32.447440+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:54:32.447440+0000","last_undegraded":"2024-05-08T20:54:32.447440+0000","last_fullsized":"2024-05-08T20:54:32.447440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.540402+0000","last_change":"2024-05-08T20:54:49.540646+0000","last_active":"2024-05-08T20:54:49.540402+0000","last_peered":"2024-05-08T20:54:49.540402+0000","last_clean":"2024-05-08T20:54:49.540402+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:49.540402+0000","last_undegraded":"2024-05-08T20:54:49.540402+0000","last_fullsized":"2024-05-08T20:54:49.540402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5325","last_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_deep_scrub":"26'5325","last_deep_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.540347+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:25.992758+0000","scrub_duration":0.061375869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.416552+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:32.416552+0000","last_peered":"2024-05-08T20:54:32.416552+0000","last_clean":"2024-05-08T20:54:32.416552+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:32.416552+0000","last_undegraded":"2024-05-08T20:54:32.416552+0000","last_fullsized":"2024-05-08T20:54:32.416552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.583918+0000","last_change":"2024-05-08T20:54:57.584171+0000","last_active":"2024-05-08T20:54:57.583918+0000","last_peered":"2024-05-08T20:54:57.583918+0000","last_clean":"2024-05-08T20:54:57.583918+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:57.583918+0000","last_undegraded":"2024-05-08T20:54:57.583918+0000","last_fullsized":"2024-05-08T20:54:57.583918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5595","last_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_deep_scrub":"26'5595","last_deep_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.583862+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:54.463390+0000","scrub_duration":0.019454468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4690,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.300795+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:32.300795+0000","last_peered":"2024-05-08T20:54:32.300795+0000","last_clean":"2024-05-08T20:54:32.300795+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:32.300795+0000","last_undegraded":"2024-05-08T20:54:32.300795+0000","last_fullsized":"2024-05-08T20:54:32.300795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:30.966449+0000","last_change":"2024-05-08T20:27:18.927975+0000","last_active":"2024-05-08T20:54:30.966449+0000","last_peered":"2024-05-08T20:54:30.966449+0000","last_clean":"2024-05-08T20:54:30.966449+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:54:30.966449+0000","last_undegraded":"2024-05-08T20:54:30.966449+0000","last_fullsized":"2024-05-08T20:54:30.966449+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.440334+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:32.440334+0000","last_peered":"2024-05-08T20:54:32.440334+0000","last_clean":"2024-05-08T20:54:32.440334+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:32.440334+0000","last_undegraded":"2024-05-08T20:54:32.440334+0000","last_fullsized":"2024-05-08T20:54:32.440334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.063296+0000","last_change":"2024-05-08T20:54:46.063510+0000","last_active":"2024-05-08T20:54:46.063296+0000","last_peered":"2024-05-08T20:54:46.063296+0000","last_clean":"2024-05-08T20:54:46.063296+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:46.063296+0000","last_undegraded":"2024-05-08T20:54:46.063296+0000","last_fullsized":"2024-05-08T20:54:46.063296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5693","last_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_deep_scrub":"26'5693","last_deep_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.063251+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:47.062496+0000","scrub_duration":0.071792174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713023+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:40.713023+0000","last_peered":"2024-05-08T20:54:40.713023+0000","last_clean":"2024-05-08T20:54:40.713023+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:40.713023+0000","last_undegraded":"2024-05-08T20:54:40.713023+0000","last_fullsized":"2024-05-08T20:54:40.713023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5428,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.862664+0000","last_change":"2024-05-08T20:27:18.889361+0000","last_active":"2024-05-08T20:54:21.862664+0000","last_peered":"2024-05-08T20:54:21.862664+0000","last_clean":"2024-05-08T20:54:21.862664+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:54:21.862664+0000","last_undegraded":"2024-05-08T20:54:21.862664+0000","last_fullsized":"2024-05-08T20:54:21.862664+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:39.444918+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:39.444918+0000","last_peered":"2024-05-08T20:54:39.444918+0000","last_clean":"2024-05-08T20:54:39.444918+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:39.444918+0000","last_undegraded":"2024-05-08T20:54:39.444918+0000","last_fullsized":"2024-05-08T20:54:39.444918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.715273+0000","last_change":"2024-05-08T20:55:06.715543+0000","last_active":"2024-05-08T20:55:06.715273+0000","last_peered":"2024-05-08T20:55:06.715273+0000","last_clean":"2024-05-08T20:55:06.715273+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:55:06.715273+0000","last_undegraded":"2024-05-08T20:55:06.715273+0000","last_fullsized":"2024-05-08T20:55:06.715273+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5958","last_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_deep_scrub":"26'5958","last_deep_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.715216+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.934398+0000","scrub_duration":0.015652640999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.712868+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:40.712868+0000","last_peered":"2024-05-08T20:54:40.712868+0000","last_clean":"2024-05-08T20:54:40.712868+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:40.712868+0000","last_undegraded":"2024-05-08T20:54:40.712868+0000","last_fullsized":"2024-05-08T20:54:40.712868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.492210+0000","last_change":"2024-05-08T20:54:47.492492+0000","last_active":"2024-05-08T20:54:47.492210+0000","last_peered":"2024-05-08T20:54:47.492210+0000","last_clean":"2024-05-08T20:54:47.492210+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:47.492210+0000","last_undegraded":"2024-05-08T20:54:47.492210+0000","last_fullsized":"2024-05-08T20:54:47.492210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5066","last_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_deep_scrub":"26'5066","last_deep_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.492152+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.271368+0000","scrub_duration":0.020000068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922568+0000","last_change":"2024-05-08T20:27:27.982126+0000","last_active":"2024-05-08T20:54:37.922568+0000","last_peered":"2024-05-08T20:54:37.922568+0000","last_clean":"2024-05-08T20:54:37.922568+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:54:37.922568+0000","last_undegraded":"2024-05-08T20:54:37.922568+0000","last_fullsized":"2024-05-08T20:54:37.922568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.445329+0000","last_change":"2024-05-08T20:55:08.445597+0000","last_active":"2024-05-08T20:55:08.445329+0000","last_peered":"2024-05-08T20:55:08.445329+0000","last_clean":"2024-05-08T20:55:08.445329+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:55:08.445329+0000","last_undegraded":"2024-05-08T20:55:08.445329+0000","last_fullsized":"2024-05-08T20:55:08.445329+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6126","last_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_deep_scrub":"26'6126","last_deep_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.445271+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:56.722437+0000","scrub_duration":0.012766164999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4933,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.449638+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:32.449638+0000","last_peered":"2024-05-08T20:54:32.449638+0000","last_clean":"2024-05-08T20:54:32.449638+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:32.449638+0000","last_undegraded":"2024-05-08T20:54:32.449638+0000","last_fullsized":"2024-05-08T20:54:32.449638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5391,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.824405+0000","last_change":"2024-05-08T20:27:18.903226+0000","last_active":"2024-05-08T20:54:21.824405+0000","last_peered":"2024-05-08T20:54:21.824405+0000","last_clean":"2024-05-08T20:54:21.824405+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:54:21.824405+0000","last_undegraded":"2024-05-08T20:54:21.824405+0000","last_fullsized":"2024-05-08T20:54:21.824405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.726901+0000","last_change":"2024-05-08T20:55:18.727229+0000","last_active":"2024-05-08T20:55:18.726901+0000","last_peered":"2024-05-08T20:55:18.726901+0000","last_clean":"2024-05-08T20:55:18.726901+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:55:18.726901+0000","last_undegraded":"2024-05-08T20:55:18.726901+0000","last_fullsized":"2024-05-08T20:55:18.726901+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.726746+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:12.191809+0000","scrub_duration":0.059782137999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.442535+0000","last_change":"2024-05-08T20:55:02.442768+0000","last_active":"2024-05-08T20:55:02.442535+0000","last_peered":"2024-05-08T20:55:02.442535+0000","last_clean":"2024-05-08T20:55:02.442535+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:55:02.442535+0000","last_undegraded":"2024-05-08T20:55:02.442535+0000","last_fullsized":"2024-05-08T20:55:02.442535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5184","last_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_deep_scrub":"26'5184","last_deep_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.442482+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:06.919194+0000","scrub_duration":0.015103089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.601981+0000","last_change":"2024-05-08T20:55:10.602221+0000","last_active":"2024-05-08T20:55:10.601981+0000","last_peered":"2024-05-08T20:55:10.601981+0000","last_clean":"2024-05-08T20:55:10.601981+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:55:10.601981+0000","last_undegraded":"2024-05-08T20:55:10.601981+0000","last_fullsized":"2024-05-08T20:55:10.601981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4176","last_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_deep_scrub":"26'4176","last_deep_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.601877+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:47.707725+0000","scrub_duration":0.083099372000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.878243+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.878243+0000","last_peered":"2024-05-08T20:54:21.878243+0000","last_clean":"2024-05-08T20:54:21.878243+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.878243+0000","last_undegraded":"2024-05-08T20:54:21.878243+0000","last_fullsized":"2024-05-08T20:54:21.878243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4593,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:33.851895+0000","last_change":"2024-05-08T20:27:27.984077+0000","last_active":"2024-05-08T20:54:33.851895+0000","last_peered":"2024-05-08T20:54:33.851895+0000","last_clean":"2024-05-08T20:54:33.851895+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:54:33.851895+0000","last_undegraded":"2024-05-08T20:54:33.851895+0000","last_fullsized":"2024-05-08T20:54:33.851895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6423,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.732804+0000","last_change":"2024-05-08T20:28:01.238331+0000","last_active":"2024-05-08T20:54:42.732804+0000","last_peered":"2024-05-08T20:54:42.732804+0000","last_clean":"2024-05-08T20:54:42.732804+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:54:42.732804+0000","last_undegraded":"2024-05-08T20:54:42.732804+0000","last_fullsized":"2024-05-08T20:54:42.732804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4868,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443742+0000","last_change":"2024-05-08T20:27:28.018591+0000","last_active":"2024-05-08T20:54:34.443742+0000","last_peered":"2024-05-08T20:54:34.443742+0000","last_clean":"2024-05-08T20:54:34.443742+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:54:34.443742+0000","last_undegraded":"2024-05-08T20:54:34.443742+0000","last_fullsized":"2024-05-08T20:54:34.443742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.577214+0000","last_change":"2024-05-08T20:55:06.577459+0000","last_active":"2024-05-08T20:55:06.577214+0000","last_peered":"2024-05-08T20:55:06.577214+0000","last_clean":"2024-05-08T20:55:06.577214+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:55:06.577214+0000","last_undegraded":"2024-05-08T20:55:06.577214+0000","last_fullsized":"2024-05-08T20:55:06.577214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4987","last_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_deep_scrub":"26'4987","last_deep_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.577160+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:42.945808+0000","scrub_duration":0.016149487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443798+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:34.443798+0000","last_peered":"2024-05-08T20:54:34.443798+0000","last_clean":"2024-05-08T20:54:34.443798+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:34.443798+0000","last_undegraded":"2024-05-08T20:54:34.443798+0000","last_fullsized":"2024-05-08T20:54:34.443798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6047,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.588062+0000","last_change":"2024-05-08T20:55:10.588330+0000","last_active":"2024-05-08T20:55:10.588062+0000","last_peered":"2024-05-08T20:55:10.588062+0000","last_clean":"2024-05-08T20:55:10.588062+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:55:10.588062+0000","last_undegraded":"2024-05-08T20:55:10.588062+0000","last_fullsized":"2024-05-08T20:55:10.588062+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.588008+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.452979+0000","scrub_duration":0.016104663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.330591+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.330591+0000","last_peered":"2024-05-08T20:54:32.330591+0000","last_clean":"2024-05-08T20:54:32.330591+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.330591+0000","last_undegraded":"2024-05-08T20:54:32.330591+0000","last_fullsized":"2024-05-08T20:54:32.330591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5442,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.580745+0000","last_change":"2024-05-08T20:54:59.580745+0000","last_active":"2024-05-08T20:54:59.580745+0000","last_peered":"2024-05-08T20:54:59.580745+0000","last_clean":"2024-05-08T20:54:59.580745+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:59.580745+0000","last_undegraded":"2024-05-08T20:54:59.580745+0000","last_fullsized":"2024-05-08T20:54:59.580745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5402","last_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_deep_scrub":"26'5402","last_deep_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.580403+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:43.325297+0000","scrub_duration":0.019827373999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3952,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.024577+0000","last_change":"2024-05-08T20:55:16.024733+0000","last_active":"2024-05-08T20:55:16.024577+0000","last_peered":"2024-05-08T20:55:16.024577+0000","last_clean":"2024-05-08T20:55:16.024577+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:55:16.024577+0000","last_undegraded":"2024-05-08T20:55:16.024577+0000","last_fullsized":"2024-05-08T20:55:16.024577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3916","last_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_deep_scrub":"26'3916","last_deep_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.024547+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:35.429176+0000","scrub_duration":0.084433175999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.091558+0000","last_change":"2024-05-08T20:55:17.091777+0000","last_active":"2024-05-08T20:55:17.091558+0000","last_peered":"2024-05-08T20:55:17.091558+0000","last_clean":"2024-05-08T20:55:17.091558+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:55:17.091558+0000","last_undegraded":"2024-05-08T20:55:17.091558+0000","last_fullsized":"2024-05-08T20:55:17.091558+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7179","last_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_deep_scrub":"26'7179","last_deep_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.091504+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:30.475338+0000","scrub_duration":0.010907612000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4673,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.421794+0000","last_change":"2024-05-08T20:27:27.982715+0000","last_active":"2024-05-08T20:54:32.421794+0000","last_peered":"2024-05-08T20:54:32.421794+0000","last_clean":"2024-05-08T20:54:32.421794+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:54:32.421794+0000","last_undegraded":"2024-05-08T20:54:32.421794+0000","last_fullsized":"2024-05-08T20:54:32.421794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5160,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.191509+0000","last_change":"2024-05-08T20:54:47.191768+0000","last_active":"2024-05-08T20:54:47.191509+0000","last_peered":"2024-05-08T20:54:47.191509+0000","last_clean":"2024-05-08T20:54:47.191509+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:47.191509+0000","last_undegraded":"2024-05-08T20:54:47.191509+0000","last_fullsized":"2024-05-08T20:54:47.191509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5121","last_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_deep_scrub":"26'5121","last_deep_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.191457+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:32.886217+0000","scrub_duration":0.059662343999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.415210+0000","last_change":"2024-05-08T20:27:28.011559+0000","last_active":"2024-05-08T20:54:32.415210+0000","last_peered":"2024-05-08T20:54:32.415210+0000","last_clean":"2024-05-08T20:54:32.415210+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:54:32.415210+0000","last_undegraded":"2024-05-08T20:54:32.415210+0000","last_fullsized":"2024-05-08T20:54:32.415210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.836939+0000","last_change":"2024-05-08T20:54:54.836939+0000","last_active":"2024-05-08T20:54:54.836939+0000","last_peered":"2024-05-08T20:54:54.836939+0000","last_clean":"2024-05-08T20:54:54.836939+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:54.836939+0000","last_undegraded":"2024-05-08T20:54:54.836939+0000","last_fullsized":"2024-05-08T20:54:54.836939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4602","last_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_deep_scrub":"26'4602","last_deep_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.836650+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:37.068481+0000","scrub_duration":0.026253420999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.343098+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.343098+0000","last_peered":"2024-05-08T20:54:32.343098+0000","last_clean":"2024-05-08T20:54:32.343098+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.343098+0000","last_undegraded":"2024-05-08T20:54:32.343098+0000","last_fullsized":"2024-05-08T20:54:32.343098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941403+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941403+0000","last_peered":"2024-05-08T20:54:42.941403+0000","last_clean":"2024-05-08T20:54:42.941403+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941403+0000","last_undegraded":"2024-05-08T20:54:42.941403+0000","last_fullsized":"2024-05-08T20:54:42.941403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405851+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.405851+0000","last_peered":"2024-05-08T20:54:32.405851+0000","last_clean":"2024-05-08T20:54:32.405851+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.405851+0000","last_undegraded":"2024-05-08T20:54:32.405851+0000","last_fullsized":"2024-05-08T20:54:32.405851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.450359+0000","last_change":"2024-05-08T20:55:10.450576+0000","last_active":"2024-05-08T20:55:10.450359+0000","last_peered":"2024-05-08T20:55:10.450359+0000","last_clean":"2024-05-08T20:55:10.450359+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:55:10.450359+0000","last_undegraded":"2024-05-08T20:55:10.450359+0000","last_fullsized":"2024-05-08T20:55:10.450359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4626","last_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_deep_scrub":"26'4626","last_deep_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.450304+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:20.915560+0000","scrub_duration":0.011125820999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.357288+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:32.357288+0000","last_peered":"2024-05-08T20:54:32.357288+0000","last_clean":"2024-05-08T20:54:32.357288+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:32.357288+0000","last_undegraded":"2024-05-08T20:54:32.357288+0000","last_fullsized":"2024-05-08T20:54:32.357288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.891543+0000","last_change":"2024-05-08T20:55:16.891829+0000","last_active":"2024-05-08T20:55:16.891543+0000","last_peered":"2024-05-08T20:55:16.891543+0000","last_clean":"2024-05-08T20:55:16.891543+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:55:16.891543+0000","last_undegraded":"2024-05-08T20:55:16.891543+0000","last_fullsized":"2024-05-08T20:55:16.891543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3688","last_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_deep_scrub":"26'3688","last_deep_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.891490+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.749773+0000","scrub_duration":0.012960828000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.540769+0000","last_change":"2024-05-08T20:55:13.541058+0000","last_active":"2024-05-08T20:55:13.540769+0000","last_peered":"2024-05-08T20:55:13.540769+0000","last_clean":"2024-05-08T20:55:13.540769+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:55:13.540769+0000","last_undegraded":"2024-05-08T20:55:13.540769+0000","last_fullsized":"2024-05-08T20:55:13.540769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3316","last_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_deep_scrub":"26'3316","last_deep_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.540711+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:12.992902+0000","scrub_duration":0.076822395000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.474491+0000","last_change":"2024-05-08T20:54:51.474745+0000","last_active":"2024-05-08T20:54:51.474491+0000","last_peered":"2024-05-08T20:54:51.474491+0000","last_clean":"2024-05-08T20:54:51.474491+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:51.474491+0000","last_undegraded":"2024-05-08T20:54:51.474491+0000","last_fullsized":"2024-05-08T20:54:51.474491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5609","last_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_deep_scrub":"26'5609","last_deep_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.474437+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:37.535496+0000","scrub_duration":0.017226228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4562,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.729018+0000","last_change":"2024-05-08T20:55:13.729274+0000","last_active":"2024-05-08T20:55:13.729018+0000","last_peered":"2024-05-08T20:55:13.729018+0000","last_clean":"2024-05-08T20:55:13.729018+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:55:13.729018+0000","last_undegraded":"2024-05-08T20:55:13.729018+0000","last_fullsized":"2024-05-08T20:55:13.729018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4527","last_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_deep_scrub":"26'4527","last_deep_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.728968+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:30.126015+0000","scrub_duration":0.045784956000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.487212+0000","last_change":"2024-05-08T20:54:45.487445+0000","last_active":"2024-05-08T20:54:45.487212+0000","last_peered":"2024-05-08T20:54:45.487212+0000","last_clean":"2024-05-08T20:54:45.487212+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:45.487212+0000","last_undegraded":"2024-05-08T20:54:45.487212+0000","last_fullsized":"2024-05-08T20:54:45.487212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5845","last_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_deep_scrub":"26'5845","last_deep_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.487159+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:35.646681+0000","scrub_duration":0.033861688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.154072+0000","last_change":"2024-05-08T20:55:19.154336+0000","last_active":"2024-05-08T20:55:19.154072+0000","last_peered":"2024-05-08T20:55:19.154072+0000","last_clean":"2024-05-08T20:55:19.154072+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:55:19.154072+0000","last_undegraded":"2024-05-08T20:55:19.154072+0000","last_fullsized":"2024-05-08T20:55:19.154072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3505","last_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_deep_scrub":"26'3505","last_deep_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.154016+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:16.617871+0000","scrub_duration":0.075724768999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.715004+0000","last_change":"2024-05-08T20:55:15.715259+0000","last_active":"2024-05-08T20:55:15.715004+0000","last_peered":"2024-05-08T20:55:15.715004+0000","last_clean":"2024-05-08T20:55:15.715004+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:55:15.715004+0000","last_undegraded":"2024-05-08T20:55:15.715004+0000","last_fullsized":"2024-05-08T20:55:15.715004+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6642","last_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_deep_scrub":"26'6642","last_deep_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.714948+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:11.017870+0000","scrub_duration":0.018435876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.852816+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:38.852816+0000","last_peered":"2024-05-08T20:54:38.852816+0000","last_clean":"2024-05-08T20:54:38.852816+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:38.852816+0000","last_undegraded":"2024-05-08T20:54:38.852816+0000","last_fullsized":"2024-05-08T20:54:38.852816+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5520,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.828298+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:21.828298+0000","last_peered":"2024-05-08T20:54:21.828298+0000","last_clean":"2024-05-08T20:54:21.828298+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:21.828298+0000","last_undegraded":"2024-05-08T20:54:21.828298+0000","last_fullsized":"2024-05-08T20:54:21.828298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4045,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:37.922814+0000","last_change":"2024-05-08T20:27:28.009470+0000","last_active":"2024-05-08T20:54:37.922814+0000","last_peered":"2024-05-08T20:54:37.922814+0000","last_clean":"2024-05-08T20:54:37.922814+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:54:37.922814+0000","last_undegraded":"2024-05-08T20:54:37.922814+0000","last_fullsized":"2024-05-08T20:54:37.922814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.628544+0000","last_change":"2024-05-08T20:55:07.628786+0000","last_active":"2024-05-08T20:55:07.628544+0000","last_peered":"2024-05-08T20:55:07.628544+0000","last_clean":"2024-05-08T20:55:07.628544+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:55:07.628544+0000","last_undegraded":"2024-05-08T20:55:07.628544+0000","last_fullsized":"2024-05-08T20:55:07.628544+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5870","last_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_deep_scrub":"26'5870","last_deep_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.628488+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:59.204406+0000","scrub_duration":0.036094273000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.385760+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:32.385760+0000","last_peered":"2024-05-08T20:54:32.385760+0000","last_clean":"2024-05-08T20:54:32.385760+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:32.385760+0000","last_undegraded":"2024-05-08T20:54:32.385760+0000","last_fullsized":"2024-05-08T20:54:32.385760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.154571+0000","last_change":"2024-05-08T20:55:02.154865+0000","last_active":"2024-05-08T20:55:02.154571+0000","last_peered":"2024-05-08T20:55:02.154571+0000","last_clean":"2024-05-08T20:55:02.154571+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:55:02.154571+0000","last_undegraded":"2024-05-08T20:55:02.154571+0000","last_fullsized":"2024-05-08T20:55:02.154571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4536","last_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_deep_scrub":"26'4536","last_deep_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.154517+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:54.549611+0000","scrub_duration":0.047608635000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.387527+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.387527+0000","last_peered":"2024-05-08T20:54:32.387527+0000","last_clean":"2024-05-08T20:54:32.387527+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.387527+0000","last_undegraded":"2024-05-08T20:54:32.387527+0000","last_fullsized":"2024-05-08T20:54:32.387527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.592398+0000","last_change":"2024-05-08T20:55:05.592654+0000","last_active":"2024-05-08T20:55:05.592398+0000","last_peered":"2024-05-08T20:55:05.592398+0000","last_clean":"2024-05-08T20:55:05.592398+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:55:05.592398+0000","last_undegraded":"2024-05-08T20:55:05.592398+0000","last_fullsized":"2024-05-08T20:55:05.592398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4811","last_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_deep_scrub":"26'4811","last_deep_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.592322+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:00.479073+0000","scrub_duration":0.018874953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3764,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185689+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:43.185689+0000","last_peered":"2024-05-08T20:54:43.185689+0000","last_clean":"2024-05-08T20:54:43.185689+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:43.185689+0000","last_undegraded":"2024-05-08T20:54:43.185689+0000","last_fullsized":"2024-05-08T20:54:43.185689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4750,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.171330+0000","last_change":"2024-05-08T20:54:54.172178+0000","last_active":"2024-05-08T20:54:54.171330+0000","last_peered":"2024-05-08T20:54:54.171330+0000","last_clean":"2024-05-08T20:54:54.171330+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:54.171330+0000","last_undegraded":"2024-05-08T20:54:54.171330+0000","last_fullsized":"2024-05-08T20:54:54.171330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4709","last_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_deep_scrub":"26'4709","last_deep_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.171276+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.280762+0000","scrub_duration":0.026438705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.500842+0000","last_change":"2024-05-08T20:55:15.501128+0000","last_active":"2024-05-08T20:55:15.500842+0000","last_peered":"2024-05-08T20:55:15.500842+0000","last_clean":"2024-05-08T20:55:15.500842+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:55:15.500842+0000","last_undegraded":"2024-05-08T20:55:15.500842+0000","last_fullsized":"2024-05-08T20:55:15.500842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3900","last_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_deep_scrub":"26'3900","last_deep_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.500780+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:36.458071+0000","scrub_duration":0.028467224999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5679,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.101942+0000","last_change":"2024-05-08T20:55:03.102295+0000","last_active":"2024-05-08T20:55:03.101942+0000","last_peered":"2024-05-08T20:55:03.101942+0000","last_clean":"2024-05-08T20:55:03.101942+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:55:03.101942+0000","last_undegraded":"2024-05-08T20:55:03.101942+0000","last_fullsized":"2024-05-08T20:55:03.101942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5638","last_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_deep_scrub":"26'5638","last_deep_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.101828+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:45.438163+0000","scrub_duration":0.077280746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976854+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:44.976854+0000","last_peered":"2024-05-08T20:54:44.976854+0000","last_clean":"2024-05-08T20:54:44.976854+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:44.976854+0000","last_undegraded":"2024-05-08T20:54:44.976854+0000","last_fullsized":"2024-05-08T20:54:44.976854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.773320+0000","last_change":"2024-05-08T20:54:49.773606+0000","last_active":"2024-05-08T20:54:49.773320+0000","last_peered":"2024-05-08T20:54:49.773320+0000","last_clean":"2024-05-08T20:54:49.773320+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:49.773320+0000","last_undegraded":"2024-05-08T20:54:49.773320+0000","last_fullsized":"2024-05-08T20:54:49.773320+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6644","last_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_deep_scrub":"26'6644","last_deep_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.773265+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:23.617467+0000","scrub_duration":0.054899599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4781,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.832111+0000","last_change":"2024-05-08T20:55:22.832380+0000","last_active":"2024-05-08T20:55:22.832111+0000","last_peered":"2024-05-08T20:55:22.832111+0000","last_clean":"2024-05-08T20:55:22.832111+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:55:22.832111+0000","last_undegraded":"2024-05-08T20:55:22.832111+0000","last_fullsized":"2024-05-08T20:55:22.832111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4746","last_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_deep_scrub":"26'4746","last_deep_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.832058+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:06.840030+0000","scrub_duration":0.062733702000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5146,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.584824+0000","last_change":"2024-05-08T20:54:48.585054+0000","last_active":"2024-05-08T20:54:48.584824+0000","last_peered":"2024-05-08T20:54:48.584824+0000","last_clean":"2024-05-08T20:54:48.584824+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:48.584824+0000","last_undegraded":"2024-05-08T20:54:48.584824+0000","last_fullsized":"2024-05-08T20:54:48.584824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5105","last_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_deep_scrub":"26'5105","last_deep_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.584770+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:58.380211+0000","scrub_duration":0.012206140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3558,"ondisk_log_size":3558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3562,"ondisk_log_size":3562,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575193,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":3.0630000000000002,"15min":1.577},"min":{"1min":0.48699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.96099999999999997,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.6200000000000001,"15min":1.2010000000000001},"min":{"1min":0.68300000000000005,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.2210000000000001,"5min":34.091000000000001,"15min":34.091000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.413,"15min":1.077},"min":{"1min":0.58299999999999996,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0940000000000001,"5min":11.189,"15min":13.579000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":1.448,"15min":1.1519999999999999},"min":{"1min":0.57699999999999996,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":1.0549999999999999,"5min":12.048,"15min":13.467000000000001},"last":1.071}]},{"osd":2,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.7210000000000001,"15min":1.153},"min":{"1min":0.59799999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.2669999999999999,"5min":33.950000000000003,"15min":33.950000000000003},"last":1.087},{"interface":"front","average":{"1min":1.054,"5min":1.784,"15min":1.29},"min":{"1min":0.71199999999999997,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":1.3460000000000001,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.141}]},{"osd":3,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.391,"15min":1.119},"min":{"1min":0.629,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.391,"5min":11.215,"15min":15.532},"last":1.01},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.851,"15min":1.399},"min":{"1min":0.66500000000000004,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1850000000000001,"5min":16.584,"15min":16.584},"last":0.76100000000000001}]},{"osd":4,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":2.4929999999999999,"15min":1.726},"min":{"1min":0.42199999999999999,"5min":0.255,"15min":0.214},"max":{"1min":1.3580000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.736,"15min":1.353},"min":{"1min":0.56799999999999995,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":1.1080000000000001,"5min":20.565999999999999,"15min":22.741},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":2.9910000000000001,"15min":1.9770000000000001},"min":{"1min":0.64100000000000001,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":1.4179999999999999,"5min":32.381,"15min":33.679000000000002},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.181,"5min":2.2229999999999999,"15min":1.51},"min":{"1min":0.75700000000000001,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":1.492,"5min":20.869,"15min":20.869},"last":1.212}]},{"osd":6,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.538,"15min":1.264},"min":{"1min":0.40799999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.45,"5min":11.484,"15min":13.714},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.8700000000000001,"15min":1.351},"min":{"1min":0.73599999999999999,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":1.4670000000000001,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.93500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575191,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":1.389,"15min":0.98899999999999999},"min":{"1min":0.39400000000000002,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":1.25,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":1.111},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.5780000000000001,"15min":1.173},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2829999999999999,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":0.75800000000000001}]},{"osd":1,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.504,"15min":1.1799999999999999},"min":{"1min":0.38200000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":1.2050000000000001,"5min":6.5739999999999998,"15min":14.717000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.4610000000000001,"15min":1.1100000000000001},"min":{"1min":0.442,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":3.645,"5min":11.523999999999999,"15min":14.404},"last":1.0169999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.3500000000000001,"15min":1.0980000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":1.198,"5min":9.907,"15min":9.907},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.244,"15min":1.0940000000000001},"min":{"1min":0.51200000000000001,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":1.294,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.7729999999999999,"15min":1.3140000000000001},"min":{"1min":0.46899999999999997,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":1.349,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.7490000000000001,"5min":1.6870000000000001,"15min":1.252},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":13.960000000000001,"5min":13.960000000000001,"15min":13.960000000000001},"last":0.94899999999999995}]},{"osd":4,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":2.4609999999999999,"15min":1.5580000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.223},"max":{"1min":3.177,"5min":30.094000000000001,"15min":30.094000000000001},"last":1.206},{"interface":"front","average":{"1min":1.048,"5min":1.9530000000000001,"15min":1.444},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":1.476,"5min":29.538,"15min":29.538},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.8440000000000001,"15min":1.2090000000000001},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.25},"max":{"1min":1.3759999999999999,"5min":11.568,"15min":11.568},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.9279999999999999,"15min":1.333},"min":{"1min":0.54100000000000004,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":1.484,"5min":11.593999999999999,"15min":11.593999999999999},"last":1.1359999999999999}]},{"osd":7,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.9219999999999999,"15min":1.27},"min":{"1min":0.312,"5min":0.188,"15min":0.188},"max":{"1min":1.2949999999999999,"5min":12.77,"15min":12.77},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.788,"15min":1.3069999999999999},"min":{"1min":0.48499999999999999,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":1.4319999999999999,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575191,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.3320000000000001,"15min":1.0800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.1559999999999997,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.754},{"interface":"front","average":{"1min":1.109,"5min":1.3109999999999999,"15min":1.018},"min":{"1min":0.55900000000000005,"5min":0.27800000000000002,"15min":0.23599999999999999},"max":{"1min":3.7090000000000001,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":1.1539999999999999}]},{"osd":1,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":4.976,"15min":2.3239999999999998},"min":{"1min":0.43099999999999999,"5min":0.27100000000000002,"15min":0.20799999999999999},"max":{"1min":3.7530000000000001,"5min":121.521,"15min":121.521},"last":1.107},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.9179999999999999,"15min":1.2310000000000001},"min":{"1min":0.57399999999999995,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.1980000000000004,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.86699999999999999}]},{"osd":2,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.8109999999999999,"15min":1.224},"min":{"1min":0.317,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":4.6870000000000003,"5min":16.535,"15min":16.535},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.7529999999999999,"15min":1.1599999999999999},"min":{"1min":0.40000000000000002,"5min":0.27900000000000003,"15min":0.249},"max":{"1min":3.7930000000000001,"5min":15.006,"15min":15.006},"last":1.05}]},{"osd":3,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":5.3209999999999997,"15min":2.516},"min":{"1min":0.33900000000000002,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":4.6150000000000002,"5min":121.498,"15min":121.498},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.714,"5min":1.8939999999999999,"15min":1.3129999999999999},"min":{"1min":0.5,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.737,"5min":33.140000000000001,"15min":33.140000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":4.6740000000000004,"15min":2.335},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.4790000000000001,"5min":121.464,"15min":121.464},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.657,"15min":1.2010000000000001},"min":{"1min":0.36599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.8759999999999999,"5min":7.7110000000000003,"15min":8.2710000000000008},"last":0.88700000000000001}]},{"osd":6,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.8580000000000001,"15min":1.351},"min":{"1min":0.66500000000000004,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0430000000000001,"5min":15.048,"15min":15.048},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.665,"15min":1.2270000000000001},"min":{"1min":0.71399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":3.649,"5min":11.56,"15min":11.56},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":3.113,"15min":2.0150000000000001},"min":{"1min":0.55200000000000005,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":5.1050000000000004,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.028},{"interface":"front","average":{"1min":1.383,"5min":1.554,"15min":1.2549999999999999},"min":{"1min":0.68000000000000005,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.8300000000000001,"5min":9.4890000000000008,"15min":12.679},"last":0.99199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575192,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.853,"15min":1.244},"min":{"1min":0.41799999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.2050000000000001,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.036},{"interface":"front","average":{"1min":1.02,"5min":1.579,"15min":1.2},"min":{"1min":0.44700000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":1.3640000000000001,"5min":16.119,"15min":16.119},"last":1.103}]},{"osd":1,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":2.2149999999999999,"15min":1.423},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.403,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.4630000000000001,"15min":1.081},"min":{"1min":0.67700000000000005,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9689999999999999,"5min":16.904,"15min":16.904},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":2.0310000000000001,"15min":1.4730000000000001},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":1.0720000000000001,"5min":28.271999999999998,"15min":28.271999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.232,"15min":1.002},"min":{"1min":0.64100000000000001,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":3.0190000000000001,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.98899999999999999}]},{"osd":3,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":2.2799999999999998,"15min":1.542},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.7880000000000003,"5min":16.449000000000002,"15min":16.449000000000002},"last":1.137},{"interface":"front","average":{"1min":1.125,"5min":2.2759999999999998,"15min":1.5089999999999999},"min":{"1min":0.67000000000000004,"5min":0.316,"15min":0.316},"max":{"1min":3.1579999999999999,"5min":29.526,"15min":29.526},"last":1.0649999999999999}]},{"osd":5,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":2.508,"15min":1.464},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":1.1639999999999999,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.5149999999999999,"15min":1.1859999999999999},"min":{"1min":0.60099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0880000000000001,"5min":9.0370000000000008,"15min":14.863},"last":0.81899999999999995}]},{"osd":6,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.899,"15min":1.325},"min":{"1min":0.36199999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.327,"5min":33.198,"15min":33.198},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.9530000000000001,"15min":1.373},"min":{"1min":0.38900000000000001,"5min":0.318,"15min":0.308},"max":{"1min":1.425,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.202}]},{"osd":7,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":3.4980000000000002,"15min":1.853},"min":{"1min":0.77400000000000002,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":3.0529999999999999,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":3.7010000000000001,"15min":1.97},"min":{"1min":1.095,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":3.125,"5min":54.113,"15min":54.113},"last":1.2450000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575191,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.379,"15min":0.95699999999999996},"min":{"1min":0.48399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.97899999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.4730000000000001,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.192,"15min":0.192},"max":{"1min":1.0369999999999999,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":1.171,"15min":1.0289999999999999},"min":{"1min":0.40600000000000003,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.88,"5min":12.253,"15min":16.355},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.04,"15min":0.86199999999999999},"min":{"1min":0.36099999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.872,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.85099999999999998}]},{"osd":2,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":0.90600000000000003},"min":{"1min":0.54900000000000004,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":1.127,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.96299999999999997,"15min":0.83999999999999997},"min":{"1min":0.48599999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.0880000000000001,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.512,"15min":1.091},"min":{"1min":0.70599999999999996,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5539999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.4319999999999999,"15min":1.046},"min":{"1min":0.74299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.4630000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.7350000000000001,"15min":1.9179999999999999},"min":{"1min":0.52900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4750000000000001,"5min":17.004999999999999,"15min":117.105},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.5549999999999999,"15min":1.1619999999999999},"min":{"1min":0.45400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1879999999999999,"5min":14.394,"15min":14.394},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.6359999999999999,"15min":1.3340000000000001},"min":{"1min":0.67000000000000004,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5629999999999999,"5min":10.834,"15min":16.113},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.163,"5min":1.651,"15min":1.2230000000000001},"min":{"1min":0.84999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5109999999999999,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.075}]},{"osd":7,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.827,"15min":1.3520000000000001},"min":{"1min":0.79100000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4430000000000001,"5min":16.977,"15min":16.977},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.7509999999999999,"15min":1.2929999999999999},"min":{"1min":0.51800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":1.4410000000000001,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.0089999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575189,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.111,"15min":0.86899999999999999},"min":{"1min":0.315,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":7.5679999999999996,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":1.101,"15min":0.91900000000000004},"min":{"1min":0.34000000000000002,"5min":0.189,"15min":0.189},"max":{"1min":2.2440000000000002,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.02,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.7409999999999997,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.373,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.3170000000000002,"5min":6.0380000000000003,"15min":6.7009999999999996},"last":0.85999999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.3340000000000001,"15min":0.94699999999999995},"min":{"1min":0.45900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.6289999999999996,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.2350000000000001,"15min":0.97299999999999998},"min":{"1min":0.52300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":10.510999999999999,"5min":10.510999999999999,"15min":10.510999999999999},"last":1.0680000000000001}]},{"osd":4,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.9930000000000001,"15min":1.2609999999999999},"min":{"1min":0.59699999999999998,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":5.7949999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.6319999999999999,"15min":1.232},"min":{"1min":0.68899999999999995,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2310000000000001,"5min":18.065000000000001,"15min":18.065000000000001},"last":1.2689999999999999}]},{"osd":5,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.764,"15min":1.3169999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":1.1659999999999999,"5min":12.391999999999999,"15min":22.489000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.6839999999999999,"15min":1.2450000000000001},"min":{"1min":0.71899999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.0059999999999998,"5min":14.968999999999999,"15min":14.968999999999999},"last":1.0409999999999999}]},{"osd":6,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.657,"15min":1.214},"min":{"1min":0.53500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.6520000000000001,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6439999999999999,"15min":1.2010000000000001},"min":{"1min":0.66100000000000003,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":7.5060000000000002,"5min":12.553000000000001,"15min":12.553000000000001},"last":1.196}]},{"osd":7,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":2.0390000000000001,"15min":1.4330000000000001},"min":{"1min":0.57099999999999995,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":7.4210000000000003,"5min":13.663,"15min":13.663},"last":1.133},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4510000000000001,"15min":1.51},"min":{"1min":0.85699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.915,"5min":19.201000000000001,"15min":19.201000000000001},"last":1.1579999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575190,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.92700000000000005,"15min":0.78000000000000003},"min":{"1min":0.214,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.633,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":1.236,"15min":0.94099999999999995},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0779999999999998,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":0.88600000000000001},"min":{"1min":0.23000000000000001,"5min":0.20000000000000001,"15min":0.188},"max":{"1min":0.95799999999999996,"5min":13.961,"15min":13.961},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.0369999999999999,"15min":0.84499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.0740000000000001,"5min":14.760999999999999,"15min":14.760999999999999},"last":1.1919999999999999}]},{"osd":3,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":2.2909999999999999,"15min":1.458},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":1.6599999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.22},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.20399999999999999},"max":{"1min":1.548,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":1.3999999999999999,"15min":1.137},"min":{"1min":0.46999999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1319999999999999,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.2490000000000001,"15min":1.04},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":1.5980000000000001,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":3.3940000000000001,"15min":1.8720000000000001},"min":{"1min":0.46999999999999997,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":2.7490000000000001,"5min":68.162000000000006,"15min":68.162000000000006},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.8140000000000001,"15min":1.3080000000000001},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.444,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.095}]},{"osd":6,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.2210000000000001},"min":{"1min":0.60499999999999998,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":14.032,"15min":14.032},"last":1.151},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.405,"15min":1.1379999999999999},"min":{"1min":0.58799999999999997,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":2.9079999999999999,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.25}]},{"osd":7,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":2.4660000000000002,"15min":1.677},"min":{"1min":0.60099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.7749999999999999,"5min":26.881,"15min":26.881},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.738,"15min":1.339},"min":{"1min":0.45900000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":7.1429999999999998,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.2170000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.879,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.877,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":1.0329999999999999,"15min":0.84699999999999998},"min":{"1min":0.36099999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.96599999999999997,"5min":8.8330000000000002,"15min":13.305},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":1.093,"15min":0.82699999999999996},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.98599999999999999,"5min":15.212,"15min":15.212},"last":0.625},{"interface":"front","average":{"1min":0.81899999999999995,"5min":1.095,"15min":0.83399999999999996},"min":{"1min":0.376,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":1.137,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.85999999999999999},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":1.3140000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98299999999999998,"15min":0.94899999999999995},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.26300000000000001},"max":{"1min":1.375,"5min":6.758,"15min":6.758},"last":1.0189999999999999}]},{"osd":4,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.502,"15min":1.1040000000000001},"min":{"1min":0.47299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":18.407,"15min":18.407},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.4750000000000001,"15min":1.097},"min":{"1min":0.61699999999999999,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.226,"5min":18.466999999999999,"15min":18.466999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":2.0470000000000002,"15min":1.3080000000000001},"min":{"1min":0.629,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":1.147,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.671,"15min":1.1919999999999999},"min":{"1min":0.66800000000000004,"5min":0.312,"15min":0.312},"max":{"1min":1.5289999999999999,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.3939999999999999,"15min":1.1000000000000001},"min":{"1min":0.63500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.611,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.421,"15min":1.131},"min":{"1min":0.497,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":1.444,"5min":8.9870000000000001,"15min":11.597},"last":0.82499999999999996}]},{"osd":7,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":2.0030000000000001,"15min":1.417},"min":{"1min":0.89200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.718,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":2.0470000000000002,"15min":1.504},"min":{"1min":0.85899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.79,"5min":18.788,"15min":18.788},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.132 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.133 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.134 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.134 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.134 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.134 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.134 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T20:27:07.421269+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=7, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.135 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.136 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.137 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.138 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.139 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.140 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:26.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T20:55:29.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:29.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:46.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 Processor -- start 2024-05-08T20:55:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 -- start start 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ba80c1bb0 0x7f0ba8151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0ba81535a0 0x7f0ba815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba80c2420 con 0x7f0ba80c1f90 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba8155060 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0bae181640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba8155340 con 0x7f0ba81535a0 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0ba77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ba80c1bb0 0x7f0ba8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0ba6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ba80c1f90 0x7f0ba8152e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48074/0 (socket says 172.21.15.81:48074) 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0ba77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ba80c1bb0 0x7f0ba8151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51210/0 (socket says 172.21.15.81:51210) 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.272+0000 7f0ba6ffd640 1 -- 172.21.15.81:0/1995920052 learned_addr learned my addr 172.21.15.81:0/1995920052 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba7fff640 1 --2- 172.21.15.81:0/1995920052 >> v2:172.21.15.117:3300/0 conn(0x7f0ba81535a0 0x7f0ba815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba77fe640 1 -- 172.21.15.81:0/1995920052 >> v2:172.21.15.117:3300/0 conn(0x7f0ba81535a0 msgr2=0x7f0ba815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba77fe640 1 --2- 172.21.15.81:0/1995920052 >> v2:172.21.15.117:3300/0 conn(0x7f0ba81535a0 0x7f0ba815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba77fe640 1 -- 172.21.15.81:0/1995920052 >> v1:172.21.15.81:6789/0 conn(0x7f0ba80c1f90 legacy=0x7f0ba8152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba77fe640 1 -- 172.21.15.81:0/1995920052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8155620 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba77fe640 1 --2- 172.21.15.81:0/1995920052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba80c1bb0 0x7f0ba8151740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0ba806f190 tx=0x7f0b9c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a7e3a29605a604 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba67fc640 1 -- 172.21.15.81:0/1995920052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0ac600 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba67fc640 1 -- 172.21.15.81:0/1995920052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c0a8050 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0ba67fc640 1 -- 172.21.15.81:0/1995920052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0ac980 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 -- 172.21.15.81:0/1995920052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba80c1bb0 msgr2=0x7f0ba8151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 --2- 172.21.15.81:0/1995920052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba80c1bb0 0x7f0ba8151740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0ba806f190 tx=0x7f0b9c01c3c0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 -- 172.21.15.81:0/1995920052 shutdown_connections 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 --2- 172.21.15.81:0/1995920052 >> v2:172.21.15.117:3300/0 conn(0x7f0ba81535a0 0x7f0ba815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 --2- 172.21.15.81:0/1995920052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba80c1bb0 0x7f0ba8151740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 -- 172.21.15.81:0/1995920052 >> 172.21.15.81:0/1995920052 conn(0x7f0ba80c2ca0 msgr2=0x7f0ba80c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 -- 172.21.15.81:0/1995920052 shutdown_connections 2024-05-08T20:55:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.276+0000 7f0bae181640 1 -- 172.21.15.81:0/1995920052 wait complete. 2024-05-08T20:55:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 Processor -- start 2024-05-08T20:55:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- start start 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba80c1bb0 0x7f0ba814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 0x7f0ba814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80be230 con 0x7f0ba81535a0 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81eae00 con 0x7f0ba80c1f90 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81eb0e0 con 0x7f0ba80c1bb0 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51212/0 (socket says 172.21.15.81:51212) 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 -- 172.21.15.81:0/4019919232 learned_addr learned my addr 172.21.15.81:0/4019919232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba6ffd640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 0x7f0ba814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba77fe640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba80c1bb0 0x7f0ba814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 -- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba80c1bb0 msgr2=0x7f0ba814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba80c1bb0 0x7f0ba814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 -- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 msgr2=0x7f0ba814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 0x7f0ba814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 -- 172.21.15.81:0/4019919232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009420 con 0x7f0ba81535a0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba6ffd640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 0x7f0ba814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0ba7fff640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007e40 tx=0x7f0ba000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0014620 con 0x7f0ba81535a0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba000ee90 con 0x7f0ba81535a0 2024-05-08T20:55:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba81eb3c0 con 0x7f0ba81535a0 2024-05-08T20:55:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00149e0 con 0x7f0ba81535a0 2024-05-08T20:55:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba814e930 con 0x7f0ba81535a0 2024-05-08T20:55:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8154c70 con 0x7f0ba81535a0 2024-05-08T20:55:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.280+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ba0014b40 con 0x7f0ba81535a0 2024-05-08T20:55:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.284+0000 7f0b8ffff640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 0x7f0b94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.284+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0ba0084ed0 con 0x7f0ba81535a0 2024-05-08T20:55:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.284+0000 7f0ba77fe640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 0x7f0b94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.284+0000 7f0ba77fe640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 0x7f0b94068b50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0ae000 tx=0x7f0b9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.288+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0ba0051f30 con 0x7f0ba81535a0 2024-05-08T20:55:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.440+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ba81eaf70 con 0x7f0b94066690 2024-05-08T20:55:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.480+0000 7f0b8ffff640 1 -- 172.21.15.81:0/4019919232 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531734 (secure 0 0 0) 0x7f0ba81eaf70 con 0x7f0b94066690 2024-05-08T20:55:46.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:55:46.493 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 msgr2=0x7f0b94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 0x7f0b94068b50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0ae000 tx=0x7f0b9c008040 comp rx=0 tx=0).stop 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 msgr2=0x7f0ba814d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0007e40 tx=0x7f0ba000e4b0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 shutdown_connections 2024-05-08T20:55:46.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f0b94066690 0x7f0b94068b50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba81535a0 0x7f0ba814d9e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80c1f90 0x7f0ba814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 --2- 172.21.15.81:0/4019919232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba80c1bb0 0x7f0ba814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 >> 172.21.15.81:0/4019919232 conn(0x7f0ba80c2ca0 msgr2=0x7f0ba8152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 shutdown_connections 2024-05-08T20:55:46.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:55:46.488+0000 7f0bae181640 1 -- 172.21.15.81:0/4019919232 wait complete. 2024-05-08T20:55:46.512 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":878,"stamp":"2024-05-08T20:55:45.921733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622922,"ondisk_log_size":622922,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005839"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.075935+0000","last_change":"2024-05-08T20:55:27.076189+0000","last_active":"2024-05-08T20:55:27.075935+0000","last_peered":"2024-05-08T20:55:27.075935+0000","last_clean":"2024-05-08T20:55:27.075935+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:55:27.075935+0000","last_undegraded":"2024-05-08T20:55:27.075935+0000","last_fullsized":"2024-05-08T20:55:27.075935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4778","last_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_deep_scrub":"26'4778","last_deep_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.075881+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:10.493830+0000","scrub_duration":0.060369219000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'767","reported_seq":809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.034026+0000","last_change":"2024-05-08T20:54:52.034318+0000","last_active":"2024-05-08T20:54:52.034026+0000","last_peered":"2024-05-08T20:54:52.034026+0000","last_clean":"2024-05-08T20:54:52.034026+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:52.034026+0000","last_undegraded":"2024-05-08T20:54:52.034026+0000","last_fullsized":"2024-05-08T20:54:52.034026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'767","last_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_deep_scrub":"26'767","last_deep_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.033968+0000","objects_scrubbed":3,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.997884+0000","scrub_duration":0.095634259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5356,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.354589+0000","last_change":"2024-05-08T20:55:25.354823+0000","last_active":"2024-05-08T20:55:25.354589+0000","last_peered":"2024-05-08T20:55:25.354589+0000","last_clean":"2024-05-08T20:55:25.354589+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:55:25.354589+0000","last_undegraded":"2024-05-08T20:55:25.354589+0000","last_fullsized":"2024-05-08T20:55:25.354589+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5314","last_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_deep_scrub":"26'5314","last_deep_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.354534+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.054489+0000","scrub_duration":0.015367578999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.318767+0000","last_change":"2024-05-08T20:54:58.319009+0000","last_active":"2024-05-08T20:54:58.318767+0000","last_peered":"2024-05-08T20:54:58.318767+0000","last_clean":"2024-05-08T20:54:58.318767+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:58.318767+0000","last_undegraded":"2024-05-08T20:54:58.318767+0000","last_fullsized":"2024-05-08T20:54:58.318767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.318713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:57.774502+0000","scrub_duration":0.0077592889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.695146+0000","last_change":"2024-05-08T20:55:40.695305+0000","last_active":"2024-05-08T20:55:40.695146+0000","last_peered":"2024-05-08T20:55:40.695146+0000","last_clean":"2024-05-08T20:55:40.695146+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:55:40.695146+0000","last_undegraded":"2024-05-08T20:55:40.695146+0000","last_fullsized":"2024-05-08T20:55:40.695146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5153","last_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_deep_scrub":"26'5153","last_deep_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.695112+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:29.089686+0000","scrub_duration":0.10690976200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.320721+0000","last_change":"2024-05-08T20:55:24.320973+0000","last_active":"2024-05-08T20:55:24.320721+0000","last_peered":"2024-05-08T20:55:24.320721+0000","last_clean":"2024-05-08T20:55:24.320721+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:55:24.320721+0000","last_undegraded":"2024-05-08T20:55:24.320721+0000","last_fullsized":"2024-05-08T20:55:24.320721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.320666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:33.689682+0000","scrub_duration":0.0078549569999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.962764+0000","last_change":"2024-05-08T20:55:21.962980+0000","last_active":"2024-05-08T20:55:21.962764+0000","last_peered":"2024-05-08T20:55:21.962764+0000","last_clean":"2024-05-08T20:55:21.962764+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:55:21.962764+0000","last_undegraded":"2024-05-08T20:55:21.962764+0000","last_fullsized":"2024-05-08T20:55:21.962764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.962709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:06.689855+0000","scrub_duration":0.0035857630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976543+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:44.976543+0000","last_peered":"2024-05-08T20:54:44.976543+0000","last_clean":"2024-05-08T20:54:44.976543+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:44.976543+0000","last_undegraded":"2024-05-08T20:54:44.976543+0000","last_fullsized":"2024-05-08T20:54:44.976543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975997+0000","last_change":"2024-05-08T20:27:18.531854+0000","last_active":"2024-05-08T20:54:44.975997+0000","last_peered":"2024-05-08T20:54:44.975997+0000","last_clean":"2024-05-08T20:54:44.975997+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:54:44.975997+0000","last_undegraded":"2024-05-08T20:54:44.975997+0000","last_fullsized":"2024-05-08T20:54:44.975997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.217320+0000","last_change":"2024-05-08T20:54:58.217575+0000","last_active":"2024-05-08T20:54:58.217320+0000","last_peered":"2024-05-08T20:54:58.217320+0000","last_clean":"2024-05-08T20:54:58.217320+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:58.217320+0000","last_undegraded":"2024-05-08T20:54:58.217320+0000","last_fullsized":"2024-05-08T20:54:58.217320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.217264+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:04.029681+0000","scrub_duration":0.019522241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'619","reported_seq":655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.174972+0000","last_change":"2024-05-08T20:54:55.174972+0000","last_active":"2024-05-08T20:54:55.174972+0000","last_peered":"2024-05-08T20:54:55.174972+0000","last_clean":"2024-05-08T20:54:55.174972+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:55.174972+0000","last_undegraded":"2024-05-08T20:54:55.174972+0000","last_fullsized":"2024-05-08T20:54:55.174972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'619","last_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_deep_scrub":"26'619","last_deep_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.174692+0000","objects_scrubbed":1,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:43.612782+0000","scrub_duration":0.059475472000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.147415+0000","last_change":"2024-05-08T20:55:11.147679+0000","last_active":"2024-05-08T20:55:11.147415+0000","last_peered":"2024-05-08T20:55:11.147415+0000","last_clean":"2024-05-08T20:55:11.147415+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:55:11.147415+0000","last_undegraded":"2024-05-08T20:55:11.147415+0000","last_fullsized":"2024-05-08T20:55:11.147415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3818","last_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_deep_scrub":"26'3818","last_deep_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.147361+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:52.832177+0000","scrub_duration":0.046126465999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.673307+0000","last_change":"2024-05-08T20:55:33.673559+0000","last_active":"2024-05-08T20:55:33.673307+0000","last_peered":"2024-05-08T20:55:33.673307+0000","last_clean":"2024-05-08T20:55:33.673307+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:55:33.673307+0000","last_undegraded":"2024-05-08T20:55:33.673307+0000","last_fullsized":"2024-05-08T20:55:33.673307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.673248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:18.931451+0000","scrub_duration":0.0067036639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.186266+0000","last_change":"2024-05-08T20:54:51.186266+0000","last_active":"2024-05-08T20:54:51.186266+0000","last_peered":"2024-05-08T20:54:51.186266+0000","last_clean":"2024-05-08T20:54:51.186266+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:51.186266+0000","last_undegraded":"2024-05-08T20:54:51.186266+0000","last_fullsized":"2024-05-08T20:54:51.186266+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6790","last_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_deep_scrub":"26'6790","last_deep_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.185945+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:12.471228+0000","scrub_duration":0.025898879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.145576+0000","last_change":"2024-05-08T20:54:52.145576+0000","last_active":"2024-05-08T20:54:52.145576+0000","last_peered":"2024-05-08T20:54:52.145576+0000","last_clean":"2024-05-08T20:54:52.145576+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:52.145576+0000","last_undegraded":"2024-05-08T20:54:52.145576+0000","last_fullsized":"2024-05-08T20:54:52.145576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.145299+0000","objects_scrubbed":1,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:17.689064+0000","scrub_duration":0.013037381000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.647773+0000","last_change":"2024-05-08T20:55:33.647883+0000","last_active":"2024-05-08T20:55:33.647773+0000","last_peered":"2024-05-08T20:55:33.647773+0000","last_clean":"2024-05-08T20:55:33.647773+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:55:33.647773+0000","last_undegraded":"2024-05-08T20:55:33.647773+0000","last_fullsized":"2024-05-08T20:55:33.647773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4662","last_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_deep_scrub":"26'4662","last_deep_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.647749+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:01.916015+0000","scrub_duration":0.126015248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.576011+0000","last_change":"2024-05-08T20:55:08.576011+0000","last_active":"2024-05-08T20:55:08.576011+0000","last_peered":"2024-05-08T20:55:08.576011+0000","last_clean":"2024-05-08T20:55:08.576011+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:55:08.576011+0000","last_undegraded":"2024-05-08T20:55:08.576011+0000","last_fullsized":"2024-05-08T20:55:08.576011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5323","last_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_deep_scrub":"26'5323","last_deep_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.575724+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:03.281285+0000","scrub_duration":0.015670814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1107","reported_seq":1148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.662027+0000","last_change":"2024-05-08T20:55:40.662250+0000","last_active":"2024-05-08T20:55:40.662027+0000","last_peered":"2024-05-08T20:55:40.662027+0000","last_clean":"2024-05-08T20:55:40.662027+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:55:40.662027+0000","last_undegraded":"2024-05-08T20:55:40.662027+0000","last_fullsized":"2024-05-08T20:55:40.662027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1107","last_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_deep_scrub":"26'1107","last_deep_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.661973+0000","objects_scrubbed":2,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:39.070710+0000","scrub_duration":0.029834421999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.298281+0000","last_change":"2024-05-08T20:54:46.298581+0000","last_active":"2024-05-08T20:54:46.298281+0000","last_peered":"2024-05-08T20:54:46.298281+0000","last_clean":"2024-05-08T20:54:46.298281+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:46.298281+0000","last_undegraded":"2024-05-08T20:54:46.298281+0000","last_fullsized":"2024-05-08T20:54:46.298281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.298228+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:28.684882+0000","scrub_duration":0.047052471999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.551738+0000","last_change":"2024-05-08T20:55:08.552011+0000","last_active":"2024-05-08T20:55:08.551738+0000","last_peered":"2024-05-08T20:55:08.551738+0000","last_clean":"2024-05-08T20:55:08.551738+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:55:08.551738+0000","last_undegraded":"2024-05-08T20:55:08.551738+0000","last_fullsized":"2024-05-08T20:55:08.551738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4342","last_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_deep_scrub":"26'4342","last_deep_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.551682+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:49.967545+0000","scrub_duration":0.065785658999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.490880+0000","last_change":"2024-05-08T20:55:30.491109+0000","last_active":"2024-05-08T20:55:30.490880+0000","last_peered":"2024-05-08T20:55:30.490880+0000","last_clean":"2024-05-08T20:55:30.490880+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:55:30.490880+0000","last_undegraded":"2024-05-08T20:55:30.490880+0000","last_fullsized":"2024-05-08T20:55:30.490880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4762","last_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_deep_scrub":"26'4762","last_deep_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.490824+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:39.900078+0000","scrub_duration":0.031951308999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.642343+0000","last_change":"2024-05-08T20:55:14.642343+0000","last_active":"2024-05-08T20:55:14.642343+0000","last_peered":"2024-05-08T20:55:14.642343+0000","last_clean":"2024-05-08T20:55:14.642343+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:55:14.642343+0000","last_undegraded":"2024-05-08T20:55:14.642343+0000","last_fullsized":"2024-05-08T20:55:14.642343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.642037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:30.640727+0000","scrub_duration":0.0074746580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.127560+0000","last_change":"2024-05-08T20:54:59.127778+0000","last_active":"2024-05-08T20:54:59.127560+0000","last_peered":"2024-05-08T20:54:59.127560+0000","last_clean":"2024-05-08T20:54:59.127560+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:59.127560+0000","last_undegraded":"2024-05-08T20:54:59.127560+0000","last_fullsized":"2024-05-08T20:54:59.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.127504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:30.421435+0000","scrub_duration":0.0034702330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3475,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.028473+0000","last_change":"2024-05-08T20:55:29.028690+0000","last_active":"2024-05-08T20:55:29.028473+0000","last_peered":"2024-05-08T20:55:29.028473+0000","last_clean":"2024-05-08T20:55:29.028473+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:55:29.028473+0000","last_undegraded":"2024-05-08T20:55:29.028473+0000","last_fullsized":"2024-05-08T20:55:29.028473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3439","last_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_deep_scrub":"26'3439","last_deep_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.028429+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:19.936303+0000","scrub_duration":0.056611084999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.443400+0000","last_change":"2024-05-08T20:55:29.443400+0000","last_active":"2024-05-08T20:55:29.443400+0000","last_peered":"2024-05-08T20:55:29.443400+0000","last_clean":"2024-05-08T20:55:29.443400+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:55:29.443400+0000","last_undegraded":"2024-05-08T20:55:29.443400+0000","last_fullsized":"2024-05-08T20:55:29.443400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4943","last_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_deep_scrub":"26'4943","last_deep_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.442961+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.926108+0000","scrub_duration":0.022816175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.671190+0000","last_change":"2024-05-08T20:55:13.671190+0000","last_active":"2024-05-08T20:55:13.671190+0000","last_peered":"2024-05-08T20:55:13.671190+0000","last_clean":"2024-05-08T20:55:13.671190+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:55:13.671190+0000","last_undegraded":"2024-05-08T20:55:13.671190+0000","last_fullsized":"2024-05-08T20:55:13.671190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.670918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:25.637941+0000","scrub_duration":0.0076373999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.870480+0000","last_change":"2024-05-08T20:54:56.870718+0000","last_active":"2024-05-08T20:54:56.870480+0000","last_peered":"2024-05-08T20:54:56.870480+0000","last_clean":"2024-05-08T20:54:56.870480+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:56.870480+0000","last_undegraded":"2024-05-08T20:54:56.870480+0000","last_fullsized":"2024-05-08T20:54:56.870480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.870433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:43.134102+0000","scrub_duration":0.054762970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5796,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.968995+0000","last_change":"2024-05-08T20:27:28.013709+0000","last_active":"2024-05-08T20:54:40.968995+0000","last_peered":"2024-05-08T20:54:40.968995+0000","last_clean":"2024-05-08T20:54:40.968995+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:54:40.968995+0000","last_undegraded":"2024-05-08T20:54:40.968995+0000","last_fullsized":"2024-05-08T20:54:40.968995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.863669+0000","last_change":"2024-05-08T20:55:11.863669+0000","last_active":"2024-05-08T20:55:11.863669+0000","last_peered":"2024-05-08T20:55:11.863669+0000","last_clean":"2024-05-08T20:55:11.863669+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:55:11.863669+0000","last_undegraded":"2024-05-08T20:55:11.863669+0000","last_fullsized":"2024-05-08T20:55:11.863669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4668","last_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_deep_scrub":"26'4668","last_deep_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.863229+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:40.887182+0000","scrub_duration":0.013718674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975893+0000","last_change":"2024-05-08T20:27:18.520429+0000","last_active":"2024-05-08T20:54:44.975893+0000","last_peered":"2024-05-08T20:54:44.975893+0000","last_clean":"2024-05-08T20:54:44.975893+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:54:44.975893+0000","last_undegraded":"2024-05-08T20:54:44.975893+0000","last_fullsized":"2024-05-08T20:54:44.975893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:17.471859+0000","last_clean_scrub_stamp":"2024-05-08T20:27:17.471859+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.185941+0000","last_change":"2024-05-08T20:54:44.186218+0000","last_active":"2024-05-08T20:54:44.185941+0000","last_peered":"2024-05-08T20:54:44.185941+0000","last_clean":"2024-05-08T20:54:44.185941+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:44.185941+0000","last_undegraded":"2024-05-08T20:54:44.185941+0000","last_fullsized":"2024-05-08T20:54:44.185941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_clean_scrub_stamp":"2024-05-08T20:54:44.185881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:49.152153+0000","scrub_duration":0.0071163260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.468990+0000","last_change":"2024-05-08T20:55:14.468990+0000","last_active":"2024-05-08T20:55:14.468990+0000","last_peered":"2024-05-08T20:55:14.468990+0000","last_clean":"2024-05-08T20:55:14.468990+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:55:14.468990+0000","last_undegraded":"2024-05-08T20:55:14.468990+0000","last_fullsized":"2024-05-08T20:55:14.468990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3392","last_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_deep_scrub":"26'3392","last_deep_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.468610+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:17.529243+0000","scrub_duration":0.100340728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.043067+0000","last_change":"2024-05-08T20:54:59.043067+0000","last_active":"2024-05-08T20:54:59.043067+0000","last_peered":"2024-05-08T20:54:59.043067+0000","last_clean":"2024-05-08T20:54:59.043067+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:59.043067+0000","last_undegraded":"2024-05-08T20:54:59.043067+0000","last_fullsized":"2024-05-08T20:54:59.043067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6011","last_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_deep_scrub":"26'6011","last_deep_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.042843+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:03.715065+0000","scrub_duration":0.062194480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'9","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.549940+0000","last_change":"2024-05-08T20:54:55.549940+0000","last_active":"2024-05-08T20:54:55.549940+0000","last_peered":"2024-05-08T20:54:55.549940+0000","last_clean":"2024-05-08T20:54:55.549940+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:54:55.549940+0000","last_undegraded":"2024-05-08T20:54:55.549940+0000","last_fullsized":"2024-05-08T20:54:55.549940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.549635+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:30.768311+0000","scrub_duration":0.012030836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'65","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.950830+0000","last_change":"2024-05-08T20:55:22.951068+0000","last_active":"2024-05-08T20:55:22.950830+0000","last_peered":"2024-05-08T20:55:22.950830+0000","last_clean":"2024-05-08T20:55:22.950830+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:55:22.950830+0000","last_undegraded":"2024-05-08T20:55:22.950830+0000","last_fullsized":"2024-05-08T20:55:22.950830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.950775+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:09.874263+0000","scrub_duration":0.0069395639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4017,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.923004+0000","last_change":"2024-05-08T20:55:34.923234+0000","last_active":"2024-05-08T20:55:34.923004+0000","last_peered":"2024-05-08T20:55:34.923004+0000","last_clean":"2024-05-08T20:55:34.923004+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:55:34.923004+0000","last_undegraded":"2024-05-08T20:55:34.923004+0000","last_fullsized":"2024-05-08T20:55:34.923004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3980","last_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_deep_scrub":"26'3980","last_deep_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.922959+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:15.764076+0000","scrub_duration":0.048454346000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4708,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.222714+0000","last_change":"2024-05-08T20:55:20.222714+0000","last_active":"2024-05-08T20:55:20.222714+0000","last_peered":"2024-05-08T20:55:20.222714+0000","last_clean":"2024-05-08T20:55:20.222714+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:55:20.222714+0000","last_undegraded":"2024-05-08T20:55:20.222714+0000","last_fullsized":"2024-05-08T20:55:20.222714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.222435+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:22.265649+0000","scrub_duration":0.010318590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'255","reported_seq":297,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.700383+0000","last_change":"2024-05-08T20:55:11.700383+0000","last_active":"2024-05-08T20:55:11.700383+0000","last_peered":"2024-05-08T20:55:11.700383+0000","last_clean":"2024-05-08T20:55:11.700383+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:55:11.700383+0000","last_undegraded":"2024-05-08T20:55:11.700383+0000","last_fullsized":"2024-05-08T20:55:11.700383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'255","last_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_deep_scrub":"26'255","last_deep_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.700078+0000","objects_scrubbed":1,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:05.942160+0000","scrub_duration":0.012718293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.476447+0000","last_change":"2024-05-08T20:55:09.476447+0000","last_active":"2024-05-08T20:55:09.476447+0000","last_peered":"2024-05-08T20:55:09.476447+0000","last_clean":"2024-05-08T20:55:09.476447+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:55:09.476447+0000","last_undegraded":"2024-05-08T20:55:09.476447+0000","last_fullsized":"2024-05-08T20:55:09.476447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.476143+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:20.326575+0000","scrub_duration":0.0053068539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.579958+0000","last_change":"2024-05-08T20:55:27.580135+0000","last_active":"2024-05-08T20:55:27.579958+0000","last_peered":"2024-05-08T20:55:27.579958+0000","last_clean":"2024-05-08T20:55:27.579958+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:55:27.579958+0000","last_undegraded":"2024-05-08T20:55:27.579958+0000","last_fullsized":"2024-05-08T20:55:27.579958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4309","last_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_deep_scrub":"26'4309","last_deep_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.579920+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:08.630417+0000","scrub_duration":0.096292584000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6877,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.661513+0000","last_change":"2024-05-08T20:55:20.661789+0000","last_active":"2024-05-08T20:55:20.661513+0000","last_peered":"2024-05-08T20:55:20.661513+0000","last_clean":"2024-05-08T20:55:20.661513+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:55:20.661513+0000","last_undegraded":"2024-05-08T20:55:20.661513+0000","last_fullsized":"2024-05-08T20:55:20.661513+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6836","last_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_deep_scrub":"26'6836","last_deep_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.661466+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.019245+0000","scrub_duration":0.046721182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.679878+0000","last_change":"2024-05-08T20:55:35.680097+0000","last_active":"2024-05-08T20:55:35.679878+0000","last_peered":"2024-05-08T20:55:35.679878+0000","last_clean":"2024-05-08T20:55:35.679878+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:55:35.679878+0000","last_undegraded":"2024-05-08T20:55:35.679878+0000","last_fullsized":"2024-05-08T20:55:35.679878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.679823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:18.016597+0000","scrub_duration":0.0038273439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.016256+0000","last_change":"2024-05-08T20:55:07.016519+0000","last_active":"2024-05-08T20:55:07.016256+0000","last_peered":"2024-05-08T20:55:07.016256+0000","last_clean":"2024-05-08T20:55:07.016256+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:55:07.016256+0000","last_undegraded":"2024-05-08T20:55:07.016256+0000","last_fullsized":"2024-05-08T20:55:07.016256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.016198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:21.537191+0000","scrub_duration":0.034043589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4660,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.044003+0000","last_change":"2024-05-08T20:55:18.044138+0000","last_active":"2024-05-08T20:55:18.044003+0000","last_peered":"2024-05-08T20:55:18.044003+0000","last_clean":"2024-05-08T20:55:18.044003+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:55:18.044003+0000","last_undegraded":"2024-05-08T20:55:18.044003+0000","last_fullsized":"2024-05-08T20:55:18.044003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4623","last_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_deep_scrub":"26'4623","last_deep_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.043977+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:18.907698+0000","scrub_duration":0.113151719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.149350+0000","last_change":"2024-05-08T20:54:50.149623+0000","last_active":"2024-05-08T20:54:50.149350+0000","last_peered":"2024-05-08T20:54:50.149350+0000","last_clean":"2024-05-08T20:54:50.149350+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:50.149350+0000","last_undegraded":"2024-05-08T20:54:50.149350+0000","last_fullsized":"2024-05-08T20:54:50.149350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4622","last_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_deep_scrub":"26'4622","last_deep_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.149296+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:43.672383+0000","scrub_duration":0.028645501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.677449+0000","last_change":"2024-05-08T20:55:09.677733+0000","last_active":"2024-05-08T20:55:09.677449+0000","last_peered":"2024-05-08T20:55:09.677449+0000","last_clean":"2024-05-08T20:55:09.677449+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:55:09.677449+0000","last_undegraded":"2024-05-08T20:55:09.677449+0000","last_fullsized":"2024-05-08T20:55:09.677449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.677387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:52.277246+0000","scrub_duration":0.0096814850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.802099+0000","last_change":"2024-05-08T20:54:45.802328+0000","last_active":"2024-05-08T20:54:45.802099+0000","last_peered":"2024-05-08T20:54:45.802099+0000","last_clean":"2024-05-08T20:54:45.802099+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:45.802099+0000","last_undegraded":"2024-05-08T20:54:45.802099+0000","last_fullsized":"2024-05-08T20:54:45.802099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.802044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:29.693595+0000","scrub_duration":0.0040510620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.092766+0000","last_change":"2024-05-08T20:55:22.093023+0000","last_active":"2024-05-08T20:55:22.092766+0000","last_peered":"2024-05-08T20:55:22.092766+0000","last_clean":"2024-05-08T20:55:22.092766+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:55:22.092766+0000","last_undegraded":"2024-05-08T20:55:22.092766+0000","last_fullsized":"2024-05-08T20:55:22.092766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4079","last_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_deep_scrub":"26'4079","last_deep_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.092719+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:36.160004+0000","scrub_duration":0.119144502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.951072+0000","last_change":"2024-05-08T20:55:15.951284+0000","last_active":"2024-05-08T20:55:15.951072+0000","last_peered":"2024-05-08T20:55:15.951072+0000","last_clean":"2024-05-08T20:55:15.951072+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:55:15.951072+0000","last_undegraded":"2024-05-08T20:55:15.951072+0000","last_fullsized":"2024-05-08T20:55:15.951072+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5879","last_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_deep_scrub":"26'5879","last_deep_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.951022+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:30.374831+0000","scrub_duration":0.045408759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.176230+0000","last_change":"2024-05-08T20:55:29.176471+0000","last_active":"2024-05-08T20:55:29.176230+0000","last_peered":"2024-05-08T20:55:29.176230+0000","last_clean":"2024-05-08T20:55:29.176230+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:55:29.176230+0000","last_undegraded":"2024-05-08T20:55:29.176230+0000","last_fullsized":"2024-05-08T20:55:29.176230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.176178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:58.118118+0000","scrub_duration":0.0061181179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.723537+0000","last_change":"2024-05-08T20:54:43.723653+0000","last_active":"2024-05-08T20:54:43.723537+0000","last_peered":"2024-05-08T20:54:43.723537+0000","last_clean":"2024-05-08T20:54:43.723537+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:43.723537+0000","last_undegraded":"2024-05-08T20:54:43.723537+0000","last_fullsized":"2024-05-08T20:54:43.723537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.723507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:06.949102+0000","scrub_duration":0.001729041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.506331+0000","last_change":"2024-05-08T20:55:06.506331+0000","last_active":"2024-05-08T20:55:06.506331+0000","last_peered":"2024-05-08T20:55:06.506331+0000","last_clean":"2024-05-08T20:55:06.506331+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:55:06.506331+0000","last_undegraded":"2024-05-08T20:55:06.506331+0000","last_fullsized":"2024-05-08T20:55:06.506331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.506041+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:14.298193+0000","scrub_duration":0.090320424999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.609510+0000","last_change":"2024-05-08T20:55:17.609510+0000","last_active":"2024-05-08T20:55:17.609510+0000","last_peered":"2024-05-08T20:55:17.609510+0000","last_clean":"2024-05-08T20:55:17.609510+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:55:17.609510+0000","last_undegraded":"2024-05-08T20:55:17.609510+0000","last_fullsized":"2024-05-08T20:55:17.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4755","last_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_deep_scrub":"26'4755","last_deep_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.609211+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.114442+0000","scrub_duration":0.021058222000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'73","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.584883+0000","last_change":"2024-05-08T20:54:47.585094+0000","last_active":"2024-05-08T20:54:47.584883+0000","last_peered":"2024-05-08T20:54:47.584883+0000","last_clean":"2024-05-08T20:54:47.584883+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:47.584883+0000","last_undegraded":"2024-05-08T20:54:47.584883+0000","last_fullsized":"2024-05-08T20:54:47.584883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.584829+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.762899+0000","scrub_duration":0.021519024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.758169+0000","last_change":"2024-05-08T20:54:48.758169+0000","last_active":"2024-05-08T20:54:48.758169+0000","last_peered":"2024-05-08T20:54:48.758169+0000","last_clean":"2024-05-08T20:54:48.758169+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:48.758169+0000","last_undegraded":"2024-05-08T20:54:48.758169+0000","last_fullsized":"2024-05-08T20:54:48.758169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.757894+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:28.411623+0000","scrub_duration":0.026700504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3654,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079606+0000","last_change":"2024-05-08T20:27:27.995360+0000","last_active":"2024-05-08T20:54:44.079606+0000","last_peered":"2024-05-08T20:54:44.079606+0000","last_clean":"2024-05-08T20:54:44.079606+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:54:44.079606+0000","last_undegraded":"2024-05-08T20:54:44.079606+0000","last_fullsized":"2024-05-08T20:54:44.079606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":5008,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.005590+0000","last_change":"2024-05-08T20:54:55.005875+0000","last_active":"2024-05-08T20:54:55.005590+0000","last_peered":"2024-05-08T20:54:55.005590+0000","last_clean":"2024-05-08T20:54:55.005590+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:55.005590+0000","last_undegraded":"2024-05-08T20:54:55.005590+0000","last_fullsized":"2024-05-08T20:54:55.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4967","last_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_deep_scrub":"26'4967","last_deep_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.005533+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:32.459770+0000","scrub_duration":0.055935091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.647597+0000","last_change":"2024-05-08T20:55:37.647809+0000","last_active":"2024-05-08T20:55:37.647597+0000","last_peered":"2024-05-08T20:55:37.647597+0000","last_clean":"2024-05-08T20:55:37.647597+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:55:37.647597+0000","last_undegraded":"2024-05-08T20:55:37.647597+0000","last_fullsized":"2024-05-08T20:55:37.647597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.647540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:23.038617+0000","scrub_duration":0.0036765499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'277","reported_seq":315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.959319+0000","last_change":"2024-05-08T20:55:07.959319+0000","last_active":"2024-05-08T20:55:07.959319+0000","last_peered":"2024-05-08T20:55:07.959319+0000","last_clean":"2024-05-08T20:55:07.959319+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:55:07.959319+0000","last_undegraded":"2024-05-08T20:55:07.959319+0000","last_fullsized":"2024-05-08T20:55:07.959319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.959046+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:19.805541+0000","scrub_duration":0.0082517920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713107+0000","last_change":"2024-05-08T20:27:27.994468+0000","last_active":"2024-05-08T20:54:40.713107+0000","last_peered":"2024-05-08T20:54:40.713107+0000","last_clean":"2024-05-08T20:54:40.713107+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:54:40.713107+0000","last_undegraded":"2024-05-08T20:54:40.713107+0000","last_fullsized":"2024-05-08T20:54:40.713107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.390992+0000","last_change":"2024-05-08T20:55:27.391236+0000","last_active":"2024-05-08T20:55:27.390992+0000","last_peered":"2024-05-08T20:55:27.390992+0000","last_clean":"2024-05-08T20:55:27.390992+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:55:27.390992+0000","last_undegraded":"2024-05-08T20:55:27.390992+0000","last_fullsized":"2024-05-08T20:55:27.390992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5070","last_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_deep_scrub":"26'5070","last_deep_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.390937+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:54.672683+0000","scrub_duration":0.014365846999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.183366+0000","last_change":"2024-05-08T20:55:30.183602+0000","last_active":"2024-05-08T20:55:30.183366+0000","last_peered":"2024-05-08T20:55:30.183366+0000","last_clean":"2024-05-08T20:55:30.183366+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:55:30.183366+0000","last_undegraded":"2024-05-08T20:55:30.183366+0000","last_fullsized":"2024-05-08T20:55:30.183366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.183311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:37.269932+0000","scrub_duration":0.010531156999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.799061+0000","last_change":"2024-05-08T20:55:29.799301+0000","last_active":"2024-05-08T20:55:29.799061+0000","last_peered":"2024-05-08T20:55:29.799061+0000","last_clean":"2024-05-08T20:55:29.799061+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:55:29.799061+0000","last_undegraded":"2024-05-08T20:55:29.799061+0000","last_fullsized":"2024-05-08T20:55:29.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.799005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:26.004174+0000","scrub_duration":0.010450918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.523201+0000","last_change":"2024-05-08T20:55:17.523419+0000","last_active":"2024-05-08T20:55:17.523201+0000","last_peered":"2024-05-08T20:55:17.523201+0000","last_clean":"2024-05-08T20:55:17.523201+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:55:17.523201+0000","last_undegraded":"2024-05-08T20:55:17.523201+0000","last_fullsized":"2024-05-08T20:55:17.523201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.523147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:26.971511+0000","scrub_duration":0.0037874789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.561694+0000","last_change":"2024-05-08T20:55:09.561956+0000","last_active":"2024-05-08T20:55:09.561694+0000","last_peered":"2024-05-08T20:55:09.561694+0000","last_clean":"2024-05-08T20:55:09.561694+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:55:09.561694+0000","last_undegraded":"2024-05-08T20:55:09.561694+0000","last_fullsized":"2024-05-08T20:55:09.561694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3754","last_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_deep_scrub":"26'3754","last_deep_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.561619+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.309817+0000","scrub_duration":0.072311814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.675660+0000","last_change":"2024-05-08T20:54:59.675908+0000","last_active":"2024-05-08T20:54:59.675660+0000","last_peered":"2024-05-08T20:54:59.675660+0000","last_clean":"2024-05-08T20:54:59.675660+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:59.675660+0000","last_undegraded":"2024-05-08T20:54:59.675660+0000","last_fullsized":"2024-05-08T20:54:59.675660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5554","last_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_deep_scrub":"26'5554","last_deep_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.675603+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:25.048100+0000","scrub_duration":0.019361314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.490516+0000","last_change":"2024-05-08T20:54:54.490784+0000","last_active":"2024-05-08T20:54:54.490516+0000","last_peered":"2024-05-08T20:54:54.490516+0000","last_clean":"2024-05-08T20:54:54.490516+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:54.490516+0000","last_undegraded":"2024-05-08T20:54:54.490516+0000","last_fullsized":"2024-05-08T20:54:54.490516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.490464+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:32.933174+0000","scrub_duration":0.0037125420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.537068+0000","last_change":"2024-05-08T20:55:11.537068+0000","last_active":"2024-05-08T20:55:11.537068+0000","last_peered":"2024-05-08T20:55:11.537068+0000","last_clean":"2024-05-08T20:55:11.537068+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:55:11.537068+0000","last_undegraded":"2024-05-08T20:55:11.537068+0000","last_fullsized":"2024-05-08T20:55:11.537068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.536797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:00.377575+0000","scrub_duration":0.0033698030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4049,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.521421+0000","last_change":"2024-05-08T20:55:07.521421+0000","last_active":"2024-05-08T20:55:07.521421+0000","last_peered":"2024-05-08T20:55:07.521421+0000","last_clean":"2024-05-08T20:55:07.521421+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:55:07.521421+0000","last_undegraded":"2024-05-08T20:55:07.521421+0000","last_fullsized":"2024-05-08T20:55:07.521421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4012","last_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_deep_scrub":"26'4012","last_deep_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.521110+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:03.444633+0000","scrub_duration":0.063926325000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5635,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.501804+0000","last_change":"2024-05-08T20:55:16.502074+0000","last_active":"2024-05-08T20:55:16.501804+0000","last_peered":"2024-05-08T20:55:16.501804+0000","last_clean":"2024-05-08T20:55:16.501804+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:55:16.501804+0000","last_undegraded":"2024-05-08T20:55:16.501804+0000","last_fullsized":"2024-05-08T20:55:16.501804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5601","last_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_deep_scrub":"26'5601","last_deep_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.501744+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:36.883976+0000","scrub_duration":0.012783813,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'7","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:12.704523+0000","last_change":"2024-05-08T20:55:12.704754+0000","last_active":"2024-05-08T20:55:12.704523+0000","last_peered":"2024-05-08T20:55:12.704523+0000","last_clean":"2024-05-08T20:55:12.704523+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:55:12.704523+0000","last_undegraded":"2024-05-08T20:55:12.704523+0000","last_fullsized":"2024-05-08T20:55:12.704523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_clean_scrub_stamp":"2024-05-08T20:55:12.704463+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:16.190314+0000","scrub_duration":0.023886415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1138","reported_seq":1175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.063954+0000","last_change":"2024-05-08T20:55:09.064235+0000","last_active":"2024-05-08T20:55:09.063954+0000","last_peered":"2024-05-08T20:55:09.063954+0000","last_clean":"2024-05-08T20:55:09.063954+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:55:09.063954+0000","last_undegraded":"2024-05-08T20:55:09.063954+0000","last_fullsized":"2024-05-08T20:55:09.063954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1138","last_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_deep_scrub":"26'1138","last_deep_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.063899+0000","objects_scrubbed":2,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:52.567416+0000","scrub_duration":0.080673476999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3859,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976512+0000","last_change":"2024-05-08T20:27:27.995733+0000","last_active":"2024-05-08T20:54:44.976512+0000","last_peered":"2024-05-08T20:54:44.976512+0000","last_clean":"2024-05-08T20:54:44.976512+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:54:44.976512+0000","last_undegraded":"2024-05-08T20:54:44.976512+0000","last_fullsized":"2024-05-08T20:54:44.976512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.820930+0000","last_change":"2024-05-08T20:55:24.821157+0000","last_active":"2024-05-08T20:55:24.820930+0000","last_peered":"2024-05-08T20:55:24.820930+0000","last_clean":"2024-05-08T20:55:24.820930+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:55:24.820930+0000","last_undegraded":"2024-05-08T20:55:24.820930+0000","last_fullsized":"2024-05-08T20:55:24.820930+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7221","last_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_deep_scrub":"26'7221","last_deep_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.820875+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:12.961351+0000","scrub_duration":0.011508404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.541242+0000","last_change":"2024-05-08T20:54:46.541548+0000","last_active":"2024-05-08T20:54:46.541242+0000","last_peered":"2024-05-08T20:54:46.541242+0000","last_clean":"2024-05-08T20:54:46.541242+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:46.541242+0000","last_undegraded":"2024-05-08T20:54:46.541242+0000","last_fullsized":"2024-05-08T20:54:46.541242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.541186+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:53.630432+0000","scrub_duration":0.014769915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.201979+0000","last_change":"2024-05-08T20:54:55.201979+0000","last_active":"2024-05-08T20:54:55.201979+0000","last_peered":"2024-05-08T20:54:55.201979+0000","last_clean":"2024-05-08T20:54:55.201979+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:55.201979+0000","last_undegraded":"2024-05-08T20:54:55.201979+0000","last_fullsized":"2024-05-08T20:54:55.201979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.201695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:39.510474+0000","scrub_duration":0.0064570130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3763,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.650155+0000","last_change":"2024-05-08T20:54:45.650155+0000","last_active":"2024-05-08T20:54:45.650155+0000","last_peered":"2024-05-08T20:54:45.650155+0000","last_clean":"2024-05-08T20:54:45.650155+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:45.650155+0000","last_undegraded":"2024-05-08T20:54:45.650155+0000","last_fullsized":"2024-05-08T20:54:45.650155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3726","last_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_deep_scrub":"26'3726","last_deep_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.649980+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:59.522800+0000","scrub_duration":0.11612742700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.738096+0000","last_change":"2024-05-08T20:55:21.738325+0000","last_active":"2024-05-08T20:55:21.738096+0000","last_peered":"2024-05-08T20:55:21.738096+0000","last_clean":"2024-05-08T20:55:21.738096+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:55:21.738096+0000","last_undegraded":"2024-05-08T20:55:21.738096+0000","last_fullsized":"2024-05-08T20:55:21.738096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4502","last_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_deep_scrub":"26'4502","last_deep_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.738039+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:43.638169+0000","scrub_duration":0.011148622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.196680+0000","last_change":"2024-05-08T20:55:03.196899+0000","last_active":"2024-05-08T20:55:03.196680+0000","last_peered":"2024-05-08T20:55:03.196680+0000","last_clean":"2024-05-08T20:55:03.196680+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:55:03.196680+0000","last_undegraded":"2024-05-08T20:55:03.196680+0000","last_fullsized":"2024-05-08T20:55:03.196680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.196622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:49.285017+0000","scrub_duration":0.017642686000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.240489+0000","last_change":"2024-05-08T20:54:48.240489+0000","last_active":"2024-05-08T20:54:48.240489+0000","last_peered":"2024-05-08T20:54:48.240489+0000","last_clean":"2024-05-08T20:54:48.240489+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:48.240489+0000","last_undegraded":"2024-05-08T20:54:48.240489+0000","last_fullsized":"2024-05-08T20:54:48.240489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.240164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:57.651499+0000","scrub_duration":0.0039283549999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.367383+0000","last_change":"2024-05-08T20:27:27.984319+0000","last_active":"2024-05-08T20:54:32.367383+0000","last_peered":"2024-05-08T20:54:32.367383+0000","last_clean":"2024-05-08T20:54:32.367383+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:54:32.367383+0000","last_undegraded":"2024-05-08T20:54:32.367383+0000","last_fullsized":"2024-05-08T20:54:32.367383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:00.644023+0000","last_change":"2024-05-08T20:55:00.644023+0000","last_active":"2024-05-08T20:55:00.644023+0000","last_peered":"2024-05-08T20:55:00.644023+0000","last_clean":"2024-05-08T20:55:00.644023+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:55:00.644023+0000","last_undegraded":"2024-05-08T20:55:00.644023+0000","last_fullsized":"2024-05-08T20:55:00.644023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4877","last_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_deep_scrub":"26'4877","last_deep_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_clean_scrub_stamp":"2024-05-08T20:55:00.643679+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:46.199456+0000","scrub_duration":0.018174326000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'19","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.552614+0000","last_change":"2024-05-08T20:54:56.552614+0000","last_active":"2024-05-08T20:54:56.552614+0000","last_peered":"2024-05-08T20:54:56.552614+0000","last_clean":"2024-05-08T20:54:56.552614+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:56.552614+0000","last_undegraded":"2024-05-08T20:54:56.552614+0000","last_fullsized":"2024-05-08T20:54:56.552614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.552316+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:38.919551+0000","scrub_duration":0.016343099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.950947+0000","last_change":"2024-05-08T20:54:43.951036+0000","last_active":"2024-05-08T20:54:43.950947+0000","last_peered":"2024-05-08T20:54:43.950947+0000","last_clean":"2024-05-08T20:54:43.950947+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:43.950947+0000","last_undegraded":"2024-05-08T20:54:43.950947+0000","last_fullsized":"2024-05-08T20:54:43.950947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.950926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:21.719335+0000","scrub_duration":0.0015213539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4854,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.382130+0000","last_change":"2024-05-08T20:27:27.995681+0000","last_active":"2024-05-08T20:54:32.382130+0000","last_peered":"2024-05-08T20:54:32.382130+0000","last_clean":"2024-05-08T20:54:32.382130+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:54:32.382130+0000","last_undegraded":"2024-05-08T20:54:32.382130+0000","last_fullsized":"2024-05-08T20:54:32.382130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.624126+0000","last_change":"2024-05-08T20:55:05.624126+0000","last_active":"2024-05-08T20:55:05.624126+0000","last_peered":"2024-05-08T20:55:05.624126+0000","last_clean":"2024-05-08T20:55:05.624126+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:55:05.624126+0000","last_undegraded":"2024-05-08T20:55:05.624126+0000","last_fullsized":"2024-05-08T20:55:05.624126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4806","last_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_deep_scrub":"26'4806","last_deep_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.623784+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:05.299562+0000","scrub_duration":0.050542888000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:53.472321+0000","last_change":"2024-05-08T20:54:53.472321+0000","last_active":"2024-05-08T20:54:53.472321+0000","last_peered":"2024-05-08T20:54:53.472321+0000","last_clean":"2024-05-08T20:54:53.472321+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:54:53.472321+0000","last_undegraded":"2024-05-08T20:54:53.472321+0000","last_fullsized":"2024-05-08T20:54:53.472321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_clean_scrub_stamp":"2024-05-08T20:54:53.472031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:36.420711+0000","scrub_duration":0.0032315270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.416742+0000","last_change":"2024-05-08T20:55:01.416966+0000","last_active":"2024-05-08T20:55:01.416742+0000","last_peered":"2024-05-08T20:55:01.416742+0000","last_clean":"2024-05-08T20:55:01.416742+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:55:01.416742+0000","last_undegraded":"2024-05-08T20:55:01.416742+0000","last_fullsized":"2024-05-08T20:55:01.416742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.416687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:50.039785+0000","scrub_duration":0.038290926000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.368953+0000","last_change":"2024-05-08T20:27:27.997881+0000","last_active":"2024-05-08T20:54:32.368953+0000","last_peered":"2024-05-08T20:54:32.368953+0000","last_clean":"2024-05-08T20:54:32.368953+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:54:32.368953+0000","last_undegraded":"2024-05-08T20:54:32.368953+0000","last_fullsized":"2024-05-08T20:54:32.368953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6082,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.975979+0000","last_change":"2024-05-08T20:27:18.922690+0000","last_active":"2024-05-08T20:54:44.975979+0000","last_peered":"2024-05-08T20:54:44.975979+0000","last_clean":"2024-05-08T20:54:44.975979+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:54:44.975979+0000","last_undegraded":"2024-05-08T20:54:44.975979+0000","last_fullsized":"2024-05-08T20:54:44.975979+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.171355+0000","last_change":"2024-05-08T20:55:35.171606+0000","last_active":"2024-05-08T20:55:35.171355+0000","last_peered":"2024-05-08T20:55:35.171355+0000","last_clean":"2024-05-08T20:55:35.171355+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:55:35.171355+0000","last_undegraded":"2024-05-08T20:55:35.171355+0000","last_fullsized":"2024-05-08T20:55:35.171355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.171302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:53.218021+0000","scrub_duration":0.0036972229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417411+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417411+0000","last_peered":"2024-05-08T20:54:43.417411+0000","last_clean":"2024-05-08T20:54:43.417411+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417411+0000","last_undegraded":"2024-05-08T20:54:43.417411+0000","last_fullsized":"2024-05-08T20:54:43.417411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.470587+0000","last_change":"2024-05-08T20:55:35.470865+0000","last_active":"2024-05-08T20:55:35.470587+0000","last_peered":"2024-05-08T20:55:35.470587+0000","last_clean":"2024-05-08T20:55:35.470587+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:55:35.470587+0000","last_undegraded":"2024-05-08T20:55:35.470587+0000","last_fullsized":"2024-05-08T20:55:35.470587+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5309","last_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_deep_scrub":"26'5309","last_deep_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.470527+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:48.455547+0000","scrub_duration":0.049539302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.102627+0000","last_change":"2024-05-08T20:54:57.102627+0000","last_active":"2024-05-08T20:54:57.102627+0000","last_peered":"2024-05-08T20:54:57.102627+0000","last_clean":"2024-05-08T20:54:57.102627+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:57.102627+0000","last_undegraded":"2024-05-08T20:54:57.102627+0000","last_fullsized":"2024-05-08T20:54:57.102627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4707","last_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_deep_scrub":"26'4707","last_deep_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.102409+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:04.868854+0000","scrub_duration":0.064899769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.967329+0000","last_change":"2024-05-08T20:54:47.967329+0000","last_active":"2024-05-08T20:54:47.967329+0000","last_peered":"2024-05-08T20:54:47.967329+0000","last_clean":"2024-05-08T20:54:47.967329+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:54:47.967329+0000","last_undegraded":"2024-05-08T20:54:47.967329+0000","last_fullsized":"2024-05-08T20:54:47.967329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.967013+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:43.643764+0000","scrub_duration":0.019010636000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.135142+0000","last_change":"2024-05-08T20:55:01.135433+0000","last_active":"2024-05-08T20:55:01.135142+0000","last_peered":"2024-05-08T20:55:01.135142+0000","last_clean":"2024-05-08T20:55:01.135142+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:55:01.135142+0000","last_undegraded":"2024-05-08T20:55:01.135142+0000","last_fullsized":"2024-05-08T20:55:01.135142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.135090+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:17.529691+0000","scrub_duration":0.017716335999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.359712+0000","last_change":"2024-05-08T20:55:17.359712+0000","last_active":"2024-05-08T20:55:17.359712+0000","last_peered":"2024-05-08T20:55:17.359712+0000","last_clean":"2024-05-08T20:55:17.359712+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:55:17.359712+0000","last_undegraded":"2024-05-08T20:55:17.359712+0000","last_fullsized":"2024-05-08T20:55:17.359712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4311","last_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_deep_scrub":"26'4311","last_deep_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.359387+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:10.597732+0000","scrub_duration":0.071380895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.557391+0000","last_change":"2024-05-08T20:55:04.557627+0000","last_active":"2024-05-08T20:55:04.557391+0000","last_peered":"2024-05-08T20:55:04.557391+0000","last_clean":"2024-05-08T20:55:04.557391+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:55:04.557391+0000","last_undegraded":"2024-05-08T20:55:04.557391+0000","last_fullsized":"2024-05-08T20:55:04.557391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4308","last_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_deep_scrub":"26'4308","last_deep_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.557335+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:14.404320+0000","scrub_duration":0.013594441000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'376","reported_seq":417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.547300+0000","last_change":"2024-05-08T20:55:01.547300+0000","last_active":"2024-05-08T20:55:01.547300+0000","last_peered":"2024-05-08T20:55:01.547300+0000","last_clean":"2024-05-08T20:55:01.547300+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:55:01.547300+0000","last_undegraded":"2024-05-08T20:55:01.547300+0000","last_fullsized":"2024-05-08T20:55:01.547300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'376","last_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_deep_scrub":"26'376","last_deep_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.546976+0000","objects_scrubbed":4,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:51.672058+0000","scrub_duration":0.025240988999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.700173+0000","last_change":"2024-05-08T20:54:50.700173+0000","last_active":"2024-05-08T20:54:50.700173+0000","last_peered":"2024-05-08T20:54:50.700173+0000","last_clean":"2024-05-08T20:54:50.700173+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:50.700173+0000","last_undegraded":"2024-05-08T20:54:50.700173+0000","last_fullsized":"2024-05-08T20:54:50.700173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.699899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:25.302614+0000","scrub_duration":0.003656903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.777139+0000","last_change":"2024-05-08T20:55:27.777139+0000","last_active":"2024-05-08T20:55:27.777139+0000","last_peered":"2024-05-08T20:55:27.777139+0000","last_clean":"2024-05-08T20:55:27.777139+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:55:27.777139+0000","last_undegraded":"2024-05-08T20:55:27.777139+0000","last_fullsized":"2024-05-08T20:55:27.777139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3942","last_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_deep_scrub":"26'3942","last_deep_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.776997+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:00.897092+0000","scrub_duration":0.15286592099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.147116+0000","last_change":"2024-05-08T20:55:04.147116+0000","last_active":"2024-05-08T20:55:04.147116+0000","last_peered":"2024-05-08T20:55:04.147116+0000","last_clean":"2024-05-08T20:55:04.147116+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:55:04.147116+0000","last_undegraded":"2024-05-08T20:55:04.147116+0000","last_fullsized":"2024-05-08T20:55:04.147116+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6472","last_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_deep_scrub":"26'6472","last_deep_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.146808+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:26.755900+0000","scrub_duration":0.015729532000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'42","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.627876+0000","last_change":"2024-05-08T20:55:16.628190+0000","last_active":"2024-05-08T20:55:16.627876+0000","last_peered":"2024-05-08T20:55:16.627876+0000","last_clean":"2024-05-08T20:55:16.627876+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:55:16.627876+0000","last_undegraded":"2024-05-08T20:55:16.627876+0000","last_fullsized":"2024-05-08T20:55:16.627876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.627755+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:04.126022+0000","scrub_duration":0.018944094000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.249501+0000","last_change":"2024-05-08T20:54:45.249501+0000","last_active":"2024-05-08T20:54:45.249501+0000","last_peered":"2024-05-08T20:54:45.249501+0000","last_clean":"2024-05-08T20:54:45.249501+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:45.249501+0000","last_undegraded":"2024-05-08T20:54:45.249501+0000","last_fullsized":"2024-05-08T20:54:45.249501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.249216+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:16.617377+0000","scrub_duration":0.021333827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.557977+0000","last_change":"2024-05-08T20:55:23.557977+0000","last_active":"2024-05-08T20:55:23.557977+0000","last_peered":"2024-05-08T20:55:23.557977+0000","last_clean":"2024-05-08T20:55:23.557977+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:55:23.557977+0000","last_undegraded":"2024-05-08T20:55:23.557977+0000","last_fullsized":"2024-05-08T20:55:23.557977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3366","last_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_deep_scrub":"26'3366","last_deep_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.557812+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:29.860852+0000","scrub_duration":0.092935954000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5293,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.082903+0000","last_change":"2024-05-08T20:55:05.083125+0000","last_active":"2024-05-08T20:55:05.082903+0000","last_peered":"2024-05-08T20:55:05.082903+0000","last_clean":"2024-05-08T20:55:05.082903+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:55:05.082903+0000","last_undegraded":"2024-05-08T20:55:05.082903+0000","last_fullsized":"2024-05-08T20:55:05.082903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5254","last_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_deep_scrub":"26'5254","last_deep_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.082849+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:08.613953+0000","scrub_duration":0.046904636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:31.191286+0000","last_change":"2024-05-08T20:55:31.191526+0000","last_active":"2024-05-08T20:55:31.191286+0000","last_peered":"2024-05-08T20:55:31.191286+0000","last_clean":"2024-05-08T20:55:31.191286+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:55:31.191286+0000","last_undegraded":"2024-05-08T20:55:31.191286+0000","last_fullsized":"2024-05-08T20:55:31.191286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:31.191230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:27.565005+0000","scrub_duration":0.003542014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'19","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.395653+0000","last_change":"2024-05-08T20:54:46.395653+0000","last_active":"2024-05-08T20:54:46.395653+0000","last_peered":"2024-05-08T20:54:46.395653+0000","last_clean":"2024-05-08T20:54:46.395653+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:46.395653+0000","last_undegraded":"2024-05-08T20:54:46.395653+0000","last_fullsized":"2024-05-08T20:54:46.395653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.395382+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:12.986179+0000","scrub_duration":0.011244446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3840,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976504+0000","last_change":"2024-05-08T20:27:28.023801+0000","last_active":"2024-05-08T20:54:44.976504+0000","last_peered":"2024-05-08T20:54:44.976504+0000","last_clean":"2024-05-08T20:54:44.976504+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:54:44.976504+0000","last_undegraded":"2024-05-08T20:54:44.976504+0000","last_fullsized":"2024-05-08T20:54:44.976504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.001816+0000","last_change":"2024-05-08T20:55:22.002055+0000","last_active":"2024-05-08T20:55:22.001816+0000","last_peered":"2024-05-08T20:55:22.001816+0000","last_clean":"2024-05-08T20:55:22.001816+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:55:22.001816+0000","last_undegraded":"2024-05-08T20:55:22.001816+0000","last_fullsized":"2024-05-08T20:55:22.001816+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5959","last_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_deep_scrub":"26'5959","last_deep_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.001765+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:55.739345+0000","scrub_duration":0.013812233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.579721+0000","last_change":"2024-05-08T20:55:04.579960+0000","last_active":"2024-05-08T20:55:04.579721+0000","last_peered":"2024-05-08T20:55:04.579721+0000","last_clean":"2024-05-08T20:55:04.579721+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:55:04.579721+0000","last_undegraded":"2024-05-08T20:55:04.579721+0000","last_fullsized":"2024-05-08T20:55:04.579721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.579663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.992226+0000","scrub_duration":0.010179356000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.363021+0000","last_change":"2024-05-08T20:55:06.363021+0000","last_active":"2024-05-08T20:55:06.363021+0000","last_peered":"2024-05-08T20:55:06.363021+0000","last_clean":"2024-05-08T20:55:06.363021+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:55:06.363021+0000","last_undegraded":"2024-05-08T20:55:06.363021+0000","last_fullsized":"2024-05-08T20:55:06.363021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.362763+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:52.398831+0000","scrub_duration":0.005099742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.487296+0000","last_change":"2024-05-08T20:55:34.487547+0000","last_active":"2024-05-08T20:55:34.487296+0000","last_peered":"2024-05-08T20:55:34.487296+0000","last_clean":"2024-05-08T20:55:34.487296+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:55:34.487296+0000","last_undegraded":"2024-05-08T20:55:34.487296+0000","last_fullsized":"2024-05-08T20:55:34.487296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6588","last_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_deep_scrub":"26'6588","last_deep_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.487238+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:48.676035+0000","scrub_duration":0.054108730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.929619+0000","last_change":"2024-05-08T20:55:11.929619+0000","last_active":"2024-05-08T20:55:11.929619+0000","last_peered":"2024-05-08T20:55:11.929619+0000","last_clean":"2024-05-08T20:55:11.929619+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:55:11.929619+0000","last_undegraded":"2024-05-08T20:55:11.929619+0000","last_fullsized":"2024-05-08T20:55:11.929619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.929353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:48.141846+0000","scrub_duration":0.0054755710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6038,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.865004+0000","last_change":"2024-05-08T20:54:59.865230+0000","last_active":"2024-05-08T20:54:59.865004+0000","last_peered":"2024-05-08T20:54:59.865004+0000","last_clean":"2024-05-08T20:54:59.865004+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:59.865004+0000","last_undegraded":"2024-05-08T20:54:59.865004+0000","last_fullsized":"2024-05-08T20:54:59.865004+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5999","last_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_deep_scrub":"26'5999","last_deep_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.864944+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:43.980839+0000","scrub_duration":0.021147691999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.164801+0000","last_change":"2024-05-08T20:55:34.165115+0000","last_active":"2024-05-08T20:55:34.164801+0000","last_peered":"2024-05-08T20:55:34.164801+0000","last_clean":"2024-05-08T20:55:34.164801+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:55:34.164801+0000","last_undegraded":"2024-05-08T20:55:34.164801+0000","last_fullsized":"2024-05-08T20:55:34.164801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.164740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:57.308501+0000","scrub_duration":0.0034682070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.041756+0000","last_change":"2024-05-08T20:55:19.041756+0000","last_active":"2024-05-08T20:55:19.041756+0000","last_peered":"2024-05-08T20:55:19.041756+0000","last_clean":"2024-05-08T20:55:19.041756+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:55:19.041756+0000","last_undegraded":"2024-05-08T20:55:19.041756+0000","last_fullsized":"2024-05-08T20:55:19.041756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4346","last_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_deep_scrub":"26'4346","last_deep_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.041549+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.115810+0000","scrub_duration":0.090105366000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'750","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.624205+0000","last_change":"2024-05-08T20:55:13.624444+0000","last_active":"2024-05-08T20:55:13.624205+0000","last_peered":"2024-05-08T20:55:13.624205+0000","last_clean":"2024-05-08T20:55:13.624205+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:55:13.624205+0000","last_undegraded":"2024-05-08T20:55:13.624205+0000","last_fullsized":"2024-05-08T20:55:13.624205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.624149+0000","objects_scrubbed":3,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:48.563067+0000","scrub_duration":0.082494374999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5586,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.369752+0000","last_change":"2024-05-08T20:55:16.369985+0000","last_active":"2024-05-08T20:55:16.369752+0000","last_peered":"2024-05-08T20:55:16.369752+0000","last_clean":"2024-05-08T20:55:16.369752+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:55:16.369752+0000","last_undegraded":"2024-05-08T20:55:16.369752+0000","last_fullsized":"2024-05-08T20:55:16.369752+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5547","last_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_deep_scrub":"26'5547","last_deep_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.369692+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:07.095999+0000","scrub_duration":0.052017234000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.268871+0000","last_change":"2024-05-08T20:55:21.269094+0000","last_active":"2024-05-08T20:55:21.268871+0000","last_peered":"2024-05-08T20:55:21.268871+0000","last_clean":"2024-05-08T20:55:21.268871+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:55:21.268871+0000","last_undegraded":"2024-05-08T20:55:21.268871+0000","last_fullsized":"2024-05-08T20:55:21.268871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.268812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:45.570299+0000","scrub_duration":0.0068504059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.889215+0000","last_change":"2024-05-08T20:55:03.889349+0000","last_active":"2024-05-08T20:55:03.889215+0000","last_peered":"2024-05-08T20:55:03.889215+0000","last_clean":"2024-05-08T20:55:03.889215+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:55:03.889215+0000","last_undegraded":"2024-05-08T20:55:03.889215+0000","last_fullsized":"2024-05-08T20:55:03.889215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4926","last_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_deep_scrub":"26'4926","last_deep_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.889187+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:53.056172+0000","scrub_duration":0.110946349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'163","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.590220+0000","last_change":"2024-05-08T20:54:59.590495+0000","last_active":"2024-05-08T20:54:59.590220+0000","last_peered":"2024-05-08T20:54:59.590220+0000","last_clean":"2024-05-08T20:54:59.590220+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:59.590220+0000","last_undegraded":"2024-05-08T20:54:59.590220+0000","last_fullsized":"2024-05-08T20:54:59.590220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'163","last_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_deep_scrub":"26'163","last_deep_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.590164+0000","objects_scrubbed":1,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.910490+0000","scrub_duration":0.020938656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.049268+0000","last_change":"2024-05-08T20:55:06.049513+0000","last_active":"2024-05-08T20:55:06.049268+0000","last_peered":"2024-05-08T20:55:06.049268+0000","last_clean":"2024-05-08T20:55:06.049268+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:55:06.049268+0000","last_undegraded":"2024-05-08T20:55:06.049268+0000","last_fullsized":"2024-05-08T20:55:06.049268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4451","last_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_deep_scrub":"26'4451","last_deep_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.049212+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:24.430723+0000","scrub_duration":0.052059591000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.520135+0000","last_change":"2024-05-08T20:55:02.520371+0000","last_active":"2024-05-08T20:55:02.520135+0000","last_peered":"2024-05-08T20:55:02.520135+0000","last_clean":"2024-05-08T20:55:02.520135+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:55:02.520135+0000","last_undegraded":"2024-05-08T20:55:02.520135+0000","last_fullsized":"2024-05-08T20:55:02.520135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.520078+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:26.455981+0000","scrub_duration":0.0061828689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:42.936803+0000","last_change":"2024-05-08T20:55:42.937094+0000","last_active":"2024-05-08T20:55:42.936803+0000","last_peered":"2024-05-08T20:55:42.936803+0000","last_clean":"2024-05-08T20:55:42.936803+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:55:42.936803+0000","last_undegraded":"2024-05-08T20:55:42.936803+0000","last_fullsized":"2024-05-08T20:55:42.936803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3676","last_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_deep_scrub":"26'3676","last_deep_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_clean_scrub_stamp":"2024-05-08T20:55:42.936748+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:31.860506+0000","scrub_duration":0.049010799000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'655","reported_seq":695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.317920+0000","last_change":"2024-05-08T20:55:23.318135+0000","last_active":"2024-05-08T20:55:23.317920+0000","last_peered":"2024-05-08T20:55:23.317920+0000","last_clean":"2024-05-08T20:55:23.317920+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:55:23.317920+0000","last_undegraded":"2024-05-08T20:55:23.317920+0000","last_fullsized":"2024-05-08T20:55:23.317920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'655","last_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_deep_scrub":"26'655","last_deep_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.317866+0000","objects_scrubbed":1,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:46.680579+0000","scrub_duration":0.028425507999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.863360+0000","last_change":"2024-05-08T20:55:13.863574+0000","last_active":"2024-05-08T20:55:13.863360+0000","last_peered":"2024-05-08T20:55:13.863360+0000","last_clean":"2024-05-08T20:55:13.863360+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:55:13.863360+0000","last_undegraded":"2024-05-08T20:55:13.863360+0000","last_fullsized":"2024-05-08T20:55:13.863360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4749","last_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_deep_scrub":"26'4749","last_deep_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.863305+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:59.772479+0000","scrub_duration":0.028153702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.342167+0000","last_change":"2024-05-08T20:54:56.342167+0000","last_active":"2024-05-08T20:54:56.342167+0000","last_peered":"2024-05-08T20:54:56.342167+0000","last_clean":"2024-05-08T20:54:56.342167+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:56.342167+0000","last_undegraded":"2024-05-08T20:54:56.342167+0000","last_fullsized":"2024-05-08T20:54:56.342167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.341600+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:37.112673+0000","scrub_duration":0.0065677610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3752,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.513008+0000","last_change":"2024-05-08T20:55:33.513008+0000","last_active":"2024-05-08T20:55:33.513008+0000","last_peered":"2024-05-08T20:55:33.513008+0000","last_clean":"2024-05-08T20:55:33.513008+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:55:33.513008+0000","last_undegraded":"2024-05-08T20:55:33.513008+0000","last_fullsized":"2024-05-08T20:55:33.513008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3715","last_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_deep_scrub":"26'3715","last_deep_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.512769+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:45.954826+0000","scrub_duration":0.065087201999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.540402+0000","last_change":"2024-05-08T20:54:49.540646+0000","last_active":"2024-05-08T20:54:49.540402+0000","last_peered":"2024-05-08T20:54:49.540402+0000","last_clean":"2024-05-08T20:54:49.540402+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:49.540402+0000","last_undegraded":"2024-05-08T20:54:49.540402+0000","last_fullsized":"2024-05-08T20:54:49.540402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5325","last_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_deep_scrub":"26'5325","last_deep_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.540347+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:25.992758+0000","scrub_duration":0.061375869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.263978+0000","last_change":"2024-05-08T20:27:27.987180+0000","last_active":"2024-05-08T20:54:42.263978+0000","last_peered":"2024-05-08T20:54:42.263978+0000","last_clean":"2024-05-08T20:54:42.263978+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:54:42.263978+0000","last_undegraded":"2024-05-08T20:54:42.263978+0000","last_fullsized":"2024-05-08T20:54:42.263978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.583918+0000","last_change":"2024-05-08T20:54:57.584171+0000","last_active":"2024-05-08T20:54:57.583918+0000","last_peered":"2024-05-08T20:54:57.583918+0000","last_clean":"2024-05-08T20:54:57.583918+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:57.583918+0000","last_undegraded":"2024-05-08T20:54:57.583918+0000","last_fullsized":"2024-05-08T20:54:57.583918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5595","last_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_deep_scrub":"26'5595","last_deep_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.583862+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:54.463390+0000","scrub_duration":0.019454468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079848+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:44.079848+0000","last_peered":"2024-05-08T20:54:44.079848+0000","last_clean":"2024-05-08T20:54:44.079848+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:44.079848+0000","last_undegraded":"2024-05-08T20:54:44.079848+0000","last_fullsized":"2024-05-08T20:54:44.079848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.221892+0000","last_change":"2024-05-08T20:55:37.222118+0000","last_active":"2024-05-08T20:55:37.221892+0000","last_peered":"2024-05-08T20:55:37.221892+0000","last_clean":"2024-05-08T20:55:37.221892+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:55:37.221892+0000","last_undegraded":"2024-05-08T20:55:37.221892+0000","last_fullsized":"2024-05-08T20:55:37.221892+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6159","last_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_deep_scrub":"26'6159","last_deep_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.221839+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:00.718155+0000","scrub_duration":0.013317416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4814,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.263960+0000","last_change":"2024-05-08T20:27:28.015701+0000","last_active":"2024-05-08T20:54:42.263960+0000","last_peered":"2024-05-08T20:54:42.263960+0000","last_clean":"2024-05-08T20:54:42.263960+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:54:42.263960+0000","last_undegraded":"2024-05-08T20:54:42.263960+0000","last_fullsized":"2024-05-08T20:54:42.263960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.063296+0000","last_change":"2024-05-08T20:54:46.063510+0000","last_active":"2024-05-08T20:54:46.063296+0000","last_peered":"2024-05-08T20:54:46.063296+0000","last_clean":"2024-05-08T20:54:46.063296+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:46.063296+0000","last_undegraded":"2024-05-08T20:54:46.063296+0000","last_fullsized":"2024-05-08T20:54:46.063296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5693","last_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_deep_scrub":"26'5693","last_deep_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.063251+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:47.062496+0000","scrub_duration":0.071792174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713023+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:40.713023+0000","last_peered":"2024-05-08T20:54:40.713023+0000","last_clean":"2024-05-08T20:54:40.713023+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:40.713023+0000","last_undegraded":"2024-05-08T20:54:40.713023+0000","last_fullsized":"2024-05-08T20:54:40.713023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:26.388312+0000","last_change":"2024-05-08T20:55:26.388312+0000","last_active":"2024-05-08T20:55:26.388312+0000","last_peered":"2024-05-08T20:55:26.388312+0000","last_clean":"2024-05-08T20:55:26.388312+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:55:26.388312+0000","last_undegraded":"2024-05-08T20:55:26.388312+0000","last_fullsized":"2024-05-08T20:55:26.388312+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5399","last_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_deep_scrub":"26'5399","last_deep_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_clean_scrub_stamp":"2024-05-08T20:55:26.387951+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:31.944366+0000","scrub_duration":0.012044920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:39.444918+0000","last_change":"2024-05-08T20:27:28.019831+0000","last_active":"2024-05-08T20:54:39.444918+0000","last_peered":"2024-05-08T20:54:39.444918+0000","last_clean":"2024-05-08T20:54:39.444918+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:54:39.444918+0000","last_undegraded":"2024-05-08T20:54:39.444918+0000","last_fullsized":"2024-05-08T20:54:39.444918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.715543+0000","last_change":"2024-05-08T20:55:06.715543+0000","last_active":"2024-05-08T20:55:06.715543+0000","last_peered":"2024-05-08T20:55:06.715543+0000","last_clean":"2024-05-08T20:55:06.715543+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:55:06.715543+0000","last_undegraded":"2024-05-08T20:55:06.715543+0000","last_fullsized":"2024-05-08T20:55:06.715543+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5958","last_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_deep_scrub":"26'5958","last_deep_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.715216+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.934398+0000","scrub_duration":0.015652640999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4689,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.712868+0000","last_change":"2024-05-08T20:27:28.022666+0000","last_active":"2024-05-08T20:54:40.712868+0000","last_peered":"2024-05-08T20:54:40.712868+0000","last_clean":"2024-05-08T20:54:40.712868+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:54:40.712868+0000","last_undegraded":"2024-05-08T20:54:40.712868+0000","last_fullsized":"2024-05-08T20:54:40.712868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.492492+0000","last_change":"2024-05-08T20:54:47.492492+0000","last_active":"2024-05-08T20:54:47.492492+0000","last_peered":"2024-05-08T20:54:47.492492+0000","last_clean":"2024-05-08T20:54:47.492492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:47.492492+0000","last_undegraded":"2024-05-08T20:54:47.492492+0000","last_fullsized":"2024-05-08T20:54:47.492492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5066","last_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_deep_scrub":"26'5066","last_deep_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.492152+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.271368+0000","scrub_duration":0.020000068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.445587+0000","last_change":"2024-05-08T20:55:40.445754+0000","last_active":"2024-05-08T20:55:40.445587+0000","last_peered":"2024-05-08T20:55:40.445587+0000","last_clean":"2024-05-08T20:55:40.445587+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:55:40.445587+0000","last_undegraded":"2024-05-08T20:55:40.445587+0000","last_fullsized":"2024-05-08T20:55:40.445587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4639","last_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_deep_scrub":"26'4639","last_deep_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.445550+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:21.821161+0000","scrub_duration":0.079421377000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.445597+0000","last_change":"2024-05-08T20:55:08.445597+0000","last_active":"2024-05-08T20:55:08.445597+0000","last_peered":"2024-05-08T20:55:08.445597+0000","last_clean":"2024-05-08T20:55:08.445597+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:55:08.445597+0000","last_undegraded":"2024-05-08T20:55:08.445597+0000","last_fullsized":"2024-05-08T20:55:08.445597+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6126","last_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_deep_scrub":"26'6126","last_deep_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.445271+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:56.722437+0000","scrub_duration":0.012766164999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185622+0000","last_change":"2024-05-08T20:27:27.984238+0000","last_active":"2024-05-08T20:54:43.185622+0000","last_peered":"2024-05-08T20:54:43.185622+0000","last_clean":"2024-05-08T20:54:43.185622+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:54:43.185622+0000","last_undegraded":"2024-05-08T20:54:43.185622+0000","last_fullsized":"2024-05-08T20:54:43.185622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.202269+0000","last_change":"2024-05-08T20:55:39.202269+0000","last_active":"2024-05-08T20:55:39.202269+0000","last_peered":"2024-05-08T20:55:39.202269+0000","last_clean":"2024-05-08T20:55:39.202269+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:55:39.202269+0000","last_undegraded":"2024-05-08T20:55:39.202269+0000","last_fullsized":"2024-05-08T20:55:39.202269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5362","last_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_deep_scrub":"26'5362","last_deep_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.201982+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:26.275471+0000","scrub_duration":0.012871195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.727229+0000","last_change":"2024-05-08T20:55:18.727229+0000","last_active":"2024-05-08T20:55:18.727229+0000","last_peered":"2024-05-08T20:55:18.727229+0000","last_clean":"2024-05-08T20:55:18.727229+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:55:18.727229+0000","last_undegraded":"2024-05-08T20:55:18.727229+0000","last_fullsized":"2024-05-08T20:55:18.727229+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.726746+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:12.191809+0000","scrub_duration":0.059782137999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.442535+0000","last_change":"2024-05-08T20:55:02.442768+0000","last_active":"2024-05-08T20:55:02.442535+0000","last_peered":"2024-05-08T20:55:02.442535+0000","last_clean":"2024-05-08T20:55:02.442535+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:55:02.442535+0000","last_undegraded":"2024-05-08T20:55:02.442535+0000","last_fullsized":"2024-05-08T20:55:02.442535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5184","last_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_deep_scrub":"26'5184","last_deep_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.442482+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:06.919194+0000","scrub_duration":0.015103089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.601981+0000","last_change":"2024-05-08T20:55:10.602221+0000","last_active":"2024-05-08T20:55:10.601981+0000","last_peered":"2024-05-08T20:55:10.601981+0000","last_clean":"2024-05-08T20:55:10.601981+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:55:10.601981+0000","last_undegraded":"2024-05-08T20:55:10.601981+0000","last_fullsized":"2024-05-08T20:55:10.601981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4176","last_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_deep_scrub":"26'4176","last_deep_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.601877+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:47.707725+0000","scrub_duration":0.083099372000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5692,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:21.878243+0000","last_change":"2024-05-08T20:27:18.930844+0000","last_active":"2024-05-08T20:54:21.878243+0000","last_peered":"2024-05-08T20:54:21.878243+0000","last_clean":"2024-05-08T20:54:21.878243+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:54:21.878243+0000","last_undegraded":"2024-05-08T20:54:21.878243+0000","last_fullsized":"2024-05-08T20:54:21.878243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.558291+0000","last_change":"2024-05-08T20:55:34.558561+0000","last_active":"2024-05-08T20:55:34.558291+0000","last_peered":"2024-05-08T20:55:34.558291+0000","last_clean":"2024-05-08T20:55:34.558291+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:55:34.558291+0000","last_undegraded":"2024-05-08T20:55:34.558291+0000","last_fullsized":"2024-05-08T20:55:34.558291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4568","last_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_deep_scrub":"26'4568","last_deep_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.558230+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:54.666430+0000","scrub_duration":0.090672077000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.439461+0000","last_change":"2024-05-08T20:55:25.439693+0000","last_active":"2024-05-08T20:55:25.439461+0000","last_peered":"2024-05-08T20:55:25.439461+0000","last_clean":"2024-05-08T20:55:25.439461+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:55:25.439461+0000","last_undegraded":"2024-05-08T20:55:25.439461+0000","last_fullsized":"2024-05-08T20:55:25.439461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6400","last_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_deep_scrub":"26'6400","last_deep_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.439401+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:51.706253+0000","scrub_duration":0.013054441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.886387+0000","last_change":"2024-05-08T20:55:43.886627+0000","last_active":"2024-05-08T20:55:43.886387+0000","last_peered":"2024-05-08T20:55:43.886387+0000","last_clean":"2024-05-08T20:55:43.886387+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:55:43.886387+0000","last_undegraded":"2024-05-08T20:55:43.886387+0000","last_fullsized":"2024-05-08T20:55:43.886387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4843","last_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_deep_scrub":"26'4843","last_deep_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.886334+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:11.158351+0000","scrub_duration":0.035733203999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.577214+0000","last_change":"2024-05-08T20:55:06.577459+0000","last_active":"2024-05-08T20:55:06.577214+0000","last_peered":"2024-05-08T20:55:06.577214+0000","last_clean":"2024-05-08T20:55:06.577214+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:55:06.577214+0000","last_undegraded":"2024-05-08T20:55:06.577214+0000","last_fullsized":"2024-05-08T20:55:06.577214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4987","last_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_deep_scrub":"26'4987","last_deep_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.577160+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:42.945808+0000","scrub_duration":0.016149487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:34.443798+0000","last_change":"2024-05-08T20:27:28.010671+0000","last_active":"2024-05-08T20:54:34.443798+0000","last_peered":"2024-05-08T20:54:34.443798+0000","last_clean":"2024-05-08T20:54:34.443798+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:54:34.443798+0000","last_undegraded":"2024-05-08T20:54:34.443798+0000","last_fullsized":"2024-05-08T20:54:34.443798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6047,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.588062+0000","last_change":"2024-05-08T20:55:10.588330+0000","last_active":"2024-05-08T20:55:10.588062+0000","last_peered":"2024-05-08T20:55:10.588062+0000","last_clean":"2024-05-08T20:55:10.588062+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:55:10.588062+0000","last_undegraded":"2024-05-08T20:55:10.588062+0000","last_fullsized":"2024-05-08T20:55:10.588062+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.588008+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.452979+0000","scrub_duration":0.016104663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.330591+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:32.330591+0000","last_peered":"2024-05-08T20:54:32.330591+0000","last_clean":"2024-05-08T20:54:32.330591+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:32.330591+0000","last_undegraded":"2024-05-08T20:54:32.330591+0000","last_fullsized":"2024-05-08T20:54:32.330591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5442,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.580745+0000","last_change":"2024-05-08T20:54:59.580745+0000","last_active":"2024-05-08T20:54:59.580745+0000","last_peered":"2024-05-08T20:54:59.580745+0000","last_clean":"2024-05-08T20:54:59.580745+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:59.580745+0000","last_undegraded":"2024-05-08T20:54:59.580745+0000","last_fullsized":"2024-05-08T20:54:59.580745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5402","last_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_deep_scrub":"26'5402","last_deep_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.580403+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:43.325297+0000","scrub_duration":0.019827373999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3952,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.024577+0000","last_change":"2024-05-08T20:55:16.024733+0000","last_active":"2024-05-08T20:55:16.024577+0000","last_peered":"2024-05-08T20:55:16.024577+0000","last_clean":"2024-05-08T20:55:16.024577+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:55:16.024577+0000","last_undegraded":"2024-05-08T20:55:16.024577+0000","last_fullsized":"2024-05-08T20:55:16.024577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3916","last_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_deep_scrub":"26'3916","last_deep_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.024547+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:35.429176+0000","scrub_duration":0.084433175999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.091777+0000","last_change":"2024-05-08T20:55:17.091777+0000","last_active":"2024-05-08T20:55:17.091777+0000","last_peered":"2024-05-08T20:55:17.091777+0000","last_clean":"2024-05-08T20:55:17.091777+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:55:17.091777+0000","last_undegraded":"2024-05-08T20:55:17.091777+0000","last_fullsized":"2024-05-08T20:55:17.091777+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7179","last_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_deep_scrub":"26'7179","last_deep_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.091504+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:30.475338+0000","scrub_duration":0.010907612000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4684,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:41.742542+0000","last_change":"2024-05-08T20:55:41.742659+0000","last_active":"2024-05-08T20:55:41.742542+0000","last_peered":"2024-05-08T20:55:41.742542+0000","last_clean":"2024-05-08T20:55:41.742542+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:55:41.742542+0000","last_undegraded":"2024-05-08T20:55:41.742542+0000","last_fullsized":"2024-05-08T20:55:41.742542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4649","last_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_deep_scrub":"26'4649","last_deep_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_clean_scrub_stamp":"2024-05-08T20:55:41.742520+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:28.769014+0000","scrub_duration":0.11890376499999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.191768+0000","last_change":"2024-05-08T20:54:47.191768+0000","last_active":"2024-05-08T20:54:47.191768+0000","last_peered":"2024-05-08T20:54:47.191768+0000","last_clean":"2024-05-08T20:54:47.191768+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:47.191768+0000","last_undegraded":"2024-05-08T20:54:47.191768+0000","last_fullsized":"2024-05-08T20:54:47.191768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5121","last_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_deep_scrub":"26'5121","last_deep_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.191457+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:32.886217+0000","scrub_duration":0.059662343999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.974385+0000","last_change":"2024-05-08T20:55:37.974674+0000","last_active":"2024-05-08T20:55:37.974385+0000","last_peered":"2024-05-08T20:55:37.974385+0000","last_clean":"2024-05-08T20:55:37.974385+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:55:37.974385+0000","last_undegraded":"2024-05-08T20:55:37.974385+0000","last_fullsized":"2024-05-08T20:55:37.974385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5300","last_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_deep_scrub":"26'5300","last_deep_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.974326+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:27.991254+0000","scrub_duration":0.052724812000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.836939+0000","last_change":"2024-05-08T20:54:54.836939+0000","last_active":"2024-05-08T20:54:54.836939+0000","last_peered":"2024-05-08T20:54:54.836939+0000","last_clean":"2024-05-08T20:54:54.836939+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:54.836939+0000","last_undegraded":"2024-05-08T20:54:54.836939+0000","last_fullsized":"2024-05-08T20:54:54.836939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4602","last_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_deep_scrub":"26'4602","last_deep_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.836650+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:37.068481+0000","scrub_duration":0.026253420999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.343098+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.343098+0000","last_peered":"2024-05-08T20:54:32.343098+0000","last_clean":"2024-05-08T20:54:32.343098+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.343098+0000","last_undegraded":"2024-05-08T20:54:32.343098+0000","last_fullsized":"2024-05-08T20:54:32.343098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941519+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941519+0000","last_peered":"2024-05-08T20:54:42.941519+0000","last_clean":"2024-05-08T20:54:42.941519+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941519+0000","last_undegraded":"2024-05-08T20:54:42.941519+0000","last_fullsized":"2024-05-08T20:54:42.941519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405851+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.405851+0000","last_peered":"2024-05-08T20:54:32.405851+0000","last_clean":"2024-05-08T20:54:32.405851+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.405851+0000","last_undegraded":"2024-05-08T20:54:32.405851+0000","last_fullsized":"2024-05-08T20:54:32.405851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.450359+0000","last_change":"2024-05-08T20:55:10.450576+0000","last_active":"2024-05-08T20:55:10.450359+0000","last_peered":"2024-05-08T20:55:10.450359+0000","last_clean":"2024-05-08T20:55:10.450359+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:55:10.450359+0000","last_undegraded":"2024-05-08T20:55:10.450359+0000","last_fullsized":"2024-05-08T20:55:10.450359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4626","last_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_deep_scrub":"26'4626","last_deep_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.450304+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:20.915560+0000","scrub_duration":0.011125820999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185628+0000","last_change":"2024-05-08T20:27:27.977056+0000","last_active":"2024-05-08T20:54:43.185628+0000","last_peered":"2024-05-08T20:54:43.185628+0000","last_clean":"2024-05-08T20:54:43.185628+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:54:43.185628+0000","last_undegraded":"2024-05-08T20:54:43.185628+0000","last_fullsized":"2024-05-08T20:54:43.185628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.891543+0000","last_change":"2024-05-08T20:55:16.891829+0000","last_active":"2024-05-08T20:55:16.891543+0000","last_peered":"2024-05-08T20:55:16.891543+0000","last_clean":"2024-05-08T20:55:16.891543+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:55:16.891543+0000","last_undegraded":"2024-05-08T20:55:16.891543+0000","last_fullsized":"2024-05-08T20:55:16.891543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3688","last_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_deep_scrub":"26'3688","last_deep_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.891490+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.749773+0000","scrub_duration":0.012960828000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.540769+0000","last_change":"2024-05-08T20:55:13.541058+0000","last_active":"2024-05-08T20:55:13.540769+0000","last_peered":"2024-05-08T20:55:13.540769+0000","last_clean":"2024-05-08T20:55:13.540769+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:55:13.540769+0000","last_undegraded":"2024-05-08T20:55:13.540769+0000","last_fullsized":"2024-05-08T20:55:13.540769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3316","last_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_deep_scrub":"26'3316","last_deep_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.540711+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:12.992902+0000","scrub_duration":0.076822395000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.474491+0000","last_change":"2024-05-08T20:54:51.474745+0000","last_active":"2024-05-08T20:54:51.474491+0000","last_peered":"2024-05-08T20:54:51.474491+0000","last_clean":"2024-05-08T20:54:51.474491+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:51.474491+0000","last_undegraded":"2024-05-08T20:54:51.474491+0000","last_fullsized":"2024-05-08T20:54:51.474491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5609","last_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_deep_scrub":"26'5609","last_deep_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.474437+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:37.535496+0000","scrub_duration":0.017226228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4563,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.729274+0000","last_change":"2024-05-08T20:55:13.729274+0000","last_active":"2024-05-08T20:55:13.729274+0000","last_peered":"2024-05-08T20:55:13.729274+0000","last_clean":"2024-05-08T20:55:13.729274+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:55:13.729274+0000","last_undegraded":"2024-05-08T20:55:13.729274+0000","last_fullsized":"2024-05-08T20:55:13.729274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4527","last_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_deep_scrub":"26'4527","last_deep_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.728968+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:30.126015+0000","scrub_duration":0.045784956000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.487212+0000","last_change":"2024-05-08T20:54:45.487445+0000","last_active":"2024-05-08T20:54:45.487212+0000","last_peered":"2024-05-08T20:54:45.487212+0000","last_clean":"2024-05-08T20:54:45.487212+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:45.487212+0000","last_undegraded":"2024-05-08T20:54:45.487212+0000","last_fullsized":"2024-05-08T20:54:45.487212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5845","last_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_deep_scrub":"26'5845","last_deep_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.487159+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:35.646681+0000","scrub_duration":0.033861688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.154336+0000","last_change":"2024-05-08T20:55:19.154336+0000","last_active":"2024-05-08T20:55:19.154336+0000","last_peered":"2024-05-08T20:55:19.154336+0000","last_clean":"2024-05-08T20:55:19.154336+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:55:19.154336+0000","last_undegraded":"2024-05-08T20:55:19.154336+0000","last_fullsized":"2024-05-08T20:55:19.154336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3505","last_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_deep_scrub":"26'3505","last_deep_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.154016+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:16.617871+0000","scrub_duration":0.075724768999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.715004+0000","last_change":"2024-05-08T20:55:15.715259+0000","last_active":"2024-05-08T20:55:15.715004+0000","last_peered":"2024-05-08T20:55:15.715004+0000","last_clean":"2024-05-08T20:55:15.715004+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:55:15.715004+0000","last_undegraded":"2024-05-08T20:55:15.715004+0000","last_fullsized":"2024-05-08T20:55:15.715004+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6642","last_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_deep_scrub":"26'6642","last_deep_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.714948+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:11.017870+0000","scrub_duration":0.018435876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5303,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:38.852816+0000","last_change":"2024-05-08T20:27:27.980183+0000","last_active":"2024-05-08T20:54:38.852816+0000","last_peered":"2024-05-08T20:54:38.852816+0000","last_clean":"2024-05-08T20:54:38.852816+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:54:38.852816+0000","last_undegraded":"2024-05-08T20:54:38.852816+0000","last_fullsized":"2024-05-08T20:54:38.852816+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5521,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.263646+0000","last_change":"2024-05-08T20:28:00.414139+0000","last_active":"2024-05-08T20:54:42.263646+0000","last_peered":"2024-05-08T20:54:42.263646+0000","last_clean":"2024-05-08T20:54:42.263646+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:54:42.263646+0000","last_undegraded":"2024-05-08T20:54:42.263646+0000","last_fullsized":"2024-05-08T20:54:42.263646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:18.480048+0000","last_clean_scrub_stamp":"2024-05-08T20:27:18.480048+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4056,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.437920+0000","last_change":"2024-05-08T20:55:39.438189+0000","last_active":"2024-05-08T20:55:39.437920+0000","last_peered":"2024-05-08T20:55:39.437920+0000","last_clean":"2024-05-08T20:55:39.437920+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:55:39.437920+0000","last_undegraded":"2024-05-08T20:55:39.437920+0000","last_fullsized":"2024-05-08T20:55:39.437920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4019","last_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_deep_scrub":"26'4019","last_deep_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.437865+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:21.643997+0000","scrub_duration":0.022369057000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.628544+0000","last_change":"2024-05-08T20:55:07.628786+0000","last_active":"2024-05-08T20:55:07.628544+0000","last_peered":"2024-05-08T20:55:07.628544+0000","last_clean":"2024-05-08T20:55:07.628544+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:55:07.628544+0000","last_undegraded":"2024-05-08T20:55:07.628544+0000","last_fullsized":"2024-05-08T20:55:07.628544+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5870","last_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_deep_scrub":"26'5870","last_deep_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.628488+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:59.204406+0000","scrub_duration":0.036094273000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3820,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.264050+0000","last_change":"2024-05-08T20:27:28.016581+0000","last_active":"2024-05-08T20:54:42.264050+0000","last_peered":"2024-05-08T20:54:42.264050+0000","last_clean":"2024-05-08T20:54:42.264050+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:54:42.264050+0000","last_undegraded":"2024-05-08T20:54:42.264050+0000","last_fullsized":"2024-05-08T20:54:42.264050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.154571+0000","last_change":"2024-05-08T20:55:02.154865+0000","last_active":"2024-05-08T20:55:02.154571+0000","last_peered":"2024-05-08T20:55:02.154571+0000","last_clean":"2024-05-08T20:55:02.154571+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:55:02.154571+0000","last_undegraded":"2024-05-08T20:55:02.154571+0000","last_fullsized":"2024-05-08T20:55:02.154571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4536","last_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_deep_scrub":"26'4536","last_deep_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.154517+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:54.549611+0000","scrub_duration":0.047608635000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4546,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.387527+0000","last_change":"2024-05-08T20:27:27.995500+0000","last_active":"2024-05-08T20:54:32.387527+0000","last_peered":"2024-05-08T20:54:32.387527+0000","last_clean":"2024-05-08T20:54:32.387527+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:54:32.387527+0000","last_undegraded":"2024-05-08T20:54:32.387527+0000","last_fullsized":"2024-05-08T20:54:32.387527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.592398+0000","last_change":"2024-05-08T20:55:05.592654+0000","last_active":"2024-05-08T20:55:05.592398+0000","last_peered":"2024-05-08T20:55:05.592398+0000","last_clean":"2024-05-08T20:55:05.592398+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:55:05.592398+0000","last_undegraded":"2024-05-08T20:55:05.592398+0000","last_fullsized":"2024-05-08T20:55:05.592398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4811","last_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_deep_scrub":"26'4811","last_deep_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.592322+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:00.479073+0000","scrub_duration":0.018874953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3764,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.185689+0000","last_change":"2024-05-08T20:27:28.211338+0000","last_active":"2024-05-08T20:54:43.185689+0000","last_peered":"2024-05-08T20:54:43.185689+0000","last_clean":"2024-05-08T20:54:43.185689+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:54:43.185689+0000","last_undegraded":"2024-05-08T20:54:43.185689+0000","last_fullsized":"2024-05-08T20:54:43.185689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.172178+0000","last_change":"2024-05-08T20:54:54.172178+0000","last_active":"2024-05-08T20:54:54.172178+0000","last_peered":"2024-05-08T20:54:54.172178+0000","last_clean":"2024-05-08T20:54:54.172178+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:54.172178+0000","last_undegraded":"2024-05-08T20:54:54.172178+0000","last_fullsized":"2024-05-08T20:54:54.172178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4709","last_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_deep_scrub":"26'4709","last_deep_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.171276+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.280762+0000","scrub_duration":0.026438705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.500842+0000","last_change":"2024-05-08T20:55:15.501128+0000","last_active":"2024-05-08T20:55:15.500842+0000","last_peered":"2024-05-08T20:55:15.500842+0000","last_clean":"2024-05-08T20:55:15.500842+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:55:15.500842+0000","last_undegraded":"2024-05-08T20:55:15.500842+0000","last_fullsized":"2024-05-08T20:55:15.500842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3900","last_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_deep_scrub":"26'3900","last_deep_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.500780+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:36.458071+0000","scrub_duration":0.028467224999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5679,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.101942+0000","last_change":"2024-05-08T20:55:03.102295+0000","last_active":"2024-05-08T20:55:03.101942+0000","last_peered":"2024-05-08T20:55:03.101942+0000","last_clean":"2024-05-08T20:55:03.101942+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:55:03.101942+0000","last_undegraded":"2024-05-08T20:55:03.101942+0000","last_fullsized":"2024-05-08T20:55:03.101942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5638","last_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_deep_scrub":"26'5638","last_deep_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.101828+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:45.438163+0000","scrub_duration":0.077280746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976854+0000","last_change":"2024-05-08T20:27:27.993435+0000","last_active":"2024-05-08T20:54:44.976854+0000","last_peered":"2024-05-08T20:54:44.976854+0000","last_clean":"2024-05-08T20:54:44.976854+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:54:44.976854+0000","last_undegraded":"2024-05-08T20:54:44.976854+0000","last_fullsized":"2024-05-08T20:54:44.976854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.773320+0000","last_change":"2024-05-08T20:54:49.773606+0000","last_active":"2024-05-08T20:54:49.773320+0000","last_peered":"2024-05-08T20:54:49.773320+0000","last_clean":"2024-05-08T20:54:49.773320+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:49.773320+0000","last_undegraded":"2024-05-08T20:54:49.773320+0000","last_fullsized":"2024-05-08T20:54:49.773320+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6644","last_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_deep_scrub":"26'6644","last_deep_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.773265+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:23.617467+0000","scrub_duration":0.054899599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4781,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.832111+0000","last_change":"2024-05-08T20:55:22.832380+0000","last_active":"2024-05-08T20:55:22.832111+0000","last_peered":"2024-05-08T20:55:22.832111+0000","last_clean":"2024-05-08T20:55:22.832111+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:55:22.832111+0000","last_undegraded":"2024-05-08T20:55:22.832111+0000","last_fullsized":"2024-05-08T20:55:22.832111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4746","last_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_deep_scrub":"26'4746","last_deep_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.832058+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:06.840030+0000","scrub_duration":0.062733702000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5146,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.584824+0000","last_change":"2024-05-08T20:54:48.585054+0000","last_active":"2024-05-08T20:54:48.584824+0000","last_peered":"2024-05-08T20:54:48.584824+0000","last_clean":"2024-05-08T20:54:48.584824+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:48.584824+0000","last_undegraded":"2024-05-08T20:54:48.584824+0000","last_fullsized":"2024-05-08T20:54:48.584824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5105","last_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_deep_scrub":"26'5105","last_deep_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.584770+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:58.380211+0000","scrub_duration":0.012206140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3558,"ondisk_log_size":3558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3565,"ondisk_log_size":3565,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575197,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":3.0630000000000002,"15min":1.577},"min":{"1min":0.48699999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.96099999999999997,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.6200000000000001,"15min":1.2010000000000001},"min":{"1min":0.68300000000000005,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.2210000000000001,"5min":34.091000000000001,"15min":34.091000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.413,"15min":1.077},"min":{"1min":0.58299999999999996,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0940000000000001,"5min":11.189,"15min":13.579000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":1.448,"15min":1.1519999999999999},"min":{"1min":0.57699999999999996,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":1.0549999999999999,"5min":12.048,"15min":13.467000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.7210000000000001,"15min":1.153},"min":{"1min":0.59799999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.2669999999999999,"5min":33.950000000000003,"15min":33.950000000000003},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.784,"15min":1.29},"min":{"1min":0.71199999999999997,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":1.3460000000000001,"5min":34.003999999999998,"15min":34.003999999999998},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.391,"15min":1.119},"min":{"1min":0.629,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.391,"5min":11.215,"15min":15.532},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.851,"15min":1.399},"min":{"1min":0.66500000000000004,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1850000000000001,"5min":16.584,"15min":16.584},"last":1.0209999999999999}]},{"osd":4,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":2.4929999999999999,"15min":1.726},"min":{"1min":0.42199999999999999,"5min":0.255,"15min":0.214},"max":{"1min":1.3580000000000001,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.752},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.736,"15min":1.353},"min":{"1min":0.56799999999999995,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":1.1080000000000001,"5min":20.565999999999999,"15min":22.741},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":2.9910000000000001,"15min":1.9770000000000001},"min":{"1min":0.64100000000000001,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":1.4179999999999999,"5min":32.381,"15min":33.679000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.181,"5min":2.2229999999999999,"15min":1.51},"min":{"1min":0.75700000000000001,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":1.492,"5min":20.869,"15min":20.869},"last":1.1930000000000001}]},{"osd":6,"last update":"Wed May 8 20:55:03 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.538,"15min":1.264},"min":{"1min":0.40799999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.45,"5min":11.484,"15min":13.714},"last":1.151},{"interface":"front","average":{"1min":1.018,"5min":1.8700000000000001,"15min":1.351},"min":{"1min":0.73599999999999999,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":1.4670000000000001,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.81499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575195,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":1.389,"15min":0.98899999999999999},"min":{"1min":0.39400000000000002,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":1.25,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.5780000000000001,"15min":1.173},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2829999999999999,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":0.78100000000000003}]},{"osd":1,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.504,"15min":1.1799999999999999},"min":{"1min":0.38200000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":1.2050000000000001,"5min":6.5739999999999998,"15min":14.717000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.095,"5min":1.4610000000000001,"15min":1.1100000000000001},"min":{"1min":0.442,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":3.645,"5min":11.523999999999999,"15min":14.404},"last":0.89900000000000002}]},{"osd":2,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.3500000000000001,"15min":1.0980000000000001},"min":{"1min":0.42799999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":1.198,"5min":9.907,"15min":9.907},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.244,"15min":1.0940000000000001},"min":{"1min":0.51200000000000001,"5min":0.28000000000000003,"15min":0.254},"max":{"1min":1.294,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.028}]},{"osd":3,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.7729999999999999,"15min":1.3140000000000001},"min":{"1min":0.46899999999999997,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":1.349,"5min":26.088999999999999,"15min":26.088999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.7490000000000001,"5min":1.6870000000000001,"15min":1.252},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":13.960000000000001,"5min":13.960000000000001,"15min":13.960000000000001},"last":1.046}]},{"osd":4,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":2.4609999999999999,"15min":1.5580000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.223},"max":{"1min":3.177,"5min":30.094000000000001,"15min":30.094000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.9530000000000001,"15min":1.444},"min":{"1min":0.36699999999999999,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":1.476,"5min":29.538,"15min":29.538},"last":0.96199999999999997}]},{"osd":5,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.8440000000000001,"15min":1.2090000000000001},"min":{"1min":0.45900000000000002,"5min":0.33500000000000002,"15min":0.25},"max":{"1min":1.3759999999999999,"5min":11.568,"15min":11.568},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.127,"5min":1.9279999999999999,"15min":1.333},"min":{"1min":0.54100000000000004,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":1.484,"5min":11.593999999999999,"15min":11.593999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.9219999999999999,"15min":1.27},"min":{"1min":0.312,"5min":0.188,"15min":0.188},"max":{"1min":1.2949999999999999,"5min":12.77,"15min":12.77},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.788,"15min":1.3069999999999999},"min":{"1min":0.48499999999999999,"5min":0.33500000000000002,"15min":0.29699999999999999},"max":{"1min":1.4319999999999999,"5min":20.495999999999999,"15min":20.495999999999999},"last":0.872}]}]},{"osd":5,"up_from":13,"seq":55834575195,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.3320000000000001,"15min":1.0800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.1559999999999997,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.3109999999999999,"15min":1.018},"min":{"1min":0.55900000000000005,"5min":0.27800000000000002,"15min":0.23599999999999999},"max":{"1min":3.7090000000000001,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.86599999999999999}]},{"osd":1,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":4.976,"15min":2.3239999999999998},"min":{"1min":0.43099999999999999,"5min":0.27100000000000002,"15min":0.20799999999999999},"max":{"1min":3.7530000000000001,"5min":121.521,"15min":121.521},"last":1.002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.9179999999999999,"15min":1.2310000000000001},"min":{"1min":0.57399999999999995,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":5.1980000000000004,"5min":18.957999999999998,"15min":18.957999999999998},"last":0.98299999999999998}]},{"osd":2,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.8109999999999999,"15min":1.224},"min":{"1min":0.317,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":4.6870000000000003,"5min":16.535,"15min":16.535},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.7529999999999999,"15min":1.1599999999999999},"min":{"1min":0.40000000000000002,"5min":0.27900000000000003,"15min":0.249},"max":{"1min":3.7930000000000001,"5min":15.006,"15min":15.006},"last":0.68000000000000005}]},{"osd":3,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":5.3209999999999997,"15min":2.516},"min":{"1min":0.33900000000000002,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":4.6150000000000002,"5min":121.498,"15min":121.498},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.714,"5min":1.8939999999999999,"15min":1.3129999999999999},"min":{"1min":0.5,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.737,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.0880000000000001}]},{"osd":4,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":4.6740000000000004,"15min":2.335},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.4790000000000001,"5min":121.464,"15min":121.464},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.657,"15min":1.2010000000000001},"min":{"1min":0.36599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":3.8759999999999999,"5min":7.7110000000000003,"15min":8.2710000000000008},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":1.8580000000000001,"15min":1.351},"min":{"1min":0.66500000000000004,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":5.0430000000000001,"5min":15.048,"15min":15.048},"last":1.149},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.665,"15min":1.2270000000000001},"min":{"1min":0.71399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":3.649,"5min":11.56,"15min":11.56},"last":1.1899999999999999}]},{"osd":7,"last update":"Wed May 8 20:54:48 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":3.113,"15min":2.0150000000000001},"min":{"1min":0.55200000000000005,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":5.1050000000000004,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.554,"15min":1.2549999999999999},"min":{"1min":0.68000000000000005,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.8300000000000001,"5min":9.4890000000000008,"15min":12.679},"last":1.048}]}]},{"osd":4,"up_from":13,"seq":55834575196,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.853,"15min":1.244},"min":{"1min":0.41799999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.2050000000000001,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.579,"15min":1.2},"min":{"1min":0.44700000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":1.3640000000000001,"5min":16.119,"15min":16.119},"last":1.1459999999999999}]},{"osd":1,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":2.2149999999999999,"15min":1.423},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.403,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.4630000000000001,"15min":1.081},"min":{"1min":0.67700000000000005,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9689999999999999,"5min":16.904,"15min":16.904},"last":0.93700000000000006}]},{"osd":2,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":2.0310000000000001,"15min":1.4730000000000001},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":1.0720000000000001,"5min":28.271999999999998,"15min":28.271999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.232,"15min":1.002},"min":{"1min":0.64100000000000001,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":3.0190000000000001,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":1.028}]},{"osd":3,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":2.2799999999999998,"15min":1.542},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.7880000000000003,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.125,"5min":2.2759999999999998,"15min":1.5089999999999999},"min":{"1min":0.67000000000000004,"5min":0.316,"15min":0.316},"max":{"1min":3.1579999999999999,"5min":29.526,"15min":29.526},"last":0.91400000000000003}]},{"osd":5,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":2.508,"15min":1.464},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":1.1639999999999999,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.5149999999999999,"15min":1.1859999999999999},"min":{"1min":0.60099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0880000000000001,"5min":9.0370000000000008,"15min":14.863},"last":0.872}]},{"osd":6,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.899,"15min":1.325},"min":{"1min":0.36199999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.327,"5min":33.198,"15min":33.198},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.9530000000000001,"15min":1.373},"min":{"1min":0.38900000000000001,"5min":0.318,"15min":0.308},"max":{"1min":1.425,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.115}]},{"osd":7,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":3.4980000000000002,"15min":1.853},"min":{"1min":0.77400000000000002,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":3.0529999999999999,"5min":54.073999999999998,"15min":54.073999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3580000000000001,"5min":3.7010000000000001,"15min":1.97},"min":{"1min":1.095,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":3.125,"5min":54.113,"15min":54.113},"last":1.083}]}]},{"osd":3,"up_from":13,"seq":55834575195,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":1.379,"15min":0.95699999999999996},"min":{"1min":0.48399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.97899999999999998,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":1.4730000000000001,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.192,"15min":0.192},"max":{"1min":1.0369999999999999,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.91600000000000004}]},{"osd":1,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":1.171,"15min":1.0289999999999999},"min":{"1min":0.40600000000000003,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.88,"5min":12.253,"15min":16.355},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.04,"15min":0.86199999999999999},"min":{"1min":0.36099999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.872,"5min":9.7230000000000008,"15min":9.7230000000000008},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.3149999999999999,"15min":0.90600000000000003},"min":{"1min":0.54900000000000004,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":1.127,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.96299999999999997,"15min":0.83999999999999997},"min":{"1min":0.48599999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.0880000000000001,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.70899999999999996}]},{"osd":4,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.512,"15min":1.091},"min":{"1min":0.70599999999999996,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":3.5539999999999998,"5min":16.885999999999999,"15min":16.885999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.4319999999999999,"15min":1.046},"min":{"1min":0.74299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.4630000000000001,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.88500000000000001}]},{"osd":5,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.7350000000000001,"15min":1.9179999999999999},"min":{"1min":0.52900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.4750000000000001,"5min":17.004999999999999,"15min":117.105},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.5549999999999999,"15min":1.1619999999999999},"min":{"1min":0.45400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1879999999999999,"5min":14.394,"15min":14.394},"last":1.141}]},{"osd":6,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.6359999999999999,"15min":1.3340000000000001},"min":{"1min":0.67000000000000004,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5629999999999999,"5min":10.834,"15min":16.113},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.651,"15min":1.2230000000000001},"min":{"1min":0.84999999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5109999999999999,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.1180000000000001}]},{"osd":7,"last update":"Wed May 8 20:54:56 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.827,"15min":1.3520000000000001},"min":{"1min":0.79100000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4430000000000001,"5min":16.977,"15min":16.977},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.7509999999999999,"15min":1.2929999999999999},"min":{"1min":0.51800000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":1.4410000000000001,"5min":15.289999999999999,"15min":15.289999999999999},"last":1.2689999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575193,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.111,"15min":0.86899999999999999},"min":{"1min":0.315,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":7.5679999999999996,"5min":12.609999999999999,"15min":12.609999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":1.101,"15min":0.91900000000000004},"min":{"1min":0.34000000000000002,"5min":0.189,"15min":0.189},"max":{"1min":2.2440000000000002,"5min":12.359999999999999,"15min":12.359999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":1.02,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.7409999999999997,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.373,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":2.3170000000000002,"5min":6.0380000000000003,"15min":6.7009999999999996},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.3340000000000001,"15min":0.94699999999999995},"min":{"1min":0.45900000000000002,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.6289999999999996,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.2350000000000001,"15min":0.97299999999999998},"min":{"1min":0.52300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":10.510999999999999,"5min":10.510999999999999,"15min":10.510999999999999},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.9930000000000001,"15min":1.2609999999999999},"min":{"1min":0.59699999999999998,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":5.7949999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.6319999999999999,"15min":1.232},"min":{"1min":0.68899999999999995,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2310000000000001,"5min":18.065000000000001,"15min":18.065000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.764,"15min":1.3169999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":1.1659999999999999,"5min":12.391999999999999,"15min":22.489000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.6839999999999999,"15min":1.2450000000000001},"min":{"1min":0.71899999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.0059999999999998,"5min":14.968999999999999,"15min":14.968999999999999},"last":0.94999999999999996}]},{"osd":6,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.657,"15min":1.214},"min":{"1min":0.53500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.6520000000000001,"5min":9.7370000000000001,"15min":9.7370000000000001},"last":1.097},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6439999999999999,"15min":1.2010000000000001},"min":{"1min":0.66100000000000003,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":7.5060000000000002,"5min":12.553000000000001,"15min":12.553000000000001},"last":0.91300000000000003}]},{"osd":7,"last update":"Wed May 8 20:54:51 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":2.0390000000000001,"15min":1.4330000000000001},"min":{"1min":0.57099999999999995,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":7.4210000000000003,"5min":13.663,"15min":13.663},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4510000000000001,"15min":1.51},"min":{"1min":0.85699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.915,"5min":19.201000000000001,"15min":19.201000000000001},"last":1.1279999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575194,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.92700000000000005,"15min":0.78000000000000003},"min":{"1min":0.214,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.633,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.874},{"interface":"front","average":{"1min":0.82799999999999996,"5min":1.236,"15min":0.94099999999999995},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0779999999999998,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":1.069,"15min":0.88600000000000001},"min":{"1min":0.23000000000000001,"5min":0.20000000000000001,"15min":0.188},"max":{"1min":0.95799999999999996,"5min":13.961,"15min":13.961},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.0369999999999999,"15min":0.84499999999999997},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.0740000000000001,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":2.2909999999999999,"15min":1.458},"min":{"1min":0.33100000000000002,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":1.6599999999999999,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.22},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.20399999999999999},"max":{"1min":1.548,"5min":61.957000000000001,"15min":61.957000000000001},"last":1.014}]},{"osd":4,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":1.3999999999999999,"15min":1.137},"min":{"1min":0.46999999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1319999999999999,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.2490000000000001,"15min":1.04},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":1.5980000000000001,"5min":9.5630000000000006,"15min":9.5630000000000006},"last":1.2709999999999999}]},{"osd":5,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":3.3940000000000001,"15min":1.8720000000000001},"min":{"1min":0.46999999999999997,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":2.7490000000000001,"5min":68.162000000000006,"15min":68.162000000000006},"last":1.107},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.8140000000000001,"15min":1.3080000000000001},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.444,"5min":23.742000000000001,"15min":23.742000000000001},"last":0.98699999999999999}]},{"osd":6,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.5940000000000001,"15min":1.2210000000000001},"min":{"1min":0.60499999999999998,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":1.2769999999999999,"5min":14.032,"15min":14.032},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.405,"15min":1.1379999999999999},"min":{"1min":0.58799999999999997,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":2.9079999999999999,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.085}]},{"osd":7,"last update":"Wed May 8 20:54:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":2.4660000000000002,"15min":1.677},"min":{"1min":0.60099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.7749999999999999,"5min":26.881,"15min":26.881},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.738,"15min":1.339},"min":{"1min":0.45900000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":7.1429999999999998,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.054}]}]},{"osd":0,"up_from":13,"seq":55834575194,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.879,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.877,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":1.0329999999999999,"15min":0.84699999999999998},"min":{"1min":0.36099999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.96599999999999997,"5min":8.8330000000000002,"15min":13.305},"last":1.2849999999999999}]},{"osd":2,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":1.093,"15min":0.82699999999999996},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.98599999999999999,"5min":15.212,"15min":15.212},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":1.095,"15min":0.83399999999999996},"min":{"1min":0.376,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":1.137,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.90000000000000002}]},{"osd":3,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.85999999999999999},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":1.3140000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98299999999999998,"15min":0.94899999999999995},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.26300000000000001},"max":{"1min":1.375,"5min":6.758,"15min":6.758},"last":0.98199999999999998}]},{"osd":4,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.502,"15min":1.1040000000000001},"min":{"1min":0.47299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":18.407,"15min":18.407},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.4750000000000001,"15min":1.097},"min":{"1min":0.61699999999999999,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.226,"5min":18.466999999999999,"15min":18.466999999999999},"last":1.028}]},{"osd":5,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":2.0470000000000002,"15min":1.3080000000000001},"min":{"1min":0.629,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":1.147,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.671,"15min":1.1919999999999999},"min":{"1min":0.66800000000000004,"5min":0.312,"15min":0.312},"max":{"1min":1.5289999999999999,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.3939999999999999,"15min":1.1000000000000001},"min":{"1min":0.63500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.611,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.421,"15min":1.131},"min":{"1min":0.497,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":1.444,"5min":8.9870000000000001,"15min":11.597},"last":1.0840000000000001}]},{"osd":7,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":2.0030000000000001,"15min":1.417},"min":{"1min":0.89200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.718,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.054},{"interface":"front","average":{"1min":1.2050000000000001,"5min":2.0470000000000002,"15min":1.504},"min":{"1min":0.85899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.79,"5min":18.788,"15min":18.788},"last":1.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:46.523 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.523 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.523 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.524 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:27:17.471859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=17, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.524 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.524 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.524 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.525 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.525 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.525 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.525 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.525 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.526 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.527 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:27:18.480048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:55:46.528 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T20:55:59.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:59.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:06.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:06.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 Processor -- start 2024-05-08T20:56:06.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 -- start start 2024-05-08T20:56:06.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb85c1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb85c0ca000 0x7fb85c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c158e20 con 0x7fb85c154cf0 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c06bb20 con 0x7fb85c0ca000 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb8636b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1548e0 con 0x7fb85c151f00 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb860c50640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb85c154cf0 0x7fb85c155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42306/0 (socket says 172.21.15.81:42306) 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb860c50640 1 -- 172.21.15.81:0/3784225145 learned_addr learned my addr 172.21.15.81:0/3784225145 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb85c1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861c52640 1 --2- 172.21.15.81:0/3784225145 >> v2:172.21.15.117:3300/0 conn(0x7fb85c0ca000 0x7fb85c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061256892 0 0) 0x7fb85c158e20 con 0x7fb85c154cf0 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb848003530 con 0x7fb85c154cf0 2024-05-08T20:56:06.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62847893 0 0) 0x7fb848003530 con 0x7fb85c154cf0 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 msgr2=0x7fb85c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb85c1588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 >> v2:172.21.15.117:3300/0 conn(0x7fb85c0ca000 msgr2=0x7fb85c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 --2- 172.21.15.81:0/3784225145 >> v2:172.21.15.117:3300/0 conn(0x7fb85c0ca000 0x7fb85c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c155860 con 0x7fb85c154cf0 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fb84c001680 con 0x7fb85c154cf0 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 >> v1:172.21.15.81:6789/0 conn(0x7fb85c154cf0 legacy=0x7fb85c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb848003980 0x7fb848003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb8480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848004d10 0x7fb848005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800b990 con 0x7fb848003980 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb848003980 0x7fb848003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800bad0 con 0x7fb848004d10 2024-05-08T20:56:06.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84800bc90 con 0x7fb85c151f00 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861c52640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848004d10 0x7fb848005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb860c50640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb8480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 -- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 msgr2=0x7fb8480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c151f00 0x7fb8480047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 -- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848004d10 msgr2=0x7fb848005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848004d10 0x7fb848005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.660+0000 7fb861451640 1 -- 172.21.15.81:0/3784225145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848003530 con 0x7fb848003980 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb861451640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb848003980 0x7fb848003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb858009ae0 tx=0x7fb85801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140291479915eb58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a5660 con 0x7fb848003980 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580a57c0 con 0x7fb848003980 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb853fff640 1 -- 172.21.15.81:0/3784225145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a5b70 con 0x7fb848003980 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- 172.21.15.81:0/3784225145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb848003980 msgr2=0x7fb848003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3784225145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb848003980 0x7fb848003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb858009ae0 tx=0x7fb85801ca70 comp rx=0 tx=0).stop 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb861c52640 1 -- 172.21.15.81:0/3784225145 reap_dead start 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- 172.21.15.81:0/3784225145 shutdown_connections 2024-05-08T20:56:06.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- 172.21.15.81:0/3784225145 >> 172.21.15.81:0/3784225145 conn(0x7fb85c0715f0 msgr2=0x7fb85c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- 172.21.15.81:0/3784225145 shutdown_connections 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- 172.21.15.81:0/3784225145 wait complete. 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 Processor -- start 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.664+0000 7fb8636b5640 1 -- start start 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848003980 0x7fb85c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0aeae0 0x7fb85c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0ae820 con 0x7fb85c14c0f0 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c14c570 con 0x7fb848003980 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1f1080 con 0x7fb85c0aeae0 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38126/0 (socket says 172.21.15.81:38126) 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 -- 172.21.15.81:0/3986988463 learned_addr learned my addr 172.21.15.81:0/3986988463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861451640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848003980 0x7fb85c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb860c50640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0aeae0 0x7fb85c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 -- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0aeae0 msgr2=0x7fb85c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0aeae0 0x7fb85c14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 -- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848003980 msgr2=0x7fb85c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848003980 0x7fb85c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 -- 172.21.15.81:0/3986988463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c1f1510 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861c52640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0cb050 tx=0x7fb8540115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e070 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854011e10 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c1f0750 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540039a0 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1f0d10 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c0675e0 con 0x7fb85c14c0f0 2024-05-08T20:56:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb854003b00 con 0x7fb85c14c0f0 2024-05-08T20:56:06.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 0x7fb840068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:06.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fb854084a40 con 0x7fb85c14c0f0 2024-05-08T20:56:06.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861451640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 0x7fb840068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:06.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.668+0000 7fb861451640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 0x7fb840068b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb8580af000 tx=0x7fb8580046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.672+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb854086e60 con 0x7fb85c14c0f0 2024-05-08T20:56:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.856+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb85c0c6820 con 0x7fb8400666c0 2024-05-08T20:56:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.876+0000 7fb851ffb640 1 -- 172.21.15.81:0/3986988463 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+533155 (secure 0 0 0) 0x7fb8580a5930 con 0x7fb8400666c0 2024-05-08T20:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 msgr2=0x7fb840068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 0x7fb840068b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb8580af000 tx=0x7fb8580046d0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 msgr2=0x7fb85c15b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0cb050 tx=0x7fb8540115a0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 shutdown_connections 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.880+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb8400666c0 0x7fb840068b80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85c14c0f0 0x7fb85c15b240 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb85c0aeae0 0x7fb85c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 --2- 172.21.15.81:0/3986988463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb848003980 0x7fb85c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 >> 172.21.15.81:0/3986988463 conn(0x7fb85c0715f0 msgr2=0x7fb85c0c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 shutdown_connections 2024-05-08T20:56:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:06.884+0000 7fb8636b5640 1 -- 172.21.15.81:0/3986988463 wait complete. 2024-05-08T20:56:06.903 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":888,"stamp":"2024-05-08T20:56:05.931180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622923,"ondisk_log_size":622923,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005796"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.075935+0000","last_change":"2024-05-08T20:55:27.076189+0000","last_active":"2024-05-08T20:55:27.075935+0000","last_peered":"2024-05-08T20:55:27.075935+0000","last_clean":"2024-05-08T20:55:27.075935+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:55:27.075935+0000","last_undegraded":"2024-05-08T20:55:27.075935+0000","last_fullsized":"2024-05-08T20:55:27.075935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4778","last_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_deep_scrub":"26'4778","last_deep_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.075881+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:10.493830+0000","scrub_duration":0.060369219000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'767","reported_seq":809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.034026+0000","last_change":"2024-05-08T20:54:52.034318+0000","last_active":"2024-05-08T20:54:52.034026+0000","last_peered":"2024-05-08T20:54:52.034026+0000","last_clean":"2024-05-08T20:54:52.034026+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:52.034026+0000","last_undegraded":"2024-05-08T20:54:52.034026+0000","last_fullsized":"2024-05-08T20:54:52.034026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'767","last_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_deep_scrub":"26'767","last_deep_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.033968+0000","objects_scrubbed":3,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.997884+0000","scrub_duration":0.095634259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5356,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.354589+0000","last_change":"2024-05-08T20:55:25.354823+0000","last_active":"2024-05-08T20:55:25.354589+0000","last_peered":"2024-05-08T20:55:25.354589+0000","last_clean":"2024-05-08T20:55:25.354589+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:55:25.354589+0000","last_undegraded":"2024-05-08T20:55:25.354589+0000","last_fullsized":"2024-05-08T20:55:25.354589+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5314","last_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_deep_scrub":"26'5314","last_deep_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.354534+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.054489+0000","scrub_duration":0.015367578999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.318767+0000","last_change":"2024-05-08T20:54:58.319009+0000","last_active":"2024-05-08T20:54:58.318767+0000","last_peered":"2024-05-08T20:54:58.318767+0000","last_clean":"2024-05-08T20:54:58.318767+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:58.318767+0000","last_undegraded":"2024-05-08T20:54:58.318767+0000","last_fullsized":"2024-05-08T20:54:58.318767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.318713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:57.774502+0000","scrub_duration":0.0077592889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.695146+0000","last_change":"2024-05-08T20:55:40.695305+0000","last_active":"2024-05-08T20:55:40.695146+0000","last_peered":"2024-05-08T20:55:40.695146+0000","last_clean":"2024-05-08T20:55:40.695146+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:55:40.695146+0000","last_undegraded":"2024-05-08T20:55:40.695146+0000","last_fullsized":"2024-05-08T20:55:40.695146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5153","last_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_deep_scrub":"26'5153","last_deep_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.695112+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:29.089686+0000","scrub_duration":0.10690976200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.320721+0000","last_change":"2024-05-08T20:55:24.320973+0000","last_active":"2024-05-08T20:55:24.320721+0000","last_peered":"2024-05-08T20:55:24.320721+0000","last_clean":"2024-05-08T20:55:24.320721+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:55:24.320721+0000","last_undegraded":"2024-05-08T20:55:24.320721+0000","last_fullsized":"2024-05-08T20:55:24.320721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.320666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:33.689682+0000","scrub_duration":0.0078549569999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.962764+0000","last_change":"2024-05-08T20:55:21.962980+0000","last_active":"2024-05-08T20:55:21.962764+0000","last_peered":"2024-05-08T20:55:21.962764+0000","last_clean":"2024-05-08T20:55:21.962764+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:55:21.962764+0000","last_undegraded":"2024-05-08T20:55:21.962764+0000","last_fullsized":"2024-05-08T20:55:21.962764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.962709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:06.689855+0000","scrub_duration":0.0035857630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.976543+0000","last_change":"2024-05-08T20:27:28.022413+0000","last_active":"2024-05-08T20:54:44.976543+0000","last_peered":"2024-05-08T20:54:44.976543+0000","last_clean":"2024-05-08T20:54:44.976543+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:54:44.976543+0000","last_undegraded":"2024-05-08T20:54:44.976543+0000","last_fullsized":"2024-05-08T20:54:44.976543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'8","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:46.660871+0000","last_change":"2024-05-08T20:55:46.661126+0000","last_active":"2024-05-08T20:55:46.660871+0000","last_peered":"2024-05-08T20:55:46.660871+0000","last_clean":"2024-05-08T20:55:46.660871+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:55:46.660871+0000","last_undegraded":"2024-05-08T20:55:46.660871+0000","last_fullsized":"2024-05-08T20:55:46.660871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:55:46.660816+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:55:46.660816+0000","last_clean_scrub_stamp":"2024-05-08T20:55:46.660816+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:50.039422+0000","scrub_duration":0.0061115309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.217320+0000","last_change":"2024-05-08T20:54:58.217575+0000","last_active":"2024-05-08T20:54:58.217320+0000","last_peered":"2024-05-08T20:54:58.217320+0000","last_clean":"2024-05-08T20:54:58.217320+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:58.217320+0000","last_undegraded":"2024-05-08T20:54:58.217320+0000","last_fullsized":"2024-05-08T20:54:58.217320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.217264+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:04.029681+0000","scrub_duration":0.019522241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'619","reported_seq":655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.174972+0000","last_change":"2024-05-08T20:54:55.174972+0000","last_active":"2024-05-08T20:54:55.174972+0000","last_peered":"2024-05-08T20:54:55.174972+0000","last_clean":"2024-05-08T20:54:55.174972+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:55.174972+0000","last_undegraded":"2024-05-08T20:54:55.174972+0000","last_fullsized":"2024-05-08T20:54:55.174972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'619","last_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_deep_scrub":"26'619","last_deep_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.174692+0000","objects_scrubbed":1,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:43.612782+0000","scrub_duration":0.059475472000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.147415+0000","last_change":"2024-05-08T20:55:11.147679+0000","last_active":"2024-05-08T20:55:11.147415+0000","last_peered":"2024-05-08T20:55:11.147415+0000","last_clean":"2024-05-08T20:55:11.147415+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:55:11.147415+0000","last_undegraded":"2024-05-08T20:55:11.147415+0000","last_fullsized":"2024-05-08T20:55:11.147415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3818","last_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_deep_scrub":"26'3818","last_deep_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.147361+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:52.832177+0000","scrub_duration":0.046126465999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.673307+0000","last_change":"2024-05-08T20:55:33.673559+0000","last_active":"2024-05-08T20:55:33.673307+0000","last_peered":"2024-05-08T20:55:33.673307+0000","last_clean":"2024-05-08T20:55:33.673307+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:55:33.673307+0000","last_undegraded":"2024-05-08T20:55:33.673307+0000","last_fullsized":"2024-05-08T20:55:33.673307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.673248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:18.931451+0000","scrub_duration":0.0067036639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.186266+0000","last_change":"2024-05-08T20:54:51.186266+0000","last_active":"2024-05-08T20:54:51.186266+0000","last_peered":"2024-05-08T20:54:51.186266+0000","last_clean":"2024-05-08T20:54:51.186266+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:51.186266+0000","last_undegraded":"2024-05-08T20:54:51.186266+0000","last_fullsized":"2024-05-08T20:54:51.186266+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6790","last_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_deep_scrub":"26'6790","last_deep_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.185945+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:12.471228+0000","scrub_duration":0.025898879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.145576+0000","last_change":"2024-05-08T20:54:52.145576+0000","last_active":"2024-05-08T20:54:52.145576+0000","last_peered":"2024-05-08T20:54:52.145576+0000","last_clean":"2024-05-08T20:54:52.145576+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:52.145576+0000","last_undegraded":"2024-05-08T20:54:52.145576+0000","last_fullsized":"2024-05-08T20:54:52.145576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.145299+0000","objects_scrubbed":1,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:17.689064+0000","scrub_duration":0.013037381000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.647773+0000","last_change":"2024-05-08T20:55:33.647883+0000","last_active":"2024-05-08T20:55:33.647773+0000","last_peered":"2024-05-08T20:55:33.647773+0000","last_clean":"2024-05-08T20:55:33.647773+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:55:33.647773+0000","last_undegraded":"2024-05-08T20:55:33.647773+0000","last_fullsized":"2024-05-08T20:55:33.647773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4662","last_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_deep_scrub":"26'4662","last_deep_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.647749+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:01.916015+0000","scrub_duration":0.126015248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.576011+0000","last_change":"2024-05-08T20:55:08.576011+0000","last_active":"2024-05-08T20:55:08.576011+0000","last_peered":"2024-05-08T20:55:08.576011+0000","last_clean":"2024-05-08T20:55:08.576011+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:55:08.576011+0000","last_undegraded":"2024-05-08T20:55:08.576011+0000","last_fullsized":"2024-05-08T20:55:08.576011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5323","last_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_deep_scrub":"26'5323","last_deep_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.575724+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:03.281285+0000","scrub_duration":0.015670814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1107","reported_seq":1148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.662027+0000","last_change":"2024-05-08T20:55:40.662250+0000","last_active":"2024-05-08T20:55:40.662027+0000","last_peered":"2024-05-08T20:55:40.662027+0000","last_clean":"2024-05-08T20:55:40.662027+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:55:40.662027+0000","last_undegraded":"2024-05-08T20:55:40.662027+0000","last_fullsized":"2024-05-08T20:55:40.662027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1107","last_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_deep_scrub":"26'1107","last_deep_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.661973+0000","objects_scrubbed":2,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:39.070710+0000","scrub_duration":0.029834421999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.298281+0000","last_change":"2024-05-08T20:54:46.298581+0000","last_active":"2024-05-08T20:54:46.298281+0000","last_peered":"2024-05-08T20:54:46.298281+0000","last_clean":"2024-05-08T20:54:46.298281+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:46.298281+0000","last_undegraded":"2024-05-08T20:54:46.298281+0000","last_fullsized":"2024-05-08T20:54:46.298281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.298228+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:28.684882+0000","scrub_duration":0.047052471999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.551738+0000","last_change":"2024-05-08T20:55:08.552011+0000","last_active":"2024-05-08T20:55:08.551738+0000","last_peered":"2024-05-08T20:55:08.551738+0000","last_clean":"2024-05-08T20:55:08.551738+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:55:08.551738+0000","last_undegraded":"2024-05-08T20:55:08.551738+0000","last_fullsized":"2024-05-08T20:55:08.551738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4342","last_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_deep_scrub":"26'4342","last_deep_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.551682+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:49.967545+0000","scrub_duration":0.065785658999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.490880+0000","last_change":"2024-05-08T20:55:30.491109+0000","last_active":"2024-05-08T20:55:30.490880+0000","last_peered":"2024-05-08T20:55:30.490880+0000","last_clean":"2024-05-08T20:55:30.490880+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:55:30.490880+0000","last_undegraded":"2024-05-08T20:55:30.490880+0000","last_fullsized":"2024-05-08T20:55:30.490880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4762","last_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_deep_scrub":"26'4762","last_deep_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.490824+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:39.900078+0000","scrub_duration":0.031951308999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.642343+0000","last_change":"2024-05-08T20:55:14.642343+0000","last_active":"2024-05-08T20:55:14.642343+0000","last_peered":"2024-05-08T20:55:14.642343+0000","last_clean":"2024-05-08T20:55:14.642343+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:55:14.642343+0000","last_undegraded":"2024-05-08T20:55:14.642343+0000","last_fullsized":"2024-05-08T20:55:14.642343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.642037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:30.640727+0000","scrub_duration":0.0074746580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.127560+0000","last_change":"2024-05-08T20:54:59.127778+0000","last_active":"2024-05-08T20:54:59.127560+0000","last_peered":"2024-05-08T20:54:59.127560+0000","last_clean":"2024-05-08T20:54:59.127560+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:59.127560+0000","last_undegraded":"2024-05-08T20:54:59.127560+0000","last_fullsized":"2024-05-08T20:54:59.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.127504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:30.421435+0000","scrub_duration":0.0034702330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3475,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.028473+0000","last_change":"2024-05-08T20:55:29.028690+0000","last_active":"2024-05-08T20:55:29.028473+0000","last_peered":"2024-05-08T20:55:29.028473+0000","last_clean":"2024-05-08T20:55:29.028473+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:55:29.028473+0000","last_undegraded":"2024-05-08T20:55:29.028473+0000","last_fullsized":"2024-05-08T20:55:29.028473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3439","last_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_deep_scrub":"26'3439","last_deep_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.028429+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:19.936303+0000","scrub_duration":0.056611084999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.443400+0000","last_change":"2024-05-08T20:55:29.443400+0000","last_active":"2024-05-08T20:55:29.443400+0000","last_peered":"2024-05-08T20:55:29.443400+0000","last_clean":"2024-05-08T20:55:29.443400+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:55:29.443400+0000","last_undegraded":"2024-05-08T20:55:29.443400+0000","last_fullsized":"2024-05-08T20:55:29.443400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4943","last_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_deep_scrub":"26'4943","last_deep_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.442961+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.926108+0000","scrub_duration":0.022816175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.671190+0000","last_change":"2024-05-08T20:55:13.671190+0000","last_active":"2024-05-08T20:55:13.671190+0000","last_peered":"2024-05-08T20:55:13.671190+0000","last_clean":"2024-05-08T20:55:13.671190+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:55:13.671190+0000","last_undegraded":"2024-05-08T20:55:13.671190+0000","last_fullsized":"2024-05-08T20:55:13.671190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.670918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:25.637941+0000","scrub_duration":0.0076373999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.870480+0000","last_change":"2024-05-08T20:54:56.870718+0000","last_active":"2024-05-08T20:54:56.870480+0000","last_peered":"2024-05-08T20:54:56.870480+0000","last_clean":"2024-05-08T20:54:56.870480+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:56.870480+0000","last_undegraded":"2024-05-08T20:54:56.870480+0000","last_fullsized":"2024-05-08T20:54:56.870480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.870433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:43.134102+0000","scrub_duration":0.054762970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5807,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:55.205936+0000","last_change":"2024-05-08T20:55:55.206178+0000","last_active":"2024-05-08T20:55:55.205936+0000","last_peered":"2024-05-08T20:55:55.205936+0000","last_clean":"2024-05-08T20:55:55.205936+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:55:55.205936+0000","last_undegraded":"2024-05-08T20:55:55.205936+0000","last_fullsized":"2024-05-08T20:55:55.205936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5771","last_scrub_stamp":"2024-05-08T20:55:55.205885+0000","last_deep_scrub":"26'5771","last_deep_scrub_stamp":"2024-05-08T20:55:55.205885+0000","last_clean_scrub_stamp":"2024-05-08T20:55:55.205885+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:51.999348+0000","scrub_duration":0.026754956999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.863669+0000","last_change":"2024-05-08T20:55:11.863669+0000","last_active":"2024-05-08T20:55:11.863669+0000","last_peered":"2024-05-08T20:55:11.863669+0000","last_clean":"2024-05-08T20:55:11.863669+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:55:11.863669+0000","last_undegraded":"2024-05-08T20:55:11.863669+0000","last_fullsized":"2024-05-08T20:55:11.863669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4668","last_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_deep_scrub":"26'4668","last_deep_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.863229+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:40.887182+0000","scrub_duration":0.013718674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.641900+0000","last_change":"2024-05-08T20:55:47.642193+0000","last_active":"2024-05-08T20:55:47.641900+0000","last_peered":"2024-05-08T20:55:47.641900+0000","last_clean":"2024-05-08T20:55:47.641900+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:55:47.641900+0000","last_undegraded":"2024-05-08T20:55:47.641900+0000","last_fullsized":"2024-05-08T20:55:47.641900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:47.641840+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:47.641840+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.641840+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:29.061974+0000","scrub_duration":0.0042002439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.185941+0000","last_change":"2024-05-08T20:54:44.186218+0000","last_active":"2024-05-08T20:54:44.185941+0000","last_peered":"2024-05-08T20:54:44.185941+0000","last_clean":"2024-05-08T20:54:44.185941+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:44.185941+0000","last_undegraded":"2024-05-08T20:54:44.185941+0000","last_fullsized":"2024-05-08T20:54:44.185941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_clean_scrub_stamp":"2024-05-08T20:54:44.185881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:49.152153+0000","scrub_duration":0.0071163260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.468990+0000","last_change":"2024-05-08T20:55:14.468990+0000","last_active":"2024-05-08T20:55:14.468990+0000","last_peered":"2024-05-08T20:55:14.468990+0000","last_clean":"2024-05-08T20:55:14.468990+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:55:14.468990+0000","last_undegraded":"2024-05-08T20:55:14.468990+0000","last_fullsized":"2024-05-08T20:55:14.468990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3392","last_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_deep_scrub":"26'3392","last_deep_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.468610+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:17.529243+0000","scrub_duration":0.100340728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.043067+0000","last_change":"2024-05-08T20:54:59.043067+0000","last_active":"2024-05-08T20:54:59.043067+0000","last_peered":"2024-05-08T20:54:59.043067+0000","last_clean":"2024-05-08T20:54:59.043067+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:59.043067+0000","last_undegraded":"2024-05-08T20:54:59.043067+0000","last_fullsized":"2024-05-08T20:54:59.043067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6011","last_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_deep_scrub":"26'6011","last_deep_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.042843+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:03.715065+0000","scrub_duration":0.062194480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'9","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.549940+0000","last_change":"2024-05-08T20:54:55.549940+0000","last_active":"2024-05-08T20:54:55.549940+0000","last_peered":"2024-05-08T20:54:55.549940+0000","last_clean":"2024-05-08T20:54:55.549940+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:54:55.549940+0000","last_undegraded":"2024-05-08T20:54:55.549940+0000","last_fullsized":"2024-05-08T20:54:55.549940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.549635+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:30.768311+0000","scrub_duration":0.012030836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'65","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.950830+0000","last_change":"2024-05-08T20:55:22.951068+0000","last_active":"2024-05-08T20:55:22.950830+0000","last_peered":"2024-05-08T20:55:22.950830+0000","last_clean":"2024-05-08T20:55:22.950830+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:55:22.950830+0000","last_undegraded":"2024-05-08T20:55:22.950830+0000","last_fullsized":"2024-05-08T20:55:22.950830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.950775+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:09.874263+0000","scrub_duration":0.0069395639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4017,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.923004+0000","last_change":"2024-05-08T20:55:34.923234+0000","last_active":"2024-05-08T20:55:34.923004+0000","last_peered":"2024-05-08T20:55:34.923004+0000","last_clean":"2024-05-08T20:55:34.923004+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:55:34.923004+0000","last_undegraded":"2024-05-08T20:55:34.923004+0000","last_fullsized":"2024-05-08T20:55:34.923004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3980","last_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_deep_scrub":"26'3980","last_deep_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.922959+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:15.764076+0000","scrub_duration":0.048454346000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4708,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.222714+0000","last_change":"2024-05-08T20:55:20.222714+0000","last_active":"2024-05-08T20:55:20.222714+0000","last_peered":"2024-05-08T20:55:20.222714+0000","last_clean":"2024-05-08T20:55:20.222714+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:55:20.222714+0000","last_undegraded":"2024-05-08T20:55:20.222714+0000","last_fullsized":"2024-05-08T20:55:20.222714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.222435+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:22.265649+0000","scrub_duration":0.010318590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'255","reported_seq":297,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.700383+0000","last_change":"2024-05-08T20:55:11.700383+0000","last_active":"2024-05-08T20:55:11.700383+0000","last_peered":"2024-05-08T20:55:11.700383+0000","last_clean":"2024-05-08T20:55:11.700383+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:55:11.700383+0000","last_undegraded":"2024-05-08T20:55:11.700383+0000","last_fullsized":"2024-05-08T20:55:11.700383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'255","last_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_deep_scrub":"26'255","last_deep_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.700078+0000","objects_scrubbed":1,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:05.942160+0000","scrub_duration":0.012718293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.476447+0000","last_change":"2024-05-08T20:55:09.476447+0000","last_active":"2024-05-08T20:55:09.476447+0000","last_peered":"2024-05-08T20:55:09.476447+0000","last_clean":"2024-05-08T20:55:09.476447+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:55:09.476447+0000","last_undegraded":"2024-05-08T20:55:09.476447+0000","last_fullsized":"2024-05-08T20:55:09.476447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.476143+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:20.326575+0000","scrub_duration":0.0053068539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.579958+0000","last_change":"2024-05-08T20:55:27.580135+0000","last_active":"2024-05-08T20:55:27.579958+0000","last_peered":"2024-05-08T20:55:27.579958+0000","last_clean":"2024-05-08T20:55:27.579958+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:55:27.579958+0000","last_undegraded":"2024-05-08T20:55:27.579958+0000","last_fullsized":"2024-05-08T20:55:27.579958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4309","last_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_deep_scrub":"26'4309","last_deep_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.579920+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:08.630417+0000","scrub_duration":0.096292584000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6877,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.661513+0000","last_change":"2024-05-08T20:55:20.661789+0000","last_active":"2024-05-08T20:55:20.661513+0000","last_peered":"2024-05-08T20:55:20.661513+0000","last_clean":"2024-05-08T20:55:20.661513+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:55:20.661513+0000","last_undegraded":"2024-05-08T20:55:20.661513+0000","last_fullsized":"2024-05-08T20:55:20.661513+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6836","last_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_deep_scrub":"26'6836","last_deep_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.661466+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.019245+0000","scrub_duration":0.046721182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.679878+0000","last_change":"2024-05-08T20:55:35.680097+0000","last_active":"2024-05-08T20:55:35.679878+0000","last_peered":"2024-05-08T20:55:35.679878+0000","last_clean":"2024-05-08T20:55:35.679878+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:55:35.679878+0000","last_undegraded":"2024-05-08T20:55:35.679878+0000","last_fullsized":"2024-05-08T20:55:35.679878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.679823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:18.016597+0000","scrub_duration":0.0038273439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.016256+0000","last_change":"2024-05-08T20:55:07.016519+0000","last_active":"2024-05-08T20:55:07.016256+0000","last_peered":"2024-05-08T20:55:07.016256+0000","last_clean":"2024-05-08T20:55:07.016256+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:55:07.016256+0000","last_undegraded":"2024-05-08T20:55:07.016256+0000","last_fullsized":"2024-05-08T20:55:07.016256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.016198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:21.537191+0000","scrub_duration":0.034043589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4660,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.044003+0000","last_change":"2024-05-08T20:55:18.044138+0000","last_active":"2024-05-08T20:55:18.044003+0000","last_peered":"2024-05-08T20:55:18.044003+0000","last_clean":"2024-05-08T20:55:18.044003+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:55:18.044003+0000","last_undegraded":"2024-05-08T20:55:18.044003+0000","last_fullsized":"2024-05-08T20:55:18.044003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4623","last_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_deep_scrub":"26'4623","last_deep_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.043977+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:18.907698+0000","scrub_duration":0.113151719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.149350+0000","last_change":"2024-05-08T20:54:50.149623+0000","last_active":"2024-05-08T20:54:50.149350+0000","last_peered":"2024-05-08T20:54:50.149350+0000","last_clean":"2024-05-08T20:54:50.149350+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:50.149350+0000","last_undegraded":"2024-05-08T20:54:50.149350+0000","last_fullsized":"2024-05-08T20:54:50.149350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4622","last_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_deep_scrub":"26'4622","last_deep_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.149296+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:43.672383+0000","scrub_duration":0.028645501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.677449+0000","last_change":"2024-05-08T20:55:09.677733+0000","last_active":"2024-05-08T20:55:09.677449+0000","last_peered":"2024-05-08T20:55:09.677449+0000","last_clean":"2024-05-08T20:55:09.677449+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:55:09.677449+0000","last_undegraded":"2024-05-08T20:55:09.677449+0000","last_fullsized":"2024-05-08T20:55:09.677449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.677387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:52.277246+0000","scrub_duration":0.0096814850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.802099+0000","last_change":"2024-05-08T20:54:45.802328+0000","last_active":"2024-05-08T20:54:45.802099+0000","last_peered":"2024-05-08T20:54:45.802099+0000","last_clean":"2024-05-08T20:54:45.802099+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:45.802099+0000","last_undegraded":"2024-05-08T20:54:45.802099+0000","last_fullsized":"2024-05-08T20:54:45.802099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.802044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:29.693595+0000","scrub_duration":0.0040510620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.092766+0000","last_change":"2024-05-08T20:55:22.093023+0000","last_active":"2024-05-08T20:55:22.092766+0000","last_peered":"2024-05-08T20:55:22.092766+0000","last_clean":"2024-05-08T20:55:22.092766+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:55:22.092766+0000","last_undegraded":"2024-05-08T20:55:22.092766+0000","last_fullsized":"2024-05-08T20:55:22.092766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4079","last_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_deep_scrub":"26'4079","last_deep_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.092719+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:36.160004+0000","scrub_duration":0.119144502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.951072+0000","last_change":"2024-05-08T20:55:15.951284+0000","last_active":"2024-05-08T20:55:15.951072+0000","last_peered":"2024-05-08T20:55:15.951072+0000","last_clean":"2024-05-08T20:55:15.951072+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:55:15.951072+0000","last_undegraded":"2024-05-08T20:55:15.951072+0000","last_fullsized":"2024-05-08T20:55:15.951072+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5879","last_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_deep_scrub":"26'5879","last_deep_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.951022+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:30.374831+0000","scrub_duration":0.045408759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.176230+0000","last_change":"2024-05-08T20:55:29.176471+0000","last_active":"2024-05-08T20:55:29.176230+0000","last_peered":"2024-05-08T20:55:29.176230+0000","last_clean":"2024-05-08T20:55:29.176230+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:55:29.176230+0000","last_undegraded":"2024-05-08T20:55:29.176230+0000","last_fullsized":"2024-05-08T20:55:29.176230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.176178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:58.118118+0000","scrub_duration":0.0061181179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.723537+0000","last_change":"2024-05-08T20:54:43.723653+0000","last_active":"2024-05-08T20:54:43.723537+0000","last_peered":"2024-05-08T20:54:43.723537+0000","last_clean":"2024-05-08T20:54:43.723537+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:43.723537+0000","last_undegraded":"2024-05-08T20:54:43.723537+0000","last_fullsized":"2024-05-08T20:54:43.723537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.723507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:06.949102+0000","scrub_duration":0.001729041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.506331+0000","last_change":"2024-05-08T20:55:06.506331+0000","last_active":"2024-05-08T20:55:06.506331+0000","last_peered":"2024-05-08T20:55:06.506331+0000","last_clean":"2024-05-08T20:55:06.506331+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:55:06.506331+0000","last_undegraded":"2024-05-08T20:55:06.506331+0000","last_fullsized":"2024-05-08T20:55:06.506331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.506041+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:14.298193+0000","scrub_duration":0.090320424999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.609510+0000","last_change":"2024-05-08T20:55:17.609510+0000","last_active":"2024-05-08T20:55:17.609510+0000","last_peered":"2024-05-08T20:55:17.609510+0000","last_clean":"2024-05-08T20:55:17.609510+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:55:17.609510+0000","last_undegraded":"2024-05-08T20:55:17.609510+0000","last_fullsized":"2024-05-08T20:55:17.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4755","last_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_deep_scrub":"26'4755","last_deep_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.609211+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.114442+0000","scrub_duration":0.021058222000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'73","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.584883+0000","last_change":"2024-05-08T20:54:47.585094+0000","last_active":"2024-05-08T20:54:47.584883+0000","last_peered":"2024-05-08T20:54:47.584883+0000","last_clean":"2024-05-08T20:54:47.584883+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:47.584883+0000","last_undegraded":"2024-05-08T20:54:47.584883+0000","last_fullsized":"2024-05-08T20:54:47.584883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.584829+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.762899+0000","scrub_duration":0.021519024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.758169+0000","last_change":"2024-05-08T20:54:48.758169+0000","last_active":"2024-05-08T20:54:48.758169+0000","last_peered":"2024-05-08T20:54:48.758169+0000","last_clean":"2024-05-08T20:54:48.758169+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:48.758169+0000","last_undegraded":"2024-05-08T20:54:48.758169+0000","last_fullsized":"2024-05-08T20:54:48.758169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.757894+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:28.411623+0000","scrub_duration":0.026700504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:46.186137+0000","last_change":"2024-05-08T20:55:46.186386+0000","last_active":"2024-05-08T20:55:46.186137+0000","last_peered":"2024-05-08T20:55:46.186137+0000","last_clean":"2024-05-08T20:55:46.186137+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:55:46.186137+0000","last_undegraded":"2024-05-08T20:55:46.186137+0000","last_fullsized":"2024-05-08T20:55:46.186137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3628","last_scrub_stamp":"2024-05-08T20:55:46.186083+0000","last_deep_scrub":"26'3628","last_deep_scrub_stamp":"2024-05-08T20:55:46.186083+0000","last_clean_scrub_stamp":"2024-05-08T20:55:46.186083+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:34.901845+0000","scrub_duration":0.039027459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":5008,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.005590+0000","last_change":"2024-05-08T20:54:55.005875+0000","last_active":"2024-05-08T20:54:55.005590+0000","last_peered":"2024-05-08T20:54:55.005590+0000","last_clean":"2024-05-08T20:54:55.005590+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:55.005590+0000","last_undegraded":"2024-05-08T20:54:55.005590+0000","last_fullsized":"2024-05-08T20:54:55.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4967","last_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_deep_scrub":"26'4967","last_deep_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.005533+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:32.459770+0000","scrub_duration":0.055935091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.647597+0000","last_change":"2024-05-08T20:55:37.647809+0000","last_active":"2024-05-08T20:55:37.647597+0000","last_peered":"2024-05-08T20:55:37.647597+0000","last_clean":"2024-05-08T20:55:37.647597+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:55:37.647597+0000","last_undegraded":"2024-05-08T20:55:37.647597+0000","last_fullsized":"2024-05-08T20:55:37.647597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.647540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:23.038617+0000","scrub_duration":0.0036765499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'277","reported_seq":315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.959319+0000","last_change":"2024-05-08T20:55:07.959319+0000","last_active":"2024-05-08T20:55:07.959319+0000","last_peered":"2024-05-08T20:55:07.959319+0000","last_clean":"2024-05-08T20:55:07.959319+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:55:07.959319+0000","last_undegraded":"2024-05-08T20:55:07.959319+0000","last_fullsized":"2024-05-08T20:55:07.959319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.959046+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:19.805541+0000","scrub_duration":0.0082517920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:03.801127+0000","last_change":"2024-05-08T20:56:03.801382+0000","last_active":"2024-05-08T20:56:03.801127+0000","last_peered":"2024-05-08T20:56:03.801127+0000","last_clean":"2024-05-08T20:56:03.801127+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:56:03.801127+0000","last_undegraded":"2024-05-08T20:56:03.801127+0000","last_fullsized":"2024-05-08T20:56:03.801127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5479","last_scrub_stamp":"2024-05-08T20:56:03.801073+0000","last_deep_scrub":"26'5479","last_deep_scrub_stamp":"2024-05-08T20:56:03.801073+0000","last_clean_scrub_stamp":"2024-05-08T20:56:03.801073+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:40.218781+0000","scrub_duration":0.072488915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.390992+0000","last_change":"2024-05-08T20:55:27.391236+0000","last_active":"2024-05-08T20:55:27.390992+0000","last_peered":"2024-05-08T20:55:27.390992+0000","last_clean":"2024-05-08T20:55:27.390992+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:55:27.390992+0000","last_undegraded":"2024-05-08T20:55:27.390992+0000","last_fullsized":"2024-05-08T20:55:27.390992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5070","last_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_deep_scrub":"26'5070","last_deep_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.390937+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:54.672683+0000","scrub_duration":0.014365846999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.183366+0000","last_change":"2024-05-08T20:55:30.183602+0000","last_active":"2024-05-08T20:55:30.183366+0000","last_peered":"2024-05-08T20:55:30.183366+0000","last_clean":"2024-05-08T20:55:30.183366+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:55:30.183366+0000","last_undegraded":"2024-05-08T20:55:30.183366+0000","last_fullsized":"2024-05-08T20:55:30.183366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.183311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:37.269932+0000","scrub_duration":0.010531156999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.799061+0000","last_change":"2024-05-08T20:55:29.799301+0000","last_active":"2024-05-08T20:55:29.799061+0000","last_peered":"2024-05-08T20:55:29.799061+0000","last_clean":"2024-05-08T20:55:29.799061+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:55:29.799061+0000","last_undegraded":"2024-05-08T20:55:29.799061+0000","last_fullsized":"2024-05-08T20:55:29.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.799005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:26.004174+0000","scrub_duration":0.010450918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.523201+0000","last_change":"2024-05-08T20:55:17.523419+0000","last_active":"2024-05-08T20:55:17.523201+0000","last_peered":"2024-05-08T20:55:17.523201+0000","last_clean":"2024-05-08T20:55:17.523201+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:55:17.523201+0000","last_undegraded":"2024-05-08T20:55:17.523201+0000","last_fullsized":"2024-05-08T20:55:17.523201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.523147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:26.971511+0000","scrub_duration":0.0037874789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.561694+0000","last_change":"2024-05-08T20:55:09.561956+0000","last_active":"2024-05-08T20:55:09.561694+0000","last_peered":"2024-05-08T20:55:09.561694+0000","last_clean":"2024-05-08T20:55:09.561694+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:55:09.561694+0000","last_undegraded":"2024-05-08T20:55:09.561694+0000","last_fullsized":"2024-05-08T20:55:09.561694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3754","last_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_deep_scrub":"26'3754","last_deep_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.561619+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.309817+0000","scrub_duration":0.072311814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.675660+0000","last_change":"2024-05-08T20:54:59.675908+0000","last_active":"2024-05-08T20:54:59.675660+0000","last_peered":"2024-05-08T20:54:59.675660+0000","last_clean":"2024-05-08T20:54:59.675660+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:59.675660+0000","last_undegraded":"2024-05-08T20:54:59.675660+0000","last_fullsized":"2024-05-08T20:54:59.675660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5554","last_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_deep_scrub":"26'5554","last_deep_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.675603+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:25.048100+0000","scrub_duration":0.019361314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.490516+0000","last_change":"2024-05-08T20:54:54.490784+0000","last_active":"2024-05-08T20:54:54.490516+0000","last_peered":"2024-05-08T20:54:54.490516+0000","last_clean":"2024-05-08T20:54:54.490516+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:54.490516+0000","last_undegraded":"2024-05-08T20:54:54.490516+0000","last_fullsized":"2024-05-08T20:54:54.490516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.490464+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:32.933174+0000","scrub_duration":0.0037125420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.537068+0000","last_change":"2024-05-08T20:55:11.537068+0000","last_active":"2024-05-08T20:55:11.537068+0000","last_peered":"2024-05-08T20:55:11.537068+0000","last_clean":"2024-05-08T20:55:11.537068+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:55:11.537068+0000","last_undegraded":"2024-05-08T20:55:11.537068+0000","last_fullsized":"2024-05-08T20:55:11.537068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.536797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:00.377575+0000","scrub_duration":0.0033698030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4049,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.521421+0000","last_change":"2024-05-08T20:55:07.521421+0000","last_active":"2024-05-08T20:55:07.521421+0000","last_peered":"2024-05-08T20:55:07.521421+0000","last_clean":"2024-05-08T20:55:07.521421+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:55:07.521421+0000","last_undegraded":"2024-05-08T20:55:07.521421+0000","last_fullsized":"2024-05-08T20:55:07.521421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4012","last_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_deep_scrub":"26'4012","last_deep_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.521110+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:03.444633+0000","scrub_duration":0.063926325000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5635,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.501804+0000","last_change":"2024-05-08T20:55:16.502074+0000","last_active":"2024-05-08T20:55:16.501804+0000","last_peered":"2024-05-08T20:55:16.501804+0000","last_clean":"2024-05-08T20:55:16.501804+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:55:16.501804+0000","last_undegraded":"2024-05-08T20:55:16.501804+0000","last_fullsized":"2024-05-08T20:55:16.501804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5601","last_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_deep_scrub":"26'5601","last_deep_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.501744+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:36.883976+0000","scrub_duration":0.012783813,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'7","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:12.704523+0000","last_change":"2024-05-08T20:55:12.704754+0000","last_active":"2024-05-08T20:55:12.704523+0000","last_peered":"2024-05-08T20:55:12.704523+0000","last_clean":"2024-05-08T20:55:12.704523+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:55:12.704523+0000","last_undegraded":"2024-05-08T20:55:12.704523+0000","last_fullsized":"2024-05-08T20:55:12.704523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_clean_scrub_stamp":"2024-05-08T20:55:12.704463+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:16.190314+0000","scrub_duration":0.023886415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1138","reported_seq":1175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.063954+0000","last_change":"2024-05-08T20:55:09.064235+0000","last_active":"2024-05-08T20:55:09.063954+0000","last_peered":"2024-05-08T20:55:09.063954+0000","last_clean":"2024-05-08T20:55:09.063954+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:55:09.063954+0000","last_undegraded":"2024-05-08T20:55:09.063954+0000","last_fullsized":"2024-05-08T20:55:09.063954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1138","last_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_deep_scrub":"26'1138","last_deep_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.063899+0000","objects_scrubbed":2,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:52.567416+0000","scrub_duration":0.080673476999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3870,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:57.741612+0000","last_change":"2024-05-08T20:55:57.741864+0000","last_active":"2024-05-08T20:55:57.741612+0000","last_peered":"2024-05-08T20:55:57.741612+0000","last_clean":"2024-05-08T20:55:57.741612+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:55:57.741612+0000","last_undegraded":"2024-05-08T20:55:57.741612+0000","last_fullsized":"2024-05-08T20:55:57.741612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3833","last_scrub_stamp":"2024-05-08T20:55:57.741553+0000","last_deep_scrub":"26'3833","last_deep_scrub_stamp":"2024-05-08T20:55:57.741553+0000","last_clean_scrub_stamp":"2024-05-08T20:55:57.741553+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:47.452983+0000","scrub_duration":0.063092123999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.820930+0000","last_change":"2024-05-08T20:55:24.821157+0000","last_active":"2024-05-08T20:55:24.820930+0000","last_peered":"2024-05-08T20:55:24.820930+0000","last_clean":"2024-05-08T20:55:24.820930+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:55:24.820930+0000","last_undegraded":"2024-05-08T20:55:24.820930+0000","last_fullsized":"2024-05-08T20:55:24.820930+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7221","last_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_deep_scrub":"26'7221","last_deep_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.820875+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:12.961351+0000","scrub_duration":0.011508404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.541242+0000","last_change":"2024-05-08T20:54:46.541548+0000","last_active":"2024-05-08T20:54:46.541242+0000","last_peered":"2024-05-08T20:54:46.541242+0000","last_clean":"2024-05-08T20:54:46.541242+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:46.541242+0000","last_undegraded":"2024-05-08T20:54:46.541242+0000","last_fullsized":"2024-05-08T20:54:46.541242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.541186+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:53.630432+0000","scrub_duration":0.014769915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.201979+0000","last_change":"2024-05-08T20:54:55.201979+0000","last_active":"2024-05-08T20:54:55.201979+0000","last_peered":"2024-05-08T20:54:55.201979+0000","last_clean":"2024-05-08T20:54:55.201979+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:55.201979+0000","last_undegraded":"2024-05-08T20:54:55.201979+0000","last_fullsized":"2024-05-08T20:54:55.201979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.201695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:39.510474+0000","scrub_duration":0.0064570130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3763,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.650155+0000","last_change":"2024-05-08T20:54:45.650155+0000","last_active":"2024-05-08T20:54:45.650155+0000","last_peered":"2024-05-08T20:54:45.650155+0000","last_clean":"2024-05-08T20:54:45.650155+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:45.650155+0000","last_undegraded":"2024-05-08T20:54:45.650155+0000","last_fullsized":"2024-05-08T20:54:45.650155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3726","last_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_deep_scrub":"26'3726","last_deep_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.649980+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:59.522800+0000","scrub_duration":0.11612742700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.738096+0000","last_change":"2024-05-08T20:55:21.738325+0000","last_active":"2024-05-08T20:55:21.738096+0000","last_peered":"2024-05-08T20:55:21.738096+0000","last_clean":"2024-05-08T20:55:21.738096+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:55:21.738096+0000","last_undegraded":"2024-05-08T20:55:21.738096+0000","last_fullsized":"2024-05-08T20:55:21.738096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4502","last_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_deep_scrub":"26'4502","last_deep_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.738039+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:43.638169+0000","scrub_duration":0.011148622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.196680+0000","last_change":"2024-05-08T20:55:03.196899+0000","last_active":"2024-05-08T20:55:03.196680+0000","last_peered":"2024-05-08T20:55:03.196680+0000","last_clean":"2024-05-08T20:55:03.196680+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:55:03.196680+0000","last_undegraded":"2024-05-08T20:55:03.196680+0000","last_fullsized":"2024-05-08T20:55:03.196680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.196622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:49.285017+0000","scrub_duration":0.017642686000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.240489+0000","last_change":"2024-05-08T20:54:48.240489+0000","last_active":"2024-05-08T20:54:48.240489+0000","last_peered":"2024-05-08T20:54:48.240489+0000","last_clean":"2024-05-08T20:54:48.240489+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:48.240489+0000","last_undegraded":"2024-05-08T20:54:48.240489+0000","last_fullsized":"2024-05-08T20:54:48.240489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.240164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:57.651499+0000","scrub_duration":0.0039283549999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.503104+0000","last_change":"2024-05-08T20:55:47.503330+0000","last_active":"2024-05-08T20:55:47.503104+0000","last_peered":"2024-05-08T20:55:47.503104+0000","last_clean":"2024-05-08T20:55:47.503104+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:55:47.503104+0000","last_undegraded":"2024-05-08T20:55:47.503104+0000","last_fullsized":"2024-05-08T20:55:47.503104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4490","last_scrub_stamp":"2024-05-08T20:55:47.503047+0000","last_deep_scrub":"26'4490","last_deep_scrub_stamp":"2024-05-08T20:55:47.503047+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.503047+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:29.437257+0000","scrub_duration":0.036698586999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:00.644023+0000","last_change":"2024-05-08T20:55:00.644023+0000","last_active":"2024-05-08T20:55:00.644023+0000","last_peered":"2024-05-08T20:55:00.644023+0000","last_clean":"2024-05-08T20:55:00.644023+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:55:00.644023+0000","last_undegraded":"2024-05-08T20:55:00.644023+0000","last_fullsized":"2024-05-08T20:55:00.644023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4877","last_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_deep_scrub":"26'4877","last_deep_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_clean_scrub_stamp":"2024-05-08T20:55:00.643679+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:46.199456+0000","scrub_duration":0.018174326000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'19","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.552614+0000","last_change":"2024-05-08T20:54:56.552614+0000","last_active":"2024-05-08T20:54:56.552614+0000","last_peered":"2024-05-08T20:54:56.552614+0000","last_clean":"2024-05-08T20:54:56.552614+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:56.552614+0000","last_undegraded":"2024-05-08T20:54:56.552614+0000","last_fullsized":"2024-05-08T20:54:56.552614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.552316+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:38.919551+0000","scrub_duration":0.016343099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.950947+0000","last_change":"2024-05-08T20:54:43.951036+0000","last_active":"2024-05-08T20:54:43.950947+0000","last_peered":"2024-05-08T20:54:43.950947+0000","last_clean":"2024-05-08T20:54:43.950947+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:43.950947+0000","last_undegraded":"2024-05-08T20:54:43.950947+0000","last_fullsized":"2024-05-08T20:54:43.950947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.950926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:21.719335+0000","scrub_duration":0.0015213539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:54.204200+0000","last_change":"2024-05-08T20:55:54.204477+0000","last_active":"2024-05-08T20:55:54.204200+0000","last_peered":"2024-05-08T20:55:54.204200+0000","last_clean":"2024-05-08T20:55:54.204200+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:55:54.204200+0000","last_undegraded":"2024-05-08T20:55:54.204200+0000","last_fullsized":"2024-05-08T20:55:54.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4830","last_scrub_stamp":"2024-05-08T20:55:54.204146+0000","last_deep_scrub":"26'4830","last_deep_scrub_stamp":"2024-05-08T20:55:54.204146+0000","last_clean_scrub_stamp":"2024-05-08T20:55:54.204146+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:33.593568+0000","scrub_duration":0.033220448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.624126+0000","last_change":"2024-05-08T20:55:05.624126+0000","last_active":"2024-05-08T20:55:05.624126+0000","last_peered":"2024-05-08T20:55:05.624126+0000","last_clean":"2024-05-08T20:55:05.624126+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:55:05.624126+0000","last_undegraded":"2024-05-08T20:55:05.624126+0000","last_fullsized":"2024-05-08T20:55:05.624126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4806","last_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_deep_scrub":"26'4806","last_deep_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.623784+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:05.299562+0000","scrub_duration":0.050542888000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:53.472321+0000","last_change":"2024-05-08T20:54:53.472321+0000","last_active":"2024-05-08T20:54:53.472321+0000","last_peered":"2024-05-08T20:54:53.472321+0000","last_clean":"2024-05-08T20:54:53.472321+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:54:53.472321+0000","last_undegraded":"2024-05-08T20:54:53.472321+0000","last_fullsized":"2024-05-08T20:54:53.472321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_clean_scrub_stamp":"2024-05-08T20:54:53.472031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:36.420711+0000","scrub_duration":0.0032315270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.416742+0000","last_change":"2024-05-08T20:55:01.416966+0000","last_active":"2024-05-08T20:55:01.416742+0000","last_peered":"2024-05-08T20:55:01.416742+0000","last_clean":"2024-05-08T20:55:01.416742+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:55:01.416742+0000","last_undegraded":"2024-05-08T20:55:01.416742+0000","last_fullsized":"2024-05-08T20:55:01.416742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.416687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:50.039785+0000","scrub_duration":0.038290926000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:45.229736+0000","last_change":"2024-05-08T20:55:45.229979+0000","last_active":"2024-05-08T20:55:45.229736+0000","last_peered":"2024-05-08T20:55:45.229736+0000","last_clean":"2024-05-08T20:55:45.229736+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:55:45.229736+0000","last_undegraded":"2024-05-08T20:55:45.229736+0000","last_fullsized":"2024-05-08T20:55:45.229736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3384","last_scrub_stamp":"2024-05-08T20:55:45.229683+0000","last_deep_scrub":"26'3384","last_deep_scrub_stamp":"2024-05-08T20:55:45.229683+0000","last_clean_scrub_stamp":"2024-05-08T20:55:45.229683+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:15.927106+0000","scrub_duration":0.068570875000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:50.707881+0000","last_change":"2024-05-08T20:55:50.708193+0000","last_active":"2024-05-08T20:55:50.707881+0000","last_peered":"2024-05-08T20:55:50.707881+0000","last_clean":"2024-05-08T20:55:50.707881+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:55:50.707881+0000","last_undegraded":"2024-05-08T20:55:50.707881+0000","last_fullsized":"2024-05-08T20:55:50.707881+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6053","last_scrub_stamp":"2024-05-08T20:55:50.707827+0000","last_deep_scrub":"26'6053","last_deep_scrub_stamp":"2024-05-08T20:55:50.707827+0000","last_clean_scrub_stamp":"2024-05-08T20:55:50.707827+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:18.842925+0000","scrub_duration":0.015015142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.171355+0000","last_change":"2024-05-08T20:55:35.171606+0000","last_active":"2024-05-08T20:55:35.171355+0000","last_peered":"2024-05-08T20:55:35.171355+0000","last_clean":"2024-05-08T20:55:35.171355+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:55:35.171355+0000","last_undegraded":"2024-05-08T20:55:35.171355+0000","last_fullsized":"2024-05-08T20:55:35.171355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.171302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:53.218021+0000","scrub_duration":0.0036972229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417411+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417411+0000","last_peered":"2024-05-08T20:54:43.417411+0000","last_clean":"2024-05-08T20:54:43.417411+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417411+0000","last_undegraded":"2024-05-08T20:54:43.417411+0000","last_fullsized":"2024-05-08T20:54:43.417411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.470587+0000","last_change":"2024-05-08T20:55:35.470865+0000","last_active":"2024-05-08T20:55:35.470587+0000","last_peered":"2024-05-08T20:55:35.470587+0000","last_clean":"2024-05-08T20:55:35.470587+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:55:35.470587+0000","last_undegraded":"2024-05-08T20:55:35.470587+0000","last_fullsized":"2024-05-08T20:55:35.470587+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5309","last_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_deep_scrub":"26'5309","last_deep_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.470527+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:48.455547+0000","scrub_duration":0.049539302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.102627+0000","last_change":"2024-05-08T20:54:57.102627+0000","last_active":"2024-05-08T20:54:57.102627+0000","last_peered":"2024-05-08T20:54:57.102627+0000","last_clean":"2024-05-08T20:54:57.102627+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:57.102627+0000","last_undegraded":"2024-05-08T20:54:57.102627+0000","last_fullsized":"2024-05-08T20:54:57.102627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4707","last_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_deep_scrub":"26'4707","last_deep_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.102409+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:04.868854+0000","scrub_duration":0.064899769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.967329+0000","last_change":"2024-05-08T20:54:47.967329+0000","last_active":"2024-05-08T20:54:47.967329+0000","last_peered":"2024-05-08T20:54:47.967329+0000","last_clean":"2024-05-08T20:54:47.967329+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:54:47.967329+0000","last_undegraded":"2024-05-08T20:54:47.967329+0000","last_fullsized":"2024-05-08T20:54:47.967329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.967013+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:43.643764+0000","scrub_duration":0.019010636000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.135142+0000","last_change":"2024-05-08T20:55:01.135433+0000","last_active":"2024-05-08T20:55:01.135142+0000","last_peered":"2024-05-08T20:55:01.135142+0000","last_clean":"2024-05-08T20:55:01.135142+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:55:01.135142+0000","last_undegraded":"2024-05-08T20:55:01.135142+0000","last_fullsized":"2024-05-08T20:55:01.135142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.135090+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:17.529691+0000","scrub_duration":0.017716335999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.359712+0000","last_change":"2024-05-08T20:55:17.359712+0000","last_active":"2024-05-08T20:55:17.359712+0000","last_peered":"2024-05-08T20:55:17.359712+0000","last_clean":"2024-05-08T20:55:17.359712+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:55:17.359712+0000","last_undegraded":"2024-05-08T20:55:17.359712+0000","last_fullsized":"2024-05-08T20:55:17.359712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4311","last_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_deep_scrub":"26'4311","last_deep_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.359387+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:10.597732+0000","scrub_duration":0.071380895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.557391+0000","last_change":"2024-05-08T20:55:04.557627+0000","last_active":"2024-05-08T20:55:04.557391+0000","last_peered":"2024-05-08T20:55:04.557391+0000","last_clean":"2024-05-08T20:55:04.557391+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:55:04.557391+0000","last_undegraded":"2024-05-08T20:55:04.557391+0000","last_fullsized":"2024-05-08T20:55:04.557391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4308","last_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_deep_scrub":"26'4308","last_deep_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.557335+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:14.404320+0000","scrub_duration":0.013594441000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'376","reported_seq":417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.547300+0000","last_change":"2024-05-08T20:55:01.547300+0000","last_active":"2024-05-08T20:55:01.547300+0000","last_peered":"2024-05-08T20:55:01.547300+0000","last_clean":"2024-05-08T20:55:01.547300+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:55:01.547300+0000","last_undegraded":"2024-05-08T20:55:01.547300+0000","last_fullsized":"2024-05-08T20:55:01.547300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'376","last_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_deep_scrub":"26'376","last_deep_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.546976+0000","objects_scrubbed":4,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:51.672058+0000","scrub_duration":0.025240988999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.700173+0000","last_change":"2024-05-08T20:54:50.700173+0000","last_active":"2024-05-08T20:54:50.700173+0000","last_peered":"2024-05-08T20:54:50.700173+0000","last_clean":"2024-05-08T20:54:50.700173+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:50.700173+0000","last_undegraded":"2024-05-08T20:54:50.700173+0000","last_fullsized":"2024-05-08T20:54:50.700173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.699899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:25.302614+0000","scrub_duration":0.003656903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.777139+0000","last_change":"2024-05-08T20:55:27.777139+0000","last_active":"2024-05-08T20:55:27.777139+0000","last_peered":"2024-05-08T20:55:27.777139+0000","last_clean":"2024-05-08T20:55:27.777139+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:55:27.777139+0000","last_undegraded":"2024-05-08T20:55:27.777139+0000","last_fullsized":"2024-05-08T20:55:27.777139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3942","last_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_deep_scrub":"26'3942","last_deep_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.776997+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:00.897092+0000","scrub_duration":0.15286592099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.147116+0000","last_change":"2024-05-08T20:55:04.147116+0000","last_active":"2024-05-08T20:55:04.147116+0000","last_peered":"2024-05-08T20:55:04.147116+0000","last_clean":"2024-05-08T20:55:04.147116+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:55:04.147116+0000","last_undegraded":"2024-05-08T20:55:04.147116+0000","last_fullsized":"2024-05-08T20:55:04.147116+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6472","last_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_deep_scrub":"26'6472","last_deep_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.146808+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:26.755900+0000","scrub_duration":0.015729532000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'42","reported_seq":82,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.627876+0000","last_change":"2024-05-08T20:55:16.628190+0000","last_active":"2024-05-08T20:55:16.627876+0000","last_peered":"2024-05-08T20:55:16.627876+0000","last_clean":"2024-05-08T20:55:16.627876+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:55:16.627876+0000","last_undegraded":"2024-05-08T20:55:16.627876+0000","last_fullsized":"2024-05-08T20:55:16.627876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.627755+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:04.126022+0000","scrub_duration":0.018944094000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.249501+0000","last_change":"2024-05-08T20:54:45.249501+0000","last_active":"2024-05-08T20:54:45.249501+0000","last_peered":"2024-05-08T20:54:45.249501+0000","last_clean":"2024-05-08T20:54:45.249501+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:45.249501+0000","last_undegraded":"2024-05-08T20:54:45.249501+0000","last_fullsized":"2024-05-08T20:54:45.249501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.249216+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:16.617377+0000","scrub_duration":0.021333827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.557977+0000","last_change":"2024-05-08T20:55:23.557977+0000","last_active":"2024-05-08T20:55:23.557977+0000","last_peered":"2024-05-08T20:55:23.557977+0000","last_clean":"2024-05-08T20:55:23.557977+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:55:23.557977+0000","last_undegraded":"2024-05-08T20:55:23.557977+0000","last_fullsized":"2024-05-08T20:55:23.557977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3366","last_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_deep_scrub":"26'3366","last_deep_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.557812+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:29.860852+0000","scrub_duration":0.092935954000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5293,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.082903+0000","last_change":"2024-05-08T20:55:05.083125+0000","last_active":"2024-05-08T20:55:05.082903+0000","last_peered":"2024-05-08T20:55:05.082903+0000","last_clean":"2024-05-08T20:55:05.082903+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:55:05.082903+0000","last_undegraded":"2024-05-08T20:55:05.082903+0000","last_fullsized":"2024-05-08T20:55:05.082903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5254","last_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_deep_scrub":"26'5254","last_deep_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.082849+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:08.613953+0000","scrub_duration":0.046904636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:31.191286+0000","last_change":"2024-05-08T20:55:31.191526+0000","last_active":"2024-05-08T20:55:31.191286+0000","last_peered":"2024-05-08T20:55:31.191286+0000","last_clean":"2024-05-08T20:55:31.191286+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:55:31.191286+0000","last_undegraded":"2024-05-08T20:55:31.191286+0000","last_fullsized":"2024-05-08T20:55:31.191286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:31.191230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:27.565005+0000","scrub_duration":0.003542014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'19","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.395653+0000","last_change":"2024-05-08T20:54:46.395653+0000","last_active":"2024-05-08T20:54:46.395653+0000","last_peered":"2024-05-08T20:54:46.395653+0000","last_clean":"2024-05-08T20:54:46.395653+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:46.395653+0000","last_undegraded":"2024-05-08T20:54:46.395653+0000","last_fullsized":"2024-05-08T20:54:46.395653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.395382+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:12.986179+0000","scrub_duration":0.011244446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:51.692972+0000","last_change":"2024-05-08T20:55:51.693216+0000","last_active":"2024-05-08T20:55:51.692972+0000","last_peered":"2024-05-08T20:55:51.692972+0000","last_clean":"2024-05-08T20:55:51.692972+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:55:51.692972+0000","last_undegraded":"2024-05-08T20:55:51.692972+0000","last_fullsized":"2024-05-08T20:55:51.692972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3815","last_scrub_stamp":"2024-05-08T20:55:51.692913+0000","last_deep_scrub":"26'3815","last_deep_scrub_stamp":"2024-05-08T20:55:51.692913+0000","last_clean_scrub_stamp":"2024-05-08T20:55:51.692913+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:12.707969+0000","scrub_duration":0.048560441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.001816+0000","last_change":"2024-05-08T20:55:22.002055+0000","last_active":"2024-05-08T20:55:22.001816+0000","last_peered":"2024-05-08T20:55:22.001816+0000","last_clean":"2024-05-08T20:55:22.001816+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:55:22.001816+0000","last_undegraded":"2024-05-08T20:55:22.001816+0000","last_fullsized":"2024-05-08T20:55:22.001816+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5959","last_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_deep_scrub":"26'5959","last_deep_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.001765+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:55.739345+0000","scrub_duration":0.013812233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.579721+0000","last_change":"2024-05-08T20:55:04.579960+0000","last_active":"2024-05-08T20:55:04.579721+0000","last_peered":"2024-05-08T20:55:04.579721+0000","last_clean":"2024-05-08T20:55:04.579721+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:55:04.579721+0000","last_undegraded":"2024-05-08T20:55:04.579721+0000","last_fullsized":"2024-05-08T20:55:04.579721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.579663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.992226+0000","scrub_duration":0.010179356000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.363021+0000","last_change":"2024-05-08T20:55:06.363021+0000","last_active":"2024-05-08T20:55:06.363021+0000","last_peered":"2024-05-08T20:55:06.363021+0000","last_clean":"2024-05-08T20:55:06.363021+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:55:06.363021+0000","last_undegraded":"2024-05-08T20:55:06.363021+0000","last_fullsized":"2024-05-08T20:55:06.363021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.362763+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:52.398831+0000","scrub_duration":0.005099742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.487296+0000","last_change":"2024-05-08T20:55:34.487547+0000","last_active":"2024-05-08T20:55:34.487296+0000","last_peered":"2024-05-08T20:55:34.487296+0000","last_clean":"2024-05-08T20:55:34.487296+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:55:34.487296+0000","last_undegraded":"2024-05-08T20:55:34.487296+0000","last_fullsized":"2024-05-08T20:55:34.487296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6588","last_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_deep_scrub":"26'6588","last_deep_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.487238+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:48.676035+0000","scrub_duration":0.054108730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.929619+0000","last_change":"2024-05-08T20:55:11.929619+0000","last_active":"2024-05-08T20:55:11.929619+0000","last_peered":"2024-05-08T20:55:11.929619+0000","last_clean":"2024-05-08T20:55:11.929619+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:55:11.929619+0000","last_undegraded":"2024-05-08T20:55:11.929619+0000","last_fullsized":"2024-05-08T20:55:11.929619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.929353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:48.141846+0000","scrub_duration":0.0054755710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6038,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.865004+0000","last_change":"2024-05-08T20:54:59.865230+0000","last_active":"2024-05-08T20:54:59.865004+0000","last_peered":"2024-05-08T20:54:59.865004+0000","last_clean":"2024-05-08T20:54:59.865004+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:59.865004+0000","last_undegraded":"2024-05-08T20:54:59.865004+0000","last_fullsized":"2024-05-08T20:54:59.865004+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5999","last_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_deep_scrub":"26'5999","last_deep_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.864944+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:43.980839+0000","scrub_duration":0.021147691999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.164801+0000","last_change":"2024-05-08T20:55:34.165115+0000","last_active":"2024-05-08T20:55:34.164801+0000","last_peered":"2024-05-08T20:55:34.164801+0000","last_clean":"2024-05-08T20:55:34.164801+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:55:34.164801+0000","last_undegraded":"2024-05-08T20:55:34.164801+0000","last_fullsized":"2024-05-08T20:55:34.164801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.164740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:57.308501+0000","scrub_duration":0.0034682070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.041756+0000","last_change":"2024-05-08T20:55:19.041756+0000","last_active":"2024-05-08T20:55:19.041756+0000","last_peered":"2024-05-08T20:55:19.041756+0000","last_clean":"2024-05-08T20:55:19.041756+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:55:19.041756+0000","last_undegraded":"2024-05-08T20:55:19.041756+0000","last_fullsized":"2024-05-08T20:55:19.041756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4346","last_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_deep_scrub":"26'4346","last_deep_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.041549+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.115810+0000","scrub_duration":0.090105366000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'750","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.624205+0000","last_change":"2024-05-08T20:55:13.624444+0000","last_active":"2024-05-08T20:55:13.624205+0000","last_peered":"2024-05-08T20:55:13.624205+0000","last_clean":"2024-05-08T20:55:13.624205+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:55:13.624205+0000","last_undegraded":"2024-05-08T20:55:13.624205+0000","last_fullsized":"2024-05-08T20:55:13.624205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.624149+0000","objects_scrubbed":3,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:48.563067+0000","scrub_duration":0.082494374999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5586,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.369752+0000","last_change":"2024-05-08T20:55:16.369985+0000","last_active":"2024-05-08T20:55:16.369752+0000","last_peered":"2024-05-08T20:55:16.369752+0000","last_clean":"2024-05-08T20:55:16.369752+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:55:16.369752+0000","last_undegraded":"2024-05-08T20:55:16.369752+0000","last_fullsized":"2024-05-08T20:55:16.369752+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5547","last_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_deep_scrub":"26'5547","last_deep_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.369692+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:07.095999+0000","scrub_duration":0.052017234000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.268871+0000","last_change":"2024-05-08T20:55:21.269094+0000","last_active":"2024-05-08T20:55:21.268871+0000","last_peered":"2024-05-08T20:55:21.268871+0000","last_clean":"2024-05-08T20:55:21.268871+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:55:21.268871+0000","last_undegraded":"2024-05-08T20:55:21.268871+0000","last_fullsized":"2024-05-08T20:55:21.268871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.268812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:45.570299+0000","scrub_duration":0.0068504059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.889215+0000","last_change":"2024-05-08T20:55:03.889349+0000","last_active":"2024-05-08T20:55:03.889215+0000","last_peered":"2024-05-08T20:55:03.889215+0000","last_clean":"2024-05-08T20:55:03.889215+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:55:03.889215+0000","last_undegraded":"2024-05-08T20:55:03.889215+0000","last_fullsized":"2024-05-08T20:55:03.889215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4926","last_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_deep_scrub":"26'4926","last_deep_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.889187+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:53.056172+0000","scrub_duration":0.110946349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'163","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.590220+0000","last_change":"2024-05-08T20:54:59.590495+0000","last_active":"2024-05-08T20:54:59.590220+0000","last_peered":"2024-05-08T20:54:59.590220+0000","last_clean":"2024-05-08T20:54:59.590220+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:59.590220+0000","last_undegraded":"2024-05-08T20:54:59.590220+0000","last_fullsized":"2024-05-08T20:54:59.590220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'163","last_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_deep_scrub":"26'163","last_deep_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.590164+0000","objects_scrubbed":1,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.910490+0000","scrub_duration":0.020938656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.049268+0000","last_change":"2024-05-08T20:55:06.049513+0000","last_active":"2024-05-08T20:55:06.049268+0000","last_peered":"2024-05-08T20:55:06.049268+0000","last_clean":"2024-05-08T20:55:06.049268+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:55:06.049268+0000","last_undegraded":"2024-05-08T20:55:06.049268+0000","last_fullsized":"2024-05-08T20:55:06.049268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4451","last_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_deep_scrub":"26'4451","last_deep_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.049212+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:24.430723+0000","scrub_duration":0.052059591000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.520135+0000","last_change":"2024-05-08T20:55:02.520371+0000","last_active":"2024-05-08T20:55:02.520135+0000","last_peered":"2024-05-08T20:55:02.520135+0000","last_clean":"2024-05-08T20:55:02.520135+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:55:02.520135+0000","last_undegraded":"2024-05-08T20:55:02.520135+0000","last_fullsized":"2024-05-08T20:55:02.520135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.520078+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:26.455981+0000","scrub_duration":0.0061828689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:42.936803+0000","last_change":"2024-05-08T20:55:42.937094+0000","last_active":"2024-05-08T20:55:42.936803+0000","last_peered":"2024-05-08T20:55:42.936803+0000","last_clean":"2024-05-08T20:55:42.936803+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:55:42.936803+0000","last_undegraded":"2024-05-08T20:55:42.936803+0000","last_fullsized":"2024-05-08T20:55:42.936803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3676","last_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_deep_scrub":"26'3676","last_deep_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_clean_scrub_stamp":"2024-05-08T20:55:42.936748+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:31.860506+0000","scrub_duration":0.049010799000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'655","reported_seq":695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.317920+0000","last_change":"2024-05-08T20:55:23.318135+0000","last_active":"2024-05-08T20:55:23.317920+0000","last_peered":"2024-05-08T20:55:23.317920+0000","last_clean":"2024-05-08T20:55:23.317920+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:55:23.317920+0000","last_undegraded":"2024-05-08T20:55:23.317920+0000","last_fullsized":"2024-05-08T20:55:23.317920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'655","last_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_deep_scrub":"26'655","last_deep_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.317866+0000","objects_scrubbed":1,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:46.680579+0000","scrub_duration":0.028425507999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.863360+0000","last_change":"2024-05-08T20:55:13.863574+0000","last_active":"2024-05-08T20:55:13.863360+0000","last_peered":"2024-05-08T20:55:13.863360+0000","last_clean":"2024-05-08T20:55:13.863360+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:55:13.863360+0000","last_undegraded":"2024-05-08T20:55:13.863360+0000","last_fullsized":"2024-05-08T20:55:13.863360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4749","last_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_deep_scrub":"26'4749","last_deep_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.863305+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:59.772479+0000","scrub_duration":0.028153702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.342167+0000","last_change":"2024-05-08T20:54:56.342167+0000","last_active":"2024-05-08T20:54:56.342167+0000","last_peered":"2024-05-08T20:54:56.342167+0000","last_clean":"2024-05-08T20:54:56.342167+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:56.342167+0000","last_undegraded":"2024-05-08T20:54:56.342167+0000","last_fullsized":"2024-05-08T20:54:56.342167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.341600+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:37.112673+0000","scrub_duration":0.0065677610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3752,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.513008+0000","last_change":"2024-05-08T20:55:33.513008+0000","last_active":"2024-05-08T20:55:33.513008+0000","last_peered":"2024-05-08T20:55:33.513008+0000","last_clean":"2024-05-08T20:55:33.513008+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:55:33.513008+0000","last_undegraded":"2024-05-08T20:55:33.513008+0000","last_fullsized":"2024-05-08T20:55:33.513008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3715","last_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_deep_scrub":"26'3715","last_deep_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.512769+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:45.954826+0000","scrub_duration":0.065087201999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.540402+0000","last_change":"2024-05-08T20:54:49.540646+0000","last_active":"2024-05-08T20:54:49.540402+0000","last_peered":"2024-05-08T20:54:49.540402+0000","last_clean":"2024-05-08T20:54:49.540402+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:49.540402+0000","last_undegraded":"2024-05-08T20:54:49.540402+0000","last_fullsized":"2024-05-08T20:54:49.540402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5325","last_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_deep_scrub":"26'5325","last_deep_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.540347+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:25.992758+0000","scrub_duration":0.061375869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:45.682831+0000","last_change":"2024-05-08T20:55:45.682973+0000","last_active":"2024-05-08T20:55:45.682831+0000","last_peered":"2024-05-08T20:55:45.682831+0000","last_clean":"2024-05-08T20:55:45.682831+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:55:45.682831+0000","last_undegraded":"2024-05-08T20:55:45.682831+0000","last_fullsized":"2024-05-08T20:55:45.682831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4854","last_scrub_stamp":"2024-05-08T20:55:45.682800+0000","last_deep_scrub":"26'4854","last_deep_scrub_stamp":"2024-05-08T20:55:45.682800+0000","last_clean_scrub_stamp":"2024-05-08T20:55:45.682800+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:20.964758+0000","scrub_duration":0.080428569000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.583918+0000","last_change":"2024-05-08T20:54:57.584171+0000","last_active":"2024-05-08T20:54:57.583918+0000","last_peered":"2024-05-08T20:54:57.583918+0000","last_clean":"2024-05-08T20:54:57.583918+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:57.583918+0000","last_undegraded":"2024-05-08T20:54:57.583918+0000","last_fullsized":"2024-05-08T20:54:57.583918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5595","last_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_deep_scrub":"26'5595","last_deep_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.583862+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:54.463390+0000","scrub_duration":0.019454468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079848+0000","last_change":"2024-05-08T20:27:27.997656+0000","last_active":"2024-05-08T20:54:44.079848+0000","last_peered":"2024-05-08T20:54:44.079848+0000","last_clean":"2024-05-08T20:54:44.079848+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:54:44.079848+0000","last_undegraded":"2024-05-08T20:54:44.079848+0000","last_fullsized":"2024-05-08T20:54:44.079848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.221892+0000","last_change":"2024-05-08T20:55:37.222118+0000","last_active":"2024-05-08T20:55:37.221892+0000","last_peered":"2024-05-08T20:55:37.221892+0000","last_clean":"2024-05-08T20:55:37.221892+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:55:37.221892+0000","last_undegraded":"2024-05-08T20:55:37.221892+0000","last_fullsized":"2024-05-08T20:55:37.221892+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6159","last_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_deep_scrub":"26'6159","last_deep_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.221839+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:00.718155+0000","scrub_duration":0.013317416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4825,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.695476+0000","last_change":"2024-05-08T20:55:43.695606+0000","last_active":"2024-05-08T20:55:43.695476+0000","last_peered":"2024-05-08T20:55:43.695476+0000","last_clean":"2024-05-08T20:55:43.695476+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:55:43.695476+0000","last_undegraded":"2024-05-08T20:55:43.695476+0000","last_fullsized":"2024-05-08T20:55:43.695476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4788","last_scrub_stamp":"2024-05-08T20:55:43.695448+0000","last_deep_scrub":"26'4788","last_deep_scrub_stamp":"2024-05-08T20:55:43.695448+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.695448+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:16.813820+0000","scrub_duration":0.095509810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.063296+0000","last_change":"2024-05-08T20:54:46.063510+0000","last_active":"2024-05-08T20:54:46.063296+0000","last_peered":"2024-05-08T20:54:46.063296+0000","last_clean":"2024-05-08T20:54:46.063296+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:46.063296+0000","last_undegraded":"2024-05-08T20:54:46.063296+0000","last_fullsized":"2024-05-08T20:54:46.063296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5693","last_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_deep_scrub":"26'5693","last_deep_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.063251+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:47.062496+0000","scrub_duration":0.071792174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:40.713023+0000","last_change":"2024-05-08T20:27:27.995834+0000","last_active":"2024-05-08T20:54:40.713023+0000","last_peered":"2024-05-08T20:54:40.713023+0000","last_clean":"2024-05-08T20:54:40.713023+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:54:40.713023+0000","last_undegraded":"2024-05-08T20:54:40.713023+0000","last_fullsized":"2024-05-08T20:54:40.713023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:26.388312+0000","last_change":"2024-05-08T20:55:26.388312+0000","last_active":"2024-05-08T20:55:26.388312+0000","last_peered":"2024-05-08T20:55:26.388312+0000","last_clean":"2024-05-08T20:55:26.388312+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:55:26.388312+0000","last_undegraded":"2024-05-08T20:55:26.388312+0000","last_fullsized":"2024-05-08T20:55:26.388312+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5399","last_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_deep_scrub":"26'5399","last_deep_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_clean_scrub_stamp":"2024-05-08T20:55:26.387951+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:31.944366+0000","scrub_duration":0.012044920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:48.890030+0000","last_change":"2024-05-08T20:55:48.890307+0000","last_active":"2024-05-08T20:55:48.890030+0000","last_peered":"2024-05-08T20:55:48.890030+0000","last_clean":"2024-05-08T20:55:48.890030+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:55:48.890030+0000","last_undegraded":"2024-05-08T20:55:48.890030+0000","last_fullsized":"2024-05-08T20:55:48.890030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4115","last_scrub_stamp":"2024-05-08T20:55:48.889975+0000","last_deep_scrub":"26'4115","last_deep_scrub_stamp":"2024-05-08T20:55:48.889975+0000","last_clean_scrub_stamp":"2024-05-08T20:55:48.889975+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:27.885953+0000","scrub_duration":0.041821670999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.715543+0000","last_change":"2024-05-08T20:55:06.715543+0000","last_active":"2024-05-08T20:55:06.715543+0000","last_peered":"2024-05-08T20:55:06.715543+0000","last_clean":"2024-05-08T20:55:06.715543+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:55:06.715543+0000","last_undegraded":"2024-05-08T20:55:06.715543+0000","last_fullsized":"2024-05-08T20:55:06.715543+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5958","last_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_deep_scrub":"26'5958","last_deep_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.715216+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.934398+0000","scrub_duration":0.015652640999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4700,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:56.680713+0000","last_change":"2024-05-08T20:55:56.680962+0000","last_active":"2024-05-08T20:55:56.680713+0000","last_peered":"2024-05-08T20:55:56.680713+0000","last_clean":"2024-05-08T20:55:56.680713+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:55:56.680713+0000","last_undegraded":"2024-05-08T20:55:56.680713+0000","last_fullsized":"2024-05-08T20:55:56.680713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4663","last_scrub_stamp":"2024-05-08T20:55:56.680651+0000","last_deep_scrub":"26'4663","last_deep_scrub_stamp":"2024-05-08T20:55:56.680651+0000","last_clean_scrub_stamp":"2024-05-08T20:55:56.680651+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:23.603835+0000","scrub_duration":0.044246287000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.492492+0000","last_change":"2024-05-08T20:54:47.492492+0000","last_active":"2024-05-08T20:54:47.492492+0000","last_peered":"2024-05-08T20:54:47.492492+0000","last_clean":"2024-05-08T20:54:47.492492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:47.492492+0000","last_undegraded":"2024-05-08T20:54:47.492492+0000","last_fullsized":"2024-05-08T20:54:47.492492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5066","last_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_deep_scrub":"26'5066","last_deep_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.492152+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.271368+0000","scrub_duration":0.020000068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.445587+0000","last_change":"2024-05-08T20:55:40.445754+0000","last_active":"2024-05-08T20:55:40.445587+0000","last_peered":"2024-05-08T20:55:40.445587+0000","last_clean":"2024-05-08T20:55:40.445587+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:55:40.445587+0000","last_undegraded":"2024-05-08T20:55:40.445587+0000","last_fullsized":"2024-05-08T20:55:40.445587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4639","last_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_deep_scrub":"26'4639","last_deep_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.445550+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:21.821161+0000","scrub_duration":0.079421377000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.445597+0000","last_change":"2024-05-08T20:55:08.445597+0000","last_active":"2024-05-08T20:55:08.445597+0000","last_peered":"2024-05-08T20:55:08.445597+0000","last_clean":"2024-05-08T20:55:08.445597+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:55:08.445597+0000","last_undegraded":"2024-05-08T20:55:08.445597+0000","last_fullsized":"2024-05-08T20:55:08.445597+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6126","last_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_deep_scrub":"26'6126","last_deep_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.445271+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:56.722437+0000","scrub_duration":0.012766164999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4945,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:53.578187+0000","last_change":"2024-05-08T20:55:53.578433+0000","last_active":"2024-05-08T20:55:53.578187+0000","last_peered":"2024-05-08T20:55:53.578187+0000","last_clean":"2024-05-08T20:55:53.578187+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:55:53.578187+0000","last_undegraded":"2024-05-08T20:55:53.578187+0000","last_fullsized":"2024-05-08T20:55:53.578187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4909","last_scrub_stamp":"2024-05-08T20:55:53.578132+0000","last_deep_scrub":"26'4909","last_deep_scrub_stamp":"2024-05-08T20:55:53.578132+0000","last_clean_scrub_stamp":"2024-05-08T20:55:53.578132+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:58.318894+0000","scrub_duration":0.088954009000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.202269+0000","last_change":"2024-05-08T20:55:39.202269+0000","last_active":"2024-05-08T20:55:39.202269+0000","last_peered":"2024-05-08T20:55:39.202269+0000","last_clean":"2024-05-08T20:55:39.202269+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:55:39.202269+0000","last_undegraded":"2024-05-08T20:55:39.202269+0000","last_fullsized":"2024-05-08T20:55:39.202269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5362","last_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_deep_scrub":"26'5362","last_deep_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.201982+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:26.275471+0000","scrub_duration":0.012871195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.727229+0000","last_change":"2024-05-08T20:55:18.727229+0000","last_active":"2024-05-08T20:55:18.727229+0000","last_peered":"2024-05-08T20:55:18.727229+0000","last_clean":"2024-05-08T20:55:18.727229+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:55:18.727229+0000","last_undegraded":"2024-05-08T20:55:18.727229+0000","last_fullsized":"2024-05-08T20:55:18.727229+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.726746+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:12.191809+0000","scrub_duration":0.059782137999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.442535+0000","last_change":"2024-05-08T20:55:02.442768+0000","last_active":"2024-05-08T20:55:02.442535+0000","last_peered":"2024-05-08T20:55:02.442535+0000","last_clean":"2024-05-08T20:55:02.442535+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:55:02.442535+0000","last_undegraded":"2024-05-08T20:55:02.442535+0000","last_fullsized":"2024-05-08T20:55:02.442535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5184","last_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_deep_scrub":"26'5184","last_deep_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.442482+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:06.919194+0000","scrub_duration":0.015103089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.601981+0000","last_change":"2024-05-08T20:55:10.602221+0000","last_active":"2024-05-08T20:55:10.601981+0000","last_peered":"2024-05-08T20:55:10.601981+0000","last_clean":"2024-05-08T20:55:10.601981+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:55:10.601981+0000","last_undegraded":"2024-05-08T20:55:10.601981+0000","last_fullsized":"2024-05-08T20:55:10.601981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4176","last_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_deep_scrub":"26'4176","last_deep_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.601877+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:47.707725+0000","scrub_duration":0.083099372000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.139294+0000","last_change":"2024-05-08T20:55:43.139539+0000","last_active":"2024-05-08T20:55:43.139294+0000","last_peered":"2024-05-08T20:55:43.139294+0000","last_clean":"2024-05-08T20:55:43.139294+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:55:43.139294+0000","last_undegraded":"2024-05-08T20:55:43.139294+0000","last_fullsized":"2024-05-08T20:55:43.139294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5663","last_scrub_stamp":"2024-05-08T20:55:43.139241+0000","last_deep_scrub":"26'5663","last_deep_scrub_stamp":"2024-05-08T20:55:43.139241+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.139241+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:02.484959+0000","scrub_duration":0.010645274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.558291+0000","last_change":"2024-05-08T20:55:34.558561+0000","last_active":"2024-05-08T20:55:34.558291+0000","last_peered":"2024-05-08T20:55:34.558291+0000","last_clean":"2024-05-08T20:55:34.558291+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:55:34.558291+0000","last_undegraded":"2024-05-08T20:55:34.558291+0000","last_fullsized":"2024-05-08T20:55:34.558291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4568","last_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_deep_scrub":"26'4568","last_deep_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.558230+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:54.666430+0000","scrub_duration":0.090672077000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.439461+0000","last_change":"2024-05-08T20:55:25.439693+0000","last_active":"2024-05-08T20:55:25.439461+0000","last_peered":"2024-05-08T20:55:25.439461+0000","last_clean":"2024-05-08T20:55:25.439461+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:55:25.439461+0000","last_undegraded":"2024-05-08T20:55:25.439461+0000","last_fullsized":"2024-05-08T20:55:25.439461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6400","last_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_deep_scrub":"26'6400","last_deep_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.439401+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:51.706253+0000","scrub_duration":0.013054441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.886387+0000","last_change":"2024-05-08T20:55:43.886627+0000","last_active":"2024-05-08T20:55:43.886387+0000","last_peered":"2024-05-08T20:55:43.886387+0000","last_clean":"2024-05-08T20:55:43.886387+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:55:43.886387+0000","last_undegraded":"2024-05-08T20:55:43.886387+0000","last_fullsized":"2024-05-08T20:55:43.886387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4843","last_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_deep_scrub":"26'4843","last_deep_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.886334+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:11.158351+0000","scrub_duration":0.035733203999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.577214+0000","last_change":"2024-05-08T20:55:06.577459+0000","last_active":"2024-05-08T20:55:06.577214+0000","last_peered":"2024-05-08T20:55:06.577214+0000","last_clean":"2024-05-08T20:55:06.577214+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:55:06.577214+0000","last_undegraded":"2024-05-08T20:55:06.577214+0000","last_fullsized":"2024-05-08T20:55:06.577214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4987","last_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_deep_scrub":"26'4987","last_deep_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.577160+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:42.945808+0000","scrub_duration":0.016149487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:49.909056+0000","last_change":"2024-05-08T20:55:49.909344+0000","last_active":"2024-05-08T20:55:49.909056+0000","last_peered":"2024-05-08T20:55:49.909056+0000","last_clean":"2024-05-08T20:55:49.909056+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:55:49.909056+0000","last_undegraded":"2024-05-08T20:55:49.909056+0000","last_fullsized":"2024-05-08T20:55:49.909056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5231","last_scrub_stamp":"2024-05-08T20:55:49.908998+0000","last_deep_scrub":"26'5231","last_deep_scrub_stamp":"2024-05-08T20:55:49.908998+0000","last_clean_scrub_stamp":"2024-05-08T20:55:49.908998+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:47.254466+0000","scrub_duration":0.057442419000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6047,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.588062+0000","last_change":"2024-05-08T20:55:10.588330+0000","last_active":"2024-05-08T20:55:10.588062+0000","last_peered":"2024-05-08T20:55:10.588062+0000","last_clean":"2024-05-08T20:55:10.588062+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:55:10.588062+0000","last_undegraded":"2024-05-08T20:55:10.588062+0000","last_fullsized":"2024-05-08T20:55:10.588062+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.588008+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.452979+0000","scrub_duration":0.016104663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.079874+0000","last_change":"2024-05-08T20:27:27.989193+0000","last_active":"2024-05-08T20:54:44.079874+0000","last_peered":"2024-05-08T20:54:44.079874+0000","last_clean":"2024-05-08T20:54:44.079874+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:54:44.079874+0000","last_undegraded":"2024-05-08T20:54:44.079874+0000","last_fullsized":"2024-05-08T20:54:44.079874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5442,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.580745+0000","last_change":"2024-05-08T20:54:59.580745+0000","last_active":"2024-05-08T20:54:59.580745+0000","last_peered":"2024-05-08T20:54:59.580745+0000","last_clean":"2024-05-08T20:54:59.580745+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:59.580745+0000","last_undegraded":"2024-05-08T20:54:59.580745+0000","last_fullsized":"2024-05-08T20:54:59.580745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5402","last_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_deep_scrub":"26'5402","last_deep_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.580403+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:43.325297+0000","scrub_duration":0.019827373999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3952,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.024577+0000","last_change":"2024-05-08T20:55:16.024733+0000","last_active":"2024-05-08T20:55:16.024577+0000","last_peered":"2024-05-08T20:55:16.024577+0000","last_clean":"2024-05-08T20:55:16.024577+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:55:16.024577+0000","last_undegraded":"2024-05-08T20:55:16.024577+0000","last_fullsized":"2024-05-08T20:55:16.024577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3916","last_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_deep_scrub":"26'3916","last_deep_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.024547+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:35.429176+0000","scrub_duration":0.084433175999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.091777+0000","last_change":"2024-05-08T20:55:17.091777+0000","last_active":"2024-05-08T20:55:17.091777+0000","last_peered":"2024-05-08T20:55:17.091777+0000","last_clean":"2024-05-08T20:55:17.091777+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:55:17.091777+0000","last_undegraded":"2024-05-08T20:55:17.091777+0000","last_fullsized":"2024-05-08T20:55:17.091777+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7179","last_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_deep_scrub":"26'7179","last_deep_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.091504+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:30.475338+0000","scrub_duration":0.010907612000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4684,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:41.742542+0000","last_change":"2024-05-08T20:55:41.742659+0000","last_active":"2024-05-08T20:55:41.742542+0000","last_peered":"2024-05-08T20:55:41.742542+0000","last_clean":"2024-05-08T20:55:41.742542+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:55:41.742542+0000","last_undegraded":"2024-05-08T20:55:41.742542+0000","last_fullsized":"2024-05-08T20:55:41.742542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4649","last_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_deep_scrub":"26'4649","last_deep_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_clean_scrub_stamp":"2024-05-08T20:55:41.742520+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:28.769014+0000","scrub_duration":0.11890376499999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.191768+0000","last_change":"2024-05-08T20:54:47.191768+0000","last_active":"2024-05-08T20:54:47.191768+0000","last_peered":"2024-05-08T20:54:47.191768+0000","last_clean":"2024-05-08T20:54:47.191768+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:47.191768+0000","last_undegraded":"2024-05-08T20:54:47.191768+0000","last_fullsized":"2024-05-08T20:54:47.191768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5121","last_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_deep_scrub":"26'5121","last_deep_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.191457+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:32.886217+0000","scrub_duration":0.059662343999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.974385+0000","last_change":"2024-05-08T20:55:37.974674+0000","last_active":"2024-05-08T20:55:37.974385+0000","last_peered":"2024-05-08T20:55:37.974385+0000","last_clean":"2024-05-08T20:55:37.974385+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:55:37.974385+0000","last_undegraded":"2024-05-08T20:55:37.974385+0000","last_fullsized":"2024-05-08T20:55:37.974385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5300","last_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_deep_scrub":"26'5300","last_deep_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.974326+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:27.991254+0000","scrub_duration":0.052724812000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.836939+0000","last_change":"2024-05-08T20:54:54.836939+0000","last_active":"2024-05-08T20:54:54.836939+0000","last_peered":"2024-05-08T20:54:54.836939+0000","last_clean":"2024-05-08T20:54:54.836939+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:54.836939+0000","last_undegraded":"2024-05-08T20:54:54.836939+0000","last_fullsized":"2024-05-08T20:54:54.836939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4602","last_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_deep_scrub":"26'4602","last_deep_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.836650+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:37.068481+0000","scrub_duration":0.026253420999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3166,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.343098+0000","last_change":"2024-05-08T20:27:27.999767+0000","last_active":"2024-05-08T20:54:32.343098+0000","last_peered":"2024-05-08T20:54:32.343098+0000","last_clean":"2024-05-08T20:54:32.343098+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:54:32.343098+0000","last_undegraded":"2024-05-08T20:54:32.343098+0000","last_fullsized":"2024-05-08T20:54:32.343098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941519+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941519+0000","last_peered":"2024-05-08T20:54:42.941519+0000","last_clean":"2024-05-08T20:54:42.941519+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941519+0000","last_undegraded":"2024-05-08T20:54:42.941519+0000","last_fullsized":"2024-05-08T20:54:42.941519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:32.405851+0000","last_change":"2024-05-08T20:27:28.002744+0000","last_active":"2024-05-08T20:54:32.405851+0000","last_peered":"2024-05-08T20:54:32.405851+0000","last_clean":"2024-05-08T20:54:32.405851+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:54:32.405851+0000","last_undegraded":"2024-05-08T20:54:32.405851+0000","last_fullsized":"2024-05-08T20:54:32.405851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:27:27.565015+0000","last_clean_scrub_stamp":"2024-05-08T20:27:27.565015+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.450359+0000","last_change":"2024-05-08T20:55:10.450576+0000","last_active":"2024-05-08T20:55:10.450359+0000","last_peered":"2024-05-08T20:55:10.450359+0000","last_clean":"2024-05-08T20:55:10.450359+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:55:10.450359+0000","last_undegraded":"2024-05-08T20:55:10.450359+0000","last_fullsized":"2024-05-08T20:55:10.450359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4626","last_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_deep_scrub":"26'4626","last_deep_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.450304+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:20.915560+0000","scrub_duration":0.011125820999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:52.515090+0000","last_change":"2024-05-08T20:55:52.515388+0000","last_active":"2024-05-08T20:55:52.515090+0000","last_peered":"2024-05-08T20:55:52.515090+0000","last_clean":"2024-05-08T20:55:52.515090+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:55:52.515090+0000","last_undegraded":"2024-05-08T20:55:52.515090+0000","last_fullsized":"2024-05-08T20:55:52.515090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4345","last_scrub_stamp":"2024-05-08T20:55:52.515029+0000","last_deep_scrub":"26'4345","last_deep_scrub_stamp":"2024-05-08T20:55:52.515029+0000","last_clean_scrub_stamp":"2024-05-08T20:55:52.515029+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:48.805687+0000","scrub_duration":0.051040321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.891543+0000","last_change":"2024-05-08T20:55:16.891829+0000","last_active":"2024-05-08T20:55:16.891543+0000","last_peered":"2024-05-08T20:55:16.891543+0000","last_clean":"2024-05-08T20:55:16.891543+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:55:16.891543+0000","last_undegraded":"2024-05-08T20:55:16.891543+0000","last_fullsized":"2024-05-08T20:55:16.891543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3688","last_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_deep_scrub":"26'3688","last_deep_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.891490+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.749773+0000","scrub_duration":0.012960828000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.540769+0000","last_change":"2024-05-08T20:55:13.541058+0000","last_active":"2024-05-08T20:55:13.540769+0000","last_peered":"2024-05-08T20:55:13.540769+0000","last_clean":"2024-05-08T20:55:13.540769+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:55:13.540769+0000","last_undegraded":"2024-05-08T20:55:13.540769+0000","last_fullsized":"2024-05-08T20:55:13.540769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3316","last_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_deep_scrub":"26'3316","last_deep_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.540711+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:12.992902+0000","scrub_duration":0.076822395000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.474491+0000","last_change":"2024-05-08T20:54:51.474745+0000","last_active":"2024-05-08T20:54:51.474491+0000","last_peered":"2024-05-08T20:54:51.474491+0000","last_clean":"2024-05-08T20:54:51.474491+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:51.474491+0000","last_undegraded":"2024-05-08T20:54:51.474491+0000","last_fullsized":"2024-05-08T20:54:51.474491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5609","last_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_deep_scrub":"26'5609","last_deep_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.474437+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:37.535496+0000","scrub_duration":0.017226228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4563,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.729274+0000","last_change":"2024-05-08T20:55:13.729274+0000","last_active":"2024-05-08T20:55:13.729274+0000","last_peered":"2024-05-08T20:55:13.729274+0000","last_clean":"2024-05-08T20:55:13.729274+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:55:13.729274+0000","last_undegraded":"2024-05-08T20:55:13.729274+0000","last_fullsized":"2024-05-08T20:55:13.729274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4527","last_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_deep_scrub":"26'4527","last_deep_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.728968+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:30.126015+0000","scrub_duration":0.045784956000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.487212+0000","last_change":"2024-05-08T20:54:45.487445+0000","last_active":"2024-05-08T20:54:45.487212+0000","last_peered":"2024-05-08T20:54:45.487212+0000","last_clean":"2024-05-08T20:54:45.487212+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:45.487212+0000","last_undegraded":"2024-05-08T20:54:45.487212+0000","last_fullsized":"2024-05-08T20:54:45.487212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5845","last_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_deep_scrub":"26'5845","last_deep_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.487159+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:35.646681+0000","scrub_duration":0.033861688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.154336+0000","last_change":"2024-05-08T20:55:19.154336+0000","last_active":"2024-05-08T20:55:19.154336+0000","last_peered":"2024-05-08T20:55:19.154336+0000","last_clean":"2024-05-08T20:55:19.154336+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:55:19.154336+0000","last_undegraded":"2024-05-08T20:55:19.154336+0000","last_fullsized":"2024-05-08T20:55:19.154336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3505","last_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_deep_scrub":"26'3505","last_deep_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.154016+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:16.617871+0000","scrub_duration":0.075724768999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.715004+0000","last_change":"2024-05-08T20:55:15.715259+0000","last_active":"2024-05-08T20:55:15.715004+0000","last_peered":"2024-05-08T20:55:15.715004+0000","last_clean":"2024-05-08T20:55:15.715004+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:55:15.715004+0000","last_undegraded":"2024-05-08T20:55:15.715004+0000","last_fullsized":"2024-05-08T20:55:15.715004+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6642","last_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_deep_scrub":"26'6642","last_deep_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.714948+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:11.017870+0000","scrub_duration":0.018435876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:59.553584+0000","last_change":"2024-05-08T20:55:59.553907+0000","last_active":"2024-05-08T20:55:59.553584+0000","last_peered":"2024-05-08T20:55:59.553584+0000","last_clean":"2024-05-08T20:55:59.553584+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:55:59.553584+0000","last_undegraded":"2024-05-08T20:55:59.553584+0000","last_fullsized":"2024-05-08T20:55:59.553584+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5277","last_scrub_stamp":"2024-05-08T20:55:59.553519+0000","last_deep_scrub":"26'5277","last_deep_scrub_stamp":"2024-05-08T20:55:59.553519+0000","last_clean_scrub_stamp":"2024-05-08T20:55:59.553519+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.653883+0000","scrub_duration":0.067196559000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:55.587903+0000","last_change":"2024-05-08T20:55:55.588153+0000","last_active":"2024-05-08T20:55:55.587903+0000","last_peered":"2024-05-08T20:55:55.587903+0000","last_clean":"2024-05-08T20:55:55.587903+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:55:55.587903+0000","last_undegraded":"2024-05-08T20:55:55.587903+0000","last_fullsized":"2024-05-08T20:55:55.587903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5499","last_scrub_stamp":"2024-05-08T20:55:55.587847+0000","last_deep_scrub":"26'5499","last_deep_scrub_stamp":"2024-05-08T20:55:55.587847+0000","last_clean_scrub_stamp":"2024-05-08T20:55:55.587847+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:57.508355+0000","scrub_duration":0.046845655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4056,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.437920+0000","last_change":"2024-05-08T20:55:39.438189+0000","last_active":"2024-05-08T20:55:39.437920+0000","last_peered":"2024-05-08T20:55:39.437920+0000","last_clean":"2024-05-08T20:55:39.437920+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:55:39.437920+0000","last_undegraded":"2024-05-08T20:55:39.437920+0000","last_fullsized":"2024-05-08T20:55:39.437920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4019","last_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_deep_scrub":"26'4019","last_deep_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.437865+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:21.643997+0000","scrub_duration":0.022369057000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.628544+0000","last_change":"2024-05-08T20:55:07.628786+0000","last_active":"2024-05-08T20:55:07.628544+0000","last_peered":"2024-05-08T20:55:07.628544+0000","last_clean":"2024-05-08T20:55:07.628544+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:55:07.628544+0000","last_undegraded":"2024-05-08T20:55:07.628544+0000","last_fullsized":"2024-05-08T20:55:07.628544+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5870","last_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_deep_scrub":"26'5870","last_deep_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.628488+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:59.204406+0000","scrub_duration":0.036094273000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3831,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.708561+0000","last_change":"2024-05-08T20:55:47.708667+0000","last_active":"2024-05-08T20:55:47.708561+0000","last_peered":"2024-05-08T20:55:47.708561+0000","last_clean":"2024-05-08T20:55:47.708561+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:55:47.708561+0000","last_undegraded":"2024-05-08T20:55:47.708561+0000","last_fullsized":"2024-05-08T20:55:47.708561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3793","last_scrub_stamp":"2024-05-08T20:55:47.708538+0000","last_deep_scrub":"26'3793","last_deep_scrub_stamp":"2024-05-08T20:55:47.708538+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.708538+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:52.051746+0000","scrub_duration":0.114960331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.154571+0000","last_change":"2024-05-08T20:55:02.154865+0000","last_active":"2024-05-08T20:55:02.154571+0000","last_peered":"2024-05-08T20:55:02.154571+0000","last_clean":"2024-05-08T20:55:02.154571+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:55:02.154571+0000","last_undegraded":"2024-05-08T20:55:02.154571+0000","last_fullsized":"2024-05-08T20:55:02.154571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4536","last_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_deep_scrub":"26'4536","last_deep_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.154517+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:54.549611+0000","scrub_duration":0.047608635000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:44.226392+0000","last_change":"2024-05-08T20:55:44.226628+0000","last_active":"2024-05-08T20:55:44.226392+0000","last_peered":"2024-05-08T20:55:44.226392+0000","last_clean":"2024-05-08T20:55:44.226392+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:55:44.226392+0000","last_undegraded":"2024-05-08T20:55:44.226392+0000","last_fullsized":"2024-05-08T20:55:44.226392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4520","last_scrub_stamp":"2024-05-08T20:55:44.226335+0000","last_deep_scrub":"26'4520","last_deep_scrub_stamp":"2024-05-08T20:55:44.226335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:44.226335+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:28.141864+0000","scrub_duration":0.064812995999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.592398+0000","last_change":"2024-05-08T20:55:05.592654+0000","last_active":"2024-05-08T20:55:05.592398+0000","last_peered":"2024-05-08T20:55:05.592398+0000","last_clean":"2024-05-08T20:55:05.592398+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:55:05.592398+0000","last_undegraded":"2024-05-08T20:55:05.592398+0000","last_fullsized":"2024-05-08T20:55:05.592398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4811","last_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_deep_scrub":"26'4811","last_deep_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.592322+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:00.479073+0000","scrub_duration":0.018874953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:56.469720+0000","last_change":"2024-05-08T20:55:56.470002+0000","last_active":"2024-05-08T20:55:56.469720+0000","last_peered":"2024-05-08T20:55:56.469720+0000","last_clean":"2024-05-08T20:55:56.469720+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:55:56.469720+0000","last_undegraded":"2024-05-08T20:55:56.469720+0000","last_fullsized":"2024-05-08T20:55:56.469720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3740","last_scrub_stamp":"2024-05-08T20:55:56.469646+0000","last_deep_scrub":"26'3740","last_deep_scrub_stamp":"2024-05-08T20:55:56.469646+0000","last_clean_scrub_stamp":"2024-05-08T20:55:56.469646+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:28.879490+0000","scrub_duration":0.027286621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.172178+0000","last_change":"2024-05-08T20:54:54.172178+0000","last_active":"2024-05-08T20:54:54.172178+0000","last_peered":"2024-05-08T20:54:54.172178+0000","last_clean":"2024-05-08T20:54:54.172178+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:54.172178+0000","last_undegraded":"2024-05-08T20:54:54.172178+0000","last_fullsized":"2024-05-08T20:54:54.172178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4709","last_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_deep_scrub":"26'4709","last_deep_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.171276+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.280762+0000","scrub_duration":0.026438705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.500842+0000","last_change":"2024-05-08T20:55:15.501128+0000","last_active":"2024-05-08T20:55:15.500842+0000","last_peered":"2024-05-08T20:55:15.500842+0000","last_clean":"2024-05-08T20:55:15.500842+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:55:15.500842+0000","last_undegraded":"2024-05-08T20:55:15.500842+0000","last_fullsized":"2024-05-08T20:55:15.500842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3900","last_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_deep_scrub":"26'3900","last_deep_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.500780+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:36.458071+0000","scrub_duration":0.028467224999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5679,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.101942+0000","last_change":"2024-05-08T20:55:03.102295+0000","last_active":"2024-05-08T20:55:03.101942+0000","last_peered":"2024-05-08T20:55:03.101942+0000","last_clean":"2024-05-08T20:55:03.101942+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:55:03.101942+0000","last_undegraded":"2024-05-08T20:55:03.101942+0000","last_fullsized":"2024-05-08T20:55:03.101942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5638","last_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_deep_scrub":"26'5638","last_deep_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.101828+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:45.438163+0000","scrub_duration":0.077280746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:02.748759+0000","last_change":"2024-05-08T20:56:02.748998+0000","last_active":"2024-05-08T20:56:02.748759+0000","last_peered":"2024-05-08T20:56:02.748759+0000","last_clean":"2024-05-08T20:56:02.748759+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:56:02.748759+0000","last_undegraded":"2024-05-08T20:56:02.748759+0000","last_fullsized":"2024-05-08T20:56:02.748759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4354","last_scrub_stamp":"2024-05-08T20:56:02.748702+0000","last_deep_scrub":"26'4354","last_deep_scrub_stamp":"2024-05-08T20:56:02.748702+0000","last_clean_scrub_stamp":"2024-05-08T20:56:02.748702+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:44.308337+0000","scrub_duration":0.067721527000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.773320+0000","last_change":"2024-05-08T20:54:49.773606+0000","last_active":"2024-05-08T20:54:49.773320+0000","last_peered":"2024-05-08T20:54:49.773320+0000","last_clean":"2024-05-08T20:54:49.773320+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:49.773320+0000","last_undegraded":"2024-05-08T20:54:49.773320+0000","last_fullsized":"2024-05-08T20:54:49.773320+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6644","last_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_deep_scrub":"26'6644","last_deep_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.773265+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:23.617467+0000","scrub_duration":0.054899599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4781,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.832111+0000","last_change":"2024-05-08T20:55:22.832380+0000","last_active":"2024-05-08T20:55:22.832111+0000","last_peered":"2024-05-08T20:55:22.832111+0000","last_clean":"2024-05-08T20:55:22.832111+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:55:22.832111+0000","last_undegraded":"2024-05-08T20:55:22.832111+0000","last_fullsized":"2024-05-08T20:55:22.832111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4746","last_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_deep_scrub":"26'4746","last_deep_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.832058+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:06.840030+0000","scrub_duration":0.062733702000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5146,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.584824+0000","last_change":"2024-05-08T20:54:48.585054+0000","last_active":"2024-05-08T20:54:48.584824+0000","last_peered":"2024-05-08T20:54:48.584824+0000","last_clean":"2024-05-08T20:54:48.584824+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:48.584824+0000","last_undegraded":"2024-05-08T20:54:48.584824+0000","last_fullsized":"2024-05-08T20:54:48.584824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5105","last_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_deep_scrub":"26'5105","last_deep_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.584770+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:58.380211+0000","scrub_duration":0.012206140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3558,"ondisk_log_size":3558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3566,"ondisk_log_size":3566,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575201,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":2.6960000000000002,"15min":1.5840000000000001},"min":{"1min":0.59399999999999997,"5min":0.192,"15min":0.192},"max":{"1min":1.0169999999999999,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":1,"5min":1.4390000000000001,"15min":1.22},"min":{"1min":0.80300000000000005,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.139,"5min":34.091000000000001,"15min":34.091000000000001},"last":1.0569999999999999}]},{"osd":1,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.226,"15min":1.0880000000000001},"min":{"1min":0.622,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2090000000000001,"5min":11.189,"15min":13.579000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.2290000000000001,"15min":1.141},"min":{"1min":0.65900000000000003,"5min":0.29599999999999999,"15min":0.255},"max":{"1min":1.071,"5min":11.260999999999999,"15min":13.467000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.4590000000000001,"15min":1.1659999999999999},"min":{"1min":0.69999999999999996,"5min":0.245,"15min":0.245},"max":{"1min":1.2370000000000001,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.548,"15min":1.3},"min":{"1min":0.89400000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":1.3009999999999999,"5min":34.003999999999998,"15min":34.003999999999998},"last":1.252}]},{"osd":3,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.21,"15min":1.115},"min":{"1min":0.70699999999999996,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0569999999999999,"5min":11.215,"15min":15.532},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.5329999999999999,"15min":1.3939999999999999},"min":{"1min":0.76100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0860000000000001,"5min":16.584,"15min":16.584},"last":0.86399999999999999}]},{"osd":4,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":2.024,"15min":1.726},"min":{"1min":0.65000000000000002,"5min":0.255,"15min":0.214},"max":{"1min":1.294,"5min":34.046999999999997,"15min":34.046999999999997},"last":1.294},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.5800000000000001,"15min":1.3400000000000001},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":1.0409999999999999,"5min":20.565999999999999,"15min":22.741},"last":0.81899999999999995}]},{"osd":5,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":2.2999999999999998,"15min":1.978},"min":{"1min":0.77100000000000002,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":1.274,"5min":20.626999999999999,"15min":33.679000000000002},"last":1.117},{"interface":"front","average":{"1min":1.2430000000000001,"5min":2.165,"15min":1.5189999999999999},"min":{"1min":1.0609999999999999,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":1.371,"5min":20.869,"15min":20.869},"last":1.335}]},{"osd":6,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.528,"15min":1.2589999999999999},"min":{"1min":1.0209999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.4410000000000001,"5min":11.484,"15min":13.714},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.756,"15min":1.347},"min":{"1min":0.65300000000000002,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":1.2010000000000001,"5min":22.405000000000001,"15min":22.405000000000001},"last":1.0229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575199,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":1.389,"15min":0.98899999999999999},"min":{"1min":0.39400000000000002,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":1.25,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.5780000000000001,"15min":1.173},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2829999999999999,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":1.129}]},{"osd":1,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.0940000000000001,"15min":1.1699999999999999},"min":{"1min":0.67000000000000004,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":1.1899999999999999,"5min":5.8179999999999996,"15min":14.717000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.24,"15min":1.111},"min":{"1min":0.77200000000000002,"5min":0.32800000000000001,"15min":0.23300000000000001},"max":{"1min":1.8200000000000001,"5min":7.3810000000000002,"15min":14.404},"last":1.022}]},{"osd":2,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.1739999999999999,"15min":1.087},"min":{"1min":0.623,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":1.2549999999999999,"5min":9.907,"15min":9.907},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1080000000000001,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.38400000000000001,"15min":0.254},"max":{"1min":1.3149999999999999,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":0.89500000000000002}]},{"osd":3,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.4330000000000001,"15min":1.3180000000000001},"min":{"1min":0.82099999999999995,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":1.5940000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.419,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":1.6719999999999999,"5min":13.960000000000001,"15min":13.960000000000001},"last":0.92100000000000004}]},{"osd":4,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.891,"15min":1.5549999999999999},"min":{"1min":0.62,"5min":0.32600000000000001,"15min":0.223},"max":{"1min":1.7849999999999999,"5min":30.094000000000001,"15min":30.094000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.177,"5min":1.6299999999999999,"15min":1.4450000000000001},"min":{"1min":0.85599999999999998,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":1.8280000000000001,"5min":29.538,"15min":29.538},"last":1.25}]},{"osd":5,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.5169999999999999,"15min":1.196},"min":{"1min":0.58499999999999996,"5min":0.33500000000000002,"15min":0.25},"max":{"1min":1.4059999999999999,"5min":10.833,"15min":11.568},"last":1.101},{"interface":"front","average":{"1min":1.117,"5min":1.621,"15min":1.3200000000000001},"min":{"1min":0.92000000000000004,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":1.5329999999999999,"5min":10.872,"15min":11.593999999999999},"last":1.2130000000000001}]},{"osd":7,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.5580000000000001,"15min":1.2569999999999999},"min":{"1min":0.64700000000000002,"5min":0.188,"15min":0.188},"max":{"1min":1.2330000000000001,"5min":10.339,"15min":12.77},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.732,"15min":1.3160000000000001},"min":{"1min":0.751,"5min":0.371,"15min":0.29699999999999999},"max":{"1min":1.6240000000000001,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.294}]}]},{"osd":5,"up_from":13,"seq":55834575199,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.57399999999999995,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.284,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.173,"15min":1.03},"min":{"1min":0.80400000000000005,"5min":0.27800000000000002,"15min":0.23599999999999999},"max":{"1min":1.2270000000000001,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.89700000000000002}]},{"osd":1,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":2.609,"15min":2.335},"min":{"1min":0.72299999999999998,"5min":0.27100000000000002,"15min":0.20799999999999999},"max":{"1min":1.149,"5min":99.978999999999999,"15min":121.521},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.5409999999999999,"15min":1.2370000000000001},"min":{"1min":0.73499999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":1.1140000000000001,"5min":7.5529999999999999,"15min":18.957999999999998},"last":0.94599999999999995}]},{"osd":2,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.4490000000000001,"15min":1.2290000000000001},"min":{"1min":0.67600000000000005,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":1.3029999999999999,"5min":12.079000000000001,"15min":16.535},"last":1.085},{"interface":"front","average":{"1min":0.875,"5min":1.446,"15min":1.159},"min":{"1min":0.68000000000000005,"5min":0.27900000000000003,"15min":0.249},"max":{"1min":1.1140000000000001,"5min":8.7490000000000006,"15min":15.006},"last":0.77500000000000002}]},{"osd":3,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":3.0409999999999999,"15min":2.5259999999999998},"min":{"1min":0.83799999999999997,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":1.4450000000000001,"5min":99.861999999999995,"15min":121.498},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.704,"15min":1.3049999999999999},"min":{"1min":0.70199999999999996,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":1.1819999999999999,"5min":33.140000000000001,"15min":33.140000000000001},"last":1.1240000000000001}]},{"osd":4,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":2.6160000000000001,"15min":2.343},"min":{"1min":0.68000000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.496,"5min":100.571,"15min":121.464},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.474,"15min":1.202},"min":{"1min":0.64900000000000002,"5min":0.35999999999999999,"15min":0.21199999999999999},"max":{"1min":1.206,"5min":7.7110000000000003,"15min":8.2710000000000008},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.5680000000000001,"15min":1.355},"min":{"1min":0.64900000000000002,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":1.302,"5min":15.048,"15min":15.048},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.5209999999999999,"15min":1.2350000000000001},"min":{"1min":0.71699999999999997,"5min":0.34100000000000003,"15min":0.23999999999999999},"max":{"1min":1.333,"5min":7.4969999999999999,"15min":11.56},"last":1.218}]},{"osd":7,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.8490000000000002,"15min":2.0179999999999998},"min":{"1min":0.81399999999999995,"5min":0.33000000000000002,"15min":0.28499999999999998},"max":{"1min":1.4099999999999999,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.476,"15min":1.2529999999999999},"min":{"1min":0.749,"5min":0.432,"15min":0.30599999999999999},"max":{"1min":1.2110000000000001,"5min":9.4890000000000008,"15min":12.679},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834575200,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.853,"15min":1.244},"min":{"1min":0.41799999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.2050000000000001,"5min":28.303999999999998,"15min":28.303999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.579,"15min":1.2},"min":{"1min":0.44700000000000001,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":1.3640000000000001,"5min":16.119,"15min":16.119},"last":1.1419999999999999}]},{"osd":1,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":2.2149999999999999,"15min":1.423},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.403,"5min":27.975000000000001,"15min":27.975000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.4630000000000001,"15min":1.081},"min":{"1min":0.67700000000000005,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.9689999999999999,"5min":16.904,"15min":16.904},"last":0.88100000000000001}]},{"osd":2,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":2.0310000000000001,"15min":1.4730000000000001},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":1.0720000000000001,"5min":28.271999999999998,"15min":28.271999999999998},"last":1.228},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.232,"15min":1.002},"min":{"1min":0.64100000000000001,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":3.0190000000000001,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":1.0860000000000001}]},{"osd":3,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":2.2799999999999998,"15min":1.542},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.7880000000000003,"5min":16.449000000000002,"15min":16.449000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.125,"5min":2.2759999999999998,"15min":1.5089999999999999},"min":{"1min":0.67000000000000004,"5min":0.316,"15min":0.316},"max":{"1min":3.1579999999999999,"5min":29.526,"15min":29.526},"last":1.0369999999999999}]},{"osd":5,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":2.508,"15min":1.464},"min":{"1min":0.32900000000000001,"5min":0.26200000000000001,"15min":0.22800000000000001},"max":{"1min":1.1639999999999999,"5min":25.030999999999999,"15min":25.030999999999999},"last":1.169},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.5149999999999999,"15min":1.1859999999999999},"min":{"1min":0.60099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.0880000000000001,"5min":9.0370000000000008,"15min":14.863},"last":1.1910000000000001}]},{"osd":6,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.899,"15min":1.325},"min":{"1min":0.36199999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.327,"5min":33.198,"15min":33.198},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.9530000000000001,"15min":1.373},"min":{"1min":0.38900000000000001,"5min":0.318,"15min":0.308},"max":{"1min":1.425,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.268}]},{"osd":7,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":3.4980000000000002,"15min":1.853},"min":{"1min":0.77400000000000002,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":3.0529999999999999,"5min":54.073999999999998,"15min":54.073999999999998},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":3.7010000000000001,"15min":1.97},"min":{"1min":1.095,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":3.125,"5min":54.113,"15min":54.113},"last":1.6339999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575199,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.97399999999999998,"15min":0.95599999999999996},"min":{"1min":0.48099999999999998,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.80500000000000005,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.64900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.018,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed May 8 20:56:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.88500000000000001,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.85299999999999998,"5min":12.204000000000001,"15min":16.355},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.57499999999999996,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.3109999999999999,"5min":6.3140000000000001,"15min":9.7230000000000008},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.276,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":1.242,"5min":17.106000000000002,"15min":17.106000000000002},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88100000000000001,"15min":0.83899999999999997},"min":{"1min":0.68899999999999995,"5min":0.191,"15min":0.191},"max":{"1min":1.0489999999999999,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":1.0469999999999999}]},{"osd":4,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.4119999999999999,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1850000000000001,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3240000000000001,"15min":1.0549999999999999},"min":{"1min":0.83199999999999996,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.21,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.88}]},{"osd":5,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.3480000000000001,"15min":1.9219999999999999},"min":{"1min":0.79800000000000004,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.3089999999999999,"5min":12.167999999999999,"15min":117.105},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.323,"15min":1.1719999999999999},"min":{"1min":0.79100000000000004,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.335,"5min":9.9700000000000006,"15min":14.394},"last":0.995}]},{"osd":6,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.4430000000000001,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3720000000000001,"5min":10.834,"15min":16.113},"last":1.073},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.4950000000000001,"15min":1.2330000000000001},"min":{"1min":1.0169999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.573,"5min":16.992999999999999,"15min":16.992999999999999},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.4810000000000001,"15min":1.3680000000000001},"min":{"1min":0.90100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.677,"5min":16.977,"15min":16.977},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.4059999999999999,"15min":1.294},"min":{"1min":0.93200000000000005,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":1.3400000000000001,"5min":13.092000000000001,"15min":15.289999999999999},"last":0.93700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575197,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70799999999999996,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.81999999999999995,"5min":7.5679999999999996,"15min":12.609999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.872,"15min":0.91500000000000004},"min":{"1min":0.56799999999999995,"5min":0.189,"15min":0.189},"max":{"1min":0.85199999999999998,"5min":8.7889999999999997,"15min":12.359999999999999},"last":0.95799999999999996}]},{"osd":1,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.84199999999999997,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.98099999999999998,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.621},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70199999999999996,"15min":0.77300000000000002},"min":{"1min":0.61499999999999999,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":1.052,"5min":6.0380000000000003,"15min":6.7009999999999996},"last":0.69099999999999995}]},{"osd":3,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.014,"15min":0.95399999999999996},"min":{"1min":0.59599999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.252,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.073,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.255,"15min":0.255},"max":{"1min":1.1319999999999999,"5min":10.510999999999999,"15min":10.510999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Wed May 8 20:55:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.9930000000000001,"15min":1.2609999999999999},"min":{"1min":0.59699999999999998,"5min":0.29399999999999998,"15min":0.28599999999999998},"max":{"1min":5.7949999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.6319999999999999,"15min":1.232},"min":{"1min":0.68899999999999995,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2310000000000001,"5min":18.065000000000001,"15min":18.065000000000001},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.421,"15min":1.3160000000000001},"min":{"1min":0.68300000000000005,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":1.2909999999999999,"5min":9.2910000000000004,"15min":22.489000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.998,"5min":1.462,"15min":1.2390000000000001},"min":{"1min":0.83999999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3480000000000001,"5min":12.234,"15min":14.968999999999999},"last":1.0209999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.355,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.274,"5min":7.6520000000000001,"15min":9.7370000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.4379999999999999,"15min":1.2010000000000001},"min":{"1min":0.84399999999999997,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":1.321,"5min":12.553000000000001,"15min":12.553000000000001},"last":1.046}]},{"osd":7,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.7150000000000001,"15min":1.4319999999999999},"min":{"1min":0.91700000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.393,"5min":13.663,"15min":13.663},"last":1.097},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.8160000000000001,"15min":1.5049999999999999},"min":{"1min":0.879,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4259999999999999,"5min":13.33,"15min":19.201000000000001},"last":1.0640000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575198,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.39000000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.874,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0209999999999999,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.1359999999999999,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.878}]},{"osd":2,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.81999999999999995,"15min":0.89000000000000001},"min":{"1min":0.55000000000000004,"5min":0.20000000000000001,"15min":0.188},"max":{"1min":0.97099999999999997,"5min":13.961,"15min":13.961},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.56799999999999995,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.1919999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.9179999999999999,"15min":1.4730000000000001},"min":{"1min":0.48099999999999998,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":1.173,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.62},{"interface":"front","average":{"1min":0.749,"5min":1.5409999999999999,"15min":1.218},"min":{"1min":0.51800000000000002,"5min":0.254,"15min":0.20399999999999999},"max":{"1min":1.014,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":1.0820000000000001,"15min":1.141},"min":{"1min":0.70999999999999996,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.145,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.012,"15min":1.042},"min":{"1min":0.64000000000000001,"5min":0.29899999999999999,"15min":0.26700000000000002},"max":{"1min":1.2709999999999999,"5min":3.8220000000000001,"15min":9.5630000000000006},"last":0.93000000000000005}]},{"osd":5,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.77,"15min":1.871},"min":{"1min":0.75800000000000001,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":1.2609999999999999,"5min":21.469000000000001,"15min":68.162000000000006},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.6180000000000001,"15min":1.3120000000000001},"min":{"1min":0.70299999999999996,"5min":0.316,"15min":0.316},"max":{"1min":1.353,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.401,"15min":1.228},"min":{"1min":0.77900000000000003,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":1.222,"5min":14.032,"15min":14.032},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.222,"15min":1.143},"min":{"1min":0.74399999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":1.401,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.105}]},{"osd":7,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.8140000000000001,"15min":1.6819999999999999},"min":{"1min":0.78900000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.321,"5min":21.734000000000002,"15min":26.881},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.4350000000000001,"15min":1.339},"min":{"1min":0.82399999999999995,"5min":0.36099999999999999,"15min":0.34799999999999998},"max":{"1min":1.2170000000000001,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.0609999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575198,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.879,"15min":0.70099999999999996},"min":{"1min":0.32100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.877,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":1.0329999999999999,"15min":0.84699999999999998},"min":{"1min":0.36099999999999999,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.96599999999999997,"5min":8.8330000000000002,"15min":13.305},"last":0.71899999999999997}]},{"osd":2,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":1.093,"15min":0.82699999999999996},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.98599999999999999,"5min":15.212,"15min":15.212},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":1.095,"15min":0.83399999999999996},"min":{"1min":0.376,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":1.137,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.85999999999999999},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":1.3140000000000001,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":1.038},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98299999999999998,"15min":0.94899999999999995},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.26300000000000001},"max":{"1min":1.375,"5min":6.758,"15min":6.758},"last":1.143}]},{"osd":4,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":1.502,"15min":1.1040000000000001},"min":{"1min":0.47299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":18.407,"15min":18.407},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.4750000000000001,"15min":1.097},"min":{"1min":0.61699999999999999,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.226,"5min":18.466999999999999,"15min":18.466999999999999},"last":1.228}]},{"osd":5,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":2.0470000000000002,"15min":1.3080000000000001},"min":{"1min":0.629,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":1.147,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.004,"5min":1.671,"15min":1.1919999999999999},"min":{"1min":0.66800000000000004,"5min":0.312,"15min":0.312},"max":{"1min":1.5289999999999999,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.2}]},{"osd":6,"last update":"Wed May 8 20:55:05 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.3939999999999999,"15min":1.1000000000000001},"min":{"1min":0.63500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.611,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":1.105},{"interface":"front","average":{"1min":1.048,"5min":1.421,"15min":1.131},"min":{"1min":0.497,"5min":0.314,"15min":0.30599999999999999},"max":{"1min":1.444,"5min":8.9870000000000001,"15min":11.597},"last":1.01}]},{"osd":7,"last update":"Wed May 8 20:55:08 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":2.0030000000000001,"15min":1.417},"min":{"1min":0.89200000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.718,"5min":18.748999999999999,"15min":18.748999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":2.0470000000000002,"15min":1.504},"min":{"1min":0.85899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.79,"5min":18.788,"15min":18.788},"last":1.3089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:06.912 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.914 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.914 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.914 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.915 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.915 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-05-08T20:27:27.565015+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=27, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T20:56:06.915 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T20:56:26.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.043+0000 7ff05a1ac640 1 Processor -- start 2024-05-08T20:56:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.043+0000 7ff05a1ac640 1 -- start start 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff05a1ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff05406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff05a1ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0540725f0 0x7ff0540c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff05a1ac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540c0650 con 0x7ff05406f400 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff05a1ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05406fd60 con 0x7ff0540725f0 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff05a1ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff054072180 con 0x7ff0541501e0 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff053fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff05406f400 0x7ff0540c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33330/0 (socket says 172.21.15.81:33330) 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff053fff640 1 -- 172.21.15.81:0/3725440407 learned_addr learned my addr 172.21.15.81:0/3725440407 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014555589 0 0) 0x7ff0540c0650 con 0x7ff05406f400 2024-05-08T20:56:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040003530 con 0x7ff05406f400 2024-05-08T20:56:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 --2- 172.21.15.81:0/3725440407 >> v2:172.21.15.117:3300/0 conn(0x7ff0540725f0 0x7ff0540c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0537fe640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff05406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18319081 0 0) 0x7ff040003530 con 0x7ff05406f400 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 msgr2=0x7ff05406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff05406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 >> v2:172.21.15.117:3300/0 conn(0x7ff0540725f0 msgr2=0x7ff0540c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 --2- 172.21.15.81:0/3725440407 >> v2:172.21.15.117:3300/0 conn(0x7ff0540725f0 0x7ff0540c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05406fa80 con 0x7ff05406f400 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff04c001a00 con 0x7ff05406f400 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 >> v1:172.21.15.81:6789/0 conn(0x7ff05406f400 legacy=0x7ff0540c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff040003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff040003f00 0x7ff0400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040004d10 0x7ff040005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05406fd60 con 0x7ff040003f00 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff054072180 con 0x7ff040004d10 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000ba70 con 0x7ff0541501e0 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff040003f00 0x7ff0400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff0537fe640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff040003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff053fff640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040004d10 0x7ff040005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 -- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 msgr2=0x7ff040003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541501e0 0x7ff040003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 -- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040004d10 msgr2=0x7ff040005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040004d10 0x7ff040005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 -- 172.21.15.81:0/3725440407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040003530 con 0x7ff040003f00 2024-05-08T20:56:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff053fff640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040004d10 0x7ff040005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:27.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.047+0000 7ff052ffd640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff040003f00 0x7ff0400047d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff044009ae0 tx=0x7ff04401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f909a18dea92152 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440a5670 con 0x7ff040003f00 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440a57d0 con 0x7ff040003f00 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff0527fc640 1 -- 172.21.15.81:0/3725440407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440a5980 con 0x7ff040003f00 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/3725440407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff040003f00 msgr2=0x7ff0400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/3725440407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff040003f00 0x7ff0400047d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff044009ae0 tx=0x7ff04401ca80 comp rx=0 tx=0).stop 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff053fff640 1 -- 172.21.15.81:0/3725440407 reap_dead start 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/3725440407 shutdown_connections 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/3725440407 >> 172.21.15.81:0/3725440407 conn(0x7ff0540c2ca0 msgr2=0x7ff0540c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/3725440407 shutdown_connections 2024-05-08T20:56:27.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/3725440407 wait complete. 2024-05-08T20:56:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 Processor -- start 2024-05-08T20:56:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- start start 2024-05-08T20:56:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 0x7ff0541508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541483e0 0x7ff054148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541ede90 con 0x7ff05415be70 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541ecf50 con 0x7ff040003f00 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541ed210 con 0x7ff0541483e0 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40472/0 (socket says 172.21.15.81:40472) 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 -- 172.21.15.81:0/1536633841 learned_addr learned my addr 172.21.15.81:0/1536633841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff0537fe640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 0x7ff0541508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff053fff640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541483e0 0x7ff054148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 -- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541483e0 msgr2=0x7ff054148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541483e0 0x7ff054148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 -- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 msgr2=0x7ff0541508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 0x7ff0541508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 -- 172.21.15.81:0/1536633841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054150740 con 0x7ff05415be70 2024-05-08T20:56:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff0537fe640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 0x7ff0541508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff052ffd640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff04401c8b0 tx=0x7ff040005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044004020 con 0x7ff05415be70 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440041a0 con 0x7ff05415be70 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0541ed4f0 con 0x7ff05415be70 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044003620 con 0x7ff05415be70 2024-05-08T20:56:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.051+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0541edab0 con 0x7ff05415be70 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05415a330 con 0x7ff05415be70 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0440b4040 con 0x7ff05415be70 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff04bfff640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 0x7ff034068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff04411e7b0 con 0x7ff05415be70 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff0537fe640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 0x7ff034068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.055+0000 7ff0537fe640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 0x7ff034068b50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009a10 tx=0x7ff03c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.059+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff05415a330 con 0x7ff05415be70 2024-05-08T20:56:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.215+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 --> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0541505c0 con 0x7ff034066690 2024-05-08T20:56:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.235+0000 7ff04bfff640 1 -- 172.21.15.81:0/1536633841 <== mgr.4110 v2:172.21.15.81:6832/27511 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+533852 (secure 0 0 0) 0x7ff03c013960 con 0x7ff034066690 2024-05-08T20:56:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 msgr2=0x7ff034068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 0x7ff034068b50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009a10 tx=0x7ff03c008040 comp rx=0 tx=0).stop 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 msgr2=0x7ff054071550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff04401c8b0 tx=0x7ff040005800 comp rx=0 tx=0).stop 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 shutdown_connections 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff034066690 0x7ff034068b50 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0541483e0 0x7ff054148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05415be70 0x7ff054071550 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 --2- 172.21.15.81:0/1536633841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff040003f00 0x7ff0541508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 >> 172.21.15.81:0/1536633841 conn(0x7ff0540c2ca0 msgr2=0x7ff0540bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 shutdown_connections 2024-05-08T20:56:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.243+0000 7ff05a1ac640 1 -- 172.21.15.81:0/1536633841 wait complete. 2024-05-08T20:56:27.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":898,"stamp":"2024-05-08T20:56:25.940726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38453382,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":246,"num_read_kb":354,"num_write":3385632,"num_write_kb":39809727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622923,"ondisk_log_size":622923,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349980,"kb_used_data":77404,"kb_used_omap":12,"kb_used_meta":8272499,"kb_avail":746624740,"statfs":{"total":773094113280,"available":764543733760,"internally_reserved":0,"allocated":79261696,"data_stored":77810057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8471039544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005922"},"pg_stats":[{"pgid":"5.18","version":"26'4778","reported_seq":4813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.075935+0000","last_change":"2024-05-08T20:55:27.076189+0000","last_active":"2024-05-08T20:55:27.075935+0000","last_peered":"2024-05-08T20:55:27.075935+0000","last_clean":"2024-05-08T20:55:27.075935+0000","last_became_active":"2024-05-08T20:27:28.005272+0000","last_became_peered":"2024-05-08T20:27:28.005272+0000","last_unstale":"2024-05-08T20:55:27.075935+0000","last_undegraded":"2024-05-08T20:55:27.075935+0000","last_fullsized":"2024-05-08T20:55:27.075935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4778","last_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_deep_scrub":"26'4778","last_deep_scrub_stamp":"2024-05-08T20:55:27.075881+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.075881+0000","objects_scrubbed":0,"log_size":4778,"log_dups_size":0,"ondisk_log_size":4778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:10.493830+0000","scrub_duration":0.060369219000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26675,"num_write_kb":319926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'767","reported_seq":809,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.034026+0000","last_change":"2024-05-08T20:54:52.034318+0000","last_active":"2024-05-08T20:54:52.034026+0000","last_peered":"2024-05-08T20:54:52.034026+0000","last_clean":"2024-05-08T20:54:52.034026+0000","last_became_active":"2024-05-08T20:27:18.518789+0000","last_became_peered":"2024-05-08T20:27:18.518789+0000","last_unstale":"2024-05-08T20:54:52.034026+0000","last_undegraded":"2024-05-08T20:54:52.034026+0000","last_fullsized":"2024-05-08T20:54:52.034026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'767","last_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_deep_scrub":"26'767","last_deep_scrub_stamp":"2024-05-08T20:54:52.033968+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.033968+0000","objects_scrubbed":3,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.997884+0000","scrub_duration":0.095634259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5314","reported_seq":5356,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.354589+0000","last_change":"2024-05-08T20:55:25.354823+0000","last_active":"2024-05-08T20:55:25.354589+0000","last_peered":"2024-05-08T20:55:25.354589+0000","last_clean":"2024-05-08T20:55:25.354589+0000","last_became_active":"2024-05-08T20:27:18.906450+0000","last_became_peered":"2024-05-08T20:27:18.906450+0000","last_unstale":"2024-05-08T20:55:25.354589+0000","last_undegraded":"2024-05-08T20:55:25.354589+0000","last_fullsized":"2024-05-08T20:55:25.354589+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5314","last_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_deep_scrub":"26'5314","last_deep_scrub_stamp":"2024-05-08T20:55:25.354534+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.354534+0000","objects_scrubbed":0,"log_size":5214,"log_dups_size":0,"ondisk_log_size":5214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.054489+0000","scrub_duration":0.015367578999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28407,"num_write_kb":322941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.318767+0000","last_change":"2024-05-08T20:54:58.319009+0000","last_active":"2024-05-08T20:54:58.318767+0000","last_peered":"2024-05-08T20:54:58.318767+0000","last_clean":"2024-05-08T20:54:58.318767+0000","last_became_active":"2024-05-08T20:27:27.600855+0000","last_became_peered":"2024-05-08T20:27:27.600855+0000","last_unstale":"2024-05-08T20:54:58.318767+0000","last_undegraded":"2024-05-08T20:54:58.318767+0000","last_fullsized":"2024-05-08T20:54:58.318767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:58.318713+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.318713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:57.774502+0000","scrub_duration":0.0077592889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5153","reported_seq":5188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.695146+0000","last_change":"2024-05-08T20:55:40.695305+0000","last_active":"2024-05-08T20:55:40.695146+0000","last_peered":"2024-05-08T20:55:40.695146+0000","last_clean":"2024-05-08T20:55:40.695146+0000","last_became_active":"2024-05-08T20:27:28.001179+0000","last_became_peered":"2024-05-08T20:27:28.001179+0000","last_unstale":"2024-05-08T20:55:40.695146+0000","last_undegraded":"2024-05-08T20:55:40.695146+0000","last_fullsized":"2024-05-08T20:55:40.695146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5153","last_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_deep_scrub":"26'5153","last_deep_scrub_stamp":"2024-05-08T20:55:40.695112+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.695112+0000","objects_scrubbed":0,"log_size":5153,"log_dups_size":0,"ondisk_log_size":5153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:29.089686+0000","scrub_duration":0.10690976200000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27293,"num_write_kb":347036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'5","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.320721+0000","last_change":"2024-05-08T20:55:24.320973+0000","last_active":"2024-05-08T20:55:24.320721+0000","last_peered":"2024-05-08T20:55:24.320721+0000","last_clean":"2024-05-08T20:55:24.320721+0000","last_became_active":"2024-05-08T20:27:18.515771+0000","last_became_peered":"2024-05-08T20:27:18.515771+0000","last_unstale":"2024-05-08T20:55:24.320721+0000","last_undegraded":"2024-05-08T20:55:24.320721+0000","last_fullsized":"2024-05-08T20:55:24.320721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:24.320666+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.320666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:33.689682+0000","scrub_duration":0.0078549569999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'7698","reported_seq":7739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:41.927515+0000","last_change":"2024-05-08T20:54:41.927766+0000","last_active":"2024-05-08T20:54:41.927515+0000","last_peered":"2024-05-08T20:54:41.927515+0000","last_clean":"2024-05-08T20:54:41.927515+0000","last_became_active":"2024-05-08T20:27:18.930020+0000","last_became_peered":"2024-05-08T20:27:18.930020+0000","last_unstale":"2024-05-08T20:54:41.927515+0000","last_undegraded":"2024-05-08T20:54:41.927515+0000","last_fullsized":"2024-05-08T20:54:41.927515+0000","mapping_epoch":18,"log_start":"26'700","ondisk_log_start":"26'700","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7698","last_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_deep_scrub":"26'7698","last_deep_scrub_stamp":"2024-05-08T20:54:41.927487+0000","last_clean_scrub_stamp":"2024-05-08T20:54:41.927487+0000","objects_scrubbed":0,"log_size":6998,"log_dups_size":0,"ondisk_log_size":6998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:19.553503+0000","scrub_duration":0.016735446000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41470,"num_write_kb":461489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'2","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.962764+0000","last_change":"2024-05-08T20:55:21.962980+0000","last_active":"2024-05-08T20:55:21.962764+0000","last_peered":"2024-05-08T20:55:21.962764+0000","last_clean":"2024-05-08T20:55:21.962764+0000","last_became_active":"2024-05-08T20:27:27.626004+0000","last_became_peered":"2024-05-08T20:27:27.626004+0000","last_unstale":"2024-05-08T20:55:21.962764+0000","last_undegraded":"2024-05-08T20:55:21.962764+0000","last_fullsized":"2024-05-08T20:55:21.962764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:21.962709+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.962709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:06.689855+0000","scrub_duration":0.0035857630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3596","reported_seq":3631,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:09.693818+0000","last_change":"2024-05-08T20:56:09.694067+0000","last_active":"2024-05-08T20:56:09.693818+0000","last_peered":"2024-05-08T20:56:09.693818+0000","last_clean":"2024-05-08T20:56:09.693818+0000","last_became_active":"2024-05-08T20:27:28.021892+0000","last_became_peered":"2024-05-08T20:27:28.021892+0000","last_unstale":"2024-05-08T20:56:09.693818+0000","last_undegraded":"2024-05-08T20:56:09.693818+0000","last_fullsized":"2024-05-08T20:56:09.693818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3596","last_scrub_stamp":"2024-05-08T20:56:09.693764+0000","last_deep_scrub":"26'3596","last_deep_scrub_stamp":"2024-05-08T20:56:09.693764+0000","last_clean_scrub_stamp":"2024-05-08T20:56:09.693764+0000","objects_scrubbed":0,"log_size":3596,"log_dups_size":0,"ondisk_log_size":3596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:24.418164+0000","scrub_duration":0.033699267999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19089,"num_write_kb":256756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'8","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:46.660871+0000","last_change":"2024-05-08T20:55:46.661126+0000","last_active":"2024-05-08T20:55:46.660871+0000","last_peered":"2024-05-08T20:55:46.660871+0000","last_clean":"2024-05-08T20:55:46.660871+0000","last_became_active":"2024-05-08T20:27:18.531042+0000","last_became_peered":"2024-05-08T20:27:18.531042+0000","last_unstale":"2024-05-08T20:55:46.660871+0000","last_undegraded":"2024-05-08T20:55:46.660871+0000","last_fullsized":"2024-05-08T20:55:46.660871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:55:46.660816+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:55:46.660816+0000","last_clean_scrub_stamp":"2024-05-08T20:55:46.660816+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:50.039422+0000","scrub_duration":0.0061115309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'4689","reported_seq":4728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:58.217320+0000","last_change":"2024-05-08T20:54:58.217575+0000","last_active":"2024-05-08T20:54:58.217320+0000","last_peered":"2024-05-08T20:54:58.217320+0000","last_clean":"2024-05-08T20:54:58.217320+0000","last_became_active":"2024-05-08T20:27:18.926398+0000","last_became_peered":"2024-05-08T20:27:18.926398+0000","last_unstale":"2024-05-08T20:54:58.217320+0000","last_undegraded":"2024-05-08T20:54:58.217320+0000","last_fullsized":"2024-05-08T20:54:58.217320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:58.217264+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.217264+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:04.029681+0000","scrub_duration":0.019522241999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":276986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'619","reported_seq":655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.174972+0000","last_change":"2024-05-08T20:54:55.174972+0000","last_active":"2024-05-08T20:54:55.174972+0000","last_peered":"2024-05-08T20:54:55.174972+0000","last_clean":"2024-05-08T20:54:55.174972+0000","last_became_active":"2024-05-08T20:27:27.618028+0000","last_became_peered":"2024-05-08T20:27:27.618028+0000","last_unstale":"2024-05-08T20:54:55.174972+0000","last_undegraded":"2024-05-08T20:54:55.174972+0000","last_fullsized":"2024-05-08T20:54:55.174972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'619","last_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_deep_scrub":"26'619","last_deep_scrub_stamp":"2024-05-08T20:54:55.174692+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.174692+0000","objects_scrubbed":1,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:43.612782+0000","scrub_duration":0.059475472000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3818","reported_seq":3853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.147415+0000","last_change":"2024-05-08T20:55:11.147679+0000","last_active":"2024-05-08T20:55:11.147415+0000","last_peered":"2024-05-08T20:55:11.147415+0000","last_clean":"2024-05-08T20:55:11.147415+0000","last_became_active":"2024-05-08T20:27:27.996708+0000","last_became_peered":"2024-05-08T20:27:27.996708+0000","last_unstale":"2024-05-08T20:55:11.147415+0000","last_undegraded":"2024-05-08T20:55:11.147415+0000","last_fullsized":"2024-05-08T20:55:11.147415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3818","last_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_deep_scrub":"26'3818","last_deep_scrub_stamp":"2024-05-08T20:55:11.147361+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.147361+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:52.832177+0000","scrub_duration":0.046126465999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20130,"num_write_kb":256763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'6","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.673307+0000","last_change":"2024-05-08T20:55:33.673559+0000","last_active":"2024-05-08T20:55:33.673307+0000","last_peered":"2024-05-08T20:55:33.673307+0000","last_clean":"2024-05-08T20:55:33.673307+0000","last_became_active":"2024-05-08T20:27:18.532603+0000","last_became_peered":"2024-05-08T20:27:18.532603+0000","last_unstale":"2024-05-08T20:55:33.673307+0000","last_undegraded":"2024-05-08T20:55:33.673307+0000","last_fullsized":"2024-05-08T20:55:33.673307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:33.673248+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.673248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:18.931451+0000","scrub_duration":0.0067036639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6790","reported_seq":6829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.186266+0000","last_change":"2024-05-08T20:54:51.186266+0000","last_active":"2024-05-08T20:54:51.186266+0000","last_peered":"2024-05-08T20:54:51.186266+0000","last_clean":"2024-05-08T20:54:51.186266+0000","last_became_active":"2024-05-08T20:27:18.929845+0000","last_became_peered":"2024-05-08T20:27:18.929845+0000","last_unstale":"2024-05-08T20:54:51.186266+0000","last_undegraded":"2024-05-08T20:54:51.186266+0000","last_fullsized":"2024-05-08T20:54:51.186266+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6790","last_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_deep_scrub":"26'6790","last_deep_scrub_stamp":"2024-05-08T20:54:51.185945+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.185945+0000","objects_scrubbed":0,"log_size":5790,"log_dups_size":0,"ondisk_log_size":5790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:12.471228+0000","scrub_duration":0.025898879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36269,"num_write_kb":383174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'148","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:52.145576+0000","last_change":"2024-05-08T20:54:52.145576+0000","last_active":"2024-05-08T20:54:52.145576+0000","last_peered":"2024-05-08T20:54:52.145576+0000","last_clean":"2024-05-08T20:54:52.145576+0000","last_became_active":"2024-05-08T20:27:27.617390+0000","last_became_peered":"2024-05-08T20:27:27.617390+0000","last_unstale":"2024-05-08T20:54:52.145576+0000","last_undegraded":"2024-05-08T20:54:52.145576+0000","last_fullsized":"2024-05-08T20:54:52.145576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-05-08T20:54:52.145299+0000","last_clean_scrub_stamp":"2024-05-08T20:54:52.145299+0000","objects_scrubbed":1,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:12:17.689064+0000","scrub_duration":0.013037381000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4662","reported_seq":4698,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.647773+0000","last_change":"2024-05-08T20:55:33.647883+0000","last_active":"2024-05-08T20:55:33.647773+0000","last_peered":"2024-05-08T20:55:33.647773+0000","last_clean":"2024-05-08T20:55:33.647773+0000","last_became_active":"2024-05-08T20:27:28.015412+0000","last_became_peered":"2024-05-08T20:27:28.015412+0000","last_unstale":"2024-05-08T20:55:33.647773+0000","last_undegraded":"2024-05-08T20:55:33.647773+0000","last_fullsized":"2024-05-08T20:55:33.647773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4662","last_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_deep_scrub":"26'4662","last_deep_scrub_stamp":"2024-05-08T20:55:33.647749+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.647749+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:01.916015+0000","scrub_duration":0.126015248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25483,"num_write_kb":311170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'5323","reported_seq":5364,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.576011+0000","last_change":"2024-05-08T20:55:08.576011+0000","last_active":"2024-05-08T20:55:08.576011+0000","last_peered":"2024-05-08T20:55:08.576011+0000","last_clean":"2024-05-08T20:55:08.576011+0000","last_became_active":"2024-05-08T20:27:18.907882+0000","last_became_peered":"2024-05-08T20:27:18.907882+0000","last_unstale":"2024-05-08T20:55:08.576011+0000","last_undegraded":"2024-05-08T20:55:08.576011+0000","last_fullsized":"2024-05-08T20:55:08.576011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5323","last_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_deep_scrub":"26'5323","last_deep_scrub_stamp":"2024-05-08T20:55:08.575724+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.575724+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:03.281285+0000","scrub_duration":0.015670814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28130,"num_write_kb":317654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'1107","reported_seq":1148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.662027+0000","last_change":"2024-05-08T20:55:40.662250+0000","last_active":"2024-05-08T20:55:40.662027+0000","last_peered":"2024-05-08T20:55:40.662027+0000","last_clean":"2024-05-08T20:55:40.662027+0000","last_became_active":"2024-05-08T20:27:18.541677+0000","last_became_peered":"2024-05-08T20:27:18.541677+0000","last_unstale":"2024-05-08T20:55:40.662027+0000","last_undegraded":"2024-05-08T20:55:40.662027+0000","last_fullsized":"2024-05-08T20:55:40.662027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1107","last_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_deep_scrub":"26'1107","last_deep_scrub_stamp":"2024-05-08T20:55:40.661973+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.661973+0000","objects_scrubbed":2,"log_size":1107,"log_dups_size":0,"ondisk_log_size":1107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:39.070710+0000","scrub_duration":0.029834421999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1099,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.298281+0000","last_change":"2024-05-08T20:54:46.298581+0000","last_active":"2024-05-08T20:54:46.298281+0000","last_peered":"2024-05-08T20:54:46.298281+0000","last_clean":"2024-05-08T20:54:46.298281+0000","last_became_active":"2024-05-08T20:27:27.616860+0000","last_became_peered":"2024-05-08T20:27:27.616860+0000","last_unstale":"2024-05-08T20:54:46.298281+0000","last_undegraded":"2024-05-08T20:54:46.298281+0000","last_fullsized":"2024-05-08T20:54:46.298281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:54:46.298228+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.298228+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:28.684882+0000","scrub_duration":0.047052471999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4342","reported_seq":4378,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.551738+0000","last_change":"2024-05-08T20:55:08.552011+0000","last_active":"2024-05-08T20:55:08.551738+0000","last_peered":"2024-05-08T20:55:08.551738+0000","last_clean":"2024-05-08T20:55:08.551738+0000","last_became_active":"2024-05-08T20:27:27.993428+0000","last_became_peered":"2024-05-08T20:27:27.993428+0000","last_unstale":"2024-05-08T20:55:08.551738+0000","last_undegraded":"2024-05-08T20:55:08.551738+0000","last_fullsized":"2024-05-08T20:55:08.551738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4342","last_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_deep_scrub":"26'4342","last_deep_scrub_stamp":"2024-05-08T20:55:08.551682+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.551682+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:49.967545+0000","scrub_duration":0.065785658999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24585,"num_write_kb":311679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'4762","reported_seq":4802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.490880+0000","last_change":"2024-05-08T20:55:30.491109+0000","last_active":"2024-05-08T20:55:30.490880+0000","last_peered":"2024-05-08T20:55:30.490880+0000","last_clean":"2024-05-08T20:55:30.490880+0000","last_became_active":"2024-05-08T20:27:18.890000+0000","last_became_peered":"2024-05-08T20:27:18.890000+0000","last_unstale":"2024-05-08T20:55:30.490880+0000","last_undegraded":"2024-05-08T20:55:30.490880+0000","last_fullsized":"2024-05-08T20:55:30.490880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4762","last_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_deep_scrub":"26'4762","last_deep_scrub_stamp":"2024-05-08T20:55:30.490824+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.490824+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:39.900078+0000","scrub_duration":0.031951308999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24554,"num_write_kb":270462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.642343+0000","last_change":"2024-05-08T20:55:14.642343+0000","last_active":"2024-05-08T20:55:14.642343+0000","last_peered":"2024-05-08T20:55:14.642343+0000","last_clean":"2024-05-08T20:55:14.642343+0000","last_became_active":"2024-05-08T20:27:18.511728+0000","last_became_peered":"2024-05-08T20:27:18.511728+0000","last_unstale":"2024-05-08T20:55:14.642343+0000","last_undegraded":"2024-05-08T20:55:14.642343+0000","last_fullsized":"2024-05-08T20:55:14.642343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:14.642037+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.642037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:30.640727+0000","scrub_duration":0.0074746580000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.127560+0000","last_change":"2024-05-08T20:54:59.127778+0000","last_active":"2024-05-08T20:54:59.127560+0000","last_peered":"2024-05-08T20:54:59.127560+0000","last_clean":"2024-05-08T20:54:59.127560+0000","last_became_active":"2024-05-08T20:27:27.618382+0000","last_became_peered":"2024-05-08T20:27:27.618382+0000","last_unstale":"2024-05-08T20:54:59.127560+0000","last_undegraded":"2024-05-08T20:54:59.127560+0000","last_fullsized":"2024-05-08T20:54:59.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:59.127504+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.127504+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:30.421435+0000","scrub_duration":0.0034702330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'3439","reported_seq":3475,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.028473+0000","last_change":"2024-05-08T20:55:29.028690+0000","last_active":"2024-05-08T20:55:29.028473+0000","last_peered":"2024-05-08T20:55:29.028473+0000","last_clean":"2024-05-08T20:55:29.028473+0000","last_became_active":"2024-05-08T20:27:28.006295+0000","last_became_peered":"2024-05-08T20:27:28.006295+0000","last_unstale":"2024-05-08T20:55:29.028473+0000","last_undegraded":"2024-05-08T20:55:29.028473+0000","last_fullsized":"2024-05-08T20:55:29.028473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3439","last_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_deep_scrub":"26'3439","last_deep_scrub_stamp":"2024-05-08T20:55:29.028429+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.028429+0000","objects_scrubbed":0,"log_size":3439,"log_dups_size":0,"ondisk_log_size":3439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:19.936303+0000","scrub_duration":0.056611084999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18847,"num_write_kb":243512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4943","reported_seq":4984,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.443400+0000","last_change":"2024-05-08T20:55:29.443400+0000","last_active":"2024-05-08T20:55:29.443400+0000","last_peered":"2024-05-08T20:55:29.443400+0000","last_clean":"2024-05-08T20:55:29.443400+0000","last_became_active":"2024-05-08T20:27:18.884032+0000","last_became_peered":"2024-05-08T20:27:18.884032+0000","last_unstale":"2024-05-08T20:55:29.443400+0000","last_undegraded":"2024-05-08T20:55:29.443400+0000","last_fullsized":"2024-05-08T20:55:29.443400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4943","last_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_deep_scrub":"26'4943","last_deep_scrub_stamp":"2024-05-08T20:55:29.442961+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.442961+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.926108+0000","scrub_duration":0.022816175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26924,"num_write_kb":292362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.671190+0000","last_change":"2024-05-08T20:55:13.671190+0000","last_active":"2024-05-08T20:55:13.671190+0000","last_peered":"2024-05-08T20:55:13.671190+0000","last_clean":"2024-05-08T20:55:13.671190+0000","last_became_active":"2024-05-08T20:27:18.517777+0000","last_became_peered":"2024-05-08T20:27:18.517777+0000","last_unstale":"2024-05-08T20:55:13.671190+0000","last_undegraded":"2024-05-08T20:55:13.671190+0000","last_fullsized":"2024-05-08T20:55:13.671190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:13.670918+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.670918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:25.637941+0000","scrub_duration":0.0076373999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.870480+0000","last_change":"2024-05-08T20:54:56.870718+0000","last_active":"2024-05-08T20:54:56.870480+0000","last_peered":"2024-05-08T20:54:56.870480+0000","last_clean":"2024-05-08T20:54:56.870480+0000","last_became_active":"2024-05-08T20:27:27.604683+0000","last_became_peered":"2024-05-08T20:27:27.604683+0000","last_unstale":"2024-05-08T20:54:56.870480+0000","last_undegraded":"2024-05-08T20:54:56.870480+0000","last_fullsized":"2024-05-08T20:54:56.870480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:56.870433+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.870433+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:43.134102+0000","scrub_duration":0.054762970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5771","reported_seq":5807,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:55.205936+0000","last_change":"2024-05-08T20:55:55.206178+0000","last_active":"2024-05-08T20:55:55.205936+0000","last_peered":"2024-05-08T20:55:55.205936+0000","last_clean":"2024-05-08T20:55:55.205936+0000","last_became_active":"2024-05-08T20:27:28.013353+0000","last_became_peered":"2024-05-08T20:27:28.013353+0000","last_unstale":"2024-05-08T20:55:55.205936+0000","last_undegraded":"2024-05-08T20:55:55.205936+0000","last_fullsized":"2024-05-08T20:55:55.205936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5771","last_scrub_stamp":"2024-05-08T20:55:55.205885+0000","last_deep_scrub":"26'5771","last_deep_scrub_stamp":"2024-05-08T20:55:55.205885+0000","last_clean_scrub_stamp":"2024-05-08T20:55:55.205885+0000","objects_scrubbed":0,"log_size":5771,"log_dups_size":0,"ondisk_log_size":5771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:51.999348+0000","scrub_duration":0.026754956999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31262,"num_write_kb":395734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4668","reported_seq":4709,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.863669+0000","last_change":"2024-05-08T20:55:11.863669+0000","last_active":"2024-05-08T20:55:11.863669+0000","last_peered":"2024-05-08T20:55:11.863669+0000","last_clean":"2024-05-08T20:55:11.863669+0000","last_became_active":"2024-05-08T20:27:18.887613+0000","last_became_peered":"2024-05-08T20:27:18.887613+0000","last_unstale":"2024-05-08T20:55:11.863669+0000","last_undegraded":"2024-05-08T20:55:11.863669+0000","last_fullsized":"2024-05-08T20:55:11.863669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4668","last_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_deep_scrub":"26'4668","last_deep_scrub_stamp":"2024-05-08T20:55:11.863229+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.863229+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:40.887182+0000","scrub_duration":0.013718674,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24632,"num_write_kb":283218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'5","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.641900+0000","last_change":"2024-05-08T20:55:47.642193+0000","last_active":"2024-05-08T20:55:47.641900+0000","last_peered":"2024-05-08T20:55:47.641900+0000","last_clean":"2024-05-08T20:55:47.641900+0000","last_became_active":"2024-05-08T20:27:18.519733+0000","last_became_peered":"2024-05-08T20:27:18.519733+0000","last_unstale":"2024-05-08T20:55:47.641900+0000","last_undegraded":"2024-05-08T20:55:47.641900+0000","last_fullsized":"2024-05-08T20:55:47.641900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:47.641840+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:47.641840+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.641840+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:29.061974+0000","scrub_duration":0.0042002439999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'8","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:44.185941+0000","last_change":"2024-05-08T20:54:44.186218+0000","last_active":"2024-05-08T20:54:44.185941+0000","last_peered":"2024-05-08T20:54:44.185941+0000","last_clean":"2024-05-08T20:54:44.185941+0000","last_became_active":"2024-05-08T20:27:27.617414+0000","last_became_peered":"2024-05-08T20:27:27.617414+0000","last_unstale":"2024-05-08T20:54:44.185941+0000","last_undegraded":"2024-05-08T20:54:44.185941+0000","last_fullsized":"2024-05-08T20:54:44.185941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:44.185881+0000","last_clean_scrub_stamp":"2024-05-08T20:54:44.185881+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:49.152153+0000","scrub_duration":0.0071163260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'3392","reported_seq":3430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:14.468990+0000","last_change":"2024-05-08T20:55:14.468990+0000","last_active":"2024-05-08T20:55:14.468990+0000","last_peered":"2024-05-08T20:55:14.468990+0000","last_clean":"2024-05-08T20:55:14.468990+0000","last_became_active":"2024-05-08T20:27:27.971917+0000","last_became_peered":"2024-05-08T20:27:27.971917+0000","last_unstale":"2024-05-08T20:55:14.468990+0000","last_undegraded":"2024-05-08T20:55:14.468990+0000","last_fullsized":"2024-05-08T20:55:14.468990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3392","last_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_deep_scrub":"26'3392","last_deep_scrub_stamp":"2024-05-08T20:55:14.468610+0000","last_clean_scrub_stamp":"2024-05-08T20:55:14.468610+0000","objects_scrubbed":0,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:17.529243+0000","scrub_duration":0.100340728,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18967,"num_write_kb":240076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6011","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.043067+0000","last_change":"2024-05-08T20:54:59.043067+0000","last_active":"2024-05-08T20:54:59.043067+0000","last_peered":"2024-05-08T20:54:59.043067+0000","last_clean":"2024-05-08T20:54:59.043067+0000","last_became_active":"2024-05-08T20:27:18.882080+0000","last_became_peered":"2024-05-08T20:27:18.882080+0000","last_unstale":"2024-05-08T20:54:59.043067+0000","last_undegraded":"2024-05-08T20:54:59.043067+0000","last_fullsized":"2024-05-08T20:54:59.043067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6011","last_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_deep_scrub":"26'6011","last_deep_scrub_stamp":"2024-05-08T20:54:59.042843+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.042843+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:03.715065+0000","scrub_duration":0.062194480000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31442,"num_write_kb":351331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'9","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.549940+0000","last_change":"2024-05-08T20:54:55.549940+0000","last_active":"2024-05-08T20:54:55.549940+0000","last_peered":"2024-05-08T20:54:55.549940+0000","last_clean":"2024-05-08T20:54:55.549940+0000","last_became_active":"2024-05-08T20:27:18.527523+0000","last_became_peered":"2024-05-08T20:27:18.527523+0000","last_unstale":"2024-05-08T20:54:55.549940+0000","last_undegraded":"2024-05-08T20:54:55.549940+0000","last_fullsized":"2024-05-08T20:54:55.549940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:55.549635+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.549635+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:30.768311+0000","scrub_duration":0.012030836,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'65","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.950830+0000","last_change":"2024-05-08T20:55:22.951068+0000","last_active":"2024-05-08T20:55:22.950830+0000","last_peered":"2024-05-08T20:55:22.950830+0000","last_clean":"2024-05-08T20:55:22.950830+0000","last_became_active":"2024-05-08T20:27:27.616513+0000","last_became_peered":"2024-05-08T20:27:27.616513+0000","last_unstale":"2024-05-08T20:55:22.950830+0000","last_undegraded":"2024-05-08T20:55:22.950830+0000","last_fullsized":"2024-05-08T20:55:22.950830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-05-08T20:55:22.950775+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.950775+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:09.874263+0000","scrub_duration":0.0069395639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84646,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":61,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'3980","reported_seq":4017,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.923004+0000","last_change":"2024-05-08T20:55:34.923234+0000","last_active":"2024-05-08T20:55:34.923004+0000","last_peered":"2024-05-08T20:55:34.923004+0000","last_clean":"2024-05-08T20:55:34.923004+0000","last_became_active":"2024-05-08T20:27:28.005902+0000","last_became_peered":"2024-05-08T20:27:28.005902+0000","last_unstale":"2024-05-08T20:55:34.923004+0000","last_undegraded":"2024-05-08T20:55:34.923004+0000","last_fullsized":"2024-05-08T20:55:34.923004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3980","last_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_deep_scrub":"26'3980","last_deep_scrub_stamp":"2024-05-08T20:55:34.922959+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.922959+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:15.764076+0000","scrub_duration":0.048454346000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22197,"num_write_kb":265132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4667","reported_seq":4708,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.222714+0000","last_change":"2024-05-08T20:55:20.222714+0000","last_active":"2024-05-08T20:55:20.222714+0000","last_peered":"2024-05-08T20:55:20.222714+0000","last_clean":"2024-05-08T20:55:20.222714+0000","last_became_active":"2024-05-08T20:27:18.898954+0000","last_became_peered":"2024-05-08T20:27:18.898954+0000","last_unstale":"2024-05-08T20:55:20.222714+0000","last_undegraded":"2024-05-08T20:55:20.222714+0000","last_fullsized":"2024-05-08T20:55:20.222714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:20.222435+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.222435+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:22.265649+0000","scrub_duration":0.010318590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24875,"num_write_kb":271871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'255","reported_seq":297,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.700383+0000","last_change":"2024-05-08T20:55:11.700383+0000","last_active":"2024-05-08T20:55:11.700383+0000","last_peered":"2024-05-08T20:55:11.700383+0000","last_clean":"2024-05-08T20:55:11.700383+0000","last_became_active":"2024-05-08T20:27:18.508117+0000","last_became_peered":"2024-05-08T20:27:18.508117+0000","last_unstale":"2024-05-08T20:55:11.700383+0000","last_undegraded":"2024-05-08T20:55:11.700383+0000","last_fullsized":"2024-05-08T20:55:11.700383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'255","last_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_deep_scrub":"26'255","last_deep_scrub_stamp":"2024-05-08T20:55:11.700078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.700078+0000","objects_scrubbed":1,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:05.942160+0000","scrub_duration":0.012718293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'7","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.476447+0000","last_change":"2024-05-08T20:55:09.476447+0000","last_active":"2024-05-08T20:55:09.476447+0000","last_peered":"2024-05-08T20:55:09.476447+0000","last_clean":"2024-05-08T20:55:09.476447+0000","last_became_active":"2024-05-08T20:27:27.623716+0000","last_became_peered":"2024-05-08T20:27:27.623716+0000","last_unstale":"2024-05-08T20:55:09.476447+0000","last_undegraded":"2024-05-08T20:55:09.476447+0000","last_fullsized":"2024-05-08T20:55:09.476447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:09.476143+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.476143+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:20.326575+0000","scrub_duration":0.0053068539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4309","reported_seq":4346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.579958+0000","last_change":"2024-05-08T20:55:27.580135+0000","last_active":"2024-05-08T20:55:27.579958+0000","last_peered":"2024-05-08T20:55:27.579958+0000","last_clean":"2024-05-08T20:55:27.579958+0000","last_became_active":"2024-05-08T20:27:27.981673+0000","last_became_peered":"2024-05-08T20:27:27.981673+0000","last_unstale":"2024-05-08T20:55:27.579958+0000","last_undegraded":"2024-05-08T20:55:27.579958+0000","last_fullsized":"2024-05-08T20:55:27.579958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4309","last_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_deep_scrub":"26'4309","last_deep_scrub_stamp":"2024-05-08T20:55:27.579920+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.579920+0000","objects_scrubbed":0,"log_size":4309,"log_dups_size":0,"ondisk_log_size":4309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:08.630417+0000","scrub_duration":0.096292584000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23774,"num_write_kb":291930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'6836","reported_seq":6877,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:20.661513+0000","last_change":"2024-05-08T20:55:20.661789+0000","last_active":"2024-05-08T20:55:20.661513+0000","last_peered":"2024-05-08T20:55:20.661513+0000","last_clean":"2024-05-08T20:55:20.661513+0000","last_became_active":"2024-05-08T20:27:18.884453+0000","last_became_peered":"2024-05-08T20:27:18.884453+0000","last_unstale":"2024-05-08T20:55:20.661513+0000","last_undegraded":"2024-05-08T20:55:20.661513+0000","last_fullsized":"2024-05-08T20:55:20.661513+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6836","last_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_deep_scrub":"26'6836","last_deep_scrub_stamp":"2024-05-08T20:55:20.661466+0000","last_clean_scrub_stamp":"2024-05-08T20:55:20.661466+0000","objects_scrubbed":0,"log_size":5836,"log_dups_size":0,"ondisk_log_size":5836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:16.019245+0000","scrub_duration":0.046721182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36166,"num_write_kb":395076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.679878+0000","last_change":"2024-05-08T20:55:35.680097+0000","last_active":"2024-05-08T20:55:35.679878+0000","last_peered":"2024-05-08T20:55:35.679878+0000","last_clean":"2024-05-08T20:55:35.679878+0000","last_became_active":"2024-05-08T20:27:18.527703+0000","last_became_peered":"2024-05-08T20:27:18.527703+0000","last_unstale":"2024-05-08T20:55:35.679878+0000","last_undegraded":"2024-05-08T20:55:35.679878+0000","last_fullsized":"2024-05-08T20:55:35.679878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:35.679823+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.679823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:18.016597+0000","scrub_duration":0.0038273439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.016256+0000","last_change":"2024-05-08T20:55:07.016519+0000","last_active":"2024-05-08T20:55:07.016256+0000","last_peered":"2024-05-08T20:55:07.016256+0000","last_clean":"2024-05-08T20:55:07.016256+0000","last_became_active":"2024-05-08T20:27:27.611151+0000","last_became_peered":"2024-05-08T20:27:27.611151+0000","last_unstale":"2024-05-08T20:55:07.016256+0000","last_undegraded":"2024-05-08T20:55:07.016256+0000","last_fullsized":"2024-05-08T20:55:07.016256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:07.016198+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.016198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:21.537191+0000","scrub_duration":0.034043589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4623","reported_seq":4660,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.044003+0000","last_change":"2024-05-08T20:55:18.044138+0000","last_active":"2024-05-08T20:55:18.044003+0000","last_peered":"2024-05-08T20:55:18.044003+0000","last_clean":"2024-05-08T20:55:18.044003+0000","last_became_active":"2024-05-08T20:27:27.981685+0000","last_became_peered":"2024-05-08T20:27:27.981685+0000","last_unstale":"2024-05-08T20:55:18.044003+0000","last_undegraded":"2024-05-08T20:55:18.044003+0000","last_fullsized":"2024-05-08T20:55:18.044003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4623","last_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_deep_scrub":"26'4623","last_deep_scrub_stamp":"2024-05-08T20:55:18.043977+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.043977+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:18.907698+0000","scrub_duration":0.113151719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25767,"num_write_kb":320390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'4622","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.149350+0000","last_change":"2024-05-08T20:54:50.149623+0000","last_active":"2024-05-08T20:54:50.149350+0000","last_peered":"2024-05-08T20:54:50.149350+0000","last_clean":"2024-05-08T20:54:50.149350+0000","last_became_active":"2024-05-08T20:27:18.928990+0000","last_became_peered":"2024-05-08T20:27:18.928990+0000","last_unstale":"2024-05-08T20:54:50.149350+0000","last_undegraded":"2024-05-08T20:54:50.149350+0000","last_fullsized":"2024-05-08T20:54:50.149350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4622","last_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_deep_scrub":"26'4622","last_deep_scrub_stamp":"2024-05-08T20:54:50.149296+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.149296+0000","objects_scrubbed":0,"log_size":4622,"log_dups_size":0,"ondisk_log_size":4622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:43.672383+0000","scrub_duration":0.028645501,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":279742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'2","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.677449+0000","last_change":"2024-05-08T20:55:09.677733+0000","last_active":"2024-05-08T20:55:09.677449+0000","last_peered":"2024-05-08T20:55:09.677449+0000","last_clean":"2024-05-08T20:55:09.677449+0000","last_became_active":"2024-05-08T20:27:18.506103+0000","last_became_peered":"2024-05-08T20:27:18.506103+0000","last_unstale":"2024-05-08T20:55:09.677449+0000","last_undegraded":"2024-05-08T20:55:09.677449+0000","last_fullsized":"2024-05-08T20:55:09.677449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:09.677387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.677387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:52.277246+0000","scrub_duration":0.0096814850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'4","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.802099+0000","last_change":"2024-05-08T20:54:45.802328+0000","last_active":"2024-05-08T20:54:45.802099+0000","last_peered":"2024-05-08T20:54:45.802099+0000","last_clean":"2024-05-08T20:54:45.802099+0000","last_became_active":"2024-05-08T20:27:27.611743+0000","last_became_peered":"2024-05-08T20:27:27.611743+0000","last_unstale":"2024-05-08T20:54:45.802099+0000","last_undegraded":"2024-05-08T20:54:45.802099+0000","last_fullsized":"2024-05-08T20:54:45.802099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:54:45.802044+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.802044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:29.693595+0000","scrub_duration":0.0040510620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'4079","reported_seq":4116,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.092766+0000","last_change":"2024-05-08T20:55:22.093023+0000","last_active":"2024-05-08T20:55:22.092766+0000","last_peered":"2024-05-08T20:55:22.092766+0000","last_clean":"2024-05-08T20:55:22.092766+0000","last_became_active":"2024-05-08T20:27:27.974353+0000","last_became_peered":"2024-05-08T20:27:27.974353+0000","last_unstale":"2024-05-08T20:55:22.092766+0000","last_undegraded":"2024-05-08T20:55:22.092766+0000","last_fullsized":"2024-05-08T20:55:22.092766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4079","last_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_deep_scrub":"26'4079","last_deep_scrub_stamp":"2024-05-08T20:55:22.092719+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.092719+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:36.160004+0000","scrub_duration":0.119144502,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23420,"num_write_kb":274266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'5879","reported_seq":5920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.951072+0000","last_change":"2024-05-08T20:55:15.951284+0000","last_active":"2024-05-08T20:55:15.951072+0000","last_peered":"2024-05-08T20:55:15.951072+0000","last_clean":"2024-05-08T20:55:15.951072+0000","last_became_active":"2024-05-08T20:27:18.910629+0000","last_became_peered":"2024-05-08T20:27:18.910629+0000","last_unstale":"2024-05-08T20:55:15.951072+0000","last_undegraded":"2024-05-08T20:55:15.951072+0000","last_fullsized":"2024-05-08T20:55:15.951072+0000","mapping_epoch":18,"log_start":"26'400","ondisk_log_start":"26'400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5879","last_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_deep_scrub":"26'5879","last_deep_scrub_stamp":"2024-05-08T20:55:15.951022+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.951022+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:30.374831+0000","scrub_duration":0.045408759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31173,"num_write_kb":342254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'4","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.176230+0000","last_change":"2024-05-08T20:55:29.176471+0000","last_active":"2024-05-08T20:55:29.176230+0000","last_peered":"2024-05-08T20:55:29.176230+0000","last_clean":"2024-05-08T20:55:29.176230+0000","last_became_active":"2024-05-08T20:27:18.519991+0000","last_became_peered":"2024-05-08T20:27:18.519991+0000","last_unstale":"2024-05-08T20:55:29.176230+0000","last_undegraded":"2024-05-08T20:55:29.176230+0000","last_fullsized":"2024-05-08T20:55:29.176230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-05-08T20:55:29.176178+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.176178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:58.118118+0000","scrub_duration":0.0061181179999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.723537+0000","last_change":"2024-05-08T20:54:43.723653+0000","last_active":"2024-05-08T20:54:43.723537+0000","last_peered":"2024-05-08T20:54:43.723537+0000","last_clean":"2024-05-08T20:54:43.723537+0000","last_became_active":"2024-05-08T20:27:27.596081+0000","last_became_peered":"2024-05-08T20:27:27.596081+0000","last_unstale":"2024-05-08T20:54:43.723537+0000","last_undegraded":"2024-05-08T20:54:43.723537+0000","last_fullsized":"2024-05-08T20:54:43.723537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:43.723507+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.723507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:06.949102+0000","scrub_duration":0.001729041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'4667","reported_seq":4704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.506331+0000","last_change":"2024-05-08T20:55:06.506331+0000","last_active":"2024-05-08T20:55:06.506331+0000","last_peered":"2024-05-08T20:55:06.506331+0000","last_clean":"2024-05-08T20:55:06.506331+0000","last_became_active":"2024-05-08T20:27:27.995488+0000","last_became_peered":"2024-05-08T20:27:27.995488+0000","last_unstale":"2024-05-08T20:55:06.506331+0000","last_undegraded":"2024-05-08T20:55:06.506331+0000","last_fullsized":"2024-05-08T20:55:06.506331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4667","last_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_deep_scrub":"26'4667","last_deep_scrub_stamp":"2024-05-08T20:55:06.506041+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.506041+0000","objects_scrubbed":0,"log_size":4667,"log_dups_size":0,"ondisk_log_size":4667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:14.298193+0000","scrub_duration":0.090320424999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25284,"num_write_kb":326555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'4755","reported_seq":4797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.609510+0000","last_change":"2024-05-08T20:55:17.609510+0000","last_active":"2024-05-08T20:55:17.609510+0000","last_peered":"2024-05-08T20:55:17.609510+0000","last_clean":"2024-05-08T20:55:17.609510+0000","last_became_active":"2024-05-08T20:27:18.883764+0000","last_became_peered":"2024-05-08T20:27:18.883764+0000","last_unstale":"2024-05-08T20:55:17.609510+0000","last_undegraded":"2024-05-08T20:55:17.609510+0000","last_fullsized":"2024-05-08T20:55:17.609510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4755","last_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_deep_scrub":"26'4755","last_deep_scrub_stamp":"2024-05-08T20:55:17.609211+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.609211+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:01.114442+0000","scrub_duration":0.021058222000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25365,"num_write_kb":265632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'73","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.584883+0000","last_change":"2024-05-08T20:54:47.585094+0000","last_active":"2024-05-08T20:54:47.584883+0000","last_peered":"2024-05-08T20:54:47.584883+0000","last_clean":"2024-05-08T20:54:47.584883+0000","last_became_active":"2024-05-08T20:27:18.512689+0000","last_became_peered":"2024-05-08T20:27:18.512689+0000","last_unstale":"2024-05-08T20:54:47.584883+0000","last_undegraded":"2024-05-08T20:54:47.584883+0000","last_fullsized":"2024-05-08T20:54:47.584883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-05-08T20:54:47.584829+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.584829+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:57.762899+0000","scrub_duration":0.021519024000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84545,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":69,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'10","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.758169+0000","last_change":"2024-05-08T20:54:48.758169+0000","last_active":"2024-05-08T20:54:48.758169+0000","last_peered":"2024-05-08T20:54:48.758169+0000","last_clean":"2024-05-08T20:54:48.758169+0000","last_became_active":"2024-05-08T20:27:27.611846+0000","last_became_peered":"2024-05-08T20:27:27.611846+0000","last_unstale":"2024-05-08T20:54:48.758169+0000","last_undegraded":"2024-05-08T20:54:48.758169+0000","last_fullsized":"2024-05-08T20:54:48.758169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-05-08T20:54:48.757894+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.757894+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:28.411623+0000","scrub_duration":0.026700504999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'3628","reported_seq":3665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:46.186137+0000","last_change":"2024-05-08T20:55:46.186386+0000","last_active":"2024-05-08T20:55:46.186137+0000","last_peered":"2024-05-08T20:55:46.186137+0000","last_clean":"2024-05-08T20:55:46.186137+0000","last_became_active":"2024-05-08T20:27:27.994715+0000","last_became_peered":"2024-05-08T20:27:27.994715+0000","last_unstale":"2024-05-08T20:55:46.186137+0000","last_undegraded":"2024-05-08T20:55:46.186137+0000","last_fullsized":"2024-05-08T20:55:46.186137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3628","last_scrub_stamp":"2024-05-08T20:55:46.186083+0000","last_deep_scrub":"26'3628","last_deep_scrub_stamp":"2024-05-08T20:55:46.186083+0000","last_clean_scrub_stamp":"2024-05-08T20:55:46.186083+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:34.901845+0000","scrub_duration":0.039027459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20287,"num_write_kb":253411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4967","reported_seq":5008,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.005590+0000","last_change":"2024-05-08T20:54:55.005875+0000","last_active":"2024-05-08T20:54:55.005590+0000","last_peered":"2024-05-08T20:54:55.005590+0000","last_clean":"2024-05-08T20:54:55.005590+0000","last_became_active":"2024-05-08T20:27:18.907376+0000","last_became_peered":"2024-05-08T20:27:18.907376+0000","last_unstale":"2024-05-08T20:54:55.005590+0000","last_undegraded":"2024-05-08T20:54:55.005590+0000","last_fullsized":"2024-05-08T20:54:55.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4967","last_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_deep_scrub":"26'4967","last_deep_scrub_stamp":"2024-05-08T20:54:55.005533+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.005533+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:32.459770+0000","scrub_duration":0.055935091999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26519,"num_write_kb":282516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'7","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.647597+0000","last_change":"2024-05-08T20:55:37.647809+0000","last_active":"2024-05-08T20:55:37.647597+0000","last_peered":"2024-05-08T20:55:37.647597+0000","last_clean":"2024-05-08T20:55:37.647597+0000","last_became_active":"2024-05-08T20:27:18.521353+0000","last_became_peered":"2024-05-08T20:27:18.521353+0000","last_unstale":"2024-05-08T20:55:37.647597+0000","last_undegraded":"2024-05-08T20:55:37.647597+0000","last_fullsized":"2024-05-08T20:55:37.647597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:37.647540+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.647540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:23.038617+0000","scrub_duration":0.0036765499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'277","reported_seq":315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.959319+0000","last_change":"2024-05-08T20:55:07.959319+0000","last_active":"2024-05-08T20:55:07.959319+0000","last_peered":"2024-05-08T20:55:07.959319+0000","last_clean":"2024-05-08T20:55:07.959319+0000","last_became_active":"2024-05-08T20:27:27.597545+0000","last_became_peered":"2024-05-08T20:27:27.597545+0000","last_unstale":"2024-05-08T20:55:07.959319+0000","last_undegraded":"2024-05-08T20:55:07.959319+0000","last_fullsized":"2024-05-08T20:55:07.959319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-05-08T20:55:07.959046+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.959046+0000","objects_scrubbed":1,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:19.805541+0000","scrub_duration":0.0082517920000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'5479","reported_seq":5516,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:03.801127+0000","last_change":"2024-05-08T20:56:03.801382+0000","last_active":"2024-05-08T20:56:03.801127+0000","last_peered":"2024-05-08T20:56:03.801127+0000","last_clean":"2024-05-08T20:56:03.801127+0000","last_became_active":"2024-05-08T20:27:27.993776+0000","last_became_peered":"2024-05-08T20:27:27.993776+0000","last_unstale":"2024-05-08T20:56:03.801127+0000","last_undegraded":"2024-05-08T20:56:03.801127+0000","last_fullsized":"2024-05-08T20:56:03.801127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5479","last_scrub_stamp":"2024-05-08T20:56:03.801073+0000","last_deep_scrub":"26'5479","last_deep_scrub_stamp":"2024-05-08T20:56:03.801073+0000","last_clean_scrub_stamp":"2024-05-08T20:56:03.801073+0000","objects_scrubbed":0,"log_size":5479,"log_dups_size":0,"ondisk_log_size":5479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:40.218781+0000","scrub_duration":0.072488915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30361,"num_write_kb":371740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'5070","reported_seq":5111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.390992+0000","last_change":"2024-05-08T20:55:27.391236+0000","last_active":"2024-05-08T20:55:27.390992+0000","last_peered":"2024-05-08T20:55:27.390992+0000","last_clean":"2024-05-08T20:55:27.390992+0000","last_became_active":"2024-05-08T20:27:18.928354+0000","last_became_peered":"2024-05-08T20:27:18.928354+0000","last_unstale":"2024-05-08T20:55:27.390992+0000","last_undegraded":"2024-05-08T20:55:27.390992+0000","last_fullsized":"2024-05-08T20:55:27.390992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5070","last_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_deep_scrub":"26'5070","last_deep_scrub_stamp":"2024-05-08T20:55:27.390937+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.390937+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:54.672683+0000","scrub_duration":0.014365846999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26323,"num_write_kb":302218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:30.183366+0000","last_change":"2024-05-08T20:55:30.183602+0000","last_active":"2024-05-08T20:55:30.183366+0000","last_peered":"2024-05-08T20:55:30.183366+0000","last_clean":"2024-05-08T20:55:30.183366+0000","last_became_active":"2024-05-08T20:27:18.521755+0000","last_became_peered":"2024-05-08T20:27:18.521755+0000","last_unstale":"2024-05-08T20:55:30.183366+0000","last_undegraded":"2024-05-08T20:55:30.183366+0000","last_fullsized":"2024-05-08T20:55:30.183366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:30.183311+0000","last_clean_scrub_stamp":"2024-05-08T20:55:30.183311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:37.269932+0000","scrub_duration":0.010531156999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":198,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:29.799061+0000","last_change":"2024-05-08T20:55:29.799301+0000","last_active":"2024-05-08T20:55:29.799061+0000","last_peered":"2024-05-08T20:55:29.799061+0000","last_clean":"2024-05-08T20:55:29.799061+0000","last_became_active":"2024-05-08T20:27:08.441487+0000","last_became_peered":"2024-05-08T20:27:08.441487+0000","last_unstale":"2024-05-08T20:55:29.799061+0000","last_undegraded":"2024-05-08T20:55:29.799061+0000","last_fullsized":"2024-05-08T20:55:29.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-05-08T20:55:29.799005+0000","last_clean_scrub_stamp":"2024-05-08T20:55:29.799005+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:26.004174+0000","scrub_duration":0.010450918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.523201+0000","last_change":"2024-05-08T20:55:17.523419+0000","last_active":"2024-05-08T20:55:17.523201+0000","last_peered":"2024-05-08T20:55:17.523201+0000","last_clean":"2024-05-08T20:55:17.523201+0000","last_became_active":"2024-05-08T20:27:27.620295+0000","last_became_peered":"2024-05-08T20:27:27.620295+0000","last_unstale":"2024-05-08T20:55:17.523201+0000","last_undegraded":"2024-05-08T20:55:17.523201+0000","last_fullsized":"2024-05-08T20:55:17.523201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:17.523147+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.523147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:26.971511+0000","scrub_duration":0.0037874789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3754","reported_seq":3790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.561694+0000","last_change":"2024-05-08T20:55:09.561956+0000","last_active":"2024-05-08T20:55:09.561694+0000","last_peered":"2024-05-08T20:55:09.561694+0000","last_clean":"2024-05-08T20:55:09.561694+0000","last_became_active":"2024-05-08T20:27:27.979368+0000","last_became_peered":"2024-05-08T20:27:27.979368+0000","last_unstale":"2024-05-08T20:55:09.561694+0000","last_undegraded":"2024-05-08T20:55:09.561694+0000","last_fullsized":"2024-05-08T20:55:09.561694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3754","last_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_deep_scrub":"26'3754","last_deep_scrub_stamp":"2024-05-08T20:55:09.561619+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.561619+0000","objects_scrubbed":0,"log_size":3754,"log_dups_size":0,"ondisk_log_size":3754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.309817+0000","scrub_duration":0.072311814000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20370,"num_write_kb":253786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'5554","reported_seq":5594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.675660+0000","last_change":"2024-05-08T20:54:59.675908+0000","last_active":"2024-05-08T20:54:59.675660+0000","last_peered":"2024-05-08T20:54:59.675660+0000","last_clean":"2024-05-08T20:54:59.675660+0000","last_became_active":"2024-05-08T20:27:18.932550+0000","last_became_peered":"2024-05-08T20:27:18.932550+0000","last_unstale":"2024-05-08T20:54:59.675660+0000","last_undegraded":"2024-05-08T20:54:59.675660+0000","last_fullsized":"2024-05-08T20:54:59.675660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5554","last_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_deep_scrub":"26'5554","last_deep_scrub_stamp":"2024-05-08T20:54:59.675603+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.675603+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:25.048100+0000","scrub_duration":0.019361314000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29328,"num_write_kb":330655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.490516+0000","last_change":"2024-05-08T20:54:54.490784+0000","last_active":"2024-05-08T20:54:54.490516+0000","last_peered":"2024-05-08T20:54:54.490516+0000","last_clean":"2024-05-08T20:54:54.490516+0000","last_became_active":"2024-05-08T20:27:18.528497+0000","last_became_peered":"2024-05-08T20:27:18.528497+0000","last_unstale":"2024-05-08T20:54:54.490516+0000","last_undegraded":"2024-05-08T20:54:54.490516+0000","last_fullsized":"2024-05-08T20:54:54.490516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:54.490464+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.490464+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:32.933174+0000","scrub_duration":0.0037125420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'3","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.537068+0000","last_change":"2024-05-08T20:55:11.537068+0000","last_active":"2024-05-08T20:55:11.537068+0000","last_peered":"2024-05-08T20:55:11.537068+0000","last_clean":"2024-05-08T20:55:11.537068+0000","last_became_active":"2024-05-08T20:27:27.604924+0000","last_became_peered":"2024-05-08T20:27:27.604924+0000","last_unstale":"2024-05-08T20:55:11.537068+0000","last_undegraded":"2024-05-08T20:55:11.537068+0000","last_fullsized":"2024-05-08T20:55:11.537068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:11.536797+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.536797+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:00.377575+0000","scrub_duration":0.0033698030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'4012","reported_seq":4049,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.521421+0000","last_change":"2024-05-08T20:55:07.521421+0000","last_active":"2024-05-08T20:55:07.521421+0000","last_peered":"2024-05-08T20:55:07.521421+0000","last_clean":"2024-05-08T20:55:07.521421+0000","last_became_active":"2024-05-08T20:27:28.010543+0000","last_became_peered":"2024-05-08T20:27:28.010543+0000","last_unstale":"2024-05-08T20:55:07.521421+0000","last_undegraded":"2024-05-08T20:55:07.521421+0000","last_fullsized":"2024-05-08T20:55:07.521421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4012","last_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_deep_scrub":"26'4012","last_deep_scrub_stamp":"2024-05-08T20:55:07.521110+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.521110+0000","objects_scrubbed":0,"log_size":4012,"log_dups_size":0,"ondisk_log_size":4012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:03.444633+0000","scrub_duration":0.063926325000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22426,"num_write_kb":294714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'5601","reported_seq":5635,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.501804+0000","last_change":"2024-05-08T20:55:16.502074+0000","last_active":"2024-05-08T20:55:16.501804+0000","last_peered":"2024-05-08T20:55:16.501804+0000","last_clean":"2024-05-08T20:55:16.501804+0000","last_became_active":"2024-05-08T20:28:00.413881+0000","last_became_peered":"2024-05-08T20:28:00.413881+0000","last_unstale":"2024-05-08T20:55:16.501804+0000","last_undegraded":"2024-05-08T20:55:16.501804+0000","last_fullsized":"2024-05-08T20:55:16.501804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5601","last_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_deep_scrub":"26'5601","last_deep_scrub_stamp":"2024-05-08T20:55:16.501744+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.501744+0000","objects_scrubbed":0,"log_size":5601,"log_dups_size":0,"ondisk_log_size":5601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:01:36.883976+0000","scrub_duration":0.012783813,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29013,"num_write_kb":325338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"26'7","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:12.704523+0000","last_change":"2024-05-08T20:55:12.704754+0000","last_active":"2024-05-08T20:55:12.704523+0000","last_peered":"2024-05-08T20:55:12.704523+0000","last_clean":"2024-05-08T20:55:12.704523+0000","last_became_active":"2024-05-08T20:27:18.540403+0000","last_became_peered":"2024-05-08T20:27:18.540403+0000","last_unstale":"2024-05-08T20:55:12.704523+0000","last_undegraded":"2024-05-08T20:55:12.704523+0000","last_fullsized":"2024-05-08T20:55:12.704523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-05-08T20:55:12.704463+0000","last_clean_scrub_stamp":"2024-05-08T20:55:12.704463+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:16.190314+0000","scrub_duration":0.023886415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'1138","reported_seq":1175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.063954+0000","last_change":"2024-05-08T20:55:09.064235+0000","last_active":"2024-05-08T20:55:09.063954+0000","last_peered":"2024-05-08T20:55:09.063954+0000","last_clean":"2024-05-08T20:55:09.063954+0000","last_became_active":"2024-05-08T20:27:27.597471+0000","last_became_peered":"2024-05-08T20:27:27.597471+0000","last_unstale":"2024-05-08T20:55:09.063954+0000","last_undegraded":"2024-05-08T20:55:09.063954+0000","last_fullsized":"2024-05-08T20:55:09.063954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1138","last_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_deep_scrub":"26'1138","last_deep_scrub_stamp":"2024-05-08T20:55:09.063899+0000","last_clean_scrub_stamp":"2024-05-08T20:55:09.063899+0000","objects_scrubbed":2,"log_size":1138,"log_dups_size":0,"ondisk_log_size":1138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:52.567416+0000","scrub_duration":0.080673476999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1130,"num_write_kb":4393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'3833","reported_seq":3870,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:57.741612+0000","last_change":"2024-05-08T20:55:57.741864+0000","last_active":"2024-05-08T20:55:57.741612+0000","last_peered":"2024-05-08T20:55:57.741612+0000","last_clean":"2024-05-08T20:55:57.741612+0000","last_became_active":"2024-05-08T20:27:27.995021+0000","last_became_peered":"2024-05-08T20:27:27.995021+0000","last_unstale":"2024-05-08T20:55:57.741612+0000","last_undegraded":"2024-05-08T20:55:57.741612+0000","last_fullsized":"2024-05-08T20:55:57.741612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3833","last_scrub_stamp":"2024-05-08T20:55:57.741553+0000","last_deep_scrub":"26'3833","last_deep_scrub_stamp":"2024-05-08T20:55:57.741553+0000","last_clean_scrub_stamp":"2024-05-08T20:55:57.741553+0000","objects_scrubbed":0,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:47.452983+0000","scrub_duration":0.063092123999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21178,"num_write_kb":269322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'7221","reported_seq":7261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:24.820930+0000","last_change":"2024-05-08T20:55:24.821157+0000","last_active":"2024-05-08T20:55:24.820930+0000","last_peered":"2024-05-08T20:55:24.820930+0000","last_clean":"2024-05-08T20:55:24.820930+0000","last_became_active":"2024-05-08T20:27:18.921785+0000","last_became_peered":"2024-05-08T20:27:18.921785+0000","last_unstale":"2024-05-08T20:55:24.820930+0000","last_undegraded":"2024-05-08T20:55:24.820930+0000","last_fullsized":"2024-05-08T20:55:24.820930+0000","mapping_epoch":18,"log_start":"26'1500","ondisk_log_start":"26'1500","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7221","last_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_deep_scrub":"26'7221","last_deep_scrub_stamp":"2024-05-08T20:55:24.820875+0000","last_clean_scrub_stamp":"2024-05-08T20:55:24.820875+0000","objects_scrubbed":0,"log_size":5721,"log_dups_size":0,"ondisk_log_size":5721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:12.961351+0000","scrub_duration":0.011508404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37975,"num_write_kb":422722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'8","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.541242+0000","last_change":"2024-05-08T20:54:46.541548+0000","last_active":"2024-05-08T20:54:46.541242+0000","last_peered":"2024-05-08T20:54:46.541242+0000","last_clean":"2024-05-08T20:54:46.541242+0000","last_became_active":"2024-05-08T20:27:18.512735+0000","last_became_peered":"2024-05-08T20:27:18.512735+0000","last_unstale":"2024-05-08T20:54:46.541242+0000","last_undegraded":"2024-05-08T20:54:46.541242+0000","last_fullsized":"2024-05-08T20:54:46.541242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:46.541186+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.541186+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:53.630432+0000","scrub_duration":0.014769915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'5","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:55.201979+0000","last_change":"2024-05-08T20:54:55.201979+0000","last_active":"2024-05-08T20:54:55.201979+0000","last_peered":"2024-05-08T20:54:55.201979+0000","last_clean":"2024-05-08T20:54:55.201979+0000","last_became_active":"2024-05-08T20:27:27.610475+0000","last_became_peered":"2024-05-08T20:27:27.610475+0000","last_unstale":"2024-05-08T20:54:55.201979+0000","last_undegraded":"2024-05-08T20:54:55.201979+0000","last_fullsized":"2024-05-08T20:54:55.201979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:55.201695+0000","last_clean_scrub_stamp":"2024-05-08T20:54:55.201695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:39.510474+0000","scrub_duration":0.0064570130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'3726","reported_seq":3763,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.650155+0000","last_change":"2024-05-08T20:54:45.650155+0000","last_active":"2024-05-08T20:54:45.650155+0000","last_peered":"2024-05-08T20:54:45.650155+0000","last_clean":"2024-05-08T20:54:45.650155+0000","last_became_active":"2024-05-08T20:27:27.979331+0000","last_became_peered":"2024-05-08T20:27:27.979331+0000","last_unstale":"2024-05-08T20:54:45.650155+0000","last_undegraded":"2024-05-08T20:54:45.650155+0000","last_fullsized":"2024-05-08T20:54:45.650155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3726","last_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_deep_scrub":"26'3726","last_deep_scrub_stamp":"2024-05-08T20:54:45.649980+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.649980+0000","objects_scrubbed":0,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:59.522800+0000","scrub_duration":0.11612742700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21183,"num_write_kb":269250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4502","reported_seq":4542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.738096+0000","last_change":"2024-05-08T20:55:21.738325+0000","last_active":"2024-05-08T20:55:21.738096+0000","last_peered":"2024-05-08T20:55:21.738096+0000","last_clean":"2024-05-08T20:55:21.738096+0000","last_became_active":"2024-05-08T20:27:18.920279+0000","last_became_peered":"2024-05-08T20:27:18.920279+0000","last_unstale":"2024-05-08T20:55:21.738096+0000","last_undegraded":"2024-05-08T20:55:21.738096+0000","last_fullsized":"2024-05-08T20:55:21.738096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4502","last_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_deep_scrub":"26'4502","last_deep_scrub_stamp":"2024-05-08T20:55:21.738039+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.738039+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:43.638169+0000","scrub_duration":0.011148622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23112,"num_write_kb":260604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.196680+0000","last_change":"2024-05-08T20:55:03.196899+0000","last_active":"2024-05-08T20:55:03.196680+0000","last_peered":"2024-05-08T20:55:03.196680+0000","last_clean":"2024-05-08T20:55:03.196680+0000","last_became_active":"2024-05-08T20:27:18.540087+0000","last_became_peered":"2024-05-08T20:27:18.540087+0000","last_unstale":"2024-05-08T20:55:03.196680+0000","last_undegraded":"2024-05-08T20:55:03.196680+0000","last_fullsized":"2024-05-08T20:55:03.196680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:03.196622+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.196622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:49.285017+0000","scrub_duration":0.017642686000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.240489+0000","last_change":"2024-05-08T20:54:48.240489+0000","last_active":"2024-05-08T20:54:48.240489+0000","last_peered":"2024-05-08T20:54:48.240489+0000","last_clean":"2024-05-08T20:54:48.240489+0000","last_became_active":"2024-05-08T20:27:27.619157+0000","last_became_peered":"2024-05-08T20:27:27.619157+0000","last_unstale":"2024-05-08T20:54:48.240489+0000","last_undegraded":"2024-05-08T20:54:48.240489+0000","last_fullsized":"2024-05-08T20:54:48.240489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:54:48.240164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.240164+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:57.651499+0000","scrub_duration":0.0039283549999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'4490","reported_seq":4525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.503104+0000","last_change":"2024-05-08T20:55:47.503330+0000","last_active":"2024-05-08T20:55:47.503104+0000","last_peered":"2024-05-08T20:55:47.503104+0000","last_clean":"2024-05-08T20:55:47.503104+0000","last_became_active":"2024-05-08T20:27:27.984068+0000","last_became_peered":"2024-05-08T20:27:27.984068+0000","last_unstale":"2024-05-08T20:55:47.503104+0000","last_undegraded":"2024-05-08T20:55:47.503104+0000","last_fullsized":"2024-05-08T20:55:47.503104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4490","last_scrub_stamp":"2024-05-08T20:55:47.503047+0000","last_deep_scrub":"26'4490","last_deep_scrub_stamp":"2024-05-08T20:55:47.503047+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.503047+0000","objects_scrubbed":0,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:29.437257+0000","scrub_duration":0.036698586999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24055,"num_write_kb":305497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'4877","reported_seq":4917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:00.644023+0000","last_change":"2024-05-08T20:55:00.644023+0000","last_active":"2024-05-08T20:55:00.644023+0000","last_peered":"2024-05-08T20:55:00.644023+0000","last_clean":"2024-05-08T20:55:00.644023+0000","last_became_active":"2024-05-08T20:27:18.917713+0000","last_became_peered":"2024-05-08T20:27:18.917713+0000","last_unstale":"2024-05-08T20:55:00.644023+0000","last_undegraded":"2024-05-08T20:55:00.644023+0000","last_fullsized":"2024-05-08T20:55:00.644023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4877","last_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_deep_scrub":"26'4877","last_deep_scrub_stamp":"2024-05-08T20:55:00.643679+0000","last_clean_scrub_stamp":"2024-05-08T20:55:00.643679+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:46.199456+0000","scrub_duration":0.018174326000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26822,"num_write_kb":271635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'19","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.552614+0000","last_change":"2024-05-08T20:54:56.552614+0000","last_active":"2024-05-08T20:54:56.552614+0000","last_peered":"2024-05-08T20:54:56.552614+0000","last_clean":"2024-05-08T20:54:56.552614+0000","last_became_active":"2024-05-08T20:27:18.506714+0000","last_became_peered":"2024-05-08T20:27:18.506714+0000","last_unstale":"2024-05-08T20:54:56.552614+0000","last_undegraded":"2024-05-08T20:54:56.552614+0000","last_fullsized":"2024-05-08T20:54:56.552614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:56.552316+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.552316+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:38.919551+0000","scrub_duration":0.016343099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.950947+0000","last_change":"2024-05-08T20:54:43.951036+0000","last_active":"2024-05-08T20:54:43.950947+0000","last_peered":"2024-05-08T20:54:43.950947+0000","last_clean":"2024-05-08T20:54:43.950947+0000","last_became_active":"2024-05-08T20:27:27.604705+0000","last_became_peered":"2024-05-08T20:27:27.604705+0000","last_unstale":"2024-05-08T20:54:43.950947+0000","last_undegraded":"2024-05-08T20:54:43.950947+0000","last_fullsized":"2024-05-08T20:54:43.950947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:43.950926+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.950926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:21.719335+0000","scrub_duration":0.0015213539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4830","reported_seq":4865,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:54.204200+0000","last_change":"2024-05-08T20:55:54.204477+0000","last_active":"2024-05-08T20:55:54.204200+0000","last_peered":"2024-05-08T20:55:54.204200+0000","last_clean":"2024-05-08T20:55:54.204200+0000","last_became_active":"2024-05-08T20:27:27.994932+0000","last_became_peered":"2024-05-08T20:27:27.994932+0000","last_unstale":"2024-05-08T20:55:54.204200+0000","last_undegraded":"2024-05-08T20:55:54.204200+0000","last_fullsized":"2024-05-08T20:55:54.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4830","last_scrub_stamp":"2024-05-08T20:55:54.204146+0000","last_deep_scrub":"26'4830","last_deep_scrub_stamp":"2024-05-08T20:55:54.204146+0000","last_clean_scrub_stamp":"2024-05-08T20:55:54.204146+0000","objects_scrubbed":0,"log_size":4830,"log_dups_size":0,"ondisk_log_size":4830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:33.593568+0000","scrub_duration":0.033220448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":329049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4806","reported_seq":4846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.624126+0000","last_change":"2024-05-08T20:55:05.624126+0000","last_active":"2024-05-08T20:55:05.624126+0000","last_peered":"2024-05-08T20:55:05.624126+0000","last_clean":"2024-05-08T20:55:05.624126+0000","last_became_active":"2024-05-08T20:27:18.898968+0000","last_became_peered":"2024-05-08T20:27:18.898968+0000","last_unstale":"2024-05-08T20:55:05.624126+0000","last_undegraded":"2024-05-08T20:55:05.624126+0000","last_fullsized":"2024-05-08T20:55:05.624126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4806","last_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_deep_scrub":"26'4806","last_deep_scrub_stamp":"2024-05-08T20:55:05.623784+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.623784+0000","objects_scrubbed":0,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:05.299562+0000","scrub_duration":0.050542888000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25162,"num_write_kb":281249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:53.472321+0000","last_change":"2024-05-08T20:54:53.472321+0000","last_active":"2024-05-08T20:54:53.472321+0000","last_peered":"2024-05-08T20:54:53.472321+0000","last_clean":"2024-05-08T20:54:53.472321+0000","last_became_active":"2024-05-08T20:27:18.541596+0000","last_became_peered":"2024-05-08T20:27:18.541596+0000","last_unstale":"2024-05-08T20:54:53.472321+0000","last_undegraded":"2024-05-08T20:54:53.472321+0000","last_fullsized":"2024-05-08T20:54:53.472321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:54:53.472031+0000","last_clean_scrub_stamp":"2024-05-08T20:54:53.472031+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:36.420711+0000","scrub_duration":0.0032315270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'3","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.416742+0000","last_change":"2024-05-08T20:55:01.416966+0000","last_active":"2024-05-08T20:55:01.416742+0000","last_peered":"2024-05-08T20:55:01.416742+0000","last_clean":"2024-05-08T20:55:01.416742+0000","last_became_active":"2024-05-08T20:27:27.610936+0000","last_became_peered":"2024-05-08T20:27:27.610936+0000","last_unstale":"2024-05-08T20:55:01.416742+0000","last_undegraded":"2024-05-08T20:55:01.416742+0000","last_fullsized":"2024-05-08T20:55:01.416742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:01.416687+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.416687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:50.039785+0000","scrub_duration":0.038290926000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'3384","reported_seq":3419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:45.229736+0000","last_change":"2024-05-08T20:55:45.229979+0000","last_active":"2024-05-08T20:55:45.229736+0000","last_peered":"2024-05-08T20:55:45.229736+0000","last_clean":"2024-05-08T20:55:45.229736+0000","last_became_active":"2024-05-08T20:27:27.997247+0000","last_became_peered":"2024-05-08T20:27:27.997247+0000","last_unstale":"2024-05-08T20:55:45.229736+0000","last_undegraded":"2024-05-08T20:55:45.229736+0000","last_fullsized":"2024-05-08T20:55:45.229736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3384","last_scrub_stamp":"2024-05-08T20:55:45.229683+0000","last_deep_scrub":"26'3384","last_deep_scrub_stamp":"2024-05-08T20:55:45.229683+0000","last_clean_scrub_stamp":"2024-05-08T20:55:45.229683+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:15.927106+0000","scrub_duration":0.068570875000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19286,"num_write_kb":241198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'6053","reported_seq":6093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:50.707881+0000","last_change":"2024-05-08T20:55:50.708193+0000","last_active":"2024-05-08T20:55:50.707881+0000","last_peered":"2024-05-08T20:55:50.707881+0000","last_clean":"2024-05-08T20:55:50.707881+0000","last_became_active":"2024-05-08T20:27:18.921931+0000","last_became_peered":"2024-05-08T20:27:18.921931+0000","last_unstale":"2024-05-08T20:55:50.707881+0000","last_undegraded":"2024-05-08T20:55:50.707881+0000","last_fullsized":"2024-05-08T20:55:50.707881+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6053","last_scrub_stamp":"2024-05-08T20:55:50.707827+0000","last_deep_scrub":"26'6053","last_deep_scrub_stamp":"2024-05-08T20:55:50.707827+0000","last_clean_scrub_stamp":"2024-05-08T20:55:50.707827+0000","objects_scrubbed":0,"log_size":5753,"log_dups_size":0,"ondisk_log_size":5753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:18.842925+0000","scrub_duration":0.015015142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32868,"num_write_kb":336745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.171355+0000","last_change":"2024-05-08T20:55:35.171606+0000","last_active":"2024-05-08T20:55:35.171355+0000","last_peered":"2024-05-08T20:55:35.171355+0000","last_clean":"2024-05-08T20:55:35.171355+0000","last_became_active":"2024-05-08T20:27:18.519291+0000","last_became_peered":"2024-05-08T20:27:18.519291+0000","last_unstale":"2024-05-08T20:55:35.171355+0000","last_undegraded":"2024-05-08T20:55:35.171355+0000","last_fullsized":"2024-05-08T20:55:35.171355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:35.171302+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.171302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:53.218021+0000","scrub_duration":0.0036972229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'392","reported_seq":429,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:43.417411+0000","last_change":"2024-05-08T20:54:43.417411+0000","last_active":"2024-05-08T20:54:43.417411+0000","last_peered":"2024-05-08T20:54:43.417411+0000","last_clean":"2024-05-08T20:54:43.417411+0000","last_became_active":"2024-05-08T20:27:27.603491+0000","last_became_peered":"2024-05-08T20:27:27.603491+0000","last_unstale":"2024-05-08T20:54:43.417411+0000","last_undegraded":"2024-05-08T20:54:43.417411+0000","last_fullsized":"2024-05-08T20:54:43.417411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'392","last_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_deep_scrub":"26'392","last_deep_scrub_stamp":"2024-05-08T20:54:43.417303+0000","last_clean_scrub_stamp":"2024-05-08T20:54:43.417303+0000","objects_scrubbed":4,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:52.047079+0000","scrub_duration":0.016119251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'5309","reported_seq":5345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:35.470587+0000","last_change":"2024-05-08T20:55:35.470865+0000","last_active":"2024-05-08T20:55:35.470587+0000","last_peered":"2024-05-08T20:55:35.470587+0000","last_clean":"2024-05-08T20:55:35.470587+0000","last_became_active":"2024-05-08T20:27:27.993929+0000","last_became_peered":"2024-05-08T20:27:27.993929+0000","last_unstale":"2024-05-08T20:55:35.470587+0000","last_undegraded":"2024-05-08T20:55:35.470587+0000","last_fullsized":"2024-05-08T20:55:35.470587+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5309","last_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_deep_scrub":"26'5309","last_deep_scrub_stamp":"2024-05-08T20:55:35.470527+0000","last_clean_scrub_stamp":"2024-05-08T20:55:35.470527+0000","objects_scrubbed":0,"log_size":5209,"log_dups_size":0,"ondisk_log_size":5209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:48.455547+0000","scrub_duration":0.049539302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28707,"num_write_kb":369022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'4707","reported_seq":4747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.102627+0000","last_change":"2024-05-08T20:54:57.102627+0000","last_active":"2024-05-08T20:54:57.102627+0000","last_peered":"2024-05-08T20:54:57.102627+0000","last_clean":"2024-05-08T20:54:57.102627+0000","last_became_active":"2024-05-08T20:27:18.900926+0000","last_became_peered":"2024-05-08T20:27:18.900926+0000","last_unstale":"2024-05-08T20:54:57.102627+0000","last_undegraded":"2024-05-08T20:54:57.102627+0000","last_fullsized":"2024-05-08T20:54:57.102627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4707","last_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_deep_scrub":"26'4707","last_deep_scrub_stamp":"2024-05-08T20:54:57.102409+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.102409+0000","objects_scrubbed":0,"log_size":4707,"log_dups_size":0,"ondisk_log_size":4707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:04.868854+0000","scrub_duration":0.064899769999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24891,"num_write_kb":280158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.967329+0000","last_change":"2024-05-08T20:54:47.967329+0000","last_active":"2024-05-08T20:54:47.967329+0000","last_peered":"2024-05-08T20:54:47.967329+0000","last_clean":"2024-05-08T20:54:47.967329+0000","last_became_active":"2024-05-08T20:27:18.540501+0000","last_became_peered":"2024-05-08T20:27:18.540501+0000","last_unstale":"2024-05-08T20:54:47.967329+0000","last_undegraded":"2024-05-08T20:54:47.967329+0000","last_fullsized":"2024-05-08T20:54:47.967329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:47.967013+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.967013+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:43.643764+0000","scrub_duration":0.019010636000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'40","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.135142+0000","last_change":"2024-05-08T20:55:01.135433+0000","last_active":"2024-05-08T20:55:01.135142+0000","last_peered":"2024-05-08T20:55:01.135142+0000","last_clean":"2024-05-08T20:55:01.135142+0000","last_became_active":"2024-05-08T20:27:27.619470+0000","last_became_peered":"2024-05-08T20:27:27.619470+0000","last_unstale":"2024-05-08T20:55:01.135142+0000","last_undegraded":"2024-05-08T20:55:01.135142+0000","last_fullsized":"2024-05-08T20:55:01.135142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'40","last_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_deep_scrub":"26'40","last_deep_scrub_stamp":"2024-05-08T20:55:01.135090+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.135090+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:17.529691+0000","scrub_duration":0.017716335999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4311","reported_seq":4347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.359712+0000","last_change":"2024-05-08T20:55:17.359712+0000","last_active":"2024-05-08T20:55:17.359712+0000","last_peered":"2024-05-08T20:55:17.359712+0000","last_clean":"2024-05-08T20:55:17.359712+0000","last_became_active":"2024-05-08T20:27:27.979952+0000","last_became_peered":"2024-05-08T20:27:27.979952+0000","last_unstale":"2024-05-08T20:55:17.359712+0000","last_undegraded":"2024-05-08T20:55:17.359712+0000","last_fullsized":"2024-05-08T20:55:17.359712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4311","last_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_deep_scrub":"26'4311","last_deep_scrub_stamp":"2024-05-08T20:55:17.359387+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.359387+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:10.597732+0000","scrub_duration":0.071380895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23637,"num_write_kb":299661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'4308","reported_seq":4348,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.557627+0000","last_change":"2024-05-08T20:55:04.557627+0000","last_active":"2024-05-08T20:55:04.557627+0000","last_peered":"2024-05-08T20:55:04.557627+0000","last_clean":"2024-05-08T20:55:04.557627+0000","last_became_active":"2024-05-08T20:27:18.914558+0000","last_became_peered":"2024-05-08T20:27:18.914558+0000","last_unstale":"2024-05-08T20:55:04.557627+0000","last_undegraded":"2024-05-08T20:55:04.557627+0000","last_fullsized":"2024-05-08T20:55:04.557627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4308","last_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_deep_scrub":"26'4308","last_deep_scrub_stamp":"2024-05-08T20:55:04.557335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.557335+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:14.404320+0000","scrub_duration":0.013594441000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22877,"num_write_kb":255518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'376","reported_seq":417,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:01.547300+0000","last_change":"2024-05-08T20:55:01.547300+0000","last_active":"2024-05-08T20:55:01.547300+0000","last_peered":"2024-05-08T20:55:01.547300+0000","last_clean":"2024-05-08T20:55:01.547300+0000","last_became_active":"2024-05-08T20:27:18.510532+0000","last_became_peered":"2024-05-08T20:27:18.510532+0000","last_unstale":"2024-05-08T20:55:01.547300+0000","last_undegraded":"2024-05-08T20:55:01.547300+0000","last_fullsized":"2024-05-08T20:55:01.547300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'376","last_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_deep_scrub":"26'376","last_deep_scrub_stamp":"2024-05-08T20:55:01.546976+0000","last_clean_scrub_stamp":"2024-05-08T20:55:01.546976+0000","objects_scrubbed":4,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:51.672058+0000","scrub_duration":0.025240988999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:50.700173+0000","last_change":"2024-05-08T20:54:50.700173+0000","last_active":"2024-05-08T20:54:50.700173+0000","last_peered":"2024-05-08T20:54:50.700173+0000","last_clean":"2024-05-08T20:54:50.700173+0000","last_became_active":"2024-05-08T20:27:27.614654+0000","last_became_peered":"2024-05-08T20:27:27.614654+0000","last_unstale":"2024-05-08T20:54:50.700173+0000","last_undegraded":"2024-05-08T20:54:50.700173+0000","last_fullsized":"2024-05-08T20:54:50.700173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:54:50.699899+0000","last_clean_scrub_stamp":"2024-05-08T20:54:50.699899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:25.302614+0000","scrub_duration":0.003656903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'3942","reported_seq":3978,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:27.777139+0000","last_change":"2024-05-08T20:55:27.777139+0000","last_active":"2024-05-08T20:55:27.777139+0000","last_peered":"2024-05-08T20:55:27.777139+0000","last_clean":"2024-05-08T20:55:27.777139+0000","last_became_active":"2024-05-08T20:27:28.001244+0000","last_became_peered":"2024-05-08T20:27:28.001244+0000","last_unstale":"2024-05-08T20:55:27.777139+0000","last_undegraded":"2024-05-08T20:55:27.777139+0000","last_fullsized":"2024-05-08T20:55:27.777139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3942","last_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_deep_scrub":"26'3942","last_deep_scrub_stamp":"2024-05-08T20:55:27.776997+0000","last_clean_scrub_stamp":"2024-05-08T20:55:27.776997+0000","objects_scrubbed":0,"log_size":3942,"log_dups_size":0,"ondisk_log_size":3942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:31:00.897092+0000","scrub_duration":0.15286592099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22044,"num_write_kb":268658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'6472","reported_seq":6512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.147116+0000","last_change":"2024-05-08T20:55:04.147116+0000","last_active":"2024-05-08T20:55:04.147116+0000","last_peered":"2024-05-08T20:55:04.147116+0000","last_clean":"2024-05-08T20:55:04.147116+0000","last_became_active":"2024-05-08T20:27:18.924579+0000","last_became_peered":"2024-05-08T20:27:18.924579+0000","last_unstale":"2024-05-08T20:55:04.147116+0000","last_undegraded":"2024-05-08T20:55:04.147116+0000","last_fullsized":"2024-05-08T20:55:04.147116+0000","mapping_epoch":18,"log_start":"26'1000","ondisk_log_start":"26'1000","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6472","last_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_deep_scrub":"26'6472","last_deep_scrub_stamp":"2024-05-08T20:55:04.146808+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.146808+0000","objects_scrubbed":0,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:26.755900+0000","scrub_duration":0.015729532000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33904,"num_write_kb":389946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'42","reported_seq":83,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.628190+0000","last_change":"2024-05-08T20:55:16.628190+0000","last_active":"2024-05-08T20:55:16.628190+0000","last_peered":"2024-05-08T20:55:16.628190+0000","last_clean":"2024-05-08T20:55:16.628190+0000","last_became_active":"2024-05-08T20:27:18.526090+0000","last_became_peered":"2024-05-08T20:27:18.526090+0000","last_unstale":"2024-05-08T20:55:16.628190+0000","last_undegraded":"2024-05-08T20:55:16.628190+0000","last_fullsized":"2024-05-08T20:55:16.628190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'42","last_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_deep_scrub":"26'42","last_deep_scrub_stamp":"2024-05-08T20:55:16.627755+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.627755+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:04.126022+0000","scrub_duration":0.018944094000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'9","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.249501+0000","last_change":"2024-05-08T20:54:45.249501+0000","last_active":"2024-05-08T20:54:45.249501+0000","last_peered":"2024-05-08T20:54:45.249501+0000","last_clean":"2024-05-08T20:54:45.249501+0000","last_became_active":"2024-05-08T20:27:27.618855+0000","last_became_peered":"2024-05-08T20:27:27.618855+0000","last_unstale":"2024-05-08T20:54:45.249501+0000","last_undegraded":"2024-05-08T20:54:45.249501+0000","last_fullsized":"2024-05-08T20:54:45.249501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-05-08T20:54:45.249216+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.249216+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:16.617377+0000","scrub_duration":0.021333827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'3366","reported_seq":3402,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.557977+0000","last_change":"2024-05-08T20:55:23.557977+0000","last_active":"2024-05-08T20:55:23.557977+0000","last_peered":"2024-05-08T20:55:23.557977+0000","last_clean":"2024-05-08T20:55:23.557977+0000","last_became_active":"2024-05-08T20:27:28.016076+0000","last_became_peered":"2024-05-08T20:27:28.016076+0000","last_unstale":"2024-05-08T20:55:23.557977+0000","last_undegraded":"2024-05-08T20:55:23.557977+0000","last_fullsized":"2024-05-08T20:55:23.557977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3366","last_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_deep_scrub":"26'3366","last_deep_scrub_stamp":"2024-05-08T20:55:23.557812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.557812+0000","objects_scrubbed":0,"log_size":3366,"log_dups_size":0,"ondisk_log_size":3366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:29.860852+0000","scrub_duration":0.092935954000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18758,"num_write_kb":239043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'5254","reported_seq":5294,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.083125+0000","last_change":"2024-05-08T20:55:05.083125+0000","last_active":"2024-05-08T20:55:05.083125+0000","last_peered":"2024-05-08T20:55:05.083125+0000","last_clean":"2024-05-08T20:55:05.083125+0000","last_became_active":"2024-05-08T20:27:18.929358+0000","last_became_peered":"2024-05-08T20:27:18.929358+0000","last_unstale":"2024-05-08T20:55:05.083125+0000","last_undegraded":"2024-05-08T20:55:05.083125+0000","last_fullsized":"2024-05-08T20:55:05.083125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5254","last_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_deep_scrub":"26'5254","last_deep_scrub_stamp":"2024-05-08T20:55:05.082849+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.082849+0000","objects_scrubbed":0,"log_size":5254,"log_dups_size":0,"ondisk_log_size":5254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:08.613953+0000","scrub_duration":0.046904636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26661,"num_write_kb":315909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:31.191526+0000","last_change":"2024-05-08T20:55:31.191526+0000","last_active":"2024-05-08T20:55:31.191526+0000","last_peered":"2024-05-08T20:55:31.191526+0000","last_clean":"2024-05-08T20:55:31.191526+0000","last_became_active":"2024-05-08T20:27:18.531467+0000","last_became_peered":"2024-05-08T20:27:18.531467+0000","last_unstale":"2024-05-08T20:55:31.191526+0000","last_undegraded":"2024-05-08T20:55:31.191526+0000","last_fullsized":"2024-05-08T20:55:31.191526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:31.191230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:31.191230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:27.565005+0000","scrub_duration":0.003542014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'19","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.395653+0000","last_change":"2024-05-08T20:54:46.395653+0000","last_active":"2024-05-08T20:54:46.395653+0000","last_peered":"2024-05-08T20:54:46.395653+0000","last_clean":"2024-05-08T20:54:46.395653+0000","last_became_active":"2024-05-08T20:27:27.602459+0000","last_became_peered":"2024-05-08T20:27:27.602459+0000","last_unstale":"2024-05-08T20:54:46.395653+0000","last_undegraded":"2024-05-08T20:54:46.395653+0000","last_fullsized":"2024-05-08T20:54:46.395653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-05-08T20:54:46.395382+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.395382+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:12.986179+0000","scrub_duration":0.011244446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'3815","reported_seq":3851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:51.692972+0000","last_change":"2024-05-08T20:55:51.693216+0000","last_active":"2024-05-08T20:55:51.692972+0000","last_peered":"2024-05-08T20:55:51.692972+0000","last_clean":"2024-05-08T20:55:51.692972+0000","last_became_active":"2024-05-08T20:27:28.023212+0000","last_became_peered":"2024-05-08T20:27:28.023212+0000","last_unstale":"2024-05-08T20:55:51.692972+0000","last_undegraded":"2024-05-08T20:55:51.692972+0000","last_fullsized":"2024-05-08T20:55:51.692972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3815","last_scrub_stamp":"2024-05-08T20:55:51.692913+0000","last_deep_scrub":"26'3815","last_deep_scrub_stamp":"2024-05-08T20:55:51.692913+0000","last_clean_scrub_stamp":"2024-05-08T20:55:51.692913+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:12.707969+0000","scrub_duration":0.048560441000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20951,"num_write_kb":264337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'5959","reported_seq":5999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.002055+0000","last_change":"2024-05-08T20:55:22.002055+0000","last_active":"2024-05-08T20:55:22.002055+0000","last_peered":"2024-05-08T20:55:22.002055+0000","last_clean":"2024-05-08T20:55:22.002055+0000","last_became_active":"2024-05-08T20:27:18.927536+0000","last_became_peered":"2024-05-08T20:27:18.927536+0000","last_unstale":"2024-05-08T20:55:22.002055+0000","last_undegraded":"2024-05-08T20:55:22.002055+0000","last_fullsized":"2024-05-08T20:55:22.002055+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5959","last_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_deep_scrub":"26'5959","last_deep_scrub_stamp":"2024-05-08T20:55:22.001765+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.001765+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:55.739345+0000","scrub_duration":0.013812233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31268,"num_write_kb":346609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.579960+0000","last_change":"2024-05-08T20:55:04.579960+0000","last_active":"2024-05-08T20:55:04.579960+0000","last_peered":"2024-05-08T20:55:04.579960+0000","last_clean":"2024-05-08T20:55:04.579960+0000","last_became_active":"2024-05-08T20:27:18.528316+0000","last_became_peered":"2024-05-08T20:27:18.528316+0000","last_unstale":"2024-05-08T20:55:04.579960+0000","last_undegraded":"2024-05-08T20:55:04.579960+0000","last_fullsized":"2024-05-08T20:55:04.579960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:04.579663+0000","last_clean_scrub_stamp":"2024-05-08T20:55:04.579663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:27.992226+0000","scrub_duration":0.010179356000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.363021+0000","last_change":"2024-05-08T20:55:06.363021+0000","last_active":"2024-05-08T20:55:06.363021+0000","last_peered":"2024-05-08T20:55:06.363021+0000","last_clean":"2024-05-08T20:55:06.363021+0000","last_became_active":"2024-05-08T20:27:27.615309+0000","last_became_peered":"2024-05-08T20:27:27.615309+0000","last_unstale":"2024-05-08T20:55:06.363021+0000","last_undegraded":"2024-05-08T20:55:06.363021+0000","last_fullsized":"2024-05-08T20:55:06.363021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:06.362763+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.362763+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:52.398831+0000","scrub_duration":0.005099742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'6588","reported_seq":6625,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.487296+0000","last_change":"2024-05-08T20:55:34.487547+0000","last_active":"2024-05-08T20:55:34.487296+0000","last_peered":"2024-05-08T20:55:34.487296+0000","last_clean":"2024-05-08T20:55:34.487296+0000","last_became_active":"2024-05-08T20:27:28.016661+0000","last_became_peered":"2024-05-08T20:27:28.016661+0000","last_unstale":"2024-05-08T20:55:34.487296+0000","last_undegraded":"2024-05-08T20:55:34.487296+0000","last_fullsized":"2024-05-08T20:55:34.487296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6588","last_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_deep_scrub":"26'6588","last_deep_scrub_stamp":"2024-05-08T20:55:34.487238+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.487238+0000","objects_scrubbed":0,"log_size":6588,"log_dups_size":0,"ondisk_log_size":6588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:48.676035+0000","scrub_duration":0.054108730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36782,"num_write_kb":442457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:11.929619+0000","last_change":"2024-05-08T20:55:11.929619+0000","last_active":"2024-05-08T20:55:11.929619+0000","last_peered":"2024-05-08T20:55:11.929619+0000","last_clean":"2024-05-08T20:55:11.929619+0000","last_became_active":"2024-05-08T20:27:27.615750+0000","last_became_peered":"2024-05-08T20:27:27.615750+0000","last_unstale":"2024-05-08T20:55:11.929619+0000","last_undegraded":"2024-05-08T20:55:11.929619+0000","last_fullsized":"2024-05-08T20:55:11.929619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-05-08T20:55:11.929353+0000","last_clean_scrub_stamp":"2024-05-08T20:55:11.929353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:48.141846+0000","scrub_duration":0.0054755710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'5999","reported_seq":6039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.865230+0000","last_change":"2024-05-08T20:54:59.865230+0000","last_active":"2024-05-08T20:54:59.865230+0000","last_peered":"2024-05-08T20:54:59.865230+0000","last_clean":"2024-05-08T20:54:59.865230+0000","last_became_active":"2024-05-08T20:27:18.886740+0000","last_became_peered":"2024-05-08T20:27:18.886740+0000","last_unstale":"2024-05-08T20:54:59.865230+0000","last_undegraded":"2024-05-08T20:54:59.865230+0000","last_fullsized":"2024-05-08T20:54:59.865230+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5999","last_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_deep_scrub":"26'5999","last_deep_scrub_stamp":"2024-05-08T20:54:59.864944+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.864944+0000","objects_scrubbed":0,"log_size":5799,"log_dups_size":0,"ondisk_log_size":5799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:43.980839+0000","scrub_duration":0.021147691999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31130,"num_write_kb":362404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'2","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.164801+0000","last_change":"2024-05-08T20:55:34.165115+0000","last_active":"2024-05-08T20:55:34.164801+0000","last_peered":"2024-05-08T20:55:34.164801+0000","last_clean":"2024-05-08T20:55:34.164801+0000","last_became_active":"2024-05-08T20:27:18.540417+0000","last_became_peered":"2024-05-08T20:27:18.540417+0000","last_unstale":"2024-05-08T20:55:34.164801+0000","last_undegraded":"2024-05-08T20:55:34.164801+0000","last_fullsized":"2024-05-08T20:55:34.164801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-05-08T20:55:34.164740+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.164740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:57.308501+0000","scrub_duration":0.0034682070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4346","reported_seq":4384,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.041756+0000","last_change":"2024-05-08T20:55:19.041756+0000","last_active":"2024-05-08T20:55:19.041756+0000","last_peered":"2024-05-08T20:55:19.041756+0000","last_clean":"2024-05-08T20:55:19.041756+0000","last_became_active":"2024-05-08T20:27:27.982020+0000","last_became_peered":"2024-05-08T20:27:27.982020+0000","last_unstale":"2024-05-08T20:55:19.041756+0000","last_undegraded":"2024-05-08T20:55:19.041756+0000","last_fullsized":"2024-05-08T20:55:19.041756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4346","last_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_deep_scrub":"26'4346","last_deep_scrub_stamp":"2024-05-08T20:55:19.041549+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.041549+0000","objects_scrubbed":0,"log_size":4346,"log_dups_size":0,"ondisk_log_size":4346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:04.115810+0000","scrub_duration":0.090105366000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24100,"num_write_kb":305529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'750","reported_seq":788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.624205+0000","last_change":"2024-05-08T20:55:13.624444+0000","last_active":"2024-05-08T20:55:13.624205+0000","last_peered":"2024-05-08T20:55:13.624205+0000","last_clean":"2024-05-08T20:55:13.624205+0000","last_became_active":"2024-05-08T20:27:27.623902+0000","last_became_peered":"2024-05-08T20:27:27.623902+0000","last_unstale":"2024-05-08T20:55:13.624205+0000","last_undegraded":"2024-05-08T20:55:13.624205+0000","last_fullsized":"2024-05-08T20:55:13.624205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'750","last_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_deep_scrub":"26'750","last_deep_scrub_stamp":"2024-05-08T20:55:13.624149+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.624149+0000","objects_scrubbed":3,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:48.563067+0000","scrub_duration":0.082494374999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'5547","reported_seq":5587,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.369985+0000","last_change":"2024-05-08T20:55:16.369985+0000","last_active":"2024-05-08T20:55:16.369985+0000","last_peered":"2024-05-08T20:55:16.369985+0000","last_clean":"2024-05-08T20:55:16.369985+0000","last_became_active":"2024-05-08T20:27:18.889864+0000","last_became_peered":"2024-05-08T20:27:18.889864+0000","last_unstale":"2024-05-08T20:55:16.369985+0000","last_undegraded":"2024-05-08T20:55:16.369985+0000","last_fullsized":"2024-05-08T20:55:16.369985+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5547","last_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_deep_scrub":"26'5547","last_deep_scrub_stamp":"2024-05-08T20:55:16.369692+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.369692+0000","objects_scrubbed":0,"log_size":5247,"log_dups_size":0,"ondisk_log_size":5247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:07.095999+0000","scrub_duration":0.052017234000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28850,"num_write_kb":328598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:21.269094+0000","last_change":"2024-05-08T20:55:21.269094+0000","last_active":"2024-05-08T20:55:21.269094+0000","last_peered":"2024-05-08T20:55:21.269094+0000","last_clean":"2024-05-08T20:55:21.269094+0000","last_became_active":"2024-05-08T20:27:18.518652+0000","last_became_peered":"2024-05-08T20:27:18.518652+0000","last_unstale":"2024-05-08T20:55:21.269094+0000","last_undegraded":"2024-05-08T20:55:21.269094+0000","last_fullsized":"2024-05-08T20:55:21.269094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-05-08T20:55:21.268812+0000","last_clean_scrub_stamp":"2024-05-08T20:55:21.268812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:56:45.570299+0000","scrub_duration":0.0068504059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'4926","reported_seq":4961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.889215+0000","last_change":"2024-05-08T20:55:03.889349+0000","last_active":"2024-05-08T20:55:03.889215+0000","last_peered":"2024-05-08T20:55:03.889215+0000","last_clean":"2024-05-08T20:55:03.889215+0000","last_became_active":"2024-05-08T20:27:28.010706+0000","last_became_peered":"2024-05-08T20:27:28.010706+0000","last_unstale":"2024-05-08T20:55:03.889215+0000","last_undegraded":"2024-05-08T20:55:03.889215+0000","last_fullsized":"2024-05-08T20:55:03.889215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4926","last_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_deep_scrub":"26'4926","last_deep_scrub_stamp":"2024-05-08T20:55:03.889187+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.889187+0000","objects_scrubbed":0,"log_size":4926,"log_dups_size":0,"ondisk_log_size":4926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:53.056172+0000","scrub_duration":0.110946349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27172,"num_write_kb":346418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'163","reported_seq":203,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.590220+0000","last_change":"2024-05-08T20:54:59.590495+0000","last_active":"2024-05-08T20:54:59.590220+0000","last_peered":"2024-05-08T20:54:59.590220+0000","last_clean":"2024-05-08T20:54:59.590220+0000","last_became_active":"2024-05-08T20:27:18.540588+0000","last_became_peered":"2024-05-08T20:27:18.540588+0000","last_unstale":"2024-05-08T20:54:59.590220+0000","last_undegraded":"2024-05-08T20:54:59.590220+0000","last_fullsized":"2024-05-08T20:54:59.590220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'163","last_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_deep_scrub":"26'163","last_deep_scrub_stamp":"2024-05-08T20:54:59.590164+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.590164+0000","objects_scrubbed":1,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:55.910490+0000","scrub_duration":0.020938656999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2225163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'4451","reported_seq":4490,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.049268+0000","last_change":"2024-05-08T20:55:06.049513+0000","last_active":"2024-05-08T20:55:06.049268+0000","last_peered":"2024-05-08T20:55:06.049268+0000","last_clean":"2024-05-08T20:55:06.049268+0000","last_became_active":"2024-05-08T20:27:18.907699+0000","last_became_peered":"2024-05-08T20:27:18.907699+0000","last_unstale":"2024-05-08T20:55:06.049268+0000","last_undegraded":"2024-05-08T20:55:06.049268+0000","last_fullsized":"2024-05-08T20:55:06.049268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4451","last_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_deep_scrub":"26'4451","last_deep_scrub_stamp":"2024-05-08T20:55:06.049212+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.049212+0000","objects_scrubbed":0,"log_size":4451,"log_dups_size":0,"ondisk_log_size":4451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:23:24.430723+0000","scrub_duration":0.052059591000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22324,"num_write_kb":265519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'6","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.520135+0000","last_change":"2024-05-08T20:55:02.520371+0000","last_active":"2024-05-08T20:55:02.520135+0000","last_peered":"2024-05-08T20:55:02.520135+0000","last_clean":"2024-05-08T20:55:02.520135+0000","last_became_active":"2024-05-08T20:27:27.593768+0000","last_became_peered":"2024-05-08T20:27:27.593768+0000","last_unstale":"2024-05-08T20:55:02.520135+0000","last_undegraded":"2024-05-08T20:55:02.520135+0000","last_fullsized":"2024-05-08T20:55:02.520135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-05-08T20:55:02.520078+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.520078+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:26.455981+0000","scrub_duration":0.0061828689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3676","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:42.936803+0000","last_change":"2024-05-08T20:55:42.937094+0000","last_active":"2024-05-08T20:55:42.936803+0000","last_peered":"2024-05-08T20:55:42.936803+0000","last_clean":"2024-05-08T20:55:42.936803+0000","last_became_active":"2024-05-08T20:27:28.011514+0000","last_became_peered":"2024-05-08T20:27:28.011514+0000","last_unstale":"2024-05-08T20:55:42.936803+0000","last_undegraded":"2024-05-08T20:55:42.936803+0000","last_fullsized":"2024-05-08T20:55:42.936803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3676","last_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_deep_scrub":"26'3676","last_deep_scrub_stamp":"2024-05-08T20:55:42.936748+0000","last_clean_scrub_stamp":"2024-05-08T20:55:42.936748+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:31.860506+0000","scrub_duration":0.049010799000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":259110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'655","reported_seq":695,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:23.317920+0000","last_change":"2024-05-08T20:55:23.318135+0000","last_active":"2024-05-08T20:55:23.317920+0000","last_peered":"2024-05-08T20:55:23.317920+0000","last_clean":"2024-05-08T20:55:23.317920+0000","last_became_active":"2024-05-08T20:27:18.527852+0000","last_became_peered":"2024-05-08T20:27:18.527852+0000","last_unstale":"2024-05-08T20:55:23.317920+0000","last_undegraded":"2024-05-08T20:55:23.317920+0000","last_fullsized":"2024-05-08T20:55:23.317920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'655","last_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_deep_scrub":"26'655","last_deep_scrub_stamp":"2024-05-08T20:55:23.317866+0000","last_clean_scrub_stamp":"2024-05-08T20:55:23.317866+0000","objects_scrubbed":1,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:46.680579+0000","scrub_duration":0.028425507999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'4749","reported_seq":4788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.863360+0000","last_change":"2024-05-08T20:55:13.863574+0000","last_active":"2024-05-08T20:55:13.863360+0000","last_peered":"2024-05-08T20:55:13.863360+0000","last_clean":"2024-05-08T20:55:13.863360+0000","last_became_active":"2024-05-08T20:27:18.894624+0000","last_became_peered":"2024-05-08T20:27:18.894624+0000","last_unstale":"2024-05-08T20:55:13.863360+0000","last_undegraded":"2024-05-08T20:55:13.863360+0000","last_fullsized":"2024-05-08T20:55:13.863360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4749","last_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_deep_scrub":"26'4749","last_deep_scrub_stamp":"2024-05-08T20:55:13.863305+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.863305+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:59.772479+0000","scrub_duration":0.028153702999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23903,"num_write_kb":276108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'8","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:56.342167+0000","last_change":"2024-05-08T20:54:56.342167+0000","last_active":"2024-05-08T20:54:56.342167+0000","last_peered":"2024-05-08T20:54:56.342167+0000","last_clean":"2024-05-08T20:54:56.342167+0000","last_became_active":"2024-05-08T20:27:27.602529+0000","last_became_peered":"2024-05-08T20:27:27.602529+0000","last_unstale":"2024-05-08T20:54:56.342167+0000","last_undegraded":"2024-05-08T20:54:56.342167+0000","last_fullsized":"2024-05-08T20:54:56.342167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-05-08T20:54:56.341600+0000","last_clean_scrub_stamp":"2024-05-08T20:54:56.341600+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:37.112673+0000","scrub_duration":0.0065677610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3715","reported_seq":3752,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:33.513008+0000","last_change":"2024-05-08T20:55:33.513008+0000","last_active":"2024-05-08T20:55:33.513008+0000","last_peered":"2024-05-08T20:55:33.513008+0000","last_clean":"2024-05-08T20:55:33.513008+0000","last_became_active":"2024-05-08T20:27:27.987323+0000","last_became_peered":"2024-05-08T20:27:27.987323+0000","last_unstale":"2024-05-08T20:55:33.513008+0000","last_undegraded":"2024-05-08T20:55:33.513008+0000","last_fullsized":"2024-05-08T20:55:33.513008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3715","last_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_deep_scrub":"26'3715","last_deep_scrub_stamp":"2024-05-08T20:55:33.512769+0000","last_clean_scrub_stamp":"2024-05-08T20:55:33.512769+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:45.954826+0000","scrub_duration":0.065087201999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20643,"num_write_kb":263025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5325","reported_seq":5366,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.540402+0000","last_change":"2024-05-08T20:54:49.540646+0000","last_active":"2024-05-08T20:54:49.540402+0000","last_peered":"2024-05-08T20:54:49.540402+0000","last_clean":"2024-05-08T20:54:49.540402+0000","last_became_active":"2024-05-08T20:27:18.890021+0000","last_became_peered":"2024-05-08T20:27:18.890021+0000","last_unstale":"2024-05-08T20:54:49.540402+0000","last_undegraded":"2024-05-08T20:54:49.540402+0000","last_fullsized":"2024-05-08T20:54:49.540402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5325","last_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_deep_scrub":"26'5325","last_deep_scrub_stamp":"2024-05-08T20:54:49.540347+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.540347+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:25.992758+0000","scrub_duration":0.061375869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28032,"num_write_kb":325317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'4854","reported_seq":4891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:45.682831+0000","last_change":"2024-05-08T20:55:45.682973+0000","last_active":"2024-05-08T20:55:45.682831+0000","last_peered":"2024-05-08T20:55:45.682831+0000","last_clean":"2024-05-08T20:55:45.682831+0000","last_became_active":"2024-05-08T20:27:27.986899+0000","last_became_peered":"2024-05-08T20:27:27.986899+0000","last_unstale":"2024-05-08T20:55:45.682831+0000","last_undegraded":"2024-05-08T20:55:45.682831+0000","last_fullsized":"2024-05-08T20:55:45.682831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4854","last_scrub_stamp":"2024-05-08T20:55:45.682800+0000","last_deep_scrub":"26'4854","last_deep_scrub_stamp":"2024-05-08T20:55:45.682800+0000","last_clean_scrub_stamp":"2024-05-08T20:55:45.682800+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:20.964758+0000","scrub_duration":0.080428569000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26823,"num_write_kb":345145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'5595","reported_seq":5636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:57.583918+0000","last_change":"2024-05-08T20:54:57.584171+0000","last_active":"2024-05-08T20:54:57.583918+0000","last_peered":"2024-05-08T20:54:57.583918+0000","last_clean":"2024-05-08T20:54:57.583918+0000","last_became_active":"2024-05-08T20:27:18.926055+0000","last_became_peered":"2024-05-08T20:27:18.926055+0000","last_unstale":"2024-05-08T20:54:57.583918+0000","last_undegraded":"2024-05-08T20:54:57.583918+0000","last_fullsized":"2024-05-08T20:54:57.583918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5595","last_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_deep_scrub":"26'5595","last_deep_scrub_stamp":"2024-05-08T20:54:57.583862+0000","last_clean_scrub_stamp":"2024-05-08T20:54:57.583862+0000","objects_scrubbed":0,"log_size":5595,"log_dups_size":0,"ondisk_log_size":5595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:54.463390+0000","scrub_duration":0.019454468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29112,"num_write_kb":329667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4665","reported_seq":4702,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:09.267578+0000","last_change":"2024-05-08T20:56:09.267823+0000","last_active":"2024-05-08T20:56:09.267578+0000","last_peered":"2024-05-08T20:56:09.267578+0000","last_clean":"2024-05-08T20:56:09.267578+0000","last_became_active":"2024-05-08T20:27:27.996853+0000","last_became_peered":"2024-05-08T20:27:27.996853+0000","last_unstale":"2024-05-08T20:56:09.267578+0000","last_undegraded":"2024-05-08T20:56:09.267578+0000","last_fullsized":"2024-05-08T20:56:09.267578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4665","last_scrub_stamp":"2024-05-08T20:56:09.267525+0000","last_deep_scrub":"26'4665","last_deep_scrub_stamp":"2024-05-08T20:56:09.267525+0000","last_clean_scrub_stamp":"2024-05-08T20:56:09.267525+0000","objects_scrubbed":0,"log_size":4665,"log_dups_size":0,"ondisk_log_size":4665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:58.613395+0000","scrub_duration":0.072073648000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26145,"num_write_kb":318092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'6159","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.221892+0000","last_change":"2024-05-08T20:55:37.222118+0000","last_active":"2024-05-08T20:55:37.221892+0000","last_peered":"2024-05-08T20:55:37.221892+0000","last_clean":"2024-05-08T20:55:37.221892+0000","last_became_active":"2024-05-08T20:27:18.926993+0000","last_became_peered":"2024-05-08T20:27:18.926993+0000","last_unstale":"2024-05-08T20:55:37.221892+0000","last_undegraded":"2024-05-08T20:55:37.221892+0000","last_fullsized":"2024-05-08T20:55:37.221892+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6159","last_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_deep_scrub":"26'6159","last_deep_scrub_stamp":"2024-05-08T20:55:37.221839+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.221839+0000","objects_scrubbed":0,"log_size":5859,"log_dups_size":0,"ondisk_log_size":5859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:00.718155+0000","scrub_duration":0.013317416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":362629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4788","reported_seq":4825,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.695476+0000","last_change":"2024-05-08T20:55:43.695606+0000","last_active":"2024-05-08T20:55:43.695476+0000","last_peered":"2024-05-08T20:55:43.695476+0000","last_clean":"2024-05-08T20:55:43.695476+0000","last_became_active":"2024-05-08T20:27:28.015418+0000","last_became_peered":"2024-05-08T20:27:28.015418+0000","last_unstale":"2024-05-08T20:55:43.695476+0000","last_undegraded":"2024-05-08T20:55:43.695476+0000","last_fullsized":"2024-05-08T20:55:43.695476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4788","last_scrub_stamp":"2024-05-08T20:55:43.695448+0000","last_deep_scrub":"26'4788","last_deep_scrub_stamp":"2024-05-08T20:55:43.695448+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.695448+0000","objects_scrubbed":0,"log_size":4788,"log_dups_size":0,"ondisk_log_size":4788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:16.813820+0000","scrub_duration":0.095509810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27466,"num_write_kb":323202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'5693","reported_seq":5734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:46.063296+0000","last_change":"2024-05-08T20:54:46.063510+0000","last_active":"2024-05-08T20:54:46.063296+0000","last_peered":"2024-05-08T20:54:46.063296+0000","last_clean":"2024-05-08T20:54:46.063296+0000","last_became_active":"2024-05-08T20:27:18.887345+0000","last_became_peered":"2024-05-08T20:27:18.887345+0000","last_unstale":"2024-05-08T20:54:46.063296+0000","last_undegraded":"2024-05-08T20:54:46.063296+0000","last_fullsized":"2024-05-08T20:54:46.063296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5693","last_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_deep_scrub":"26'5693","last_deep_scrub_stamp":"2024-05-08T20:54:46.063251+0000","last_clean_scrub_stamp":"2024-05-08T20:54:46.063251+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:47.062496+0000","scrub_duration":0.071792174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29849,"num_write_kb":324548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5089","reported_seq":5126,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:16.744714+0000","last_change":"2024-05-08T20:56:16.744963+0000","last_active":"2024-05-08T20:56:16.744714+0000","last_peered":"2024-05-08T20:56:16.744714+0000","last_clean":"2024-05-08T20:56:16.744714+0000","last_became_active":"2024-05-08T20:27:27.995052+0000","last_became_peered":"2024-05-08T20:27:27.995052+0000","last_unstale":"2024-05-08T20:56:16.744714+0000","last_undegraded":"2024-05-08T20:56:16.744714+0000","last_fullsized":"2024-05-08T20:56:16.744714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5089","last_scrub_stamp":"2024-05-08T20:56:16.744656+0000","last_deep_scrub":"26'5089","last_deep_scrub_stamp":"2024-05-08T20:56:16.744656+0000","last_clean_scrub_stamp":"2024-05-08T20:56:16.744656+0000","objects_scrubbed":0,"log_size":5089,"log_dups_size":0,"ondisk_log_size":5089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:34.221171+0000","scrub_duration":0.048502770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27012,"num_write_kb":341733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'5399","reported_seq":5440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:26.388312+0000","last_change":"2024-05-08T20:55:26.388312+0000","last_active":"2024-05-08T20:55:26.388312+0000","last_peered":"2024-05-08T20:55:26.388312+0000","last_clean":"2024-05-08T20:55:26.388312+0000","last_became_active":"2024-05-08T20:27:18.889089+0000","last_became_peered":"2024-05-08T20:27:18.889089+0000","last_unstale":"2024-05-08T20:55:26.388312+0000","last_undegraded":"2024-05-08T20:55:26.388312+0000","last_fullsized":"2024-05-08T20:55:26.388312+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5399","last_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_deep_scrub":"26'5399","last_deep_scrub_stamp":"2024-05-08T20:55:26.387951+0000","last_clean_scrub_stamp":"2024-05-08T20:55:26.387951+0000","objects_scrubbed":0,"log_size":5199,"log_dups_size":0,"ondisk_log_size":5199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:31.944366+0000","scrub_duration":0.012044920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28733,"num_write_kb":328444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'4115","reported_seq":4152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:48.890030+0000","last_change":"2024-05-08T20:55:48.890307+0000","last_active":"2024-05-08T20:55:48.890030+0000","last_peered":"2024-05-08T20:55:48.890030+0000","last_clean":"2024-05-08T20:55:48.890030+0000","last_became_active":"2024-05-08T20:27:28.016367+0000","last_became_peered":"2024-05-08T20:27:28.016367+0000","last_unstale":"2024-05-08T20:55:48.890030+0000","last_undegraded":"2024-05-08T20:55:48.890030+0000","last_fullsized":"2024-05-08T20:55:48.890030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4115","last_scrub_stamp":"2024-05-08T20:55:48.889975+0000","last_deep_scrub":"26'4115","last_deep_scrub_stamp":"2024-05-08T20:55:48.889975+0000","last_clean_scrub_stamp":"2024-05-08T20:55:48.889975+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":0,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:27.885953+0000","scrub_duration":0.041821670999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22648,"num_write_kb":295672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'5958","reported_seq":5999,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.715543+0000","last_change":"2024-05-08T20:55:06.715543+0000","last_active":"2024-05-08T20:55:06.715543+0000","last_peered":"2024-05-08T20:55:06.715543+0000","last_clean":"2024-05-08T20:55:06.715543+0000","last_became_active":"2024-05-08T20:27:18.886706+0000","last_became_peered":"2024-05-08T20:27:18.886706+0000","last_unstale":"2024-05-08T20:55:06.715543+0000","last_undegraded":"2024-05-08T20:55:06.715543+0000","last_fullsized":"2024-05-08T20:55:06.715543+0000","mapping_epoch":18,"log_start":"26'100","ondisk_log_start":"26'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5958","last_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_deep_scrub":"26'5958","last_deep_scrub_stamp":"2024-05-08T20:55:06.715216+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.715216+0000","objects_scrubbed":0,"log_size":5858,"log_dups_size":0,"ondisk_log_size":5858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.934398+0000","scrub_duration":0.015652640999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32319,"num_write_kb":342574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'4663","reported_seq":4700,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:56.680713+0000","last_change":"2024-05-08T20:55:56.680962+0000","last_active":"2024-05-08T20:55:56.680713+0000","last_peered":"2024-05-08T20:55:56.680713+0000","last_clean":"2024-05-08T20:55:56.680713+0000","last_became_active":"2024-05-08T20:27:28.022028+0000","last_became_peered":"2024-05-08T20:27:28.022028+0000","last_unstale":"2024-05-08T20:55:56.680713+0000","last_undegraded":"2024-05-08T20:55:56.680713+0000","last_fullsized":"2024-05-08T20:55:56.680713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4663","last_scrub_stamp":"2024-05-08T20:55:56.680651+0000","last_deep_scrub":"26'4663","last_deep_scrub_stamp":"2024-05-08T20:55:56.680651+0000","last_clean_scrub_stamp":"2024-05-08T20:55:56.680651+0000","objects_scrubbed":0,"log_size":4663,"log_dups_size":0,"ondisk_log_size":4663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:23.603835+0000","scrub_duration":0.044246287000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25835,"num_write_kb":316561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'5066","reported_seq":5107,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.492492+0000","last_change":"2024-05-08T20:54:47.492492+0000","last_active":"2024-05-08T20:54:47.492492+0000","last_peered":"2024-05-08T20:54:47.492492+0000","last_clean":"2024-05-08T20:54:47.492492+0000","last_became_active":"2024-05-08T20:27:18.909525+0000","last_became_peered":"2024-05-08T20:27:18.909525+0000","last_unstale":"2024-05-08T20:54:47.492492+0000","last_undegraded":"2024-05-08T20:54:47.492492+0000","last_fullsized":"2024-05-08T20:54:47.492492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5066","last_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_deep_scrub":"26'5066","last_deep_scrub_stamp":"2024-05-08T20:54:47.492152+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.492152+0000","objects_scrubbed":0,"log_size":5066,"log_dups_size":0,"ondisk_log_size":5066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.271368+0000","scrub_duration":0.020000068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":287921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4639","reported_seq":4676,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:40.445587+0000","last_change":"2024-05-08T20:55:40.445754+0000","last_active":"2024-05-08T20:55:40.445587+0000","last_peered":"2024-05-08T20:55:40.445587+0000","last_clean":"2024-05-08T20:55:40.445587+0000","last_became_active":"2024-05-08T20:27:27.981424+0000","last_became_peered":"2024-05-08T20:27:27.981424+0000","last_unstale":"2024-05-08T20:55:40.445587+0000","last_undegraded":"2024-05-08T20:55:40.445587+0000","last_fullsized":"2024-05-08T20:55:40.445587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4639","last_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_deep_scrub":"26'4639","last_deep_scrub_stamp":"2024-05-08T20:55:40.445550+0000","last_clean_scrub_stamp":"2024-05-08T20:55:40.445550+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:21.821161+0000","scrub_duration":0.079421377000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25555,"num_write_kb":315543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'6126","reported_seq":6167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:08.445597+0000","last_change":"2024-05-08T20:55:08.445597+0000","last_active":"2024-05-08T20:55:08.445597+0000","last_peered":"2024-05-08T20:55:08.445597+0000","last_clean":"2024-05-08T20:55:08.445597+0000","last_became_active":"2024-05-08T20:27:18.897994+0000","last_became_peered":"2024-05-08T20:27:18.897994+0000","last_unstale":"2024-05-08T20:55:08.445597+0000","last_undegraded":"2024-05-08T20:55:08.445597+0000","last_fullsized":"2024-05-08T20:55:08.445597+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6126","last_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_deep_scrub":"26'6126","last_deep_scrub_stamp":"2024-05-08T20:55:08.445271+0000","last_clean_scrub_stamp":"2024-05-08T20:55:08.445271+0000","objects_scrubbed":0,"log_size":5226,"log_dups_size":0,"ondisk_log_size":5226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:56.722437+0000","scrub_duration":0.012766164999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32697,"num_write_kb":368753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'4909","reported_seq":4945,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:53.578187+0000","last_change":"2024-05-08T20:55:53.578433+0000","last_active":"2024-05-08T20:55:53.578187+0000","last_peered":"2024-05-08T20:55:53.578187+0000","last_clean":"2024-05-08T20:55:53.578187+0000","last_became_active":"2024-05-08T20:27:27.983941+0000","last_became_peered":"2024-05-08T20:27:27.983941+0000","last_unstale":"2024-05-08T20:55:53.578187+0000","last_undegraded":"2024-05-08T20:55:53.578187+0000","last_fullsized":"2024-05-08T20:55:53.578187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4909","last_scrub_stamp":"2024-05-08T20:55:53.578132+0000","last_deep_scrub":"26'4909","last_deep_scrub_stamp":"2024-05-08T20:55:53.578132+0000","last_clean_scrub_stamp":"2024-05-08T20:55:53.578132+0000","objects_scrubbed":0,"log_size":4909,"log_dups_size":0,"ondisk_log_size":4909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:58.318894+0000","scrub_duration":0.088954009000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26221,"num_write_kb":326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'5362","reported_seq":5403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.202269+0000","last_change":"2024-05-08T20:55:39.202269+0000","last_active":"2024-05-08T20:55:39.202269+0000","last_peered":"2024-05-08T20:55:39.202269+0000","last_clean":"2024-05-08T20:55:39.202269+0000","last_became_active":"2024-05-08T20:27:18.902410+0000","last_became_peered":"2024-05-08T20:27:18.902410+0000","last_unstale":"2024-05-08T20:55:39.202269+0000","last_undegraded":"2024-05-08T20:55:39.202269+0000","last_fullsized":"2024-05-08T20:55:39.202269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5362","last_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_deep_scrub":"26'5362","last_deep_scrub_stamp":"2024-05-08T20:55:39.201982+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.201982+0000","objects_scrubbed":0,"log_size":5362,"log_dups_size":0,"ondisk_log_size":5362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:26.275471+0000","scrub_duration":0.012871195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27744,"num_write_kb":316064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'6007","reported_seq":6043,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:18.727229+0000","last_change":"2024-05-08T20:55:18.727229+0000","last_active":"2024-05-08T20:55:18.727229+0000","last_peered":"2024-05-08T20:55:18.727229+0000","last_clean":"2024-05-08T20:55:18.727229+0000","last_became_active":"2024-05-08T20:27:27.999444+0000","last_became_peered":"2024-05-08T20:27:27.999444+0000","last_unstale":"2024-05-08T20:55:18.727229+0000","last_undegraded":"2024-05-08T20:55:18.727229+0000","last_fullsized":"2024-05-08T20:55:18.727229+0000","mapping_epoch":22,"log_start":"26'300","ondisk_log_start":"26'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:18.726746+0000","last_clean_scrub_stamp":"2024-05-08T20:55:18.726746+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:12.191809+0000","scrub_duration":0.059782137999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32823,"num_write_kb":406093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'5184","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.442535+0000","last_change":"2024-05-08T20:55:02.442768+0000","last_active":"2024-05-08T20:55:02.442535+0000","last_peered":"2024-05-08T20:55:02.442535+0000","last_clean":"2024-05-08T20:55:02.442535+0000","last_became_active":"2024-05-08T20:27:18.897160+0000","last_became_peered":"2024-05-08T20:27:18.897160+0000","last_unstale":"2024-05-08T20:55:02.442535+0000","last_undegraded":"2024-05-08T20:55:02.442535+0000","last_fullsized":"2024-05-08T20:55:02.442535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5184","last_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_deep_scrub":"26'5184","last_deep_scrub_stamp":"2024-05-08T20:55:02.442482+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.442482+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:06.919194+0000","scrub_duration":0.015103089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27589,"num_write_kb":303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4176","reported_seq":4212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.601981+0000","last_change":"2024-05-08T20:55:10.602221+0000","last_active":"2024-05-08T20:55:10.601981+0000","last_peered":"2024-05-08T20:55:10.601981+0000","last_clean":"2024-05-08T20:55:10.601981+0000","last_became_active":"2024-05-08T20:27:27.997647+0000","last_became_peered":"2024-05-08T20:27:27.997647+0000","last_unstale":"2024-05-08T20:55:10.601981+0000","last_undegraded":"2024-05-08T20:55:10.601981+0000","last_fullsized":"2024-05-08T20:55:10.601981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4176","last_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_deep_scrub":"26'4176","last_deep_scrub_stamp":"2024-05-08T20:55:10.601877+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.601877+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:25:47.707725+0000","scrub_duration":0.083099372000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23931,"num_write_kb":284390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'5663","reported_seq":5703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.139294+0000","last_change":"2024-05-08T20:55:43.139539+0000","last_active":"2024-05-08T20:55:43.139294+0000","last_peered":"2024-05-08T20:55:43.139294+0000","last_clean":"2024-05-08T20:55:43.139294+0000","last_became_active":"2024-05-08T20:27:18.927242+0000","last_became_peered":"2024-05-08T20:27:18.927242+0000","last_unstale":"2024-05-08T20:55:43.139294+0000","last_undegraded":"2024-05-08T20:55:43.139294+0000","last_fullsized":"2024-05-08T20:55:43.139294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5663","last_scrub_stamp":"2024-05-08T20:55:43.139241+0000","last_deep_scrub":"26'5663","last_deep_scrub_stamp":"2024-05-08T20:55:43.139241+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.139241+0000","objects_scrubbed":0,"log_size":5663,"log_dups_size":0,"ondisk_log_size":5663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:02.484959+0000","scrub_duration":0.010645274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29707,"num_write_kb":328150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4568","reported_seq":4604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:34.558291+0000","last_change":"2024-05-08T20:55:34.558561+0000","last_active":"2024-05-08T20:55:34.558291+0000","last_peered":"2024-05-08T20:55:34.558291+0000","last_clean":"2024-05-08T20:55:34.558291+0000","last_became_active":"2024-05-08T20:27:27.983800+0000","last_became_peered":"2024-05-08T20:27:27.983800+0000","last_unstale":"2024-05-08T20:55:34.558291+0000","last_undegraded":"2024-05-08T20:55:34.558291+0000","last_fullsized":"2024-05-08T20:55:34.558291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4568","last_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_deep_scrub":"26'4568","last_deep_scrub_stamp":"2024-05-08T20:55:34.558230+0000","last_clean_scrub_stamp":"2024-05-08T20:55:34.558230+0000","objects_scrubbed":0,"log_size":4568,"log_dups_size":0,"ondisk_log_size":4568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:54.666430+0000","scrub_duration":0.090672077000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":328635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'6400","reported_seq":6434,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:25.439461+0000","last_change":"2024-05-08T20:55:25.439693+0000","last_active":"2024-05-08T20:55:25.439461+0000","last_peered":"2024-05-08T20:55:25.439461+0000","last_clean":"2024-05-08T20:55:25.439461+0000","last_became_active":"2024-05-08T20:28:01.237789+0000","last_became_peered":"2024-05-08T20:28:01.237789+0000","last_unstale":"2024-05-08T20:55:25.439461+0000","last_undegraded":"2024-05-08T20:55:25.439461+0000","last_fullsized":"2024-05-08T20:55:25.439461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6400","last_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_deep_scrub":"26'6400","last_deep_scrub_stamp":"2024-05-08T20:55:25.439401+0000","last_clean_scrub_stamp":"2024-05-08T20:55:25.439401+0000","objects_scrubbed":0,"log_size":6400,"log_dups_size":0,"ondisk_log_size":6400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:51.706253+0000","scrub_duration":0.013054441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33367,"num_write_kb":379917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4843","reported_seq":4879,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:43.886387+0000","last_change":"2024-05-08T20:55:43.886627+0000","last_active":"2024-05-08T20:55:43.886387+0000","last_peered":"2024-05-08T20:55:43.886387+0000","last_clean":"2024-05-08T20:55:43.886387+0000","last_became_active":"2024-05-08T20:27:28.011765+0000","last_became_peered":"2024-05-08T20:27:28.011765+0000","last_unstale":"2024-05-08T20:55:43.886387+0000","last_undegraded":"2024-05-08T20:55:43.886387+0000","last_fullsized":"2024-05-08T20:55:43.886387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4843","last_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_deep_scrub":"26'4843","last_deep_scrub_stamp":"2024-05-08T20:55:43.886334+0000","last_clean_scrub_stamp":"2024-05-08T20:55:43.886334+0000","objects_scrubbed":0,"log_size":4843,"log_dups_size":0,"ondisk_log_size":4843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:11.158351+0000","scrub_duration":0.035733203999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27313,"num_write_kb":318510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4987","reported_seq":5027,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:06.577214+0000","last_change":"2024-05-08T20:55:06.577459+0000","last_active":"2024-05-08T20:55:06.577214+0000","last_peered":"2024-05-08T20:55:06.577214+0000","last_clean":"2024-05-08T20:55:06.577214+0000","last_became_active":"2024-05-08T20:27:18.917258+0000","last_became_peered":"2024-05-08T20:27:18.917258+0000","last_unstale":"2024-05-08T20:55:06.577214+0000","last_undegraded":"2024-05-08T20:55:06.577214+0000","last_fullsized":"2024-05-08T20:55:06.577214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4987","last_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_deep_scrub":"26'4987","last_deep_scrub_stamp":"2024-05-08T20:55:06.577160+0000","last_clean_scrub_stamp":"2024-05-08T20:55:06.577160+0000","objects_scrubbed":0,"log_size":4987,"log_dups_size":0,"ondisk_log_size":4987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:42.945808+0000","scrub_duration":0.016149487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26594,"num_write_kb":295202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'5231","reported_seq":5267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:49.909056+0000","last_change":"2024-05-08T20:55:49.909344+0000","last_active":"2024-05-08T20:55:49.909056+0000","last_peered":"2024-05-08T20:55:49.909056+0000","last_clean":"2024-05-08T20:55:49.909056+0000","last_became_active":"2024-05-08T20:27:28.004613+0000","last_became_peered":"2024-05-08T20:27:28.004613+0000","last_unstale":"2024-05-08T20:55:49.909056+0000","last_undegraded":"2024-05-08T20:55:49.909056+0000","last_fullsized":"2024-05-08T20:55:49.909056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5231","last_scrub_stamp":"2024-05-08T20:55:49.908998+0000","last_deep_scrub":"26'5231","last_deep_scrub_stamp":"2024-05-08T20:55:49.908998+0000","last_clean_scrub_stamp":"2024-05-08T20:55:49.908998+0000","objects_scrubbed":0,"log_size":5231,"log_dups_size":0,"ondisk_log_size":5231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:47.254466+0000","scrub_duration":0.057442419000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28777,"num_write_kb":361437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'6007","reported_seq":6047,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.588062+0000","last_change":"2024-05-08T20:55:10.588330+0000","last_active":"2024-05-08T20:55:10.588062+0000","last_peered":"2024-05-08T20:55:10.588062+0000","last_clean":"2024-05-08T20:55:10.588062+0000","last_became_active":"2024-05-08T20:27:18.913854+0000","last_became_peered":"2024-05-08T20:27:18.913854+0000","last_unstale":"2024-05-08T20:55:10.588062+0000","last_undegraded":"2024-05-08T20:55:10.588062+0000","last_fullsized":"2024-05-08T20:55:10.588062+0000","mapping_epoch":18,"log_start":"26'300","ondisk_log_start":"26'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6007","last_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_deep_scrub":"26'6007","last_deep_scrub_stamp":"2024-05-08T20:55:10.588008+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.588008+0000","objects_scrubbed":0,"log_size":5707,"log_dups_size":0,"ondisk_log_size":5707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.452979+0000","scrub_duration":0.016104663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31084,"num_write_kb":353999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4162","reported_seq":4199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:02.312322+0000","last_change":"2024-05-08T20:56:02.312577+0000","last_active":"2024-05-08T20:56:02.312322+0000","last_peered":"2024-05-08T20:56:02.312322+0000","last_clean":"2024-05-08T20:56:02.312322+0000","last_became_active":"2024-05-08T20:27:27.988432+0000","last_became_peered":"2024-05-08T20:27:27.988432+0000","last_unstale":"2024-05-08T20:56:02.312322+0000","last_undegraded":"2024-05-08T20:56:02.312322+0000","last_fullsized":"2024-05-08T20:56:02.312322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4162","last_scrub_stamp":"2024-05-08T20:56:02.312244+0000","last_deep_scrub":"26'4162","last_deep_scrub_stamp":"2024-05-08T20:56:02.312244+0000","last_clean_scrub_stamp":"2024-05-08T20:56:02.312244+0000","objects_scrubbed":0,"log_size":4162,"log_dups_size":0,"ondisk_log_size":4162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:54.650141+0000","scrub_duration":0.065205662999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22634,"num_write_kb":295668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'5402","reported_seq":5442,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:59.580745+0000","last_change":"2024-05-08T20:54:59.580745+0000","last_active":"2024-05-08T20:54:59.580745+0000","last_peered":"2024-05-08T20:54:59.580745+0000","last_clean":"2024-05-08T20:54:59.580745+0000","last_became_active":"2024-05-08T20:27:18.904764+0000","last_became_peered":"2024-05-08T20:27:18.904764+0000","last_unstale":"2024-05-08T20:54:59.580745+0000","last_undegraded":"2024-05-08T20:54:59.580745+0000","last_fullsized":"2024-05-08T20:54:59.580745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5402","last_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_deep_scrub":"26'5402","last_deep_scrub_stamp":"2024-05-08T20:54:59.580403+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.580403+0000","objects_scrubbed":0,"log_size":5402,"log_dups_size":0,"ondisk_log_size":5402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:43.325297+0000","scrub_duration":0.019827373999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28039,"num_write_kb":333717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'3916","reported_seq":3952,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.024577+0000","last_change":"2024-05-08T20:55:16.024733+0000","last_active":"2024-05-08T20:55:16.024577+0000","last_peered":"2024-05-08T20:55:16.024577+0000","last_clean":"2024-05-08T20:55:16.024577+0000","last_became_active":"2024-05-08T20:27:27.984668+0000","last_became_peered":"2024-05-08T20:27:27.984668+0000","last_unstale":"2024-05-08T20:55:16.024577+0000","last_undegraded":"2024-05-08T20:55:16.024577+0000","last_fullsized":"2024-05-08T20:55:16.024577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3916","last_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_deep_scrub":"26'3916","last_deep_scrub_stamp":"2024-05-08T20:55:16.024547+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.024547+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:35.429176+0000","scrub_duration":0.084433175999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21652,"num_write_kb":279241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'7179","reported_seq":7219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:17.091777+0000","last_change":"2024-05-08T20:55:17.091777+0000","last_active":"2024-05-08T20:55:17.091777+0000","last_peered":"2024-05-08T20:55:17.091777+0000","last_clean":"2024-05-08T20:55:17.091777+0000","last_became_active":"2024-05-08T20:27:18.929379+0000","last_became_peered":"2024-05-08T20:27:18.929379+0000","last_unstale":"2024-05-08T20:55:17.091777+0000","last_undegraded":"2024-05-08T20:55:17.091777+0000","last_fullsized":"2024-05-08T20:55:17.091777+0000","mapping_epoch":18,"log_start":"26'1400","ondisk_log_start":"26'1400","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7179","last_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_deep_scrub":"26'7179","last_deep_scrub_stamp":"2024-05-08T20:55:17.091504+0000","last_clean_scrub_stamp":"2024-05-08T20:55:17.091504+0000","objects_scrubbed":0,"log_size":5779,"log_dups_size":0,"ondisk_log_size":5779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:30.475338+0000","scrub_duration":0.010907612000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37334,"num_write_kb":424157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'4649","reported_seq":4684,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:41.742542+0000","last_change":"2024-05-08T20:55:41.742659+0000","last_active":"2024-05-08T20:55:41.742542+0000","last_peered":"2024-05-08T20:55:41.742542+0000","last_clean":"2024-05-08T20:55:41.742542+0000","last_became_active":"2024-05-08T20:27:27.982398+0000","last_became_peered":"2024-05-08T20:27:27.982398+0000","last_unstale":"2024-05-08T20:55:41.742542+0000","last_undegraded":"2024-05-08T20:55:41.742542+0000","last_fullsized":"2024-05-08T20:55:41.742542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4649","last_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_deep_scrub":"26'4649","last_deep_scrub_stamp":"2024-05-08T20:55:41.742520+0000","last_clean_scrub_stamp":"2024-05-08T20:55:41.742520+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:18:28.769014+0000","scrub_duration":0.11890376499999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25698,"num_write_kb":324273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'5121","reported_seq":5161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:47.191768+0000","last_change":"2024-05-08T20:54:47.191768+0000","last_active":"2024-05-08T20:54:47.191768+0000","last_peered":"2024-05-08T20:54:47.191768+0000","last_clean":"2024-05-08T20:54:47.191768+0000","last_became_active":"2024-05-08T20:27:18.924159+0000","last_became_peered":"2024-05-08T20:27:18.924159+0000","last_unstale":"2024-05-08T20:54:47.191768+0000","last_undegraded":"2024-05-08T20:54:47.191768+0000","last_fullsized":"2024-05-08T20:54:47.191768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5121","last_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_deep_scrub":"26'5121","last_deep_scrub_stamp":"2024-05-08T20:54:47.191457+0000","last_clean_scrub_stamp":"2024-05-08T20:54:47.191457+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:32.886217+0000","scrub_duration":0.059662343999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27419,"num_write_kb":306597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5300","reported_seq":5335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:37.974385+0000","last_change":"2024-05-08T20:55:37.974674+0000","last_active":"2024-05-08T20:55:37.974385+0000","last_peered":"2024-05-08T20:55:37.974385+0000","last_clean":"2024-05-08T20:55:37.974385+0000","last_became_active":"2024-05-08T20:27:28.010861+0000","last_became_peered":"2024-05-08T20:27:28.010861+0000","last_unstale":"2024-05-08T20:55:37.974385+0000","last_undegraded":"2024-05-08T20:55:37.974385+0000","last_fullsized":"2024-05-08T20:55:37.974385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5300","last_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_deep_scrub":"26'5300","last_deep_scrub_stamp":"2024-05-08T20:55:37.974326+0000","last_clean_scrub_stamp":"2024-05-08T20:55:37.974326+0000","objects_scrubbed":0,"log_size":5300,"log_dups_size":0,"ondisk_log_size":5300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:27.991254+0000","scrub_duration":0.052724812000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30499,"num_write_kb":364204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4602","reported_seq":4642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.836939+0000","last_change":"2024-05-08T20:54:54.836939+0000","last_active":"2024-05-08T20:54:54.836939+0000","last_peered":"2024-05-08T20:54:54.836939+0000","last_clean":"2024-05-08T20:54:54.836939+0000","last_became_active":"2024-05-08T20:27:18.894241+0000","last_became_peered":"2024-05-08T20:27:18.894241+0000","last_unstale":"2024-05-08T20:54:54.836939+0000","last_undegraded":"2024-05-08T20:54:54.836939+0000","last_fullsized":"2024-05-08T20:54:54.836939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4602","last_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_deep_scrub":"26'4602","last_deep_scrub_stamp":"2024-05-08T20:54:54.836650+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.836650+0000","objects_scrubbed":0,"log_size":4602,"log_dups_size":0,"ondisk_log_size":4602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:37.068481+0000","scrub_duration":0.026253420999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":267458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3142","reported_seq":3177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:16.250259+0000","last_change":"2024-05-08T20:56:16.250519+0000","last_active":"2024-05-08T20:56:16.250259+0000","last_peered":"2024-05-08T20:56:16.250259+0000","last_clean":"2024-05-08T20:56:16.250259+0000","last_became_active":"2024-05-08T20:27:27.998893+0000","last_became_peered":"2024-05-08T20:27:27.998893+0000","last_unstale":"2024-05-08T20:56:16.250259+0000","last_undegraded":"2024-05-08T20:56:16.250259+0000","last_fullsized":"2024-05-08T20:56:16.250259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3142","last_scrub_stamp":"2024-05-08T20:56:16.250181+0000","last_deep_scrub":"26'3142","last_deep_scrub_stamp":"2024-05-08T20:56:16.250181+0000","last_clean_scrub_stamp":"2024-05-08T20:56:16.250181+0000","objects_scrubbed":0,"log_size":3142,"log_dups_size":0,"ondisk_log_size":3142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.248105+0000","scrub_duration":0.023840109000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17271,"num_write_kb":208497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4689","reported_seq":4729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:42.941519+0000","last_change":"2024-05-08T20:54:42.941519+0000","last_active":"2024-05-08T20:54:42.941519+0000","last_peered":"2024-05-08T20:54:42.941519+0000","last_clean":"2024-05-08T20:54:42.941519+0000","last_became_active":"2024-05-08T20:27:18.885940+0000","last_became_peered":"2024-05-08T20:27:18.885940+0000","last_unstale":"2024-05-08T20:54:42.941519+0000","last_undegraded":"2024-05-08T20:54:42.941519+0000","last_fullsized":"2024-05-08T20:54:42.941519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4689","last_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_deep_scrub":"26'4689","last_deep_scrub_stamp":"2024-05-08T20:54:42.941381+0000","last_clean_scrub_stamp":"2024-05-08T20:54:42.941381+0000","objects_scrubbed":0,"log_size":4689,"log_dups_size":0,"ondisk_log_size":4689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:27:41.187924+0000","scrub_duration":0.030470918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24599,"num_write_kb":287244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4190","reported_seq":4225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:06.836813+0000","last_change":"2024-05-08T20:56:06.837052+0000","last_active":"2024-05-08T20:56:06.836813+0000","last_peered":"2024-05-08T20:56:06.836813+0000","last_clean":"2024-05-08T20:56:06.836813+0000","last_became_active":"2024-05-08T20:27:28.002066+0000","last_became_peered":"2024-05-08T20:27:28.002066+0000","last_unstale":"2024-05-08T20:56:06.836813+0000","last_undegraded":"2024-05-08T20:56:06.836813+0000","last_fullsized":"2024-05-08T20:56:06.836813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4190","last_scrub_stamp":"2024-05-08T20:56:06.836757+0000","last_deep_scrub":"26'4190","last_deep_scrub_stamp":"2024-05-08T20:56:06.836757+0000","last_clean_scrub_stamp":"2024-05-08T20:56:06.836757+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:40.251293+0000","scrub_duration":0.074218645999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23180,"num_write_kb":293624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'4626","reported_seq":4666,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:10.450576+0000","last_change":"2024-05-08T20:55:10.450576+0000","last_active":"2024-05-08T20:55:10.450576+0000","last_peered":"2024-05-08T20:55:10.450576+0000","last_clean":"2024-05-08T20:55:10.450576+0000","last_became_active":"2024-05-08T20:27:18.885714+0000","last_became_peered":"2024-05-08T20:27:18.885714+0000","last_unstale":"2024-05-08T20:55:10.450576+0000","last_undegraded":"2024-05-08T20:55:10.450576+0000","last_fullsized":"2024-05-08T20:55:10.450576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4626","last_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_deep_scrub":"26'4626","last_deep_scrub_stamp":"2024-05-08T20:55:10.450304+0000","last_clean_scrub_stamp":"2024-05-08T20:55:10.450304+0000","objects_scrubbed":0,"log_size":4626,"log_dups_size":0,"ondisk_log_size":4626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:20.915560+0000","scrub_duration":0.011125820999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24777,"num_write_kb":259368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4345","reported_seq":4381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:52.515090+0000","last_change":"2024-05-08T20:55:52.515388+0000","last_active":"2024-05-08T20:55:52.515090+0000","last_peered":"2024-05-08T20:55:52.515090+0000","last_clean":"2024-05-08T20:55:52.515090+0000","last_became_active":"2024-05-08T20:27:27.976726+0000","last_became_peered":"2024-05-08T20:27:27.976726+0000","last_unstale":"2024-05-08T20:55:52.515090+0000","last_undegraded":"2024-05-08T20:55:52.515090+0000","last_fullsized":"2024-05-08T20:55:52.515090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4345","last_scrub_stamp":"2024-05-08T20:55:52.515029+0000","last_deep_scrub":"26'4345","last_deep_scrub_stamp":"2024-05-08T20:55:52.515029+0000","last_clean_scrub_stamp":"2024-05-08T20:55:52.515029+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:48.805687+0000","scrub_duration":0.051040321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23854,"num_write_kb":284156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3688","reported_seq":3728,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:16.891829+0000","last_change":"2024-05-08T20:55:16.891829+0000","last_active":"2024-05-08T20:55:16.891829+0000","last_peered":"2024-05-08T20:55:16.891829+0000","last_clean":"2024-05-08T20:55:16.891829+0000","last_became_active":"2024-05-08T20:27:18.917269+0000","last_became_peered":"2024-05-08T20:27:18.917269+0000","last_unstale":"2024-05-08T20:55:16.891829+0000","last_undegraded":"2024-05-08T20:55:16.891829+0000","last_fullsized":"2024-05-08T20:55:16.891829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3688","last_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_deep_scrub":"26'3688","last_deep_scrub_stamp":"2024-05-08T20:55:16.891490+0000","last_clean_scrub_stamp":"2024-05-08T20:55:16.891490+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:25.749773+0000","scrub_duration":0.012960828000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18844,"num_write_kb":214965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'3316","reported_seq":3351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.540769+0000","last_change":"2024-05-08T20:55:13.541058+0000","last_active":"2024-05-08T20:55:13.540769+0000","last_peered":"2024-05-08T20:55:13.540769+0000","last_clean":"2024-05-08T20:55:13.540769+0000","last_became_active":"2024-05-08T20:27:27.968836+0000","last_became_peered":"2024-05-08T20:27:27.968836+0000","last_unstale":"2024-05-08T20:55:13.540769+0000","last_undegraded":"2024-05-08T20:55:13.540769+0000","last_fullsized":"2024-05-08T20:55:13.540769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3316","last_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_deep_scrub":"26'3316","last_deep_scrub_stamp":"2024-05-08T20:55:13.540711+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.540711+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:12.992902+0000","scrub_duration":0.076822395000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18493,"num_write_kb":234192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'5609","reported_seq":5649,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:51.474745+0000","last_change":"2024-05-08T20:54:51.474745+0000","last_active":"2024-05-08T20:54:51.474745+0000","last_peered":"2024-05-08T20:54:51.474745+0000","last_clean":"2024-05-08T20:54:51.474745+0000","last_became_active":"2024-05-08T20:27:18.932085+0000","last_became_peered":"2024-05-08T20:27:18.932085+0000","last_unstale":"2024-05-08T20:54:51.474745+0000","last_undegraded":"2024-05-08T20:54:51.474745+0000","last_fullsized":"2024-05-08T20:54:51.474745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5609","last_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_deep_scrub":"26'5609","last_deep_scrub_stamp":"2024-05-08T20:54:51.474437+0000","last_clean_scrub_stamp":"2024-05-08T20:54:51.474437+0000","objects_scrubbed":0,"log_size":5609,"log_dups_size":0,"ondisk_log_size":5609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:37.535496+0000","scrub_duration":0.017226228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29717,"num_write_kb":320036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'4527","reported_seq":4563,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:13.729274+0000","last_change":"2024-05-08T20:55:13.729274+0000","last_active":"2024-05-08T20:55:13.729274+0000","last_peered":"2024-05-08T20:55:13.729274+0000","last_clean":"2024-05-08T20:55:13.729274+0000","last_became_active":"2024-05-08T20:27:28.000389+0000","last_became_peered":"2024-05-08T20:27:28.000389+0000","last_unstale":"2024-05-08T20:55:13.729274+0000","last_undegraded":"2024-05-08T20:55:13.729274+0000","last_fullsized":"2024-05-08T20:55:13.729274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4527","last_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_deep_scrub":"26'4527","last_deep_scrub_stamp":"2024-05-08T20:55:13.728968+0000","last_clean_scrub_stamp":"2024-05-08T20:55:13.728968+0000","objects_scrubbed":0,"log_size":4527,"log_dups_size":0,"ondisk_log_size":4527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:30.126015+0000","scrub_duration":0.045784956000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25053,"num_write_kb":297077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'5845","reported_seq":5893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:45.487445+0000","last_change":"2024-05-08T20:54:45.487445+0000","last_active":"2024-05-08T20:54:45.487445+0000","last_peered":"2024-05-08T20:54:45.487445+0000","last_clean":"2024-05-08T20:54:45.487445+0000","last_became_active":"2024-05-08T20:28:00.412289+0000","last_became_peered":"2024-05-08T20:28:00.412289+0000","last_unstale":"2024-05-08T20:54:45.487445+0000","last_undegraded":"2024-05-08T20:54:45.487445+0000","last_fullsized":"2024-05-08T20:54:45.487445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5845","last_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_deep_scrub":"26'5845","last_deep_scrub_stamp":"2024-05-08T20:54:45.487159+0000","last_clean_scrub_stamp":"2024-05-08T20:54:45.487159+0000","objects_scrubbed":0,"log_size":5845,"log_dups_size":0,"ondisk_log_size":5845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:35.646681+0000","scrub_duration":0.033861688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30833,"num_write_kb":344793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'3505","reported_seq":3541,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:19.154336+0000","last_change":"2024-05-08T20:55:19.154336+0000","last_active":"2024-05-08T20:55:19.154336+0000","last_peered":"2024-05-08T20:55:19.154336+0000","last_clean":"2024-05-08T20:55:19.154336+0000","last_became_active":"2024-05-08T20:27:27.992795+0000","last_became_peered":"2024-05-08T20:27:27.992795+0000","last_unstale":"2024-05-08T20:55:19.154336+0000","last_undegraded":"2024-05-08T20:55:19.154336+0000","last_fullsized":"2024-05-08T20:55:19.154336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3505","last_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_deep_scrub":"26'3505","last_deep_scrub_stamp":"2024-05-08T20:55:19.154016+0000","last_clean_scrub_stamp":"2024-05-08T20:55:19.154016+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:16.617871+0000","scrub_duration":0.075724768999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":249926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'6642","reported_seq":6681,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.715004+0000","last_change":"2024-05-08T20:55:15.715259+0000","last_active":"2024-05-08T20:55:15.715004+0000","last_peered":"2024-05-08T20:55:15.715004+0000","last_clean":"2024-05-08T20:55:15.715004+0000","last_became_active":"2024-05-08T20:27:18.932450+0000","last_became_peered":"2024-05-08T20:27:18.932450+0000","last_unstale":"2024-05-08T20:55:15.715004+0000","last_undegraded":"2024-05-08T20:55:15.715004+0000","last_fullsized":"2024-05-08T20:55:15.715004+0000","mapping_epoch":18,"log_start":"26'900","ondisk_log_start":"26'900","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6642","last_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_deep_scrub":"26'6642","last_deep_scrub_stamp":"2024-05-08T20:55:15.714948+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.714948+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:11.017870+0000","scrub_duration":0.018435876,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35979,"num_write_kb":386188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5277","reported_seq":5314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:59.553584+0000","last_change":"2024-05-08T20:55:59.553907+0000","last_active":"2024-05-08T20:55:59.553584+0000","last_peered":"2024-05-08T20:55:59.553584+0000","last_clean":"2024-05-08T20:55:59.553584+0000","last_became_active":"2024-05-08T20:27:27.979933+0000","last_became_peered":"2024-05-08T20:27:27.979933+0000","last_unstale":"2024-05-08T20:55:59.553584+0000","last_undegraded":"2024-05-08T20:55:59.553584+0000","last_fullsized":"2024-05-08T20:55:59.553584+0000","mapping_epoch":22,"log_start":"26'100","ondisk_log_start":"26'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5277","last_scrub_stamp":"2024-05-08T20:55:59.553519+0000","last_deep_scrub":"26'5277","last_deep_scrub_stamp":"2024-05-08T20:55:59.553519+0000","last_clean_scrub_stamp":"2024-05-08T20:55:59.553519+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.653883+0000","scrub_duration":0.067196559000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28768,"num_write_kb":361247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'5499","reported_seq":5532,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:55.587903+0000","last_change":"2024-05-08T20:55:55.588153+0000","last_active":"2024-05-08T20:55:55.587903+0000","last_peered":"2024-05-08T20:55:55.587903+0000","last_clean":"2024-05-08T20:55:55.587903+0000","last_became_active":"2024-05-08T20:28:00.413321+0000","last_became_peered":"2024-05-08T20:28:00.413321+0000","last_unstale":"2024-05-08T20:55:55.587903+0000","last_undegraded":"2024-05-08T20:55:55.587903+0000","last_fullsized":"2024-05-08T20:55:55.587903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5499","last_scrub_stamp":"2024-05-08T20:55:55.587847+0000","last_deep_scrub":"26'5499","last_deep_scrub_stamp":"2024-05-08T20:55:55.587847+0000","last_clean_scrub_stamp":"2024-05-08T20:55:55.587847+0000","objects_scrubbed":0,"log_size":5499,"log_dups_size":0,"ondisk_log_size":5499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:57.508355+0000","scrub_duration":0.046845655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28692,"num_write_kb":328127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"26'4019","reported_seq":4056,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:39.437920+0000","last_change":"2024-05-08T20:55:39.438189+0000","last_active":"2024-05-08T20:55:39.437920+0000","last_peered":"2024-05-08T20:55:39.437920+0000","last_clean":"2024-05-08T20:55:39.437920+0000","last_became_active":"2024-05-08T20:27:28.008848+0000","last_became_peered":"2024-05-08T20:27:28.008848+0000","last_unstale":"2024-05-08T20:55:39.437920+0000","last_undegraded":"2024-05-08T20:55:39.437920+0000","last_fullsized":"2024-05-08T20:55:39.437920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4019","last_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_deep_scrub":"26'4019","last_deep_scrub_stamp":"2024-05-08T20:55:39.437865+0000","last_clean_scrub_stamp":"2024-05-08T20:55:39.437865+0000","objects_scrubbed":0,"log_size":4019,"log_dups_size":0,"ondisk_log_size":4019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:21.643997+0000","scrub_duration":0.022369057000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22458,"num_write_kb":278525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'5870","reported_seq":5909,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:07.628544+0000","last_change":"2024-05-08T20:55:07.628786+0000","last_active":"2024-05-08T20:55:07.628544+0000","last_peered":"2024-05-08T20:55:07.628544+0000","last_clean":"2024-05-08T20:55:07.628544+0000","last_became_active":"2024-05-08T20:27:18.902700+0000","last_became_peered":"2024-05-08T20:27:18.902700+0000","last_unstale":"2024-05-08T20:55:07.628544+0000","last_undegraded":"2024-05-08T20:55:07.628544+0000","last_fullsized":"2024-05-08T20:55:07.628544+0000","mapping_epoch":18,"log_start":"26'200","ondisk_log_start":"26'200","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5870","last_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_deep_scrub":"26'5870","last_deep_scrub_stamp":"2024-05-08T20:55:07.628488+0000","last_clean_scrub_stamp":"2024-05-08T20:55:07.628488+0000","objects_scrubbed":0,"log_size":5670,"log_dups_size":0,"ondisk_log_size":5670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:16:59.204406+0000","scrub_duration":0.036094273000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31464,"num_write_kb":343303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"26'3793","reported_seq":3831,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:47.708561+0000","last_change":"2024-05-08T20:55:47.708667+0000","last_active":"2024-05-08T20:55:47.708561+0000","last_peered":"2024-05-08T20:55:47.708561+0000","last_clean":"2024-05-08T20:55:47.708561+0000","last_became_active":"2024-05-08T20:27:28.016279+0000","last_became_peered":"2024-05-08T20:27:28.016279+0000","last_unstale":"2024-05-08T20:55:47.708561+0000","last_undegraded":"2024-05-08T20:55:47.708561+0000","last_fullsized":"2024-05-08T20:55:47.708561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3793","last_scrub_stamp":"2024-05-08T20:55:47.708538+0000","last_deep_scrub":"26'3793","last_deep_scrub_stamp":"2024-05-08T20:55:47.708538+0000","last_clean_scrub_stamp":"2024-05-08T20:55:47.708538+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:52.051746+0000","scrub_duration":0.114960331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22035,"num_write_kb":264645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'4536","reported_seq":4575,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:02.154571+0000","last_change":"2024-05-08T20:55:02.154865+0000","last_active":"2024-05-08T20:55:02.154571+0000","last_peered":"2024-05-08T20:55:02.154571+0000","last_clean":"2024-05-08T20:55:02.154571+0000","last_became_active":"2024-05-08T20:27:18.927840+0000","last_became_peered":"2024-05-08T20:27:18.927840+0000","last_unstale":"2024-05-08T20:55:02.154571+0000","last_undegraded":"2024-05-08T20:55:02.154571+0000","last_fullsized":"2024-05-08T20:55:02.154571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4536","last_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_deep_scrub":"26'4536","last_deep_scrub_stamp":"2024-05-08T20:55:02.154517+0000","last_clean_scrub_stamp":"2024-05-08T20:55:02.154517+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:54.549611+0000","scrub_duration":0.047608635000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23689,"num_write_kb":275274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4520","reported_seq":4557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:44.226392+0000","last_change":"2024-05-08T20:55:44.226628+0000","last_active":"2024-05-08T20:55:44.226392+0000","last_peered":"2024-05-08T20:55:44.226392+0000","last_clean":"2024-05-08T20:55:44.226392+0000","last_became_active":"2024-05-08T20:27:27.994696+0000","last_became_peered":"2024-05-08T20:27:27.994696+0000","last_unstale":"2024-05-08T20:55:44.226392+0000","last_undegraded":"2024-05-08T20:55:44.226392+0000","last_fullsized":"2024-05-08T20:55:44.226392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4520","last_scrub_stamp":"2024-05-08T20:55:44.226335+0000","last_deep_scrub":"26'4520","last_deep_scrub_stamp":"2024-05-08T20:55:44.226335+0000","last_clean_scrub_stamp":"2024-05-08T20:55:44.226335+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:28.141864+0000","scrub_duration":0.064812995999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24986,"num_write_kb":313338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4811","reported_seq":4850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:05.592398+0000","last_change":"2024-05-08T20:55:05.592654+0000","last_active":"2024-05-08T20:55:05.592398+0000","last_peered":"2024-05-08T20:55:05.592398+0000","last_clean":"2024-05-08T20:55:05.592398+0000","last_became_active":"2024-05-08T20:27:18.913799+0000","last_became_peered":"2024-05-08T20:27:18.913799+0000","last_unstale":"2024-05-08T20:55:05.592398+0000","last_undegraded":"2024-05-08T20:55:05.592398+0000","last_fullsized":"2024-05-08T20:55:05.592398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4811","last_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_deep_scrub":"26'4811","last_deep_scrub_stamp":"2024-05-08T20:55:05.592322+0000","last_clean_scrub_stamp":"2024-05-08T20:55:05.592322+0000","objects_scrubbed":0,"log_size":4811,"log_dups_size":0,"ondisk_log_size":4811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:00.479073+0000","scrub_duration":0.018874953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23793,"num_write_kb":283951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3740","reported_seq":3775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:56.469720+0000","last_change":"2024-05-08T20:55:56.470002+0000","last_active":"2024-05-08T20:55:56.469720+0000","last_peered":"2024-05-08T20:55:56.469720+0000","last_clean":"2024-05-08T20:55:56.469720+0000","last_became_active":"2024-05-08T20:27:28.210605+0000","last_became_peered":"2024-05-08T20:27:28.210605+0000","last_unstale":"2024-05-08T20:55:56.469720+0000","last_undegraded":"2024-05-08T20:55:56.469720+0000","last_fullsized":"2024-05-08T20:55:56.469720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3740","last_scrub_stamp":"2024-05-08T20:55:56.469646+0000","last_deep_scrub":"26'3740","last_deep_scrub_stamp":"2024-05-08T20:55:56.469646+0000","last_clean_scrub_stamp":"2024-05-08T20:55:56.469646+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:28.879490+0000","scrub_duration":0.027286621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20280,"num_write_kb":261466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'4709","reported_seq":4751,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:54.172178+0000","last_change":"2024-05-08T20:54:54.172178+0000","last_active":"2024-05-08T20:54:54.172178+0000","last_peered":"2024-05-08T20:54:54.172178+0000","last_clean":"2024-05-08T20:54:54.172178+0000","last_became_active":"2024-05-08T20:27:18.928248+0000","last_became_peered":"2024-05-08T20:27:18.928248+0000","last_unstale":"2024-05-08T20:54:54.172178+0000","last_undegraded":"2024-05-08T20:54:54.172178+0000","last_fullsized":"2024-05-08T20:54:54.172178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4709","last_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_deep_scrub":"26'4709","last_deep_scrub_stamp":"2024-05-08T20:54:54.171276+0000","last_clean_scrub_stamp":"2024-05-08T20:54:54.171276+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:26.280762+0000","scrub_duration":0.026438705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25837,"num_write_kb":279769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'3900","reported_seq":3935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:15.500842+0000","last_change":"2024-05-08T20:55:15.501128+0000","last_active":"2024-05-08T20:55:15.500842+0000","last_peered":"2024-05-08T20:55:15.500842+0000","last_clean":"2024-05-08T20:55:15.500842+0000","last_became_active":"2024-05-08T20:27:27.975179+0000","last_became_peered":"2024-05-08T20:27:27.975179+0000","last_unstale":"2024-05-08T20:55:15.500842+0000","last_undegraded":"2024-05-08T20:55:15.500842+0000","last_fullsized":"2024-05-08T20:55:15.500842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3900","last_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_deep_scrub":"26'3900","last_deep_scrub_stamp":"2024-05-08T20:55:15.500780+0000","last_clean_scrub_stamp":"2024-05-08T20:55:15.500780+0000","objects_scrubbed":0,"log_size":3900,"log_dups_size":0,"ondisk_log_size":3900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:36.458071+0000","scrub_duration":0.028467224999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20507,"num_write_kb":270751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'5638","reported_seq":5679,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:03.101942+0000","last_change":"2024-05-08T20:55:03.102295+0000","last_active":"2024-05-08T20:55:03.101942+0000","last_peered":"2024-05-08T20:55:03.101942+0000","last_clean":"2024-05-08T20:55:03.101942+0000","last_became_active":"2024-05-08T20:27:18.882417+0000","last_became_peered":"2024-05-08T20:27:18.882417+0000","last_unstale":"2024-05-08T20:55:03.101942+0000","last_undegraded":"2024-05-08T20:55:03.101942+0000","last_fullsized":"2024-05-08T20:55:03.101942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5638","last_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_deep_scrub":"26'5638","last_deep_scrub_stamp":"2024-05-08T20:55:03.101828+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.101828+0000","objects_scrubbed":0,"log_size":5638,"log_dups_size":0,"ondisk_log_size":5638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:45.438163+0000","scrub_duration":0.077280746999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29560,"num_write_kb":331674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4354","reported_seq":4389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:56:02.748759+0000","last_change":"2024-05-08T20:56:02.748998+0000","last_active":"2024-05-08T20:56:02.748759+0000","last_peered":"2024-05-08T20:56:02.748759+0000","last_clean":"2024-05-08T20:56:02.748759+0000","last_became_active":"2024-05-08T20:27:27.986839+0000","last_became_peered":"2024-05-08T20:27:27.986839+0000","last_unstale":"2024-05-08T20:56:02.748759+0000","last_undegraded":"2024-05-08T20:56:02.748759+0000","last_fullsized":"2024-05-08T20:56:02.748759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4354","last_scrub_stamp":"2024-05-08T20:56:02.748702+0000","last_deep_scrub":"26'4354","last_deep_scrub_stamp":"2024-05-08T20:56:02.748702+0000","last_clean_scrub_stamp":"2024-05-08T20:56:02.748702+0000","objects_scrubbed":0,"log_size":4354,"log_dups_size":0,"ondisk_log_size":4354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:44.308337+0000","scrub_duration":0.067721527000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":306995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'6644","reported_seq":6685,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:49.773320+0000","last_change":"2024-05-08T20:54:49.773606+0000","last_active":"2024-05-08T20:54:49.773320+0000","last_peered":"2024-05-08T20:54:49.773320+0000","last_clean":"2024-05-08T20:54:49.773320+0000","last_became_active":"2024-05-08T20:27:18.889740+0000","last_became_peered":"2024-05-08T20:27:18.889740+0000","last_unstale":"2024-05-08T20:54:49.773320+0000","last_undegraded":"2024-05-08T20:54:49.773320+0000","last_fullsized":"2024-05-08T20:54:49.773320+0000","mapping_epoch":18,"log_start":"26'800","ondisk_log_start":"26'800","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6644","last_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_deep_scrub":"26'6644","last_deep_scrub_stamp":"2024-05-08T20:54:49.773265+0000","last_clean_scrub_stamp":"2024-05-08T20:54:49.773265+0000","objects_scrubbed":0,"log_size":5844,"log_dups_size":0,"ondisk_log_size":5844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:23.617467+0000","scrub_duration":0.054899599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35294,"num_write_kb":387311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4746","reported_seq":4781,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:55:22.832111+0000","last_change":"2024-05-08T20:55:22.832380+0000","last_active":"2024-05-08T20:55:22.832111+0000","last_peered":"2024-05-08T20:55:22.832111+0000","last_clean":"2024-05-08T20:55:22.832111+0000","last_became_active":"2024-05-08T20:27:27.999461+0000","last_became_peered":"2024-05-08T20:27:27.999461+0000","last_unstale":"2024-05-08T20:55:22.832111+0000","last_undegraded":"2024-05-08T20:55:22.832111+0000","last_fullsized":"2024-05-08T20:55:22.832111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4746","last_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_deep_scrub":"26'4746","last_deep_scrub_stamp":"2024-05-08T20:55:22.832058+0000","last_clean_scrub_stamp":"2024-05-08T20:55:22.832058+0000","objects_scrubbed":0,"log_size":4746,"log_dups_size":0,"ondisk_log_size":4746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:06.840030+0000","scrub_duration":0.062733702000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26482,"num_write_kb":323351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'5105","reported_seq":5146,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T20:54:48.584824+0000","last_change":"2024-05-08T20:54:48.585054+0000","last_active":"2024-05-08T20:54:48.584824+0000","last_peered":"2024-05-08T20:54:48.584824+0000","last_clean":"2024-05-08T20:54:48.584824+0000","last_became_active":"2024-05-08T20:27:18.912581+0000","last_became_peered":"2024-05-08T20:27:18.912581+0000","last_unstale":"2024-05-08T20:54:48.584824+0000","last_undegraded":"2024-05-08T20:54:48.584824+0000","last_fullsized":"2024-05-08T20:54:48.584824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5105","last_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_deep_scrub":"26'5105","last_deep_scrub_stamp":"2024-05-08T20:54:48.584770+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.584770+0000","objects_scrubbed":0,"log_size":5105,"log_dups_size":0,"ondisk_log_size":5105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:58.380211+0000","scrub_duration":0.012206140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27658,"num_write_kb":299437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543314,"num_write_kb":19298754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279187,"ondisk_log_size":279187,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18774620,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":61,"num_read_kb":124,"num_write":3836,"num_write_kb":19937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37609472,"data_stored":37549240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3558,"ondisk_log_size":3558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834483,"num_write_kb":20468330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336493,"ondisk_log_size":336493,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":19088394,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":69,"num_read_kb":130,"num_write":3840,"num_write_kb":20290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38240256,"data_stored":38176788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3566,"ondisk_log_size":3566,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575205,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1185636,"kb_used_data":13148,"kb_used_omap":1,"kb_used_meta":1172478,"kb_avail":93186204,"statfs":{"total":96636764160,"available":95422672896,"internally_reserved":0,"allocated":13463552,"data_stored":13286991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1200617931},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":2.6960000000000002,"15min":1.5840000000000001},"min":{"1min":0.59399999999999997,"5min":0.192,"15min":0.192},"max":{"1min":1.0169999999999999,"5min":39.850000000000001,"15min":39.850000000000001},"last":0.88},{"interface":"front","average":{"1min":1,"5min":1.4390000000000001,"15min":1.22},"min":{"1min":0.80300000000000005,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.139,"5min":34.091000000000001,"15min":34.091000000000001},"last":0.95599999999999996}]},{"osd":1,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.226,"15min":1.0880000000000001},"min":{"1min":0.622,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.2090000000000001,"5min":11.189,"15min":13.579000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.2290000000000001,"15min":1.141},"min":{"1min":0.65900000000000003,"5min":0.29599999999999999,"15min":0.255},"max":{"1min":1.071,"5min":11.260999999999999,"15min":13.467000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.4590000000000001,"15min":1.1659999999999999},"min":{"1min":0.69999999999999996,"5min":0.245,"15min":0.245},"max":{"1min":1.2370000000000001,"5min":33.950000000000003,"15min":33.950000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.548,"15min":1.3},"min":{"1min":0.89400000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"max":{"1min":1.3009999999999999,"5min":34.003999999999998,"15min":34.003999999999998},"last":0.995}]},{"osd":3,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.21,"15min":1.115},"min":{"1min":0.70699999999999996,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0569999999999999,"5min":11.215,"15min":15.532},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.5329999999999999,"15min":1.3939999999999999},"min":{"1min":0.76100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0860000000000001,"5min":16.584,"15min":16.584},"last":0.97599999999999998}]},{"osd":4,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":2.024,"15min":1.726},"min":{"1min":0.65000000000000002,"5min":0.255,"15min":0.214},"max":{"1min":1.294,"5min":34.046999999999997,"15min":34.046999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.5800000000000001,"15min":1.3400000000000001},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.246},"max":{"1min":1.0409999999999999,"5min":20.565999999999999,"15min":22.741},"last":0.73199999999999998}]},{"osd":5,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":2.2999999999999998,"15min":1.978},"min":{"1min":0.77100000000000002,"5min":0.34200000000000003,"15min":0.27600000000000002},"max":{"1min":1.274,"5min":20.626999999999999,"15min":33.679000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":2.165,"15min":1.5189999999999999},"min":{"1min":1.0609999999999999,"5min":0.309,"15min":0.28299999999999997},"max":{"1min":1.371,"5min":20.869,"15min":20.869},"last":1.0820000000000001}]},{"osd":6,"last update":"Wed May 8 20:56:04 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.528,"15min":1.2589999999999999},"min":{"1min":1.0209999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.4410000000000001,"5min":11.484,"15min":13.714},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.756,"15min":1.347},"min":{"1min":0.65300000000000002,"5min":0.33100000000000002,"15min":0.29099999999999998},"max":{"1min":1.2010000000000001,"5min":22.405000000000001,"15min":22.405000000000001},"last":0.627}]}]},{"osd":6,"up_from":13,"seq":55834575203,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":776104,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":765438,"kb_avail":93595736,"statfs":{"total":96636764160,"available":95842033664,"internally_reserved":0,"allocated":10911744,"data_stored":10728098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783808967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:05 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.163,"15min":0.995},"min":{"1min":0.59499999999999997,"5min":0.23899999999999999,"15min":0.20999999999999999},"max":{"1min":1.762,"5min":7.5679999999999996,"15min":7.5679999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.327,"15min":1.1559999999999999},"min":{"1min":0.63500000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2470000000000001,"5min":7.5919999999999996,"15min":7.5919999999999996},"last":0.96699999999999997}]},{"osd":1,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.0940000000000001,"15min":1.1699999999999999},"min":{"1min":0.67000000000000004,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":1.1899999999999999,"5min":5.8179999999999996,"15min":14.717000000000001},"last":1.234},{"interface":"front","average":{"1min":1.073,"5min":1.24,"15min":1.111},"min":{"1min":0.77200000000000002,"5min":0.32800000000000001,"15min":0.23300000000000001},"max":{"1min":1.8200000000000001,"5min":7.3810000000000002,"15min":14.404},"last":1.28}]},{"osd":2,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.1739999999999999,"15min":1.087},"min":{"1min":0.623,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":1.2549999999999999,"5min":9.907,"15min":9.907},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.1080000000000001,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.38400000000000001,"15min":0.254},"max":{"1min":1.3149999999999999,"5min":9.8030000000000008,"15min":9.8030000000000008},"last":1.101}]},{"osd":3,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.4330000000000001,"15min":1.3180000000000001},"min":{"1min":0.82099999999999995,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":1.5940000000000001,"5min":26.088999999999999,"15min":26.088999999999999},"last":1.079},{"interface":"front","average":{"1min":1.095,"5min":1.419,"15min":1.2430000000000001},"min":{"1min":0.72199999999999998,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":1.6719999999999999,"5min":13.960000000000001,"15min":13.960000000000001},"last":1.1919999999999999}]},{"osd":4,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.891,"15min":1.5549999999999999},"min":{"1min":0.62,"5min":0.32600000000000001,"15min":0.223},"max":{"1min":1.7849999999999999,"5min":30.094000000000001,"15min":30.094000000000001},"last":1.353},{"interface":"front","average":{"1min":1.177,"5min":1.6299999999999999,"15min":1.4450000000000001},"min":{"1min":0.85599999999999998,"5min":0.28199999999999997,"15min":0.26300000000000001},"max":{"1min":1.8280000000000001,"5min":29.538,"15min":29.538},"last":1.4159999999999999}]},{"osd":5,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.5169999999999999,"15min":1.196},"min":{"1min":0.58499999999999996,"5min":0.33500000000000002,"15min":0.25},"max":{"1min":1.4059999999999999,"5min":10.833,"15min":11.568},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.621,"15min":1.3200000000000001},"min":{"1min":0.92000000000000004,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":1.5329999999999999,"5min":10.872,"15min":11.593999999999999},"last":1.379}]},{"osd":7,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.5580000000000001,"15min":1.2569999999999999},"min":{"1min":0.64700000000000002,"5min":0.188,"15min":0.188},"max":{"1min":1.2330000000000001,"5min":10.339,"15min":12.77},"last":1.145},{"interface":"front","average":{"1min":1.085,"5min":1.732,"15min":1.3160000000000001},"min":{"1min":0.751,"5min":0.371,"15min":0.29699999999999999},"max":{"1min":1.6240000000000001,"5min":20.495999999999999,"15min":20.495999999999999},"last":1.45}]}]},{"osd":5,"up_from":13,"seq":55834575203,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1203128,"kb_used_data":4464,"kb_used_omap":1,"kb_used_meta":1198654,"kb_avail":93168712,"statfs":{"total":96636764160,"available":95404761088,"internally_reserved":0,"allocated":4571136,"data_stored":4392751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1227422150},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.57399999999999995,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.284,"5min":9.5250000000000004,"15min":9.5250000000000004},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.173,"15min":1.03},"min":{"1min":0.80400000000000005,"5min":0.27800000000000002,"15min":0.23599999999999999},"max":{"1min":1.2270000000000001,"5min":7.0039999999999996,"15min":7.0039999999999996},"last":0.88500000000000001}]},{"osd":1,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":2.609,"15min":2.335},"min":{"1min":0.72299999999999998,"5min":0.27100000000000002,"15min":0.20799999999999999},"max":{"1min":1.149,"5min":99.978999999999999,"15min":121.521},"last":1.01},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.5409999999999999,"15min":1.2370000000000001},"min":{"1min":0.73499999999999999,"5min":0.245,"15min":0.24099999999999999},"max":{"1min":1.1140000000000001,"5min":7.5529999999999999,"15min":18.957999999999998},"last":0.749}]},{"osd":2,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.4490000000000001,"15min":1.2290000000000001},"min":{"1min":0.67600000000000005,"5min":0.25,"15min":0.23699999999999999},"max":{"1min":1.3029999999999999,"5min":12.079000000000001,"15min":16.535},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.875,"5min":1.446,"15min":1.159},"min":{"1min":0.68000000000000005,"5min":0.27900000000000003,"15min":0.249},"max":{"1min":1.1140000000000001,"5min":8.7490000000000006,"15min":15.006},"last":0.95299999999999996}]},{"osd":3,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":3.0409999999999999,"15min":2.5259999999999998},"min":{"1min":0.83799999999999997,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":1.4450000000000001,"5min":99.861999999999995,"15min":121.498},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.704,"15min":1.3049999999999999},"min":{"1min":0.70199999999999996,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":1.1819999999999999,"5min":33.140000000000001,"15min":33.140000000000001},"last":0.81200000000000006}]},{"osd":4,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":2.6160000000000001,"15min":2.343},"min":{"1min":0.68000000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.496,"5min":100.571,"15min":121.464},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.474,"15min":1.202},"min":{"1min":0.64900000000000002,"5min":0.35999999999999999,"15min":0.21199999999999999},"max":{"1min":1.206,"5min":7.7110000000000003,"15min":8.2710000000000008},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.5680000000000001,"15min":1.355},"min":{"1min":0.64900000000000002,"5min":0.29599999999999999,"15min":0.248},"max":{"1min":1.302,"5min":15.048,"15min":15.048},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.5209999999999999,"15min":1.2350000000000001},"min":{"1min":0.71699999999999997,"5min":0.34100000000000003,"15min":0.23999999999999999},"max":{"1min":1.333,"5min":7.4969999999999999,"15min":11.56},"last":0.98399999999999999}]},{"osd":7,"last update":"Wed May 8 20:55:50 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.8490000000000002,"15min":2.0179999999999998},"min":{"1min":0.81399999999999995,"5min":0.33000000000000002,"15min":0.28499999999999998},"max":{"1min":1.4099999999999999,"5min":54.956000000000003,"15min":54.956000000000003},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.476,"15min":1.2529999999999999},"min":{"1min":0.749,"5min":0.432,"15min":0.30599999999999999},"max":{"1min":1.2110000000000001,"5min":9.4890000000000008,"15min":12.679},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575204,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1234060,"kb_used_data":12612,"kb_used_omap":1,"kb_used_meta":1221438,"kb_avail":93137780,"statfs":{"total":96636764160,"available":95373086720,"internally_reserved":0,"allocated":12914688,"data_stored":12722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1250752966},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.224,"15min":1.2569999999999999},"min":{"1min":0.64900000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.3420000000000001,"5min":16.045000000000002,"15min":28.303999999999998},"last":0.879},{"interface":"front","average":{"1min":1.038,"5min":1.306,"15min":1.22},"min":{"1min":0.83499999999999996,"5min":0.26700000000000002,"15min":0.23599999999999999},"max":{"1min":1.409,"5min":16.119,"15min":16.119},"last":0.85499999999999998}]},{"osd":1,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":1.5980000000000001,"15min":1.4219999999999999},"min":{"1min":0.66500000000000004,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1779999999999999,"5min":17.010000000000002,"15min":27.975000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.2470000000000001,"15min":1.087},"min":{"1min":0.70699999999999996,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.377,"5min":16.904,"15min":16.904},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.458,"15min":1.4750000000000001},"min":{"1min":0.73999999999999999,"5min":0.28499999999999998,"15min":0.27600000000000002},"max":{"1min":1.228,"5min":16.838999999999999,"15min":28.271999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.143,"15min":1.016},"min":{"1min":0.76800000000000002,"5min":0.29199999999999998,"15min":0.26600000000000001},"max":{"1min":1.3480000000000001,"5min":9.0139999999999993,"15min":9.0139999999999993},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":1.3069999999999999,"15min":1.546},"min":{"1min":0.70599999999999996,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.1799999999999999,"5min":16.077000000000002,"15min":16.449000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.2410000000000001,"15min":1.502},"min":{"1min":0.74099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1619999999999999,"5min":10.837,"15min":29.526},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":2.1509999999999998,"15min":1.474},"min":{"1min":0.69699999999999995,"5min":0.30199999999999999,"15min":0.22800000000000001},"max":{"1min":1.3220000000000001,"5min":25.030999999999999,"15min":25.030999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.3779999999999999,"15min":1.1839999999999999},"min":{"1min":0.58199999999999996,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":1.2709999999999999,"5min":9.0370000000000008,"15min":14.863},"last":1.137}]},{"osd":6,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.8720000000000001,"15min":1.323},"min":{"1min":0.67000000000000004,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2250000000000001,"5min":33.198,"15min":33.198},"last":1.091},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.9770000000000001,"15min":1.3720000000000001},"min":{"1min":0.73899999999999999,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":1.268,"5min":31.495999999999999,"15min":31.495999999999999},"last":1.2}]},{"osd":7,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":2.6899999999999999,"15min":1.8520000000000001},"min":{"1min":0.78500000000000003,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":1.5209999999999999,"5min":25.879000000000001,"15min":54.073999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":2.9159999999999999,"15min":1.9730000000000001},"min":{"1min":1.022,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":1.6339999999999999,"5min":35.164999999999999,"15min":54.113},"last":1.2330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575203,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191564,"kb_used_data":18628,"kb_used_omap":1,"kb_used_meta":1172926,"kb_avail":93180276,"statfs":{"total":96636764160,"available":95416602624,"internally_reserved":0,"allocated":19075072,"data_stored":18887454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1201076680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.97399999999999998,"15min":0.95599999999999996},"min":{"1min":0.48099999999999998,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.80500000000000005,"5min":16.861999999999998,"15min":16.861999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.64900000000000002,"5min":0.192,"15min":0.192},"max":{"1min":1.018,"5min":16.960999999999999,"15min":16.960999999999999},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed May 8 20:56:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.88500000000000001,"15min":1.0189999999999999},"min":{"1min":0.53400000000000003,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.85299999999999998,"5min":12.204000000000001,"15min":16.355},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.83399999999999996,"15min":0.85199999999999998},"min":{"1min":0.57499999999999996,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":1.3109999999999999,"5min":6.3140000000000001,"15min":9.7230000000000008},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.276,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":1.242,"5min":17.106000000000002,"15min":17.106000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88100000000000001,"15min":0.83899999999999997},"min":{"1min":0.68899999999999995,"5min":0.191,"15min":0.191},"max":{"1min":1.0489999999999999,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.4119999999999999,"15min":1.0980000000000001},"min":{"1min":0.80400000000000005,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1850000000000001,"5min":16.885999999999999,"15min":16.885999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3240000000000001,"15min":1.0549999999999999},"min":{"1min":0.83199999999999996,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.21,"5min":16.917000000000002,"15min":16.917000000000002},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.3480000000000001,"15min":1.9219999999999999},"min":{"1min":0.79800000000000004,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.3089999999999999,"5min":12.167999999999999,"15min":117.105},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.323,"15min":1.1719999999999999},"min":{"1min":0.79100000000000004,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.335,"5min":9.9700000000000006,"15min":14.394},"last":0.84099999999999997}]},{"osd":6,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.4430000000000001,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3720000000000001,"5min":10.834,"15min":16.113},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.4950000000000001,"15min":1.2330000000000001},"min":{"1min":1.0169999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.573,"5min":16.992999999999999,"15min":16.992999999999999},"last":0.93899999999999995}]},{"osd":7,"last update":"Wed May 8 20:56:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.4810000000000001,"15min":1.3680000000000001},"min":{"1min":0.90100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.677,"5min":16.977,"15min":16.977},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.4059999999999999,"15min":1.294},"min":{"1min":0.93200000000000005,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":1.3400000000000001,"5min":13.092000000000001,"15min":15.289999999999999},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753328,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":752958,"kb_avail":93618512,"statfs":{"total":96636764160,"available":95865356288,"internally_reserved":0,"allocated":368640,"data_stored":197654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":771029446},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70799999999999996,"15min":0.86799999999999999},"min":{"1min":0.54700000000000004,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.81999999999999995,"5min":7.5679999999999996,"15min":12.609999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.872,"15min":0.91500000000000004},"min":{"1min":0.56799999999999995,"5min":0.189,"15min":0.189},"max":{"1min":0.85199999999999998,"5min":8.7889999999999997,"15min":12.359999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.84199999999999997,"15min":0.78700000000000003},"min":{"1min":0.50800000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.98099999999999998,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.70199999999999996,"15min":0.77300000000000002},"min":{"1min":0.61499999999999999,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":1.052,"5min":6.0380000000000003,"15min":6.7009999999999996},"last":0.873}]},{"osd":3,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.014,"15min":0.95399999999999996},"min":{"1min":0.59599999999999997,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.252,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.073,"15min":0.97799999999999998},"min":{"1min":0.69999999999999996,"5min":0.255,"15min":0.255},"max":{"1min":1.1319999999999999,"5min":10.510999999999999,"15min":10.510999999999999},"last":1.0660000000000001}]},{"osd":4,"last update":"Wed May 8 20:56:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.6259999999999999,"15min":1.2589999999999999},"min":{"1min":0.71599999999999997,"5min":0.29899999999999999,"15min":0.28599999999999998},"max":{"1min":1.2010000000000001,"5min":13.829000000000001,"15min":13.829000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.4730000000000001,"15min":1.234},"min":{"1min":0.747,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2689999999999999,"5min":18.065000000000001,"15min":18.065000000000001},"last":1.427}]},{"osd":5,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.421,"15min":1.3160000000000001},"min":{"1min":0.68300000000000005,"5min":0.31,"15min":0.27100000000000002},"max":{"1min":1.2909999999999999,"5min":9.2910000000000004,"15min":22.489000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.462,"15min":1.2390000000000001},"min":{"1min":0.83999999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3480000000000001,"5min":12.234,"15min":14.968999999999999},"last":1.504}]},{"osd":6,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.355,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.274,"5min":7.6520000000000001,"15min":9.7370000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.4379999999999999,"15min":1.2010000000000001},"min":{"1min":0.84399999999999997,"5min":0.34999999999999998,"15min":0.34899999999999998},"max":{"1min":1.321,"5min":12.553000000000001,"15min":12.553000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Wed May 8 20:55:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.7150000000000001,"15min":1.4319999999999999},"min":{"1min":0.91700000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.393,"5min":13.663,"15min":13.663},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.8160000000000001,"15min":1.5049999999999999},"min":{"1min":0.879,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.4259999999999999,"5min":13.33,"15min":19.201000000000001},"last":1.3340000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575202,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1008876,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":1000382,"kb_avail":93362964,"statfs":{"total":96636764160,"available":95603675136,"internally_reserved":0,"allocated":8687616,"data_stored":8502501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1024391622},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.39000000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.874,"5min":14.736000000000001,"15min":14.736000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0209999999999999,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.1359999999999999,"5min":21.094999999999999,"15min":21.094999999999999},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.81999999999999995,"15min":0.89000000000000001},"min":{"1min":0.55000000000000004,"5min":0.20000000000000001,"15min":0.188},"max":{"1min":0.97099999999999997,"5min":13.961,"15min":13.961},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85999999999999999,"15min":0.85399999999999998},"min":{"1min":0.56799999999999995,"5min":0.224,"15min":0.20799999999999999},"max":{"1min":1.1919999999999999,"5min":14.760999999999999,"15min":14.760999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.9179999999999999,"15min":1.4730000000000001},"min":{"1min":0.48099999999999998,"5min":0.27000000000000002,"15min":0.215},"max":{"1min":1.173,"5min":75.052000000000007,"15min":75.052000000000007},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.749,"5min":1.5409999999999999,"15min":1.218},"min":{"1min":0.51800000000000002,"5min":0.254,"15min":0.20399999999999999},"max":{"1min":1.014,"5min":61.957000000000001,"15min":61.957000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":1.0820000000000001,"15min":1.141},"min":{"1min":0.70999999999999996,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.145,"5min":14.002000000000001,"15min":14.002000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.012,"15min":1.042},"min":{"1min":0.64000000000000001,"5min":0.29899999999999999,"15min":0.26700000000000002},"max":{"1min":1.2709999999999999,"5min":3.8220000000000001,"15min":9.5630000000000006},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.77,"15min":1.871},"min":{"1min":0.75800000000000001,"5min":0.315,"15min":0.27900000000000003},"max":{"1min":1.2609999999999999,"5min":21.469000000000001,"15min":68.162000000000006},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.6180000000000001,"15min":1.3120000000000001},"min":{"1min":0.70299999999999996,"5min":0.316,"15min":0.316},"max":{"1min":1.353,"5min":23.742000000000001,"15min":23.742000000000001},"last":1.1339999999999999}]},{"osd":6,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.401,"15min":1.228},"min":{"1min":0.77900000000000003,"5min":0.33200000000000002,"15min":0.27900000000000003},"max":{"1min":1.222,"5min":14.032,"15min":14.032},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.222,"15min":1.143},"min":{"1min":0.74399999999999999,"5min":0.36599999999999999,"15min":0.28499999999999998},"max":{"1min":1.401,"5min":14.164999999999999,"15min":14.164999999999999},"last":1.0469999999999999}]},{"osd":7,"last update":"Wed May 8 20:55:59 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.8140000000000001,"15min":1.6819999999999999},"min":{"1min":0.78900000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.321,"5min":21.734000000000002,"15min":26.881},"last":1.101},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.4350000000000001,"15min":1.339},"min":{"1min":0.82399999999999995,"5min":0.36099999999999999,"15min":0.34799999999999998},"max":{"1min":1.2170000000000001,"5min":13.946999999999999,"15min":13.946999999999999},"last":1.157}]}]},{"osd":0,"up_from":13,"seq":55834575202,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":997284,"kb_used_data":9052,"kb_used_omap":1,"kb_used_meta":988222,"kb_avail":93374556,"statfs":{"total":96636764160,"available":95615545344,"internally_reserved":0,"allocated":9269248,"data_stored":9091634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1011939782},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.753,"15min":0.69799999999999995},"min":{"1min":0.45200000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.78800000000000003,"5min":11.516999999999999,"15min":11.516999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.85899999999999999},"min":{"1min":0.52700000000000002,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.2849999999999999,"5min":8.8330000000000002,"15min":13.305},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.88800000000000001,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.90700000000000003,"5min":15.212,"15min":15.212},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.94099999999999995,"15min":0.84299999999999997},"min":{"1min":0.63100000000000001,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.96199999999999997,"5min":15.138999999999999,"15min":15.138999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84399999999999997,"15min":0.86599999999999999},"min":{"1min":0.70599999999999996,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":1.038,"5min":6.7279999999999998,"15min":6.7279999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.84799999999999998,"5min":0.32300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1439999999999999,"5min":6.758,"15min":6.758},"last":0.87}]},{"osd":4,"last update":"Wed May 8 20:56:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.073,"15min":1.0980000000000001},"min":{"1min":0.71199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":1.157,"5min":7.7359999999999998,"15min":18.407},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.087,"15min":1.107},"min":{"1min":0.93400000000000005,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.228,"5min":7.6980000000000004,"15min":18.466999999999999},"last":1.03}]},{"osd":5,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.802,"15min":1.3129999999999999},"min":{"1min":0.85499999999999998,"5min":0.28100000000000003,"15min":0.27800000000000002},"max":{"1min":1.1319999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.528,"15min":1.2010000000000001},"min":{"1min":0.80600000000000005,"5min":0.312,"15min":0.312},"max":{"1min":1.24,"5min":14.375999999999999,"15min":14.375999999999999},"last":1.0600000000000001}]},{"osd":6,"last update":"Wed May 8 20:56:07 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.327,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.228,"5min":8.1349999999999998,"15min":8.1349999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":1.3080000000000001,"15min":1.1319999999999999},"min":{"1min":0.754,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":1.0840000000000001,"5min":8.9870000000000001,"15min":11.597},"last":0.82999999999999996}]},{"osd":7,"last update":"Wed May 8 20:56:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.7110000000000001,"15min":1.423},"min":{"1min":0.85699999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.3260000000000001,"5min":18.748999999999999,"15min":18.748999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.7669999999999999,"15min":1.51},"min":{"1min":0.89200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.375,"5min":18.788,"15min":18.788},"last":1.1040000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":84545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8482816,"data_stored":8473825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6419593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6430720,"data_stored":6420139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10313728,"data_stored":10300590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6201344,"data_stored":6190342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4288512,"data_stored":4279622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:27.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T20:56:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 Processor -- start 2024-05-08T20:56:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 -- start start 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f885806b840 0x7f88580c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8858154340 0x7f885815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885814e830 con 0x7f8858155070 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885806d6a0 con 0x7f885806b840 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f885ce61640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8858151900 con 0x7f8858154340 2024-05-08T20:56:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f885806b840 0x7f88580c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f885806b840 0x7f88580c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40484/0 (socket says 172.21.15.81:40484) 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 -- 172.21.15.81:0/2444008173 learned_addr learned my addr 172.21.15.81:0/2444008173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8856d9d640 1 --2- 172.21.15.81:0/2444008173 >> v2:172.21.15.117:3300/0 conn(0x7f8858154340 0x7f885815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 -- 172.21.15.81:0/2444008173 >> v2:172.21.15.117:3300/0 conn(0x7f8858154340 msgr2=0x7f885815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 --2- 172.21.15.81:0/2444008173 >> v2:172.21.15.117:3300/0 conn(0x7f8858154340 0x7f885815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 -- 172.21.15.81:0/2444008173 >> v1:172.21.15.117:6789/0 conn(0x7f8858155070 legacy=0x7f88580c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.431+0000 7f8855d9b640 1 -- 172.21.15.81:0/2444008173 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858151be0 con 0x7f885806b840 2024-05-08T20:56:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f8855d9b640 1 --2- 172.21.15.81:0/2444008173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885806b840 0x7f88580c3350 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f88580c32d0 tx=0x7f884801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bcdca39580d468 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885559a640 1 -- 172.21.15.81:0/2444008173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a7b70 con 0x7f885806b840 2024-05-08T20:56:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885559a640 1 -- 172.21.15.81:0/2444008173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88480a7cd0 con 0x7f885806b840 2024-05-08T20:56:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885559a640 1 -- 172.21.15.81:0/2444008173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480af660 con 0x7f885806b840 2024-05-08T20:56:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- 172.21.15.81:0/2444008173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885806b840 msgr2=0x7f88580c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- 172.21.15.81:0/2444008173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885806b840 0x7f88580c3350 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f88580c32d0 tx=0x7f884801ebf0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- 172.21.15.81:0/2444008173 shutdown_connections 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- 172.21.15.81:0/2444008173 >> v2:172.21.15.117:3300/0 conn(0x7f8858154340 0x7f885815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- 172.21.15.81:0/2444008173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885806b840 0x7f88580c3350 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- 172.21.15.81:0/2444008173 >> 172.21.15.81:0/2444008173 conn(0x7f88580c68c0 msgr2=0x7f88580c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- 172.21.15.81:0/2444008173 shutdown_connections 2024-05-08T20:56:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- 172.21.15.81:0/2444008173 wait complete. 2024-05-08T20:56:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 Processor -- start 2024-05-08T20:56:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 -- start start 2024-05-08T20:56:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 0x7f885806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8858154340 0x7f88581f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.435+0000 7f885ce61640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581ed770 con 0x7f8858155070 2024-05-08T20:56:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858071d10 con 0x7f885806b840 2024-05-08T20:56:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858071ff0 con 0x7f8858154340 2024-05-08T20:56:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40494/0 (socket says 172.21.15.81:40494) 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 -- 172.21.15.81:0/460206973 learned_addr learned my addr 172.21.15.81:0/460206973 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885659c640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 0x7f885806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8855d9b640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8858154340 0x7f88581f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 -- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8858154340 msgr2=0x7f88581f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8858154340 0x7f88581f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 -- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 msgr2=0x7f885806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 0x7f885806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 -- 172.21.15.81:0/460206973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884800b770 con 0x7f8858155070 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885659c640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 0x7f885806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8856d9d640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8850007e30 tx=0x7f885000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850014620 con 0x7f8858155070 2024-05-08T20:56:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000ee90 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500149c0 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580722d0 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8858070240 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858072bc0 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8850014b20 con 0x7f8858155070 2024-05-08T20:56:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 0x7f8838068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885659c640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 0x7f8838068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8850084ea0 con 0x7f8858155070 2024-05-08T20:56:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.439+0000 7f885659c640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 0x7f8838068b50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f884c000f70 tx=0x7f884c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.443+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8850051e70 con 0x7f8858155070 2024-05-08T20:56:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.603+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8858074950 con 0x7f8858155070 2024-05-08T20:56:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8850051e70 con 0x7f8858155070 2024-05-08T20:56:27.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f8846ffd640 1 -- 172.21.15.81:0/460206973 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8850055490 con 0x7f8858155070 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 msgr2=0x7f8838068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 0x7f8838068b50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f884c000f70 tx=0x7f884c009040 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 msgr2=0x7f88581f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8850007e30 tx=0x7f885000e4b0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 shutdown_connections 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f8838066690 0x7f8838068b50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858155070 0x7f88581f15c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8858154340 0x7f88581f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 --2- 172.21.15.81:0/460206973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f885806b840 0x7f885806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 >> 172.21.15.81:0/460206973 conn(0x7f88580c68c0 msgr2=0x7f8858150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 shutdown_connections 2024-05-08T20:56:27.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.611+0000 7f885ce61640 1 -- 172.21.15.81:0/460206973 wait complete. 2024-05-08T20:56:27.635 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-05-08T20:56:27.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.743+0000 7f1d0075f640 1 Processor -- start 2024-05-08T20:56:27.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1d0075f640 1 -- start start 2024-05-08T20:56:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1d0075f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1cf80c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1d0075f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf80c8990 con 0x7f1cf8158750 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1d0075f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf81559b0 con 0x7f1cf80c8150 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1d0075f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8155590 con 0x7f1cf80c4bd0 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfecfc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1cf8158750 0x7f1cf815f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33346/0 (socket says 172.21.15.81:33346) 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfecfc640 1 -- 172.21.15.81:0/3043301305 learned_addr learned my addr 172.21.15.81:0/3043301305 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450697041 0 0) 0x7f1cf80c8990 con 0x7f1cf8158750 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1cf80c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003530 con 0x7f1cf8158750 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859082899 0 0) 0x7f1ce4003530 con 0x7f1cf8158750 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 msgr2=0x7f1cf80c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1cf80c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 >> v1:172.21.15.117:6789/0 conn(0x7f1cf80c8150 legacy=0x7f1cf8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8154bf0 con 0x7f1cf8158750 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f1cf4001680 con 0x7f1cf8158750 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 >> v1:172.21.15.81:6789/0 conn(0x7f1cf8158750 legacy=0x7f1cf815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ce40039b0 0x7f1ce4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1ce4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1ce4005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8155590 con 0x7f1ce40047d0 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400bb50 con 0x7f1ce40039b0 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400bd10 con 0x7f1cf80c4bd0 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1ce4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ce40039b0 0x7f1ce4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfecfc640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1ce4005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 -- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 msgr2=0x7f1ce4005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1ce4005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 -- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ce40039b0 msgr2=0x7f1ce4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ce40039b0 0x7f1ce4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfdcfa640 1 -- 172.21.15.81:0/3043301305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4003530 con 0x7f1ce40047d0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfecfc640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80c4bd0 0x7f1ce4005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.747+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ce40039b0 0x7f1ce4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1ce4004c50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0001e70 tx=0x7f1cf001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ae906a845ea150 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0003b80 con 0x7f1ce40047d0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1cf0003ce0 con 0x7f1ce40047d0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfd4f9640 1 -- 172.21.15.81:0/3043301305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00052e0 con 0x7f1ce40047d0 2024-05-08T20:56:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- 172.21.15.81:0/3043301305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 msgr2=0x7f1ce4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3043301305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1ce4004c50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0001e70 tx=0x7f1cf001c780 comp rx=0 tx=0).stop 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfecfc640 1 -- 172.21.15.81:0/3043301305 reap_dead start 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- 172.21.15.81:0/3043301305 shutdown_connections 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- 172.21.15.81:0/3043301305 >> 172.21.15.81:0/3043301305 conn(0x7f1cf80abe00 msgr2=0x7f1cf80ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- 172.21.15.81:0/3043301305 shutdown_connections 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- 172.21.15.81:0/3043301305 wait complete. 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 Processor -- start 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- start start 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cf80c3e10 0x7f1cf80adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80ae4b0 0x7f1cf80acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf8158b80 con 0x7f1ce40047d0 2024-05-08T20:56:27.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80ae930 con 0x7f1cf80c3e10 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1d0075f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80af6e0 con 0x7f1cf80ae4b0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40510/0 (socket says 172.21.15.81:40510) 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 -- 172.21.15.81:0/3890924338 learned_addr learned my addr 172.21.15.81:0/3890924338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cf80c3e10 0x7f1cf80adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfecfc640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80ae4b0 0x7f1cf80acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 -- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80ae4b0 msgr2=0x7f1cf80acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80ae4b0 0x7f1cf80acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 -- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cf80c3e10 msgr2=0x7f1cf80adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cf80c3e10 0x7f1cf80adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 -- 172.21.15.81:0/3890924338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80c66d0 con 0x7f1ce40047d0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.751+0000 7f1cfe4fb640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1cec010900 tx=0x7f1cec010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00ec20 con 0x7f1ce40047d0 2024-05-08T20:56:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1cec00ed80 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80c20d0 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec004280 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf81f12e0 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80675e0 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cec003620 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 0x7f1cdc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f1cec084540 con 0x7f1ce40047d0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 0x7f1cdc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.755+0000 7f1cfdcfa640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 0x7f1cdc068b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0005000 tx=0x7f1cf0001520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.759+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1cec051510 con 0x7f1ce40047d0 2024-05-08T20:56:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.939+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cf80748b0 con 0x7f1ce40047d0 2024-05-08T20:56:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.939+0000 7f1ceaffd640 1 -- 172.21.15.81:0/3890924338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7f1cec054b30 con 0x7f1ce40047d0 2024-05-08T20:56:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:27.945 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:56:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 msgr2=0x7f1cdc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 0x7f1cdc068b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0005000 tx=0x7f1cf0001520 comp rx=0 tx=0).stop 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 msgr2=0x7f1cf80c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1cec010900 tx=0x7f1cec010dc0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 shutdown_connections 2024-05-08T20:56:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f1cdc0666c0 0x7f1cdc068b80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cf80ae4b0 0x7f1cf80acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cf80c3e10 0x7f1cf80adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 --2- 172.21.15.81:0/3890924338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce40047d0 0x7f1cf80c9110 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 >> 172.21.15.81:0/3890924338 conn(0x7f1cf80abe00 msgr2=0x7f1cf806a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 shutdown_connections 2024-05-08T20:56:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:27.943+0000 7f1d0075f640 1 -- 172.21.15.81:0/3890924338 wait complete. 2024-05-08T20:56:27.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.063+0000 7ff5226ac640 1 Processor -- start 2024-05-08T20:56:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.063+0000 7ff5226ac640 1 -- start start 2024-05-08T20:56:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff5226ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c154cf0 0x7ff51c155150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff5226ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c155690 0x7ff51c0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff5226ac640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c1522e0 con 0x7ff51c151f00 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff5226ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c06bb20 con 0x7ff51c154cf0 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff5226ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1548e0 con 0x7ff51c155690 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c154cf0 0x7ff51c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff51c154cf0 0x7ff51c155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40514/0 (socket says 172.21.15.81:40514) 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 -- 172.21.15.81:0/2952480182 learned_addr learned my addr 172.21.15.81:0/2952480182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff520c49640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c155690 0x7ff51c0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 -- 172.21.15.81:0/2952480182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c155690 msgr2=0x7ff51c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c155690 0x7ff51c0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 -- 172.21.15.81:0/2952480182 >> v1:172.21.15.117:6789/0 conn(0x7ff51c151f00 legacy=0x7ff51c1588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 -- 172.21.15.81:0/2952480182 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c0c5f80 con 0x7ff51c154cf0 2024-05-08T20:56:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51b7fe640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e044b643fda3a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51affd640 1 -- 172.21.15.81:0/2952480182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040ac640 con 0x7ff51c154cf0 2024-05-08T20:56:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51affd640 1 -- 172.21.15.81:0/2952480182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5040ac7a0 con 0x7ff51c154cf0 2024-05-08T20:56:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.067+0000 7ff51affd640 1 -- 172.21.15.81:0/2952480182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040acb50 con 0x7ff51c154cf0 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/2952480182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 msgr2=0x7ff51c155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50401c440 comp rx=0 tx=0).stop 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/2952480182 shutdown_connections 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c155690 0x7ff51c0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- 172.21.15.81:0/2952480182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155150 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/2952480182 >> 172.21.15.81:0/2952480182 conn(0x7ff51c0715f0 msgr2=0x7ff51c071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/2952480182 shutdown_connections 2024-05-08T20:56:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/2952480182 wait complete. 2024-05-08T20:56:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 Processor -- start 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- start start 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c151f00 0x7ff51c1ee190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff51c0ade80 0x7ff51c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0ad0c0 con 0x7ff51c154cf0 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0ad3a0 con 0x7ff51c0ade80 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0ad680 con 0x7ff51c151f00 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40522/0 (socket says 172.21.15.81:40522) 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 -- 172.21.15.81:0/1992315885 learned_addr learned my addr 172.21.15.81:0/1992315885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 -- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c151f00 msgr2=0x7ff51c1ee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c151f00 0x7ff51c1ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 -- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff51c0ade80 msgr2=0x7ff51c0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff520c49640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff51c0ade80 0x7ff51c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff51c0ade80 0x7ff51c0ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 -- 172.21.15.81:0/1992315885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094d0 con 0x7ff51c154cf0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff51b7fe640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff5040af040 tx=0x7ff5040191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040bb070 con 0x7ff51c154cf0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff5040b5630 con 0x7ff51c154cf0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c0ad960 con 0x7ff51c154cf0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b5a00 con 0x7ff51c154cf0 2024-05-08T20:56:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c0aeb60 con 0x7ff51c154cf0 2024-05-08T20:56:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.071+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c0675e0 con 0x7ff51c154cf0 2024-05-08T20:56:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.075+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5040b3070 con 0x7ff51c154cf0 2024-05-08T20:56:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.075+0000 7ff518ff9640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 0x7ff4fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.075+0000 7ff51bfff640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 0x7ff4fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.075+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7ff50411e560 con 0x7ff51c154cf0 2024-05-08T20:56:28.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.075+0000 7ff51bfff640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 0x7ff4fc068b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff50c000f70 tx=0x7ff50c0079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.079+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff5040eb6e0 con 0x7ff51c154cf0 2024-05-08T20:56:28.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.259+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff51c0ad200 con 0x7ff51c154cf0 2024-05-08T20:56:28.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.259+0000 7ff518ff9640 1 -- 172.21.15.81:0/1992315885 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5931 (secure 0 0 0) 0x7ff51c0ad200 con 0x7ff51c154cf0 2024-05-08T20:56:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:28.265 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:18.865500+0000","modified":"2024-05-08T20:27:22.524425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3150527784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3150527784},{"type":"v1","addr":"172.21.15.81:6837","nonce":3150527784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:56:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 msgr2=0x7ff4fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 0x7ff4fc068b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff50c000f70 tx=0x7ff50c0079c0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 msgr2=0x7ff51c155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff5040af040 tx=0x7ff5040191e0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 shutdown_connections 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff4fc066690 0x7ff4fc068b50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff51c0ade80 0x7ff51c0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c154cf0 0x7ff51c155e20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 --2- 172.21.15.81:0/1992315885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff51c151f00 0x7ff51c1ee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 >> 172.21.15.81:0/1992315885 conn(0x7ff51c0715f0 msgr2=0x7ff51c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 shutdown_connections 2024-05-08T20:56:28.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.263+0000 7ff5226ac640 1 -- 172.21.15.81:0/1992315885 wait complete. 2024-05-08T20:56:28.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 Processor -- start 2024-05-08T20:56:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 -- start start 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 0x7fc3ac151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3ac0c1f90 0x7fc3ac152e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0c2420 con 0x7fc3ac1533d0 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac155060 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.387+0000 7fc3b0ca7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac155340 con 0x7fc3ac0c1bb0 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3aad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3ac1533d0 0x7fc3ac06c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33362/0 (socket says 172.21.15.81:33362) 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3aad9d640 1 -- 172.21.15.81:0/3624602073 learned_addr learned my addr 172.21.15.81:0/3624602073 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 --2- 172.21.15.81:0/3624602073 >> v2:172.21.15.81:3300/0 conn(0x7fc3ac0c1f90 0x7fc3ac152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3aa59c640 1 --2- 172.21.15.81:0/3624602073 >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 0x7fc3ac151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 -- 172.21.15.81:0/3624602073 >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 msgr2=0x7fc3ac151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 --2- 172.21.15.81:0/3624602073 >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 0x7fc3ac151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 -- 172.21.15.81:0/3624602073 >> v1:172.21.15.81:6789/0 conn(0x7fc3ac1533d0 legacy=0x7fc3ac06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 -- 172.21.15.81:0/3624602073 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac155620 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3aa59c640 1 --2- 172.21.15.81:0/3624602073 >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 0x7fc3ac151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a9d9b640 1 --2- 172.21.15.81:0/3624602073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac0c1f90 0x7fc3ac152e90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac073fc0 tx=0x7fc3a001e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d6bc417a6bb16e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a959a640 1 -- 172.21.15.81:0/3624602073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00ac650 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a959a640 1 -- 172.21.15.81:0/3624602073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3a00ac7b0 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3a959a640 1 -- 172.21.15.81:0/3624602073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00acb60 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/3624602073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac0c1f90 msgr2=0x7fc3ac152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/3624602073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac0c1f90 0x7fc3ac152e90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac073fc0 tx=0x7fc3a001e5d0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/3624602073 shutdown_connections 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/3624602073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac0c1f90 0x7fc3ac152e90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/3624602073 >> v2:172.21.15.117:3300/0 conn(0x7fc3ac0c1bb0 0x7fc3ac151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/3624602073 >> 172.21.15.81:0/3624602073 conn(0x7fc3ac0c2ca0 msgr2=0x7fc3ac0c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/3624602073 shutdown_connections 2024-05-08T20:56:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.391+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/3624602073 wait complete. 2024-05-08T20:56:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 Processor -- start 2024-05-08T20:56:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- start start 2024-05-08T20:56:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3ac0c1bb0 0x7fc3ac151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3ac0c1f90 0x7fc3ac151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac14fe80 con 0x7fc3ac1533d0 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac14f5b0 con 0x7fc3ac0c1bb0 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0bfd70 con 0x7fc3ac0c1f90 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40538/0 (socket says 172.21.15.81:40538) 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 -- 172.21.15.81:0/2524429441 learned_addr learned my addr 172.21.15.81:0/2524429441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 -- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3ac0c1f90 msgr2=0x7fc3ac151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3ac0c1f90 0x7fc3ac151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 -- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3ac0c1bb0 msgr2=0x7fc3ac151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3ac0c1bb0 0x7fc3ac151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 -- 172.21.15.81:0/2524429441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0009420 con 0x7fc3ac1533d0 2024-05-08T20:56:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aad9d640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c400 tx=0x7fc3a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4005cf0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3a4005e50 con 0x7fc3ac1533d0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac1e9d20 con 0x7fc3ac1533d0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40072d0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac14faa0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac14ffc0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3a4007430 con 0x7fc3ac1533d0 2024-05-08T20:56:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 0x7fc38c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc3aa59c640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 0x7fc38c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.395+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc3a4083920 con 0x7fc3ac1533d0 2024-05-08T20:56:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.399+0000 7fc3aa59c640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 0x7fc38c068b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac15cbc0 tx=0x7fc39c008330 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.399+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc3ac14ffc0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.559+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3ac14ffc0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc39affd640 1 -- 172.21.15.81:0/2524429441 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+19958 (secure 0 0 0) 0x7fc3ac14ffc0 con 0x7fc3ac1533d0 2024-05-08T20:56:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:28.567 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:28:00.389383+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-05-08T20:27:17.243066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-05-08T20:27:17.854875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 msgr2=0x7fc38c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 0x7fc38c068b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac15cbc0 tx=0x7fc39c008330 comp rx=0 tx=0).stop 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 msgr2=0x7fc3ac147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c400 tx=0x7fc3a400c8c0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 shutdown_connections 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc38c0666c0 0x7fc38c068b80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3ac1533d0 0x7fc3ac147f20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3ac0c1f90 0x7fc3ac151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 --2- 172.21.15.81:0/2524429441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3ac0c1bb0 0x7fc3ac151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 >> 172.21.15.81:0/2524429441 conn(0x7fc3ac0c2ca0 msgr2=0x7fc3ac14b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 shutdown_connections 2024-05-08T20:56:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.563+0000 7fc3b0ca7640 1 -- 172.21.15.81:0/2524429441 wait complete. 2024-05-08T20:56:28.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-05-08T20:56:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 Processor -- start 2024-05-08T20:56:28.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 -- start start 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98101501e0 0x7f981006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f98100c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100c0650 con 0x7f981006f400 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981006fd60 con 0x7f98101501e0 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9817351640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9810072180 con 0x7f98100725f0 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f981006f400 0x7f98100c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33378/0 (socket says 172.21.15.81:33378) 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 -- 172.21.15.81:0/3549313018 learned_addr learned my addr 172.21.15.81:0/3549313018 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98150ed640 1 --2- 172.21.15.81:0/3549313018 >> v2:172.21.15.117:3300/0 conn(0x7f98101501e0 0x7f981006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807332409 0 0) 0x7f98100c0650 con 0x7f981006f400 2024-05-08T20:56:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97fc003530 con 0x7f981006f400 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98148ec640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f98100c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640382790 0 0) 0x7f97fc003530 con 0x7f981006f400 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 msgr2=0x7f98100c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f98100c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 >> v2:172.21.15.117:3300/0 conn(0x7f98101501e0 msgr2=0x7f981006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 --2- 172.21.15.81:0/3549313018 >> v2:172.21.15.117:3300/0 conn(0x7f98101501e0 0x7f981006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981006fa80 con 0x7f981006f400 2024-05-08T20:56:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f9808001a00 con 0x7f981006f400 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 >> v1:172.21.15.81:6789/0 conn(0x7f981006f400 legacy=0x7f98100c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f97fc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97fc003f00 0x7f97fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f97fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981006fd60 con 0x7f97fc004d10 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810072180 con 0x7f97fc003f00 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc00ba70 con 0x7f98100725f0 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f97fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98150ed640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f97fc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 -- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 msgr2=0x7f97fc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98100725f0 0x7f97fc003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 -- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97fc003f00 msgr2=0x7f97fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97fc003f00 0x7f97fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.695+0000 7f98158ee640 1 -- 172.21.15.81:0/3549313018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc003530 con 0x7f97fc004d10 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f98158ee640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f97fc005190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f980800a8d0 tx=0x7f980801d3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a9ff11ccadee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080ad630 con 0x7f97fc004d10 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f98080a8070 con 0x7f97fc004d10 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9807fff640 1 -- 172.21.15.81:0/3549313018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080ad9f0 con 0x7f97fc004d10 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- 172.21.15.81:0/3549313018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 msgr2=0x7f97fc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 --2- 172.21.15.81:0/3549313018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f97fc005190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f980800a8d0 tx=0x7f980801d3d0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f98158ee640 1 -- 172.21.15.81:0/3549313018 reap_dead start 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- 172.21.15.81:0/3549313018 shutdown_connections 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- 172.21.15.81:0/3549313018 >> 172.21.15.81:0/3549313018 conn(0x7f98100c2ca0 msgr2=0x7f98100c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- 172.21.15.81:0/3549313018 shutdown_connections 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- 172.21.15.81:0/3549313018 wait complete. 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 Processor -- start 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.699+0000 7f9817351640 1 -- start start 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f981014f600 0x7f981014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9810142310 0x7f98101427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810147990 con 0x7f97fc004d10 2024-05-08T20:56:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810142d00 con 0x7f9810142310 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101eb930 con 0x7f981014f600 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60030/0 (socket says 172.21.15.81:60030) 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 -- 172.21.15.81:0/1008569781 learned_addr learned my addr 172.21.15.81:0/1008569781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 -- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f981014f600 msgr2=0x7f981014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f981014f600 0x7f981014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 -- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9810142310 msgr2=0x7f98101427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9810142310 0x7f98101427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 -- 172.21.15.81:0/1008569781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810150740 con 0x7f97fc004d10 2024-05-08T20:56:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98150ed640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f980c010900 tx=0x7f980c010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0096b0 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f980c00eba0 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98101ebc10 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c01c400 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101ec1d0 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9810074950 con 0x7f97fc004d10 2024-05-08T20:56:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f980c01c560 con 0x7f97fc004d10 2024-05-08T20:56:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 0x7f97f4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f980c0849d0 con 0x7f97fc004d10 2024-05-08T20:56:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98148ec640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 0x7f97f4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.703+0000 7f98148ec640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 0x7f97f4068b80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9810158c40 tx=0x7f9800004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.707+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f980c051a30 con 0x7f97fc004d10 2024-05-08T20:56:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.883+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) v1 -- 0x7f98100ac3f0 con 0x7f97fc004d10 2024-05-08T20:56:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.919+0000 7f9805ffb640 1 -- 172.21.15.81:0/1008569781 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 151+0+0 (secure 0 0 0) 0x7f980c055050 con 0x7f97fc004d10 2024-05-08T20:56:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T20:56:28.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 msgr2=0x7f97f4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 0x7f97f4068b80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9810158c40 tx=0x7f9800004740 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 msgr2=0x7f98101eb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f980c010900 tx=0x7f980c010dc0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 shutdown_connections 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f97f40666c0 0x7f97f4068b80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9810142310 0x7f98101427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f981014f600 0x7f981014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 --2- 172.21.15.81:0/1008569781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc004d10 0x7f98101eb350 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 >> 172.21.15.81:0/1008569781 conn(0x7f98100c2ca0 msgr2=0x7f98100712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 shutdown_connections 2024-05-08T20:56:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:28.923+0000 7f9817351640 1 -- 172.21.15.81:0/1008569781 wait complete. 2024-05-08T20:56:28.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-05-08T20:56:28.980 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-05-08T20:56:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 Processor -- start 2024-05-08T20:56:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 -- start start 2024-05-08T20:56:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290151f00 0x7ff2901588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff290158e20 con 0x7ff2900ca000 2024-05-08T20:56:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff290155860 con 0x7ff290154cf0 2024-05-08T20:56:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff295720640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29006bb20 con 0x7ff290151f00 2024-05-08T20:56:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290151f00 0x7ff2901588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2900ca000 0x7ff2900ca440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46796/0 (socket says 172.21.15.81:46796) 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff290151f00 0x7ff2901588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60054/0 (socket says 172.21.15.81:60054) 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28f7fe640 1 -- 172.21.15.81:0/1194702158 learned_addr learned my addr 172.21.15.81:0/1194702158 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28dffb640 1 -- 172.21.15.81:0/1194702158 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728781629 0 0) 0x7ff290158e20 con 0x7ff2900ca000 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28dffb640 1 -- 172.21.15.81:0/1194702158 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff27c003530 con 0x7ff2900ca000 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28effd640 1 -- 172.21.15.81:0/1194702158 >> v1:172.21.15.117:6789/0 conn(0x7ff290154cf0 legacy=0x7ff290155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28effd640 1 -- 172.21.15.81:0/1194702158 >> v1:172.21.15.81:6789/0 conn(0x7ff2900ca000 legacy=0x7ff2900ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.059+0000 7ff28effd640 1 -- 172.21.15.81:0/1194702158 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2901522e0 con 0x7ff290151f00 2024-05-08T20:56:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff28effd640 1 --2- 172.21.15.81:0/1194702158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290151f00 0x7ff2901588e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff2780097c0 tx=0x7ff27801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfefb119e2ecf5b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff28dffb640 1 -- 172.21.15.81:0/1194702158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780ac600 con 0x7ff290151f00 2024-05-08T20:56:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff28dffb640 1 -- 172.21.15.81:0/1194702158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff2780a8050 con 0x7ff290151f00 2024-05-08T20:56:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff28dffb640 1 -- 172.21.15.81:0/1194702158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780ac960 con 0x7ff290151f00 2024-05-08T20:56:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 -- 172.21.15.81:0/1194702158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290151f00 msgr2=0x7ff2901588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 --2- 172.21.15.81:0/1194702158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290151f00 0x7ff2901588e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff2780097c0 tx=0x7ff27801c380 comp rx=0 tx=0).stop 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 -- 172.21.15.81:0/1194702158 shutdown_connections 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 --2- 172.21.15.81:0/1194702158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff290151f00 0x7ff2901588e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 -- 172.21.15.81:0/1194702158 >> 172.21.15.81:0/1194702158 conn(0x7ff2900715f0 msgr2=0x7ff290071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 -- 172.21.15.81:0/1194702158 shutdown_connections 2024-05-08T20:56:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.063+0000 7ff295720640 1 -- 172.21.15.81:0/1194702158 wait complete. 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 Processor -- start 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- start start 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff290151f00 0x7ff290147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff290154cf0 0x7ff2901ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901eceb0 con 0x7ff2900ca000 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901f13f0 con 0x7ff290151f00 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901ed0a0 con 0x7ff290154cf0 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60066/0 (socket says 172.21.15.81:60066) 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 -- 172.21.15.81:0/1002098070 learned_addr learned my addr 172.21.15.81:0/1002098070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 -- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff290154cf0 msgr2=0x7ff2901ed5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28f7fe640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff290154cf0 0x7ff2901ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff290154cf0 0x7ff2901ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 -- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff290151f00 msgr2=0x7ff290147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28e7fc640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff290151f00 0x7ff290147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff290151f00 0x7ff290147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 -- 172.21.15.81:0/1002098070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009420 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff28effd640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c10 tx=0x7ff27801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278003b30 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff278003c90 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff290153670 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780b6440 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff290153c30 con 0x7ff2900ca000 2024-05-08T20:56:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff290153e20 con 0x7ff2900ca000 2024-05-08T20:56:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2780b65a0 con 0x7ff2900ca000 2024-05-08T20:56:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 0x7ff270068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.067+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7ff27811ed40 con 0x7ff2900ca000 2024-05-08T20:56:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.071+0000 7ff28e7fc640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 0x7ff270068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.071+0000 7ff28e7fc640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 0x7ff270068b80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff280007fd0 tx=0x7ff280009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.071+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff2780ebe20 con 0x7ff2900ca000 2024-05-08T20:56:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.267+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff290074950 con 0x7ff2900ca000 2024-05-08T20:56:29.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:29.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff2877fe640 1 -- 172.21.15.81:0/1002098070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 99+0+0 (secure 0 0 0) 0x7ff2780b10a0 con 0x7ff2900ca000 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 msgr2=0x7ff270068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 0x7ff270068b80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff280007fd0 tx=0x7ff280009040 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 msgr2=0x7ff2901f0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff278000c10 tx=0x7ff27801abc0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.927+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 shutdown_connections 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff2700666c0 0x7ff270068b80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff290154cf0 0x7ff2901ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff290151f00 0x7ff290147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 --2- 172.21.15.81:0/1002098070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2900ca000 0x7ff2901f0eb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 >> 172.21.15.81:0/1002098070 conn(0x7ff2900715f0 msgr2=0x7ff2900ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 shutdown_connections 2024-05-08T20:56:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:29.931+0000 7ff295720640 1 -- 172.21.15.81:0/1002098070 wait complete. 2024-05-08T20:56:29.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-05-08T20:56:30.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 Processor -- start 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 -- start start 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff80014ff30 0x7ff80006f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80006b3f0 0x7ff80006cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80006c610 con 0x7ff80006be50 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80006cb40 con 0x7ff80014ff30 2024-05-08T20:56:30.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff805881640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff800153530 con 0x7ff80006b3f0 2024-05-08T20:56:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7feffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff80014ff30 0x7ff80006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7ff7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff80006be50 0x7ff8000ab5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46804/0 (socket says 172.21.15.81:46804) 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7ff7fe640 1 -- 172.21.15.81:0/3487839672 learned_addr learned my addr 172.21.15.81:0/3487839672 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7fe7fc640 1 --2- 172.21.15.81:0/3487839672 >> v2:172.21.15.117:3300/0 conn(0x7ff80006b3f0 0x7ff80006cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7feffd640 1 -- 172.21.15.81:0/3487839672 >> v2:172.21.15.117:3300/0 conn(0x7ff80006b3f0 msgr2=0x7ff80006cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7feffd640 1 --2- 172.21.15.81:0/3487839672 >> v2:172.21.15.117:3300/0 conn(0x7ff80006b3f0 0x7ff80006cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7feffd640 1 -- 172.21.15.81:0/3487839672 >> v1:172.21.15.81:6789/0 conn(0x7ff80006be50 legacy=0x7ff8000ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7feffd640 1 -- 172.21.15.81:0/3487839672 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800150310 con 0x7ff80014ff30 2024-05-08T20:56:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.083+0000 7ff7fdffb640 1 -- 172.21.15.81:0/3487839672 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790892136 0 0) 0x7ff80006c610 con 0x7ff80006be50 2024-05-08T20:56:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff7feffd640 1 --2- 172.21.15.81:0/3487839672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff80006f190 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff80006b030 tx=0x7ff7e801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92ac074a6daf012 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff7fdffb640 1 -- 172.21.15.81:0/3487839672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80ad660 con 0x7ff80014ff30 2024-05-08T20:56:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff7fdffb640 1 -- 172.21.15.81:0/3487839672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7e80ad7c0 con 0x7ff80014ff30 2024-05-08T20:56:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff7fdffb640 1 -- 172.21.15.81:0/3487839672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80adb70 con 0x7ff80014ff30 2024-05-08T20:56:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- 172.21.15.81:0/3487839672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 msgr2=0x7ff80006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 --2- 172.21.15.81:0/3487839672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff80006f190 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff80006b030 tx=0x7ff7e801c360 comp rx=0 tx=0).stop 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- 172.21.15.81:0/3487839672 shutdown_connections 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 --2- 172.21.15.81:0/3487839672 >> v2:172.21.15.117:3300/0 conn(0x7ff80006b3f0 0x7ff80006cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 --2- 172.21.15.81:0/3487839672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff80006f190 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- 172.21.15.81:0/3487839672 >> 172.21.15.81:0/3487839672 conn(0x7ff8000c2d10 msgr2=0x7ff8000c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- 172.21.15.81:0/3487839672 shutdown_connections 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- 172.21.15.81:0/3487839672 wait complete. 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 Processor -- start 2024-05-08T20:56:30.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 -- start start 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80006b3f0 0x7ff80014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.087+0000 7ff805881640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 0x7ff8001444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c4190 con 0x7ff80014ff30 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c4470 con 0x7ff80006be50 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c4750 con 0x7ff80006b3f0 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60082/0 (socket says 172.21.15.81:60082) 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 -- 172.21.15.81:0/1797318736 learned_addr learned my addr 172.21.15.81:0/1797318736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7feffd640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80006b3f0 0x7ff80014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7fe7fc640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 0x7ff8001444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 -- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80006b3f0 msgr2=0x7ff80014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:30.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80006b3f0 0x7ff80014be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 -- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 msgr2=0x7ff8001444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 0x7ff8001444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 -- 172.21.15.81:0/1797318736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009420 con 0x7ff80014ff30 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7fe7fc640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 0x7ff8001444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7ff7fe640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8001570 tx=0x7ff7f800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800a640 con 0x7ff80014ff30 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7f800a7c0 con 0x7ff80014ff30 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8000c4a30 con 0x7ff80014ff30 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800ab90 con 0x7ff80014ff30 2024-05-08T20:56:30.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff800144a30 con 0x7ff80014ff30 2024-05-08T20:56:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff800074950 con 0x7ff80014ff30 2024-05-08T20:56:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7f800acf0 con 0x7ff80014ff30 2024-05-08T20:56:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 0x7ff7e0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7feffd640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 0x7ff7e0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7ff7f8083d50 con 0x7ff80014ff30 2024-05-08T20:56:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.091+0000 7ff7feffd640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 0x7ff7e0068b80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80af000 tx=0x7ff7e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.095+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff7f8087030 con 0x7ff80014ff30 2024-05-08T20:56:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:30.255+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8000c42d0 con 0x7ff80014ff30 2024-05-08T20:56:31.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.203+0000 7ff7f7fff640 1 -- 172.21.15.81:0/1797318736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v28) v1 ==== 166+0+0 (secure 0 0 0) 0x7ff8000c42d0 con 0x7ff80014ff30 2024-05-08T20:56:31.208 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'a_metadata' removed 2024-05-08T20:56:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 msgr2=0x7ff7e0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 0x7ff7e0068b80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80af000 tx=0x7ff7e8008040 comp rx=0 tx=0).stop 2024-05-08T20:56:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 msgr2=0x7ff800141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8001570 tx=0x7ff7f800cca0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 shutdown_connections 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff7e00666c0 0x7ff7e0068b80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff80014ff30 0x7ff800141f50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80006be50 0x7ff8001444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 --2- 172.21.15.81:0/1797318736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff80006b3f0 0x7ff80014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 >> 172.21.15.81:0/1797318736 conn(0x7ff8000c2d10 msgr2=0x7ff800071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 shutdown_connections 2024-05-08T20:56:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.207+0000 7ff805881640 1 -- 172.21.15.81:0/1797318736 wait complete. 2024-05-08T20:56:31.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-05-08T20:56:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 Processor -- start 2024-05-08T20:56:31.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 -- start start 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f453006e360 0x7f453014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45300a94b0 0x7f453014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45301504d0 con 0x7f453006ee40 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4530156960 con 0x7f45300a94b0 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f453844b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4530156c40 con 0x7f453006e360 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45300a94b0 0x7f453014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45300a94b0 0x7f453014ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60092/0 (socket says 172.21.15.81:60092) 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 -- 172.21.15.81:0/3975710049 learned_addr learned my addr 172.21.15.81:0/3975710049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45361e7640 1 --2- 172.21.15.81:0/3975710049 >> v2:172.21.15.117:3300/0 conn(0x7f453006e360 0x7f453014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 -- 172.21.15.81:0/3975710049 >> v2:172.21.15.117:3300/0 conn(0x7f453006e360 msgr2=0x7f453014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 --2- 172.21.15.81:0/3975710049 >> v2:172.21.15.117:3300/0 conn(0x7f453006e360 0x7f453014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 -- 172.21.15.81:0/3975710049 >> v1:172.21.15.117:6789/0 conn(0x7f453006ee40 legacy=0x7f4530152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:31.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.359+0000 7f45359e6640 1 -- 172.21.15.81:0/3975710049 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300c2cc0 con 0x7f45300a94b0 2024-05-08T20:56:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f45359e6640 1 --2- 172.21.15.81:0/3975710049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300a94b0 0x7f453014ff90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4530073ba0 tx=0x7f452801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6c4d2d18cf6518 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f45351e5640 1 -- 172.21.15.81:0/3975710049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280ac630 con 0x7f45300a94b0 2024-05-08T20:56:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f45351e5640 1 -- 172.21.15.81:0/3975710049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45280ac790 con 0x7f45300a94b0 2024-05-08T20:56:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f45351e5640 1 -- 172.21.15.81:0/3975710049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280acb40 con 0x7f45300a94b0 2024-05-08T20:56:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 -- 172.21.15.81:0/3975710049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300a94b0 msgr2=0x7f453014ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 --2- 172.21.15.81:0/3975710049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300a94b0 0x7f453014ff90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4530073ba0 tx=0x7f452801c3d0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 -- 172.21.15.81:0/3975710049 shutdown_connections 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 --2- 172.21.15.81:0/3975710049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45300a94b0 0x7f453014ff90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 --2- 172.21.15.81:0/3975710049 >> v2:172.21.15.117:3300/0 conn(0x7f453006e360 0x7f453014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.363+0000 7f453844b640 1 -- 172.21.15.81:0/3975710049 >> 172.21.15.81:0/3975710049 conn(0x7f45300c82c0 msgr2=0x7f45300c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- 172.21.15.81:0/3975710049 shutdown_connections 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- 172.21.15.81:0/3975710049 wait complete. 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 Processor -- start 2024-05-08T20:56:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- start start 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453006e360 0x7f45300c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45301557f0 0x7f453013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453014e4d0 con 0x7f453006ee40 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45301f0520 con 0x7f45301557f0 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45301f0d80 con 0x7f453006e360 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60096/0 (socket says 172.21.15.81:60096) 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 -- 172.21.15.81:0/2661675167 learned_addr learned my addr 172.21.15.81:0/2661675167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45361e7640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453006e360 0x7f45300c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45369e8640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45301557f0 0x7f453013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 -- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453006e360 msgr2=0x7f45300c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453006e360 0x7f45300c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 -- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45301557f0 msgr2=0x7f453013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45301557f0 0x7f453013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 -- 172.21.15.81:0/2661675167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280094d0 con 0x7f453006ee40 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f45359e6640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f45280af040 tx=0x7f4528019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280b7670 con 0x7f453006ee40 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45280b77f0 con 0x7f453006ee40 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4530140240 con 0x7f453006ee40 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280b7bc0 con 0x7f453006ee40 2024-05-08T20:56:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.367+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45301f0a10 con 0x7f453006ee40 2024-05-08T20:56:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453006f5c0 con 0x7f453006ee40 2024-05-08T20:56:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45280b3070 con 0x7f453006ee40 2024-05-08T20:56:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f4526ffd640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 0x7f4514068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f452811eb60 con 0x7f453006ee40 2024-05-08T20:56:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f45361e7640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 0x7f4514068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.371+0000 7f45361e7640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 0x7f4514068b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f452c003fd0 tx=0x7f452c0039a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.375+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f45280ebd10 con 0x7f453006ee40 2024-05-08T20:56:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:31.535+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45301f0f30 con 0x7f453006ee40 2024-05-08T20:56:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.215+0000 7f4526ffd640 1 -- 172.21.15.81:0/2661675167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v29) v1 ==== 154+0+0 (secure 0 0 0) 0x7f45301f0f30 con 0x7f453006ee40 2024-05-08T20:56:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'a_data' removed 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 msgr2=0x7f4514068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 0x7f4514068b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f452c003fd0 tx=0x7f452c0039a0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 msgr2=0x7f453013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f45280af040 tx=0x7f4528019170 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 shutdown_connections 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f45140666c0 0x7f4514068b80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45301557f0 0x7f453013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006ee40 0x7f453013f620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 --2- 172.21.15.81:0/2661675167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f453006e360 0x7f45300c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 >> 172.21.15.81:0/2661675167 conn(0x7f45300c82c0 msgr2=0x7f4530071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 shutdown_connections 2024-05-08T20:56:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.227+0000 7f453844b640 1 -- 172.21.15.81:0/2661675167 wait complete. 2024-05-08T20:56:32.258 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-05-08T20:56:32.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 Processor -- start 2024-05-08T20:56:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 -- start start 2024-05-08T20:56:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f700c2bc0 0x7f4f700c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 0x7f4f700a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f70155e10 con 0x7f4f700c30d0 2024-05-08T20:56:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7006e790 con 0x7f4f700c2bc0 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f774f0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7006f460 con 0x7f4f700a94b0 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f74a8b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f700c2bc0 0x7f4f700c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f75a8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 0x7f4f700a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f7528c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4f700c30d0 0x7f4f700c4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.81:41194/0 (socket says 172.21.15.81:41194) 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f7528c640 1 -- 172.21.15.81:0/1555152704 learned_addr learned my addr 172.21.15.81:0/1555152704 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f75a8d640 1 -- 172.21.15.81:0/1555152704 >> v2:172.21.15.117:3300/0 conn(0x7f4f700c2bc0 msgr2=0x7f4f700c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.399+0000 7f4f75a8d640 1 --2- 172.21.15.81:0/1555152704 >> v2:172.21.15.117:3300/0 conn(0x7f4f700c2bc0 0x7f4f700c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f75a8d640 1 -- 172.21.15.81:0/1555152704 >> v1:172.21.15.117:6789/0 conn(0x7f4f700c30d0 legacy=0x7f4f700c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f75a8d640 1 -- 172.21.15.81:0/1555152704 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f700a9e20 con 0x7f4f700a94b0 2024-05-08T20:56:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f75a8d640 1 --2- 172.21.15.81:0/1555152704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 0x7f4f700a98e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009d90 tx=0x7f4f6801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac92e9120fbe5369 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f67fff640 1 -- 172.21.15.81:0/1555152704 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680a5970 con 0x7f4f700a94b0 2024-05-08T20:56:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f67fff640 1 -- 172.21.15.81:0/1555152704 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f680a5ad0 con 0x7f4f700a94b0 2024-05-08T20:56:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f67fff640 1 -- 172.21.15.81:0/1555152704 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680a5e80 con 0x7f4f700a94b0 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 -- 172.21.15.81:0/1555152704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 msgr2=0x7f4f700a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 --2- 172.21.15.81:0/1555152704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 0x7f4f700a98e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009d90 tx=0x7f4f6801c8b0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 -- 172.21.15.81:0/1555152704 shutdown_connections 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 --2- 172.21.15.81:0/1555152704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700a94b0 0x7f4f700a98e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 --2- 172.21.15.81:0/1555152704 >> v2:172.21.15.117:3300/0 conn(0x7f4f700c2bc0 0x7f4f700c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 -- 172.21.15.81:0/1555152704 >> 172.21.15.81:0/1555152704 conn(0x7f4f700c4cc0 msgr2=0x7f4f700c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 -- 172.21.15.81:0/1555152704 shutdown_connections 2024-05-08T20:56:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.403+0000 7f4f774f0640 1 -- 172.21.15.81:0/1555152704 wait complete. 2024-05-08T20:56:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 Processor -- start 2024-05-08T20:56:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- start start 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f700a94b0 0x7f4f7015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700c30d0 0x7f4f7013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f70151000 con 0x7f4f700c2bc0 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701ecf70 con 0x7f4f700a94b0 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701506d0 con 0x7f4f700c30d0 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60098/0 (socket says 172.21.15.81:60098) 2024-05-08T20:56:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 -- 172.21.15.81:0/456966959 learned_addr learned my addr 172.21.15.81:0/456966959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f75a8d640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700c30d0 0x7f4f7013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f7528c640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f700a94b0 0x7f4f7015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 -- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700c30d0 msgr2=0x7f4f7013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700c30d0 0x7f4f7013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 -- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f700a94b0 msgr2=0x7f4f7015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f700a94b0 0x7f4f7015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 -- 172.21.15.81:0/456966959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009a70 con 0x7f4f700c2bc0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f74a8b640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000e900 tx=0x7f4f6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60009690 con 0x7f4f700c2bc0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f6000ca00 con 0x7f4f700c2bc0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000cdd0 con 0x7f4f700c2bc0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f701509b0 con 0x7f4f700c2bc0 2024-05-08T20:56:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7013f930 con 0x7f4f700c2bc0 2024-05-08T20:56:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.407+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f701511b0 con 0x7f4f700c2bc0 2024-05-08T20:56:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.411+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f60013470 con 0x7f4f700c2bc0 2024-05-08T20:56:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.411+0000 7f4f65ffb640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.411+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5775+0+0 (secure 0 0 0) 0x7f4f60084340 con 0x7f4f700c2bc0 2024-05-08T20:56:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.411+0000 7f4f7528c640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.411+0000 7f4f7528c640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 0x7f4f54068b50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c005890 tx=0x7f4f6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.415+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4f60051720 con 0x7f4f700c2bc0 2024-05-08T20:56:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.679+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f70074950 con 0x7f4f700c2bc0 2024-05-08T20:56:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.679+0000 7f4f65ffb640 1 -- 172.21.15.81:0/456966959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f4f60054d40 con 0x7f4f700c2bc0 2024-05-08T20:56:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:32.684 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":284949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3869158459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3869158459},{"type":"v1","addr":"172.21.15.81:6837","nonce":3869158459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:56:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 msgr2=0x7f4f54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 0x7f4f54068b50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c005890 tx=0x7f4f6c009040 comp rx=0 tx=0).stop 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 msgr2=0x7f4f7013eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000e900 tx=0x7f4f6000edc0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 shutdown_connections 2024-05-08T20:56:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f700c30d0 0x7f4f7013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f700c2bc0 0x7f4f7013eeb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 --2- 172.21.15.81:0/456966959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f700a94b0 0x7f4f7015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 >> 172.21.15.81:0/456966959 conn(0x7f4f700c4cc0 msgr2=0x7f4f700c3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 shutdown_connections 2024-05-08T20:56:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.683+0000 7f4f774f0640 1 -- 172.21.15.81:0/456966959 wait complete. 2024-05-08T20:56:32.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 Processor -- start 2024-05-08T20:56:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 -- start start 2024-05-08T20:56:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 0x7ff5840c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5840c0650 con 0x7ff5840725f0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58406fa80 con 0x7ff5841501e0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff58abe1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58406fd60 con 0x7ff58406f400 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff583fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff5840725f0 0x7ff5840c1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46808/0 (socket says 172.21.15.81:46808) 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.807+0000 7ff583fff640 1 -- 172.21.15.81:0/3021229661 learned_addr learned my addr 172.21.15.81:0/3021229661 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58917e640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 0x7ff5840c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505814167 0 0) 0x7ff5840c0650 con 0x7ff5840725f0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff56c003530 con 0x7ff5840725f0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241253788 0 0) 0x7ff56c003530 con 0x7ff5840725f0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 msgr2=0x7ff5840c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 0x7ff5840c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 >> v1:172.21.15.117:6789/0 conn(0x7ff5841501e0 legacy=0x7ff58406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584071ea0 con 0x7ff5840725f0 2024-05-08T20:56:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7ff578001680 con 0x7ff5840725f0 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 >> v1:172.21.15.81:6789/0 conn(0x7ff5840725f0 legacy=0x7ff5840c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff56c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 0x7ff56c005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58406fd60 con 0x7ff56c0047d0 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c00bb80 con 0x7ff56c0039b0 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c00bd40 con 0x7ff58406f400 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff56c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58897d640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 -- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 msgr2=0x7ff56c005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58406f400 0x7ff56c005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 -- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff56c0039b0 msgr2=0x7ff56c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 -- 172.21.15.81:0/3021229661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c003530 con 0x7ff56c0047d0 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff583fff640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff56c004c50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c240 tx=0x7ff57801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55c3651bc76c2fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578005ae0 con 0x7ff56c0047d0 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff578005c60 con 0x7ff56c0047d0 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff5837fe640 1 -- 172.21.15.81:0/3021229661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5780a5790 con 0x7ff56c0047d0 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58abe1640 1 -- 172.21.15.81:0/3021229661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 msgr2=0x7ff56c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58abe1640 1 --2- 172.21.15.81:0/3021229661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff56c004c50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff57800c240 tx=0x7ff57801cc60 comp rx=0 tx=0).stop 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58917e640 1 -- 172.21.15.81:0/3021229661 reap_dead start 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58abe1640 1 -- 172.21.15.81:0/3021229661 shutdown_connections 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58abe1640 1 -- 172.21.15.81:0/3021229661 >> 172.21.15.81:0/3021229661 conn(0x7ff5840c2ca0 msgr2=0x7ff5840c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.811+0000 7ff58abe1640 1 -- 172.21.15.81:0/3021229661 shutdown_connections 2024-05-08T20:56:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- 172.21.15.81:0/3021229661 wait complete. 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 Processor -- start 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- start start 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58415b710 0x7ff5841442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff584144800 0x7ff58414a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff584072180 con 0x7ff56c0047d0 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840aa230 con 0x7ff584144800 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841f1590 con 0x7ff58415b710 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60108/0 (socket says 172.21.15.81:60108) 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 -- 172.21.15.81:0/2391088762 learned_addr learned my addr 172.21.15.81:0/2391088762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff583fff640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58415b710 0x7ff5841442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58917e640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff584144800 0x7ff58414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 -- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58415b710 msgr2=0x7ff5841442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58415b710 0x7ff5841442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 -- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff584144800 msgr2=0x7ff58414a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff584144800 0x7ff58414a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 -- 172.21.15.81:0/2391088762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5841f1a20 con 0x7ff56c0047d0 2024-05-08T20:56:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58897d640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff57400e500 tx=0x7ff57400e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740052e0 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff574005440 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5841463d0 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574003840 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5841f0c60 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.815+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff584074950 con 0x7ff56c0047d0 2024-05-08T20:56:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.819+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5740039a0 con 0x7ff56c0047d0 2024-05-08T20:56:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.819+0000 7ff5817fa640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 0x7ff570068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.819+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5775+0+0 (secure 0 0 0) 0x7ff574083c20 con 0x7ff56c0047d0 2024-05-08T20:56:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.819+0000 7ff583fff640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 0x7ff570068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.819+0000 7ff583fff640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 0x7ff570068b80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff5780ab000 tx=0x7ff5780a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:32.823+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff574050ed0 con 0x7ff56c0047d0 2024-05-08T20:56:33.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.015+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff58406ce20 con 0x7ff56c0047d0 2024-05-08T20:56:33.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.015+0000 7ff5817fa640 1 -- 172.21.15.81:0/2391088762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4733 (secure 0 0 0) 0x7ff5740544f0 con 0x7ff56c0047d0 2024-05-08T20:56:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:33.020 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3840391065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":3840391065},{"type":"v1","addr":"172.21.15.117:6835","nonce":3840391065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/152931911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":152931911},{"type":"v1","addr":"172.21.15.117:6834","nonce":152931911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":284949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3869158459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3869158459},{"type":"v1","addr":"172.21.15.81:6837","nonce":3869158459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:27:27.953430+0000","modified":"2024-05-08T20:27:30.976398+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/2268408600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2268408600},{"type":"v1","addr":"172.21.15.81:6836","nonce":2268408600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T20:56:33.020 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 msgr2=0x7ff570068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 0x7ff570068b80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff5780ab000 tx=0x7ff5780a7070 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 msgr2=0x7ff5840a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff57400e500 tx=0x7ff57400e9c0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 shutdown_connections 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7ff5700666c0 0x7ff570068b80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff584144800 0x7ff58414a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff58415b710 0x7ff5841442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 --2- 172.21.15.81:0/2391088762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff56c0047d0 0x7ff5840a9a20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 >> 172.21.15.81:0/2391088762 conn(0x7ff5840c2ca0 msgr2=0x7ff5840c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 shutdown_connections 2024-05-08T20:56:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.019+0000 7ff58abe1640 1 -- 172.21.15.81:0/2391088762 wait complete. 2024-05-08T20:56:33.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 Processor -- start 2024-05-08T20:56:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 -- start start 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9fc152340 0x7fb9fc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9fc0c2570 0x7fb9fc154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc158080 con 0x7fb9fc06d7d0 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc06ab70 con 0x7fb9fc152340 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba04548640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc154b10 con 0x7fb9fc0c2570 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9fc152340 0x7fb9fc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9fc152340 0x7fb9fc06d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60110/0 (socket says 172.21.15.81:60110) 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 -- 172.21.15.81:0/104530530 learned_addr learned my addr 172.21.15.81:0/104530530 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba01ae3640 1 --2- 172.21.15.81:0/104530530 >> v2:172.21.15.117:3300/0 conn(0x7fb9fc0c2570 0x7fb9fc154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 -- 172.21.15.81:0/104530530 >> v2:172.21.15.117:3300/0 conn(0x7fb9fc0c2570 msgr2=0x7fb9fc154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 --2- 172.21.15.81:0/104530530 >> v2:172.21.15.117:3300/0 conn(0x7fb9fc0c2570 0x7fb9fc154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba012e2640 1 -- 172.21.15.81:0/104530530 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270724560 0 0) 0x7fb9fc158080 con 0x7fb9fc06d7d0 2024-05-08T20:56:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 -- 172.21.15.81:0/104530530 >> v1:172.21.15.81:6789/0 conn(0x7fb9fc06d7d0 legacy=0x7fb9fc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 -- 172.21.15.81:0/104530530 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc06a890 con 0x7fb9fc152340 2024-05-08T20:56:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba022e4640 1 --2- 172.21.15.81:0/104530530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc06d290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc06fe70 tx=0x7fb9f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf310811fb72469 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba012e2640 1 -- 172.21.15.81:0/104530530 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80ab660 con 0x7fb9fc152340 2024-05-08T20:56:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba012e2640 1 -- 172.21.15.81:0/104530530 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9f80ab7c0 con 0x7fb9fc152340 2024-05-08T20:56:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.191+0000 7fba012e2640 1 -- 172.21.15.81:0/104530530 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80abb70 con 0x7fb9fc152340 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 -- 172.21.15.81:0/104530530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 msgr2=0x7fb9fc06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 --2- 172.21.15.81:0/104530530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc06d290 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc06fe70 tx=0x7fb9f801c460 comp rx=0 tx=0).stop 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 -- 172.21.15.81:0/104530530 shutdown_connections 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 --2- 172.21.15.81:0/104530530 >> v2:172.21.15.117:3300/0 conn(0x7fb9fc0c2570 0x7fb9fc154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 --2- 172.21.15.81:0/104530530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc06d290 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.195+0000 7fba04548640 1 -- 172.21.15.81:0/104530530 >> 172.21.15.81:0/104530530 conn(0x7fb9fc0c71b0 msgr2=0x7fb9fc0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- 172.21.15.81:0/104530530 shutdown_connections 2024-05-08T20:56:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- 172.21.15.81:0/104530530 wait complete. 2024-05-08T20:56:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 Processor -- start 2024-05-08T20:56:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- start start 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc06d7d0 0x7fb9fc071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0c2570 0x7fb9fc146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc071960 con 0x7fb9fc152340 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1ed9f0 con 0x7fb9fc0c2570 2024-05-08T20:56:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1edcd0 con 0x7fb9fc06d7d0 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60120/0 (socket says 172.21.15.81:60120) 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 -- 172.21.15.81:0/2194386792 learned_addr learned my addr 172.21.15.81:0/2194386792 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba022e4640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc06d7d0 0x7fb9fc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba01ae3640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0c2570 0x7fb9fc146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 -- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc06d7d0 msgr2=0x7fb9fc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc06d7d0 0x7fb9fc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 -- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0c2570 msgr2=0x7fb9fc146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0c2570 0x7fb9fc146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 -- 172.21.15.81:0/2194386792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80094d0 con 0x7fb9fc152340 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba02ae5640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4002240 tx=0x7fb9f400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4003db0 con 0x7fb9fc152340 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9f400ce30 con 0x7fb9fc152340 2024-05-08T20:56:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc1461a0 con 0x7fb9fc152340 2024-05-08T20:56:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4005270 con 0x7fb9fc152340 2024-05-08T20:56:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.199+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc072140 con 0x7fb9fc152340 2024-05-08T20:56:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc0675e0 con 0x7fb9fc152340 2024-05-08T20:56:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9f40053d0 con 0x7fb9fc152340 2024-05-08T20:56:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fb9f2ffd640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 0x7fb9e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5775+0+0 (secure 0 0 0) 0x7fb9f4083970 con 0x7fb9fc152340 2024-05-08T20:56:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fba022e4640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 0x7fb9e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.203+0000 7fba022e4640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 0x7fb9e0068b50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80af000 tx=0x7fb9f80b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.207+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb9f4050d50 con 0x7fb9fc152340 2024-05-08T20:56:33.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.371+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9fc074950 con 0x7fb9fc152340 2024-05-08T20:56:33.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.371+0000 7fb9f2ffd640 1 -- 172.21.15.81:0/2194386792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16210 (secure 0 0 0) 0x7fb9f4017070 con 0x7fb9fc152340 2024-05-08T20:56:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T20:56:33.377 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"fsid":"d71bfc5b-5bc0-431a-b162-ebb87bd62ea5","created":"2024-05-08T20:26:54.689028+0000","modified":"2024-05-08T20:56:32.204725+0000","last_up_change":"2024-05-08T20:27:06.387595+0000","last_in_change":"2024-05-08T20:26:56.997819+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:27:07.299974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-05-08T20:27:25.763523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-05-08T20:27:26.947347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"35d3a8b1-1b6b-459d-a234-cfb0e5f6758f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":27589},{"type":"v1","addr":"172.21.15.81:6825","nonce":27589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":27589},{"type":"v1","addr":"172.21.15.81:6827","nonce":27589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":27589},{"type":"v1","addr":"172.21.15.81:6831","nonce":27589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":27589},{"type":"v1","addr":"172.21.15.81:6829","nonce":27589}]},"public_addr":"172.21.15.81:6825/27589","cluster_addr":"172.21.15.81:6827/27589","heartbeat_back_addr":"172.21.15.81:6831/27589","heartbeat_front_addr":"172.21.15.81:6829/27589","state":["exists","up"]},{"osd":1,"uuid":"057bf102-d571-4d10-b66b-8d5c09f237dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":27590},{"type":"v1","addr":"172.21.15.81:6809","nonce":27590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":27590},{"type":"v1","addr":"172.21.15.81:6811","nonce":27590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":27590},{"type":"v1","addr":"172.21.15.81:6815","nonce":27590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":27590},{"type":"v1","addr":"172.21.15.81:6813","nonce":27590}]},"public_addr":"172.21.15.81:6809/27590","cluster_addr":"172.21.15.81:6811/27590","heartbeat_back_addr":"172.21.15.81:6815/27590","heartbeat_front_addr":"172.21.15.81:6813/27590","state":["exists","up"]},{"osd":2,"uuid":"07ebdf02-bf28-4000-8328-1608230943c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":27592},{"type":"v1","addr":"172.21.15.81:6817","nonce":27592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":27592},{"type":"v1","addr":"172.21.15.81:6819","nonce":27592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":27592},{"type":"v1","addr":"172.21.15.81:6823","nonce":27592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":27592},{"type":"v1","addr":"172.21.15.81:6821","nonce":27592}]},"public_addr":"172.21.15.81:6817/27592","cluster_addr":"172.21.15.81:6819/27592","heartbeat_back_addr":"172.21.15.81:6823/27592","heartbeat_front_addr":"172.21.15.81:6821/27592","state":["exists","up"]},{"osd":3,"uuid":"3a99259d-d34c-4598-8b08-ae343ca95d63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":27591},{"type":"v1","addr":"172.21.15.81:6801","nonce":27591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":27591},{"type":"v1","addr":"172.21.15.81:6803","nonce":27591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":27591},{"type":"v1","addr":"172.21.15.81:6808","nonce":27591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":27591},{"type":"v1","addr":"172.21.15.81:6805","nonce":27591}]},"public_addr":"172.21.15.81:6801/27591","cluster_addr":"172.21.15.81:6803/27591","heartbeat_back_addr":"172.21.15.81:6808/27591","heartbeat_front_addr":"172.21.15.81:6805/27591","state":["exists","up"]},{"osd":4,"uuid":"2fc6a93a-5001-4e39-812a-16200995ae22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":27738},{"type":"v1","addr":"172.21.15.117:6801","nonce":27738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":27738},{"type":"v1","addr":"172.21.15.117:6803","nonce":27738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":27738},{"type":"v1","addr":"172.21.15.117:6810","nonce":27738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":27738},{"type":"v1","addr":"172.21.15.117:6807","nonce":27738}]},"public_addr":"172.21.15.117:6801/27738","cluster_addr":"172.21.15.117:6803/27738","heartbeat_back_addr":"172.21.15.117:6810/27738","heartbeat_front_addr":"172.21.15.117:6807/27738","state":["exists","up"]},{"osd":5,"uuid":"f67ddc53-b077-466f-a37d-6d8d4634a98f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":27739},{"type":"v1","addr":"172.21.15.117:6817","nonce":27739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":27739},{"type":"v1","addr":"172.21.15.117:6819","nonce":27739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":27739},{"type":"v1","addr":"172.21.15.117:6823","nonce":27739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":27739},{"type":"v1","addr":"172.21.15.117:6821","nonce":27739}]},"public_addr":"172.21.15.117:6817/27739","cluster_addr":"172.21.15.117:6819/27739","heartbeat_back_addr":"172.21.15.117:6823/27739","heartbeat_front_addr":"172.21.15.117:6821/27739","state":["exists","up"]},{"osd":6,"uuid":"6254b146-801c-4d69-af74-48327ce9b920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":27741},{"type":"v1","addr":"172.21.15.117:6825","nonce":27741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":27741},{"type":"v1","addr":"172.21.15.117:6827","nonce":27741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":27741},{"type":"v1","addr":"172.21.15.117:6831","nonce":27741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":27741},{"type":"v1","addr":"172.21.15.117:6829","nonce":27741}]},"public_addr":"172.21.15.117:6825/27741","cluster_addr":"172.21.15.117:6827/27741","heartbeat_back_addr":"172.21.15.117:6831/27741","heartbeat_front_addr":"172.21.15.117:6829/27741","state":["exists","up"]},{"osd":7,"uuid":"8f0d589f-2421-43e6-a265-88d4315ffb7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":27740},{"type":"v1","addr":"172.21.15.117:6806","nonce":27740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":27740},{"type":"v1","addr":"172.21.15.117:6811","nonce":27740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":27740},{"type":"v1","addr":"172.21.15.117:6815","nonce":27740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":27740},{"type":"v1","addr":"172.21.15.117:6813","nonce":27740}]},"public_addr":"172.21.15.117:6806/27740","cluster_addr":"172.21.15.117:6811/27740","heartbeat_back_addr":"172.21.15.117:6815/27740","heartbeat_front_addr":"172.21.15.117:6813/27740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.590932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.593003+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.499332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.619480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.581560+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.584357+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.628972+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:27:02.459586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3150527784":"2024-05-09T20:56:28.890164+0000","172.21.15.81:6835/3150527784":"2024-05-09T20:56:28.890164+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 msgr2=0x7fb9e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 0x7fb9e0068b50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80af000 tx=0x7fb9f80b6040 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 msgr2=0x7fb9fc146ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4002240 tx=0x7fb9f400cbe0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 shutdown_connections 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fb9e0066690 0x7fb9e0068b50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9fc152340 0x7fb9fc146ec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9fc0c2570 0x7fb9fc146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 --2- 172.21.15.81:0/2194386792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9fc06d7d0 0x7fb9fc071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 >> 172.21.15.81:0/2194386792 conn(0x7fb9fc0c71b0 msgr2=0x7fb9fc152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 shutdown_connections 2024-05-08T20:56:33.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.375+0000 7fba04548640 1 -- 172.21.15.81:0/2194386792 wait complete. 2024-05-08T20:56:33.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-05-08T20:56:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 Processor -- start 2024-05-08T20:56:33.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 -- start start 2024-05-08T20:56:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f579415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5794152ab0 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5794152d90 con 0x7f579414fe70 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579924a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57941528a0 con 0x7f579406a6d0 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5794155e90 0x7f5794069fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46838/0 (socket says 172.21.15.81:46838) 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579259c640 1 -- 172.21.15.81:0/2909143142 learned_addr learned my addr 172.21.15.81:0/2909143142 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579359e640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f579415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744791383 0 0) 0x7f5794152ab0 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003530 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537900100 0 0) 0x7f5780003530 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 msgr2=0x7f579415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f579415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 >> v1:172.21.15.117:6789/0 conn(0x7f579414fe70 legacy=0x7f579406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794153070 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7f577c001680 con 0x7f5794155e90 2024-05-08T20:56:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 >> v1:172.21.15.81:6789/0 conn(0x7f5794155e90 legacy=0x7f5794069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57800039b0 0x7f5780003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f5780005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57941528a0 con 0x7f57800039b0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578000bb50 con 0x7f57800047d0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578000bd10 con 0x7f579406a6d0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57800039b0 0x7f5780003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579259c640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f579359e640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f5780005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 -- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 msgr2=0x7f5780005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579406a6d0 0x7f5780005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 -- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57800047d0 msgr2=0x7f5780004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.519+0000 7f5792d9d640 1 -- 172.21.15.81:0/2909143142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780003530 con 0x7f57800039b0 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f5792d9d640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57800039b0 0x7f5780003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f578c001780 tx=0x7f578c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d50eb9f81f76c63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0052d0 con 0x7f57800039b0 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f578c005450 con 0x7f57800039b0 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f5791d9b640 1 -- 172.21.15.81:0/2909143142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c003860 con 0x7f57800039b0 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- 172.21.15.81:0/2909143142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57800039b0 msgr2=0x7f5780003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 --2- 172.21.15.81:0/2909143142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57800039b0 0x7f5780003dd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f578c001780 tx=0x7f578c01c3f0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579359e640 1 -- 172.21.15.81:0/2909143142 reap_dead start 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- 172.21.15.81:0/2909143142 shutdown_connections 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- 172.21.15.81:0/2909143142 >> 172.21.15.81:0/2909143142 conn(0x7f57940c71b0 msgr2=0x7f57940c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- 172.21.15.81:0/2909143142 shutdown_connections 2024-05-08T20:56:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- 172.21.15.81:0/2909143142 wait complete. 2024-05-08T20:56:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 Processor -- start 2024-05-08T20:56:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.523+0000 7f579924a640 1 -- start start 2024-05-08T20:56:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 0x7f579414caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579414bf40 0x7f57941ec990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940c5f70 con 0x7f57940c4b10 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579414d410 con 0x7f579414bf40 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579414bcf0 con 0x7f57800039b0 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60146/0 (socket says 172.21.15.81:60146) 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 -- 172.21.15.81:0/1692864515 learned_addr learned my addr 172.21.15.81:0/1692864515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f5792d9d640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 0x7f579414caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579359e640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579414bf40 0x7f57941ec990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 -- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 msgr2=0x7f579414caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 0x7f579414caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 -- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579414bf40 msgr2=0x7f57941ec990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579414bf40 0x7f57941ec990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 -- 172.21.15.81:0/1692864515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579414ba10 con 0x7f57940c4b10 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f5792d9d640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 0x7f579414caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579259c640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f577c00e780 tx=0x7f577c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00c6c0 con 0x7f57940c4b10 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f577c00c820 con 0x7f57940c4b10 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 -- 172.21.15.81:0/1692864515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57941f0a10 con 0x7f57940c4b10 2024-05-08T20:56:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00cbf0 con 0x7f57940c4b10 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f579924a640 1 -- 172.21.15.81:0/1692864515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5794071b30 con 0x7f57940c4b10 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c005260 con 0x7f57940c4b10 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f577c00cd50 con 0x7f57940c4b10 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 0x7f5774068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5775+0+0 (secure 0 0 0) 0x7f577c083c90 con 0x7f57940c4b10 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.527+0000 7f5792d9d640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 0x7f5774068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.531+0000 7f5792d9d640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 0x7f5774068b80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f578c001750 tx=0x7f578c0011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.531+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f577c054ae0 con 0x7f57940c4b10 2024-05-08T20:56:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.731+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) v1 -- 0x7f576c005510 con 0x7f57940c4b10 2024-05-08T20:56:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f578b7fe640 1 -- 172.21.15.81:0/1692864515 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 151+0+0 (secure 0 0 0) 0x7f577c054670 con 0x7f57940c4b10 2024-05-08T20:56:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T20:56:33.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 msgr2=0x7f5774068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 0x7f5774068b80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f578c001750 tx=0x7f578c0011a0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 msgr2=0x7f57940c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f577c00e780 tx=0x7f577c00ec40 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 shutdown_connections 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f57740666c0 0x7f5774068b80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579414bf40 0x7f57941ec990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57940c4b10 0x7f57940c55b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 --2- 172.21.15.81:0/1692864515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800039b0 0x7f579414caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.747+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 >> 172.21.15.81:0/1692864515 conn(0x7f57940c71b0 msgr2=0x7f579406aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.751+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 shutdown_connections 2024-05-08T20:56:33.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.751+0000 7f57897fa640 1 -- 172.21.15.81:0/1692864515 wait complete. 2024-05-08T20:56:33.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-05-08T20:56:33.812 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-05-08T20:56:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 Processor -- start 2024-05-08T20:56:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 -- start start 2024-05-08T20:56:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc04806c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0480725f0 0x7fc0480c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480c0650 con 0x7fc04806f400 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04806fd60 con 0x7fc0480725f0 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc04da70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048072180 con 0x7fc0481501e0 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc047fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc04806f400 0x7fc0480c2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46850/0 (socket says 172.21.15.81:46850) 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc047fff640 1 -- 172.21.15.81:0/595071129 learned_addr learned my addr 172.21.15.81:0/595071129 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc046ffd640 1 --2- 172.21.15.81:0/595071129 >> v2:172.21.15.117:3300/0 conn(0x7fc0480725f0 0x7fc0480c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc04806c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371879991 0 0) 0x7fc0480c0650 con 0x7fc04806f400 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034003530 con 0x7fc04806f400 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 705781056 0 0) 0x7fc034003530 con 0x7fc04806f400 2024-05-08T20:56:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 msgr2=0x7fc04806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc04806c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 >> v2:172.21.15.117:3300/0 conn(0x7fc0480725f0 msgr2=0x7fc0480c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 --2- 172.21.15.81:0/595071129 >> v2:172.21.15.117:3300/0 conn(0x7fc0480725f0 0x7fc0480c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04806fa80 con 0x7fc04806f400 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 763988095 0 0) 0x7fc038001a00 con 0x7fc04806f400 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc04806c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 >> v1:172.21.15.81:6789/0 conn(0x7fc04806f400 legacy=0x7fc0480c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc034003980 0x7fc034003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc0340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034004d10 0x7fc034005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04806fd60 con 0x7fc034003980 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc048072180 con 0x7fc034004d10 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400fdf0 con 0x7fc0481501e0 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc046ffd640 1 --2- 172.21.15.81:0/595071129 >> v2:172.21.15.117:3300/0 conn(0x7fc0480725f0 0x7fc0480c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.887+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc034003980 0x7fc034003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc046ffd640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc0340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 -- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 msgr2=0x7fc0340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481501e0 0x7fc0340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 -- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034004d10 msgr2=0x7fc034005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034004d10 0x7fc034005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 -- 172.21.15.81:0/595071129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009420 con 0x7fc034003980 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0477fe640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc034003980 0x7fc034003da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc040009ce0 tx=0x7fc04001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f9a25d463f2b01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400a5880 con 0x7fc034003980 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc0400a59e0 con 0x7fc034003980 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc0467fc640 1 -- 172.21.15.81:0/595071129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400a5b90 con 0x7fc034003980 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 -- 172.21.15.81:0/595071129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc034003980 msgr2=0x7fc034003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 --2- 172.21.15.81:0/595071129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc034003980 0x7fc034003da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc040009ce0 tx=0x7fc04001cbc0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc047fff640 1 -- 172.21.15.81:0/595071129 reap_dead start 2024-05-08T20:56:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 -- 172.21.15.81:0/595071129 shutdown_connections 2024-05-08T20:56:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 -- 172.21.15.81:0/595071129 >> 172.21.15.81:0/595071129 conn(0x7fc0480c2ca0 msgr2=0x7fc0480c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 -- 172.21.15.81:0/595071129 shutdown_connections 2024-05-08T20:56:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.891+0000 7fc04da70640 1 -- 172.21.15.81:0/595071129 wait complete. 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 Processor -- start 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- start start 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034003980 0x7fc0481ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481476d0 0x7fc0480be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481474f0 con 0x7fc0480c0150 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481ec7b0 con 0x7fc034003980 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481eca90 con 0x7fc0481476d0 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60198/0 (socket says 172.21.15.81:60198) 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 -- 172.21.15.81:0/3438022461 learned_addr learned my addr 172.21.15.81:0/3438022461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:33.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc047fff640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481476d0 0x7fc0480be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc0477fe640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034003980 0x7fc0481ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 -- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481476d0 msgr2=0x7fc0480be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481476d0 0x7fc0480be7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 -- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034003980 msgr2=0x7fc0481ebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034003980 0x7fc0481ebc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 -- 172.21.15.81:0/3438022461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048150740 con 0x7fc0480c0150 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc046ffd640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc030011900 tx=0x7fc030011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000fbd0 con 0x7fc0480c0150 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc03000fd30 con 0x7fc0480c0150 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030015680 con 0x7fc0480c0150 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04814b150 con 0x7fc0480c0150 2024-05-08T20:56:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0481471a0 con 0x7fc0480c0150 2024-05-08T20:56:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.895+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc048074950 con 0x7fc0480c0150 2024-05-08T20:56:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.899+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0300157e0 con 0x7fc0480c0150 2024-05-08T20:56:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.899+0000 7fc03ffff640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 0x7fc028068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.899+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5861+0+0 (secure 0 0 0) 0x7fc030084d20 con 0x7fc0480c0150 2024-05-08T20:56:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.899+0000 7fc0477fe640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 0x7fc028068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.899+0000 7fc0477fe640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 0x7fc028068b50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc0400af000 tx=0x7fc0400046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:33.903+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc030051f60 con 0x7fc0480c0150 2024-05-08T20:56:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.087+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc04806b640 con 0x7fc0480c0150 2024-05-08T20:56:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.759+0000 7fc03ffff640 1 -- 172.21.15.81:0/3438022461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 99+0+0 (secure 0 0 0) 0x7fc03000fea0 con 0x7fc0480c0150 2024-05-08T20:56:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 msgr2=0x7fc028068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 0x7fc028068b50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc0400af000 tx=0x7fc0400046d0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 msgr2=0x7fc0481ec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc030011900 tx=0x7fc030011dc0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 shutdown_connections 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7fc028066690 0x7fc028068b50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0481476d0 0x7fc0480be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0480c0150 0x7fc0481ec1b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 --2- 172.21.15.81:0/3438022461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc034003980 0x7fc0481ebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 >> 172.21.15.81:0/3438022461 conn(0x7fc0480c2ca0 msgr2=0x7fc0480a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 shutdown_connections 2024-05-08T20:56:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.763+0000 7fc04da70640 1 -- 172.21.15.81:0/3438022461 wait complete. 2024-05-08T20:56:34.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-05-08T20:56:34.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.951+0000 7f015eb74640 1 Processor -- start 2024-05-08T20:56:34.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 -- start start 2024-05-08T20:56:34.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f015806c500 0x7f015806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0158154c70 con 0x7f0158152100 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015806f710 con 0x7f015806c500 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015eb74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580aba40 con 0x7f015814edb0 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015d111640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f015806c500 0x7f015806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.81:42482/0 (socket says 172.21.15.81:42482) 2024-05-08T20:56:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 -- 172.21.15.81:0/332925611 learned_addr learned my addr 172.21.15.81:0/332925611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 -- 172.21.15.81:0/332925611 >> v2:172.21.15.117:3300/0 conn(0x7f015806c500 msgr2=0x7f015806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 --2- 172.21.15.81:0/332925611 >> v2:172.21.15.117:3300/0 conn(0x7f015806c500 0x7f015806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 -- 172.21.15.81:0/332925611 >> v1:172.21.15.117:6789/0 conn(0x7f0158152100 legacy=0x7f0158155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.955+0000 7f015c910640 1 -- 172.21.15.81:0/332925611 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01580abd20 con 0x7f015814edb0 2024-05-08T20:56:34.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015c910640 1 --2- 172.21.15.81:0/332925611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f015000d150 tx=0x7f015001eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa6ff667af89f6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:34.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f01577fe640 1 -- 172.21.15.81:0/332925611 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000b2d0 con 0x7f015814edb0 2024-05-08T20:56:34.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f01577fe640 1 -- 172.21.15.81:0/332925611 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f015000b430 con 0x7f015814edb0 2024-05-08T20:56:34.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f01577fe640 1 -- 172.21.15.81:0/332925611 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01500a7aa0 con 0x7f015814edb0 2024-05-08T20:56:34.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- 172.21.15.81:0/332925611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 msgr2=0x7f0158152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 --2- 172.21.15.81:0/332925611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f015000d150 tx=0x7f015001eba0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- 172.21.15.81:0/332925611 shutdown_connections 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 --2- 172.21.15.81:0/332925611 >> v2:172.21.15.117:3300/0 conn(0x7f015806c500 0x7f015806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 --2- 172.21.15.81:0/332925611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f0158152b70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- 172.21.15.81:0/332925611 >> 172.21.15.81:0/332925611 conn(0x7f01580c2d10 msgr2=0x7f01580c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- 172.21.15.81:0/332925611 shutdown_connections 2024-05-08T20:56:34.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- 172.21.15.81:0/332925611 wait complete. 2024-05-08T20:56:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 Processor -- start 2024-05-08T20:56:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.959+0000 7f015eb74640 1 -- start start 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f015814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0158152100 0x7f01581415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015814a560 con 0x7f015806c500 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015814ce20 con 0x7f0158152100 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015814a7b0 con 0x7f015814edb0 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60208/0 (socket says 172.21.15.81:60208) 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 -- 172.21.15.81:0/799706396 learned_addr learned my addr 172.21.15.81:0/799706396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:34.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f0157fff640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f015814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015d111640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0158152100 0x7f01581415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 -- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 msgr2=0x7f015814c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f015814c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 -- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0158152100 msgr2=0x7f01581415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0158152100 0x7f01581415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 -- 172.21.15.81:0/799706396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015000bd40 con 0x7f015806c500 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015c910640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01500b1040 tx=0x7f015001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150009800 con 0x7f015806c500 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0150009980 con 0x7f015806c500 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015814aa90 con 0x7f015806c500 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150009d50 con 0x7f015806c500 2024-05-08T20:56:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01581493e0 con 0x7f015806c500 2024-05-08T20:56:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158074950 con 0x7f015806c500 2024-05-08T20:56:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01500ba470 con 0x7f015806c500 2024-05-08T20:56:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 0x7f0144068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5861+0+0 (secure 0 0 0) 0x7f0150121e50 con 0x7f015806c500 2024-05-08T20:56:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.963+0000 7f0157fff640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 0x7f0144068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.967+0000 7f0157fff640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 0x7f0144068b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0158154480 tx=0x7f014c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:34.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:34.967+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f01500ef100 con 0x7f015806c500 2024-05-08T20:56:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.127+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f015814af40 con 0x7f015806c500 2024-05-08T20:56:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.763+0000 7f01557fa640 1 -- 172.21.15.81:0/799706396 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v31) v1 ==== 166+0+0 (secure 0 0 0) 0x7f015000b720 con 0x7f015806c500 2024-05-08T20:56:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'b_metadata' removed 2024-05-08T20:56:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 msgr2=0x7f0144068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 0x7f0144068b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0158154480 tx=0x7f014c009040 comp rx=0 tx=0).stop 2024-05-08T20:56:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 msgr2=0x7f015814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01500b1040 tx=0x7f015001b940 comp rx=0 tx=0).stop 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 shutdown_connections 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f01440666c0 0x7f0144068b80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0158152100 0x7f01581415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015814edb0 0x7f015814c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 --2- 172.21.15.81:0/799706396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f015806c500 0x7f015814d620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 >> 172.21.15.81:0/799706396 conn(0x7f01580c2d10 msgr2=0x7f01580713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 shutdown_connections 2024-05-08T20:56:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.771+0000 7f015eb74640 1 -- 172.21.15.81:0/799706396 wait complete. 2024-05-08T20:56:35.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-05-08T20:56:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 Processor -- start 2024-05-08T20:56:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 -- start start 2024-05-08T20:56:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f9806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f9806b3f0 0x7f4f9806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9806c610 con 0x7f4f9806be50 2024-05-08T20:56:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9806cb40 con 0x7f4f9806b3f0 2024-05-08T20:56:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9fa6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f98153530 con 0x7f4f9814ff30 2024-05-08T20:56:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9e007640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f9806be50 0x7f4f980ab5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46866/0 (socket says 172.21.15.81:46866) 2024-05-08T20:56:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d005640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f9806b3f0 0x7f4f9806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9e007640 1 -- 172.21.15.81:0/2607704774 learned_addr learned my addr 172.21.15.81:0/2607704774 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-05-08T20:56:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9c804640 1 -- 172.21.15.81:0/2607704774 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409415966 0 0) 0x7f4f9806c610 con 0x7f4f9806be50 2024-05-08T20:56:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9c804640 1 -- 172.21.15.81:0/2607704774 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f84003530 con 0x7f4f9806be50 2024-05-08T20:56:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d806640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f9806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d005640 1 -- 172.21.15.81:0/2607704774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 msgr2=0x7f4f9806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d005640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f9806f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d005640 1 -- 172.21.15.81:0/2607704774 >> v1:172.21.15.81:6789/0 conn(0x7f4f9806be50 legacy=0x7f4f980ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d005640 1 -- 172.21.15.81:0/2607704774 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98150310 con 0x7f4f9806b3f0 2024-05-08T20:56:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.919+0000 7f4f9d806640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f9806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806b3f0 0x7f4f9806cca0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f880097c0 tx=0x7f4f8801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91042ee58f375f22 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9c804640 1 -- 172.21.15.81:0/2607704774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880ac600 con 0x7f4f9806b3f0 2024-05-08T20:56:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9c804640 1 -- 172.21.15.81:0/2607704774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f880a8050 con 0x7f4f9806b3f0 2024-05-08T20:56:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9c804640 1 -- 172.21.15.81:0/2607704774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880ac9a0 con 0x7f4f9806b3f0 2024-05-08T20:56:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/2607704774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806b3f0 msgr2=0x7f4f9806cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806b3f0 0x7f4f9806cca0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f880097c0 tx=0x7f4f8801c380 comp rx=0 tx=0).stop 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/2607704774 shutdown_connections 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806b3f0 0x7f4f9806cca0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/2607704774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f9806f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/2607704774 >> 172.21.15.81:0/2607704774 conn(0x7f4f980c2d10 msgr2=0x7f4f980c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/2607704774 shutdown_connections 2024-05-08T20:56:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/2607704774 wait complete. 2024-05-08T20:56:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 Processor -- start 2024-05-08T20:56:35.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- start start 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9806b3f0 0x7f4f9814b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f981ee150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980c4270 con 0x7f4f9806be50 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981eeee0 con 0x7f4f9806b3f0 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9fa6a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980c23e0 con 0x7f4f9814ff30 2024-05-08T20:56:35.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60228/0 (socket says 172.21.15.81:60228) 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 -- 172.21.15.81:0/3513579099 learned_addr learned my addr 172.21.15.81:0/3513579099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 -- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 msgr2=0x7f4f981ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d806640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9806b3f0 0x7f4f9814b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f981ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 -- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9806b3f0 msgr2=0x7f4f9814b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9806b3f0 0x7f4f9814b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.923+0000 7f4f9d005640 1 -- 172.21.15.81:0/3513579099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88009420 con 0x7f4f9806be50 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9d005640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4f8801aa30 tx=0x7f4f88019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880b5410 con 0x7f4f9806be50 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4f880b5570 con 0x7f4f9806be50 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f980c2870 con 0x7f4f9806be50 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880b58e0 con 0x7f4f9806be50 2024-05-08T20:56:35.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f980c3f40 con 0x7f4f9806be50 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f980c21b0 con 0x7f4f9806be50 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f880b3040 con 0x7f4f9806be50 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 0x7f4f7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5433+0+0 (secure 0 0 0) 0x7f4f8811df80 con 0x7f4f9806be50 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9d806640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 0x7f4f7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.927+0000 7f4f9d806640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 0x7f4f7c068b50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006fd0 tx=0x7f4f94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:35.931+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4f8814fcf0 con 0x7f4f9806be50 2024-05-08T20:56:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.119+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4f98074950 con 0x7f4f9806be50 2024-05-08T20:56:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.771+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3513579099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v32) v1 ==== 154+0+0 (secure 0 0 0) 0x7f4f880b10c0 con 0x7f4f9806be50 2024-05-08T20:56:36.775 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'b_data' removed 2024-05-08T20:56:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 msgr2=0x7f4f7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 0x7f4f7c068b50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006fd0 tx=0x7f4f94008040 comp rx=0 tx=0).stop 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 msgr2=0x7f4f980c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4f8801aa30 tx=0x7f4f88019120 comp rx=0 tx=0).stop 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 shutdown_connections 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:6832/27511,v1:172.21.15.81:6833/27511] conn(0x7f4f7c066690 0x7f4f7c068b50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9814ff30 0x7f4f981ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9806be50 0x7f4f980c5880 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 --2- 172.21.15.81:0/3513579099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9806b3f0 0x7f4f9814b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 >> 172.21.15.81:0/3513579099 conn(0x7f4f980c2d10 msgr2=0x7f4f9814e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:36.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 shutdown_connections 2024-05-08T20:56:36.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T20:56:36.775+0000 7f4f9fa6a640 1 -- 172.21.15.81:0/3513579099 wait complete. 2024-05-08T20:56:36.800 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T20:56:36.801 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T20:56:36.801 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:36.811 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T20:56:36.811 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T20:56:36.811 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:36.863 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T20:56:36.864 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T20:56:36.864 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:36.882 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T20:56:36.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T20:56:36.883 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:36.943 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T20:56:36.944 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T20:56:36.944 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T20:56:36.944 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:42.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-08T20:56:43.046 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T20:56:43.046 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T20:56:43.046 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:48.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-08T20:56:48.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-08T20:56:49.148 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T20:56:49.148 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T20:56:49.148 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:49.237 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T20:56:49.238 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T20:56:49.238 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:49.338 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T20:56:49.338 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T20:56:49.338 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:54.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-08T20:56:54.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-08T20:56:55.440 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T20:56:55.440 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T20:56:55.440 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:55.517 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T20:56:55.518 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T20:56:55.518 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:56:59.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:59.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:00.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-08T20:57:00.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-08T20:57:01.619 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T20:57:01.620 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T20:57:01.620 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:05.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-08T20:57:05.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-08T20:57:07.722 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T20:57:07.722 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T20:57:07.723 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T20:57:07.723 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:07.753 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T20:57:07.754 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T20:57:07.754 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:07.784 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T20:57:07.784 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T20:57:07.784 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T20:57:07.784 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:07.811 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T20:57:07.812 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T20:57:07.812 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:07.847 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T20:57:07.847 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T20:57:07.847 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:57:07.911 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T20:57:07.912 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T20:57:07.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-08T20:57:08.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:57:08.046 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T20:57:08.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:57:08.433 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T20:57:08.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:57:08.702 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T20:57:08.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T20:57:08.923 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T20:57:09.166 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:57:09.167 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T20:57:09.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:57:09.588 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T20:57:09.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:57:09.824 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T20:57:10.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T20:57:10.044 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T20:57:10.269 INFO:tasks.ceph:Archiving mon data... 2024-05-08T20:57:10.271 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/data/mon.a.tgz 2024-05-08T20:57:10.271 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-05-08T20:57:10.299 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.pxVCchBy1W 2024-05-08T20:57:10.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pxVCchBy1W 2024-05-08T20:57:10.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.pxVCchBy1W 2024-05-08T20:57:10.548 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.pxVCchBy1W is 451KB 2024-05-08T20:57:10.611 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.pxVCchBy1W 2024-05-08T20:57:10.617 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/data/mon.b.tgz 2024-05-08T20:57:10.617 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-08T20:57:10.631 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.kXjnTsZF2F 2024-05-08T20:57:10.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kXjnTsZF2F 2024-05-08T20:57:10.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.kXjnTsZF2F 2024-05-08T20:57:10.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-08T20:57:10.912 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.kXjnTsZF2F is 461KB 2024-05-08T20:57:10.973 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.kXjnTsZF2F 2024-05-08T20:57:10.979 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/data/mon.c.tgz 2024-05-08T20:57:10.979 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-08T20:57:11.029 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.ZWsPFDTorx 2024-05-08T20:57:11.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZWsPFDTorx 2024-05-08T20:57:11.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.ZWsPFDTorx 2024-05-08T20:57:11.244 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.ZWsPFDTorx is 464KB 2024-05-08T20:57:11.306 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.ZWsPFDTorx 2024-05-08T20:57:11.311 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T20:57:11.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T20:57:11.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T20:57:11.368 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T20:57:11.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T20:57:11.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T20:57:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T20:57:11.448 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T20:57:11.452 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T20:57:11.454 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi081/crash 2024-05-08T20:57:11.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T20:57:11.466 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi117/crash 2024-05-08T20:57:11.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T20:57:11.505 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T20:57:11.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:11.511 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:11.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:11.596 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:11.635 INFO:tasks.ceph:Compressing logs... 2024-05-08T20:57:11.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:57:11.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:02:33.506 INFO:tasks.ceph:Archiving logs... 2024-05-08T21:02:33.506 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi081/log 2024-05-08T21:02:33.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:03:00.809 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi117/log 2024-05-08T21:03:00.810 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:03:26.271 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T21:03:26.281 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T21:03:26.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:03:26.284 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:03:26.449 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T21:03:26.459 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T21:03:26.459 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:03:26.462 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:03:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T21:03:26.498 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-05-08T21:03:26.498 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.135 -3.893 0.622 2024-05-08T21:03:26.498 INFO:teuthology.orchestra.run.smithi081.stdout:*hv02.front.sepi 63.231.80.2 3 u 18 64 377 0.096 -0.739 0.530 2024-05-08T21:03:26.499 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.100 -1.761 0.591 2024-05-08T21:03:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.089 -3.667 0.492 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.097 -1.104 0.360 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout:*hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.097 -2.913 0.384 2024-05-08T21:03:26.510 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-05-08T21:03:26.511 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T21:03:26.521 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T21:03:26.522 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T21:03:26.534 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T21:03:26.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T21:03:26.555 INFO:teuthology.task.internal:Duration was 2873.000856 seconds 2024-05-08T21:03:26.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T21:03:26.566 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T21:03:26.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:03:26.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:03:26.790 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T21:03:26.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T21:03:26.790 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:03:26.800 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-05-08T21:03:26.801 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:03:26.811 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T21:03:26.811 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:03:26.846 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:03:26.889 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T21:03:26.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:03:26.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:03:27.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T21:03:27.133 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T21:03:27.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:03:27.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:03:27.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T21:03:27.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:03:27.206 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:03:27.229 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-05-08T21:03:27.259 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-05-08T21:03:27.287 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:03:27.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:03:27.291 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:03:27.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:03:27.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T21:03:27.347 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T21:03:27.348 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi081 2024-05-08T21:03:27.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:03:27.369 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698003/remote/smithi117 2024-05-08T21:03:27.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:03:27.400 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T21:03:27.400 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:03:27.410 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:03:27.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T21:03:27.455 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T21:03:27.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T21:03:27.465 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T21:03:27.465 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:03:27.468 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:03:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: 658468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:03 /home/ubuntu/cephtest 2024-05-08T21:03:27.492 INFO:teuthology.orchestra.run.smithi117.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:03 /home/ubuntu/cephtest 2024-05-08T21:03:27.493 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T21:03:27.504 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T21:03:27.588 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 2873.000855922699 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T21:03:27.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:03:27.672 INFO:teuthology.run:pass